2024-04-03T08:08:16.629 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-03T08:08:16.629 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921 --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_vshankar@teuthology --verbose --name vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/orig.config.yaml 2024-04-03T08:08:16.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:08:16.785 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7637921' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip_fs_upgrade_c8 sha1: 2be5a1775aca69fcf233a1e71f017149db5077bf owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 7030 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 subset: 717/1024 suite: fs:upgrade:mds_upgrade_sequence suite_branch: wip_fs_upgrade_c8 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_2be5a1775aca69fcf233a1e71f017149db5077bf/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: 2be5a1775aca69fcf233a1e71f017149db5077bf targets: smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIj5vXcXyW7p+hNPMfWUxE7HyjmtTgUmtfv7OAnm2Jz8+AN/+pMFOJj28v1vv8oxsYsXbcDe78jT1MPuZLbTBtg= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJu/VFx99Ln1VySKzZO/HcE2aHlQYZ5as7hZCrEudGbAjylst+jKr/xr2H6OmdVgfoy6yjMuRrSFLoDbwvxEuA= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/vshankar/src/github.com_vshankar_ceph_wip_fs_upgrade_c8/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-03_07:59:51 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-03T08:08:16.785 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_2be5a1775aca69fcf233a1e71f017149db5077bf/qa; will attempt to use it 2024-04-03T08:08:16.786 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_2be5a1775aca69fcf233a1e71f017149db5077bf/qa/tasks 2024-04-03T08:08:16.786 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-03T08:08:16.787 INFO:teuthology.task.internal:Checking packages... 2024-04-03T08:08:16.815 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-04-03T08:08:16.816 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:08:16.816 INFO:teuthology.packaging:ref: None 2024-04-03T08:08:16.816 INFO:teuthology.packaging:tag: None 2024-04-03T08:08:16.816 INFO:teuthology.packaging:branch: main 2024-04-03T08:08:16.816 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:08:16.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2024-04-03T08:08:17.058 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2592.gd7e176b4 2024-04-03T08:08:17.059 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-03T08:08:17.066 INFO:teuthology.task.internal:no buildpackages task found 2024-04-03T08:08:17.066 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-03T08:08:17.088 INFO:teuthology.task.internal:Saving configuration 2024-04-03T08:08:17.108 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-03T08:08:17.114 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-03T08:08:17.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-03 08:02:23.897196', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIj5vXcXyW7p+hNPMfWUxE7HyjmtTgUmtfv7OAnm2Jz8+AN/+pMFOJj28v1vv8oxsYsXbcDe78jT1MPuZLbTBtg='} 2024-04-03T08:08:17.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-03 08:02:23.895434', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJu/VFx99Ln1VySKzZO/HcE2aHlQYZ5as7hZCrEudGbAjylst+jKr/xr2H6OmdVgfoy6yjMuRrSFLoDbwvxEuA='} 2024-04-03T08:08:17.161 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-03T08:08:17.167 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-03T08:08:17.167 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-03T08:08:17.168 INFO:teuthology.run_tasks:Running task console_log... 2024-04-03T08:08:17.272 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99655ae160>, signals=[15]) 2024-04-03T08:08:17.274 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-03T08:08:17.279 INFO:teuthology.task.internal:Opening connections... 2024-04-03T08:08:17.280 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:08:17.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:08:17.362 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-04-03T08:08:17.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:08:17.438 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-03T08:08:17.445 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-04-03T08:08:17.467 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-04-03T08:08:17.467 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-04-03T08:08:17.527 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-04-03T08:08:17.527 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2024-04-03T08:08:17.527 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-04-03T08:08:17.527 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-03T08:08:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-03T08:08:17.529 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-04-03T08:08:17.553 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-04-03T08:08:17.575 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-04-03T08:08:17.576 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-04-03T08:08:17.637 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-03T08:08:17.638 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-03T08:08:17.639 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-03T08:08:17.639 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-04-03T08:08:17.661 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-03T08:08:17.673 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-03T08:08:17.705 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-03T08:08:17.705 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-04-03T08:08:17.708 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-04-03T08:08:17.728 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-03T08:08:17.734 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-03T08:08:17.734 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-04-03T08:08:17.770 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-04-03T08:08:17.803 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-03T08:08:17.860 INFO:teuthology.run_tasks:Running task kernel... 2024-04-03T08:08:17.920 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-04-03T08:08:17.920 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-04-03T08:08:17.921 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-03T08:08:17.921 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-03T08:08:17.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T08:08:17.942 DEBUG:teuthology.task.kernel:sha1 for host.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:08:17.942 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-03T08:08:17.942 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-04-03T08:08:17.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T08:08:17.943 DEBUG:teuthology.task.kernel:sha1 for host.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:08:17.943 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-03T08:08:17.943 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-04-03T08:08:18.004 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-489.el8.x86_64 2024-04-03T08:08:18.004 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:08:18.004 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-03T08:08:18.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:08:18.008 INFO:teuthology.orchestra.run.smithi181.stdout:4.18.0-489.el8.x86_64 2024-04-03T08:08:18.008 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:08:18.008 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-03T08:08:18.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:08:18.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum upgrade -y linux-firmware 2024-04-03T08:08:18.158 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum upgrade -y linux-firmware 2024-04-03T08:08:23.835 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - AppStream 8.8 MB/s | 28 MB 00:03 2024-04-03T08:08:23.900 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - AppStream 8.7 MB/s | 28 MB 00:03 2024-04-03T08:08:30.152 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - BaseOS 8.0 MB/s | 10 MB 00:01 2024-04-03T08:08:30.184 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - BaseOS 8.0 MB/s | 10 MB 00:01 2024-04-03T08:08:32.019 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - Extras 64 kB/s | 18 kB 00:00 2024-04-03T08:08:32.067 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras 74 kB/s | 18 kB 00:00 2024-04-03T08:08:32.362 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - Extras common packages 32 kB/s | 7.5 kB 00:00 2024-04-03T08:08:32.551 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 7.5 kB 00:00 2024-04-03T08:08:32.629 INFO:teuthology.orchestra.run.smithi181.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-04-03T08:08:32.853 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-04-03T08:08:35.764 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 16 MB 00:03 2024-04-03T08:08:39.538 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 431 kB/s | 24 kB 00:00 2024-04-03T08:08:42.706 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:08:42.706 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:08:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-04-03T08:08:42.706 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 1 Package 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:08:42.707 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 355 M 2024-04-03T08:08:42.708 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:08:49.913 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 982 kB/s | 16 MB 00:16 2024-04-03T08:08:53.643 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 411 kB/s | 24 kB 00:00 2024-04-03T08:08:56.555 INFO:teuthology.orchestra.run.smithi181.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 26 MB/s | 355 MB 00:13 2024-04-03T08:08:56.555 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:08:56.555 INFO:teuthology.orchestra.run.smithi181.stdout:Total 26 MB/s | 355 MB 00:13 2024-04-03T08:08:56.814 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 1 Package 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 355 M 2024-04-03T08:08:56.815 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:08:58.656 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:08:58.726 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:08:58.726 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:09:00.904 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:09:00.931 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:09:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 25 MB/s | 355 MB 00:14 2024-04-03T08:09:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:09:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:Total 25 MB/s | 355 MB 00:14 2024-04-03T08:09:13.318 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:09:13.393 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:09:13.393 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:09:15.597 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:09:15.621 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:09:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:09:24.135 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-04-03T08:09:24.365 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-03T08:09:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-03T08:09:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-04-03T08:09:25.109 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-03T08:09:25.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:09:25.110 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-04-03T08:09:25.110 INFO:teuthology.orchestra.run.smithi181.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-04-03T08:09:25.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:09:25.110 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:09:25.305 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on host.b... 2024-04-03T08:09:25.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:09:25.600 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/ 2024-04-03T08:09:25.601 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/ --input-file=- 2024-04-03T08:09:25.603 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi181.front.sepia.ceph.com to complete... 2024-04-03T08:09:38.493 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:09:38.864 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-04-03T08:09:39.125 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-03T08:09:39.358 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-03T08:09:39.358 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-04-03T08:09:39.807 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-03T08:09:39.807 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:09:39.807 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-04-03T08:09:39.808 INFO:teuthology.orchestra.run.smithi157.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-04-03T08:09:39.808 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:09:39.808 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:09:40.000 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on host.a... 2024-04-03T08:09:40.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-03T08:09:40.151 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/ 2024-04-03T08:09:40.151 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/ --input-file=- 2024-04-03T08:09:40.153 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi157.front.sepia.ceph.com to complete... 2024-04-03T08:09:45.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03 08:09:45 URL:https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [401601944/401601944] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-03T08:09:45.086 INFO:teuthology.orchestra.run.smithi181.stderr:FINISHED --2024-04-03 08:09:45-- 2024-04-03T08:09:45.086 INFO:teuthology.orchestra.run.smithi181.stderr:Total wall clock time: 19s 2024-04-03T08:09:45.086 INFO:teuthology.orchestra.run.smithi181.stderr:Downloaded: 1 files, 383M in 19s (20.1 MB/s) 2024-04-03T08:09:45.090 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on host.b... 2024-04-03T08:09:45.091 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-03T08:09:46.834 INFO:teuthology.orchestra.run.smithi181.stdout:Verifying... ######################################## 2024-04-03T08:09:46.879 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing... ######################################## 2024-04-03T08:09:46.990 INFO:teuthology.orchestra.run.smithi181.stdout:Updating / installing... 2024-04-03T08:10:02.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03 08:10:02 URL:https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [401601944/401601944] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-03T08:10:02.323 INFO:teuthology.orchestra.run.smithi157.stderr:FINISHED --2024-04-03 08:10:02-- 2024-04-03T08:10:02.323 INFO:teuthology.orchestra.run.smithi157.stderr:Total wall clock time: 22s 2024-04-03T08:10:02.323 INFO:teuthology.orchestra.run.smithi157.stderr:Downloaded: 1 files, 383M in 22s (17.5 MB/s) 2024-04-03T08:10:02.326 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on host.a... 2024-04-03T08:10:02.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-03T08:10:04.118 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying... ######################################## 2024-04-03T08:10:04.162 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing... ######################################## 2024-04-03T08:10:04.271 INFO:teuthology.orchestra.run.smithi157.stdout:Updating / installing... 2024-04-03T08:10:27.385 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-03T08:10:30.400 INFO:teuthology.orchestra.run.smithi181.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-03T08:10:44.604 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-03T08:10:45.989 INFO:teuthology.orchestra.run.smithi157.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-03T08:10:50.459 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-03T08:10:50.459 DEBUG:teuthology.orchestra.run.smithi181:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-03T08:10:50.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-03T08:10:50.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-03T08:10:50.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-03T08:10:50.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-03T08:10:50.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-03T08:10:50.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-03T08:10:50.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-03T08:10:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-03T08:10:50.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-03T08:10:50.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-03T08:10:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-03T08:10:50.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-03T08:10:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-03T08:10:50.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-03T08:10:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-03T08:10:50.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-03T08:10:50.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-03T08:10:50.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-03T08:10:50.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-03T08:10:50.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-03T08:10:50.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-03T08:10:50.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-03T08:10:50.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-03T08:10:50.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-03T08:10:50.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-03T08:10:50.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-03T08:10:50.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-03T08:10:50.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-03T08:10:50.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-03T08:10:50.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-03T08:10:50.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-03T08:10:50.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-03T08:10:50.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-03T08:10:50.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-03T08:10:50.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-03T08:10:50.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-03T08:10:50.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-03T08:10:50.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-03T08:10:50.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-03T08:10:50.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-03T08:10:50.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-03T08:10:50.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-03T08:10:50.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-03T08:10:50.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-03T08:10:50.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-03T08:10:50.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-03T08:10:50.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-03T08:10:50.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-03T08:10:50.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-03T08:10:50.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-03T08:10:50.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-03T08:10:50.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-03T08:10:50.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-03T08:10:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-03T08:10:50.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-03T08:10:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-03T08:10:50.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-03T08:10:50.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-03T08:10:50.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-03T08:10:50.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-03T08:10:50.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-03T08:10:50.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-03T08:10:50.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-03T08:10:50.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-03T08:10:50.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-03T08:10:50.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-03T08:10:50.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-03T08:10:50.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-03T08:10:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-03T08:10:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-03T08:10:50.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-03T08:10:50.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-03T08:10:50.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-03T08:10:50.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-03T08:10:50.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-03T08:10:50.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-03T08:10:50.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-03T08:10:50.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-03T08:10:50.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-03T08:10:50.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-03T08:10:50.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-03T08:10:50.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-03T08:10:50.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-03T08:10:50.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-03T08:10:50.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-03T08:10:50.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-03T08:10:50.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-03T08:10:50.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-03T08:10:50.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-03T08:10:50.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-03T08:10:50.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-03T08:10:50.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-03T08:10:50.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-03T08:10:50.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-03T08:10:50.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-03T08:10:50.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-03T08:10:50.659 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-03T08:10:50.660 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-03T08:10:50.661 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-03T08:10:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-03T08:10:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-03T08:10:50.664 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-03T08:10:50.665 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-03T08:10:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-03T08:10:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-03T08:10:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-03T08:10:50.669 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-03T08:10:50.670 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-03T08:10:50.671 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-03T08:10:50.672 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-03T08:10:50.673 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-03T08:10:50.674 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-03T08:10:50.675 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-03T08:10:50.676 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-03T08:10:50.677 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-03T08:10:50.678 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-03T08:10:50.679 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-03T08:10:50.680 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-03T08:10:50.681 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-03T08:10:50.682 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-03T08:10:50.683 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-03T08:10:50.684 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-03T08:10:50.685 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-03T08:10:50.686 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-03T08:10:50.687 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-03T08:10:50.688 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-03T08:10:50.689 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-03T08:10:50.690 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-03T08:10:50.691 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-03T08:10:50.692 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-03T08:10:50.693 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-03T08:10:50.694 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-03T08:10:50.695 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-03T08:10:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-03T08:10:50.697 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-03T08:10:50.698 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-03T08:10:50.699 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-03T08:10:50.700 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-03T08:10:50.701 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-03T08:10:50.705 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-03T08:10:50.705 DEBUG:teuthology.orchestra.run.smithi181:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout:postinstall scriptlet (using /bin/sh): 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout:for file in vmlinuz System.map config; do 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-03T08:10:50.730 INFO:teuthology.orchestra.run.smithi181.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout: fi 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-03T08:10:50.731 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-04-03T08:10:50.732 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.02 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 129.el8 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Group : System Environment/Base 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 9265586 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-04-03T08:10:50.811 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Relocations : (not relocatable) 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : CentOS BuildSystem 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:10:50.812 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-04-03T08:10:50.813 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-03T08:10:50.813 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 6.8.0-g1df0c7e8a235 2024-04-03T08:10:50.814 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-03T08:10:56.153 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-04-03T08:10:58.759 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-04-03T08:10:58.761 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-04-03T08:10:58.787 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.JuUjv4UyRd 2024-04-03T08:10:58.787 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JuUjv4UyRd 2024-04-03T08:10:58.861 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.JuUjv4UyRd 2024-04-03T08:10:59.048 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.JuUjv4UyRd is 6KB 2024-04-03T08:10:59.095 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.JuUjv4UyRd 2024-04-03T08:10:59.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-04-03T08:10:59.192 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-03T08:10:59.192 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-03T08:10:59.192 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-03T08:10:59.192 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-6.8.0-g1df0c7e8a235.conf 2024-04-03T08:10:59.193 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.8.0-g1df0c7e8a235 2024-04-03T08:10:59.404 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-04-03T08:11:08.114 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-03T08:11:08.115 DEBUG:teuthology.orchestra.run.smithi157:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-03T08:11:08.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-03T08:11:08.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-03T08:11:08.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-03T08:11:08.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-03T08:11:08.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-03T08:11:08.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-03T08:11:08.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-03T08:11:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-03T08:11:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-03T08:11:08.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-03T08:11:08.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-03T08:11:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-03T08:11:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-03T08:11:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-03T08:11:08.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-03T08:11:08.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-03T08:11:08.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-03T08:11:08.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-03T08:11:08.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-03T08:11:08.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-03T08:11:08.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-03T08:11:08.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-03T08:11:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-03T08:11:08.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-03T08:11:08.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-03T08:11:08.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-03T08:11:08.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-03T08:11:08.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-03T08:11:08.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-03T08:11:08.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-03T08:11:08.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-03T08:11:08.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-03T08:11:08.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-03T08:11:08.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-03T08:11:08.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-03T08:11:08.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-03T08:11:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-03T08:11:08.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-03T08:11:08.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-03T08:11:08.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-03T08:11:08.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-03T08:11:08.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-03T08:11:08.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-03T08:11:08.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-03T08:11:08.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-03T08:11:08.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-03T08:11:08.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-03T08:11:08.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-03T08:11:08.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-03T08:11:08.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-03T08:11:08.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-03T08:11:08.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-03T08:11:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-03T08:11:08.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-03T08:11:08.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-03T08:11:08.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-03T08:11:08.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-03T08:11:08.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-03T08:11:08.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-03T08:11:08.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-03T08:11:08.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-03T08:11:08.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-03T08:11:08.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-03T08:11:08.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-03T08:11:08.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-03T08:11:08.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-03T08:11:08.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-03T08:11:08.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-03T08:11:08.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-03T08:11:08.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-03T08:11:08.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-03T08:11:08.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-03T08:11:08.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-03T08:11:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-03T08:11:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-03T08:11:08.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-03T08:11:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-03T08:11:08.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-03T08:11:08.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-03T08:11:08.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-03T08:11:08.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-03T08:11:08.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-03T08:11:08.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-03T08:11:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-03T08:11:08.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-03T08:11:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-03T08:11:08.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-03T08:11:08.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-03T08:11:08.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-03T08:11:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-03T08:11:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-03T08:11:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-03T08:11:08.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-03T08:11:08.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-03T08:11:08.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-03T08:11:08.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-03T08:11:08.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-03T08:11:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-03T08:11:08.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-03T08:11:08.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-03T08:11:08.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-03T08:11:08.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-03T08:11:08.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-03T08:11:08.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-03T08:11:08.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-03T08:11:08.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-03T08:11:08.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-03T08:11:08.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-03T08:11:08.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-03T08:11:08.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-03T08:11:08.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-03T08:11:08.280 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-03T08:11:08.281 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-03T08:11:08.282 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-03T08:11:08.283 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-03T08:11:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-03T08:11:08.285 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-03T08:11:08.286 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-03T08:11:08.287 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-03T08:11:08.288 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-03T08:11:08.289 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-03T08:11:08.290 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-03T08:11:08.291 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-03T08:11:08.292 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-03T08:11:08.293 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-03T08:11:08.294 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-03T08:11:08.295 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-03T08:11:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-03T08:11:08.297 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-03T08:11:08.298 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-03T08:11:08.299 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-03T08:11:08.300 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-03T08:11:08.301 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-03T08:11:08.302 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-03T08:11:08.303 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-03T08:11:08.303 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-03T08:11:08.303 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-03T08:11:08.303 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-03T08:11:08.303 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-03T08:11:08.304 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-03T08:11:08.305 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-03T08:11:08.306 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-03T08:11:08.307 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-03T08:11:08.308 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-03T08:11:08.309 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-03T08:11:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-03T08:11:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-03T08:11:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-03T08:11:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-03T08:11:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-03T08:11:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-03T08:11:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-03T08:11:08.315 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-03T08:11:08.316 DEBUG:teuthology.orchestra.run.smithi157:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-03T08:11:08.341 INFO:teuthology.orchestra.run.smithi157.stdout:postinstall scriptlet (using /bin/sh): 2024-04-03T08:11:08.341 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-03T08:11:08.341 INFO:teuthology.orchestra.run.smithi157.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-03T08:11:08.341 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:for file in vmlinuz System.map config; do 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout: fi 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-03T08:11:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-03T08:11:08.343 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-03T08:11:08.343 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-04-03T08:11:08.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2024-04-03T08:11:08.417 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2024-04-03T08:11:08.417 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2024-04-03T08:11:08.417 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.02 2024-04-03T08:11:08.417 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 129.el8 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Group : System Environment/Base 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 9265586 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Relocations : (not relocatable) 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : CentOS BuildSystem 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-03T08:11:08.418 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:11:08.419 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2024-04-03T08:11:08.420 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-03T08:11:08.420 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 6.8.0-g1df0c7e8a235 2024-04-03T08:11:08.420 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-03T08:11:12.636 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-04-03T08:11:14.875 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-04-03T08:11:14.877 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-03T08:11:14.901 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.hicys9ipLe 2024-04-03T08:11:14.901 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hicys9ipLe 2024-04-03T08:11:14.975 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.hicys9ipLe 2024-04-03T08:11:15.150 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.hicys9ipLe is 6KB 2024-04-03T08:11:15.198 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.hicys9ipLe 2024-04-03T08:11:15.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2024-04-03T08:11:15.281 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-03T08:11:15.282 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-03T08:11:15.282 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-03T08:11:15.282 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-6.8.0-g1df0c7e8a235.conf 2024-04-03T08:11:15.283 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.8.0-g1df0c7e8a235 2024-04-03T08:11:15.460 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-04-03T08:11:29.418 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-03T08:11:29.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-03T08:11:29.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:11:45.473 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-03T08:11:45.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-03T08:11:45.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:12:29.465 DEBUG:teuthology.orchestra.remote:timed out 2024-04-03T08:12:38.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-03T08:12:38.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:12:41.903 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-04-03T08:12:42.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-03T08:12:42.479 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.8.0-g1df0c7e8a235"... 2024-04-03T08:12:42.480 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-04-03T08:12:42.523 INFO:teuthology.orchestra.run.smithi181.stdout:6.8.0-g1df0c7e8a235 2024-04-03T08:12:42.523 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-03T08:12:42.523 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-03T08:12:42.523 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-03T08:12:43.524 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-03T08:12:43.524 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-03T08:12:43.670 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-04-03T08:12:43.697 DEBUG:teuthology.parallel:result is None 2024-04-03T08:12:45.476 DEBUG:teuthology.orchestra.remote:timed out 2024-04-03T08:12:54.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-03T08:12:54.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:13:12.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-03T08:13:24.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-03T08:13:24.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:13:25.334 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-03T08:13:25.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-03T08:13:25.707 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.8.0-g1df0c7e8a235"... 2024-04-03T08:13:25.707 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-04-03T08:13:25.750 INFO:teuthology.orchestra.run.smithi157.stdout:6.8.0-g1df0c7e8a235 2024-04-03T08:13:25.750 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-03T08:13:25.750 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-03T08:13:25.750 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-03T08:13:26.751 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-03T08:13:26.751 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-03T08:13:26.885 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-04-03T08:13:26.909 DEBUG:teuthology.parallel:result is None 2024-04-03T08:13:26.910 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-03T08:13:26.917 INFO:teuthology.task.internal:Creating test directory... 2024-04-03T08:13:26.917 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-03T08:13:26.921 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-03T08:13:26.973 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-03T08:13:26.980 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-03T08:13:27.001 INFO:teuthology.task.internal:Creating archive directory... 2024-04-03T08:13:27.001 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-03T08:13:27.010 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-03T08:13:27.079 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-03T08:13:27.086 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-03T08:13:27.087 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-03T08:13:27.090 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-03T08:13:27.174 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T08:13:27.179 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T08:13:27.199 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T08:13:27.204 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T08:13:27.210 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-03T08:13:27.217 INFO:teuthology.task.internal:Configuring sudo... 2024-04-03T08:13:27.217 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-03T08:13:27.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-03T08:13:27.288 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-03T08:13:27.297 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-03T08:13:27.298 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-03T08:13:27.302 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-03T08:13:27.345 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-03T08:13:27.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-03T08:13:27.544 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-03T08:13:27.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-03T08:13:27.702 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:13:27.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-03T08:13:27.768 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-03T08:13:27.836 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-03T08:13:27.909 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-03T08:13:27.979 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-03T08:13:28.045 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:13:28.045 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-03T08:13:28.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-04-03T08:13:28.115 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-04-03T08:13:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-03T08:13:28.280 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-03T08:13:28.625 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-03T08:13:28.633 INFO:teuthology.task.internal:Starting timer... 2024-04-03T08:13:28.633 INFO:teuthology.run_tasks:Running task pcp... 2024-04-03T08:13:28.676 INFO:teuthology.run_tasks:Running task selinux... 2024-04-03T08:13:28.705 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-03T08:13:28.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-04-03T08:13:28.807 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-04-03T08:13:28.810 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-04-03T08:13:28.928 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-04-03T08:13:28.932 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-03T08:13:28.932 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-04-03T08:13:28.983 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-04-03T08:13:28.984 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-04-03T08:13:29.037 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-04-03T08:13:29.037 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-04-03T08:13:29.038 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-03T08:13:29.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T08:13:29.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-03T08:13:29.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T08:13:29.174 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-03T08:13:29.175 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-04-03T08:13:29.267 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-04-03T08:13:29.336 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-03T08:13:29.348 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-03T08:13:29.355 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-03T08:13:29.497 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-03T08:13:29.512 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-03T08:13:29.513 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-03T08:20:40.644 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-04-03T08:20:40.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-03T08:20:40.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:20:40.736 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-03T08:20:40.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-03T08:20:40.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-03T08:20:40.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T08:20:40.944 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-04-03T08:20:41.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-03T08:20:41.062 INFO:teuthology.run_tasks:Running task clock... 2024-04-03T08:20:41.080 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-03T08:20:41.080 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-03T08:20:41.081 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T08:20:41.085 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-03T08:20:41.085 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T08:20:41.153 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-03T08:20:41.173 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-03T08:20:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-03T08:20:41.204 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-03T08:20:41.275 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-04-03T08:20:41.290 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-04-03T08:20:41.301 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-04-03T08:20:41.316 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-04-03T08:20:41.333 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-03T08:20:41.347 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-03T08:20:41.364 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-03T08:20:41.378 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-03T08:20:41.449 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2024-04-03T08:20:41.456 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-03T08:20:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-04-03T08:20:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.461 INFO:teuthology.orchestra.run.smithi181.stderr:bash: ntpq: command not found 2024-04-03T08:20:41.467 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-03T08:20:41.468 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-04-03T08:20:41.468 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.468 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.468 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.468 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T08:20:41.469 INFO:teuthology.run_tasks:Running task pexec... 2024-04-03T08:20:41.479 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-03T08:20:41.479 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:20:41.480 DEBUG:teuthology.orchestra.run.smithi157:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-03T08:20:41.480 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi181.front.sepia.ceph.com 2024-04-03T08:20:41.480 DEBUG:teuthology.orchestra.run.smithi181:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-03T08:20:42.408 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:42 ago on Wed 03 Apr 2024 08:19:00 AM UTC. 2024-04-03T08:20:42.409 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:41 ago on Wed 03 Apr 2024 08:19:01 AM UTC. 2024-04-03T08:20:44.598 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:20:44.599 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout:Resetting modules: 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:20:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:44.722 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout:Resetting modules: 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: container-tools 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:20:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:20:44.911 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:20:45.019 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:20:45.921 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:45 ago on Wed 03 Apr 2024 08:19:00 AM UTC. 2024-04-03T08:20:46.044 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:44 ago on Wed 03 Apr 2024 08:19:01 AM UTC. 2024-04-03T08:20:48.069 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:20:48.108 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:20:48.108 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout:Installing group/module packages: 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-03T08:20:48.109 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout:Installing module profiles: 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools/common 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools rhel8 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2024-04-03T08:20:48.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:48.111 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 27 M 2024-04-03T08:20:48.111 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 91 M 2024-04-03T08:20:48.111 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:20:48.235 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:20:48.275 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout:Installing group/module packages: 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-03T08:20:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout:Installing module profiles: 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: container-tools/common 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout:Enabling module streams: 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: container-tools rhel8 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:20:48.277 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:20:48.278 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:20:48.278 INFO:teuthology.orchestra.run.smithi181.stdout:Install 13 Packages 2024-04-03T08:20:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:20:48.278 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 27 M 2024-04-03T08:20:48.278 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 91 M 2024-04-03T08:20:48.278 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:20:49.208 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 661 kB/s | 689 kB 00:01 2024-04-03T08:20:49.275 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 929 kB/s | 1.0 MB 00:01 2024-04-03T08:20:49.467 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 147 kB/s | 38 kB 00:00 2024-04-03T08:20:49.568 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 882 kB/s | 258 kB 00:00 2024-04-03T08:20:49.617 INFO:teuthology.orchestra.run.smithi181.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 636 kB/s | 689 kB 00:01 2024-04-03T08:20:49.726 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 1.1 MB/s | 180 kB 00:00 2024-04-03T08:20:49.766 INFO:teuthology.orchestra.run.smithi181.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 253 kB/s | 38 kB 00:00 2024-04-03T08:20:49.800 INFO:teuthology.orchestra.run.smithi181.stdout:(3/13): aardvark-dns-1.10.0-1.module_el8+871+55 813 kB/s | 1.0 MB 00:01 2024-04-03T08:20:49.877 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 165 kB/s | 25 kB 00:00 2024-04-03T08:20:50.027 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 626 kB/s | 94 kB 00:00 2024-04-03T08:20:50.067 INFO:teuthology.orchestra.run.smithi181.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 859 kB/s | 258 kB 00:00 2024-04-03T08:20:50.467 INFO:teuthology.orchestra.run.smithi181.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 451 kB/s | 180 kB 00:00 2024-04-03T08:20:50.618 INFO:teuthology.orchestra.run.smithi181.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 165 kB/s | 25 kB 00:00 2024-04-03T08:20:50.794 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): buildah-1.33.6-2.module_el8+976+1136073 3.7 MB/s | 9.6 MB 00:02 2024-04-03T08:20:50.853 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): netavark-1.10.3-1.module_el8+951+32019c 3.0 MB/s | 4.1 MB 00:01 2024-04-03T08:20:51.026 INFO:teuthology.orchestra.run.smithi181.stdout:(7/13): netavark-1.10.3-1.module_el8+951+32019c 3.3 MB/s | 4.1 MB 00:01 2024-04-03T08:20:51.052 INFO:teuthology.orchestra.run.smithi181.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 217 kB/s | 94 kB 00:00 2024-04-03T08:20:51.121 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 196 kB/s | 53 kB 00:00 2024-04-03T08:20:51.270 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 277 kB/s | 41 kB 00:00 2024-04-03T08:20:51.320 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 4.8 MB/s | 2.5 MB 00:00 2024-04-03T08:20:51.735 INFO:teuthology.orchestra.run.smithi181.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 3.0 MB/s | 9.6 MB 00:03 2024-04-03T08:20:51.787 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 5.0 MB/s | 8.8 MB 00:01 2024-04-03T08:20:51.788 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:20:51.788 INFO:teuthology.orchestra.run.smithi157.stdout:Total 7.5 MB/s | 27 MB 00:03 2024-04-03T08:20:51.886 INFO:teuthology.orchestra.run.smithi181.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 351 kB/s | 53 kB 00:00 2024-04-03T08:20:52.196 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:20:52.222 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:20:52.222 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:20:52.228 INFO:teuthology.orchestra.run.smithi181.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 120 kB/s | 41 kB 00:00 2024-04-03T08:20:52.506 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:20:52.507 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:20:52.637 INFO:teuthology.orchestra.run.smithi181.stdout:(12/13): skopeo-1.14.3-0.1.module_el8+885+7da14 5.5 MB/s | 8.8 MB 00:01 2024-04-03T08:20:52.786 INFO:teuthology.orchestra.run.smithi181.stdout:(13/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 1.5 MB/s | 2.5 MB 00:01 2024-04-03T08:20:52.787 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:20:52.787 INFO:teuthology.orchestra.run.smithi181.stdout:Total 6.1 MB/s | 27 MB 00:04 2024-04-03T08:20:53.180 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:20:53.203 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:20:53.228 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:20:53.228 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:20:53.503 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:20:53.507 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:20:54.183 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-03T08:20:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:20:54.394 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-03T08:20:54.571 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-03T08:20:54.800 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-03T08:20:55.050 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-03T08:20:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-03T08:20:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-03T08:20:55.586 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-03T08:20:55.633 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-03T08:20:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-03T08:20:56.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-03T08:20:56.590 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-03T08:20:56.696 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-03T08:20:56.963 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-03T08:20:57.219 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-03T08:20:57.615 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-03T08:20:57.672 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-03T08:20:57.829 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-03T08:20:57.939 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-03T08:20:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-03T08:20:58.153 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-03T08:20:58.335 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-03T08:20:58.477 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-03T08:20:58.697 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-03T08:20:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-03T08:20:58.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-03T08:20:58.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-03T08:20:58.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-03T08:20:58.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-03T08:20:58.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-03T08:20:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-03T08:20:59.535 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-03T08:20:59.536 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-03T08:20:59.537 INFO:teuthology.orchestra.run.smithi157.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-03T08:20:59.537 INFO:teuthology.orchestra.run.smithi157.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-03T08:20:59.537 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:20:59.537 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:20:59.764 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-03T08:20:59.764 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-03T08:20:59.764 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-03T08:20:59.764 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-03T08:20:59.764 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-03T08:20:59.764 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-03T08:20:59.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-03T08:20:59.768 DEBUG:teuthology.parallel:result is None 2024-04-03T08:21:00.275 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-03T08:21:00.275 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:21:00.275 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:21:00.275 INFO:teuthology.orchestra.run.smithi181.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-03T08:21:00.275 INFO:teuthology.orchestra.run.smithi181.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-03T08:21:00.275 INFO:teuthology.orchestra.run.smithi181.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:21:00.276 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:21:00.513 DEBUG:teuthology.parallel:result is None 2024-04-03T08:21:00.513 INFO:teuthology.run_tasks:Running task install... 2024-04-03T08:21:00.523 DEBUG:teuthology.task.install:project ceph 2024-04-03T08:21:00.523 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-04-03T08:21:00.523 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-04-03T08:21:00.523 INFO:teuthology.task.install:Using flavor: default 2024-04-03T08:21:00.532 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-03T08:21:00.532 INFO:teuthology.task.install:extra packages: [] 2024-04-03T08:21:00.532 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-04-03T08:21:00.532 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:21:00.533 INFO:teuthology.packaging:ref: None 2024-04-03T08:21:00.533 INFO:teuthology.packaging:tag: None 2024-04-03T08:21:00.533 INFO:teuthology.packaging:branch: quincy 2024-04-03T08:21:00.533 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:21:00.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-03T08:21:00.535 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-04-03T08:21:00.535 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:21:00.535 INFO:teuthology.packaging:ref: None 2024-04-03T08:21:00.535 INFO:teuthology.packaging:tag: None 2024-04-03T08:21:00.535 INFO:teuthology.packaging:branch: quincy 2024-04-03T08:21:00.535 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:21:00.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-03T08:21:00.793 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/ 2024-04-03T08:21:00.794 INFO:teuthology.task.install.rpm:Package version is 17.2.7-805.g6fda41ff 2024-04-03T08:21:01.137 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-03T08:21:01.137 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:21:01.137 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-03T08:21:01.211 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-03T08:21:01.211 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:21:01.212 INFO:teuthology.packaging:ref: None 2024-04-03T08:21:01.212 INFO:teuthology.packaging:tag: None 2024-04-03T08:21:01.212 INFO:teuthology.packaging:branch: quincy 2024-04-03T08:21:01.212 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:21:01.212 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-03T08:21:01.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-03T08:21:01.419 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-03T08:21:01.486 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-04-03T08:21:01.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-04-03T08:21:01.832 INFO:teuthology.orchestra.run.smithi157.stdout:76 files removed 2024-04-03T08:21:01.868 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw 2024-04-03T08:21:02.351 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/ 2024-04-03T08:21:02.351 INFO:teuthology.task.install.rpm:Package version is 17.2.7-805.g6fda41ff 2024-04-03T08:21:02.707 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6fda41ff74b7f038ecae6f40cc5fca107a3d4207/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-03T08:21:02.708 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:21:02.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-03T08:21:02.782 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-03T08:21:02.782 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:21:02.783 INFO:teuthology.packaging:ref: None 2024-04-03T08:21:02.783 INFO:teuthology.packaging:tag: None 2024-04-03T08:21:02.783 INFO:teuthology.packaging:branch: quincy 2024-04-03T08:21:02.783 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:21:02.783 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-03T08:21:02.892 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-03T08:21:02.983 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-03T08:21:03.049 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-04-03T08:21:03.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-04-03T08:21:03.385 INFO:teuthology.orchestra.run.smithi181.stdout:76 files removed 2024-04-03T08:21:03.421 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw 2024-04-03T08:21:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 58 kB/s | 78 kB 00:01 2024-04-03T08:21:05.062 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 71 kB/s | 78 kB 00:01 2024-04-03T08:21:05.939 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 4.3 kB/s | 9.1 kB 00:02 2024-04-03T08:21:06.231 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2024-04-03T08:21:06.987 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 4.9 kB/s | 9.1 kB 00:01 2024-04-03T08:21:07.455 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 3.3 kB/s | 1.4 kB 00:00 2024-04-03T08:21:09.381 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - AppStream 8.9 MB/s | 28 MB 00:03 2024-04-03T08:21:10.005 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - AppStream 11 MB/s | 28 MB 00:02 2024-04-03T08:21:15.923 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - BaseOS 8.9 MB/s | 10 MB 00:01 2024-04-03T08:21:16.722 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - BaseOS 7.8 MB/s | 10 MB 00:01 2024-04-03T08:21:18.098 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras 41 kB/s | 18 kB 00:00 2024-04-03T08:21:18.533 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 7.5 kB 00:00 2024-04-03T08:21:18.689 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - Extras 68 kB/s | 18 kB 00:00 2024-04-03T08:21:19.106 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 7.5 kB 00:00 2024-04-03T08:21:21.008 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - PowerTools 2.7 MB/s | 4.9 MB 00:01 2024-04-03T08:21:21.551 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - PowerTools 1.7 MB/s | 4.9 MB 00:02 2024-04-03T08:21:22.359 INFO:teuthology.orchestra.run.smithi181.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2024-04-03T08:21:22.843 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2024-04-03T08:21:24.060 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2024-04-03T08:21:24.205 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-03T08:21:28.669 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 393 kB/s | 24 kB 00:00 2024-04-03T08:21:29.103 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 36 kB/s | 24 kB 00:00 2024-04-03T08:21:32.591 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 17 M 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 3.5 M 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 3.6 M 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 5.3 M 2024-04-03T08:21:32.594 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 24 M 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 24 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 798 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 506 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 5.6 M 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 45 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 117 k 2024-04-03T08:21:32.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 190 k 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 372 k 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 358 k 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 107 k 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout:Install 21 Packages 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2024-04-03T08:21:32.596 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:21:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 64 M 2024-04-03T08:21:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:21:32.796 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:21:32.798 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:21:32.798 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 17 M 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 3.5 M 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 3.6 M 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 5.3 M 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 24 M 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 24 k 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 798 k 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-03T08:21:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 506 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 5.6 M 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 45 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 117 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 190 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 372 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 358 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 107 k 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-03T08:21:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout:Install 21 Packages 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 2 Packages 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 64 M 2024-04-03T08:21:32.801 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:21:34.472 INFO:teuthology.orchestra.run.smithi157.stdout:(1/23): ceph-base-17.2.7-805.g6fda41ff.el8.x86_ 3.5 MB/s | 5.3 MB 00:01 2024-04-03T08:21:34.521 INFO:teuthology.orchestra.run.smithi157.stdout:(2/23): ceph-selinux-17.2.7-805.g6fda41ff.el8.x 492 kB/s | 24 kB 00:00 2024-04-03T08:21:34.630 INFO:teuthology.orchestra.run.smithi157.stdout:(3/23): libcephfs2-17.2.7-805.g6fda41ff.el8.x86 7.2 MB/s | 798 kB 00:00 2024-04-03T08:21:34.739 INFO:teuthology.orchestra.run.smithi157.stdout:(4/23): libradosstriper1-17.2.7-805.g6fda41ff.e 4.5 MB/s | 506 kB 00:00 2024-04-03T08:21:35.289 INFO:teuthology.orchestra.run.smithi157.stdout:(5/23): librgw2-17.2.7-805.g6fda41ff.el8.x86_64 10 MB/s | 5.6 MB 00:00 2024-04-03T08:21:35.331 INFO:teuthology.orchestra.run.smithi157.stdout:(6/23): python3-ceph-argparse-17.2.7-805.g6fda4 1.1 MB/s | 45 kB 00:00 2024-04-03T08:21:35.415 INFO:teuthology.orchestra.run.smithi157.stdout:(7/23): python3-ceph-common-17.2.7-805.g6fda41f 1.4 MB/s | 117 kB 00:00 2024-04-03T08:21:35.473 INFO:teuthology.orchestra.run.smithi157.stdout:(8/23): python3-cephfs-17.2.7-805.g6fda41ff.el8 3.2 MB/s | 190 kB 00:00 2024-04-03T08:21:35.548 INFO:teuthology.orchestra.run.smithi157.stdout:(9/23): python3-rados-17.2.7-805.g6fda41ff.el8. 4.9 MB/s | 372 kB 00:00 2024-04-03T08:21:35.666 INFO:teuthology.orchestra.run.smithi157.stdout:(10/23): python3-rbd-17.2.7-805.g6fda41ff.el8.x 3.0 MB/s | 358 kB 00:00 2024-04-03T08:21:35.732 INFO:teuthology.orchestra.run.smithi157.stdout:(11/23): python3-rgw-17.2.7-805.g6fda41ff.el8.x 1.6 MB/s | 107 kB 00:00 2024-04-03T08:21:36.807 INFO:teuthology.orchestra.run.smithi157.stdout:(12/23): librdkafka-1.6.1-1.el8.x86_64.rpm 630 kB/s | 677 kB 00:01 2024-04-03T08:21:36.949 INFO:teuthology.orchestra.run.smithi157.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-04-03T08:21:37.091 INFO:teuthology.orchestra.run.smithi157.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 311 kB/s | 44 kB 00:00 2024-04-03T08:21:37.416 INFO:teuthology.orchestra.run.smithi157.stdout:(15/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 145 kB/s | 47 kB 00:00 2024-04-03T08:21:37.925 INFO:teuthology.orchestra.run.smithi157.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 602 kB/s | 306 kB 00:00 2024-04-03T08:21:38.276 INFO:teuthology.orchestra.run.smithi157.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 168 kB/s | 59 kB 00:00 2024-04-03T08:21:38.709 INFO:teuthology.orchestra.run.smithi157.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 173 kB/s | 75 kB 00:00 2024-04-03T08:21:39.561 INFO:teuthology.orchestra.run.smithi157.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 2.0 MB/s | 1.7 MB 00:00 2024-04-03T08:21:39.934 INFO:teuthology.orchestra.run.smithi157.stdout:(20/23): librados2-17.2.7-805.g6fda41ff.el8.x86 9.3 MB/s | 3.5 MB 00:00 2024-04-03T08:21:40.168 INFO:teuthology.orchestra.run.smithi157.stdout:(21/23): librbd1-17.2.7-805.g6fda41ff.el8.x86_6 15 MB/s | 3.6 MB 00:00 2024-04-03T08:21:45.345 INFO:teuthology.orchestra.run.smithi181.stdout:(1/23): ceph-base-17.2.7-805.g6fda41ff.el8.x86_ 457 kB/s | 5.3 MB 00:11 2024-04-03T08:21:45.428 INFO:teuthology.orchestra.run.smithi181.stdout:(2/23): ceph-selinux-17.2.7-805.g6fda41ff.el8.x 293 kB/s | 24 kB 00:00 2024-04-03T08:21:46.079 INFO:teuthology.orchestra.run.smithi181.stdout:(3/23): libcephfs2-17.2.7-805.g6fda41ff.el8.x86 1.2 MB/s | 798 kB 00:00 2024-04-03T08:21:46.754 INFO:teuthology.orchestra.run.smithi181.stdout:(4/23): libradosstriper1-17.2.7-805.g6fda41ff.e 750 kB/s | 506 kB 00:00 2024-04-03T08:21:51.062 INFO:teuthology.orchestra.run.smithi181.stdout:(5/23): librgw2-17.2.7-805.g6fda41ff.el8.x86_64 1.3 MB/s | 5.6 MB 00:04 2024-04-03T08:21:51.137 INFO:teuthology.orchestra.run.smithi181.stdout:(6/23): python3-ceph-argparse-17.2.7-805.g6fda4 599 kB/s | 45 kB 00:00 2024-04-03T08:21:51.279 INFO:teuthology.orchestra.run.smithi181.stdout:(7/23): python3-ceph-common-17.2.7-805.g6fda41f 827 kB/s | 117 kB 00:00 2024-04-03T08:21:51.521 INFO:teuthology.orchestra.run.smithi181.stdout:(8/23): python3-cephfs-17.2.7-805.g6fda41ff.el8 786 kB/s | 190 kB 00:00 2024-04-03T08:21:51.792 INFO:teuthology.orchestra.run.smithi157.stdout:(22/23): ceph-radosgw-17.2.7-805.g6fda41ff.el8. 915 kB/s | 17 MB 00:18 2024-04-03T08:21:51.838 INFO:teuthology.orchestra.run.smithi181.stdout:(9/23): python3-rados-17.2.7-805.g6fda41ff.el8. 1.1 MB/s | 372 kB 00:00 2024-04-03T08:21:52.130 INFO:teuthology.orchestra.run.smithi181.stdout:(10/23): python3-rbd-17.2.7-805.g6fda41ff.el8.x 1.2 MB/s | 358 kB 00:00 2024-04-03T08:21:52.247 INFO:teuthology.orchestra.run.smithi181.stdout:(11/23): python3-rgw-17.2.7-805.g6fda41ff.el8.x 915 kB/s | 107 kB 00:00 2024-04-03T08:21:52.747 INFO:teuthology.orchestra.run.smithi181.stdout:(12/23): ceph-radosgw-17.2.7-805.g6fda41ff.el8. 896 kB/s | 17 MB 00:19 2024-04-03T08:21:53.455 INFO:teuthology.orchestra.run.smithi181.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 367 kB/s | 259 kB 00:00 2024-04-03T08:21:53.589 INFO:teuthology.orchestra.run.smithi181.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 330 kB/s | 44 kB 00:00 2024-04-03T08:21:53.673 INFO:teuthology.orchestra.run.smithi181.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 475 kB/s | 677 kB 00:01 2024-04-03T08:21:53.932 INFO:teuthology.orchestra.run.smithi181.stdout:(16/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 138 kB/s | 47 kB 00:00 2024-04-03T08:21:54.390 INFO:teuthology.orchestra.run.smithi181.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 427 kB/s | 306 kB 00:00 2024-04-03T08:21:54.491 INFO:teuthology.orchestra.run.smithi181.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 751 kB/s | 75 kB 00:00 2024-04-03T08:21:54.766 INFO:teuthology.orchestra.run.smithi181.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 70 kB/s | 59 kB 00:00 2024-04-03T08:21:55.049 INFO:teuthology.orchestra.run.smithi181.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 3.1 MB/s | 1.7 MB 00:00 2024-04-03T08:21:56.550 INFO:teuthology.orchestra.run.smithi157.stdout:(23/23): ceph-common-17.2.7-805.g6fda41ff.el8.x 1.0 MB/s | 24 MB 00:23 2024-04-03T08:21:56.553 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:21:56.553 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.7 MB/s | 64 MB 00:23 2024-04-03T08:21:56.646 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:21:56.697 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:21:56.697 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:21:56.841 INFO:teuthology.orchestra.run.smithi181.stdout:(21/23): librbd1-17.2.7-805.g6fda41ff.el8.x86_6 2.0 MB/s | 3.6 MB 00:01 2024-04-03T08:21:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:21:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:21:57.292 INFO:teuthology.orchestra.run.smithi181.stdout:(22/23): ceph-common-17.2.7-805.g6fda41ff.el8.x 1.0 MB/s | 24 MB 00:23 2024-04-03T08:21:58.137 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:21:58.250 INFO:teuthology.orchestra.run.smithi181.stdout:(23/23): librados2-17.2.7-805.g6fda41ff.el8.x86 1.0 MB/s | 3.5 MB 00:03 2024-04-03T08:21:58.254 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:21:58.255 INFO:teuthology.orchestra.run.smithi181.stdout:Total 2.5 MB/s | 64 MB 00:25 2024-04-03T08:21:58.346 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:21:58.397 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:21:58.397 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:21:58.468 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-04-03T08:21:58.691 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-03T08:21:58.792 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:21:58.795 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:21:59.121 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-03T08:21:59.316 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 3/25 2024-04-03T08:21:59.429 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 3/25 2024-04-03T08:21:59.662 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 4/25 2024-04-03T08:21:59.841 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 5/25 2024-04-03T08:21:59.872 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:22:00.093 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-04-03T08:22:00.310 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 5/25 2024-04-03T08:22:00.314 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-03T08:22:00.516 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 6/25 2024-04-03T08:22:00.739 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-03T08:22:00.768 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 6/25 2024-04-03T08:22:00.955 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2024-04-03T08:22:00.981 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 3/25 2024-04-03T08:22:01.090 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 3/25 2024-04-03T08:22:01.197 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/25 2024-04-03T08:22:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 4/25 2024-04-03T08:22:01.497 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 5/25 2024-04-03T08:22:01.894 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2024-04-03T08:22:01.935 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 5/25 2024-04-03T08:22:02.067 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 10/25 2024-04-03T08:22:02.114 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 6/25 2024-04-03T08:22:02.156 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 10/25 2024-04-03T08:22:02.320 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:17.2.7-805.g6fda41ff.el8.x 11/25 2024-04-03T08:22:02.351 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 6/25 2024-04-03T08:22:02.495 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 12/25 2024-04-03T08:22:02.537 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2024-04-03T08:22:02.699 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 13/25 2024-04-03T08:22:02.728 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/25 2024-04-03T08:22:02.927 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 14/25 2024-04-03T08:22:03.074 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 15/25 2024-04-03T08:22:03.145 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 15/25 2024-04-03T08:22:03.441 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-04-03T08:22:03.450 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2024-04-03T08:22:03.606 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 10/25 2024-04-03T08:22:03.617 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-04-03T08:22:03.689 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 10/25 2024-04-03T08:22:03.826 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-03T08:22:03.851 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:17.2.7-805.g6fda41ff.el8.x 11/25 2024-04-03T08:22:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:17.2.7-805.g6fda41ff.el8.x86 19/25 2024-04-03T08:22:04.060 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 12/25 2024-04-03T08:22:04.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 13/25 2024-04-03T08:22:04.504 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 14/25 2024-04-03T08:22:04.647 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 15/25 2024-04-03T08:22:04.729 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 15/25 2024-04-03T08:22:04.944 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-04-03T08:22:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-04-03T08:22:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-03T08:22:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:17.2.7-805.g6fda41ff.el8.x86 19/25 2024-04-03T08:22:07.024 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 20/25 2024-04-03T08:22:07.249 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 20/25 2024-04-03T08:22:07.940 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 20/25 2024-04-03T08:22:08.179 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 21/25 2024-04-03T08:22:08.388 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 21/25 2024-04-03T08:22:08.416 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 20/25 2024-04-03T08:22:08.582 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 22/25 2024-04-03T08:22:08.631 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 20/25 2024-04-03T08:22:09.335 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 20/25 2024-04-03T08:22:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 21/25 2024-04-03T08:22:09.779 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 21/25 2024-04-03T08:22:09.963 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 22/25 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 22/25 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-04-03T08:22:29.608 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-04-03T08:22:29.609 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2024-04-03T08:22:29.609 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:22:30.832 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 22/25 2024-04-03T08:22:30.832 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-04-03T08:22:30.832 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /dev 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /run 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /dev 2024-04-03T08:22:30.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:31.451 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 23/25 2024-04-03T08:22:31.564 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 23/25 2024-04-03T08:22:31.564 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-03T08:22:31.808 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-03T08:22:31.809 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-03T08:22:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 23/25 2024-04-03T08:22:32.756 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 23/25 2024-04-03T08:22:32.756 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-03T08:22:32.779 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 1/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 2/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 3/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 4/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 5/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 6/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 7/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:17.2.7-805.g6fda41ff.el8.x 8/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:17.2.7-805.g6fda41ff.el8.x86 9/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 10/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 11/25 2024-04-03T08:22:32.780 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 12/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 13/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 22/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-03T08:22:32.781 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 24/25 2024-04-03T08:22:32.989 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-03T08:22:32.990 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.478 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.479 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:22:33.480 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:22:33.849 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-test 2024-04-03T08:22:33.980 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-03T08:22:33.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 1/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 2/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 3/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 4/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 5/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 6/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 7/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:17.2.7-805.g6fda41ff.el8.x 8/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:17.2.7-805.g6fda41ff.el8.x86 9/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 10/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 11/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 12/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 13/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-03T08:22:33.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 22/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-03T08:22:33.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 24/25 2024-04-03T08:22:34.695 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-03T08:22:34.695 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:34.695 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-04-03T08:22:34.695 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.695 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-03T08:22:34.696 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:34.697 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:22:34.782 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:06 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:22:35.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-test 2024-04-03T08:22:35.969 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:07 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:22:36.476 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:22:36.477 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:22:36.477 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:22:36.477 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:22:36.477 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:22:36.477 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 53 M 2024-04-03T08:22:36.477 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 179 k 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-04-03T08:22:36.478 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:22:36.479 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 54 M 2024-04-03T08:22:36.479 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 236 M 2024-04-03T08:22:36.479 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:22:37.040 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): libcephsqlite-17.2.7-805.g6fda41ff.el8.x 550 kB/s | 179 kB 00:00 2024-04-03T08:22:37.598 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 230 kB/s | 203 kB 00:00 2024-04-03T08:22:37.761 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 53 M 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 179 k 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-03T08:22:37.763 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:Install 6 Packages 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 54 M 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 236 M 2024-04-03T08:22:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:22:37.798 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 248 kB/s | 188 kB 00:00 2024-04-03T08:22:37.919 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2024-04-03T08:22:37.974 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 403 kB/s | 71 kB 00:00 2024-04-03T08:22:38.106 INFO:teuthology.orchestra.run.smithi181.stdout:(1/6): libcephsqlite-17.2.7-805.g6fda41ff.el8.x 640 kB/s | 179 kB 00:00 2024-04-03T08:22:38.532 INFO:teuthology.orchestra.run.smithi181.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 288 kB/s | 203 kB 00:00 2024-04-03T08:22:38.824 INFO:teuthology.orchestra.run.smithi181.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2024-04-03T08:22:38.849 INFO:teuthology.orchestra.run.smithi181.stdout:(4/6): oniguruma-6.8.2-3.el8.x86_64.rpm 253 kB/s | 188 kB 00:00 2024-04-03T08:22:38.974 INFO:teuthology.orchestra.run.smithi181.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 471 kB/s | 71 kB 00:00 2024-04-03T08:22:43.616 INFO:teuthology.orchestra.run.smithi181.stdout:(6/6): ceph-test-17.2.7-805.g6fda41ff.el8.x86_6 9.1 MB/s | 53 MB 00:05 2024-04-03T08:22:43.618 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:22:43.618 INFO:teuthology.orchestra.run.smithi181.stdout:Total 9.1 MB/s | 54 MB 00:05 2024-04-03T08:22:43.707 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:22:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:22:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:22:44.066 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:22:44.070 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:22:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:22:44.789 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-03T08:22:44.996 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-03T08:22:45.149 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-03T08:22:45.248 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-03T08:22:45.458 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-03T08:22:45.632 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 5/6 2024-04-03T08:22:50.993 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 5/6 2024-04-03T08:22:51.214 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 6/6 2024-04-03T08:22:51.578 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 6/6 2024-04-03T08:22:51.579 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 1/6 2024-04-03T08:22:51.579 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 2/6 2024-04-03T08:22:51.579 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-03T08:22:51.579 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-03T08:22:51.579 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-03T08:22:52.058 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-03T08:22:52.058 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: jq-1.6-8.el8.x86_64 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:22:52.238 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph 2024-04-03T08:22:53.197 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:25 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:22:54.597 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): ceph-test-17.2.7-805.g6fda41ff.el8.x86_6 2.9 MB/s | 53 MB 00:17 2024-04-03T08:22:54.599 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:22:54.600 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.0 MB/s | 54 MB 00:18 2024-04-03T08:22:54.690 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:22:54.714 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:22:54.715 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:22:54.902 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:22:54.905 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 6.4 k 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 2.3 M 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 1.6 M 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 240 k 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 4.0 M 2024-04-03T08:22:54.906 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 17 M 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-03T08:22:54.907 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-03T08:22:54.908 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout:Install 32 Packages 2024-04-03T08:22:54.909 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:22:54.910 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 29 M 2024-04-03T08:22:54.910 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 113 M 2024-04-03T08:22:54.910 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:22:55.055 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:22:55.059 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:22:55.571 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:22:55.575 INFO:teuthology.orchestra.run.smithi181.stdout:(1/32): ceph-17.2.7-805.g6fda41ff.el8.x86_64.rp 37 kB/s | 6.4 kB 00:00 2024-04-03T08:22:55.793 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-03T08:22:55.884 INFO:teuthology.orchestra.run.smithi181.stdout:(2/32): ceph-mgr-17.2.7-805.g6fda41ff.el8.x86_6 3.3 MB/s | 1.6 MB 00:00 2024-04-03T08:22:56.003 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-03T08:22:56.157 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-03T08:22:56.254 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-03T08:22:56.457 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-03T08:22:56.459 INFO:teuthology.orchestra.run.smithi181.stdout:(3/32): ceph-mon-17.2.7-805.g6fda41ff.el8.x86_6 4.6 MB/s | 4.0 MB 00:00 2024-04-03T08:22:56.596 INFO:teuthology.orchestra.run.smithi181.stdout:(4/32): ceph-mds-17.2.7-805.g6fda41ff.el8.x86_6 1.9 MB/s | 2.3 MB 00:01 2024-04-03T08:22:56.598 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 5/6 2024-04-03T08:22:56.627 INFO:teuthology.orchestra.run.smithi181.stdout:(5/32): ceph-mgr-modules-core-17.2.7-805.g6fda4 1.4 MB/s | 240 kB 00:00 2024-04-03T08:22:57.010 INFO:teuthology.orchestra.run.smithi181.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 101 kB/s | 39 kB 00:00 2024-04-03T08:22:57.194 INFO:teuthology.orchestra.run.smithi181.stdout:(7/32): ceph-osd-17.2.7-805.g6fda41ff.el8.x86_6 13 MB/s | 17 MB 00:01 2024-04-03T08:22:57.236 INFO:teuthology.orchestra.run.smithi181.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 245 kB/s | 157 kB 00:00 2024-04-03T08:22:57.378 INFO:teuthology.orchestra.run.smithi181.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 282 kB/s | 103 kB 00:00 2024-04-03T08:22:57.561 INFO:teuthology.orchestra.run.smithi181.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.4 MB/s | 457 kB 00:00 2024-04-03T08:22:57.637 INFO:teuthology.orchestra.run.smithi181.stdout:(11/32): python3-pytz-2017.2-11.el8.noarch.rpm 129 kB/s | 57 kB 00:00 2024-04-03T08:22:57.912 INFO:teuthology.orchestra.run.smithi181.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 466 kB/s | 249 kB 00:00 2024-04-03T08:22:58.046 INFO:teuthology.orchestra.run.smithi181.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 267 kB/s | 109 kB 00:00 2024-04-03T08:22:58.196 INFO:teuthology.orchestra.run.smithi181.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.0 MB/s | 641 kB 00:00 2024-04-03T08:22:58.221 INFO:teuthology.orchestra.run.smithi181.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 141 kB/s | 44 kB 00:00 2024-04-03T08:22:58.447 INFO:teuthology.orchestra.run.smithi181.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 691 kB/s | 173 kB 00:00 2024-04-03T08:22:58.472 INFO:teuthology.orchestra.run.smithi181.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 435 kB/s | 185 kB 00:00 2024-04-03T08:22:58.547 INFO:teuthology.orchestra.run.smithi181.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-04-03T08:22:58.573 INFO:teuthology.orchestra.run.smithi181.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2024-04-03T08:22:58.656 INFO:teuthology.orchestra.run.smithi181.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 449 kB/s | 49 kB 00:00 2024-04-03T08:22:58.682 INFO:teuthology.orchestra.run.smithi181.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 542 kB/s | 59 kB 00:00 2024-04-03T08:22:58.740 INFO:teuthology.orchestra.run.smithi181.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 742 kB/s | 384 kB 00:00 2024-04-03T08:22:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2024-04-03T08:22:58.824 INFO:teuthology.orchestra.run.smithi181.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-04-03T08:22:58.849 INFO:teuthology.orchestra.run.smithi181.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-04-03T08:22:58.875 INFO:teuthology.orchestra.run.smithi181.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 220 kB/s | 24 kB 00:00 2024-04-03T08:22:58.900 INFO:teuthology.orchestra.run.smithi181.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2024-04-03T08:22:58.925 INFO:teuthology.orchestra.run.smithi181.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2024-04-03T08:22:58.984 INFO:teuthology.orchestra.run.smithi181.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2024-04-03T08:22:59.009 INFO:teuthology.orchestra.run.smithi181.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.3 MB/s | 251 kB 00:00 2024-04-03T08:22:59.035 INFO:teuthology.orchestra.run.smithi181.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 786 kB/s | 85 kB 00:00 2024-04-03T08:22:59.071 INFO:teuthology.orchestra.run.smithi181.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 266 kB/s | 23 kB 00:00 2024-04-03T08:22:59.073 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:22:59.073 INFO:teuthology.orchestra.run.smithi181.stdout:Total 7.0 MB/s | 29 MB 00:04 2024-04-03T08:22:59.240 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:22:59.282 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:22:59.282 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:22:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:22:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:23:00.746 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:23:00.979 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-03T08:23:01.206 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-03T08:23:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-03T08:23:01.729 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-03T08:23:01.893 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-03T08:23:01.983 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 5/6 2024-04-03T08:23:02.101 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-03T08:23:02.205 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 6/6 2024-04-03T08:23:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-03T08:23:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-03T08:23:02.577 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 6/6 2024-04-03T08:23:02.577 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 1/6 2024-04-03T08:23:02.577 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 2/6 2024-04-03T08:23:02.577 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-03T08:23:02.577 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-03T08:23:02.577 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-03T08:23:02.693 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-03T08:23:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-8.el8.x86_64 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-03T08:23:03.038 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-03T08:23:03.039 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-03T08:23:03.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph 2024-04-03T08:23:03.410 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-03T08:23:03.832 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-03T08:23:04.086 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-03T08:23:04.187 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:36 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:04.808 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-03T08:23:05.061 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-03T08:23:05.266 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-03T08:23:05.590 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-03T08:23:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-03T08:23:05.898 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:05.902 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:05.902 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:23:05.902 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:05.902 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:23:05.902 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 6.4 k 2024-04-03T08:23:05.902 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 2.3 M 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 1.6 M 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 240 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 4.0 M 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 17 M 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-03T08:23:05.903 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-03T08:23:05.904 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout:Install 32 Packages 2024-04-03T08:23:05.905 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:05.906 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 29 M 2024-04-03T08:23:05.906 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 113 M 2024-04-03T08:23:05.906 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:23:05.967 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-03T08:23:06.136 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-03T08:23:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-03T08:23:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-03T08:23:06.706 INFO:teuthology.orchestra.run.smithi157.stdout:(1/32): ceph-17.2.7-805.g6fda41ff.el8.x86_64.rp 42 kB/s | 6.4 kB 00:00 2024-04-03T08:23:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:(2/32): ceph-mgr-17.2.7-805.g6fda41ff.el8.x86_6 4.4 MB/s | 1.6 MB 00:00 2024-04-03T08:23:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-03T08:23:07.263 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-03T08:23:07.281 INFO:teuthology.orchestra.run.smithi157.stdout:(3/32): ceph-mon-17.2.7-805.g6fda41ff.el8.x86_6 7.0 MB/s | 4.0 MB 00:00 2024-04-03T08:23:07.332 INFO:teuthology.orchestra.run.smithi157.stdout:(4/32): ceph-mds-17.2.7-805.g6fda41ff.el8.x86_6 3.0 MB/s | 2.3 MB 00:00 2024-04-03T08:23:07.357 INFO:teuthology.orchestra.run.smithi157.stdout:(5/32): ceph-mgr-modules-core-17.2.7-805.g6fda4 3.1 MB/s | 240 kB 00:00 2024-04-03T08:23:07.578 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-03T08:23:07.682 INFO:teuthology.orchestra.run.smithi157.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 119 kB/s | 39 kB 00:00 2024-04-03T08:23:07.908 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-805.g6fda41ff.el8.n 27/32 2024-04-03T08:23:08.024 INFO:teuthology.orchestra.run.smithi157.stdout:(7/32): ceph-osd-17.2.7-805.g6fda41ff.el8.x86_6 15 MB/s | 17 MB 00:01 2024-04-03T08:23:08.050 INFO:teuthology.orchestra.run.smithi157.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 219 kB/s | 157 kB 00:00 2024-04-03T08:23:08.075 INFO:teuthology.orchestra.run.smithi157.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 264 kB/s | 103 kB 00:00 2024-04-03T08:23:08.095 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 28/32 2024-04-03T08:23:08.142 INFO:teuthology.orchestra.run.smithi157.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 487 kB/s | 57 kB 00:00 2024-04-03T08:23:08.651 INFO:teuthology.orchestra.run.smithi157.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 432 kB/s | 249 kB 00:00 2024-04-03T08:23:08.709 INFO:teuthology.orchestra.run.smithi157.stdout:(12/32): python3-werkzeug-0.12.2-4.el8.noarch.r 694 kB/s | 457 kB 00:00 2024-04-03T08:23:08.743 INFO:teuthology.orchestra.run.smithi157.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.2 MB/s | 109 kB 00:00 2024-04-03T08:23:08.818 INFO:teuthology.orchestra.run.smithi157.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 949 kB/s | 641 kB 00:00 2024-04-03T08:23:08.877 INFO:teuthology.orchestra.run.smithi157.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 261 kB/s | 44 kB 00:00 2024-04-03T08:23:08.981 INFO:teuthology.orchestra.run.smithi157.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 794 kB/s | 185 kB 00:00 2024-04-03T08:23:09.011 INFO:teuthology.orchestra.run.smithi157.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.8 MB/s | 384 kB 00:00 2024-04-03T08:23:09.036 INFO:teuthology.orchestra.run.smithi157.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 204 kB/s | 11 kB 00:00 2024-04-03T08:23:09.062 INFO:teuthology.orchestra.run.smithi157.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 351 kB/s | 18 kB 00:00 2024-04-03T08:23:09.086 INFO:teuthology.orchestra.run.smithi157.stdout:(20/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 646 kB/s | 173 kB 00:00 2024-04-03T08:23:09.112 INFO:teuthology.orchestra.run.smithi157.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 647 kB/s | 49 kB 00:00 2024-04-03T08:23:09.137 INFO:teuthology.orchestra.run.smithi157.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 782 kB/s | 59 kB 00:00 2024-04-03T08:23:09.162 INFO:teuthology.orchestra.run.smithi157.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2024-04-03T08:23:09.187 INFO:teuthology.orchestra.run.smithi157.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s | 19 kB 00:00 2024-04-03T08:23:09.213 INFO:teuthology.orchestra.run.smithi157.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 478 kB/s | 24 kB 00:00 2024-04-03T08:23:09.246 INFO:teuthology.orchestra.run.smithi157.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 500 kB/s | 29 kB 00:00 2024-04-03T08:23:09.272 INFO:teuthology.orchestra.run.smithi157.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 472 kB/s | 27 kB 00:00 2024-04-03T08:23:09.297 INFO:teuthology.orchestra.run.smithi157.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2024-04-03T08:23:09.322 INFO:teuthology.orchestra.run.smithi157.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-04-03T08:23:09.347 INFO:teuthology.orchestra.run.smithi157.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2024-04-03T08:23:09.373 INFO:teuthology.orchestra.run.smithi157.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2024-04-03T08:23:09.398 INFO:teuthology.orchestra.run.smithi157.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 306 kB/s | 23 kB 00:00 2024-04-03T08:23:09.402 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:09.403 INFO:teuthology.orchestra.run.smithi157.stdout:Total 8.3 MB/s | 29 MB 00:03 2024-04-03T08:23:09.577 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:23:09.619 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:23:09.620 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:23:09.741 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 28/32 2024-04-03T08:23:09.953 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:23:09.957 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:23:09.961 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 29/32 2024-04-03T08:23:10.429 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 29/32 2024-04-03T08:23:10.596 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 30/32 2024-04-03T08:23:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 30/32 2024-04-03T08:23:11.070 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 31/32 2024-04-03T08:23:11.098 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:23:11.111 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 31/32 2024-04-03T08:23:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 32/32 2024-04-03T08:23:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 32/32 2024-04-03T08:23:11.326 INFO:teuthology.orchestra.run.smithi181.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-03T08:23:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:11.363 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-03T08:23:11.598 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-03T08:23:11.842 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-03T08:23:11.866 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 1/32 2024-04-03T08:23:11.866 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 2/32 2024-04-03T08:23:11.866 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 3/32 2024-04-03T08:23:11.867 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 4/32 2024-04-03T08:23:11.867 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 5/32 2024-04-03T08:23:11.867 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-805.g6fda41ff.el8.n 6/32 2024-04-03T08:23:11.867 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-03T08:23:11.867 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-03T08:23:11.867 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-03T08:23:11.868 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-03T08:23:11.869 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-03T08:23:11.870 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-03T08:23:11.871 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-03T08:23:12.070 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-03T08:23:12.292 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-03T08:23:12.484 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-03T08:23:12.666 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-03T08:23:12.738 INFO:teuthology.orchestra.run.smithi181.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-2.6-1.el8.noarch 2024-04-03T08:23:12.739 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:12.740 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:12.819 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-03T08:23:13.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-base 2024-04-03T08:23:13.032 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-03T08:23:13.251 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-03T08:23:13.514 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-03T08:23:13.738 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-03T08:23:13.947 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:45 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:14.150 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-03T08:23:14.402 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-03T08:23:14.597 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-03T08:23:14.830 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-03T08:23:15.048 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-03T08:23:15.361 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-03T08:23:15.587 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-03T08:23:15.705 INFO:teuthology.orchestra.run.smithi181.stdout:Package ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:23:15.759 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:15.760 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:23:15.760 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:15.775 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-03T08:23:15.870 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install cephadm 2024-04-03T08:23:15.976 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-03T08:23:16.264 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-03T08:23:16.532 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-03T08:23:16.786 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:48 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:16.800 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-03T08:23:17.154 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-03T08:23:17.472 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-03T08:23:17.889 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-805.g6fda41ff.el8.n 27/32 2024-04-03T08:23:18.076 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 28/32 2024-04-03T08:23:18.464 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 82 k 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:23:18.465 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:18.466 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 82 k 2024-04-03T08:23:18.466 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 372 k 2024-04-03T08:23:18.466 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:23:18.853 INFO:teuthology.orchestra.run.smithi181.stdout:cephadm-17.2.7-805.g6fda41ff.el8.noarch.rpm 212 kB/s | 82 kB 00:00 2024-04-03T08:23:18.853 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:18.854 INFO:teuthology.orchestra.run.smithi181.stdout:Total 211 kB/s | 82 kB 00:00 2024-04-03T08:23:18.854 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:23:18.865 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:23:18.865 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:23:18.867 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:23:18.871 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:23:18.920 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:23:19.536 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:19.720 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 28/32 2024-04-03T08:23:19.926 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 29/32 2024-04-03T08:23:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:20.386 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 29/32 2024-04-03T08:23:20.579 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 30/32 2024-04-03T08:23:20.832 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 30/32 2024-04-03T08:23:21.070 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 31/32 2024-04-03T08:23:21.111 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 31/32 2024-04-03T08:23:21.253 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 32/32 2024-04-03T08:23:21.356 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 32/32 2024-04-03T08:23:21.356 INFO:teuthology.orchestra.run.smithi157.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-03T08:23:21.356 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:21.883 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 1/32 2024-04-03T08:23:21.884 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 2/32 2024-04-03T08:23:21.884 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 3/32 2024-04-03T08:23:21.884 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 4/32 2024-04-03T08:23:21.884 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 5/32 2024-04-03T08:23:21.884 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-805.g6fda41ff.el8.n 6/32 2024-04-03T08:23:21.884 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-03T08:23:21.885 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-03T08:23:21.885 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-03T08:23:21.885 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-03T08:23:21.885 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-03T08:23:21.885 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-03T08:23:21.885 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-03T08:23:21.886 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-03T08:23:21.886 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-03T08:23:21.886 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-03T08:23:21.886 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-03T08:23:21.886 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-03T08:23:21.887 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-03T08:23:21.887 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-03T08:23:21.887 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-03T08:23:21.887 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-03T08:23:21.887 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-03T08:23:21.887 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-03T08:23:21.888 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-03T08:23:21.888 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-03T08:23:21.888 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-03T08:23:21.888 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-03T08:23:21.888 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-03T08:23:21.888 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-03T08:23:21.889 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-03T08:23:22.065 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:22.066 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:22.066 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:23:22.066 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:22.066 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:22.066 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:22.332 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-immutable-object-cache 2024-04-03T08:23:22.788 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-03T08:23:22.788 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:22.788 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-03T08:23:22.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-03T08:23:22.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:22.791 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:23.061 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-base 2024-04-03T08:23:23.250 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:55 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:23.988 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:55 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:24.946 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:24.946 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 162 k 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:23:24.947 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:24.948 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 162 k 2024-04-03T08:23:24.948 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 494 k 2024-04-03T08:23:24.948 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:23:25.492 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-immutable-object-cache-17.2.7-805.g6fda41f 297 kB/s | 162 kB 00:00 2024-04-03T08:23:25.493 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:25.493 INFO:teuthology.orchestra.run.smithi181.stdout:Total 296 kB/s | 162 kB 00:00 2024-04-03T08:23:25.494 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:23:25.507 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:23:25.507 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:23:25.563 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:23:25.566 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:23:25.594 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-base-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:23:25.648 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:25.650 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:23:25.650 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:25.701 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:23:25.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install cephadm 2024-04-03T08:23:25.860 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.e 1/1 2024-04-03T08:23:26.513 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.e 1/1 2024-04-03T08:23:26.682 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:58 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.e 1/1 2024-04-03T08:23:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:26.920 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:23:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:26.920 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:27.205 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr 2024-04-03T08:23:28.128 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:00 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:28.414 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:28.415 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:28.415 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:23:28.415 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:28.415 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:23:28.415 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 82 k 2024-04-03T08:23:28.416 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:28.416 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:23:28.416 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:28.416 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:23:28.416 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:28.416 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 82 k 2024-04-03T08:23:28.417 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 372 k 2024-04-03T08:23:28.417 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:23:28.630 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm-17.2.7-805.g6fda41ff.el8.noarch.rpm 385 kB/s | 82 kB 00:00 2024-04-03T08:23:28.630 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:28.630 INFO:teuthology.orchestra.run.smithi157.stdout:Total 382 kB/s | 82 kB 00:00 2024-04-03T08:23:28.631 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:23:28.641 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:23:28.641 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:23:28.644 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:23:28.648 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:23:28.696 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:23:29.303 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:29.758 INFO:teuthology.orchestra.run.smithi181.stdout:Package ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:23:29.810 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:29.811 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:23:29.811 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:29.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-dashboard 2024-04-03T08:23:30.845 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:02 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:30.903 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:31.210 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:31.624 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/1 2024-04-03T08:23:31.624 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:31.624 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:23:31.624 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:31.624 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:31.624 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:31.871 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-immutable-object-cache 2024-04-03T08:23:32.563 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 1.7 M 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 23 k 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 14 k 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-03T08:23:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout:Install 6 Packages 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:32.565 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 2.0 M 2024-04-03T08:23:32.566 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 8.0 M 2024-04-03T08:23:32.566 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:23:32.801 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:04 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:33.096 INFO:teuthology.orchestra.run.smithi181.stdout:(1/6): ceph-prometheus-alerts-17.2.7-805.g6fda4 57 kB/s | 14 kB 00:00 2024-04-03T08:23:33.180 INFO:teuthology.orchestra.run.smithi181.stdout:(2/6): ceph-mgr-dashboard-17.2.7-805.g6fda41ff. 5.0 MB/s | 1.7 MB 00:00 2024-04-03T08:23:33.196 INFO:teuthology.orchestra.run.smithi181.stdout:(3/6): ceph-grafana-dashboards-17.2.7-805.g6fda 66 kB/s | 23 kB 00:00 2024-04-03T08:23:33.388 INFO:teuthology.orchestra.run.smithi181.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 161 kB/s | 34 kB 00:00 2024-04-03T08:23:33.414 INFO:teuthology.orchestra.run.smithi181.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 134 kB/s | 43 kB 00:00 2024-04-03T08:23:33.522 INFO:teuthology.orchestra.run.smithi181.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 603 kB/s | 196 kB 00:00 2024-04-03T08:23:33.525 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:33.525 INFO:teuthology.orchestra.run.smithi181.stdout:Total 2.1 MB/s | 2.0 MB 00:00 2024-04-03T08:23:33.547 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:23:33.560 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:23:33.560 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:23:33.665 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:23:33.669 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:23:33.957 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:23:34.203 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-04-03T08:23:34.441 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-04-03T08:23:34.611 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-04-03T08:23:34.675 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:34.675 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 162 k 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:23:34.676 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:34.677 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 162 k 2024-04-03T08:23:34.677 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 494 k 2024-04-03T08:23:34.677 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:23:34.733 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-805.g6fda41ff.el8.no 4/6 2024-04-03T08:23:34.877 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-immutable-object-cache-17.2.7-805.g6fda41f 809 kB/s | 162 kB 00:00 2024-04-03T08:23:34.878 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:34.878 INFO:teuthology.orchestra.run.smithi157.stdout:Total 803 kB/s | 162 kB 00:00 2024-04-03T08:23:34.878 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:23:34.892 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:23:34.892 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:23:34.947 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:23:34.950 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:23:35.072 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:23:35.101 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-805.g6fda41ff.el8.n 5/6 2024-04-03T08:23:35.259 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.e 1/1 2024-04-03T08:23:35.290 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 6/6 2024-04-03T08:23:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 6/6 2024-04-03T08:23:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-805.g6fda41ff.el8.n 1/6 2024-04-03T08:23:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 2/6 2024-04-03T08:23:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-805.g6fda41ff.el8.no 3/6 2024-04-03T08:23:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-04-03T08:23:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-04-03T08:23:35.912 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.e 1/1 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-03T08:23:36.060 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:36.061 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:36.232 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-03T08:23:36.683 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.e 1/1 2024-04-03T08:23:36.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:36.684 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:23:36.684 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:23:36.684 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:36.684 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:36.935 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr 2024-04-03T08:23:37.137 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:09 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:37.878 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:09 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:38.812 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:38.813 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2024-04-03T08:23:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 7.4 M 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-03T08:23:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout:Install 8 Packages 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 36 M 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 210 M 2024-04-03T08:23:38.815 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:23:39.576 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-mgr-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:23:39.629 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:39.631 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:23:39.631 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:39.680 INFO:teuthology.orchestra.run.smithi181.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-805 9.7 MB/s | 7.4 MB 00:00 2024-04-03T08:23:39.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-dashboard 2024-04-03T08:23:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 4.7 MB/s | 4.7 MB 00:01 2024-04-03T08:23:40.014 INFO:teuthology.orchestra.run.smithi181.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 4.4 MB/s | 4.9 MB 00:01 2024-04-03T08:23:40.039 INFO:teuthology.orchestra.run.smithi181.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.0 MB/s | 225 kB 00:00 2024-04-03T08:23:40.548 INFO:teuthology.orchestra.run.smithi181.stdout:(5/8): python3-scipy-1.0.0-21.module_el8+762+77 27 MB/s | 14 MB 00:00 2024-04-03T08:23:40.668 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:12 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:40.715 INFO:teuthology.orchestra.run.smithi181.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 956 kB/s | 645 kB 00:00 2024-04-03T08:23:40.832 INFO:teuthology.orchestra.run.smithi181.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.2 MB/s | 3.7 MB 00:01 2024-04-03T08:23:41.024 INFO:teuthology.orchestra.run.smithi181.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 363 kB/s | 172 kB 00:00 2024-04-03T08:23:41.024 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:41.024 INFO:teuthology.orchestra.run.smithi181.stdout:Total 16 MB/s | 36 MB 00:02 2024-04-03T08:23:41.334 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:23:41.357 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:23:41.357 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:23:41.775 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:23:41.779 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:23:42.364 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:23:42.425 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:42.426 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 1.7 M 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 23 k 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 14 k 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-03T08:23:42.430 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-03T08:23:42.431 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-03T08:23:42.431 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:42.431 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:23:42.431 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:23:42.431 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-04-03T08:23:42.431 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:42.432 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.0 M 2024-04-03T08:23:42.432 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 8.0 M 2024-04-03T08:23:42.432 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:23:42.515 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-03T08:23:42.847 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): ceph-grafana-dashboards-17.2.7-805.g6fda 99 kB/s | 23 kB 00:00 2024-04-03T08:23:42.872 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): ceph-prometheus-alerts-17.2.7-805.g6fda4 56 kB/s | 14 kB 00:00 2024-04-03T08:23:42.947 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): ceph-mgr-dashboard-17.2.7-805.g6fda41ff. 5.1 MB/s | 1.7 MB 00:00 2024-04-03T08:23:43.189 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 124 kB/s | 43 kB 00:00 2024-04-03T08:23:43.223 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 96 kB/s | 34 kB 00:00 2024-04-03T08:23:43.317 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-03T08:23:43.473 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 374 kB/s | 196 kB 00:00 2024-04-03T08:23:43.475 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:43.475 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2024-04-03T08:23:43.481 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-03T08:23:43.499 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:23:43.513 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:23:43.513 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:23:43.626 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:23:43.630 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:23:43.917 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:23:44.110 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-04-03T08:23:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-03T08:23:44.273 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-03T08:23:44.346 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-04-03T08:23:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-04-03T08:23:44.649 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-805.g6fda41ff.el8.no 4/6 2024-04-03T08:23:44.975 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-03T08:23:45.044 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-805.g6fda41ff.el8.n 5/6 2024-04-03T08:23:45.131 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-03T08:23:45.262 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 6/6 2024-04-03T08:23:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 6/6 2024-04-03T08:23:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-805.g6fda41ff.el8.n 1/6 2024-04-03T08:23:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 2/6 2024-04-03T08:23:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-805.g6fda41ff.el8.no 3/6 2024-04-03T08:23:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-04-03T08:23:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-04-03T08:23:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:46.050 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:23:46.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-03T08:23:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-03T08:23:46.531 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-03T08:23:47.113 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:19 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-03T08:23:48.817 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:23:48.818 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-04-03T08:23:48.818 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:23:48.818 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-04-03T08:23:48.818 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 7.4 M 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-04-03T08:23:48.819 INFO:teuthology.orchestra.run.smithi157.stdout:Install 8 Packages 2024-04-03T08:23:48.820 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:23:48.820 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 36 M 2024-04-03T08:23:48.820 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 210 M 2024-04-03T08:23:48.820 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:23:49.614 INFO:teuthology.orchestra.run.smithi157.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-805 14 MB/s | 7.4 MB 00:00 2024-04-03T08:23:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-03T08:23:50.056 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff 8/8 2024-04-03T08:23:50.134 INFO:teuthology.orchestra.run.smithi157.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 4.6 MB/s | 4.9 MB 00:01 2024-04-03T08:23:50.222 INFO:teuthology.orchestra.run.smithi157.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 4.1 MB/s | 4.7 MB 00:01 2024-04-03T08:23:50.247 INFO:teuthology.orchestra.run.smithi157.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.0 MB/s | 225 kB 00:00 2024-04-03T08:23:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff 8/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff 1/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-03T08:23:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-03T08:23:50.689 INFO:teuthology.orchestra.run.smithi157.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.5 MB/s | 3.7 MB 00:01 2024-04-03T08:23:50.832 INFO:teuthology.orchestra.run.smithi157.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 23 MB/s | 14 MB 00:00 2024-04-03T08:23:50.873 INFO:teuthology.orchestra.run.smithi157.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-03T08:23:50.938 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-03T08:23:50.939 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:50.939 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:23:51.110 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-rook 2024-04-03T08:23:51.248 INFO:teuthology.orchestra.run.smithi157.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 309 kB/s | 172 kB 00:00 2024-04-03T08:23:51.249 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:51.249 INFO:teuthology.orchestra.run.smithi157.stdout:Total 15 MB/s | 36 MB 00:02 2024-04-03T08:23:51.567 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:23:51.590 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:23:51.590 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:23:52.033 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:24 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:23:52.142 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:23:52.145 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:23:52.770 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:23:52.922 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-03T08:23:53.070 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-03T08:23:53.230 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-03T08:23:53.769 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 47 k 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:23:53.771 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:23:53.772 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:23:53.773 INFO:teuthology.orchestra.run.smithi181.stdout:Install 13 Packages 2024-04-03T08:23:53.773 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:23:53.773 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 1.9 M 2024-04-03T08:23:53.773 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 25 M 2024-04-03T08:23:53.773 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:23:53.887 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-03T08:23:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-03T08:23:54.198 INFO:teuthology.orchestra.run.smithi181.stdout:(1/13): ceph-mgr-rook-17.2.7-805.g6fda41ff.el8. 166 kB/s | 47 kB 00:00 2024-04-03T08:23:54.223 INFO:teuthology.orchestra.run.smithi181.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 86 kB/s | 27 kB 00:00 2024-04-03T08:23:54.239 INFO:teuthology.orchestra.run.smithi181.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 61 kB/s | 20 kB 00:00 2024-04-03T08:23:54.515 INFO:teuthology.orchestra.run.smithi181.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 399 kB/s | 126 kB 00:00 2024-04-03T08:23:54.540 INFO:teuthology.orchestra.run.smithi181.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 366 kB/s | 110 kB 00:00 2024-04-03T08:23:54.682 INFO:teuthology.orchestra.run.smithi181.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 232 kB/s | 33 kB 00:00 2024-04-03T08:23:54.699 INFO:teuthology.orchestra.run.smithi181.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 337 kB/s | 155 kB 00:00 2024-04-03T08:23:54.723 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-03T08:23:54.733 INFO:teuthology.orchestra.run.smithi181.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 325 kB/s | 16 kB 00:00 2024-04-03T08:23:54.825 INFO:teuthology.orchestra.run.smithi181.stdout:(9/13): python3-requests-oauthlib-1.0.0-1.el8.n 138 kB/s | 43 kB 00:00 2024-04-03T08:23:54.850 INFO:teuthology.orchestra.run.smithi181.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 538 kB/s | 81 kB 00:00 2024-04-03T08:23:54.892 INFO:teuthology.orchestra.run.smithi181.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 954 kB/s | 64 kB 00:00 2024-04-03T08:23:54.897 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-03T08:23:54.951 INFO:teuthology.orchestra.run.smithi181.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 5.4 MB/s | 1.2 MB 00:00 2024-04-03T08:23:54.992 INFO:teuthology.orchestra.run.smithi181.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 432 kB/s | 61 kB 00:00 2024-04-03T08:23:54.993 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:23:54.993 INFO:teuthology.orchestra.run.smithi181.stdout:Total 1.6 MB/s | 1.9 MB 00:01 2024-04-03T08:23:55.113 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:23:55.132 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:23:55.132 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:23:55.242 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:23:55.246 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:23:55.702 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-03T08:23:55.858 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:23:56.063 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-03T08:23:56.090 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-04-03T08:23:56.288 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-03T08:23:56.303 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-04-03T08:23:56.512 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-04-03T08:23:56.772 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-04-03T08:23:56.997 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-04-03T08:23:57.225 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-04-03T08:23:57.515 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-04-03T08:23:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-04-03T08:23:58.295 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-03T08:23:59.017 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-04-03T08:23:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-04-03T08:23:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-04-03T08:23:59.629 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-03T08:23:59.701 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-04-03T08:23:59.838 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff 8/8 2024-04-03T08:23:59.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 13/13 2024-04-03T08:24:00.261 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff 8/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff 1/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-03T08:24:00.262 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-03T08:24:00.268 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 13/13 2024-04-03T08:24:00.268 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 1/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-04-03T08:24:00.269 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-04-03T08:24:00.716 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-03T08:24:00.716 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:00.716 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:00.716 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:24:00.716 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:00.717 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-03T08:24:00.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:00.768 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:00.878 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-rook 2024-04-03T08:24:00.915 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-cephadm 2024-04-03T08:24:01.793 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:33 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:01.830 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:33 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:03.489 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:03.491 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:03.491 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:24:03.491 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 47 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-03T08:24:03.492 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:03.493 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 1.9 M 2024-04-03T08:24:03.494 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 25 M 2024-04-03T08:24:03.494 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:24:03.646 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 123 k 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:03.648 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:03.649 INFO:teuthology.orchestra.run.smithi181.stdout:Install 5 Packages 2024-04-03T08:24:03.649 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:03.649 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 6.0 M 2024-04-03T08:24:03.649 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 26 M 2024-04-03T08:24:03.649 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:04.050 INFO:teuthology.orchestra.run.smithi181.stdout:(1/5): ceph-mgr-cephadm-17.2.7-805.g6fda41ff.el 577 kB/s | 123 kB 00:00 2024-04-03T08:24:04.054 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): ceph-mgr-rook-17.2.7-805.g6fda41ff.el8. 176 kB/s | 47 kB 00:00 2024-04-03T08:24:04.079 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 90 kB/s | 27 kB 00:00 2024-04-03T08:24:04.105 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 63 kB/s | 20 kB 00:00 2024-04-03T08:24:04.355 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 421 kB/s | 126 kB 00:00 2024-04-03T08:24:04.405 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 366 kB/s | 110 kB 00:00 2024-04-03T08:24:04.500 INFO:teuthology.orchestra.run.smithi181.stdout:(2/5): python3-jinja2-2.10.1-4.el8.noarch.rpm 871 kB/s | 578 kB 00:00 2024-04-03T08:24:04.505 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 330 kB/s | 33 kB 00:00 2024-04-03T08:24:04.548 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 393 kB/s | 16 kB 00:00 2024-04-03T08:24:04.573 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 331 kB/s | 155 kB 00:00 2024-04-03T08:24:04.606 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.4 MB/s | 81 kB 00:00 2024-04-03T08:24:04.626 INFO:teuthology.orchestra.run.smithi181.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 828 kB/s | 476 kB 00:00 2024-04-03T08:24:04.657 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 1.4 MB/s | 64 kB 00:00 2024-04-03T08:24:04.682 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): python3-requests-oauthlib-1.0.0-1.el8. 130 kB/s | 43 kB 00:00 2024-04-03T08:24:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2024-04-03T08:24:04.809 INFO:teuthology.orchestra.run.smithi181.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 4.9 MB/s | 4.8 MB 00:00 2024-04-03T08:24:04.835 INFO:teuthology.orchestra.run.smithi181.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 180 kB/s | 60 kB 00:00 2024-04-03T08:24:04.835 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:04.836 INFO:teuthology.orchestra.run.smithi181.stdout:Total 5.1 MB/s | 6.0 MB 00:01 2024-04-03T08:24:04.857 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.1 MB/s | 1.2 MB 00:00 2024-04-03T08:24:04.859 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:04.860 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2024-04-03T08:24:04.911 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:04.925 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:04.926 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:04.982 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:24:05.001 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:24:05.001 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:24:05.050 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:05.053 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:05.113 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:24:05.116 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:24:05.342 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:05.680 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2024-04-03T08:24:05.705 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:24:05.914 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-04-03T08:24:06.109 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-04-03T08:24:06.335 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-04-03T08:24:06.595 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-04-03T08:24:06.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-03T08:24:06.829 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-04-03T08:24:07.059 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-04-03T08:24:07.152 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2024-04-03T08:24:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 4/5 2024-04-03T08:24:07.620 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 5/5 2024-04-03T08:24:07.753 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-04-03T08:24:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 5/5 2024-04-03T08:24:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/5 2024-04-03T08:24:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2024-04-03T08:24:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/5 2024-04-03T08:24:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-03T08:24:08.007 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-03T08:24:08.413 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-03T08:24:08.414 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-03T08:24:08.414 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:08.414 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:08.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-fuse 2024-04-03T08:24:09.237 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-04-03T08:24:09.492 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:41 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:09.503 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-04-03T08:24:09.679 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-04-03T08:24:09.907 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-04-03T08:24:10.103 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 13/13 2024-04-03T08:24:10.466 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 13/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 1/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-04-03T08:24:10.467 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-03T08:24:11.000 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:11.001 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:11.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-cephadm 2024-04-03T08:24:11.178 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 876 k 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:Install 2 Packages 2024-04-03T08:24:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:11.180 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 959 k 2024-04-03T08:24:11.180 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 3.1 M 2024-04-03T08:24:11.180 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:11.502 INFO:teuthology.orchestra.run.smithi181.stdout:(1/2): ceph-fuse-17.2.7-805.g6fda41ff.el8.x86_6 3.2 MB/s | 876 kB 00:00 2024-04-03T08:24:11.618 INFO:teuthology.orchestra.run.smithi181.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 216 kB/s | 83 kB 00:00 2024-04-03T08:24:11.618 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:11.619 INFO:teuthology.orchestra.run.smithi181.stdout:Total 2.1 MB/s | 959 kB 00:00 2024-04-03T08:24:11.640 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:11.664 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:11.665 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:11.773 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:11.776 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:11.965 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:12.069 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:44 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-03T08:24:12.452 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 2/2 2024-04-03T08:24:13.054 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 2/2 2024-04-03T08:24:13.055 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/2 2024-04-03T08:24:13.533 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-03T08:24:13.533 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:13.533 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:13.533 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-03T08:24:13.533 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:13.533 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:13.774 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:17.2.7-805.g6fda41ff.el8 ceph-noarch 123 k 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:13.775 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:24:13.776 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:13.776 INFO:teuthology.orchestra.run.smithi157.stdout:Install 5 Packages 2024-04-03T08:24:13.776 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:13.776 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 6.0 M 2024-04-03T08:24:13.776 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 26 M 2024-04-03T08:24:13.776 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:24:13.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librados-devel 2024-04-03T08:24:14.482 INFO:teuthology.orchestra.run.smithi157.stdout:(1/5): ceph-mgr-cephadm-17.2.7-805.g6fda41ff.el 377 kB/s | 123 kB 00:00 2024-04-03T08:24:14.818 INFO:teuthology.orchestra.run.smithi157.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.4 MB/s | 476 kB 00:00 2024-04-03T08:24:14.857 INFO:teuthology.orchestra.run.smithi157.stdout:(3/5): python3-jinja2-2.10.1-4.el8.noarch.rpm 823 kB/s | 578 kB 00:00 2024-04-03T08:24:14.862 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:46 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:14.882 INFO:teuthology.orchestra.run.smithi157.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 904 kB/s | 60 kB 00:00 2024-04-03T08:24:15.349 INFO:teuthology.orchestra.run.smithi157.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 4.0 MB/s | 4.8 MB 00:01 2024-04-03T08:24:15.351 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:15.352 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.8 MB/s | 6.0 MB 00:01 2024-04-03T08:24:15.428 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:24:15.443 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:24:15.443 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:24:15.572 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:24:15.575 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:24:15.873 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:24:16.236 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2024-04-03T08:24:16.537 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 130 k 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 130 k 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 464 k 2024-04-03T08:24:16.539 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:16.773 INFO:teuthology.orchestra.run.smithi181.stdout:librados-devel-17.2.7-805.g6fda41ff.el8.x86_64. 559 kB/s | 130 kB 00:00 2024-04-03T08:24:16.773 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:16.773 INFO:teuthology.orchestra.run.smithi181.stdout:Total 554 kB/s | 130 kB 00:00 2024-04-03T08:24:16.774 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:16.781 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:16.781 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:16.839 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:16.842 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:17.209 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:17.326 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-03T08:24:17.620 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:17.698 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2024-04-03T08:24:18.060 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:18.060 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:18.060 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:18.060 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:18.060 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:18.060 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:18.078 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 4/5 2024-04-03T08:24:18.285 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 5/5 2024-04-03T08:24:18.307 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install libcephfs2 2024-04-03T08:24:18.629 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 5/5 2024-04-03T08:24:18.629 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 1/5 2024-04-03T08:24:18.629 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2024-04-03T08:24:18.629 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/5 2024-04-03T08:24:18.630 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:17.2.7-805.g6fda41ff.el8.noarch 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-03T08:24:19.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-03T08:24:19.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-03T08:24:19.053 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:19.053 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:19.209 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-fuse 2024-04-03T08:24:19.241 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:51 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:20.128 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:52 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:20.864 INFO:teuthology.orchestra.run.smithi181.stdout:Package libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:20.915 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:20.916 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:20.916 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:21.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install libcephfs-devel 2024-04-03T08:24:21.836 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 876 k 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:21.837 INFO:teuthology.orchestra.run.smithi157.stdout:Install 2 Packages 2024-04-03T08:24:21.838 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:21.838 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 959 k 2024-04-03T08:24:21.838 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 3.1 M 2024-04-03T08:24:21.838 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:24:21.954 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:53 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:22.166 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): ceph-fuse-17.2.7-805.g6fda41ff.el8.x86_6 3.1 MB/s | 876 kB 00:00 2024-04-03T08:24:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 214 kB/s | 83 kB 00:00 2024-04-03T08:24:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.1 MB/s | 959 kB 00:00 2024-04-03T08:24:22.305 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:24:22.330 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:24:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:24:22.440 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:24:22.444 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:24:22.636 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:24:22.951 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-03T08:24:23.176 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 2/2 2024-04-03T08:24:23.692 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 25 k 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:24:23.693 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:23.694 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 25 k 2024-04-03T08:24:23.694 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 109 k 2024-04-03T08:24:23.694 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:23.783 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 2/2 2024-04-03T08:24:23.783 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/2 2024-04-03T08:24:24.014 INFO:teuthology.orchestra.run.smithi181.stdout:libcephfs-devel-17.2.7-805.g6fda41ff.el8.x86_64 78 kB/s | 25 kB 00:00 2024-04-03T08:24:24.014 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:24.015 INFO:teuthology.orchestra.run.smithi181.stdout:Total 77 kB/s | 25 kB 00:00 2024-04-03T08:24:24.015 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:24.020 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:24.020 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:24.024 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:24.027 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:24.079 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:24.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-03T08:24:24.221 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:24.221 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:24.221 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-03T08:24:24.221 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:24.221 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:24.282 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:24.468 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados-devel 2024-04-03T08:24:24.596 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:24.996 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:24.996 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:24.996 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:24.996 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:24.996 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:24.996 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:25.141 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librados2 2024-04-03T08:24:25.392 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:57 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:26.067 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:58 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:27.082 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:27.082 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 130 k 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:24:27.083 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:27.084 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 130 k 2024-04-03T08:24:27.084 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 464 k 2024-04-03T08:24:27.084 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:24:27.444 INFO:teuthology.orchestra.run.smithi157.stdout:librados-devel-17.2.7-805.g6fda41ff.el8.x86_64. 360 kB/s | 130 kB 00:00 2024-04-03T08:24:27.445 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:27.445 INFO:teuthology.orchestra.run.smithi157.stdout:Total 359 kB/s | 130 kB 00:00 2024-04-03T08:24:27.446 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:24:27.453 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:24:27.453 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:24:27.512 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:24:27.515 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:24:27.639 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:24:27.687 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:27.741 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:27.742 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:27.742 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:27.866 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:27.867 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librbd1 2024-04-03T08:24:28.260 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:28.786 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:00 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:29.893 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:29.893 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:29.893 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:29.893 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:29.893 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:29.893 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:30.122 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs2 2024-04-03T08:24:30.419 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:30.472 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:30.473 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:30.473 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:30.602 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rados 2024-04-03T08:24:31.063 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:03 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:31.511 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:03 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:32.726 INFO:teuthology.orchestra.run.smithi157.stdout:Package libcephfs2-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:32.777 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:32.778 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:32.779 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:32.895 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs-devel 2024-04-03T08:24:33.174 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:33.226 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:33.227 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:33.228 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:33.338 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rgw 2024-04-03T08:24:33.808 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:05 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:34.250 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:06 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:35.490 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:35.490 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:35.490 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 25 k 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:24:35.491 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:35.492 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 25 k 2024-04-03T08:24:35.492 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 109 k 2024-04-03T08:24:35.492 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:24:35.745 INFO:teuthology.orchestra.run.smithi157.stdout:libcephfs-devel-17.2.7-805.g6fda41ff.el8.x86_64 98 kB/s | 25 kB 00:00 2024-04-03T08:24:35.746 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:35.746 INFO:teuthology.orchestra.run.smithi157.stdout:Total 98 kB/s | 25 kB 00:00 2024-04-03T08:24:35.746 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:24:35.751 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:24:35.751 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:24:35.755 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:24:35.758 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:24:35.813 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:24:35.876 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:35.927 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:35.928 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:35.928 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:35.997 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:36.042 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-cephfs 2024-04-03T08:24:36.293 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:36.672 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:36.672 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:36.672 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:36.672 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:36.672 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:36.673 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:36.826 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados2 2024-04-03T08:24:36.952 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:08 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:37.751 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:09 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:38.579 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:38.632 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:38.634 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:38.634 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:38.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rbd 2024-04-03T08:24:39.589 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:39.641 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:39.642 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:39.642 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:39.649 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:11 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:39.780 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librbd1 2024-04-03T08:24:40.709 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:12 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:41.283 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:41.336 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:41.337 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-04-03T08:24:41.337 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:41.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-fuse 2024-04-03T08:24:42.377 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:14 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:42.529 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:42.581 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:42.583 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:42.583 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:42.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rados 2024-04-03T08:24:43.619 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:15 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:44.168 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 91 k 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:24:44.169 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:44.170 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 91 k 2024-04-03T08:24:44.170 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 268 k 2024-04-03T08:24:44.170 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:44.387 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-fuse-17.2.7-805.g6fda41ff.el8.x86_64.rpm 418 kB/s | 91 kB 00:00 2024-04-03T08:24:44.387 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:44.388 INFO:teuthology.orchestra.run.smithi181.stdout:Total 415 kB/s | 91 kB 00:00 2024-04-03T08:24:44.388 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:44.400 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:44.400 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:44.457 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:44.460 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:44.829 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:45.212 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:45.260 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rados-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:45.312 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:45.313 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:45.313 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:45.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rgw 2024-04-03T08:24:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:45.747 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:45.747 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:45.996 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-mirror 2024-04-03T08:24:46.352 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:18 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:46.925 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:18 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:48.011 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rgw-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:48.062 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:48.064 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:48.064 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:48.179 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-cephfs 2024-04-03T08:24:48.630 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:48.631 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-04-03T08:24:48.631 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:48.631 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 3.5 M 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 3.5 M 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 16 M 2024-04-03T08:24:48.632 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:49.097 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:21 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:49.434 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-mirror-17.2.7-805.g6fda41ff.el8.x86_64.rpm 4.3 MB/s | 3.5 MB 00:00 2024-04-03T08:24:49.434 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:49.435 INFO:teuthology.orchestra.run.smithi181.stdout:Total 4.3 MB/s | 3.5 MB 00:00 2024-04-03T08:24:49.435 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:49.447 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:49.447 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:49.517 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:49.520 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:50.002 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:50.931 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-cephfs-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:50.982 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:50.984 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:50.984 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:51.093 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rbd 2024-04-03T08:24:51.251 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:51.251 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:51.251 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:51.251 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:51.251 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:51.251 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:51.502 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-nbd 2024-04-03T08:24:52.016 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:24 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:52.426 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:03:24 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:53.651 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rbd-2:17.2.7-805.g6fda41ff.el8.x86_64 is already installed. 2024-04-03T08:24:53.703 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:53.705 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-04-03T08:24:53.705 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:53.826 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-fuse 2024-04-03T08:24:54.145 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-03T08:24:54.146 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-04-03T08:24:54.146 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:54.146 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-03T08:24:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 175 k 2024-04-03T08:24:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:54.147 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-03T08:24:54.147 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-03T08:24:54.147 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-04-03T08:24:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:54.147 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 175 k 2024-04-03T08:24:54.147 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 556 k 2024-04-03T08:24:54.148 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-03T08:24:54.394 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-nbd-17.2.7-805.g6fda41ff.el8.x86_64.rpm 711 kB/s | 175 kB 00:00 2024-04-03T08:24:54.394 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:54.394 INFO:teuthology.orchestra.run.smithi181.stdout:Total 706 kB/s | 175 kB 00:00 2024-04-03T08:24:54.395 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-03T08:24:54.408 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-03T08:24:54.408 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-03T08:24:54.464 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-03T08:24:54.467 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-03T08:24:54.591 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-03T08:24:54.748 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:26 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:24:54.818 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:55.625 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:55.625 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:55.625 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-03T08:24:55.625 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:55.625 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:24:55.625 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-03T08:24:55.844 DEBUG:teuthology.parallel:result is None 2024-04-03T08:24:56.496 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:24:56.496 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:56.496 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 91 k 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:24:56.497 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:56.498 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 91 k 2024-04-03T08:24:56.498 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 268 k 2024-04-03T08:24:56.498 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:24:56.801 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-fuse-17.2.7-805.g6fda41ff.el8.x86_64.rpm 299 kB/s | 91 kB 00:00 2024-04-03T08:24:56.802 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:24:56.802 INFO:teuthology.orchestra.run.smithi157.stdout:Total 298 kB/s | 91 kB 00:00 2024-04-03T08:24:56.803 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:24:56.814 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:24:56.814 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:24:56.871 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:24:56.874 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:24:56.998 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:24:57.234 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:57.616 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:57.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:24:57.996 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:57.996 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:24:57.996 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:24:57.996 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:24:57.997 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:24:58.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-mirror 2024-04-03T08:24:59.163 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:31 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:25:00.817 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 3.5 M 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:25:00.818 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:25:00.819 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:00.819 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 3.5 M 2024-04-03T08:25:00.819 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 16 M 2024-04-03T08:25:00.819 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:25:01.554 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-mirror-17.2.7-805.g6fda41ff.el8.x86_64.rpm 4.7 MB/s | 3.5 MB 00:00 2024-04-03T08:25:01.554 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:25:01.555 INFO:teuthology.orchestra.run.smithi157.stdout:Total 4.7 MB/s | 3.5 MB 00:00 2024-04-03T08:25:01.555 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:25:01.570 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:25:01.570 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:25:01.640 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:25:01.644 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:25:02.130 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:25:02.319 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:25:03.003 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:25:03.425 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:25:03.425 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:03.425 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:25:03.425 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:25:03.425 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:03.425 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:25:03.651 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-nbd 2024-04-03T08:25:04.587 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:36 ago on Wed 03 Apr 2024 08:21:28 AM UTC. 2024-04-03T08:25:06.291 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-03T08:25:06.292 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:25:06.292 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-04-03T08:25:06.292 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:25:06.292 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:17.2.7-805.g6fda41ff.el8 ceph 175 k 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 175 k 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 556 k 2024-04-03T08:25:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-03T08:25:06.623 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-nbd-17.2.7-805.g6fda41ff.el8.x86_64.rpm 530 kB/s | 175 kB 00:00 2024-04-03T08:25:06.624 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:25:06.624 INFO:teuthology.orchestra.run.smithi157.stdout:Total 527 kB/s | 175 kB 00:00 2024-04-03T08:25:06.624 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-03T08:25:06.638 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-03T08:25:06.638 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-03T08:25:06.696 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-03T08:25:06.699 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-03T08:25:06.818 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-03T08:25:07.065 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:25:07.449 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:25:07.903 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 1/1 2024-04-03T08:25:07.903 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:07.903 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-03T08:25:07.903 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:17.2.7-805.g6fda41ff.el8.x86_64 2024-04-03T08:25:07.904 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:25:07.904 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-03T08:25:08.171 DEBUG:teuthology.parallel:result is None 2024-04-03T08:25:08.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:25:08.172 INFO:teuthology.packaging:ref: None 2024-04-03T08:25:08.172 INFO:teuthology.packaging:tag: None 2024-04-03T08:25:08.172 INFO:teuthology.packaging:branch: quincy 2024-04-03T08:25:08.172 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:25:08.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-03T08:25:08.409 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-03T08:25:08.462 INFO:teuthology.orchestra.run.smithi157.stdout:17.2.7-805.g6fda41ff.el8 2024-04-03T08:25:08.463 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-805.g6fda41ff.el8 2024-04-03T08:25:08.463 INFO:teuthology.task.install:The correct ceph version 17.2.7-805.g6fda41ff is installed. 2024-04-03T08:25:08.465 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T08:25:08.465 INFO:teuthology.packaging:ref: None 2024-04-03T08:25:08.465 INFO:teuthology.packaging:tag: None 2024-04-03T08:25:08.465 INFO:teuthology.packaging:branch: quincy 2024-04-03T08:25:08.465 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:25:08.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-03T08:25:08.784 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-03T08:25:08.844 INFO:teuthology.orchestra.run.smithi181.stdout:17.2.7-805.g6fda41ff.el8 2024-04-03T08:25:08.844 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-805.g6fda41ff.el8 2024-04-03T08:25:08.844 INFO:teuthology.task.install:The correct ceph version 17.2.7-805.g6fda41ff is installed. 2024-04-03T08:25:08.846 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-03T08:25:08.846 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:25:08.846 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-03T08:25:08.914 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:25:08.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-03T08:25:08.986 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-03T08:25:08.986 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:25:08.986 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-04-03T08:25:09.053 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-03T08:25:09.159 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:25:09.159 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-04-03T08:25:09.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-03T08:25:09.335 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-03T08:25:09.335 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:25:09.335 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-03T08:25:09.402 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-03T08:25:09.508 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:25:09.508 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-03T08:25:09.573 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-03T08:25:09.678 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-03T08:25:09.678 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:25:09.679 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-04-03T08:25:09.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-03T08:25:09.851 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:25:09.851 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-04-03T08:25:09.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-03T08:25:10.023 INFO:teuthology.run_tasks:Running task print... 2024-04-03T08:25:10.035 INFO:teuthology.task.print:**** done install task... 2024-04-03T08:25:10.036 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-03T08:25:10.198 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-04-03T08:25:10.198 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-03T08:25:10.199 INFO:tasks.cephadm:Cluster fsid is af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:25:10.199 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-03T08:25:10.199 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-03T08:25:10.199 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi157': '172.21.15.157', 'mon.smithi181': '172.21.15.181'} 2024-04-03T08:25:10.199 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-03T08:25:10.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-04-03T08:25:10.267 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-04-03T08:25:10.335 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-03T08:25:10.336 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-03T08:25:10.702 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-rw-r--. 1 ubuntu ubuntu 375153 Apr 3 08:25 /home/ubuntu/cephtest/cephadm 2024-04-03T08:25:10.702 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-03T08:25:11.080 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-rw-r--. 1 ubuntu ubuntu 375153 Apr 3 08:25 /home/ubuntu/cephtest/cephadm 2024-04-03T08:25:11.081 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-03T08:25:11.129 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-03T08:25:11.189 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-03T08:25:11.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-03T08:25:11.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-03T08:25:12.415 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-03T08:25:12.563 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-03T08:27:37.484 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-04-03T08:27:37.485 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)", 2024-04-03T08:27:37.485 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "a49113eacc58832dc36e13e21ab00e230e7480fa0f05e368736a82d00d143a48", 2024-04-03T08:27:37.485 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-04-03T08:27:37.485 INFO:teuthology.orchestra.run.smithi181.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:bc7712ec89fede52a2d1211e734d3862c877e03d01eec5cccb6e6be746353030" 2024-04-03T08:27:37.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-04-03T08:27:37.485 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-04-03T08:27:50.930 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:27:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)", 2024-04-03T08:27:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "a49113eacc58832dc36e13e21ab00e230e7480fa0f05e368736a82d00d143a48", 2024-04-03T08:27:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2024-04-03T08:27:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:bc7712ec89fede52a2d1211e734d3862c877e03d01eec5cccb6e6be746353030" 2024-04-03T08:27:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-04-03T08:27:50.931 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:27:50.957 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-04-03T08:27:51.027 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-04-03T08:27:51.106 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-04-03T08:27:51.172 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-04-03T08:27:51.240 INFO:tasks.cephadm:Writing seed config... 2024-04-03T08:27:51.241 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-03T08:27:51.241 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-03T08:27:51.241 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-03T08:27:51.242 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-03T08:27:51.243 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-03T08:27:51.244 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-03T08:27:51.245 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:27:51.245 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-03T08:27:51.289 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = af80a140-f193-11ee-b648-cb9ed24678a4 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-03T08:27:51.290 DEBUG:teuthology.orchestra.run.smithi157:mon.smithi157> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service 2024-04-03T08:27:51.333 INFO:tasks.cephadm:Bootstrapping... 2024-04-03T08:27:51.334 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid af80a140-f193-11ee-b648-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.157 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-03T08:27:51.400 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:-- Logs begin at Wed 2024-04-03 08:13:04 UTC. -- 2024-04-03T08:27:51.628 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-03T08:27:51.628 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'af80a140-f193-11ee-b648-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.157', '--skip-admin-label'] 2024-04-03T08:27:51.673 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-03T08:27:51.673 INFO:teuthology.orchestra.run.smithi157.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-03T08:27:51.674 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying podman|docker is present... 2024-04-03T08:27:51.719 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-03T08:27:51.719 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying lvm2 is present... 2024-04-03T08:27:51.719 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying time synchronization is in place... 2024-04-03T08:27:51.733 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-03T08:27:51.733 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-03T08:27:51.745 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-03T08:27:51.745 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout inactive 2024-04-03T08:27:51.758 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout enabled 2024-04-03T08:27:51.771 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout active 2024-04-03T08:27:51.771 INFO:teuthology.orchestra.run.smithi157.stdout:Unit chronyd.service is enabled and running 2024-04-03T08:27:51.771 INFO:teuthology.orchestra.run.smithi157.stdout:Repeating the final host check... 2024-04-03T08:27:51.816 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-03T08:27:51.816 INFO:teuthology.orchestra.run.smithi157.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-03T08:27:51.816 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl is present 2024-04-03T08:27:51.816 INFO:teuthology.orchestra.run.smithi157.stdout:lvcreate is present 2024-04-03T08:27:51.828 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-03T08:27:51.829 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-03T08:27:51.840 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-03T08:27:51.841 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout inactive 2024-04-03T08:27:51.853 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout enabled 2024-04-03T08:27:51.865 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout active 2024-04-03T08:27:51.866 INFO:teuthology.orchestra.run.smithi157.stdout:Unit chronyd.service is enabled and running 2024-04-03T08:27:51.866 INFO:teuthology.orchestra.run.smithi157.stdout:Host looks OK 2024-04-03T08:27:51.866 INFO:teuthology.orchestra.run.smithi157.stdout:Cluster fsid: af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:27:51.866 INFO:teuthology.orchestra.run.smithi157.stdout:Acquiring lock 139915110699920 on /run/cephadm/af80a140-f193-11ee-b648-cb9ed24678a4.lock 2024-04-03T08:27:51.866 INFO:teuthology.orchestra.run.smithi157.stdout:Lock 139915110699920 acquired on /run/cephadm/af80a140-f193-11ee-b648-cb9ed24678a4.lock 2024-04-03T08:27:51.867 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying IP 172.21.15.157 port 3300 ... 2024-04-03T08:27:51.867 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying IP 172.21.15.157 port 6789 ... 2024-04-03T08:27:51.867 INFO:teuthology.orchestra.run.smithi157.stdout:Base mon IP(s) is [172.21.15.157:3300, 172.21.15.157:6789], mon addrv is [v2:172.21.15.157:3300,v1:172.21.15.157:6789] 2024-04-03T08:27:51.875 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.157 metric 100 2024-04-03T08:27:51.875 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.157 metric 100 2024-04-03T08:27:51.882 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-03T08:27:51.882 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-03T08:27:51.882 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1787sec hoplimit 64 pref medium 2024-04-03T08:27:51.889 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-03T08:27:51.889 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-03T08:27:51.889 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-03T08:27:51.889 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-03T08:27:51.889 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-04-03T08:27:51.889 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-03T08:27:51.890 INFO:teuthology.orchestra.run.smithi157.stdout:Mon IP `172.21.15.157` is in CIDR network `172.21.0.0/20` 2024-04-03T08:27:51.890 INFO:teuthology.orchestra.run.smithi157.stdout:Mon IP `172.21.15.157` is in CIDR network `172.21.0.0/20` 2024-04-03T08:27:51.890 INFO:teuthology.orchestra.run.smithi157.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-03T08:27:51.890 INFO:teuthology.orchestra.run.smithi157.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-03T08:27:51.892 INFO:teuthology.orchestra.run.smithi157.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-03T08:27:53.331 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stdout a49113eacc58832dc36e13e21ab00e230e7480fa0f05e368736a82d00d143a48 2024-04-03T08:27:53.331 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-03T08:27:53.332 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stderr Getting image source signatures 2024-04-03T08:27:53.332 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stderr Copying blob sha256:7c8e66990dd5fdc46cc6d5e1ff7927cb8fbc9e77ba63bb5152631196a3d52311 2024-04-03T08:27:53.332 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stderr Copying blob sha256:77070339c81bcb5c53bbbf3f31a47f7187e5393cb0e096452852a31192d97570 2024-04-03T08:27:53.332 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stderr Copying config sha256:a49113eacc58832dc36e13e21ab00e230e7480fa0f05e368736a82d00d143a48 2024-04-03T08:27:53.332 INFO:teuthology.orchestra.run.smithi157.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-03T08:27:54.427 INFO:teuthology.orchestra.run.smithi157.stdout:ceph: stdout ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable) 2024-04-03T08:27:54.428 INFO:teuthology.orchestra.run.smithi157.stdout:Ceph version: ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable) 2024-04-03T08:27:54.428 INFO:teuthology.orchestra.run.smithi157.stdout:Extracting ceph user uid/gid from container image... 2024-04-03T08:27:55.447 INFO:teuthology.orchestra.run.smithi157.stdout:stat: stdout 167 167 2024-04-03T08:27:55.447 INFO:teuthology.orchestra.run.smithi157.stdout:Creating initial keys... 2024-04-03T08:27:56.514 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph-authtool: stdout AQALEw1m3+AMMxAARAQ1b8eB79QF4TvRCMmEhg== 2024-04-03T08:27:57.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph-authtool: stdout AQAMEw1m64DeNRAAWYu9KT+XzZwDHlcxYo0slQ== 2024-04-03T08:27:58.729 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph-authtool: stdout AQAOEw1mVeoWABAABhtNmna8a/s8pFSqd3vS/g== 2024-04-03T08:27:58.730 INFO:teuthology.orchestra.run.smithi157.stdout:Creating initial monmap... 2024-04-03T08:27:59.869 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-03T08:27:59.869 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-03T08:27:59.869 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:27:59.869 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-03T08:27:59.869 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool for smithi157 [v2:172.21.15.157:3300,v1:172.21.15.157:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-03T08:27:59.869 INFO:teuthology.orchestra.run.smithi157.stdout:setting min_mon_release = octopus 2024-04-03T08:27:59.870 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/monmaptool: set fsid to af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:27:59.870 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-03T08:27:59.870 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:27:59.870 INFO:teuthology.orchestra.run.smithi157.stdout:Creating mon... 2024-04-03T08:28:00.961 INFO:teuthology.orchestra.run.smithi157.stdout:create mon.smithi157 on 2024-04-03T08:28:01.165 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-04-03T08:28:01.344 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-03T08:28:01.535 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-af80a140-f193-11ee-b648-cb9ed24678a4.target → /etc/systemd/system/ceph-af80a140-f193-11ee-b648-cb9ed24678a4.target. 2024-04-03T08:28:01.535 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-af80a140-f193-11ee-b648-cb9ed24678a4.target → /etc/systemd/system/ceph-af80a140-f193-11ee-b648-cb9ed24678a4.target. 2024-04-03T08:28:01.802 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157 2024-04-03T08:28:01.802 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Failed to reset failed state of unit ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service: Unit ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service not loaded. 2024-04-03T08:28:02.005 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-af80a140-f193-11ee-b648-cb9ed24678a4.target.wants/ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service → /etc/systemd/system/ceph-af80a140-f193-11ee-b648-cb9ed24678a4@.service. 2024-04-03T08:28:02.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:02 smithi157 systemd[1]: Starting Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:28:02.690 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-03T08:28:02.690 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout disabled 2024-04-03T08:28:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-03T08:28:02.707 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout inactive 2024-04-03T08:28:02.707 INFO:teuthology.orchestra.run.smithi157.stdout:firewalld.service is not enabled 2024-04-03T08:28:02.707 INFO:teuthology.orchestra.run.smithi157.stdout:Not possible to enable service . firewalld.service is not available 2024-04-03T08:28:02.707 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for mon to start... 2024-04-03T08:28:02.707 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for mon... 2024-04-03T08:28:02.944 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:02 smithi157 ceph-mon[34595]: mkfs af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:02.945 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:02 smithi157 ceph-mon[34595]: mon.smithi157 is new leader, mons smithi157 in quorum (ranks 0) 2024-04-03T08:28:02.945 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:02 smithi157 bash[34557]: 5e07867bf80b75b38bfb5f63fc67b456fcf3063a804280d36768aa85145c1bc4 2024-04-03T08:28:02.945 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:02 smithi157 systemd[1]: Started Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:28:03.868 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout cluster: 2024-04-03T08:28:03.875 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout id: af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:03.875 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-03T08:28:03.875 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout services: 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi157 (age 0.670342s) 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout data: 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout pgs: 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:03.876 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.235+0000 7f7227a00700 1 Processor -- start 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.236+0000 7f7227a00700 1 -- start start 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.236+0000 7f7227a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f7220076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.236+0000 7f7227a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220077f00 con 0x7f7220077af0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.237+0000 7f7225000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f7220076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.237+0000 7f7225000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f7220076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42332/0 (socket says 172.21.15.157:42332) 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.237+0000 7f7225000700 1 -- 172.21.15.157:0/1175991959 learned_addr learned my addr 172.21.15.157:0/1175991959 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.237+0000 7f7225000700 1 -- 172.21.15.157:0/1175991959 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220078040 con 0x7f7220077af0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f7225000700 1 --2- 172.21.15.157:0/1175991959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f7220076140 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72140098e0 tx=0x7f7214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a823565ab2e106 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f721f400700 1 -- 172.21.15.157:0/1175991959 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721400b860 con 0x7f7220077af0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f721f400700 1 -- 172.21.15.157:0/1175991959 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400b9c0 con 0x7f7220077af0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f721f400700 1 -- 172.21.15.157:0/1175991959 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721400bc90 con 0x7f7220077af0 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f7227a00700 1 -- 172.21.15.157:0/1175991959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 msgr2=0x7f7220076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f7227a00700 1 --2- 172.21.15.157:0/1175991959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f7220076140 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72140098e0 tx=0x7f7214009250 comp rx=0 tx=0).stop 2024-04-03T08:28:03.877 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f7227a00700 1 -- 172.21.15.157:0/1175991959 shutdown_connections 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f7227a00700 1 --2- 172.21.15.157:0/1175991959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f7220076140 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.238+0000 7f7227a00700 1 -- 172.21.15.157:0/1175991959 >> 172.21.15.157:0/1175991959 conn(0x7f72200fe090 msgr2=0x7f7220100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.239+0000 7f7227a00700 1 -- 172.21.15.157:0/1175991959 shutdown_connections 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.239+0000 7f7227a00700 1 -- 172.21.15.157:0/1175991959 wait complete. 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.239+0000 7f7227a00700 1 Processor -- start 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.240+0000 7f7227a00700 1 -- start start 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.240+0000 7f7227a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f72201130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.240+0000 7f7227a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220113630 con 0x7f7220077af0 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.240+0000 7f7225000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f72201130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.240+0000 7f7225000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f72201130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42334/0 (socket says 172.21.15.157:42334) 2024-04-03T08:28:03.878 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.240+0000 7f7225000700 1 -- 172.21.15.157:0/2793740280 learned_addr learned my addr 172.21.15.157:0/2793740280 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f7225000700 1 -- 172.21.15.157:0/2793740280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140094f0 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f7225000700 1 --2- 172.21.15.157:0/2793740280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f72201130f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7214009290 tx=0x7f7214016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721401c5c0 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721401c740 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721401ca50 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220113830 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.241+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72201143a0 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.242+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f721401a450 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.242+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f721402e790 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.242+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722005f5f0 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.245+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f721401ce30 con 0x7f7220077af0 2024-04-03T08:28:03.879 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.317+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7220114e70 con 0x7f7220077af0 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.318+0000 7f721cc00700 1 -- 172.21.15.157:0/2793740280 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f721401a890 con 0x7f7220077af0 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 msgr2=0x7f72201130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 --2- 172.21.15.157:0/2793740280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f72201130f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7214009290 tx=0x7f7214016000 comp rx=0 tx=0).stop 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 shutdown_connections 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 --2- 172.21.15.157:0/2793740280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7220077af0 0x7f72201130f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 >> 172.21.15.157:0/2793740280 conn(0x7f72200fe090 msgr2=0x7f7220109f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 shutdown_connections 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:03.319+0000 7f7227a00700 1 -- 172.21.15.157:0/2793740280 wait complete. 2024-04-03T08:28:03.880 INFO:teuthology.orchestra.run.smithi157.stdout:mon is available 2024-04-03T08:28:03.881 INFO:teuthology.orchestra.run.smithi157.stdout:Assimilating anything we can from ceph.conf... 2024-04-03T08:28:03.881 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:03 smithi157 ceph-mon[34595]: mon.smithi157 is new leader, mons smithi157 in quorum (ranks 0) 2024-04-03T08:28:03.881 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:03 smithi157 ceph-mon[34595]: monmap e1: 1 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:28:03.881 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:03 smithi157 ceph-mon[34595]: fsmap 2024-04-03T08:28:03.881 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:03 smithi157 ceph-mon[34595]: osdmap e1: 0 total, 0 up, 0 in 2024-04-03T08:28:03.881 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:03 smithi157 ceph-mon[34595]: mgrmap e1: no daemons active 2024-04-03T08:28:03.881 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:03 smithi157 ceph-mon[34595]: from='client.? 172.21.15.157:0/2793740280' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-03T08:28:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:04 smithi157 ceph-mon[34595]: from='client.? 172.21.15.157:0/1599186868' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-03T08:28:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:04 smithi157 ceph-mon[34595]: from='client.? 172.21.15.157:0/1599186868' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout [global] 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout fsid = af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.157:3300,v1:172.21.15.157:6789] 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-03T08:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout [osd] 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-03T08:28:05.347 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.439+0000 7f4100000700 1 Processor -- start 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.439+0000 7f4100000700 1 -- start start 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.439+0000 7f4100000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f8076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.439+0000 7f4100000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f8077ee0 con 0x7f40f8077ad0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.440+0000 7f40fd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f8076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.440+0000 7f40fd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f8076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42338/0 (socket says 172.21.15.157:42338) 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.440+0000 7f40fd600700 1 -- 172.21.15.157:0/2217344590 learned_addr learned my addr 172.21.15.157:0/2217344590 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.440+0000 7f40fd600700 1 -- 172.21.15.157:0/2217344590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8078020 con 0x7f40f8077ad0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.440+0000 7f40fd600700 1 --2- 172.21.15.157:0/2217344590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f8076120 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0098e0 tx=0x7f40ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc94cb02a6e90d17 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f40f7e00700 1 -- 172.21.15.157:0/2217344590 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40ec00b860 con 0x7f40f8077ad0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f40f7e00700 1 -- 172.21.15.157:0/2217344590 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec00b9c0 con 0x7f40f8077ad0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f40f7e00700 1 -- 172.21.15.157:0/2217344590 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40ec00bc90 con 0x7f40f8077ad0 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 -- 172.21.15.157:0/2217344590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 msgr2=0x7f40f8076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:05.348 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 --2- 172.21.15.157:0/2217344590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f8076120 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0098e0 tx=0x7f40ec009250 comp rx=0 tx=0).stop 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 -- 172.21.15.157:0/2217344590 shutdown_connections 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 --2- 172.21.15.157:0/2217344590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f8076120 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 -- 172.21.15.157:0/2217344590 >> 172.21.15.157:0/2217344590 conn(0x7f40f80fe090 msgr2=0x7f40f8100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 -- 172.21.15.157:0/2217344590 shutdown_connections 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.441+0000 7f4100000700 1 -- 172.21.15.157:0/2217344590 wait complete. 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.442+0000 7f4100000700 1 Processor -- start 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.443+0000 7f4100000700 1 -- start start 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.443+0000 7f4100000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f81130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.443+0000 7f4100000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f8113610 con 0x7f40f8077ad0 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.443+0000 7f40fd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f81130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.443+0000 7f40fd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f81130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42340/0 (socket says 172.21.15.157:42340) 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.443+0000 7f40fd600700 1 -- 172.21.15.157:0/1599186868 learned_addr learned my addr 172.21.15.157:0/1599186868 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:05.349 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f40fd600700 1 -- 172.21.15.157:0/1599186868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0094f0 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f40fd600700 1 --2- 172.21.15.157:0/1599186868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f81130d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009290 tx=0x7f40ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40ec01c5c0 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec01c740 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f8113810 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40ec01ca50 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.444+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f8114380 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.445+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f40ec01a450 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.445+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f40ec02e790 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.446+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f805f5f0 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.448+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f40ec01ce30 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.516+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f40f80769d0 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.521+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f40ec02e950 con 0x7f40f8077ad0 2024-04-03T08:28:05.350 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.521+0000 7f40f5600700 1 -- 172.21.15.157:0/1599186868 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f40f80769d0 con 0x7f40f8077ad0 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 msgr2=0x7f40f81130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 --2- 172.21.15.157:0/1599186868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f81130d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009290 tx=0x7f40ec016000 comp rx=0 tx=0).stop 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 shutdown_connections 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 --2- 172.21.15.157:0/1599186868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40f8077ad0 0x7f40f81130d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 >> 172.21.15.157:0/1599186868 conn(0x7f40f80fe090 msgr2=0x7f40f8109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 shutdown_connections 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:04.522+0000 7f4100000700 1 -- 172.21.15.157:0/1599186868 wait complete. 2024-04-03T08:28:05.351 INFO:teuthology.orchestra.run.smithi157.stdout:Generating new minimal ceph.conf... 2024-04-03T08:28:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:06 smithi157 ceph-mon[34595]: from='client.? 172.21.15.157:0/2402339545' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.880+0000 7fbeea400700 1 Processor -- start 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.880+0000 7fbeea400700 1 -- start start 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.880+0000 7fbeea400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.880+0000 7fbeea400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4077f00 con 0x7fbee4077af0 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.881+0000 7fbee3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.881+0000 7fbee3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42342/0 (socket says 172.21.15.157:42342) 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.881+0000 7fbee3400700 1 -- 172.21.15.157:0/3061063233 learned_addr learned my addr 172.21.15.157:0/3061063233 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.881+0000 7fbee3400700 1 -- 172.21.15.157:0/3061063233 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4078040 con 0x7fbee4077af0 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.881+0000 7fbee3400700 1 --2- 172.21.15.157:0/3061063233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4076140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098e0 tx=0x7fbed4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905fbebd3a4a3944 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.881+0000 7fbee2000700 1 -- 172.21.15.157:0/3061063233 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbed400b860 con 0x7fbee4077af0 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbee2000700 1 -- 172.21.15.157:0/3061063233 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbed400be50 con 0x7fbee4077af0 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbee2000700 1 -- 172.21.15.157:0/3061063233 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbed4010380 con 0x7fbee4077af0 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 -- 172.21.15.157:0/3061063233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 msgr2=0x7fbee4076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 --2- 172.21.15.157:0/3061063233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4076140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098e0 tx=0x7fbed4009250 comp rx=0 tx=0).stop 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 -- 172.21.15.157:0/3061063233 shutdown_connections 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 --2- 172.21.15.157:0/3061063233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4076140 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 -- 172.21.15.157:0/3061063233 >> 172.21.15.157:0/3061063233 conn(0x7fbee40fe090 msgr2=0x7fbee4100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 -- 172.21.15.157:0/3061063233 shutdown_connections 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.882+0000 7fbeea400700 1 -- 172.21.15.157:0/3061063233 wait complete. 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.883+0000 7fbeea400700 1 Processor -- start 2024-04-03T08:28:06.627 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.883+0000 7fbeea400700 1 -- start start 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbeea400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbeea400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4113e90 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbee3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbee3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42356/0 (socket says 172.21.15.157:42356) 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbee3400700 1 -- 172.21.15.157:0/2402339545 learned_addr learned my addr 172.21.15.157:0/2402339545 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbee3400700 1 -- 172.21.15.157:0/2402339545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed40094f0 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbee3400700 1 --2- 172.21.15.157:0/2402339545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4113950 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbed4011bd0 tx=0x7fbed4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.884+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbed40107c0 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.885+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbed4010db0 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.885+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee4114090 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.885+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbed401ad60 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.885+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee4114c00 con 0x7fbee4077af0 2024-04-03T08:28:06.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.885+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbed402e6c0 con 0x7fbee4077af0 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.885+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbed4024870 con 0x7fbee4077af0 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.886+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee405f5f0 con 0x7fbee4077af0 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.889+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbed401a5c0 con 0x7fbee4077af0 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.959+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fbee4108ac0 con 0x7fbee4077af0 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.960+0000 7fbedb400700 1 -- 172.21.15.157:0/2402339545 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fbed4010920 con 0x7fbee4077af0 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 msgr2=0x7fbee4113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 --2- 172.21.15.157:0/2402339545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4113950 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbed4011bd0 tx=0x7fbed4009250 comp rx=0 tx=0).stop 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 shutdown_connections 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 --2- 172.21.15.157:0/2402339545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbee4077af0 0x7fbee4113950 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 >> 172.21.15.157:0/2402339545 conn(0x7fbee40fe090 msgr2=0x7fbee40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 shutdown_connections 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:05.961+0000 7fbeea400700 1 -- 172.21.15.157:0/2402339545 wait complete. 2024-04-03T08:28:06.629 INFO:teuthology.orchestra.run.smithi157.stdout:Restarting the monitor... 2024-04-03T08:28:06.944 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:06 smithi157 systemd[1]: Stopping Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:28:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:06 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[34571]: 2024-04-03T08:28:06.941+0000 7efcfc000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi157 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:28:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:06 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[34571]: 2024-04-03T08:28:06.941+0000 7efcfc000700 -1 mon.smithi157@0(leader) e1 *** Got Signal Terminated *** 2024-04-03T08:28:07.745 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:07 smithi157 bash[34921]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157 2024-04-03T08:28:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:07 smithi157 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service: Succeeded. 2024-04-03T08:28:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:07 smithi157 systemd[1]: Stopped Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:28:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:07 smithi157 systemd[1]: Starting Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:28:08.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: set uid:gid to 167:167 (ceph:ceph) 2024-04-03T08:28:08.605 INFO:teuthology.orchestra.run.smithi157.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-03T08:28:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable), process ceph-mon, pid 7 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: pidfile_write: ignore empty --pid-file 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: load: jerasure load: lrc 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: RocksDB version: 6.15.5 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Compile date Apr 3 2024 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: DB SUMMARY 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: DB Session ID: TRE4N1W7MRPRJ00TMOSG 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: CURRENT file: CURRENT 2024-04-03T08:28:08.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: IDENTITY file: IDENTITY 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi157/store.db dir, Total Num: 1, files: 000008.sst 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi157/store.db: 000010.log size: 98174 ; 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.error_if_exists: 0 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.create_if_missing: 0 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.paranoid_checks: 1 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.env: 0x5647897a6a80 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.fs: Posix File System 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.info_log: 0x56478a097c00 2024-04-03T08:28:08.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_file_opening_threads: 16 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.statistics: (nil) 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.use_fsync: 0 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_log_file_size: 0 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.keep_log_file_num: 1000 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.recycle_log_file_num: 0 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.allow_fallocate: 1 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.allow_mmap_reads: 0 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.allow_mmap_writes: 0 2024-04-03T08:28:08.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.use_direct_reads: 0 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.create_missing_column_families: 0 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.db_log_dir: 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi157/store.db 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.advise_random_on_open: 1 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.db_write_buffer_size: 0 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.write_buffer_manager: 0x56478ae0c990 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-03T08:28:08.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.rate_limiter: (nil) 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.wal_recovery_mode: 2 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.enable_thread_tracking: 0 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.enable_pipelined_write: 0 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.unordered_write: 0 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.row_cache: None 2024-04-03T08:28:08.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.wal_filter: None 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.allow_ingest_behind: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.preserve_deletes: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.two_write_queues: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.manual_wal_flush: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.atomic_flush: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.log_readahead_size: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.best_efforts_recovery: 0 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-03T08:28:08.821 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.allow_data_in_errors: 0 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.db_host_id: __hostname__ 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_background_jobs: 2 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_background_compactions: -1 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_subcompactions: 1 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_total_wal_size: 0 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-03T08:28:08.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_open_files: -1 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bytes_per_sync: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_readahead_size: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_background_flushes: -1 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Compression algorithms supported: 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kZSTD supported: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kXpressCompression supported: 0 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kLZ4HCCompression supported: 1 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kZlibCompression supported: 1 2024-04-03T08:28:08.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kSnappyCompression supported: 1 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kLZ4Compression supported: 1 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: kBZip2Compression supported: 0 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000009 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.merge_operator: 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_filter: None 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_filter_factory: None 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.sst_partitioner_factory: None 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56478a0ecf58) 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks: 1 2024-04-03T08:28:08.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_top_level_index_and_filter: 1 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_type: 0 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_index_type: 0 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_shortening: 1 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: hash_index_allow_collision: 1 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: checksum: 1 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: no_block_cache: 0 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache: 0x56478a11f090 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_name: BinnedLRUCache 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_options: 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: capacity : 536870912 2024-04-03T08:28:08.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: num_shard_bits : 4 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: strict_capacity_limit : 0 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: high_pri_pool_ratio: 0.000 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_compressed: (nil) 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: persistent_cache: (nil) 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size: 4096 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size_deviation: 10 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_restart_interval: 16 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_block_restart_interval: 1 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: metadata_block_size: 4096 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: partition_filters: 0 2024-04-03T08:28:08.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: use_delta_encoding: 1 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: whole_key_filtering: 1 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: verify_compression: 0 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: read_amp_bytes_per_bit: 0 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: format_version: 4 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_index_compression: 1 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_align: 0 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.write_buffer_size: 33554432 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_write_buffer_number: 2 2024-04-03T08:28:08.827 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression: NoCompression 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression: Disabled 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.prefix_extractor: nullptr 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.num_levels: 7 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-03T08:28:08.828 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-03T08:28:08.829 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-03T08:28:08.829 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-03T08:28:08.829 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-03T08:28:08.829 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:28:08.829 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-03T08:28:08.829 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-03T08:28:08.830 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-03T08:28:08.830 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.level: 32767 2024-04-03T08:28:08.830 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.strategy: 0 2024-04-03T08:28:08.830 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-03T08:28:08.830 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:28:08.830 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-03T08:28:08.831 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compression_opts.enabled: false 2024-04-03T08:28:08.831 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-03T08:28:08.831 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-03T08:28:08.831 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-03T08:28:08.831 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.target_file_size_base: 67108864 2024-04-03T08:28:08.831 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-03T08:28:08.832 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-03T08:28:08.833 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-03T08:28:08.833 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-03T08:28:08.833 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-03T08:28:08.833 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-03T08:28:08.833 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-03T08:28:08.833 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.arena_block_size: 4194304 2024-04-03T08:28:08.834 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-03T08:28:08.834 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-03T08:28:08.834 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-03T08:28:08.834 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.disable_auto_compactions: 0 2024-04-03T08:28:08.834 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-03T08:28:08.834 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-03T08:28:08.835 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-03T08:28:08.836 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-03T08:28:08.836 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.table_properties_collectors: 2024-04-03T08:28:08.836 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.inplace_update_support: 0 2024-04-03T08:28:08.836 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-03T08:28:08.836 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-03T08:28:08.836 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-03T08:28:08.837 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-03T08:28:08.837 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.bloom_locality: 0 2024-04-03T08:28:08.837 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.max_successive_merges: 0 2024-04-03T08:28:08.837 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-03T08:28:08.837 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.paranoid_file_checks: 0 2024-04-03T08:28:08.837 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.force_consistency_checks: 1 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.report_bg_io_stats: 0 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.ttl: 2592000 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.enable_blob_files: false 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.min_blob_size: 0 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.blob_file_size: 268435456 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-03T08:28:08.838 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712132888568814, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-03T08:28:08.839 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712132888570390, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93380, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91492, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84056, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1712132888, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "28fa53ed-c737-4e54-9c3f-577a6ad30c90", "db_session_id": "TRE4N1W7MRPRJ00TMOSG"}} 2024-04-03T08:28:08.840 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-03T08:28:08.840 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712132888570991, "job": 1, "event": "recovery_finished"} 2024-04-03T08:28:08.840 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi157/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-03T08:28:08.840 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56478a0b3180 2024-04-03T08:28:08.840 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: DB pointer 0x56478a188000 2024-04-03T08:28:08.840 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-03T08:28:08.841 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-03T08:28:08.841 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** DB Stats ** 2024-04-03T08:28:08.841 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:28:08.841 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-03T08:28:08.841 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-03T08:28:08.841 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:28:08.842 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-03T08:28:08.842 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-03T08:28:08.842 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:28:08.842 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.842 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-04-03T08:28:08.842 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:28:08.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:28:08.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-04-03T08:28:08.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:28:08.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:28:08.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:28:08.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-03T08:28:08.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-03T08:28:08.845 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-03T08:28:08.845 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-03T08:28:08.845 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-03T08:28:08.845 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative compaction: 0.00 GB write, 13.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:28:08.845 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval compaction: 0.00 GB write, 13.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:28:08.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-03T08:28:08.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-03T08:28:08.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-04-03T08:28:08.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-04-03T08:28:08.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:28:08.848 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:28:08.848 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 85.9 0.00 0.00 1 0.001 0 0 2024-04-03T08:28:08.848 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:28:08.848 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-03T08:28:08.848 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative compaction: 0.00 GB write, 13.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-03T08:28:08.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-03T08:28:08.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: starting mon.smithi157 rank 0 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi157 fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:08.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???) e1 preinit fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:08.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).mds e1 new map 2024-04-03T08:28:08.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).mds e1 print_map 2024-04-03T08:28:08.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: e1 2024-04-03T08:28:08.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:28:08.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:28:08.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: legacy client fscid: -1 2024-04-03T08:28:08.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:28:08.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: No filesystems configured 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 bash[35046]: 645a846e71d99d9db0b67f068eec9dc9f09c46d23f73ae612761979eb16bda8d 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 systemd[1]: Started Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mon.smithi157 is new leader, mons smithi157 in quorum (ranks 0) 2024-04-03T08:28:08.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: monmap e1: 1 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:28:08.853 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: fsmap 2024-04-03T08:28:08.853 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: osdmap e1: 0 total, 0 up, 0 in 2024-04-03T08:28:08.853 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:08 smithi157 ceph-mon[35083]: mgrmap e1: no daemons active 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.180+0000 7f40c1e00700 1 Processor -- start 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.180+0000 7f40c1e00700 1 -- start start 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.180+0000 7f40c1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.180+0000 7f40c1e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc077eb0 con 0x7f40bc077aa0 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.181+0000 7f40c0a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.181+0000 7f40c0a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42370/0 (socket says 172.21.15.157:42370) 2024-04-03T08:28:09.847 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.181+0000 7f40c0a00700 1 -- 172.21.15.157:0/238483653 learned_addr learned my addr 172.21.15.157:0/238483653 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.181+0000 7f40c0a00700 1 -- 172.21.15.157:0/238483653 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc077ff0 con 0x7f40bc077aa0 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40c0a00700 1 --2- 172.21.15.157:0/238483653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc076140 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f40b00098e0 tx=0x7f40b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6411d4298cba3f63 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40bb400700 1 -- 172.21.15.157:0/238483653 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b000b8f0 con 0x7f40bc077aa0 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40bb400700 1 -- 172.21.15.157:0/238483653 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f40b0011420 con 0x7f40bc077aa0 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40bb400700 1 -- 172.21.15.157:0/238483653 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b0010540 con 0x7f40bc077aa0 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40c1e00700 1 -- 172.21.15.157:0/238483653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 msgr2=0x7f40bc076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40c1e00700 1 --2- 172.21.15.157:0/238483653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc076140 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f40b00098e0 tx=0x7f40b0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40c1e00700 1 -- 172.21.15.157:0/238483653 shutdown_connections 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40c1e00700 1 --2- 172.21.15.157:0/238483653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc076140 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.182+0000 7f40c1e00700 1 -- 172.21.15.157:0/238483653 >> 172.21.15.157:0/238483653 conn(0x7f40bc0fdef0 msgr2=0x7f40bc100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.183+0000 7f40c1e00700 1 -- 172.21.15.157:0/238483653 shutdown_connections 2024-04-03T08:28:09.848 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.183+0000 7f40c1e00700 1 -- 172.21.15.157:0/238483653 wait complete. 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.184+0000 7f40c1e00700 1 Processor -- start 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.184+0000 7f40c1e00700 1 -- start start 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.184+0000 7f40c1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.184+0000 7f40c1e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc113cd0 con 0x7f40bc077aa0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40c0a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40c0a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42384/0 (socket says 172.21.15.157:42384) 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40c0a00700 1 -- 172.21.15.157:0/421975255 learned_addr learned my addr 172.21.15.157:0/421975255 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40c0a00700 1 -- 172.21.15.157:0/421975255 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00094f0 con 0x7f40bc077aa0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40c0a00700 1 --2- 172.21.15.157:0/421975255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc113790 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f40b00094c0 tx=0x7f40b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b0010800 con 0x7f40bc077aa0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.185+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f40b0010df0 con 0x7f40bc077aa0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.186+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc113ed0 con 0x7f40bc077aa0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.186+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b0024e50 con 0x7f40bc077aa0 2024-04-03T08:28:09.849 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.186+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc114a40 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.186+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f40b001a740 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.186+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f40b002d9a0 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.187+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc05f5f0 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.189+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f40b00246d0 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.258+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f40bc108900 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.260+0000 7f40b8c00700 1 -- 172.21.15.157:0/421975255 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f40b00350c0 con 0x7f40bc077aa0 2024-04-03T08:28:09.850 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.261+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 msgr2=0x7f40bc113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.261+0000 7f40c1e00700 1 --2- 172.21.15.157:0/421975255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc113790 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f40b00094c0 tx=0x7f40b0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.261+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 shutdown_connections 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.261+0000 7f40c1e00700 1 --2- 172.21.15.157:0/421975255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc077aa0 0x7f40bc113790 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.261+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 >> 172.21.15.157:0/421975255 conn(0x7f40bc0fdef0 msgr2=0x7f40bc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.261+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 shutdown_connections 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:09.262+0000 7f40c1e00700 1 -- 172.21.15.157:0/421975255 wait complete. 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Creating mgr... 2024-04-03T08:28:09.851 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying port 9283 ... 2024-04-03T08:28:10.106 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mgr.smithi157.qfvynr 2024-04-03T08:28:10.106 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Failed to reset failed state of unit ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mgr.smithi157.qfvynr.service: Unit ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mgr.smithi157.qfvynr.service not loaded. 2024-04-03T08:28:10.291 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-af80a140-f193-11ee-b648-cb9ed24678a4.target.wants/ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mgr.smithi157.qfvynr.service → /etc/systemd/system/ceph-af80a140-f193-11ee-b648-cb9ed24678a4@.service. 2024-04-03T08:28:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:10 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/421975255' entity='client.admin' 2024-04-03T08:28:11.058 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-03T08:28:11.058 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout disabled 2024-04-03T08:28:11.075 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-03T08:28:11.075 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout inactive 2024-04-03T08:28:11.075 INFO:teuthology.orchestra.run.smithi157.stdout:firewalld.service is not enabled 2024-04-03T08:28:11.075 INFO:teuthology.orchestra.run.smithi157.stdout:Not possible to enable service . firewalld.service is not available 2024-04-03T08:28:11.094 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-03T08:28:11.094 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout disabled 2024-04-03T08:28:11.113 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-03T08:28:11.113 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout inactive 2024-04-03T08:28:11.113 INFO:teuthology.orchestra.run.smithi157.stdout:firewalld.service is not enabled 2024-04-03T08:28:11.113 INFO:teuthology.orchestra.run.smithi157.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-03T08:28:11.113 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for mgr to start... 2024-04-03T08:28:11.113 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for mgr... 2024-04-03T08:28:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:11 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2597550749' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "fsid": "af80a140-f193-11ee-b648-cb9ed24678a4", 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "health": { 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-03T08:28:12.312 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-03T08:28:12.313 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.313 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-03T08:28:12.313 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-03T08:28:12.313 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 0 2024-04-03T08:28:12.313 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:12.313 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "smithi157" 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-03T08:28:12.314 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-03T08:28:12.315 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-03T08:28:12.323 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.324 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "restful" 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "modified": "2024-04-03T08:28:02.651280+0000", 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-03T08:28:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.706+0000 7f2f44000700 1 Processor -- start 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.707+0000 7f2f44000700 1 -- start start 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.707+0000 7f2f44000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.707+0000 7f2f44000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c1032c0 con 0x7f2f3c102970 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.708+0000 7f2f41600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.708+0000 7f2f41600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42422/0 (socket says 172.21.15.157:42422) 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.708+0000 7f2f41600700 1 -- 172.21.15.157:0/432094648 learned_addr learned my addr 172.21.15.157:0/432094648 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:12.326 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.708+0000 7f2f41600700 1 -- 172.21.15.157:0/432094648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c103400 con 0x7f2f3c102970 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.708+0000 7f2f41600700 1 --2- 172.21.15.157:0/432094648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c102d80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f300098e0 tx=0x7f2f30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6cb87b83d5dc37 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f3be00700 1 -- 172.21.15.157:0/432094648 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f3000b860 con 0x7f2f3c102970 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f3be00700 1 -- 172.21.15.157:0/432094648 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2f3000be50 con 0x7f2f3c102970 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f3be00700 1 -- 172.21.15.157:0/432094648 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f30010380 con 0x7f2f3c102970 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f44000700 1 -- 172.21.15.157:0/432094648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 msgr2=0x7f2f3c102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f44000700 1 --2- 172.21.15.157:0/432094648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c102d80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f300098e0 tx=0x7f2f30009250 comp rx=0 tx=0).stop 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f44000700 1 -- 172.21.15.157:0/432094648 shutdown_connections 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f44000700 1 --2- 172.21.15.157:0/432094648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c102d80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.709+0000 7f2f44000700 1 -- 172.21.15.157:0/432094648 >> 172.21.15.157:0/432094648 conn(0x7f2f3c0fe090 msgr2=0x7f2f3c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.710+0000 7f2f44000700 1 -- 172.21.15.157:0/432094648 shutdown_connections 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.710+0000 7f2f44000700 1 -- 172.21.15.157:0/432094648 wait complete. 2024-04-03T08:28:12.327 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.710+0000 7f2f44000700 1 Processor -- start 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.711+0000 7f2f44000700 1 -- start start 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.711+0000 7f2f44000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.711+0000 7f2f44000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c113ec0 con 0x7f2f3c102970 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.711+0000 7f2f41600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.711+0000 7f2f41600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42434/0 (socket says 172.21.15.157:42434) 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.711+0000 7f2f41600700 1 -- 172.21.15.157:0/2597550749 learned_addr learned my addr 172.21.15.157:0/2597550749 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f41600700 1 -- 172.21.15.157:0/2597550749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300094f0 con 0x7f2f3c102970 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f41600700 1 --2- 172.21.15.157:0/2597550749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c113980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000ba90 tx=0x7f2f30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f300107c0 con 0x7f2f3c102970 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2f30010db0 con 0x7f2f3c102970 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c1140c0 con 0x7f2f3c102970 2024-04-03T08:28:12.328 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f3001add0 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.712+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c114c30 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.713+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2f3002e6c0 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.713+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2f30024870 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.713+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c05f5f0 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.716+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2f30029070 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.791+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2f3c04bed0 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.792+0000 7f2f39600700 1 -- 172.21.15.157:0/2597550749 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f2f3001a430 con 0x7f2f3c102970 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 msgr2=0x7f2f3c113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 --2- 172.21.15.157:0/2597550749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c113980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000ba90 tx=0x7f2f30009250 comp rx=0 tx=0).stop 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 shutdown_connections 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 --2- 172.21.15.157:0/2597550749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f3c102970 0x7f2f3c113980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 >> 172.21.15.157:0/2597550749 conn(0x7f2f3c0fe090 msgr2=0x7f2f3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 shutdown_connections 2024-04-03T08:28:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:11.793+0000 7f2f44000700 1 -- 172.21.15.157:0/2597550749 wait complete. 2024-04-03T08:28:12.330 INFO:teuthology.orchestra.run.smithi157.stdout:mgr not available, waiting (1/15)... 2024-04-03T08:28:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:15 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1041301537' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-03T08:28:19.463 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: Activating manager daemon smithi157.qfvynr 2024-04-03T08:28:19.463 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: mgrmap e2: smithi157.qfvynr(active, starting, since 0.00416238s) 2024-04-03T08:28:19.463 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:28:19.463 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:28:19.463 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:28:19.463 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:28:19.464 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:28:19.464 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:19 smithi157 ceph-mon[35083]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:28:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:20 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:28:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:20 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:28:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:20 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:20 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:20 smithi157 ceph-mon[35083]: from='mgr.14100 172.21.15.157:0/699195828' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:20.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:20 smithi157 ceph-mon[35083]: mgrmap e3: smithi157.qfvynr(active, since 1.00924s) 2024-04-03T08:28:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:22 smithi157 ceph-mon[35083]: mgrmap e4: smithi157.qfvynr(active, since 2s) 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "fsid": "af80a140-f193-11ee-b648-cb9ed24678a4", 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "health": { 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 0 2024-04-03T08:28:24.683 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "smithi157" 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-03T08:28:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-03T08:28:24.692 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-03T08:28:24.692 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-03T08:28:24.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "restful" 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "modified": "2024-04-03T08:28:02.651280+0000", 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.900+0000 7fe837600700 1 Processor -- start 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.900+0000 7fe837600700 1 -- start start 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.900+0000 7fe837600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.900+0000 7fe837600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830102180 con 0x7fe830101830 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.901+0000 7fe834c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.901+0000 7fe834c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43886/0 (socket says 172.21.15.157:43886) 2024-04-03T08:28:24.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.901+0000 7fe834c00700 1 -- 172.21.15.157:0/1849500382 learned_addr learned my addr 172.21.15.157:0/1849500382 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.901+0000 7fe834c00700 1 -- 172.21.15.157:0/1849500382 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8301022c0 con 0x7fe830101830 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.902+0000 7fe834c00700 1 --2- 172.21.15.157:0/1849500382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830101c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8240098e0 tx=0x7fe824009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6203ce524b992f server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.902+0000 7fe82f400700 1 -- 172.21.15.157:0/1849500382 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe82400b860 con 0x7fe830101830 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.902+0000 7fe82f400700 1 -- 172.21.15.157:0/1849500382 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe82400be50 con 0x7fe830101830 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.902+0000 7fe82f400700 1 -- 172.21.15.157:0/1849500382 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe824010380 con 0x7fe830101830 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.902+0000 7fe837600700 1 -- 172.21.15.157:0/1849500382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 msgr2=0x7fe830101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.902+0000 7fe837600700 1 --2- 172.21.15.157:0/1849500382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830101c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8240098e0 tx=0x7fe824009250 comp rx=0 tx=0).stop 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.903+0000 7fe837600700 1 -- 172.21.15.157:0/1849500382 shutdown_connections 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.903+0000 7fe837600700 1 --2- 172.21.15.157:0/1849500382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830101c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.903+0000 7fe837600700 1 -- 172.21.15.157:0/1849500382 >> 172.21.15.157:0/1849500382 conn(0x7fe8300fcfb0 msgr2=0x7fe8300ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.903+0000 7fe837600700 1 -- 172.21.15.157:0/1849500382 shutdown_connections 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.903+0000 7fe837600700 1 -- 172.21.15.157:0/1849500382 wait complete. 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.903+0000 7fe837600700 1 Processor -- start 2024-04-03T08:28:24.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.904+0000 7fe837600700 1 -- start start 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.904+0000 7fe837600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.904+0000 7fe837600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830113e80 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.904+0000 7fe834c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.904+0000 7fe834c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43892/0 (socket says 172.21.15.157:43892) 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.904+0000 7fe834c00700 1 -- 172.21.15.157:0/1041301537 learned_addr learned my addr 172.21.15.157:0/1041301537 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe834c00700 1 -- 172.21.15.157:0/1041301537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8240094f0 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe834c00700 1 --2- 172.21.15.157:0/1041301537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830113940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe82400ba90 tx=0x7fe824009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8240107c0 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe824010db0 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe830114080 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe82401add0 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.905+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe830114bf0 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.906+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe82402e440 con 0x7fe830101830 2024-04-03T08:28:24.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.906+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe824024740 con 0x7fe830101830 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.906+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83005f5f0 con 0x7fe830101830 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.909+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe824029070 con 0x7fe830101830 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.983+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe830103560 con 0x7fe830101830 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.984+0000 7fe82cc00700 1 -- 172.21.15.157:0/1041301537 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe824010ba0 con 0x7fe830101830 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 msgr2=0x7fe830113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 --2- 172.21.15.157:0/1041301537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830113940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe82400ba90 tx=0x7fe824009250 comp rx=0 tx=0).stop 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 shutdown_connections 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 --2- 172.21.15.157:0/1041301537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe830101830 0x7fe830113940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 >> 172.21.15.157:0/1041301537 conn(0x7fe8300fcfb0 msgr2=0x7fe8300fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 shutdown_connections 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:14.985+0000 7fe837600700 1 -- 172.21.15.157:0/1041301537 wait complete. 2024-04-03T08:28:24.698 INFO:teuthology.orchestra.run.smithi157.stdout:mgr not available, waiting (2/15)... 2024-04-03T08:28:27.912 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:27 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2664623970' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "fsid": "af80a140-f193-11ee-b648-cb9ed24678a4", 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "health": { 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 0 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:28.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "smithi157" 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "quorum_age": 19, 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-03T08:28:28.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-03T08:28:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-03T08:28:28.198 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "restful" 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ], 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "modified": "2024-04-03T08:28:02.651280+0000", 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout }, 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-03T08:28:28.199 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.329+0000 7f5613400700 1 Processor -- start 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.329+0000 7f5613400700 1 -- start start 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.330+0000 7f5613400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.330+0000 7f5613400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c077ee0 con 0x7f560c077ad0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.330+0000 7f5610a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.330+0000 7f5610a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48182/0 (socket says 172.21.15.157:48182) 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.330+0000 7f5610a00700 1 -- 172.21.15.157:0/2196820071 learned_addr learned my addr 172.21.15.157:0/2196820071 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.330+0000 7f5610a00700 1 -- 172.21.15.157:0/2196820071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c078020 con 0x7f560c077ad0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.331+0000 7f5610a00700 1 --2- 172.21.15.157:0/2196820071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c076120 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56000098e0 tx=0x7f5600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d94a7b0bec87c92 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.331+0000 7f560b400700 1 -- 172.21.15.157:0/2196820071 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f560000b860 con 0x7f560c077ad0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.331+0000 7f560b400700 1 -- 172.21.15.157:0/2196820071 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f560000be50 con 0x7f560c077ad0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.331+0000 7f560b400700 1 -- 172.21.15.157:0/2196820071 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5600010380 con 0x7f560c077ad0 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 -- 172.21.15.157:0/2196820071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 msgr2=0x7f560c076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 --2- 172.21.15.157:0/2196820071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c076120 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56000098e0 tx=0x7f5600009250 comp rx=0 tx=0).stop 2024-04-03T08:28:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 -- 172.21.15.157:0/2196820071 shutdown_connections 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 --2- 172.21.15.157:0/2196820071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c076120 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 -- 172.21.15.157:0/2196820071 >> 172.21.15.157:0/2196820071 conn(0x7f560c0fe090 msgr2=0x7f560c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 -- 172.21.15.157:0/2196820071 shutdown_connections 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.332+0000 7f5613400700 1 -- 172.21.15.157:0/2196820071 wait complete. 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5613400700 1 Processor -- start 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5613400700 1 -- start start 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5613400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5613400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c113e90 con 0x7f560c077ad0 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5610a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5610a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48192/0 (socket says 172.21.15.157:48192) 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.333+0000 7f5610a00700 1 -- 172.21.15.157:0/2664623970 learned_addr learned my addr 172.21.15.157:0/2664623970 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5610a00700 1 -- 172.21.15.157:0/2664623970 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000094f0 con 0x7f560c077ad0 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5610a00700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c113950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5600011bd0 tx=0x7f5600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56000107c0 con 0x7f560c077ad0 2024-04-03T08:28:28.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5600010db0 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f560001ad60 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c114090 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.334+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c114c00 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.335+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f560001a5c0 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.335+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c05f5f0 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.336+0000 7f5608c00700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f55f4036790 0x7f55f4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.336+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f560004aab0 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.336+0000 7f560be00700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f55f4036790 0x7f55f4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.337+0000 7f560be00700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f55f4036790 0x7f55f4038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009990 tx=0x7f55f8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.341+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5600023dd0 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.609+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f560c04bed0 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.609+0000 7f5608c00700 1 -- 172.21.15.157:0/2664623970 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f5600023390 con 0x7f560c077ad0 2024-04-03T08:28:28.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f55f4036790 msgr2=0x7f55f4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f55f4036790 0x7f55f4038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009990 tx=0x7f55f8006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 msgr2=0x7f560c113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c113950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5600011bd0 tx=0x7f5600009250 comp rx=0 tx=0).stop 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 shutdown_connections 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f55f4036790 0x7f55f4038c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 --2- 172.21.15.157:0/2664623970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f560c077ad0 0x7f560c113950 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.611+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 >> 172.21.15.157:0/2664623970 conn(0x7f560c0fe090 msgr2=0x7f560c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.612+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 shutdown_connections 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:27.612+0000 7f5613400700 1 -- 172.21.15.157:0/2664623970 wait complete. 2024-04-03T08:28:28.203 INFO:teuthology.orchestra.run.smithi157.stdout:mgr is available 2024-04-03T08:28:29.260 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:28 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/135026736' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-03T08:28:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout [global] 2024-04-03T08:28:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout fsid = af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-03T08:28:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-03T08:28:29.590 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout [osd] 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-03T08:28:29.591 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.731+0000 7f41c4e00700 1 Processor -- start 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.731+0000 7f41c4e00700 1 -- start start 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.731+0000 7f41c4e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.731+0000 7f41c4e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0077f00 con 0x7f41c0077af0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.732+0000 7f41bde00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.732+0000 7f41bde00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48208/0 (socket says 172.21.15.157:48208) 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.732+0000 7f41bde00700 1 -- 172.21.15.157:0/3277324337 learned_addr learned my addr 172.21.15.157:0/3277324337 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.732+0000 7f41bde00700 1 -- 172.21.15.157:0/3277324337 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0078040 con 0x7f41c0077af0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.732+0000 7f41bde00700 1 --2- 172.21.15.157:0/3277324337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0076140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41b00098e0 tx=0x7f41b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210ce527a6fe191e server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41bca00700 1 -- 172.21.15.157:0/3277324337 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41b000b860 con 0x7f41c0077af0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41bca00700 1 -- 172.21.15.157:0/3277324337 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f41b000be50 con 0x7f41c0077af0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41bca00700 1 -- 172.21.15.157:0/3277324337 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41b0010380 con 0x7f41c0077af0 2024-04-03T08:28:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41c4e00700 1 -- 172.21.15.157:0/3277324337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 msgr2=0x7f41c0076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41c4e00700 1 --2- 172.21.15.157:0/3277324337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0076140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41b00098e0 tx=0x7f41b0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41c4e00700 1 -- 172.21.15.157:0/3277324337 shutdown_connections 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41c4e00700 1 --2- 172.21.15.157:0/3277324337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0076140 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41c4e00700 1 -- 172.21.15.157:0/3277324337 >> 172.21.15.157:0/3277324337 conn(0x7f41c00fe090 msgr2=0x7f41c0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.733+0000 7f41c4e00700 1 -- 172.21.15.157:0/3277324337 shutdown_connections 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.734+0000 7f41c4e00700 1 -- 172.21.15.157:0/3277324337 wait complete. 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.734+0000 7f41c4e00700 1 Processor -- start 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.734+0000 7f41c4e00700 1 -- start start 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.735+0000 7f41c4e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.735+0000 7f41c4e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0113e90 con 0x7f41c0077af0 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.735+0000 7f41bde00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.735+0000 7f41bde00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48216/0 (socket says 172.21.15.157:48216) 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.735+0000 7f41bde00700 1 -- 172.21.15.157:0/135026736 learned_addr learned my addr 172.21.15.157:0/135026736 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.735+0000 7f41bde00700 1 -- 172.21.15.157:0/135026736 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b00094f0 con 0x7f41c0077af0 2024-04-03T08:28:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.736+0000 7f41bde00700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0113950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41b0011bd0 tx=0x7f41b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.736+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41b00107c0 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.736+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f41b0010db0 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.736+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41b001ad60 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.736+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c0114090 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.736+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c0114c00 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.737+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f41b001a5c0 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.737+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c005f5f0 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.737+0000 7f41b6000700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f41a4036790 0x7f41a4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.738+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f41b004aab0 con 0x7f41c0077af0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.738+0000 7f41bd400700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f41a4036790 0x7f41a4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.738+0000 7f41bd400700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f41a4036790 0x7f41a4038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009990 tx=0x7f41ac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.742+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f41b0023dd0 con 0x7f41c0077af0 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.937+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f41c004bed0 con 0x7f41c0077af0 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.938+0000 7f41b6000700 1 -- 172.21.15.157:0/135026736 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f41b0023390 con 0x7f41c0077af0 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.940+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f41a4036790 msgr2=0x7f41a4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.940+0000 7f41c4e00700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f41a4036790 0x7f41a4038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009990 tx=0x7f41ac006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.940+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 msgr2=0x7f41c0113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.940+0000 7f41c4e00700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0113950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41b0011bd0 tx=0x7f41b0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.941+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 shutdown_connections 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.941+0000 7f41c4e00700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f41a4036790 0x7f41a4038c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.941+0000 7f41c4e00700 1 --2- 172.21.15.157:0/135026736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41c0077af0 0x7f41c0113950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.941+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 >> 172.21.15.157:0/135026736 conn(0x7f41c00fe090 msgr2=0x7f41c00fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.941+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 shutdown_connections 2024-04-03T08:28:29.596 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:28.941+0000 7f41c4e00700 1 -- 172.21.15.157:0/135026736 wait complete. 2024-04-03T08:28:29.596 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling cephadm module... 2024-04-03T08:28:30.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:30 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4160400532' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-03T08:28:31.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.148+0000 7fd106c00700 1 Processor -- start 2024-04-03T08:28:31.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.149+0000 7fd106c00700 1 -- start start 2024-04-03T08:28:31.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.149+0000 7fd106c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:31.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.149+0000 7fd106c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100103280 con 0x7fd100102930 2024-04-03T08:28:31.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.149+0000 7fd0ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.149+0000 7fd0ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48220/0 (socket says 172.21.15.157:48220) 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.149+0000 7fd0ffe00700 1 -- 172.21.15.157:0/1904068999 learned_addr learned my addr 172.21.15.157:0/1904068999 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.150+0000 7fd0ffe00700 1 -- 172.21.15.157:0/1904068999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1001033c0 con 0x7fd100102930 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.150+0000 7fd0ffe00700 1 --2- 172.21.15.157:0/1904068999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100102d40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00098e0 tx=0x7fd0f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314a05019ff5ecca server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.150+0000 7fd0fea00700 1 -- 172.21.15.157:0/1904068999 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0f000b860 con 0x7fd100102930 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.150+0000 7fd0fea00700 1 -- 172.21.15.157:0/1904068999 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd0f000be50 con 0x7fd100102930 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.150+0000 7fd0fea00700 1 -- 172.21.15.157:0/1904068999 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0f0010380 con 0x7fd100102930 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 -- 172.21.15.157:0/1904068999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 msgr2=0x7fd100102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 --2- 172.21.15.157:0/1904068999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100102d40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00098e0 tx=0x7fd0f0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 -- 172.21.15.157:0/1904068999 shutdown_connections 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 --2- 172.21.15.157:0/1904068999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100102d40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:31.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 -- 172.21.15.157:0/1904068999 >> 172.21.15.157:0/1904068999 conn(0x7fd1000fe090 msgr2=0x7fd1001004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 -- 172.21.15.157:0/1904068999 shutdown_connections 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.151+0000 7fd106c00700 1 -- 172.21.15.157:0/1904068999 wait complete. 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.152+0000 7fd106c00700 1 Processor -- start 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.152+0000 7fd106c00700 1 -- start start 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.152+0000 7fd106c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.152+0000 7fd106c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100113ea0 con 0x7fd100102930 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.153+0000 7fd0ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.153+0000 7fd0ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48222/0 (socket says 172.21.15.157:48222) 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.153+0000 7fd0ffe00700 1 -- 172.21.15.157:0/4160400532 learned_addr learned my addr 172.21.15.157:0/4160400532 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.153+0000 7fd0ffe00700 1 -- 172.21.15.157:0/4160400532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f00094f0 con 0x7fd100102930 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.153+0000 7fd0ffe00700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100113960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000ba90 tx=0x7fd0f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.153+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0f00107c0 con 0x7fd100102930 2024-04-03T08:28:31.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.154+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd0f0010db0 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.154+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1001140a0 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.154+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0f001add0 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.154+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd100114c10 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.155+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fd0f0010920 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.155+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10005f5f0 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.155+0000 7fd0f7e00700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7fd0e4036790 0x7fd0e4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.155+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd0f004a170 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.156+0000 7fd0ff400700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7fd0e4036790 0x7fd0e4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.156+0000 7fd0ff400700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7fd0e4036790 0x7fd0e4038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009990 tx=0x7fd0ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.160+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd0f001a430 con 0x7fd100102930 2024-04-03T08:28:31.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.405+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fd10004bed0 con 0x7fd100102930 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.458+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd0f002d3f0 con 0x7fd100102930 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.460+0000 7fd0f7e00700 1 -- 172.21.15.157:0/4160400532 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fd0f000ed50 con 0x7fd100102930 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7fd0e4036790 msgr2=0x7fd0e4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7fd0e4036790 0x7fd0e4038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009990 tx=0x7fd0ec006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 msgr2=0x7fd100113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100113960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000ba90 tx=0x7fd0f0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 shutdown_connections 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7fd0e4036790 0x7fd0e4038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 --2- 172.21.15.157:0/4160400532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd100102930 0x7fd100113960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 >> 172.21.15.157:0/4160400532 conn(0x7fd1000fe090 msgr2=0x7fd1000febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 shutdown_connections 2024-04-03T08:28:31.159 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:30.463+0000 7fd106c00700 1 -- 172.21.15.157:0/4160400532 wait complete. 2024-04-03T08:28:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:31 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4160400532' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-03T08:28:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:31 smithi157 ceph-mon[35083]: mgrmap e5: smithi157.qfvynr(active, since 11s) 2024-04-03T08:28:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:32 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3615458956' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-03T08:28:32.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:28:32.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-03T08:28:32.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-03T08:28:32.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "active_name": "smithi157.qfvynr", 2024-04-03T08:28:32.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.717+0000 7f50c7600700 1 Processor -- start 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.717+0000 7f50c7600700 1 -- start start 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.717+0000 7f50c7600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.717+0000 7f50c7600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0077ec0 con 0x7f50c0077ab0 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.718+0000 7f50c4c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.718+0000 7f50c4c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48258/0 (socket says 172.21.15.157:48258) 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.718+0000 7f50c4c00700 1 -- 172.21.15.157:0/2529146635 learned_addr learned my addr 172.21.15.157:0/2529146635 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.718+0000 7f50c4c00700 1 -- 172.21.15.157:0/2529146635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0078000 con 0x7f50c0077ab0 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.718+0000 7f50c4c00700 1 --2- 172.21.15.157:0/2529146635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0076100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f50b40098e0 tx=0x7f50b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138b5c01765db2a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.719+0000 7f50bf400700 1 -- 172.21.15.157:0/2529146635 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b400b860 con 0x7f50c0077ab0 2024-04-03T08:28:32.629 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.719+0000 7f50bf400700 1 -- 172.21.15.157:0/2529146635 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f50b400be50 con 0x7f50c0077ab0 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.719+0000 7f50bf400700 1 -- 172.21.15.157:0/2529146635 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b4010380 con 0x7f50c0077ab0 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.719+0000 7f50c7600700 1 -- 172.21.15.157:0/2529146635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 msgr2=0x7f50c0076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.719+0000 7f50c7600700 1 --2- 172.21.15.157:0/2529146635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0076100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f50b40098e0 tx=0x7f50b4009250 comp rx=0 tx=0).stop 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.720+0000 7f50c7600700 1 -- 172.21.15.157:0/2529146635 shutdown_connections 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.720+0000 7f50c7600700 1 --2- 172.21.15.157:0/2529146635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0076100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.720+0000 7f50c7600700 1 -- 172.21.15.157:0/2529146635 >> 172.21.15.157:0/2529146635 conn(0x7f50c00fe090 msgr2=0x7f50c0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.720+0000 7f50c7600700 1 -- 172.21.15.157:0/2529146635 shutdown_connections 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.720+0000 7f50c7600700 1 -- 172.21.15.157:0/2529146635 wait complete. 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.720+0000 7f50c7600700 1 Processor -- start 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.721+0000 7f50c7600700 1 -- start start 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.721+0000 7f50c7600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:32.630 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.721+0000 7f50c7600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0113ed0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.721+0000 7f50c4c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.721+0000 7f50c4c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48268/0 (socket says 172.21.15.157:48268) 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.721+0000 7f50c4c00700 1 -- 172.21.15.157:0/3615458956 learned_addr learned my addr 172.21.15.157:0/3615458956 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50c4c00700 1 -- 172.21.15.157:0/3615458956 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40094f0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50c4c00700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0113990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50b4011bd0 tx=0x7f50b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b40107c0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f50b4010db0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c01140d0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b401ad00 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.722+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0114c40 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.723+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f50b40193c0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.723+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c005f5f0 con 0x7f50c0077ab0 2024-04-03T08:28:32.631 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.724+0000 7f50bcc00700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 0x7f50a8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.724+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f50b404a040 con 0x7f50c0077ab0 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.724+0000 7f50bfe00700 1 -- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 msgr2=0x7f50a8038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.724+0000 7f50bfe00700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 0x7f50a8038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.729+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f50b407c190 con 0x7f50c0077ab0 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.925+0000 7f50bfe00700 1 -- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 msgr2=0x7f50a8038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.925+0000 7f50bfe00700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 0x7f50a8038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.982+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f50c0114fe0 con 0x7f50c0077ab0 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.982+0000 7f50bcc00700 1 -- 172.21.15.157:0/3615458956 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f50b4024d30 con 0x7f50c0077ab0 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 msgr2=0x7f50a8038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:28:32.632 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 0x7f50a8038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 msgr2=0x7f50c0113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0113990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50b4011bd0 tx=0x7f50b4009250 comp rx=0 tx=0).stop 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 shutdown_connections 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f50a80367e0 0x7f50a8038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 --2- 172.21.15.157:0/3615458956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c0077ab0 0x7f50c0113990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 >> 172.21.15.157:0/3615458956 conn(0x7f50c00fe090 msgr2=0x7f50c00fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 shutdown_connections 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:31.985+0000 7f50c7600700 1 -- 172.21.15.157:0/3615458956 wait complete. 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for the mgr to restart... 2024-04-03T08:28:32.633 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for mgr epoch 5... 2024-04-03T08:28:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: Active manager daemon smithi157.qfvynr restarted 2024-04-03T08:28:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: Activating manager daemon smithi157.qfvynr 2024-04-03T08:28:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: osdmap e2: 0 total, 0 up, 0 in 2024-04-03T08:28:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: mgrmap e6: smithi157.qfvynr(active, starting, since 0.00451741s) 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:28:38.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:38 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:28:40.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:39 smithi157 ceph-mon[35083]: Found migration_current of "None". Setting to last migration. 2024-04-03T08:28:40.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:39 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:28:40.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:39 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:28:40.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:39 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:28:40.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:39 smithi157 ceph-mon[35083]: mgrmap e7: smithi157.qfvynr(active, since 1.00703s) 2024-04-03T08:28:40.367 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:28:40.367 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-03T08:28:40.368 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-03T08:28:40.368 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:28:40.368 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bc6a00700 1 Processor -- start 2024-04-03T08:28:40.368 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bc6a00700 1 -- start start 2024-04-03T08:28:40.368 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bc6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc0076160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:40.369 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bc6a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0077f20 con 0x7f3bc0077b10 2024-04-03T08:28:40.369 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bbfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc0076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:40.369 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bbfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc0076160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44742/0 (socket says 172.21.15.157:44742) 2024-04-03T08:28:40.369 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.163+0000 7f3bbfe00700 1 -- 172.21.15.157:0/2699797340 learned_addr learned my addr 172.21.15.157:0/2699797340 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:40.369 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.164+0000 7f3bbfe00700 1 -- 172.21.15.157:0/2699797340 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00766a0 con 0x7f3bc0077b10 2024-04-03T08:28:40.370 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.164+0000 7f3bbfe00700 1 --2- 172.21.15.157:0/2699797340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc0076160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00098e0 tx=0x7f3bb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3aa53ec18519ec server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:40.370 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.164+0000 7f3bbea00700 1 -- 172.21.15.157:0/2699797340 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bb000b860 con 0x7f3bc0077b10 2024-04-03T08:28:40.370 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.164+0000 7f3bbea00700 1 -- 172.21.15.157:0/2699797340 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3bb000be50 con 0x7f3bc0077b10 2024-04-03T08:28:40.370 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.164+0000 7f3bbea00700 1 -- 172.21.15.157:0/2699797340 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bb0010380 con 0x7f3bc0077b10 2024-04-03T08:28:40.370 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.165+0000 7f3bc6a00700 1 -- 172.21.15.157:0/2699797340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 msgr2=0x7f3bc0076160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:40.371 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.165+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/2699797340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc0076160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00098e0 tx=0x7f3bb0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:40.371 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.165+0000 7f3bc6a00700 1 -- 172.21.15.157:0/2699797340 shutdown_connections 2024-04-03T08:28:40.371 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.165+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/2699797340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc0076160 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:40.371 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.165+0000 7f3bc6a00700 1 -- 172.21.15.157:0/2699797340 >> 172.21.15.157:0/2699797340 conn(0x7f3bc00fe090 msgr2=0x7f3bc0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:40.371 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.165+0000 7f3bc6a00700 1 -- 172.21.15.157:0/2699797340 shutdown_connections 2024-04-03T08:28:40.372 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.166+0000 7f3bc6a00700 1 -- 172.21.15.157:0/2699797340 wait complete. 2024-04-03T08:28:40.372 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.166+0000 7f3bc6a00700 1 Processor -- start 2024-04-03T08:28:40.372 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.166+0000 7f3bc6a00700 1 -- start start 2024-04-03T08:28:40.372 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.167+0000 7f3bc6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc01139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:40.372 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.167+0000 7f3bc6a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0113ef0 con 0x7f3bc0077b10 2024-04-03T08:28:40.373 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.167+0000 7f3bbfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc01139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:40.373 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.167+0000 7f3bbfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc01139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44752/0 (socket says 172.21.15.157:44752) 2024-04-03T08:28:40.373 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.167+0000 7f3bbfe00700 1 -- 172.21.15.157:0/165035358 learned_addr learned my addr 172.21.15.157:0/165035358 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:40.373 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.167+0000 7f3bbfe00700 1 -- 172.21.15.157:0/165035358 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00094f0 con 0x7f3bc0077b10 2024-04-03T08:28:40.373 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.168+0000 7f3bbfe00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc01139b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0011bd0 tx=0x7f3bb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:40.373 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.168+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bb00107c0 con 0x7f3bc0077b10 2024-04-03T08:28:40.374 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.168+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3bb0010db0 con 0x7f3bc0077b10 2024-04-03T08:28:40.374 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.168+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bb001ad00 con 0x7f3bc0077b10 2024-04-03T08:28:40.374 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.168+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc01140f0 con 0x7f3bc0077b10 2024-04-03T08:28:40.374 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.168+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc0114c60 con 0x7f3bc0077b10 2024-04-03T08:28:40.374 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.169+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f3bb001a560 con 0x7f3bc0077b10 2024-04-03T08:28:40.375 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.170+0000 7f3bb7e00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:40.375 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.170+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 --> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ba4039350 con 0x7f3ba4036790 2024-04-03T08:28:40.375 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.170+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3bb004a230 con 0x7f3bc0077b10 2024-04-03T08:28:40.375 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.170+0000 7f3bbf400700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 msgr2=0x7f3ba4038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:40.375 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.170+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.371+0000 7f3bbf400700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 msgr2=0x7f3ba4038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.371+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.772+0000 7f3bbf400700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 msgr2=0x7f3ba4038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:33.772+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:34.573+0000 7f3bbf400700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 msgr2=0x7f3ba4038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:34.573+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-03T08:28:40.376 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:36.175+0000 7f3bbf400700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 msgr2=0x7f3ba4038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/3343433321 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:36.175+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:38.708+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7f3bb0016ce0 con 0x7f3bc0077b10 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:38.708+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 msgr2=0x7f3ba4038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:38.708+0000 7f3bb7e00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.710+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f3bb004c010 con 0x7f3bc0077b10 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.710+0000 7f3bb7e00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3ba4039fc0 0x7f3ba403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.710+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ba4039350 con 0x7f3ba4039fc0 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.711+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3ba4039fc0 0x7f3ba403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.712+0000 7f3bbf400700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3ba4039fc0 0x7f3ba403c3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0039d0 tx=0x7f3bac009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.713+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f3ba4039350 con 0x7f3ba4039fc0 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.719+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3bc0114580 con 0x7f3ba4039fc0 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.719+0000 7f3bb7e00700 1 -- 172.21.15.157:0/165035358 <== mgr.14118 v2:172.21.15.157:6800/1166303024 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3bc0114580 con 0x7f3ba4039fc0 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3ba4039fc0 msgr2=0x7f3ba403c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3ba4039fc0 0x7f3ba403c3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0039d0 tx=0x7f3bac009350 comp rx=0 tx=0).stop 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 msgr2=0x7f3bc01139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:40.378 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc01139b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0011bd0 tx=0x7f3bb0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:40.379 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 shutdown_connections 2024-04-03T08:28:40.379 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3ba4039fc0 0x7f3ba403c3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:40.379 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bc0077b10 0x7f3bc01139b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:40.379 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 --2- 172.21.15.157:0/165035358 >> [v2:172.21.15.157:6800/3343433321,v1:172.21.15.157:6801/3343433321] conn(0x7f3ba4036790 0x7f3ba4038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:40.379 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 >> 172.21.15.157:0/165035358 conn(0x7f3bc00fe090 msgr2=0x7f3bc00fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:40.380 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 shutdown_connections 2024-04-03T08:28:40.380 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:39.720+0000 7f3bc6a00700 1 -- 172.21.15.157:0/165035358 wait complete. 2024-04-03T08:28:40.380 INFO:teuthology.orchestra.run.smithi157.stdout:mgr epoch 5 is available 2024-04-03T08:28:40.380 INFO:teuthology.orchestra.run.smithi157.stdout:Setting orchestrator backend to cephadm... 2024-04-03T08:28:41.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-03T08:28:41.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-03T08:28:41.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: [03/Apr/2024:08:28:40] ENGINE Bus STARTING 2024-04-03T08:28:41.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: [03/Apr/2024:08:28:40] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:28:41.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: [03/Apr/2024:08:28:40] ENGINE Bus STARTED 2024-04-03T08:28:41.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:41.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:28:41.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:41.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:41 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:28:41.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.847+0000 7f359ba00700 1 Processor -- start 2024-04-03T08:28:41.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.848+0000 7f359ba00700 1 -- start start 2024-04-03T08:28:41.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.848+0000 7f359ba00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:41.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.848+0000 7f359ba00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594077f30 con 0x7f3594077b20 2024-04-03T08:28:41.693 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.848+0000 7f3599000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.848+0000 7f3599000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44806/0 (socket says 172.21.15.157:44806) 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.848+0000 7f3599000700 1 -- 172.21.15.157:0/1541038162 learned_addr learned my addr 172.21.15.157:0/1541038162 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.849+0000 7f3599000700 1 -- 172.21.15.157:0/1541038162 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594076660 con 0x7f3594077b20 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.849+0000 7f3599000700 1 --2- 172.21.15.157:0/1541038162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594076120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35880098e0 tx=0x7f3588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb45cd055a1d788 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.849+0000 7f3593400700 1 -- 172.21.15.157:0/1541038162 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f358800b860 con 0x7f3594077b20 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.849+0000 7f3593400700 1 -- 172.21.15.157:0/1541038162 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f358800be50 con 0x7f3594077b20 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.849+0000 7f3593400700 1 -- 172.21.15.157:0/1541038162 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3588010380 con 0x7f3594077b20 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 -- 172.21.15.157:0/1541038162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 msgr2=0x7f3594076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 --2- 172.21.15.157:0/1541038162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594076120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35880098e0 tx=0x7f3588009250 comp rx=0 tx=0).stop 2024-04-03T08:28:41.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 -- 172.21.15.157:0/1541038162 shutdown_connections 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 --2- 172.21.15.157:0/1541038162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594076120 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 -- 172.21.15.157:0/1541038162 >> 172.21.15.157:0/1541038162 conn(0x7f35940fe090 msgr2=0x7f35941004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 -- 172.21.15.157:0/1541038162 shutdown_connections 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.850+0000 7f359ba00700 1 -- 172.21.15.157:0/1541038162 wait complete. 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f359ba00700 1 Processor -- start 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f359ba00700 1 -- start start 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f359ba00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f359ba00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594113f40 con 0x7f3594077b20 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f3599000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f3599000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44808/0 (socket says 172.21.15.157:44808) 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.851+0000 7f3599000700 1 -- 172.21.15.157:0/337684274 learned_addr learned my addr 172.21.15.157:0/337684274 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f3599000700 1 -- 172.21.15.157:0/337684274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880094f0 con 0x7f3594077b20 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f3599000700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594113a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3588006d40 tx=0x7f3588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:41.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35880107c0 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3588010db0 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3594114140 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f358801ad40 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.852+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594114cb0 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.853+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359405f5f0 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.853+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f358801a5f0 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.854+0000 7f3590c00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f357c0366b0 0x7f357c038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.854+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3588049e50 con 0x7f3594077b20 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.854+0000 7f3593e00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f357c0366b0 0x7f357c038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.855+0000 7f3593e00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f357c0366b0 0x7f357c038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3580009990 tx=0x7f3580006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:41.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:40.858+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3588006d70 con 0x7f3594077b20 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.065+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f35940ff520 con 0x7f357c0366b0 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.075+0000 7f3590c00700 1 -- 172.21.15.157:0/337684274 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f35940ff520 con 0x7f357c0366b0 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f357c0366b0 msgr2=0x7f357c038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f357c0366b0 0x7f357c038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3580009990 tx=0x7f3580006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 msgr2=0x7f3594113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594113a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3588006d40 tx=0x7f3588009250 comp rx=0 tx=0).stop 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 shutdown_connections 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f357c0366b0 0x7f357c038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 --2- 172.21.15.157:0/337684274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3594077b20 0x7f3594113a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.077+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 >> 172.21.15.157:0/337684274 conn(0x7f35940fe090 msgr2=0x7f35940fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.078+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 shutdown_connections 2024-04-03T08:28:41.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:41.078+0000 7f359ba00700 1 -- 172.21.15.157:0/337684274 wait complete. 2024-04-03T08:28:42.438 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:42 smithi157 ceph-mon[35083]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:42.438 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:42 smithi157 ceph-mon[35083]: mgrmap e8: smithi157.qfvynr(active, since 2s) 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.204+0000 7fa6f3000700 1 Processor -- start 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.204+0000 7fa6f3000700 1 -- start start 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.205+0000 7fa6f3000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.205+0000 7fa6f3000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec077f00 con 0x7fa6ec077af0 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.205+0000 7fa6ebe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.205+0000 7fa6ebe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44818/0 (socket says 172.21.15.157:44818) 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.205+0000 7fa6ebe00700 1 -- 172.21.15.157:0/2606273563 learned_addr learned my addr 172.21.15.157:0/2606273563 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.205+0000 7fa6ebe00700 1 -- 172.21.15.157:0/2606273563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec078040 con 0x7fa6ec077af0 2024-04-03T08:28:43.097 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.206+0000 7fa6ebe00700 1 --2- 172.21.15.157:0/2606273563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec076140 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0098e0 tx=0x7fa6dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30a69bc55216ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.206+0000 7fa6eaa00700 1 -- 172.21.15.157:0/2606273563 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6dc00b860 con 0x7fa6ec077af0 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.206+0000 7fa6eaa00700 1 -- 172.21.15.157:0/2606273563 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa6dc00be50 con 0x7fa6ec077af0 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.206+0000 7fa6eaa00700 1 -- 172.21.15.157:0/2606273563 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6dc010380 con 0x7fa6ec077af0 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.206+0000 7fa6f3000700 1 -- 172.21.15.157:0/2606273563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 msgr2=0x7fa6ec076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.206+0000 7fa6f3000700 1 --2- 172.21.15.157:0/2606273563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec076140 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0098e0 tx=0x7fa6dc009250 comp rx=0 tx=0).stop 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.207+0000 7fa6f3000700 1 -- 172.21.15.157:0/2606273563 shutdown_connections 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.207+0000 7fa6f3000700 1 --2- 172.21.15.157:0/2606273563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec076140 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.207+0000 7fa6f3000700 1 -- 172.21.15.157:0/2606273563 >> 172.21.15.157:0/2606273563 conn(0x7fa6ec0fe090 msgr2=0x7fa6ec100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.207+0000 7fa6f3000700 1 -- 172.21.15.157:0/2606273563 shutdown_connections 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.207+0000 7fa6f3000700 1 -- 172.21.15.157:0/2606273563 wait complete. 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.207+0000 7fa6f3000700 1 Processor -- start 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6f3000700 1 -- start start 2024-04-03T08:28:43.098 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6f3000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6f3000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec113e90 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6ebe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6ebe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44820/0 (socket says 172.21.15.157:44820) 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6ebe00700 1 -- 172.21.15.157:0/2597010131 learned_addr learned my addr 172.21.15.157:0/2597010131 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.208+0000 7fa6ebe00700 1 -- 172.21.15.157:0/2597010131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0094f0 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.209+0000 7fa6ebe00700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec113950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc011bd0 tx=0x7fa6dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.209+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6dc0107c0 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.209+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa6dc010db0 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.209+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec114090 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.209+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6dc01ad60 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.209+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec114c00 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.210+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa6dc01a5c0 con 0x7fa6ec077af0 2024-04-03T08:28:43.099 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.210+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec05f5f0 con 0x7fa6ec077af0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.211+0000 7fa6e3e00700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa6d00367e0 0x7fa6d0038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.211+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa6dc04abe0 con 0x7fa6ec077af0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.211+0000 7fa6eb400700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa6d00367e0 0x7fa6d0038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.211+0000 7fa6eb400700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa6d00367e0 0x7fa6d0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009990 tx=0x7fa6d8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.215+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa6dc023df0 con 0x7fa6ec077af0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.413+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6ec0ff530 con 0x7fa6d00367e0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.414+0000 7fa6e3e00700 1 -- 172.21.15.157:0/2597010131 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fa6ec0ff530 con 0x7fa6d00367e0 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa6d00367e0 msgr2=0x7fa6d0038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa6d00367e0 0x7fa6d0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009990 tx=0x7fa6d8006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 msgr2=0x7fa6ec113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec113950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc011bd0 tx=0x7fa6dc009250 comp rx=0 tx=0).stop 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 shutdown_connections 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa6d00367e0 0x7fa6d0038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 --2- 172.21.15.157:0/2597010131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ec077af0 0x7fa6ec113950 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:43.100 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 >> 172.21.15.157:0/2597010131 conn(0x7fa6ec0fe090 msgr2=0x7fa6ec0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:43.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 shutdown_connections 2024-04-03T08:28:43.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:42.417+0000 7fa6f3000700 1 -- 172.21.15.157:0/2597010131 wait complete. 2024-04-03T08:28:43.101 INFO:teuthology.orchestra.run.smithi157.stdout:Generating ssh key... 2024-04-03T08:28:43.363 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:43 smithi157 ceph-mon[35083]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:44.628 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb8d200700 1 Processor -- start 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb8d200700 1 -- start start 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb8d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb88076160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb8d200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb88077f20 con 0x7fdb88077b10 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb85e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb88076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb85e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb88076160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50938/0 (socket says 172.21.15.157:50938) 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.661+0000 7fdb85e00700 1 -- 172.21.15.157:0/3746351445 learned_addr learned my addr 172.21.15.157:0/3746351445 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.662+0000 7fdb85e00700 1 -- 172.21.15.157:0/3746351445 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880766a0 con 0x7fdb88077b10 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.662+0000 7fdb85e00700 1 --2- 172.21.15.157:0/3746351445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb88076160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098e0 tx=0x7fdb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302ccf60db1349c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.662+0000 7fdb84a00700 1 -- 172.21.15.157:0/3746351445 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb7800b860 con 0x7fdb88077b10 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.662+0000 7fdb84a00700 1 -- 172.21.15.157:0/3746351445 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdb7800be50 con 0x7fdb88077b10 2024-04-03T08:28:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.662+0000 7fdb84a00700 1 -- 172.21.15.157:0/3746351445 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb78010380 con 0x7fdb88077b10 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 -- 172.21.15.157:0/3746351445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 msgr2=0x7fdb88076160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 --2- 172.21.15.157:0/3746351445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb88076160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098e0 tx=0x7fdb78009250 comp rx=0 tx=0).stop 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 -- 172.21.15.157:0/3746351445 shutdown_connections 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 --2- 172.21.15.157:0/3746351445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb88076160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 -- 172.21.15.157:0/3746351445 >> 172.21.15.157:0/3746351445 conn(0x7fdb880fe090 msgr2=0x7fdb88100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 -- 172.21.15.157:0/3746351445 shutdown_connections 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.663+0000 7fdb8d200700 1 -- 172.21.15.157:0/3746351445 wait complete. 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.664+0000 7fdb8d200700 1 Processor -- start 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.664+0000 7fdb8d200700 1 -- start start 2024-04-03T08:28:44.635 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.665+0000 7fdb8d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb881139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.665+0000 7fdb8d200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb88113ef0 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.665+0000 7fdb85e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb881139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.665+0000 7fdb85e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb881139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50952/0 (socket says 172.21.15.157:50952) 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.665+0000 7fdb85e00700 1 -- 172.21.15.157:0/2933067632 learned_addr learned my addr 172.21.15.157:0/2933067632 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.665+0000 7fdb85e00700 1 -- 172.21.15.157:0/2933067632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780094f0 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.666+0000 7fdb85e00700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb881139b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb78011bd0 tx=0x7fdb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.666+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb780107c0 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.666+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdb78010db0 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.666+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb7801ad00 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.666+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb881140f0 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.666+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb88114c60 con 0x7fdb88077b10 2024-04-03T08:28:44.636 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.667+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fdb7801a560 con 0x7fdb88077b10 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.667+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8805f5f0 con 0x7fdb88077b10 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.667+0000 7fdb7e000700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb6c0367e0 0x7fdb6c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.667+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdb7804a1d0 con 0x7fdb88077b10 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.668+0000 7fdb85400700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb6c0367e0 0x7fdb6c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.668+0000 7fdb85400700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb6c0367e0 0x7fdb6c038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009990 tx=0x7fdb74006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.672+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdb78024590 con 0x7fdb88077b10 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:43.869+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb880ff520 con 0x7fdb6c0367e0 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.046+0000 7fdb7e000700 1 -- 172.21.15.157:0/2933067632 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdb880ff520 con 0x7fdb6c0367e0 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb6c0367e0 msgr2=0x7fdb6c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb6c0367e0 0x7fdb6c038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009990 tx=0x7fdb74006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 msgr2=0x7fdb881139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb881139b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb78011bd0 tx=0x7fdb78009250 comp rx=0 tx=0).stop 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 shutdown_connections 2024-04-03T08:28:44.637 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb6c0367e0 0x7fdb6c038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:44.638 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 --2- 172.21.15.157:0/2933067632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb88077b10 0x7fdb881139b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:44.638 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.048+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 >> 172.21.15.157:0/2933067632 conn(0x7fdb880fe090 msgr2=0x7fdb880fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:44.638 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.049+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 shutdown_connections 2024-04-03T08:28:44.638 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:44.049+0000 7fdb8d200700 1 -- 172.21.15.157:0/2933067632 wait complete. 2024-04-03T08:28:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:45 smithi157 ceph-mon[35083]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:45 smithi157 ceph-mon[35083]: Generating ssh key... 2024-04-03T08:28:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:45 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:45 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:46 smithi157 ceph-mon[35083]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE/Na+DJh7FeSEZhJS5SKtcqhqbweYPxGua1c6v8+4A8/G9zg2pEm76qyCnox57+RP9MFp0zJ49kq7Ls94S/GsCaSPvbbl7VABAqDierbrWKAqIvoaG3idccqMSXZEAm0gGjKYwAabLentgGaUThP3LGIlZ++VAoSCfiIisTB86oT9yj0RV7Zyrd7FteH6JzYtmlmDY1DY+7mjpOrAsUYsKD2Od8ZKIKMGMUSpzB3aByAzdNoCGXhJe+MhtPZvZAMcs/2nCoR+xZNgyz/XQneRDYp6gQdOxO2k+rneImSEXA4xZ7ie+JjykyX3Y9LY5iomxPwfH9fujH32qj8cCgsb5vstyPUW53gB1lNbC1an1tt485BHsG+pxc5jDcuswhbl0dFjmFMBFwlnouEYsMtth/uiQarzppNoMQeDVxC/hE1j8K6b3s7BEfC0GZADgfj3QbeMqjk0gRMaB5MB6OhXxzaK6IJvvKD2y2FT2fJi8E6y2LJci0l8doZ3jubfP2s= ceph-af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.224+0000 7f0974200700 1 Processor -- start 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.225+0000 7f0974200700 1 -- start start 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.225+0000 7f0974200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.225+0000 7f0974200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c077ee0 con 0x7f096c077ad0 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.225+0000 7f0971800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.225+0000 7f0971800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50956/0 (socket says 172.21.15.157:50956) 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.225+0000 7f0971800700 1 -- 172.21.15.157:0/3851249028 learned_addr learned my addr 172.21.15.157:0/3851249028 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:46.081 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.226+0000 7f0971800700 1 -- 172.21.15.157:0/3851249028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c078020 con 0x7f096c077ad0 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.226+0000 7f0971800700 1 --2- 172.21.15.157:0/3851249028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c076120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09600098e0 tx=0x7f0960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1035757c0c3d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.226+0000 7f096be00700 1 -- 172.21.15.157:0/3851249028 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f096000b860 con 0x7f096c077ad0 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.226+0000 7f096be00700 1 -- 172.21.15.157:0/3851249028 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f096000be50 con 0x7f096c077ad0 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.226+0000 7f096be00700 1 -- 172.21.15.157:0/3851249028 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0960010380 con 0x7f096c077ad0 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 -- 172.21.15.157:0/3851249028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 msgr2=0x7f096c076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 --2- 172.21.15.157:0/3851249028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c076120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09600098e0 tx=0x7f0960009250 comp rx=0 tx=0).stop 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 -- 172.21.15.157:0/3851249028 shutdown_connections 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 --2- 172.21.15.157:0/3851249028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c076120 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 -- 172.21.15.157:0/3851249028 >> 172.21.15.157:0/3851249028 conn(0x7f096c0fe090 msgr2=0x7f096c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 -- 172.21.15.157:0/3851249028 shutdown_connections 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.227+0000 7f0974200700 1 -- 172.21.15.157:0/3851249028 wait complete. 2024-04-03T08:28:46.082 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0974200700 1 Processor -- start 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0974200700 1 -- start start 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0974200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0974200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c113e90 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0971800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0971800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50962/0 (socket says 172.21.15.157:50962) 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.228+0000 7f0971800700 1 -- 172.21.15.157:0/3230870436 learned_addr learned my addr 172.21.15.157:0/3230870436 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0971800700 1 -- 172.21.15.157:0/3230870436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600094f0 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0971800700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c113950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0960011bd0 tx=0x7f0960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09600107c0 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0960010db0 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c114090 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f096001ad60 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.229+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096c114c00 con 0x7f096c077ad0 2024-04-03T08:28:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.230+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f096001a5c0 con 0x7f096c077ad0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.230+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096c05f5f0 con 0x7f096c077ad0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.231+0000 7f0969600700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f09540367e0 0x7f0954038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.231+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f096004ac60 con 0x7f096c077ad0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.231+0000 7f0970e00700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f09540367e0 0x7f0954038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.232+0000 7f0970e00700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f09540367e0 0x7f0954038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0958009990 tx=0x7f0958006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.236+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0960010920 con 0x7f096c077ad0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.432+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f096c0ff530 con 0x7f09540367e0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.433+0000 7f0969600700 1 -- 172.21.15.157:0/3230870436 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f096c0ff530 con 0x7f09540367e0 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f09540367e0 msgr2=0x7f0954038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f09540367e0 0x7f0954038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0958009990 tx=0x7f0958006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 msgr2=0x7f096c113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c113950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0960011bd0 tx=0x7f0960009250 comp rx=0 tx=0).stop 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 shutdown_connections 2024-04-03T08:28:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f09540367e0 0x7f0954038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 --2- 172.21.15.157:0/3230870436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f096c077ad0 0x7f096c113950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 >> 172.21.15.157:0/3230870436 conn(0x7f096c0fe090 msgr2=0x7f096c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 shutdown_connections 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:45.435+0000 7f0974200700 1 -- 172.21.15.157:0/3230870436 wait complete. 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:Adding key to root@localhost authorized_keys... 2024-04-03T08:28:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:Adding host smithi157... 2024-04-03T08:28:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:47 smithi157 ceph-mon[35083]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "addr": "172.21.15.157", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:48.885 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:48 smithi157 ceph-mon[35083]: Deploying cephadm binary to smithi157 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Added host 'smithi157' with addr '172.21.15.157' 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.642+0000 7f1ba1800700 1 Processor -- start 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.642+0000 7f1ba1800700 1 -- start start 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.643+0000 7f1ba1800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.643+0000 7f1ba1800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c103280 con 0x7f1b9c102930 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.643+0000 7f1b9aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.643+0000 7f1b9aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50976/0 (socket says 172.21.15.157:50976) 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.643+0000 7f1b9aa00700 1 -- 172.21.15.157:0/2859689280 learned_addr learned my addr 172.21.15.157:0/2859689280 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.643+0000 7f1b9aa00700 1 -- 172.21.15.157:0/2859689280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c1033c0 con 0x7f1b9c102930 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.644+0000 7f1b9aa00700 1 --2- 172.21.15.157:0/2859689280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c102d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0098e0 tx=0x7f1b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b6b2106627f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.644+0000 7f1b99600700 1 -- 172.21.15.157:0/2859689280 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b8c00b860 con 0x7f1b9c102930 2024-04-03T08:28:50.101 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.644+0000 7f1b99600700 1 -- 172.21.15.157:0/2859689280 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1b8c00be50 con 0x7f1b9c102930 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.644+0000 7f1b99600700 1 -- 172.21.15.157:0/2859689280 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b8c010380 con 0x7f1b9c102930 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.644+0000 7f1ba1800700 1 -- 172.21.15.157:0/2859689280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 msgr2=0x7f1b9c102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.644+0000 7f1ba1800700 1 --2- 172.21.15.157:0/2859689280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c102d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0098e0 tx=0x7f1b8c009250 comp rx=0 tx=0).stop 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.645+0000 7f1ba1800700 1 -- 172.21.15.157:0/2859689280 shutdown_connections 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.645+0000 7f1ba1800700 1 --2- 172.21.15.157:0/2859689280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c102d40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.645+0000 7f1ba1800700 1 -- 172.21.15.157:0/2859689280 >> 172.21.15.157:0/2859689280 conn(0x7f1b9c0fe090 msgr2=0x7f1b9c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.645+0000 7f1ba1800700 1 -- 172.21.15.157:0/2859689280 shutdown_connections 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.645+0000 7f1ba1800700 1 -- 172.21.15.157:0/2859689280 wait complete. 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.645+0000 7f1ba1800700 1 Processor -- start 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1ba1800700 1 -- start start 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1ba1800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1ba1800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c113ea0 con 0x7f1b9c102930 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1b9aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1b9aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50990/0 (socket says 172.21.15.157:50990) 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1b9aa00700 1 -- 172.21.15.157:0/983553439 learned_addr learned my addr 172.21.15.157:0/983553439 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.646+0000 7f1b9aa00700 1 -- 172.21.15.157:0/983553439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0094f0 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.647+0000 7f1b9aa00700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c113960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ba90 tx=0x7f1b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.647+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b8c0107c0 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.647+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1b8c010db0 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.647+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c1140a0 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.647+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b8c01add0 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.647+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c114c10 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.648+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f1b8c010920 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.648+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c05f5f0 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.648+0000 7f1b92a00700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1b800367e0 0x7f1b80038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.648+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1b8c04a590 con 0x7f1b9c102930 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.649+0000 7f1b9a000700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1b800367e0 0x7f1b80038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:50.103 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.649+0000 7f1b9a000700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1b800367e0 0x7f1b80038c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009990 tx=0x7f1b88006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.653+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1b8c018b40 con 0x7f1b9c102930 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:46.852+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi157", "addr": "172.21.15.157", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b9c0ff2a0 con 0x7f1b800367e0 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.385+0000 7f1b92a00700 1 -- 172.21.15.157:0/983553439 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1b9c0ff2a0 con 0x7f1b800367e0 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1b800367e0 msgr2=0x7f1b80038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1b800367e0 0x7f1b80038c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009990 tx=0x7f1b88006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 msgr2=0x7f1b9c113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c113960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ba90 tx=0x7f1b8c009250 comp rx=0 tx=0).stop 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 shutdown_connections 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1b800367e0 0x7f1b80038c90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 --2- 172.21.15.157:0/983553439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c102930 0x7f1b9c113960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 >> 172.21.15.157:0/983553439 conn(0x7f1b9c0fe090 msgr2=0x7f1b9c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 shutdown_connections 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:49.388+0000 7f1ba1800700 1 -- 172.21.15.157:0/983553439 wait complete. 2024-04-03T08:28:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying mon service with default placement... 2024-04-03T08:28:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:50 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:50 smithi157 ceph-mon[35083]: Added host smithi157 2024-04-03T08:28:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:50 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:28:51.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-03T08:28:51.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.651+0000 7f17d0400700 1 Processor -- start 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.652+0000 7f17d0400700 1 -- start start 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.652+0000 7f17d0400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8076160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.652+0000 7f17d0400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8077f70 con 0x7f17c8077b60 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.652+0000 7f17cda00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.652+0000 7f17cda00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8076160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50998/0 (socket says 172.21.15.157:50998) 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.652+0000 7f17cda00700 1 -- 172.21.15.157:0/760610736 learned_addr learned my addr 172.21.15.157:0/760610736 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.653+0000 7f17cda00700 1 -- 172.21.15.157:0/760610736 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80766a0 con 0x7f17c8077b60 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.653+0000 7f17cda00700 1 --2- 172.21.15.157:0/760610736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8076160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0098e0 tx=0x7f17bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a9058fe2b5a703 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.653+0000 7f17c7e00700 1 -- 172.21.15.157:0/760610736 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17bc00b860 con 0x7f17c8077b60 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.653+0000 7f17c7e00700 1 -- 172.21.15.157:0/760610736 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f17bc00be50 con 0x7f17c8077b60 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.653+0000 7f17c7e00700 1 -- 172.21.15.157:0/760610736 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17bc010380 con 0x7f17c8077b60 2024-04-03T08:28:51.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 -- 172.21.15.157:0/760610736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 msgr2=0x7f17c8076160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 --2- 172.21.15.157:0/760610736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8076160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0098e0 tx=0x7f17bc009250 comp rx=0 tx=0).stop 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 -- 172.21.15.157:0/760610736 shutdown_connections 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 --2- 172.21.15.157:0/760610736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8076160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 -- 172.21.15.157:0/760610736 >> 172.21.15.157:0/760610736 conn(0x7f17c80fe030 msgr2=0x7f17c8100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 -- 172.21.15.157:0/760610736 shutdown_connections 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.654+0000 7f17d0400700 1 -- 172.21.15.157:0/760610736 wait complete. 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.655+0000 7f17d0400700 1 Processor -- start 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.655+0000 7f17d0400700 1 -- start start 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.655+0000 7f17d0400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.655+0000 7f17d0400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8113dc0 con 0x7f17c8077b60 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.655+0000 7f17cda00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:51.582 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17cda00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8113880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51014/0 (socket says 172.21.15.157:51014) 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17cda00700 1 -- 172.21.15.157:0/1512509575 learned_addr learned my addr 172.21.15.157:0/1512509575 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17cda00700 1 -- 172.21.15.157:0/1512509575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc0094f0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17cda00700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8113880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f17bc006fd0 tx=0x7f17bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17bc0107c0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f17bc010db0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c8113fc0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17bc01ada0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.656+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c8114b30 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.657+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f17bc010920 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.657+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c805f5f0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.658+0000 7f17c5600700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f17b00367e0 0x7f17b0038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.658+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f17bc049db0 con 0x7f17c8077b60 2024-04-03T08:28:51.583 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.658+0000 7f17cd000700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f17b00367e0 0x7f17b0038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.659+0000 7f17cd000700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f17b00367e0 0x7f17b0038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009990 tx=0x7f17b4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.663+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f17bc023750 con 0x7f17c8077b60 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.872+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f17c80ff320 con 0x7f17b00367e0 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.878+0000 7f17c5600700 1 -- 172.21.15.157:0/1512509575 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f17c80ff320 con 0x7f17b00367e0 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f17b00367e0 msgr2=0x7f17b0038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f17b00367e0 0x7f17b0038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009990 tx=0x7f17b4006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 msgr2=0x7f17c8113880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8113880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f17bc006fd0 tx=0x7f17bc009250 comp rx=0 tx=0).stop 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 shutdown_connections 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f17b00367e0 0x7f17b0038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 --2- 172.21.15.157:0/1512509575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8077b60 0x7f17c8113880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:51.584 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 >> 172.21.15.157:0/1512509575 conn(0x7f17c80fe030 msgr2=0x7f17c80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:51.585 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.880+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 shutdown_connections 2024-04-03T08:28:51.585 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:50.881+0000 7f17d0400700 1 -- 172.21.15.157:0/1512509575 wait complete. 2024-04-03T08:28:51.585 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying mgr service with default placement... 2024-04-03T08:28:52.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:51 smithi157 ceph-mon[35083]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:52.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:51 smithi157 ceph-mon[35083]: Saving service mon spec with placement count:5 2024-04-03T08:28:52.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:51 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.654+0000 7fdb6b000700 1 Processor -- start 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.654+0000 7fdb6b000700 1 -- start start 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.654+0000 7fdb6b000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64076180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.654+0000 7fdb6b000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64077f40 con 0x7fdb64077b30 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb63e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64076180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb63e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64076180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48708/0 (socket says 172.21.15.157:48708) 2024-04-03T08:28:53.694 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb63e00700 1 -- 172.21.15.157:0/1648451405 learned_addr learned my addr 172.21.15.157:0/1648451405 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb63e00700 1 -- 172.21.15.157:0/1648451405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640766c0 con 0x7fdb64077b30 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb63e00700 1 --2- 172.21.15.157:0/1648451405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64076180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb540098e0 tx=0x7fdb54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca72337b755e7459 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb62a00700 1 -- 172.21.15.157:0/1648451405 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb5400b860 con 0x7fdb64077b30 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb62a00700 1 -- 172.21.15.157:0/1648451405 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdb5400be50 con 0x7fdb64077b30 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.655+0000 7fdb62a00700 1 -- 172.21.15.157:0/1648451405 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb54010380 con 0x7fdb64077b30 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 -- 172.21.15.157:0/1648451405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 msgr2=0x7fdb64076180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 --2- 172.21.15.157:0/1648451405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64076180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb540098e0 tx=0x7fdb54009250 comp rx=0 tx=0).stop 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 -- 172.21.15.157:0/1648451405 shutdown_connections 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 --2- 172.21.15.157:0/1648451405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64076180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:53.695 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 -- 172.21.15.157:0/1648451405 >> 172.21.15.157:0/1648451405 conn(0x7fdb640fe090 msgr2=0x7fdb64100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 -- 172.21.15.157:0/1648451405 shutdown_connections 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.656+0000 7fdb6b000700 1 -- 172.21.15.157:0/1648451405 wait complete. 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.657+0000 7fdb6b000700 1 Processor -- start 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.657+0000 7fdb6b000700 1 -- start start 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb6b000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb6b000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64113ea0 con 0x7fdb64077b30 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb63e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb63e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48714/0 (socket says 172.21.15.157:48714) 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb63e00700 1 -- 172.21.15.157:0/1473649806 learned_addr learned my addr 172.21.15.157:0/1473649806 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb63e00700 1 -- 172.21.15.157:0/1473649806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540094f0 con 0x7fdb64077b30 2024-04-03T08:28:53.696 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.658+0000 7fdb63e00700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64113960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb54011bd0 tx=0x7fdb54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.659+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb540107c0 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.659+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdb54010db0 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.659+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb5401ad60 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.659+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb641140a0 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.659+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64114c10 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.660+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fdb54010920 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.660+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6405f5f0 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.660+0000 7fdb5be00700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb480367e0 0x7fdb48038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.660+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdb5404ac20 con 0x7fdb64077b30 2024-04-03T08:28:53.697 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.661+0000 7fdb63400700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb480367e0 0x7fdb48038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.661+0000 7fdb63400700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb480367e0 0x7fdb48038c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009990 tx=0x7fdb50006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.665+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdb5402d3e0 con 0x7fdb64077b30 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.876+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb640ff4d0 con 0x7fdb480367e0 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.883+0000 7fdb5be00700 1 -- 172.21.15.157:0/1473649806 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdb640ff4d0 con 0x7fdb480367e0 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb480367e0 msgr2=0x7fdb48038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb480367e0 0x7fdb48038c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009990 tx=0x7fdb50006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 msgr2=0x7fdb64113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64113960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb54011bd0 tx=0x7fdb54009250 comp rx=0 tx=0).stop 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 shutdown_connections 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fdb480367e0 0x7fdb48038c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 --2- 172.21.15.157:0/1473649806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb64077b30 0x7fdb64113960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:53.699 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.885+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 >> 172.21.15.157:0/1473649806 conn(0x7fdb640fe090 msgr2=0x7fdb640fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:53.699 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.886+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 shutdown_connections 2024-04-03T08:28:53.699 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:52.886+0000 7fdb6b000700 1 -- 172.21.15.157:0/1473649806 wait complete. 2024-04-03T08:28:53.699 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying crash service with default placement... 2024-04-03T08:28:53.957 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:53 smithi157 ceph-mon[35083]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:53.957 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:53 smithi157 ceph-mon[35083]: Saving service mgr spec with placement count:2 2024-04-03T08:28:53.957 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:53 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:53.957 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:53 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:53.957 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:53 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:55.317 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.243+0000 7f0649400700 1 Processor -- start 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.243+0000 7f0649400700 1 -- start start 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.244+0000 7f0649400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.244+0000 7f0649400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644077ee0 con 0x7f0644077ad0 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.244+0000 7f0642800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.244+0000 7f0642800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48730/0 (socket says 172.21.15.157:48730) 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.244+0000 7f0642800700 1 -- 172.21.15.157:0/2309478134 learned_addr learned my addr 172.21.15.157:0/2309478134 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.245+0000 7f0642800700 1 -- 172.21.15.157:0/2309478134 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644078020 con 0x7f0644077ad0 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.245+0000 7f0642800700 1 --2- 172.21.15.157:0/2309478134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644076120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f06340098e0 tx=0x7f0634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b767c9352076ba server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.245+0000 7f0641400700 1 -- 172.21.15.157:0/2309478134 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f063400b860 con 0x7f0644077ad0 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.245+0000 7f0641400700 1 -- 172.21.15.157:0/2309478134 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f063400be90 con 0x7f0644077ad0 2024-04-03T08:28:55.318 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.245+0000 7f0641400700 1 -- 172.21.15.157:0/2309478134 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06340103c0 con 0x7f0644077ad0 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 -- 172.21.15.157:0/2309478134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 msgr2=0x7f0644076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 --2- 172.21.15.157:0/2309478134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644076120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f06340098e0 tx=0x7f0634009250 comp rx=0 tx=0).stop 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 -- 172.21.15.157:0/2309478134 shutdown_connections 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 --2- 172.21.15.157:0/2309478134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644076120 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 -- 172.21.15.157:0/2309478134 >> 172.21.15.157:0/2309478134 conn(0x7f06440fe090 msgr2=0x7f0644100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 -- 172.21.15.157:0/2309478134 shutdown_connections 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.246+0000 7f0649400700 1 -- 172.21.15.157:0/2309478134 wait complete. 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.247+0000 7f0649400700 1 Processor -- start 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.247+0000 7f0649400700 1 -- start start 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.247+0000 7f0649400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.247+0000 7f0649400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644113ed0 con 0x7f0644077ad0 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.248+0000 7f0642800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:55.319 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.248+0000 7f0642800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48746/0 (socket says 172.21.15.157:48746) 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.248+0000 7f0642800700 1 -- 172.21.15.157:0/2216725994 learned_addr learned my addr 172.21.15.157:0/2216725994 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.248+0000 7f0642800700 1 -- 172.21.15.157:0/2216725994 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340094f0 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.248+0000 7f0642800700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644113990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06340105b0 tx=0x7f0634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.249+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0634010840 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.249+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0634010e70 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.249+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f063401ae30 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.249+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06441140d0 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.249+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644114c40 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.250+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f063401a430 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.250+0000 7f063aa00700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f06280367e0 0x7f0628038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.250+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f063404a1b0 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.250+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064405f5f0 con 0x7f0644077ad0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.250+0000 7f0641e00700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f06280367e0 0x7f0628038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:55.320 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.251+0000 7f0641e00700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f06280367e0 0x7f0628038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0630009990 tx=0x7f0630006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.256+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0634045020 con 0x7f0644077ad0 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.479+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f06440ff530 con 0x7f06280367e0 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.484+0000 7f063aa00700 1 -- 172.21.15.157:0/2216725994 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f06440ff530 con 0x7f06280367e0 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f06280367e0 msgr2=0x7f0628038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f06280367e0 0x7f0628038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0630009990 tx=0x7f0630006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 msgr2=0x7f0644113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644113990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06340105b0 tx=0x7f0634009250 comp rx=0 tx=0).stop 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 shutdown_connections 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f06280367e0 0x7f0628038c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 --2- 172.21.15.157:0/2216725994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0644077ad0 0x7f0644113990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 >> 172.21.15.157:0/2216725994 conn(0x7f06440fe090 msgr2=0x7f06440fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 shutdown_connections 2024-04-03T08:28:55.321 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:54.487+0000 7f0649400700 1 -- 172.21.15.157:0/2216725994 wait complete. 2024-04-03T08:28:55.322 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying prometheus service with default placement... 2024-04-03T08:28:55.717 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:55 smithi157 ceph-mon[35083]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:55.717 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:55 smithi157 ceph-mon[35083]: Saving service crash spec with placement * 2024-04-03T08:28:55.717 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:55 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-03T08:28:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.262+0000 7fc8b3c00700 1 Processor -- start 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.263+0000 7fc8b3c00700 1 -- start start 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.263+0000 7fc8b3c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.263+0000 7fc8b3c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac077ec0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.263+0000 7fc8b1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.263+0000 7fc8b1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48760/0 (socket says 172.21.15.157:48760) 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.263+0000 7fc8b1200700 1 -- 172.21.15.157:0/452675424 learned_addr learned my addr 172.21.15.157:0/452675424 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.264+0000 7fc8b1200700 1 -- 172.21.15.157:0/452675424 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac078000 con 0x7fc8ac077ab0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.264+0000 7fc8b1200700 1 --2- 172.21.15.157:0/452675424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac076100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00098e0 tx=0x7fc8a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd633129c0f97e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.264+0000 7fc8ab400700 1 -- 172.21.15.157:0/452675424 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8a000b860 con 0x7fc8ac077ab0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.264+0000 7fc8ab400700 1 -- 172.21.15.157:0/452675424 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8a000be90 con 0x7fc8ac077ab0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.264+0000 7fc8ab400700 1 -- 172.21.15.157:0/452675424 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8a00103c0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 -- 172.21.15.157:0/452675424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 msgr2=0x7fc8ac076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 --2- 172.21.15.157:0/452675424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac076100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00098e0 tx=0x7fc8a0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 -- 172.21.15.157:0/452675424 shutdown_connections 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 --2- 172.21.15.157:0/452675424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac076100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 -- 172.21.15.157:0/452675424 >> 172.21.15.157:0/452675424 conn(0x7fc8ac0fe090 msgr2=0x7fc8ac100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 -- 172.21.15.157:0/452675424 shutdown_connections 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.265+0000 7fc8b3c00700 1 -- 172.21.15.157:0/452675424 wait complete. 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b3c00700 1 Processor -- start 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b3c00700 1 -- start start 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b3c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b3c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac113ed0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48764/0 (socket says 172.21.15.157:48764) 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.266+0000 7fc8b1200700 1 -- 172.21.15.157:0/1916111498 learned_addr learned my addr 172.21.15.157:0/1916111498 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8b1200700 1 -- 172.21.15.157:0/1916111498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00094f0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8b1200700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac113990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00105b0 tx=0x7fc8a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8a0010840 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8a0010e70 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac1140d0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8a001ae30 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.267+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac114c40 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.268+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fc8a001a430 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.268+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ac05f5f0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.269+0000 7fc8a8c00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fc8940367e0 0x7fc894038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.269+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc8a004a170 con 0x7fc8ac077ab0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.269+0000 7fc8abe00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fc8940367e0 0x7fc894038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.270+0000 7fc8abe00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fc8940367e0 0x7fc894038c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc898009990 tx=0x7fc898006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.273+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc8a002b8c0 con 0x7fc8ac077ab0 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.492+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8ac0ff4c0 con 0x7fc8940367e0 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.497+0000 7fc8a8c00700 1 -- 172.21.15.157:0/1916111498 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fc8ac0ff4c0 con 0x7fc8940367e0 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.499+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fc8940367e0 msgr2=0x7fc894038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.499+0000 7fc8b3c00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fc8940367e0 0x7fc894038c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc898009990 tx=0x7fc898006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.499+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 msgr2=0x7fc8ac113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.499+0000 7fc8b3c00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac113990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00105b0 tx=0x7fc8a0009250 comp rx=0 tx=0).stop 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.500+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 shutdown_connections 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.500+0000 7fc8b3c00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fc8940367e0 0x7fc894038c90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.500+0000 7fc8b3c00700 1 --2- 172.21.15.157:0/1916111498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8ac077ab0 0x7fc8ac113990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.500+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 >> 172.21.15.157:0/1916111498 conn(0x7fc8ac0fe090 msgr2=0x7fc8ac0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.500+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 shutdown_connections 2024-04-03T08:28:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:56.500+0000 7fc8b3c00700 1 -- 172.21.15.157:0/1916111498 wait complete. 2024-04-03T08:28:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying grafana service with default placement... 2024-04-03T08:28:57.424 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:57 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:57.424 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:57 smithi157 ceph-mon[35083]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:57.424 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:57 smithi157 ceph-mon[35083]: Saving service prometheus spec with placement count:1 2024-04-03T08:28:57.424 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:57 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:58.574 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-03T08:28:58.574 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.761+0000 7fa328e00700 1 Processor -- start 2024-04-03T08:28:58.574 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.761+0000 7fa328e00700 1 -- start start 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.761+0000 7fa328e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324105070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.761+0000 7fa328e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324105640 con 0x7fa324104c60 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.762+0000 7fa321e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324105070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.762+0000 7fa321e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324105070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48766/0 (socket says 172.21.15.157:48766) 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.762+0000 7fa321e00700 1 -- 172.21.15.157:0/992931512 learned_addr learned my addr 172.21.15.157:0/992931512 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.762+0000 7fa321e00700 1 -- 172.21.15.157:0/992931512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324105780 con 0x7fa324104c60 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.762+0000 7fa321e00700 1 --2- 172.21.15.157:0/992931512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324105070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3140098e0 tx=0x7fa314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8b934be2bbe9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa320a00700 1 -- 172.21.15.157:0/992931512 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa31400b860 con 0x7fa324104c60 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa320a00700 1 -- 172.21.15.157:0/992931512 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa31400be90 con 0x7fa324104c60 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa320a00700 1 -- 172.21.15.157:0/992931512 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3140103c0 con 0x7fa324104c60 2024-04-03T08:28:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa328e00700 1 -- 172.21.15.157:0/992931512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 msgr2=0x7fa324105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa328e00700 1 --2- 172.21.15.157:0/992931512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324105070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3140098e0 tx=0x7fa314009250 comp rx=0 tx=0).stop 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa328e00700 1 -- 172.21.15.157:0/992931512 shutdown_connections 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa328e00700 1 --2- 172.21.15.157:0/992931512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324105070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa328e00700 1 -- 172.21.15.157:0/992931512 >> 172.21.15.157:0/992931512 conn(0x7fa324100560 msgr2=0x7fa324102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.763+0000 7fa328e00700 1 -- 172.21.15.157:0/992931512 shutdown_connections 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.764+0000 7fa328e00700 1 -- 172.21.15.157:0/992931512 wait complete. 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.764+0000 7fa328e00700 1 Processor -- start 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.764+0000 7fa328e00700 1 -- start start 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.765+0000 7fa328e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.765+0000 7fa328e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324114090 con 0x7fa324104c60 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.765+0000 7fa321e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:58.576 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.765+0000 7fa321e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48782/0 (socket says 172.21.15.157:48782) 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.765+0000 7fa321e00700 1 -- 172.21.15.157:0/3288121437 learned_addr learned my addr 172.21.15.157:0/3288121437 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.765+0000 7fa321e00700 1 -- 172.21.15.157:0/3288121437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140094f0 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.766+0000 7fa321e00700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324113b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3140090b0 tx=0x7fa314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.766+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa314010840 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.766+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa314010e70 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.766+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa324114290 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.766+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa314024e40 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.766+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa324114e00 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.767+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa3140109a0 con 0x7fa324104c60 2024-04-03T08:28:58.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.767+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32405f5f0 con 0x7fa324104c60 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.767+0000 7fa31a000700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa308036790 0x7fa308038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.768+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa31404a7c0 con 0x7fa324104c60 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.768+0000 7fa321400700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa308036790 0x7fa308038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.768+0000 7fa321400700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa308036790 0x7fa308038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa310009990 tx=0x7fa310006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.772+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa31402c520 con 0x7fa324104c60 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.987+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fa324106ab0 con 0x7fa308036790 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.992+0000 7fa31a000700 1 -- 172.21.15.157:0/3288121437 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa324106ab0 con 0x7fa308036790 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa308036790 msgr2=0x7fa308038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa308036790 0x7fa308038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa310009990 tx=0x7fa310006e40 comp rx=0 tx=0).stop 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 msgr2=0x7fa324113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324113b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3140090b0 tx=0x7fa314009250 comp rx=0 tx=0).stop 2024-04-03T08:28:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 shutdown_connections 2024-04-03T08:28:58.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7fa308036790 0x7fa308038c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:58.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 --2- 172.21.15.157:0/3288121437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa324104c60 0x7fa324113b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:28:58.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 >> 172.21.15.157:0/3288121437 conn(0x7fa324100560 msgr2=0x7fa3241011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:28:58.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 shutdown_connections 2024-04-03T08:28:58.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:57.994+0000 7fa328e00700 1 -- 172.21.15.157:0/3288121437 wait complete. 2024-04-03T08:28:58.579 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying node-exporter service with default placement... 2024-04-03T08:28:58.846 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:58 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:28:58.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:58 smithi157 ceph-mon[35083]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:28:58.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:58 smithi157 ceph-mon[35083]: Saving service grafana spec with placement count:1 2024-04-03T08:28:58.847 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:28:58 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:00.604 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-03T08:29:00.604 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.304+0000 7f1fe3800700 1 Processor -- start 2024-04-03T08:29:00.604 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.305+0000 7f1fe3800700 1 -- start start 2024-04-03T08:29:00.604 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.305+0000 7f1fe3800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.305+0000 7f1fe3800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc077ee0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.305+0000 7f1fe0e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.305+0000 7f1fe0e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48786/0 (socket says 172.21.15.157:48786) 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.305+0000 7f1fe0e00700 1 -- 172.21.15.157:0/560842762 learned_addr learned my addr 172.21.15.157:0/560842762 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.306+0000 7f1fe0e00700 1 -- 172.21.15.157:0/560842762 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc078020 con 0x7f1fdc077ad0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.306+0000 7f1fe0e00700 1 --2- 172.21.15.157:0/560842762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc076120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00098e0 tx=0x7f1fd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af27f6c814f10cf server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.306+0000 7f1fdb400700 1 -- 172.21.15.157:0/560842762 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fd000b860 con 0x7f1fdc077ad0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.306+0000 7f1fdb400700 1 -- 172.21.15.157:0/560842762 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fd000be90 con 0x7f1fdc077ad0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.306+0000 7f1fdb400700 1 -- 172.21.15.157:0/560842762 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fd00103c0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 -- 172.21.15.157:0/560842762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 msgr2=0x7f1fdc076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 --2- 172.21.15.157:0/560842762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc076120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00098e0 tx=0x7f1fd0009250 comp rx=0 tx=0).stop 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 -- 172.21.15.157:0/560842762 shutdown_connections 2024-04-03T08:29:00.605 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 --2- 172.21.15.157:0/560842762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc076120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 -- 172.21.15.157:0/560842762 >> 172.21.15.157:0/560842762 conn(0x7f1fdc0fe090 msgr2=0x7f1fdc100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 -- 172.21.15.157:0/560842762 shutdown_connections 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.307+0000 7f1fe3800700 1 -- 172.21.15.157:0/560842762 wait complete. 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe3800700 1 Processor -- start 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe3800700 1 -- start start 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe3800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe3800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc113ed0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe0e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe0e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48790/0 (socket says 172.21.15.157:48790) 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.308+0000 7f1fe0e00700 1 -- 172.21.15.157:0/126472089 learned_addr learned my addr 172.21.15.157:0/126472089 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fe0e00700 1 -- 172.21.15.157:0/126472089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00094f0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fe0e00700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc113990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00094c0 tx=0x7f1fd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fd00118f0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fd0010d60 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fd001a430 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc1140d0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.309+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc114c40 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.310+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f1fd0024440 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.310+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc05f5f0 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.311+0000 7f1fd8c00700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1fc4036790 0x7f1fc4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.311+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1fd004a590 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.311+0000 7f1fdbe00700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1fc4036790 0x7f1fc4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.312+0000 7f1fdbe00700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1fc4036790 0x7f1fc4038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009990 tx=0x7f1fc8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.316+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1fd0024760 con 0x7f1fdc077ad0 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.542+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fdc0ff530 con 0x7f1fc4036790 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.547+0000 7f1fd8c00700 1 -- 172.21.15.157:0/126472089 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1fdc0ff530 con 0x7f1fc4036790 2024-04-03T08:29:00.607 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1fc4036790 msgr2=0x7f1fc4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1fc4036790 0x7f1fc4038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009990 tx=0x7f1fc8006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 msgr2=0x7f1fdc113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc113990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00094c0 tx=0x7f1fd0009250 comp rx=0 tx=0).stop 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 shutdown_connections 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f1fc4036790 0x7f1fc4038c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 --2- 172.21.15.157:0/126472089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fdc077ad0 0x7f1fdc113990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 >> 172.21.15.157:0/126472089 conn(0x7f1fdc0fe090 msgr2=0x7f1fdc0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 shutdown_connections 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:28:59.550+0000 7f1fe3800700 1 -- 172.21.15.157:0/126472089 wait complete. 2024-04-03T08:29:00.608 INFO:teuthology.orchestra.run.smithi157.stdout:Deploying alertmanager service with default placement... 2024-04-03T08:29:00.609 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:00 smithi157 ceph-mon[35083]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:00.609 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:00 smithi157 ceph-mon[35083]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:00.609 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:00 smithi157 ceph-mon[35083]: Saving service node-exporter spec with placement * 2024-04-03T08:29:00.609 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:00 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:02.060 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a7e00700 1 Processor -- start 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a7e00700 1 -- start start 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a01032c0 con 0x7f92a0102970 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48802/0 (socket says 172.21.15.157:48802) 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.188+0000 7f92a5400700 1 -- 172.21.15.157:0/731532478 learned_addr learned my addr 172.21.15.157:0/731532478 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.189+0000 7f92a5400700 1 -- 172.21.15.157:0/731532478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0103400 con 0x7f92a0102970 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.189+0000 7f92a5400700 1 --2- 172.21.15.157:0/731532478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0102d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92940098e0 tx=0x7f9294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7abc0c1db835d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.189+0000 7f929fe00700 1 -- 172.21.15.157:0/731532478 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f929400b860 con 0x7f92a0102970 2024-04-03T08:29:02.061 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.189+0000 7f929fe00700 1 -- 172.21.15.157:0/731532478 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f929400be90 con 0x7f92a0102970 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.189+0000 7f929fe00700 1 -- 172.21.15.157:0/731532478 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92940103c0 con 0x7f92a0102970 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 -- 172.21.15.157:0/731532478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 msgr2=0x7f92a0102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 --2- 172.21.15.157:0/731532478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0102d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92940098e0 tx=0x7f9294009250 comp rx=0 tx=0).stop 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 -- 172.21.15.157:0/731532478 shutdown_connections 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 --2- 172.21.15.157:0/731532478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0102d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 -- 172.21.15.157:0/731532478 >> 172.21.15.157:0/731532478 conn(0x7f92a00fe090 msgr2=0x7f92a0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 -- 172.21.15.157:0/731532478 shutdown_connections 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.190+0000 7f92a7e00700 1 -- 172.21.15.157:0/731532478 wait complete. 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.191+0000 7f92a7e00700 1 Processor -- start 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.192+0000 7f92a7e00700 1 -- start start 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.192+0000 7f92a7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.192+0000 7f92a7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0111ca0 con 0x7f92a0102970 2024-04-03T08:29:02.062 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.192+0000 7f92a5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.192+0000 7f92a5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0111760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48816/0 (socket says 172.21.15.157:48816) 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.192+0000 7f92a5400700 1 -- 172.21.15.157:0/4203257817 learned_addr learned my addr 172.21.15.157:0/4203257817 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f92a5400700 1 -- 172.21.15.157:0/4203257817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940094f0 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f92a5400700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0111760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9294006b00 tx=0x7f9294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9294010840 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9294010e70 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a0111ea0 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f929401ae70 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.193+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a0112a10 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.194+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f92940109a0 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.194+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a005f5f0 con 0x7f92a0102970 2024-04-03T08:29:02.063 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.195+0000 7f929d600700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f92880367e0 0x7f9288038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.195+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f929404aba0 con 0x7f92a0102970 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.195+0000 7f92a4a00700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f92880367e0 0x7f9288038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.195+0000 7f92a4a00700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f92880367e0 0x7f9288038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f928c009990 tx=0x7f928c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.199+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f929401a430 con 0x7f92a0102970 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.404+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f92a00ff490 con 0x7f92880367e0 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.408+0000 7f929d600700 1 -- 172.21.15.157:0/4203257817 <== mgr.14118 v2:172.21.15.157:6800/1166303024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f92a00ff490 con 0x7f92880367e0 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.410+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f92880367e0 msgr2=0x7f9288038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:02.064 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.410+0000 7f92a7e00700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f92880367e0 0x7f9288038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f928c009990 tx=0x7f928c006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 msgr2=0x7f92a0111760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0111760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9294006b00 tx=0x7f9294009250 comp rx=0 tx=0).stop 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 shutdown_connections 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f92880367e0 0x7f9288038c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 --2- 172.21.15.157:0/4203257817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92a0102970 0x7f92a0111760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 >> 172.21.15.157:0/4203257817 conn(0x7f92a00fe090 msgr2=0x7f92a00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 shutdown_connections 2024-04-03T08:29:02.065 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:01.411+0000 7f92a7e00700 1 -- 172.21.15.157:0/4203257817 wait complete. 2024-04-03T08:29:02.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:02 smithi157 ceph-mon[35083]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:02.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:02 smithi157 ceph-mon[35083]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:02.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:02 smithi157 ceph-mon[35083]: Saving service alertmanager spec with placement count:1 2024-04-03T08:29:02.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:02 smithi157 ceph-mon[35083]: from='mgr.14118 172.21.15.157:0/2209326325' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:03.418 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37f5a00700 1 Processor -- start 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37f5a00700 1 -- start start 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37f5a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37f5a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01032c0 con 0x7f37f0102970 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37eea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37eea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58208/0 (socket says 172.21.15.157:58208) 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.582+0000 7f37eea00700 1 -- 172.21.15.157:0/427775669 learned_addr learned my addr 172.21.15.157:0/427775669 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.583+0000 7f37eea00700 1 -- 172.21.15.157:0/427775669 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0103400 con 0x7f37f0102970 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.583+0000 7f37eea00700 1 --2- 172.21.15.157:0/427775669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0102d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f37e00098e0 tx=0x7f37e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8828d88bc2a05208 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.583+0000 7f37ed600700 1 -- 172.21.15.157:0/427775669 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37e000b860 con 0x7f37f0102970 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.583+0000 7f37ed600700 1 -- 172.21.15.157:0/427775669 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37e000be90 con 0x7f37f0102970 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.583+0000 7f37ed600700 1 -- 172.21.15.157:0/427775669 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37e00103c0 con 0x7f37f0102970 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 -- 172.21.15.157:0/427775669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 msgr2=0x7f37f0102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:03.419 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 --2- 172.21.15.157:0/427775669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0102d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f37e00098e0 tx=0x7f37e0009250 comp rx=0 tx=0).stop 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 -- 172.21.15.157:0/427775669 shutdown_connections 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 --2- 172.21.15.157:0/427775669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0102d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 -- 172.21.15.157:0/427775669 >> 172.21.15.157:0/427775669 conn(0x7f37f00fe090 msgr2=0x7f37f0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 -- 172.21.15.157:0/427775669 shutdown_connections 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.584+0000 7f37f5a00700 1 -- 172.21.15.157:0/427775669 wait complete. 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.585+0000 7f37f5a00700 1 Processor -- start 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.585+0000 7f37f5a00700 1 -- start start 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.586+0000 7f37f5a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0111740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.586+0000 7f37f5a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0111c80 con 0x7f37f0102970 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.586+0000 7f37eea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0111740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.586+0000 7f37eea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0111740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58222/0 (socket says 172.21.15.157:58222) 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.586+0000 7f37eea00700 1 -- 172.21.15.157:0/3630815556 learned_addr learned my addr 172.21.15.157:0/3630815556 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.586+0000 7f37eea00700 1 -- 172.21.15.157:0/3630815556 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e00094f0 con 0x7f37f0102970 2024-04-03T08:29:03.420 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.587+0000 7f37eea00700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0111740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37e0006b00 tx=0x7f37e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.587+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37e0010840 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.587+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37e0010e70 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.587+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f0111e80 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.587+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37e001ae70 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.587+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f01129f0 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.588+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f37e00109a0 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.588+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f005f5f0 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.588+0000 7f37e6a00700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f37d40367e0 0x7f37d4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.588+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f37e004aba0 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.589+0000 7f37ee000700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f37d40367e0 0x7f37d4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.589+0000 7f37ee000700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f37d40367e0 0x7f37d4038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009990 tx=0x7f37dc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.593+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f37e001a430 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.787+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f37f004bed0 con 0x7f37f0102970 2024-04-03T08:29:03.421 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.791+0000 7f37e6a00700 1 -- 172.21.15.157:0/3630815556 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f37e002cb80 con 0x7f37f0102970 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.793+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f37d40367e0 msgr2=0x7f37d4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.793+0000 7f37f5a00700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f37d40367e0 0x7f37d4038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009990 tx=0x7f37dc006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.793+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 msgr2=0x7f37f0111740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.793+0000 7f37f5a00700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0111740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37e0006b00 tx=0x7f37e0009250 comp rx=0 tx=0).stop 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.794+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 shutdown_connections 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.794+0000 7f37f5a00700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f37d40367e0 0x7f37d4038c90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.794+0000 7f37f5a00700 1 --2- 172.21.15.157:0/3630815556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f0102970 0x7f37f0111740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.794+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 >> 172.21.15.157:0/3630815556 conn(0x7f37f00fe090 msgr2=0x7f37f00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.794+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 shutdown_connections 2024-04-03T08:29:03.422 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:02.794+0000 7f37f5a00700 1 -- 172.21.15.157:0/3630815556 wait complete. 2024-04-03T08:29:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:03 smithi157 ceph-mon[35083]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:03 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3630815556' entity='client.admin' 2024-04-03T08:29:04.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.987+0000 7f9a0d000700 1 Processor -- start 2024-04-03T08:29:04.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.987+0000 7f9a0d000700 1 -- start start 2024-04-03T08:29:04.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.987+0000 7f9a0d000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.987+0000 7f9a0d000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08103280 con 0x7f9a08102930 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.988+0000 7f9a05e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.988+0000 7f9a05e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58224/0 (socket says 172.21.15.157:58224) 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.988+0000 7f9a05e00700 1 -- 172.21.15.157:0/3786257053 learned_addr learned my addr 172.21.15.157:0/3786257053 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.988+0000 7f9a05e00700 1 -- 172.21.15.157:0/3786257053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a081033c0 con 0x7f9a08102930 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.988+0000 7f9a05e00700 1 --2- 172.21.15.157:0/3786257053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08102d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99f80098e0 tx=0x7f99f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e872e51ffdbfcf server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a04a00700 1 -- 172.21.15.157:0/3786257053 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f800b860 con 0x7f9a08102930 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a04a00700 1 -- 172.21.15.157:0/3786257053 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99f800be90 con 0x7f9a08102930 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a04a00700 1 -- 172.21.15.157:0/3786257053 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f80103c0 con 0x7f9a08102930 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 -- 172.21.15.157:0/3786257053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 msgr2=0x7f9a08102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 --2- 172.21.15.157:0/3786257053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08102d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99f80098e0 tx=0x7f99f8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:04.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 -- 172.21.15.157:0/3786257053 shutdown_connections 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 --2- 172.21.15.157:0/3786257053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08102d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 -- 172.21.15.157:0/3786257053 >> 172.21.15.157:0/3786257053 conn(0x7f9a080fe090 msgr2=0x7f9a081004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 -- 172.21.15.157:0/3786257053 shutdown_connections 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.989+0000 7f9a0d000700 1 -- 172.21.15.157:0/3786257053 wait complete. 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.990+0000 7f9a0d000700 1 Processor -- start 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.990+0000 7f9a0d000700 1 -- start start 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a0d000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a0d000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08113ec0 con 0x7f9a08102930 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a05e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a05e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58236/0 (socket says 172.21.15.157:58236) 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a05e00700 1 -- 172.21.15.157:0/2530736537 learned_addr learned my addr 172.21.15.157:0/2530736537 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a05e00700 1 -- 172.21.15.157:0/2530736537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80094f0 con 0x7f9a08102930 2024-04-03T08:29:04.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.991+0000 7f9a05e00700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08113980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99f8011c10 tx=0x7f99f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.992+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f8010890 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.992+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99f8010ec0 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.992+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a081140c0 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.992+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f80243f0 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.992+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08114c30 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.993+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0805f5f0 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.993+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f99f801a430 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.993+0000 7f99fe000700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f99ec0367e0 0x7f99ec038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.993+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f99f804a210 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.993+0000 7f9a05400700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f99ec0367e0 0x7f99ec038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.994+0000 7f9a05400700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f99ec0367e0 0x7f99ec038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009990 tx=0x7f99f4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:03.998+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f99f802b8c0 con 0x7f9a08102930 2024-04-03T08:29:04.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.194+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f9a0804bed0 con 0x7f9a08102930 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.198+0000 7f99fe000700 1 -- 172.21.15.157:0/2530736537 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f99f802b2f0 con 0x7f9a08102930 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f99ec0367e0 msgr2=0x7f99ec038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f99ec0367e0 0x7f99ec038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009990 tx=0x7f99f4006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 msgr2=0x7f9a08113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08113980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99f8011c10 tx=0x7f99f8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 shutdown_connections 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f99ec0367e0 0x7f99ec038c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 --2- 172.21.15.157:0/2530736537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a08102930 0x7f9a08113980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.200+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 >> 172.21.15.157:0/2530736537 conn(0x7f9a080fe090 msgr2=0x7f9a080febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.201+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 shutdown_connections 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:04.201+0000 7f9a0d000700 1 -- 172.21.15.157:0/2530736537 wait complete. 2024-04-03T08:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling the dashboard module... 2024-04-03T08:29:05.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:05 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2530736537' entity='client.admin' 2024-04-03T08:29:06.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:06 smithi157 ceph-mon[35083]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:06.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:06 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/75727131' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-03T08:29:06.912 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.233+0000 7f3afb600700 1 Processor -- start 2024-04-03T08:29:06.912 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.234+0000 7f3afb600700 1 -- start start 2024-04-03T08:29:06.912 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.234+0000 7f3afb600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af4076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:06.912 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.234+0000 7f3afb600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4077f50 con 0x7f3af4077b40 2024-04-03T08:29:06.912 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.234+0000 7f3af8c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af4076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.234+0000 7f3af8c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af4076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58242/0 (socket says 172.21.15.157:58242) 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.234+0000 7f3af8c00700 1 -- 172.21.15.157:0/4128938457 learned_addr learned my addr 172.21.15.157:0/4128938457 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.235+0000 7f3af8c00700 1 -- 172.21.15.157:0/4128938457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4076680 con 0x7f3af4077b40 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.235+0000 7f3af8c00700 1 --2- 172.21.15.157:0/4128938457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af4076140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80098e0 tx=0x7f3ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13100e84ba3ffa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.235+0000 7f3af3400700 1 -- 172.21.15.157:0/4128938457 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae800b860 con 0x7f3af4077b40 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.235+0000 7f3af3400700 1 -- 172.21.15.157:0/4128938457 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ae800be90 con 0x7f3af4077b40 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.235+0000 7f3af3400700 1 -- 172.21.15.157:0/4128938457 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae80103c0 con 0x7f3af4077b40 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 -- 172.21.15.157:0/4128938457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 msgr2=0x7f3af4076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 --2- 172.21.15.157:0/4128938457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af4076140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80098e0 tx=0x7f3ae8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 -- 172.21.15.157:0/4128938457 shutdown_connections 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 --2- 172.21.15.157:0/4128938457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af4076140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 -- 172.21.15.157:0/4128938457 >> 172.21.15.157:0/4128938457 conn(0x7f3af40fe090 msgr2=0x7f3af41004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:06.913 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 -- 172.21.15.157:0/4128938457 shutdown_connections 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.236+0000 7f3afb600700 1 -- 172.21.15.157:0/4128938457 wait complete. 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3afb600700 1 Processor -- start 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3afb600700 1 -- start start 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3afb600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af41139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3afb600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4113f10 con 0x7f3af4077b40 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3af8c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af41139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3af8c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af41139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58258/0 (socket says 172.21.15.157:58258) 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.237+0000 7f3af8c00700 1 -- 172.21.15.157:0/75727131 learned_addr learned my addr 172.21.15.157:0/75727131 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3af8c00700 1 -- 172.21.15.157:0/75727131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae80094f0 con 0x7f3af4077b40 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3af8c00700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af41139d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80105b0 tx=0x7f3ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae8010840 con 0x7f3af4077b40 2024-04-03T08:29:06.914 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ae8010e70 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af4114110 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae801ae30 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.238+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af4114c80 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.239+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f3ae80109a0 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.239+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af405f5f0 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.240+0000 7f3af0c00700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3adc0367e0 0x7f3adc038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.240+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3ae804a1f0 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.240+0000 7f3af3e00700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3adc0367e0 0x7f3adc038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.241+0000 7f3af3e00700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3adc0367e0 0x7f3adc038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009990 tx=0x7f3ae0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.245+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3ae802b4d0 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:05.488+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f3af404bed0 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.204+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f3ae802d3f0 con 0x7f3af4077b40 2024-04-03T08:29:06.915 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.206+0000 7f3af0c00700 1 -- 172.21.15.157:0/75727131 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f3ae800e260 con 0x7f3af4077b40 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.209+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3adc0367e0 msgr2=0x7f3adc038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.209+0000 7f3afb600700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3adc0367e0 0x7f3adc038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009990 tx=0x7f3ae0006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.209+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 msgr2=0x7f3af41139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.209+0000 7f3afb600700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af41139d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80105b0 tx=0x7f3ae8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.210+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 shutdown_connections 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.210+0000 7f3afb600700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f3adc0367e0 0x7f3adc038c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.210+0000 7f3afb600700 1 --2- 172.21.15.157:0/75727131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3af4077b40 0x7f3af41139d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.210+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 >> 172.21.15.157:0/75727131 conn(0x7f3af40fe090 msgr2=0x7f3af40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.210+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 shutdown_connections 2024-04-03T08:29:06.916 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:06.210+0000 7f3afb600700 1 -- 172.21.15.157:0/75727131 wait complete. 2024-04-03T08:29:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:07 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/75727131' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-03T08:29:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:07 smithi157 ceph-mon[35083]: mgrmap e9: smithi157.qfvynr(active, since 27s) 2024-04-03T08:29:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:29:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-03T08:29:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-03T08:29:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "active_name": "smithi157.qfvynr", 2024-04-03T08:29:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-03T08:29:08.430 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.551+0000 7f8ab8c00700 1 Processor -- start 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.551+0000 7f8ab8c00700 1 -- start start 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.552+0000 7f8ab8c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.552+0000 7f8ab8c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab4077f00 con 0x7f8ab4077af0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.552+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.552+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58298/0 (socket says 172.21.15.157:58298) 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.552+0000 7f8ab1e00700 1 -- 172.21.15.157:0/1742057099 learned_addr learned my addr 172.21.15.157:0/1742057099 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.552+0000 7f8ab1e00700 1 -- 172.21.15.157:0/1742057099 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4078040 con 0x7f8ab4077af0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.553+0000 7f8ab1e00700 1 --2- 172.21.15.157:0/1742057099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4076140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40098e0 tx=0x7f8aa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfa4c529569ff60 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.553+0000 7f8ab0a00700 1 -- 172.21.15.157:0/1742057099 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa400b860 con 0x7f8ab4077af0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.553+0000 7f8ab0a00700 1 -- 172.21.15.157:0/1742057099 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8aa400be90 con 0x7f8ab4077af0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.553+0000 7f8ab0a00700 1 -- 172.21.15.157:0/1742057099 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa40103c0 con 0x7f8ab4077af0 2024-04-03T08:29:08.431 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 -- 172.21.15.157:0/1742057099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 msgr2=0x7f8ab4076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 --2- 172.21.15.157:0/1742057099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4076140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40098e0 tx=0x7f8aa4009250 comp rx=0 tx=0).stop 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 -- 172.21.15.157:0/1742057099 shutdown_connections 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 --2- 172.21.15.157:0/1742057099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4076140 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 -- 172.21.15.157:0/1742057099 >> 172.21.15.157:0/1742057099 conn(0x7f8ab40fe090 msgr2=0x7f8ab4100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 -- 172.21.15.157:0/1742057099 shutdown_connections 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.554+0000 7f8ab8c00700 1 -- 172.21.15.157:0/1742057099 wait complete. 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.555+0000 7f8ab8c00700 1 Processor -- start 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.555+0000 7f8ab8c00700 1 -- start start 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.555+0000 7f8ab8c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.555+0000 7f8ab8c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab4102db0 con 0x7f8ab4077af0 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.555+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4102870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58312/0 (socket says 172.21.15.157:58312) 2024-04-03T08:29:08.432 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8ab1e00700 1 -- 172.21.15.157:0/436859785 learned_addr learned my addr 172.21.15.157:0/436859785 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8ab1e00700 1 -- 172.21.15.157:0/436859785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40094f0 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8ab1e00700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4102870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40105b0 tx=0x7f8aa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa4010840 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8aa4010e70 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab4102fb0 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.556+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa401ae30 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.557+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4103440 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.557+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f8aa402d3f0 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.558+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab404bed0 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.558+0000 7f8aaa000700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 0x7f8a98038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.558+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8aa404a1d0 con 0x7f8ab4077af0 2024-04-03T08:29:08.433 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.558+0000 7f8ab1400700 1 -- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 msgr2=0x7f8a98038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.558+0000 7f8ab1400700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 0x7f8a98038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.563+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8aa402b8e0 con 0x7f8ab4077af0 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.759+0000 7f8ab1400700 1 -- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 msgr2=0x7f8a98038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.759+0000 7f8ab1400700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 0x7f8a98038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.819+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f8ab4103fc0 con 0x7f8ab4077af0 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.820+0000 7f8aaa000700 1 -- 172.21.15.157:0/436859785 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f8aa402b2f0 con 0x7f8ab4077af0 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 msgr2=0x7f8a98038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 0x7f8a98038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 msgr2=0x7f8ab4102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4102870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40105b0 tx=0x7f8aa4009250 comp rx=0 tx=0).stop 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 shutdown_connections 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f8a98036830 0x7f8a98038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:08.434 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 --2- 172.21.15.157:0/436859785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ab4077af0 0x7f8ab4102870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:08.435 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 >> 172.21.15.157:0/436859785 conn(0x7f8ab40fe090 msgr2=0x7f8ab40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:08.435 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.822+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 shutdown_connections 2024-04-03T08:29:08.435 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:07.823+0000 7f8ab8c00700 1 -- 172.21.15.157:0/436859785 wait complete. 2024-04-03T08:29:08.435 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for the mgr to restart... 2024-04-03T08:29:08.435 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for mgr epoch 9... 2024-04-03T08:29:08.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:08 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/436859785' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-03T08:29:14.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: Active manager daemon smithi157.qfvynr restarted 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: Activating manager daemon smithi157.qfvynr 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: osdmap e3: 0 total, 0 up, 0 in 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: mgrmap e10: smithi157.qfvynr(active, starting, since 0.00382846s) 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:29:14.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:14 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:29:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:29:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:29:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: [03/Apr/2024:08:29:15] ENGINE Bus STARTING 2024-04-03T08:29:16.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: [03/Apr/2024:08:29:15] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:29:16.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: [03/Apr/2024:08:29:15] ENGINE Bus STARTED 2024-04-03T08:29:16.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:16.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:15 smithi157 ceph-mon[35083]: mgrmap e11: smithi157.qfvynr(active, since 1.00722s) 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout { 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout } 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c3a600700 1 Processor -- start 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c3a600700 1 -- start start 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c3a600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c3a600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c341032c0 con 0x7f0c34102970 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c33400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c33400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58328/0 (socket says 172.21.15.157:58328) 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.007+0000 7f0c33400700 1 -- 172.21.15.157:0/825650971 learned_addr learned my addr 172.21.15.157:0/825650971 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.008+0000 7f0c33400700 1 -- 172.21.15.157:0/825650971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34103400 con 0x7f0c34102970 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.008+0000 7f0c33400700 1 --2- 172.21.15.157:0/825650971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34102d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c240098e0 tx=0x7f0c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f115236581615f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.008+0000 7f0c32000700 1 -- 172.21.15.157:0/825650971 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c2400b860 con 0x7f0c34102970 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.008+0000 7f0c32000700 1 -- 172.21.15.157:0/825650971 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c2400be90 con 0x7f0c34102970 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.008+0000 7f0c32000700 1 -- 172.21.15.157:0/825650971 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c240103c0 con 0x7f0c34102970 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 -- 172.21.15.157:0/825650971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 msgr2=0x7f0c34102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825650971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34102d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c240098e0 tx=0x7f0c24009250 comp rx=0 tx=0).stop 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 -- 172.21.15.157:0/825650971 shutdown_connections 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825650971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34102d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 -- 172.21.15.157:0/825650971 >> 172.21.15.157:0/825650971 conn(0x7f0c340fe090 msgr2=0x7f0c34100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:16.723 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 -- 172.21.15.157:0/825650971 shutdown_connections 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.009+0000 7f0c3a600700 1 -- 172.21.15.157:0/825650971 wait complete. 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.010+0000 7f0c3a600700 1 Processor -- start 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.010+0000 7f0c3a600700 1 -- start start 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.010+0000 7f0c3a600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.010+0000 7f0c3a600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34111ca0 con 0x7f0c34102970 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c33400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c33400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34111760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58344/0 (socket says 172.21.15.157:58344) 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c33400700 1 -- 172.21.15.157:0/825970592 learned_addr learned my addr 172.21.15.157:0/825970592 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c33400700 1 -- 172.21.15.157:0/825970592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240094f0 con 0x7f0c34102970 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c33400700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34111760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c24006b00 tx=0x7f0c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c24010840 con 0x7f0c34102970 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c24010e70 con 0x7f0c34102970 2024-04-03T08:29:16.724 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.011+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c34111ea0 con 0x7f0c34102970 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.012+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c2401ae70 con 0x7f0c34102970 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.012+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c34112a10 con 0x7f0c34102970 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.013+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f0c240109a0 con 0x7f0c34102970 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.013+0000 7f0c2b400700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.013+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 --> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c180393f0 con 0x7f0c18036830 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.013+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0c2404ab40 con 0x7f0c34102970 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.013+0000 7f0c32a00700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 msgr2=0x7f0c18038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.014+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.215+0000 7f0c32a00700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 msgr2=0x7f0c18038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.215+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.616+0000 7f0c32a00700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 msgr2=0x7f0c18038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:09.616+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-03T08:29:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:10.417+0000 7f0c32a00700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 msgr2=0x7f0c18038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:10.417+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:12.019+0000 7f0c32a00700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 msgr2=0x7f0c18038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/1166303024 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:12.019+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:14.605+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7f0c2402e960 con 0x7f0c34102970 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:14.606+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 msgr2=0x7f0c18038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:14.606+0000 7f0c2b400700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.608+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f0c2402ad50 con 0x7f0c34102970 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.608+0000 7f0c2b400700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f0c1803a070 0x7f0c1803c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.608+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c180393f0 con 0x7f0c1803a070 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.609+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f0c1803a070 0x7f0c1803c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.610+0000 7f0c32a00700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f0c1803a070 0x7f0c1803c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0c200039d0 tx=0x7f0c20009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.611+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f0c180393f0 con 0x7f0c1803a070 2024-04-03T08:29:16.726 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0c34112330 con 0x7f0c1803a070 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c2b400700 1 -- 172.21.15.157:0/825970592 <== mgr.14160 v2:172.21.15.157:6800/494465315 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f0c34112330 con 0x7f0c1803a070 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f0c1803a070 msgr2=0x7f0c1803c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f0c1803a070 0x7f0c1803c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0c200039d0 tx=0x7f0c20009350 comp rx=0 tx=0).stop 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 msgr2=0x7f0c34111760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34111760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c24006b00 tx=0x7f0c24009250 comp rx=0 tx=0).stop 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 shutdown_connections 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f0c1803a070 0x7f0c1803c450 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c34102970 0x7f0c34111760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 --2- 172.21.15.157:0/825970592 >> [v2:172.21.15.157:6800/1166303024,v1:172.21.15.157:6801/1166303024] conn(0x7f0c18036830 0x7f0c18038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.617+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 >> 172.21.15.157:0/825970592 conn(0x7f0c340fe090 msgr2=0x7f0c340fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.618+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 shutdown_connections 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:15.618+0000 7f0c3a600700 1 -- 172.21.15.157:0/825970592 wait complete. 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:mgr epoch 9 is available 2024-04-03T08:29:16.727 INFO:teuthology.orchestra.run.smithi157.stdout:Generating a dashboard self-signed certificate... 2024-04-03T08:29:17.674 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:17 smithi157 ceph-mon[35083]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-03T08:29:17.674 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:17 smithi157 ceph-mon[35083]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-03T08:29:17.674 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:17 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:18.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-03T08:29:18.201 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.353+0000 7f104ae00700 1 Processor -- start 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.353+0000 7f104ae00700 1 -- start start 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.353+0000 7f104ae00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.353+0000 7f104ae00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044102180 con 0x7f1044101830 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1043e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1043e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50468/0 (socket says 172.21.15.157:50468) 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1043e00700 1 -- 172.21.15.157:0/9647789 learned_addr learned my addr 172.21.15.157:0/9647789 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1043e00700 1 -- 172.21.15.157:0/9647789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10441022c0 con 0x7f1044101830 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1043e00700 1 --2- 172.21.15.157:0/9647789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044101c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10340098e0 tx=0x7f1034009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b408dbd4930fcd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1042a00700 1 -- 172.21.15.157:0/9647789 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f103400b860 con 0x7f1044101830 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1042a00700 1 -- 172.21.15.157:0/9647789 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f103400be90 con 0x7f1044101830 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.354+0000 7f1042a00700 1 -- 172.21.15.157:0/9647789 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10340103c0 con 0x7f1044101830 2024-04-03T08:29:18.202 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 -- 172.21.15.157:0/9647789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 msgr2=0x7f1044101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 --2- 172.21.15.157:0/9647789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044101c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10340098e0 tx=0x7f1034009250 comp rx=0 tx=0).stop 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 -- 172.21.15.157:0/9647789 shutdown_connections 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 --2- 172.21.15.157:0/9647789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044101c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 -- 172.21.15.157:0/9647789 >> 172.21.15.157:0/9647789 conn(0x7f10440fcfb0 msgr2=0x7f10440ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 -- 172.21.15.157:0/9647789 shutdown_connections 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.355+0000 7f104ae00700 1 -- 172.21.15.157:0/9647789 wait complete. 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.356+0000 7f104ae00700 1 Processor -- start 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.356+0000 7f104ae00700 1 -- start start 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f104ae00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f104ae00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044113e80 con 0x7f1044101830 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f1043e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f1043e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50472/0 (socket says 172.21.15.157:50472) 2024-04-03T08:29:18.203 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f1043e00700 1 -- 172.21.15.157:0/2538718161 learned_addr learned my addr 172.21.15.157:0/2538718161 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f1043e00700 1 -- 172.21.15.157:0/2538718161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340094f0 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.357+0000 7f1043e00700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044113940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1034011c10 tx=0x7f1034009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.358+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1034010890 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.358+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1034010ec0 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.358+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1044114080 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.358+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10340243f0 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.358+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1044114bf0 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.359+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104405f5f0 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.359+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f103401a430 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.360+0000 7f103be00700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f1028036830 0x7f1028038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.360+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f103404a310 con 0x7f1044101830 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.360+0000 7f1043400700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f1028036830 0x7f1028038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:18.204 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.360+0000 7f1043400700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f1028036830 0x7f1028038ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1030009990 tx=0x7f1030006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.365+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f103402b8e0 con 0x7f1044101830 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.575+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f10441157d0 con 0x7f1028036830 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.649+0000 7f103be00700 1 -- 172.21.15.157:0/2538718161 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f10441157d0 con 0x7f1028036830 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f1028036830 msgr2=0x7f1028038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f1028036830 0x7f1028038ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1030009990 tx=0x7f1030006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 msgr2=0x7f1044113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044113940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1034011c10 tx=0x7f1034009250 comp rx=0 tx=0).stop 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 shutdown_connections 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f1028036830 0x7f1028038ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 --2- 172.21.15.157:0/2538718161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1044101830 0x7f1044113940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 >> 172.21.15.157:0/2538718161 conn(0x7f10440fcfb0 msgr2=0x7f10440fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 shutdown_connections 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:17.652+0000 7f104ae00700 1 -- 172.21.15.157:0/2538718161 wait complete. 2024-04-03T08:29:18.205 INFO:teuthology.orchestra.run.smithi157.stdout:Creating initial admin user... 2024-04-03T08:29:18.458 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:18 smithi157 ceph-mon[35083]: mgrmap e12: smithi157.qfvynr(active, since 2s) 2024-04-03T08:29:18.458 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:18 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:18.459 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:18 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:18.459 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:18 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:19.695 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:19 smithi157 ceph-mon[35083]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:20.289 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$DKmWsh4kgdArv37rwj.UBuDqQZZMW0k4jtKZIciaB3qJK1XodwxQi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1712132959, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-03T08:29:20.289 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.941+0000 7ffadc000700 1 Processor -- start 2024-04-03T08:29:20.289 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.942+0000 7ffadc000700 1 -- start start 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.942+0000 7ffadc000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.942+0000 7ffadc000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4077ee0 con 0x7ffad4077ad0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.942+0000 7ffad9600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad9600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50478/0 (socket says 172.21.15.157:50478) 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad9600700 1 -- 172.21.15.157:0/3040270394 learned_addr learned my addr 172.21.15.157:0/3040270394 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad9600700 1 -- 172.21.15.157:0/3040270394 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4078020 con 0x7ffad4077ad0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad9600700 1 --2- 172.21.15.157:0/3040270394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4076120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffac80098e0 tx=0x7ffac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dd7084c09a66db server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad3e00700 1 -- 172.21.15.157:0/3040270394 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffac800b860 con 0x7ffad4077ad0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad3e00700 1 -- 172.21.15.157:0/3040270394 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffac800be90 con 0x7ffad4077ad0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.943+0000 7ffad3e00700 1 -- 172.21.15.157:0/3040270394 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffac80103c0 con 0x7ffad4077ad0 2024-04-03T08:29:20.290 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 -- 172.21.15.157:0/3040270394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 msgr2=0x7ffad4076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 --2- 172.21.15.157:0/3040270394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4076120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffac80098e0 tx=0x7ffac8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 -- 172.21.15.157:0/3040270394 shutdown_connections 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 --2- 172.21.15.157:0/3040270394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4076120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 -- 172.21.15.157:0/3040270394 >> 172.21.15.157:0/3040270394 conn(0x7ffad40fe090 msgr2=0x7ffad4100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 -- 172.21.15.157:0/3040270394 shutdown_connections 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.944+0000 7ffadc000700 1 -- 172.21.15.157:0/3040270394 wait complete. 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.945+0000 7ffadc000700 1 Processor -- start 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.945+0000 7ffadc000700 1 -- start start 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.945+0000 7ffadc000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.945+0000 7ffadc000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4113eb0 con 0x7ffad4077ad0 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad9600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad9600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50488/0 (socket says 172.21.15.157:50488) 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad9600700 1 -- 172.21.15.157:0/2281352184 learned_addr learned my addr 172.21.15.157:0/2281352184 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad9600700 1 -- 172.21.15.157:0/2281352184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80094f0 con 0x7ffad4077ad0 2024-04-03T08:29:20.291 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad9600700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4113970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffac80105b0 tx=0x7ffac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffac8010840 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffac8010e70 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad41140b0 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.946+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffac801ae30 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.947+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad4114c20 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.947+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7ffac801a430 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.948+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad405f5f0 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.948+0000 7ffad1600700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ffabc0367e0 0x7ffabc038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.948+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffac804a3b0 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.948+0000 7ffad8c00700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ffabc0367e0 0x7ffabc038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.949+0000 7ffad8c00700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ffabc0367e0 0x7ffabc038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009990 tx=0x7ffac0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:18.953+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ffac802b4d0 con 0x7ffad4077ad0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.182+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ffad405f410 con 0x7ffabc0367e0 2024-04-03T08:29:20.292 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.405+0000 7ffad1600700 1 -- 172.21.15.157:0/2281352184 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ffad405f410 con 0x7ffabc0367e0 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.407+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ffabc0367e0 msgr2=0x7ffabc038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ffabc0367e0 0x7ffabc038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009990 tx=0x7ffac0006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 msgr2=0x7ffad4113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4113970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffac80105b0 tx=0x7ffac8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 shutdown_connections 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ffabc0367e0 0x7ffabc038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 --2- 172.21.15.157:0/2281352184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad4077ad0 0x7ffad4113970 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 >> 172.21.15.157:0/2281352184 conn(0x7ffad40fe090 msgr2=0x7ffad40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 shutdown_connections 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:19.408+0000 7ffadc000700 1 -- 172.21.15.157:0/2281352184 wait complete. 2024-04-03T08:29:20.293 INFO:teuthology.orchestra.run.smithi157.stdout:Fetching dashboard port number... 2024-04-03T08:29:20.546 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:20 smithi157 ceph-mon[35083]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:20.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:20 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:21.403 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:21 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3036025230' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-03T08:29:21.708 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stdout 8443 2024-04-03T08:29:21.713 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8df600700 1 Processor -- start 2024-04-03T08:29:21.713 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8df600700 1 -- start start 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8df600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d8076180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8df600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8077f90 con 0x7fe8d8077b80 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8dcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d8076180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8dcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d8076180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50504/0 (socket says 172.21.15.157:50504) 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.875+0000 7fe8dcc00700 1 -- 172.21.15.157:0/1271375396 learned_addr learned my addr 172.21.15.157:0/1271375396 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.876+0000 7fe8dcc00700 1 -- 172.21.15.157:0/1271375396 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80766c0 con 0x7fe8d8077b80 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.876+0000 7fe8dcc00700 1 --2- 172.21.15.157:0/1271375396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d8076180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0098e0 tx=0x7fe8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1117c5bc1c4436 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.876+0000 7fe8d7400700 1 -- 172.21.15.157:0/1271375396 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc00b860 con 0x7fe8d8077b80 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.876+0000 7fe8d7400700 1 -- 172.21.15.157:0/1271375396 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8cc00be90 con 0x7fe8d8077b80 2024-04-03T08:29:21.714 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.876+0000 7fe8d7400700 1 -- 172.21.15.157:0/1271375396 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc0103c0 con 0x7fe8d8077b80 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 -- 172.21.15.157:0/1271375396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 msgr2=0x7fe8d8076180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 --2- 172.21.15.157:0/1271375396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d8076180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0098e0 tx=0x7fe8cc009250 comp rx=0 tx=0).stop 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 -- 172.21.15.157:0/1271375396 shutdown_connections 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 --2- 172.21.15.157:0/1271375396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d8076180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 -- 172.21.15.157:0/1271375396 >> 172.21.15.157:0/1271375396 conn(0x7fe8d80fe090 msgr2=0x7fe8d81004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 -- 172.21.15.157:0/1271375396 shutdown_connections 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.877+0000 7fe8df600700 1 -- 172.21.15.157:0/1271375396 wait complete. 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.878+0000 7fe8df600700 1 Processor -- start 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.878+0000 7fe8df600700 1 -- start start 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.878+0000 7fe8df600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d81139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.878+0000 7fe8df600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8113f20 con 0x7fe8d8077b80 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.878+0000 7fe8dcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d81139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8dcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d81139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50506/0 (socket says 172.21.15.157:50506) 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8dcc00700 1 -- 172.21.15.157:0/3036025230 learned_addr learned my addr 172.21.15.157:0/3036025230 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8dcc00700 1 -- 172.21.15.157:0/3036025230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0094f0 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8dcc00700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d81139e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc011c10 tx=0x7fe8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc010630 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8cc010c60 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8df600700 1 -- 172.21.15.157:0/3036025230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d8114120 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc01ad10 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.879+0000 7fe8df600700 1 -- 172.21.15.157:0/3036025230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d8114c90 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.880+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fe8cc01a5f0 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.880+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b40052b0 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.881+0000 7fe8d4c00700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe8c0036830 0x7fe8c0038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.881+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe8cc04a000 con 0x7fe8d8077b80 2024-04-03T08:29:21.716 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.881+0000 7fe8d7e00700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe8c0036830 0x7fe8c0038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.882+0000 7fe8d7e00700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe8c0036830 0x7fe8c0038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009990 tx=0x7fe8c4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:20.886+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe8cc07c190 con 0x7fe8d8077b80 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.078+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fe8b4005ae0 con 0x7fe8d8077b80 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.079+0000 7fe8d4c00700 1 -- 172.21.15.157:0/3036025230 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fe8cc020020 con 0x7fe8d8077b80 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe8c0036830 msgr2=0x7fe8c0038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe8c0036830 0x7fe8c0038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009990 tx=0x7fe8c4006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 msgr2=0x7fe8d81139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d81139e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc011c10 tx=0x7fe8cc009250 comp rx=0 tx=0).stop 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 shutdown_connections 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe8c0036830 0x7fe8c0038ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 --2- 172.21.15.157:0/3036025230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8d8077b80 0x7fe8d81139e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 >> 172.21.15.157:0/3036025230 conn(0x7fe8d80fe090 msgr2=0x7fe8d80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:21.717 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 shutdown_connections 2024-04-03T08:29:21.718 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:21.081+0000 7fe8ca000700 1 -- 172.21.15.157:0/3036025230 wait complete. 2024-04-03T08:29:21.730 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-03T08:29:21.730 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout disabled 2024-04-03T08:29:21.746 INFO:teuthology.orchestra.run.smithi157.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-03T08:29:21.746 INFO:teuthology.orchestra.run.smithi157.stdout:systemctl: stdout inactive 2024-04-03T08:29:21.746 INFO:teuthology.orchestra.run.smithi157.stdout:firewalld.service is not enabled 2024-04-03T08:29:21.747 INFO:teuthology.orchestra.run.smithi157.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-03T08:29:21.749 INFO:teuthology.orchestra.run.smithi157.stdout:Ceph Dashboard is now available at: 2024-04-03T08:29:21.750 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:21.750 INFO:teuthology.orchestra.run.smithi157.stdout: URL: https://smithi157.front.sepia.ceph.com:8443/ 2024-04-03T08:29:21.750 INFO:teuthology.orchestra.run.smithi157.stdout: User: admin 2024-04-03T08:29:21.750 INFO:teuthology.orchestra.run.smithi157.stdout: Password: amjgbnp00y 2024-04-03T08:29:21.750 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:21.750 INFO:teuthology.orchestra.run.smithi157.stdout:Saving cluster configuration to /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config directory 2024-04-03T08:29:21.751 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling autotune for osd_memory_target 2024-04-03T08:29:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:22 smithi157 ceph-mon[35083]: mgrmap e13: smithi157.qfvynr(active, since 6s) 2024-04-03T08:29:23.185 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.318+0000 7f3c26200700 1 Processor -- start 2024-04-03T08:29:23.185 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.319+0000 7f3c26200700 1 -- start start 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.319+0000 7f3c26200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.319+0000 7f3c26200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c20103280 con 0x7f3c20102930 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.319+0000 7f3c1f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.319+0000 7f3c1f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53172/0 (socket says 172.21.15.157:53172) 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.319+0000 7f3c1f400700 1 -- 172.21.15.157:0/2540146556 learned_addr learned my addr 172.21.15.157:0/2540146556 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.320+0000 7f3c1f400700 1 -- 172.21.15.157:0/2540146556 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c201033c0 con 0x7f3c20102930 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.320+0000 7f3c1f400700 1 --2- 172.21.15.157:0/2540146556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20102d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c100098e0 tx=0x7f3c10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d589dae744e91c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.320+0000 7f3c1e000700 1 -- 172.21.15.157:0/2540146556 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1000b860 con 0x7f3c20102930 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.320+0000 7f3c1e000700 1 -- 172.21.15.157:0/2540146556 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c1000be90 con 0x7f3c20102930 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.320+0000 7f3c1e000700 1 -- 172.21.15.157:0/2540146556 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c100103c0 con 0x7f3c20102930 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 -- 172.21.15.157:0/2540146556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 msgr2=0x7f3c20102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:23.186 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 --2- 172.21.15.157:0/2540146556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20102d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c100098e0 tx=0x7f3c10009250 comp rx=0 tx=0).stop 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 -- 172.21.15.157:0/2540146556 shutdown_connections 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 --2- 172.21.15.157:0/2540146556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20102d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 -- 172.21.15.157:0/2540146556 >> 172.21.15.157:0/2540146556 conn(0x7f3c200fe090 msgr2=0x7f3c201004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 -- 172.21.15.157:0/2540146556 shutdown_connections 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.321+0000 7f3c26200700 1 -- 172.21.15.157:0/2540146556 wait complete. 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.322+0000 7f3c26200700 1 Processor -- start 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.322+0000 7f3c26200700 1 -- start start 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.322+0000 7f3c26200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.322+0000 7f3c26200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c20113ec0 con 0x7f3c20102930 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.322+0000 7f3c1f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c1f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53188/0 (socket says 172.21.15.157:53188) 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c1f400700 1 -- 172.21.15.157:0/672013764 learned_addr learned my addr 172.21.15.157:0/672013764 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c1f400700 1 -- 172.21.15.157:0/672013764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c100094f0 con 0x7f3c20102930 2024-04-03T08:29:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c1f400700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20113980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c10006b00 tx=0x7f3c10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c10010840 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c10010e70 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1001ae70 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.323+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c201140c0 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.324+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c20114c30 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.324+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f3c1001a780 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.325+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2005f5f0 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.325+0000 7f3c17400700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3c04036880 0x7f3c04038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.325+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3c1004ae30 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.325+0000 7f3c1ea00700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3c04036880 0x7f3c04038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.326+0000 7f3c1ea00700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3c04036880 0x7f3c04038d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009990 tx=0x7f3c0c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.330+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3c1001a430 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.520+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f3c2004bed0 con 0x7f3c20102930 2024-04-03T08:29:23.188 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.521+0000 7f3c17400700 1 -- 172.21.15.157:0/672013764 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f3c1002cb80 con 0x7f3c20102930 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.523+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3c04036880 msgr2=0x7f3c04038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.523+0000 7f3c26200700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3c04036880 0x7f3c04038d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009990 tx=0x7f3c0c006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.523+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 msgr2=0x7f3c20113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.523+0000 7f3c26200700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20113980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c10006b00 tx=0x7f3c10009250 comp rx=0 tx=0).stop 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.524+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 shutdown_connections 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.524+0000 7f3c26200700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3c04036880 0x7f3c04038d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.524+0000 7f3c26200700 1 --2- 172.21.15.157:0/672013764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c20102930 0x7f3c20113980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.524+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 >> 172.21.15.157:0/672013764 conn(0x7f3c200fe090 msgr2=0x7f3c200fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.524+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 shutdown_connections 2024-04-03T08:29:23.189 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:22.524+0000 7f3c26200700 1 -- 172.21.15.157:0/672013764 wait complete. 2024-04-03T08:29:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.707+0000 7fb2bc400700 1 Processor -- start 2024-04-03T08:29:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.708+0000 7fb2bc400700 1 -- start start 2024-04-03T08:29:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.708+0000 7fb2bc400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.708+0000 7fb2bc400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4077f30 con 0x7fb2b4077b20 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.708+0000 7fb2b9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.708+0000 7fb2b9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53202/0 (socket says 172.21.15.157:53202) 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.708+0000 7fb2b9a00700 1 -- 172.21.15.157:0/4186974868 learned_addr learned my addr 172.21.15.157:0/4186974868 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.709+0000 7fb2b9a00700 1 -- 172.21.15.157:0/4186974868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4076660 con 0x7fb2b4077b20 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.709+0000 7fb2b9a00700 1 --2- 172.21.15.157:0/4186974868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4076120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80098e0 tx=0x7fb2a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eefbc37fed4005 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.709+0000 7fb2b3e00700 1 -- 172.21.15.157:0/4186974868 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2a800b860 con 0x7fb2b4077b20 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.709+0000 7fb2b3e00700 1 -- 172.21.15.157:0/4186974868 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2a800be90 con 0x7fb2b4077b20 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.709+0000 7fb2b3e00700 1 -- 172.21.15.157:0/4186974868 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2a80103c0 con 0x7fb2b4077b20 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 -- 172.21.15.157:0/4186974868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 msgr2=0x7fb2b4076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 --2- 172.21.15.157:0/4186974868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4076120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80098e0 tx=0x7fb2a8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 -- 172.21.15.157:0/4186974868 shutdown_connections 2024-04-03T08:29:24.578 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 --2- 172.21.15.157:0/4186974868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4076120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 -- 172.21.15.157:0/4186974868 >> 172.21.15.157:0/4186974868 conn(0x7fb2b40fe090 msgr2=0x7fb2b41004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 -- 172.21.15.157:0/4186974868 shutdown_connections 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.710+0000 7fb2bc400700 1 -- 172.21.15.157:0/4186974868 wait complete. 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2bc400700 1 Processor -- start 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2bc400700 1 -- start start 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2bc400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2bc400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4113f40 con 0x7fb2b4077b20 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2b9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2b9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53214/0 (socket says 172.21.15.157:53214) 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.711+0000 7fb2b9a00700 1 -- 172.21.15.157:0/4060528127 learned_addr learned my addr 172.21.15.157:0/4060528127 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2b9a00700 1 -- 172.21.15.157:0/4060528127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80094f0 con 0x7fb2b4077b20 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2b9a00700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4113a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8011c10 tx=0x7fb2a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2a8010630 con 0x7fb2b4077b20 2024-04-03T08:29:24.579 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4114140 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4114cb0 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2a8010c60 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.712+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2a801ab50 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.713+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fb2a801acb0 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.713+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2940052e0 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.714+0000 7fb2b1600700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fb29c0368d0 0x7fb29c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.714+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb2a804a0f0 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.714+0000 7fb2b9000700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fb29c0368d0 0x7fb29c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.714+0000 7fb2b9000700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fb29c0368d0 0x7fb29c038d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009990 tx=0x7fb2a0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:23.719+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb2a802c300 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.014+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fb294005b10 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.017+0000 7fb2b1600700 1 -- 172.21.15.157:0/4060528127 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb2a8024ba0 con 0x7fb2b4077b20 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fb29c0368d0 msgr2=0x7fb29c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fb29c0368d0 0x7fb29c038d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009990 tx=0x7fb2a0006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:24.580 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 msgr2=0x7fb2b4113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4113a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8011c10 tx=0x7fb2a8009250 comp rx=0 tx=0).stop 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 shutdown_connections 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fb29c0368d0 0x7fb29c038d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 --2- 172.21.15.157:0/4060528127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2b4077b20 0x7fb2b4113a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.019+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 >> 172.21.15.157:0/4060528127 conn(0x7fb2b40fe090 msgr2=0x7fb2b40fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.020+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 shutdown_connections 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr 2024-04-03T08:29:24.020+0000 7fb2bc400700 1 -- 172.21.15.157:0/4060528127 wait complete. 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.581 INFO:teuthology.orchestra.run.smithi157.stdout:Or, if you are only running a single cluster on this host: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: ceph telemetry on 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout:For more information see: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:24.582 INFO:teuthology.orchestra.run.smithi157.stdout:Bootstrap complete. 2024-04-03T08:29:24.635 INFO:tasks.cephadm:Fetching config... 2024-04-03T08:29:24.636 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:29:24.636 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-03T08:29:24.680 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-03T08:29:24.680 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:29:24.680 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-03T08:29:24.766 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-03T08:29:24.767 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:29:24.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/keyring of=/dev/stdout 2024-04-03T08:29:24.876 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-03T08:29:24.876 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:29:24.876 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-03T08:29:24.961 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-03T08:29:24.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE/Na+DJh7FeSEZhJS5SKtcqhqbweYPxGua1c6v8+4A8/G9zg2pEm76qyCnox57+RP9MFp0zJ49kq7Ls94S/GsCaSPvbbl7VABAqDierbrWKAqIvoaG3idccqMSXZEAm0gGjKYwAabLentgGaUThP3LGIlZ++VAoSCfiIisTB86oT9yj0RV7Zyrd7FteH6JzYtmlmDY1DY+7mjpOrAsUYsKD2Od8ZKIKMGMUSpzB3aByAzdNoCGXhJe+MhtPZvZAMcs/2nCoR+xZNgyz/XQneRDYp6gQdOxO2k+rneImSEXA4xZ7ie+JjykyX3Y9LY5iomxPwfH9fujH32qj8cCgsb5vstyPUW53gB1lNbC1an1tt485BHsG+pxc5jDcuswhbl0dFjmFMBFwlnouEYsMtth/uiQarzppNoMQeDVxC/hE1j8K6b3s7BEfC0GZADgfj3QbeMqjk0gRMaB5MB6OhXxzaK6IJvvKD2y2FT2fJi8E6y2LJci0l8doZ3jubfP2s= ceph-af80a140-f193-11ee-b648-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-03T08:29:25.096 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE/Na+DJh7FeSEZhJS5SKtcqhqbweYPxGua1c6v8+4A8/G9zg2pEm76qyCnox57+RP9MFp0zJ49kq7Ls94S/GsCaSPvbbl7VABAqDierbrWKAqIvoaG3idccqMSXZEAm0gGjKYwAabLentgGaUThP3LGIlZ++VAoSCfiIisTB86oT9yj0RV7Zyrd7FteH6JzYtmlmDY1DY+7mjpOrAsUYsKD2Od8ZKIKMGMUSpzB3aByAzdNoCGXhJe+MhtPZvZAMcs/2nCoR+xZNgyz/XQneRDYp6gQdOxO2k+rneImSEXA4xZ7ie+JjykyX3Y9LY5iomxPwfH9fujH32qj8cCgsb5vstyPUW53gB1lNbC1an1tt485BHsG+pxc5jDcuswhbl0dFjmFMBFwlnouEYsMtth/uiQarzppNoMQeDVxC/hE1j8K6b3s7BEfC0GZADgfj3QbeMqjk0gRMaB5MB6OhXxzaK6IJvvKD2y2FT2fJi8E6y2LJci0l8doZ3jubfP2s= ceph-af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:29:25.121 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:25 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4060528127' entity='client.admin' 2024-04-03T08:29:25.124 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE/Na+DJh7FeSEZhJS5SKtcqhqbweYPxGua1c6v8+4A8/G9zg2pEm76qyCnox57+RP9MFp0zJ49kq7Ls94S/GsCaSPvbbl7VABAqDierbrWKAqIvoaG3idccqMSXZEAm0gGjKYwAabLentgGaUThP3LGIlZ++VAoSCfiIisTB86oT9yj0RV7Zyrd7FteH6JzYtmlmDY1DY+7mjpOrAsUYsKD2Od8ZKIKMGMUSpzB3aByAzdNoCGXhJe+MhtPZvZAMcs/2nCoR+xZNgyz/XQneRDYp6gQdOxO2k+rneImSEXA4xZ7ie+JjykyX3Y9LY5iomxPwfH9fujH32qj8cCgsb5vstyPUW53gB1lNbC1an1tt485BHsG+pxc5jDcuswhbl0dFjmFMBFwlnouEYsMtth/uiQarzppNoMQeDVxC/hE1j8K6b3s7BEfC0GZADgfj3QbeMqjk0gRMaB5MB6OhXxzaK6IJvvKD2y2FT2fJi8E6y2LJci0l8doZ3jubfP2s= ceph-af80a140-f193-11ee-b648-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-03T08:29:25.223 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE/Na+DJh7FeSEZhJS5SKtcqhqbweYPxGua1c6v8+4A8/G9zg2pEm76qyCnox57+RP9MFp0zJ49kq7Ls94S/GsCaSPvbbl7VABAqDierbrWKAqIvoaG3idccqMSXZEAm0gGjKYwAabLentgGaUThP3LGIlZ++VAoSCfiIisTB86oT9yj0RV7Zyrd7FteH6JzYtmlmDY1DY+7mjpOrAsUYsKD2Od8ZKIKMGMUSpzB3aByAzdNoCGXhJe+MhtPZvZAMcs/2nCoR+xZNgyz/XQneRDYp6gQdOxO2k+rneImSEXA4xZ7ie+JjykyX3Y9LY5iomxPwfH9fujH32qj8cCgsb5vstyPUW53gB1lNbC1an1tt485BHsG+pxc5jDcuswhbl0dFjmFMBFwlnouEYsMtth/uiQarzppNoMQeDVxC/hE1j8K6b3s7BEfC0GZADgfj3QbeMqjk0gRMaB5MB6OhXxzaK6IJvvKD2y2FT2fJi8E6y2LJci0l8doZ3jubfP2s= ceph-af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:29:25.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-03T08:29:25.684 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:29:27.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.527+0000 7efd7aa00700 1 -- 172.21.15.157:0/1281224588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 msgr2=0x7efd740fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:27.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.527+0000 7efd7aa00700 1 --2- 172.21.15.157:0/1281224588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd740fce80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd640048c0 tx=0x7efd64009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:27.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.528+0000 7efd7aa00700 1 -- 172.21.15.157:0/1281224588 shutdown_connections 2024-04-03T08:29:27.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.528+0000 7efd7aa00700 1 --2- 172.21.15.157:0/1281224588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd740fce80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:27.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.528+0000 7efd7aa00700 1 -- 172.21.15.157:0/1281224588 >> 172.21.15.157:0/1281224588 conn(0x7efd740f81d0 msgr2=0x7efd740fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:27.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.528+0000 7efd7aa00700 1 -- 172.21.15.157:0/1281224588 shutdown_connections 2024-04-03T08:29:27.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.528+0000 7efd7aa00700 1 -- 172.21.15.157:0/1281224588 wait complete. 2024-04-03T08:29:27.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.529+0000 7efd7aa00700 1 Processor -- start 2024-04-03T08:29:27.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.529+0000 7efd7aa00700 1 -- start start 2024-04-03T08:29:27.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.530+0000 7efd7aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd74071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:27.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.530+0000 7efd7aa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd740722a0 con 0x7efd740fca70 2024-04-03T08:29:27.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.530+0000 7efd73e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd74071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:27.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.530+0000 7efd73e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd74071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53224/0 (socket says 172.21.15.157:53224) 2024-04-03T08:29:27.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.530+0000 7efd73e00700 1 -- 172.21.15.157:0/137193025 learned_addr learned my addr 172.21.15.157:0/137193025 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:27.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd73e00700 1 -- 172.21.15.157:0/137193025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64005040 con 0x7efd740fca70 2024-04-03T08:29:27.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd73e00700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd74071d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd64009680 tx=0x7efd64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:27.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd6400b5c0 con 0x7efd740fca70 2024-04-03T08:29:27.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd6400be70 con 0x7efd740fca70 2024-04-03T08:29:27.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd640135a0 con 0x7efd740fca70 2024-04-03T08:29:27.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd74070370 con 0x7efd740fca70 2024-04-03T08:29:27.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.531+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd74070860 con 0x7efd740fca70 2024-04-03T08:29:27.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.533+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7405f5f0 con 0x7efd740fca70 2024-04-03T08:29:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.533+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7efd6401ca90 con 0x7efd740fca70 2024-04-03T08:29:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.533+0000 7efd6be00700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7efd58036920 0x7efd58038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.533+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efd64049420 con 0x7efd740fca70 2024-04-03T08:29:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.534+0000 7efd73400700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7efd58036920 0x7efd58038dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.534+0000 7efd73400700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7efd58036920 0x7efd58038dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd60009990 tx=0x7efd60006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:27.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.539+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7efd64011960 con 0x7efd740fca70 2024-04-03T08:29:27.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.738+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7efd7404bed0 con 0x7efd740fca70 2024-04-03T08:29:27.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.742+0000 7efd6be00700 1 -- 172.21.15.157:0/137193025 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7efd64021020 con 0x7efd740fca70 2024-04-03T08:29:27.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.744+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7efd58036920 msgr2=0x7efd58038dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:27.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.744+0000 7efd7aa00700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7efd58036920 0x7efd58038dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd60009990 tx=0x7efd60006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.744+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 msgr2=0x7efd74071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.744+0000 7efd7aa00700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd74071d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd64009680 tx=0x7efd64009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.745+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 shutdown_connections 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.745+0000 7efd7aa00700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7efd58036920 0x7efd58038dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.745+0000 7efd7aa00700 1 --2- 172.21.15.157:0/137193025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd740fca70 0x7efd74071d60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.745+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 >> 172.21.15.157:0/137193025 conn(0x7efd740f81d0 msgr2=0x7efd74103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.745+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 shutdown_connections 2024-04-03T08:29:27.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:27.745+0000 7efd7aa00700 1 -- 172.21.15.157:0/137193025 wait complete. 2024-04-03T08:29:28.979 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-03T08:29:28.979 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-03T08:29:29.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:28 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/137193025' entity='client.admin' 2024-04-03T08:29:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:29:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 -- 172.21.15.157:0/2145850291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 msgr2=0x7fbc080feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 --2- 172.21.15.157:0/2145850291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc080feed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80048c0 tx=0x7fbbf8009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 -- 172.21.15.157:0/2145850291 shutdown_connections 2024-04-03T08:29:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 --2- 172.21.15.157:0/2145850291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc080feed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:31.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 -- 172.21.15.157:0/2145850291 >> 172.21.15.157:0/2145850291 conn(0x7fbc080fa5d0 msgr2=0x7fbc080fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:31.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 -- 172.21.15.157:0/2145850291 shutdown_connections 2024-04-03T08:29:31.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.697+0000 7fbc07e00700 1 -- 172.21.15.157:0/2145850291 wait complete. 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.698+0000 7fbc07e00700 1 Processor -- start 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.698+0000 7fbc07e00700 1 -- start start 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc07e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc0810f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc07e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0810f620 con 0x7fbc080feac0 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc06a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc0810f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc06a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc0810f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53248/0 (socket says 172.21.15.157:53248) 2024-04-03T08:29:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc06a00700 1 -- 172.21.15.157:0/3102385561 learned_addr learned my addr 172.21.15.157:0/3102385561 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc06a00700 1 -- 172.21.15.157:0/3102385561 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8005040 con 0x7fbc080feac0 2024-04-03T08:29:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.699+0000 7fbc06a00700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc0810f0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009680 tx=0x7fbbf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.700+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbf800b5c0 con 0x7fbc080feac0 2024-04-03T08:29:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.700+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbf800be70 con 0x7fbc080feac0 2024-04-03T08:29:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.700+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0810f820 con 0x7fbc080feac0 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.700+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbf80135a0 con 0x7fbc080feac0 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.700+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08110390 con 0x7fbc080feac0 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.701+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fbbf8013810 con 0x7fbc080feac0 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.701+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08104fd0 con 0x7fbc080feac0 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.701+0000 7fbbfea00700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fbbec0368d0 0x7fbbec038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.701+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbbf8049410 con 0x7fbc080feac0 2024-04-03T08:29:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.702+0000 7fbc06000700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fbbec0368d0 0x7fbbec038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:31.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.702+0000 7fbc06000700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fbbec0368d0 0x7fbbec038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009990 tx=0x7fbbf4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:31.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.706+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fbbf8011960 con 0x7fbc080feac0 2024-04-03T08:29:31.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.935+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc081105d0 con 0x7fbbec0368d0 2024-04-03T08:29:31.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.938+0000 7fbbfea00700 1 -- 172.21.15.157:0/3102385561 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbc081105d0 con 0x7fbbec0368d0 2024-04-03T08:29:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.940+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fbbec0368d0 msgr2=0x7fbbec038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.940+0000 7fbc07e00700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fbbec0368d0 0x7fbbec038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009990 tx=0x7fbbf4006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.940+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 msgr2=0x7fbc0810f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.940+0000 7fbc07e00700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc0810f0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009680 tx=0x7fbbf8009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.940+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 shutdown_connections 2024-04-03T08:29:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.940+0000 7fbc07e00700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fbbec0368d0 0x7fbbec038d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.941+0000 7fbc07e00700 1 --2- 172.21.15.157:0/3102385561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc080feac0 0x7fbc0810f0e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.941+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 >> 172.21.15.157:0/3102385561 conn(0x7fbc080fa5d0 msgr2=0x7fbc080fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.941+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 shutdown_connections 2024-04-03T08:29:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:31.941+0000 7fbc07e00700 1 -- 172.21.15.157:0/3102385561 wait complete. 2024-04-03T08:29:32.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:32.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:32.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:29:32.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:32.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:29:32.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-03T08:29:32.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:29:32.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: Deploying daemon crash.smithi157 on smithi157 2024-04-03T08:29:32.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:32 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:32.746 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-04-03T08:29:32.746 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:29:32.746 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-04-03T08:29:32.795 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:29:32.796 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:29:32.883 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-04-03T08:29:32.883 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch host add smithi181 2024-04-03T08:29:33.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:33 smithi157 ceph-mon[35083]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:29:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 -- 172.21.15.157:0/490738615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 msgr2=0x7fe01c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 --2- 172.21.15.157:0/490738615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c0703b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe0100048c0 tx=0x7fe010009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 -- 172.21.15.157:0/490738615 shutdown_connections 2024-04-03T08:29:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 --2- 172.21.15.157:0/490738615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c0703b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 -- 172.21.15.157:0/490738615 >> 172.21.15.157:0/490738615 conn(0x7fe01c0f81d0 msgr2=0x7fe01c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 -- 172.21.15.157:0/490738615 shutdown_connections 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.664+0000 7fe023c00700 1 -- 172.21.15.157:0/490738615 wait complete. 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.665+0000 7fe023c00700 1 Processor -- start 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.666+0000 7fe023c00700 1 -- start start 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.666+0000 7fe023c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c10f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.666+0000 7fe023c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c10f820 con 0x7fe01c071ea0 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.666+0000 7fe021200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c10f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.666+0000 7fe021200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c10f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38362/0 (socket says 172.21.15.157:38362) 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.666+0000 7fe021200700 1 -- 172.21.15.157:0/3842725971 learned_addr learned my addr 172.21.15.157:0/3842725971 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe021200700 1 -- 172.21.15.157:0/3842725971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe010005040 con 0x7fe01c071ea0 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe021200700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c10f2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe01000b900 tx=0x7fe010009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe01000b5c0 con 0x7fe01c071ea0 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe01000be70 con 0x7fe01c071ea0 2024-04-03T08:29:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe01001c590 con 0x7fe01c071ea0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c10fa20 con 0x7fe01c071ea0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.667+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c110590 con 0x7fe01c071ea0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.669+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c105190 con 0x7fe01c071ea0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.669+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fe01001c850 con 0x7fe01c071ea0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.669+0000 7fe018c00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe004036880 0x7fe004038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.669+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe0100493a0 con 0x7fe01c071ea0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.669+0000 7fe01be00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe004036880 0x7fe004038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.670+0000 7fe01be00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe004036880 0x7fe004038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe008009990 tx=0x7fe008006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.675+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe010011960 con 0x7fe01c071ea0 2024-04-03T08:29:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:35.889+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}) v1 -- 0x7fe01c1107d0 con 0x7fe004036880 2024-04-03T08:29:36.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:35 smithi157 ceph-mon[35083]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:36.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:36 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:36.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:36 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:36.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:36 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:36.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:36 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:36.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:36 smithi157 ceph-mon[35083]: Deploying daemon node-exporter.smithi157 on smithi157 2024-04-03T08:29:36.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:36 smithi157 ceph-mon[35083]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:37 smithi157 ceph-mon[35083]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:37 smithi157 ceph-mon[35083]: Deploying cephadm binary to smithi181 2024-04-03T08:29:38.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.475+0000 7fe018c00700 1 -- 172.21.15.157:0/3842725971 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe01c1107d0 con 0x7fe004036880 2024-04-03T08:29:38.477 INFO:teuthology.orchestra.run.smithi157.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-04-03T08:29:38.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe004036880 msgr2=0x7fe004038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:38.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe004036880 0x7fe004038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe008009990 tx=0x7fe008006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:38.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 msgr2=0x7fe01c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:38.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c10f2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe01000b900 tx=0x7fe010009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:38.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 shutdown_connections 2024-04-03T08:29:38.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fe004036880 0x7fe004038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:38.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 --2- 172.21.15.157:0/3842725971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe01c071ea0 0x7fe01c10f2e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:38.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 >> 172.21.15.157:0/3842725971 conn(0x7fe01c0f81d0 msgr2=0x7fe01c105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:38.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 shutdown_connections 2024-04-03T08:29:38.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:38.479+0000 7fe023c00700 1 -- 172.21.15.157:0/3842725971 wait complete. 2024-04-03T08:29:39.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:39 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:39.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:39 smithi157 ceph-mon[35083]: Added host smithi181 2024-04-03T08:29:39.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:39 smithi157 ceph-mon[35083]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:39.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-03T08:29:40.411 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:29:40.923 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:40 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:40.923 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:40 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:40.923 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:40 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:40.923 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:40 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:40.923 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:40 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:41.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:41 smithi157 ceph-mon[35083]: Deploying daemon alertmanager.smithi157 on smithi157 2024-04-03T08:29:41.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:41 smithi157 ceph-mon[35083]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 -- 172.21.15.157:0/1478183747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 msgr2=0x7f8d900fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 --2- 172.21.15.157:0/1478183747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d900fce80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d800048c0 tx=0x7f8d80009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 -- 172.21.15.157:0/1478183747 shutdown_connections 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 --2- 172.21.15.157:0/1478183747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d900fce80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 -- 172.21.15.157:0/1478183747 >> 172.21.15.157:0/1478183747 conn(0x7f8d900f81d0 msgr2=0x7f8d900fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 -- 172.21.15.157:0/1478183747 shutdown_connections 2024-04-03T08:29:42.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.262+0000 7f8d95c00700 1 -- 172.21.15.157:0/1478183747 wait complete. 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.263+0000 7f8d95c00700 1 Processor -- start 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.263+0000 7f8d95c00700 1 -- start start 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.263+0000 7f8d95c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d9010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.263+0000 7f8d95c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9010f7f0 con 0x7f8d900fca70 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d8ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d9010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d8ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d9010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38384/0 (socket says 172.21.15.157:38384) 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d8ea00700 1 -- 172.21.15.157:0/1941724307 learned_addr learned my addr 172.21.15.157:0/1941724307 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d8ea00700 1 -- 172.21.15.157:0/1941724307 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80005040 con 0x7f8d900fca70 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d8ea00700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d9010f2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009680 tx=0x7f8d80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:42.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d8000b5c0 con 0x7f8d900fca70 2024-04-03T08:29:42.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d8000be70 con 0x7f8d900fca70 2024-04-03T08:29:42.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d800135a0 con 0x7f8d900fca70 2024-04-03T08:29:42.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.264+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9010f9f0 con 0x7f8d900fca70 2024-04-03T08:29:42.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.265+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d90110560 con 0x7f8d900fca70 2024-04-03T08:29:42.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.266+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f8d8001c430 con 0x7f8d900fca70 2024-04-03T08:29:42.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.266+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d90102f80 con 0x7f8d900fca70 2024-04-03T08:29:42.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.266+0000 7f8d86a00700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8d740368d0 0x7f8d74038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:42.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.266+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8d800493b0 con 0x7f8d900fca70 2024-04-03T08:29:42.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.266+0000 7f8d8e000700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8d740368d0 0x7f8d74038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:42.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.267+0000 7f8d8e000700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8d740368d0 0x7f8d74038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009990 tx=0x7f8d7c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:42.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.271+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8d800117e0 con 0x7f8d900fca70 2024-04-03T08:29:42.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.476+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d90071700 con 0x7f8d740368d0 2024-04-03T08:29:42.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.477+0000 7f8d86a00700 1 -- 172.21.15.157:0/1941724307 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f8d90071700 con 0x7f8d740368d0 2024-04-03T08:29:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:29:42.478 INFO:teuthology.orchestra.run.smithi157.stdout:[{"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-04-03T08:29:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8d740368d0 msgr2=0x7f8d74038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8d740368d0 0x7f8d74038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009990 tx=0x7f8d7c006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 msgr2=0x7f8d9010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d9010f2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009680 tx=0x7f8d80009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 shutdown_connections 2024-04-03T08:29:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8d740368d0 0x7f8d74038d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 --2- 172.21.15.157:0/1941724307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d900fca70 0x7f8d9010f2b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.479+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 >> 172.21.15.157:0/1941724307 conn(0x7f8d900f81d0 msgr2=0x7f8d900fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.480+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 shutdown_connections 2024-04-03T08:29:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:42.480+0000 7f8d95c00700 1 -- 172.21.15.157:0/1941724307 wait complete. 2024-04-03T08:29:43.547 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-03T08:29:43.547 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd crush tunables default 2024-04-03T08:29:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:43 smithi157 ceph-mon[35083]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-03T08:29:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:43 smithi157 ceph-mon[35083]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:29:45.928 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:45 smithi157 ceph-mon[35083]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:45.928 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:45 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:47 smithi157 ceph-mon[35083]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:48.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 -- 172.21.15.157:0/2742024844 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 msgr2=0x7ff6d40fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 --2- 172.21.15.157:0/2742024844 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d40fce80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40048c0 tx=0x7ff6c4009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 -- 172.21.15.157:0/2742024844 shutdown_connections 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 --2- 172.21.15.157:0/2742024844 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d40fce80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 -- 172.21.15.157:0/2742024844 >> 172.21.15.157:0/2742024844 conn(0x7ff6d40f81d0 msgr2=0x7ff6d40fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 -- 172.21.15.157:0/2742024844 shutdown_connections 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.795+0000 7ff6d9200700 1 -- 172.21.15.157:0/2742024844 wait complete. 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d9200700 1 Processor -- start 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d9200700 1 -- start start 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d9200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d410f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d9200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d410f7f0 con 0x7ff6d40fca70 2024-04-03T08:29:48.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d410f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d410f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43216/0 (socket says 172.21.15.157:43216) 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.796+0000 7ff6d1e00700 1 -- 172.21.15.157:0/2590284216 learned_addr learned my addr 172.21.15.157:0/2590284216 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6d1e00700 1 -- 172.21.15.157:0/2590284216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4005040 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6d1e00700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d410f2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009680 tx=0x7ff6c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6c400b5c0 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6c400be70 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6c40135a0 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d410f9f0 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.797+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4110560 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.798+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff6c401ca90 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.798+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d4102f80 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.799+0000 7ff6ca000700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ff6b80368d0 0x7ff6b8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.799+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff6c4049410 con 0x7ff6d40fca70 2024-04-03T08:29:48.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.799+0000 7ff6d1400700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ff6b80368d0 0x7ff6b8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:48.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.799+0000 7ff6d1400700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ff6b80368d0 0x7ff6b8038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009990 tx=0x7ff6c0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:48.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:47.804+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff6c4011940 con 0x7ff6d40fca70 2024-04-03T08:29:48.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.010+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff6d41107a0 con 0x7ff6d40fca70 2024-04-03T08:29:48.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.667+0000 7ff6ca000700 1 -- 172.21.15.157:0/2590284216 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff6c4021020 con 0x7ff6d40fca70 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.669+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ff6b80368d0 msgr2=0x7ff6b8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.669+0000 7ff6d9200700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ff6b80368d0 0x7ff6b8038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009990 tx=0x7ff6c0006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.669+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 msgr2=0x7ff6d410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.669+0000 7ff6d9200700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d410f2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009680 tx=0x7ff6c4009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.670+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 shutdown_connections 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.670+0000 7ff6d9200700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7ff6b80368d0 0x7ff6b8038d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.670+0000 7ff6d9200700 1 --2- 172.21.15.157:0/2590284216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d40fca70 0x7ff6d410f2b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:48.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.670+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 >> 172.21.15.157:0/2590284216 conn(0x7ff6d40f81d0 msgr2=0x7ff6d40fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.670+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 shutdown_connections 2024-04-03T08:29:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:29:48.670+0000 7ff6d9200700 1 -- 172.21.15.157:0/2590284216 wait complete. 2024-04-03T08:29:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:adjusted tunables profile to default 2024-04-03T08:29:49.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:48 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2590284216' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-03T08:29:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:49 smithi157 ceph-mon[35083]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:49 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2590284216' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-03T08:29:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:49 smithi157 ceph-mon[35083]: osdmap e4: 0 total, 0 up, 0 in 2024-04-03T08:29:50.523 INFO:tasks.cephadm:Adding mon.smithi157 on smithi157 2024-04-03T08:29:50.523 INFO:tasks.cephadm:Adding mon.smithi181 on smithi181 2024-04-03T08:29:50.524 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch apply mon '2;smithi157:172.21.15.157=smithi157;smithi181:172.21.15.181=smithi181' 2024-04-03T08:29:50.927 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:29:51.013 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:29:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:51 smithi157 ceph-mon[35083]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:52.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 -- 172.21.15.181:0/3393717354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 msgr2=0x7f3f9c0ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:52.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 --2- 172.21.15.181:0/3393717354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c0ff060 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f900048c0 tx=0x7f3f90009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:52.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 -- 172.21.15.181:0/3393717354 shutdown_connections 2024-04-03T08:29:52.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 --2- 172.21.15.181:0/3393717354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c0ff060 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 -- 172.21.15.181:0/3393717354 >> 172.21.15.181:0/3393717354 conn(0x7f3f9c0fa5d0 msgr2=0x7f3f9c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 -- 172.21.15.181:0/3393717354 shutdown_connections 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.785+0000 7f3fa3c00700 1 -- 172.21.15.181:0/3393717354 wait complete. 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.786+0000 7f3fa3c00700 1 Processor -- start 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.786+0000 7f3fa3c00700 1 -- start start 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.786+0000 7f3fa3c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c10f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:52.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.786+0000 7f3fa3c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c10f7e0 con 0x7f3f9c0fec50 2024-04-03T08:29:52.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c10f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:52.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c10f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:51992/0 (socket says 172.21.15.181:51992) 2024-04-03T08:29:52.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa1200700 1 -- 172.21.15.181:0/551491367 learned_addr learned my addr 172.21.15.181:0/551491367 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:29:52.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa1200700 1 -- 172.21.15.181:0/551491367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90005040 con 0x7f3f9c0fec50 2024-04-03T08:29:52.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa1200700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c10f2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009680 tx=0x7f3f90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:52.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9000b5c0 con 0x7f3f9c0fec50 2024-04-03T08:29:52.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f9000be70 con 0x7f3f9c0fec50 2024-04-03T08:29:52.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f900135a0 con 0x7f3f9c0fec50 2024-04-03T08:29:52.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c10f9e0 con 0x7f3f9c0fec50 2024-04-03T08:29:52.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.787+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c110550 con 0x7f3f9c0fec50 2024-04-03T08:29:52.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.788+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f3f9001c430 con 0x7f3f9c0fec50 2024-04-03T08:29:52.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.788+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c105160 con 0x7f3f9c0fec50 2024-04-03T08:29:52.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.789+0000 7f3f98c00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3f840368d0 0x7f3f84038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:52.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.789+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3f900493b0 con 0x7f3f9c0fec50 2024-04-03T08:29:52.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.789+0000 7f3f9be00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3f840368d0 0x7f3f84038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:52.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.790+0000 7f3f9be00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3f840368d0 0x7f3f84038d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009990 tx=0x7f3f88006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:52.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.794+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3f900117e0 con 0x7f3f9c0fec50 2024-04-03T08:29:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:52.996+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 --> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi157:172.21.15.157=smithi157;smithi181:172.21.15.181=smithi181", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f9c110840 con 0x7f3f840368d0 2024-04-03T08:29:53.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.002+0000 7f3f98c00700 1 -- 172.21.15.181:0/551491367 <== mgr.14160 v2:172.21.15.157:6800/494465315 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3f9c110840 con 0x7f3f840368d0 2024-04-03T08:29:53.004 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-04-03T08:29:53.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.004+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3f840368d0 msgr2=0x7f3f84038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:53.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.004+0000 7f3fa3c00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3f840368d0 0x7f3f84038d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009990 tx=0x7f3f88006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:53.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.004+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 msgr2=0x7f3f9c10f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:53.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.004+0000 7f3fa3c00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c10f2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009680 tx=0x7f3f90009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:53.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.005+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 shutdown_connections 2024-04-03T08:29:53.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.005+0000 7f3fa3c00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f3f840368d0 0x7f3f84038d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:53.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.005+0000 7f3fa3c00700 1 --2- 172.21.15.181:0/551491367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9c0fec50 0x7f3f9c10f2a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:53.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.005+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 >> 172.21.15.181:0/551491367 conn(0x7f3f9c0fa5d0 msgr2=0x7f3f9c0fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:53.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.005+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 shutdown_connections 2024-04-03T08:29:53.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:53.005+0000 7f3fa3c00700 1 -- 172.21.15.181:0/551491367 wait complete. 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:52 smithi157 ceph-mon[35083]: Deploying daemon grafana.smithi157 on smithi157 2024-04-03T08:29:53.669 DEBUG:teuthology.orchestra.run.smithi181:mon.smithi181> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi181.service 2024-04-03T08:29:53.674 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:29:53.674 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:29:53.743 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:-- Logs begin at Wed 2024-04-03 08:12:25 UTC. -- 2024-04-03T08:29:54.108 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:29:54.196 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:29:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:54 smithi157 ceph-mon[35083]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:54 smithi157 ceph-mon[35083]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi157:172.21.15.157=smithi157;smithi181:172.21.15.181=smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:29:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:54 smithi157 ceph-mon[35083]: Saving service mon spec with placement smithi157:172.21.15.157=smithi157;smithi181:172.21.15.181=smithi181;count:2 2024-04-03T08:29:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:54 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 -- 172.21.15.181:0/1492159845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 msgr2=0x7f7b900fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 --2- 172.21.15.181:0/1492159845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b900fce80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b840048c0 tx=0x7f7b84009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 -- 172.21.15.181:0/1492159845 shutdown_connections 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 --2- 172.21.15.181:0/1492159845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b900fce80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 -- 172.21.15.181:0/1492159845 >> 172.21.15.181:0/1492159845 conn(0x7f7b900f81d0 msgr2=0x7f7b900fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 -- 172.21.15.181:0/1492159845 shutdown_connections 2024-04-03T08:29:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.850+0000 7f7b98600700 1 -- 172.21.15.181:0/1492159845 wait complete. 2024-04-03T08:29:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.851+0000 7f7b98600700 1 Processor -- start 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.851+0000 7f7b98600700 1 -- start start 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b98600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b9010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b98600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9010f7f0 con 0x7f7b900fca70 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b95c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b9010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b95c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b9010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:54962/0 (socket says 172.21.15.181:54962) 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b95c00700 1 -- 172.21.15.181:0/4158613244 learned_addr learned my addr 172.21.15.181:0/4158613244 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b95c00700 1 -- 172.21.15.181:0/4158613244 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84005040 con 0x7f7b900fca70 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.852+0000 7f7b95c00700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b9010f2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009680 tx=0x7f7b84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.853+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b8400b5c0 con 0x7f7b900fca70 2024-04-03T08:29:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.853+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9010f9f0 con 0x7f7b900fca70 2024-04-03T08:29:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.853+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b8400be70 con 0x7f7b900fca70 2024-04-03T08:29:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.853+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b90110560 con 0x7f7b900fca70 2024-04-03T08:29:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.853+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b84013580 con 0x7f7b900fca70 2024-04-03T08:29:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.854+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b90102f80 con 0x7f7b900fca70 2024-04-03T08:29:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.854+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f7b84004d30 con 0x7f7b900fca70 2024-04-03T08:29:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.854+0000 7f7b8d600700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f7b78036880 0x7f7b78038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.854+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7b84049450 con 0x7f7b900fca70 2024-04-03T08:29:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.855+0000 7f7b95200700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f7b78036880 0x7f7b78038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.855+0000 7f7b95200700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f7b78036880 0x7f7b78038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009990 tx=0x7f7b7c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:55.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:55.860+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7b84011960 con 0x7f7b900fca70 2024-04-03T08:29:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:55 smithi157 ceph-mon[35083]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:55 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:29:56.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.131+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7b901107a0 con 0x7f7b900fca70 2024-04-03T08:29:56.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.132+0000 7f7b8d600700 1 -- 172.21.15.181:0/4158613244 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7b84021070 con 0x7f7b900fca70 2024-04-03T08:29:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:29:56.133 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:29:56.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f7b78036880 msgr2=0x7f7b78038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:56.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f7b78036880 0x7f7b78038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009990 tx=0x7f7b7c006e40 comp rx=0 tx=0).stop 2024-04-03T08:29:56.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 msgr2=0x7f7b9010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:56.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b9010f2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009680 tx=0x7f7b84009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 shutdown_connections 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f7b78036880 0x7f7b78038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 --2- 172.21.15.181:0/4158613244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b900fca70 0x7f7b9010f2b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 >> 172.21.15.181:0/4158613244 conn(0x7f7b900f81d0 msgr2=0x7f7b900fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 shutdown_connections 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:56.134+0000 7f7b98600700 1 -- 172.21.15.181:0/4158613244 wait complete. 2024-04-03T08:29:56.136 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:29:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:56 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/4158613244' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:29:57.670 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:29:57.671 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:29:58.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:57 smithi157 ceph-mon[35083]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:29:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:29:58.160 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 -- 172.21.15.181:0/989402043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 msgr2=0x7f8f0c0fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 --2- 172.21.15.181:0/989402043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c0fce80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0048c0 tx=0x7f8efc009e30 comp rx=0 tx=0).stop 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 -- 172.21.15.181:0/989402043 shutdown_connections 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 --2- 172.21.15.181:0/989402043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c0fce80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 -- 172.21.15.181:0/989402043 >> 172.21.15.181:0/989402043 conn(0x7f8f0c0f81d0 msgr2=0x7f8f0c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 -- 172.21.15.181:0/989402043 shutdown_connections 2024-04-03T08:29:59.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.793+0000 7f8f13000700 1 -- 172.21.15.181:0/989402043 wait complete. 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.794+0000 7f8f13000700 1 Processor -- start 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.794+0000 7f8f13000700 1 -- start start 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.794+0000 7f8f13000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.794+0000 7f8f13000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0722a0 con 0x7f8f0c0fca70 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f0be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f0be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:54982/0 (socket says 172.21.15.181:54982) 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f0be00700 1 -- 172.21.15.181:0/3561751808 learned_addr learned my addr 172.21.15.181:0/3561751808 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f0be00700 1 -- 172.21.15.181:0/3561751808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc005040 con 0x7f8f0c0fca70 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f0be00700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c071d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009680 tx=0x7f8efc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:59.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8efc00b5c0 con 0x7f8f0c0fca70 2024-04-03T08:29:59.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.795+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8efc00be70 con 0x7f8f0c0fca70 2024-04-03T08:29:59.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.796+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c070370 con 0x7f8f0c0fca70 2024-04-03T08:29:59.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.796+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8efc0135a0 con 0x7f8f0c0fca70 2024-04-03T08:29:59.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.796+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c070860 con 0x7f8f0c0fca70 2024-04-03T08:29:59.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.797+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f8efc01c430 con 0x7f8f0c0fca70 2024-04-03T08:29:59.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.797+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c05f5f0 con 0x7f8f0c0fca70 2024-04-03T08:29:59.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.797+0000 7f8f03e00700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8ef00368d0 0x7f8ef0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:29:59.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.797+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8efc0493b0 con 0x7f8f0c0fca70 2024-04-03T08:29:59.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.797+0000 7f8f0b400700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8ef00368d0 0x7f8ef0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:29:59.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.798+0000 7f8f0b400700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8ef00368d0 0x7f8ef0038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009990 tx=0x7f8ef8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:29:59.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:29:59.803+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8efc0117e0 con 0x7f8f0c0fca70 2024-04-03T08:30:00.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:29:59 smithi157 ceph-mon[35083]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:00.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.070+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8f0c106450 con 0x7f8f0c0fca70 2024-04-03T08:30:00.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.071+0000 7f8f03e00700 1 -- 172.21.15.181:0/3561751808 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f8efc021070 con 0x7f8f0c0fca70 2024-04-03T08:30:00.072 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:00.072 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:00.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8ef00368d0 msgr2=0x7f8ef0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:00.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8ef00368d0 0x7f8ef0038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009990 tx=0x7f8ef8006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 msgr2=0x7f8f0c071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c071d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009680 tx=0x7f8efc009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 shutdown_connections 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f8ef00368d0 0x7f8ef0038d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 --2- 172.21.15.181:0/3561751808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f0c0fca70 0x7f8f0c071d60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 >> 172.21.15.181:0/3561751808 conn(0x7f8f0c0f81d0 msgr2=0x7f8f0c103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 shutdown_connections 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:00.073+0000 7f8f13000700 1 -- 172.21.15.181:0/3561751808 wait complete. 2024-04-03T08:30:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:00 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3561751808' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:01.751 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:01.751 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:01 smithi157 ceph-mon[35083]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:02.158 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:02.245 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:03.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.890+0000 7f746b200700 1 -- 172.21.15.181:0/3430539040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 msgr2=0x7f746c0fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:03.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.890+0000 7f746b200700 1 --2- 172.21.15.181:0/3430539040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c0fcc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f745c0048c0 tx=0x7f745c009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:03.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.890+0000 7f746b200700 1 -- 172.21.15.181:0/3430539040 shutdown_connections 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.890+0000 7f746b200700 1 --2- 172.21.15.181:0/3430539040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c0fcc90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.890+0000 7f746b200700 1 -- 172.21.15.181:0/3430539040 >> 172.21.15.181:0/3430539040 conn(0x7f746c0f8020 msgr2=0x7f746c0fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.890+0000 7f746b200700 1 -- 172.21.15.181:0/3430539040 shutdown_connections 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.891+0000 7f746b200700 1 -- 172.21.15.181:0/3430539040 wait complete. 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.891+0000 7f746b200700 1 Processor -- start 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.891+0000 7f746b200700 1 -- start start 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.892+0000 7f746b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c10f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.892+0000 7f746b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c10f650 con 0x7f746c0fc880 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.892+0000 7f7469e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c10f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.892+0000 7f7469e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c10f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:57430/0 (socket says 172.21.15.181:57430) 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.892+0000 7f7469e00700 1 -- 172.21.15.181:0/2240610289 learned_addr learned my addr 172.21.15.181:0/2240610289 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.892+0000 7f7469e00700 1 -- 172.21.15.181:0/2240610289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c005040 con 0x7f746c0fc880 2024-04-03T08:30:03.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.893+0000 7f7469e00700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c10f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f745c009680 tx=0x7f745c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:03.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.893+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f745c00b5c0 con 0x7f746c0fc880 2024-04-03T08:30:03.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.893+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f745c00be70 con 0x7f746c0fc880 2024-04-03T08:30:03.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.893+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c10f850 con 0x7f746c0fc880 2024-04-03T08:30:03.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.893+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f745c0135a0 con 0x7f746c0fc880 2024-04-03T08:30:03.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.893+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c1103c0 con 0x7f746c0fc880 2024-04-03T08:30:03.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.894+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f745c01c430 con 0x7f746c0fc880 2024-04-03T08:30:03.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.894+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c102d90 con 0x7f746c0fc880 2024-04-03T08:30:03.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.894+0000 7f7462000700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f74500368d0 0x7f7450038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:03.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.894+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f745c0493c0 con 0x7f746c0fc880 2024-04-03T08:30:03.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.895+0000 7f7469400700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f74500368d0 0x7f7450038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:03.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.895+0000 7f7469400700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f74500368d0 0x7f7450038d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7458009990 tx=0x7f7458006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:03.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:03.900+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f745c004d90 con 0x7f746c0fc880 2024-04-03T08:30:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:03 smithi157 ceph-mon[35083]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:04.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.172+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f746c110600 con 0x7f746c0fc880 2024-04-03T08:30:04.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.173+0000 7f7462000700 1 -- 172.21.15.181:0/2240610289 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f745c021070 con 0x7f746c0fc880 2024-04-03T08:30:04.174 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:04.174 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f74500368d0 msgr2=0x7f7450038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f74500368d0 0x7f7450038d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7458009990 tx=0x7f7458006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 msgr2=0x7f746c10f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c10f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f745c009680 tx=0x7f745c009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 shutdown_connections 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f74500368d0 0x7f7450038d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.175+0000 7f746b200700 1 --2- 172.21.15.181:0/2240610289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f746c0fc880 0x7f746c10f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.176+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 >> 172.21.15.181:0/2240610289 conn(0x7f746c0f8020 msgr2=0x7f746c0fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:04.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.176+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 shutdown_connections 2024-04-03T08:30:04.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:04.176+0000 7f746b200700 1 -- 172.21.15.181:0/2240610289 wait complete. 2024-04-03T08:30:04.177 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:04.947 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:04 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/2240610289' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:05.768 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:05.769 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:05.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:05 smithi157 ceph-mon[35083]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:06.171 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:06.258 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:07.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 -- 172.21.15.181:0/2841953225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 msgr2=0x7fde440fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:07.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 --2- 172.21.15.181:0/2841953225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde440fce80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde340048c0 tx=0x7fde34009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:07.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 -- 172.21.15.181:0/2841953225 shutdown_connections 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 --2- 172.21.15.181:0/2841953225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde440fce80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 -- 172.21.15.181:0/2841953225 >> 172.21.15.181:0/2841953225 conn(0x7fde440f81d0 msgr2=0x7fde440fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 -- 172.21.15.181:0/2841953225 shutdown_connections 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.899+0000 7fde49400700 1 -- 172.21.15.181:0/2841953225 wait complete. 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.900+0000 7fde49400700 1 Processor -- start 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.900+0000 7fde49400700 1 -- start start 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.901+0000 7fde49400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde4410f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.901+0000 7fde49400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4410f7f0 con 0x7fde440fca70 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.901+0000 7fde42800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde4410f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.901+0000 7fde42800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde4410f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:57446/0 (socket says 172.21.15.181:57446) 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.901+0000 7fde42800700 1 -- 172.21.15.181:0/4187811097 learned_addr learned my addr 172.21.15.181:0/4187811097 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde42800700 1 -- 172.21.15.181:0/4187811097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34005040 con 0x7fde440fca70 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde42800700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde4410f2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde34009680 tx=0x7fde34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:07.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde3400b5c0 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde3400be70 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4410f9f0 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde340135a0 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.902+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde44110560 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.903+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fde3401c430 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.903+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde44102f80 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.904+0000 7fde3aa00700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fde280368d0 0x7fde28038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.904+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fde340493b0 con 0x7fde440fca70 2024-04-03T08:30:07.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.904+0000 7fde41e00700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fde280368d0 0x7fde28038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:07.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.904+0000 7fde41e00700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fde280368d0 0x7fde28038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde30009990 tx=0x7fde30006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:07.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:07.908+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fde340117e0 con 0x7fde440fca70 2024-04-03T08:30:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:07 smithi157 ceph-mon[35083]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:08.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.176+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde441107a0 con 0x7fde440fca70 2024-04-03T08:30:08.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.176+0000 7fde3aa00700 1 -- 172.21.15.181:0/4187811097 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fde34021070 con 0x7fde440fca70 2024-04-03T08:30:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:08.177 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:08.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fde280368d0 msgr2=0x7fde28038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:08.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fde280368d0 0x7fde28038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde30009990 tx=0x7fde30006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:08.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 msgr2=0x7fde4410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:08.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde4410f2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde34009680 tx=0x7fde34009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:08.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 shutdown_connections 2024-04-03T08:30:08.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fde280368d0 0x7fde28038d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:08.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 --2- 172.21.15.181:0/4187811097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde440fca70 0x7fde4410f2b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:08.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 >> 172.21.15.181:0/4187811097 conn(0x7fde440f81d0 msgr2=0x7fde440fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:08.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 shutdown_connections 2024-04-03T08:30:08.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:08.179+0000 7fde49400700 1 -- 172.21.15.181:0/4187811097 wait complete. 2024-04-03T08:30:08.180 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/4187811097' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:09.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:08 smithi157 ceph-mon[35083]: Deploying daemon prometheus.smithi157 on smithi157 2024-04-03T08:30:09.803 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:09.803 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:10.205 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:10 smithi157 ceph-mon[35083]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:10 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:11.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.860+0000 7f2222400700 1 -- 172.21.15.181:0/1968712816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 msgr2=0x7f221c0fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:11.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.860+0000 7f2222400700 1 --2- 172.21.15.181:0/1968712816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c0fcc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22100048c0 tx=0x7f2210009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:11.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.861+0000 7f2222400700 1 -- 172.21.15.181:0/1968712816 shutdown_connections 2024-04-03T08:30:11.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.861+0000 7f2222400700 1 --2- 172.21.15.181:0/1968712816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c0fcc90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:11.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.861+0000 7f2222400700 1 -- 172.21.15.181:0/1968712816 >> 172.21.15.181:0/1968712816 conn(0x7f221c0f8020 msgr2=0x7f221c0fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:11.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.861+0000 7f2222400700 1 -- 172.21.15.181:0/1968712816 shutdown_connections 2024-04-03T08:30:11.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.861+0000 7f2222400700 1 -- 172.21.15.181:0/1968712816 wait complete. 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.861+0000 7f2222400700 1 Processor -- start 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.862+0000 7f2222400700 1 -- start start 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.862+0000 7f2222400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c10f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.862+0000 7f2222400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c10f650 con 0x7f221c0fc880 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.862+0000 7f2221000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c10f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.862+0000 7f2221000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c10f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:57460/0 (socket says 172.21.15.181:57460) 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.862+0000 7f2221000700 1 -- 172.21.15.181:0/711917935 learned_addr learned my addr 172.21.15.181:0/711917935 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:11.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2221000700 1 -- 172.21.15.181:0/711917935 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210005040 con 0x7f221c0fc880 2024-04-03T08:30:11.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2221000700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c10f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2210009680 tx=0x7f2210009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:11.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f221000b5c0 con 0x7f221c0fc880 2024-04-03T08:30:11.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f221000be70 con 0x7f221c0fc880 2024-04-03T08:30:11.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c10f850 con 0x7f221c0fc880 2024-04-03T08:30:11.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22100135a0 con 0x7f221c0fc880 2024-04-03T08:30:11.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.863+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1103c0 con 0x7f221c0fc880 2024-04-03T08:30:11.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.864+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c102d90 con 0x7f221c0fc880 2024-04-03T08:30:11.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.864+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f2210004d30 con 0x7f221c0fc880 2024-04-03T08:30:11.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.865+0000 7f2218c00700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f2204036880 0x7f2204038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:11.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.865+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2210049460 con 0x7f221c0fc880 2024-04-03T08:30:11.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.865+0000 7f221be00700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f2204036880 0x7f2204038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:11.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.866+0000 7f221be00700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f2204036880 0x7f2204038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2208009990 tx=0x7f2208006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:11.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:11.870+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2210011960 con 0x7f221c0fc880 2024-04-03T08:30:12.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.140+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f221c110600 con 0x7f221c0fc880 2024-04-03T08:30:12.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.140+0000 7f2218c00700 1 -- 172.21.15.181:0/711917935 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2210021070 con 0x7f221c0fc880 2024-04-03T08:30:12.141 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:12.141 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f2204036880 msgr2=0x7f2204038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f2204036880 0x7f2204038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2208009990 tx=0x7f2208006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 msgr2=0x7f221c10f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c10f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2210009680 tx=0x7f2210009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 shutdown_connections 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f2204036880 0x7f2204038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 --2- 172.21.15.181:0/711917935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c0fc880 0x7f221c10f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 >> 172.21.15.181:0/711917935 conn(0x7f221c0f8020 msgr2=0x7f221c0fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 shutdown_connections 2024-04-03T08:30:12.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:12.143+0000 7f2222400700 1 -- 172.21.15.181:0/711917935 wait complete. 2024-04-03T08:30:12.144 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:12.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:12 smithi157 ceph-mon[35083]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:12.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:12 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/711917935' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:13.707 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:13.707 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:14.111 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:14.198 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:14.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:14 smithi157 ceph-mon[35083]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:15.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 -- 172.21.15.181:0/3818412993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 msgr2=0x7f84b40fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:15.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 --2- 172.21.15.181:0/3818412993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b40fce80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84a40048c0 tx=0x7f84a4009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 -- 172.21.15.181:0/3818412993 shutdown_connections 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 --2- 172.21.15.181:0/3818412993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b40fce80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 -- 172.21.15.181:0/3818412993 >> 172.21.15.181:0/3818412993 conn(0x7f84b40f81d0 msgr2=0x7f84b40fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 -- 172.21.15.181:0/3818412993 shutdown_connections 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.932+0000 7f84ba600700 1 -- 172.21.15.181:0/3818412993 wait complete. 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.933+0000 7f84ba600700 1 Processor -- start 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.933+0000 7f84ba600700 1 -- start start 2024-04-03T08:30:15.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.934+0000 7f84ba600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b4071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.934+0000 7f84ba600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40722a0 con 0x7f84b40fca70 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.934+0000 7f84b3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b4071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.934+0000 7f84b3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b4071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:60742/0 (socket says 172.21.15.181:60742) 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.934+0000 7f84b3400700 1 -- 172.21.15.181:0/3409847751 learned_addr learned my addr 172.21.15.181:0/3409847751 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.934+0000 7f84b3400700 1 -- 172.21.15.181:0/3409847751 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4005040 con 0x7f84b40fca70 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.935+0000 7f84b3400700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b4071d60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009680 tx=0x7f84a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:15.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.935+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84a400b5c0 con 0x7f84b40fca70 2024-04-03T08:30:15.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.935+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84a400be70 con 0x7f84b40fca70 2024-04-03T08:30:15.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.935+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b4070370 con 0x7f84b40fca70 2024-04-03T08:30:15.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.935+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84a40135a0 con 0x7f84b40fca70 2024-04-03T08:30:15.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.935+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b4070860 con 0x7f84b40fca70 2024-04-03T08:30:15.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.936+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b405f5f0 con 0x7f84b40fca70 2024-04-03T08:30:15.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.936+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f84a401ca90 con 0x7f84b40fca70 2024-04-03T08:30:15.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.936+0000 7f84ab400700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f84980368d0 0x7f8498038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:15.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.936+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f84a4049410 con 0x7f84b40fca70 2024-04-03T08:30:15.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.937+0000 7f84b2a00700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f84980368d0 0x7f8498038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:15.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.937+0000 7f84b2a00700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f84980368d0 0x7f8498038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009990 tx=0x7f84a0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:15.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:15.942+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f84a4011940 con 0x7f84b40fca70 2024-04-03T08:30:16.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.213+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f84b404bed0 con 0x7f84b40fca70 2024-04-03T08:30:16.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.214+0000 7f84ab400700 1 -- 172.21.15.181:0/3409847751 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f84a4021020 con 0x7f84b40fca70 2024-04-03T08:30:16.215 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:16.215 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:16.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f84980368d0 msgr2=0x7f8498038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:16.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f84980368d0 0x7f8498038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009990 tx=0x7f84a0006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:16.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 msgr2=0x7f84b4071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b4071d60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009680 tx=0x7f84a4009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 shutdown_connections 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f84980368d0 0x7f8498038d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 --2- 172.21.15.181:0/3409847751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84b40fca70 0x7f84b4071d60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.216+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 >> 172.21.15.181:0/3409847751 conn(0x7f84b40f81d0 msgr2=0x7f84b4103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.217+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 shutdown_connections 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:16.217+0000 7f84ba600700 1 -- 172.21.15.181:0/3409847751 wait complete. 2024-04-03T08:30:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:16 smithi157 ceph-mon[35083]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:16 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3409847751' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:17.711 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:17.711 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:18.115 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:18.203 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:18.479 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:18 smithi157 ceph-mon[35083]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 -- 172.21.15.181:0/2665477016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 msgr2=0x7f88740fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 --2- 172.21.15.181:0/2665477016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f88740fce80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88640048c0 tx=0x7f8864009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 -- 172.21.15.181:0/2665477016 shutdown_connections 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 --2- 172.21.15.181:0/2665477016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f88740fce80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 -- 172.21.15.181:0/2665477016 >> 172.21.15.181:0/2665477016 conn(0x7f88740f81d0 msgr2=0x7f88740fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 -- 172.21.15.181:0/2665477016 shutdown_connections 2024-04-03T08:30:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.774+0000 7f8879200700 1 -- 172.21.15.181:0/2665477016 wait complete. 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.775+0000 7f8879200700 1 Processor -- start 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.775+0000 7f8879200700 1 -- start start 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8879200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f887410f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8879200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887410f7f0 con 0x7f88740fca70 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8871e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f887410f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8871e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f887410f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:60764/0 (socket says 172.21.15.181:60764) 2024-04-03T08:30:19.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8871e00700 1 -- 172.21.15.181:0/3029824272 learned_addr learned my addr 172.21.15.181:0/3029824272 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:19.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8871e00700 1 -- 172.21.15.181:0/3029824272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864005040 con 0x7f88740fca70 2024-04-03T08:30:19.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.776+0000 7f8871e00700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f887410f2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8864009680 tx=0x7f8864009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:19.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.777+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f886400b5c0 con 0x7f88740fca70 2024-04-03T08:30:19.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.777+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887410f9f0 con 0x7f88740fca70 2024-04-03T08:30:19.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.777+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f886400be70 con 0x7f88740fca70 2024-04-03T08:30:19.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.777+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88640135a0 con 0x7f88740fca70 2024-04-03T08:30:19.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.777+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8874110560 con 0x7f88740fca70 2024-04-03T08:30:19.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.778+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f8864013810 con 0x7f88740fca70 2024-04-03T08:30:19.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.778+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8874102f80 con 0x7f88740fca70 2024-04-03T08:30:19.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.778+0000 7f886a000700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f88580368d0 0x7f8858038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:19.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.778+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f88640494f0 con 0x7f88740fca70 2024-04-03T08:30:19.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.779+0000 7f8871400700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f88580368d0 0x7f8858038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:19.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.779+0000 7f8871400700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f88580368d0 0x7f8858038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8860009990 tx=0x7f8860006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:19.783+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8864024b10 con 0x7f88740fca70 2024-04-03T08:30:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.057+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f88741107a0 con 0x7f88740fca70 2024-04-03T08:30:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.058+0000 7f886a000700 1 -- 172.21.15.181:0/3029824272 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f886401b390 con 0x7f88740fca70 2024-04-03T08:30:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:20.058 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:20.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f88580368d0 msgr2=0x7f8858038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:20.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f88580368d0 0x7f8858038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8860009990 tx=0x7f8860006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:20.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 msgr2=0x7f887410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:20.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f887410f2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8864009680 tx=0x7f8864009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 shutdown_connections 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7f88580368d0 0x7f8858038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 --2- 172.21.15.181:0/3029824272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88740fca70 0x7f887410f2b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 >> 172.21.15.181:0/3029824272 conn(0x7f88740f81d0 msgr2=0x7f88740fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 shutdown_connections 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:20.060+0000 7f8879200700 1 -- 172.21.15.181:0/3029824272 wait complete. 2024-04-03T08:30:20.061 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:20.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:20 smithi157 ceph-mon[35083]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:20.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:20 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3029824272' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:21.728 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:21.728 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:21.934 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:21 smithi157 ceph-mon[35083]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:21.934 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:21 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:21.934 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:21 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:21.935 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:21 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:21.935 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:21 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-03T08:30:22.155 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:22.242 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:22 smithi157 ceph-mon[35083]: from='mgr.14160 172.21.15.157:0/2619670015' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-03T08:30:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:22 smithi157 ceph-mon[35083]: mgrmap e14: smithi157.qfvynr(active, since 67s) 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 -- 172.21.15.181:0/2681994644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 msgr2=0x7fa05c0fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 --2- 172.21.15.181:0/2681994644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c0fce80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0500048c0 tx=0x7fa050009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 -- 172.21.15.181:0/2681994644 shutdown_connections 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 --2- 172.21.15.181:0/2681994644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c0fce80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 -- 172.21.15.181:0/2681994644 >> 172.21.15.181:0/2681994644 conn(0x7fa05c0f81d0 msgr2=0x7fa05c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 -- 172.21.15.181:0/2681994644 shutdown_connections 2024-04-03T08:30:23.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.804+0000 7fa063a00700 1 -- 172.21.15.181:0/2681994644 wait complete. 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.805+0000 7fa063a00700 1 Processor -- start 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.805+0000 7fa063a00700 1 -- start start 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.805+0000 7fa063a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.805+0000 7fa063a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c10f7f0 con 0x7fa05c0fca70 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.806+0000 7fa061000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.806+0000 7fa061000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:60774/0 (socket says 172.21.15.181:60774) 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.806+0000 7fa061000700 1 -- 172.21.15.181:0/3802965067 learned_addr learned my addr 172.21.15.181:0/3802965067 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.806+0000 7fa061000700 1 -- 172.21.15.181:0/3802965067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050005040 con 0x7fa05c0fca70 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.806+0000 7fa061000700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c10f2b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa050009680 tx=0x7fa050009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.806+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa05000b5c0 con 0x7fa05c0fca70 2024-04-03T08:30:23.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.807+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa05000be70 con 0x7fa05c0fca70 2024-04-03T08:30:23.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.807+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0500135a0 con 0x7fa05c0fca70 2024-04-03T08:30:23.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.807+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c10f9f0 con 0x7fa05c0fca70 2024-04-03T08:30:23.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.807+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c110560 con 0x7fa05c0fca70 2024-04-03T08:30:23.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.808+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c102f80 con 0x7fa05c0fca70 2024-04-03T08:30:23.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.808+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7fa05001ca90 con 0x7fa05c0fca70 2024-04-03T08:30:23.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.808+0000 7fa058c00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 0x7fa044038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:23.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.808+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa050049440 con 0x7fa05c0fca70 2024-04-03T08:30:23.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.808+0000 7fa05be00700 1 -- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 msgr2=0x7fa044038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/494465315 2024-04-03T08:30:23.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.808+0000 7fa05be00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 0x7fa044038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:30:23.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:23.813+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa050011940 con 0x7fa05c0fca70 2024-04-03T08:30:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.009+0000 7fa05be00700 1 -- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 msgr2=0x7fa044038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/494465315 2024-04-03T08:30:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.009+0000 7fa05be00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 0x7fa044038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:30:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.080+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa05c1107a0 con 0x7fa05c0fca70 2024-04-03T08:30:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.081+0000 7fa058c00700 1 -- 172.21.15.181:0/3802965067 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa050021070 con 0x7fa05c0fca70 2024-04-03T08:30:24.081 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:24.081 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.083+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 msgr2=0x7fa044038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.083+0000 7fa063a00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 0x7fa044038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.083+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 msgr2=0x7fa05c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.083+0000 7fa063a00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c10f2b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa050009680 tx=0x7fa050009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.084+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 shutdown_connections 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.084+0000 7fa063a00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fa044036920 0x7fa044038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.084+0000 7fa063a00700 1 --2- 172.21.15.181:0/3802965067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa05c0fca70 0x7fa05c10f2b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.084+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 >> 172.21.15.181:0/3802965067 conn(0x7fa05c0f81d0 msgr2=0x7fa05c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.084+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 shutdown_connections 2024-04-03T08:30:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:24.084+0000 7fa063a00700 1 -- 172.21.15.181:0/3802965067 wait complete. 2024-04-03T08:30:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:24.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:24 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3802965067' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:25.726 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:25.727 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:26.130 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:26.217 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 -- 172.21.15.181:0/3864691370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 msgr2=0x7fef9c0fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 --2- 172.21.15.181:0/3864691370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c0fce80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0048c0 tx=0x7fef8c009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 -- 172.21.15.181:0/3864691370 shutdown_connections 2024-04-03T08:30:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 --2- 172.21.15.181:0/3864691370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c0fce80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 -- 172.21.15.181:0/3864691370 >> 172.21.15.181:0/3864691370 conn(0x7fef9c0f81d0 msgr2=0x7fef9c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 -- 172.21.15.181:0/3864691370 shutdown_connections 2024-04-03T08:30:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.830+0000 7fefa1e00700 1 -- 172.21.15.181:0/3864691370 wait complete. 2024-04-03T08:30:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.831+0000 7fefa1e00700 1 Processor -- start 2024-04-03T08:30:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.831+0000 7fefa1e00700 1 -- start start 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.831+0000 7fefa1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.831+0000 7fefa1e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10f7f0 con 0x7fef9c0fca70 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.832+0000 7fef9aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.832+0000 7fef9aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:45100/0 (socket says 172.21.15.181:45100) 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.832+0000 7fef9aa00700 1 -- 172.21.15.181:0/1698215219 learned_addr learned my addr 172.21.15.181:0/1698215219 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.832+0000 7fef9aa00700 1 -- 172.21.15.181:0/1698215219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c005040 con 0x7fef9c0fca70 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.832+0000 7fef9aa00700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c10f2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009680 tx=0x7fef8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.832+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef8c00b5c0 con 0x7fef9c0fca70 2024-04-03T08:30:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.833+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef8c00be70 con 0x7fef9c0fca70 2024-04-03T08:30:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.833+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef8c0135a0 con 0x7fef9c0fca70 2024-04-03T08:30:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.833+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c10f9f0 con 0x7fef9c0fca70 2024-04-03T08:30:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.833+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c110560 con 0x7fef9c0fca70 2024-04-03T08:30:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.834+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c102f80 con 0x7fef9c0fca70 2024-04-03T08:30:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.834+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7fef8c01ca90 con 0x7fef9c0fca70 2024-04-03T08:30:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.834+0000 7fef92a00700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 0x7fef80038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.834+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fef8c049440 con 0x7fef9c0fca70 2024-04-03T08:30:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.834+0000 7fef9a000700 1 -- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 msgr2=0x7fef80038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/494465315 2024-04-03T08:30:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.834+0000 7fef9a000700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 0x7fef80038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:30:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:27.839+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fef8c011940 con 0x7fef9c0fca70 2024-04-03T08:30:28.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.035+0000 7fef9a000700 1 -- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 msgr2=0x7fef80038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/494465315 2024-04-03T08:30:28.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.035+0000 7fef9a000700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 0x7fef80038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:30:28.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.106+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fef9c110860 con 0x7fef9c0fca70 2024-04-03T08:30:28.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.106+0000 7fef92a00700 1 -- 172.21.15.181:0/1698215219 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fef8c021020 con 0x7fef9c0fca70 2024-04-03T08:30:28.107 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:28.107 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.108+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 msgr2=0x7fef80038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.108+0000 7fefa1e00700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 0x7fef80038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 msgr2=0x7fef9c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c10f2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009680 tx=0x7fef8c009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 shutdown_connections 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:6800/494465315,v1:172.21.15.157:6801/494465315] conn(0x7fef80036920 0x7fef80038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:28.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 --2- 172.21.15.181:0/1698215219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef9c0fca70 0x7fef9c10f2b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:28.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 >> 172.21.15.181:0/1698215219 conn(0x7fef9c0f81d0 msgr2=0x7fef9c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:28.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 shutdown_connections 2024-04-03T08:30:28.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:28.109+0000 7fefa1e00700 1 -- 172.21.15.181:0/1698215219 wait complete. 2024-04-03T08:30:28.110 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:28 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/1698215219' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:29.670 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:29.671 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:30.075 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:30.102 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: Active manager daemon smithi157.qfvynr restarted 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: Activating manager daemon smithi157.qfvynr 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: osdmap e5: 0 total, 0 up, 0 in 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: mgrmap e15: smithi157.qfvynr(active, starting, since 0.00371806s) 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:30:30.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:31 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:31 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:30:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:31 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:30:31.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:31 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:30:31.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:31 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:31.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:31 smithi157 ceph-mon[35083]: mgrmap e16: smithi157.qfvynr(active, since 1.00752s) 2024-04-03T08:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 -- 172.21.15.181:0/2221336565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 msgr2=0x7fe2280fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 --2- 172.21.15.181:0/2221336565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe2280fce80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe2180048c0 tx=0x7fe218009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 -- 172.21.15.181:0/2221336565 shutdown_connections 2024-04-03T08:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 --2- 172.21.15.181:0/2221336565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe2280fce80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 -- 172.21.15.181:0/2221336565 >> 172.21.15.181:0/2221336565 conn(0x7fe2280f81d0 msgr2=0x7fe2280fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 -- 172.21.15.181:0/2221336565 shutdown_connections 2024-04-03T08:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.808+0000 7fe22e200700 1 -- 172.21.15.181:0/2221336565 wait complete. 2024-04-03T08:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.809+0000 7fe22e200700 1 Processor -- start 2024-04-03T08:30:31.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.809+0000 7fe22e200700 1 -- start start 2024-04-03T08:30:31.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.810+0000 7fe22e200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe22810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:31.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.810+0000 7fe22e200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22810d600 con 0x7fe2280fca70 2024-04-03T08:30:31.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.810+0000 7fe227400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe22810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:31.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.810+0000 7fe227400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe22810d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:45130/0 (socket says 172.21.15.181:45130) 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.810+0000 7fe227400700 1 -- 172.21.15.181:0/3363718612 learned_addr learned my addr 172.21.15.181:0/3363718612 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.810+0000 7fe227400700 1 -- 172.21.15.181:0/3363718612 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe218005040 con 0x7fe2280fca70 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.811+0000 7fe227400700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe22810d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe218009680 tx=0x7fe218009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.811+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe21800b5c0 con 0x7fe2280fca70 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.811+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe21800be70 con 0x7fe2280fca70 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.811+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22810d800 con 0x7fe2280fca70 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.811+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2180135a0 con 0x7fe2280fca70 2024-04-03T08:30:31.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.811+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22810e370 con 0x7fe2280fca70 2024-04-03T08:30:31.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.812+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 43289+0+0 (secure 0 0 0) 0x7fe21801c430 con 0x7fe2280fca70 2024-04-03T08:30:31.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.812+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe228102f80 con 0x7fe2280fca70 2024-04-03T08:30:31.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.813+0000 7fe21f400700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe20c036750 0x7fe20c038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:31.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.813+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe218049230 con 0x7fe2280fca70 2024-04-03T08:30:31.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.813+0000 7fe226a00700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe20c036750 0x7fe20c038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:31.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.814+0000 7fe226a00700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe20c036750 0x7fe20c038c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe214009990 tx=0x7fe214006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:31.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:31.818+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe2180117e0 con 0x7fe2280fca70 2024-04-03T08:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.118+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe22810ed80 con 0x7fe2280fca70 2024-04-03T08:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.118+0000 7fe21f400700 1 -- 172.21.15.181:0/3363718612 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe218021070 con 0x7fe2280fca70 2024-04-03T08:30:32.119 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:32.119 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe20c036750 msgr2=0x7fe20c038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe20c036750 0x7fe20c038c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe214009990 tx=0x7fe214006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 msgr2=0x7fe22810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe22810d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe218009680 tx=0x7fe218009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 shutdown_connections 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe20c036750 0x7fe20c038c00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 --2- 172.21.15.181:0/3363718612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2280fca70 0x7fe22810d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 >> 172.21.15.181:0/3363718612 conn(0x7fe2280f81d0 msgr2=0x7fe228103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 shutdown_connections 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:32.121+0000 7fe22e200700 1 -- 172.21.15.181:0/3363718612 wait complete. 2024-04-03T08:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:32 smithi157 ceph-mon[35083]: [03/Apr/2024:08:30:30] ENGINE Bus STARTING 2024-04-03T08:30:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:32 smithi157 ceph-mon[35083]: [03/Apr/2024:08:30:31] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:30:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:32 smithi157 ceph-mon[35083]: [03/Apr/2024:08:30:31] ENGINE Bus STARTED 2024-04-03T08:30:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:33 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3363718612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:33 smithi157 ceph-mon[35083]: mgrmap e17: smithi157.qfvynr(active, since 2s) 2024-04-03T08:30:33.790 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:33.791 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:34.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:34.955 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 -- 172.21.15.181:0/3226724469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 msgr2=0x7f73000fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 --2- 172.21.15.181:0/3226724469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f73000fce80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f72f00048c0 tx=0x7f72f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 -- 172.21.15.181:0/3226724469 shutdown_connections 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 --2- 172.21.15.181:0/3226724469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f73000fce80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 -- 172.21.15.181:0/3226724469 >> 172.21.15.181:0/3226724469 conn(0x7f73000f81d0 msgr2=0x7f73000fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 -- 172.21.15.181:0/3226724469 shutdown_connections 2024-04-03T08:30:37.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.618+0000 7f7307000700 1 -- 172.21.15.181:0/3226724469 wait complete. 2024-04-03T08:30:37.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.619+0000 7f7307000700 1 Processor -- start 2024-04-03T08:30:37.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.619+0000 7f7307000700 1 -- start start 2024-04-03T08:30:37.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.620+0000 7f7307000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f730010f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:37.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.620+0000 7f7307000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730010f820 con 0x7f73000fca70 2024-04-03T08:30:37.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.620+0000 7f72ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f730010f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:37.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.620+0000 7f72ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f730010f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:59756/0 (socket says 172.21.15.181:59756) 2024-04-03T08:30:37.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.620+0000 7f72ffe00700 1 -- 172.21.15.181:0/1646103215 learned_addr learned my addr 172.21.15.181:0/1646103215 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:37.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.620+0000 7f72ffe00700 1 -- 172.21.15.181:0/1646103215 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0005040 con 0x7f73000fca70 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.621+0000 7f72ffe00700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f730010f2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f72f00096b0 tx=0x7f72f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.621+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72f000bed0 con 0x7f73000fca70 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.621+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72f000b5c0 con 0x7f73000fca70 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.621+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730010fa20 con 0x7f73000fca70 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.621+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72f001c5b0 con 0x7f73000fca70 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.621+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300110590 con 0x7f73000fca70 2024-04-03T08:30:37.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.622+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7300102f80 con 0x7f73000fca70 2024-04-03T08:30:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.622+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f72f0013420 con 0x7f73000fca70 2024-04-03T08:30:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.622+0000 7f72f7e00700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f72e40369c0 0x7f72e4038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.623+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f72f0049cc0 con 0x7f73000fca70 2024-04-03T08:30:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.623+0000 7f72ff400700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f72e40369c0 0x7f72e4038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:37.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.623+0000 7f72ff400700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f72e40369c0 0x7f72e4038e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009990 tx=0x7f72ec006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:37.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.628+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f72f0004d30 con 0x7f73000fca70 2024-04-03T08:30:37.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.895+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f73001107d0 con 0x7f73000fca70 2024-04-03T08:30:37.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.896+0000 7f72f7e00700 1 -- 172.21.15.181:0/1646103215 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f72f0011370 con 0x7f73000fca70 2024-04-03T08:30:37.896 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:37.896 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f72e40369c0 msgr2=0x7f72e4038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f72e40369c0 0x7f72e4038e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009990 tx=0x7f72ec006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 msgr2=0x7f730010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f730010f2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f72f00096b0 tx=0x7f72f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 shutdown_connections 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f72e40369c0 0x7f72e4038e70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 --2- 172.21.15.181:0/1646103215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73000fca70 0x7f730010f2e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 >> 172.21.15.181:0/1646103215 conn(0x7f73000f81d0 msgr2=0x7f73000fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:37.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.898+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 shutdown_connections 2024-04-03T08:30:37.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:37.899+0000 7f7307000700 1 -- 172.21.15.181:0/1646103215 wait complete. 2024-04-03T08:30:37.900 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:30:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/1646103215' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:39.482 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:39.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:39.888 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:39.977 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-03T08:30:41.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:40 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:41.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:40 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:41.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 -- 172.21.15.181:0/3261200906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 msgr2=0x7f9e200fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:41.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 --2- 172.21.15.181:0/3261200906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e200fce80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9e100048c0 tx=0x7f9e10009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:41.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 -- 172.21.15.181:0/3261200906 shutdown_connections 2024-04-03T08:30:41.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 --2- 172.21.15.181:0/3261200906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e200fce80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:41.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 -- 172.21.15.181:0/3261200906 >> 172.21.15.181:0/3261200906 conn(0x7f9e200f81d0 msgr2=0x7f9e200fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:41.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 -- 172.21.15.181:0/3261200906 shutdown_connections 2024-04-03T08:30:41.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.805+0000 7f9e25600700 1 -- 172.21.15.181:0/3261200906 wait complete. 2024-04-03T08:30:41.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.806+0000 7f9e25600700 1 Processor -- start 2024-04-03T08:30:41.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.807+0000 7f9e25600700 1 -- start start 2024-04-03T08:30:41.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.807+0000 7f9e25600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e20071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:41.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.807+0000 7f9e25600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200722a0 con 0x7f9e200fca70 2024-04-03T08:30:41.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.807+0000 7f9e1ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e20071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:41.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.807+0000 7f9e1ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e20071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:59776/0 (socket says 172.21.15.181:59776) 2024-04-03T08:30:41.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.808+0000 7f9e1ea00700 1 -- 172.21.15.181:0/116067851 learned_addr learned my addr 172.21.15.181:0/116067851 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:41.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.808+0000 7f9e1ea00700 1 -- 172.21.15.181:0/116067851 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10005040 con 0x7f9e200fca70 2024-04-03T08:30:41.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.808+0000 7f9e1ea00700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e20071d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009680 tx=0x7f9e10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:41.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.808+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e1000b5c0 con 0x7f9e200fca70 2024-04-03T08:30:41.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.809+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20070370 con 0x7f9e200fca70 2024-04-03T08:30:41.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.809+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e1000be70 con 0x7f9e200fca70 2024-04-03T08:30:41.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.809+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e100135a0 con 0x7f9e200fca70 2024-04-03T08:30:41.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.809+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e20070860 con 0x7f9e200fca70 2024-04-03T08:30:41.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.810+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f9e1001ca90 con 0x7f9e200fca70 2024-04-03T08:30:41.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.810+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2005f5f0 con 0x7f9e200fca70 2024-04-03T08:30:41.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.810+0000 7f9e16a00700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9e040369c0 0x7f9e04038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:41.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.810+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9e10049610 con 0x7f9e200fca70 2024-04-03T08:30:41.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.811+0000 7f9e1e000700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9e040369c0 0x7f9e04038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:41.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.811+0000 7f9e1e000700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9e040369c0 0x7f9e04038e70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009990 tx=0x7f9e0c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:41.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:41.815+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9e10011940 con 0x7f9e200fca70 2024-04-03T08:30:42.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.101+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9e20106450 con 0x7f9e200fca70 2024-04-03T08:30:42.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.102+0000 7f9e16a00700 1 -- 172.21.15.181:0/116067851 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9e10021070 con 0x7f9e200fca70 2024-04-03T08:30:42.103 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:42.103 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9e040369c0 msgr2=0x7f9e04038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9e040369c0 0x7f9e04038e70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009990 tx=0x7f9e0c006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 msgr2=0x7f9e20071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e20071d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009680 tx=0x7f9e10009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 shutdown_connections 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9e040369c0 0x7f9e04038e70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 --2- 172.21.15.181:0/116067851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e200fca70 0x7f9e20071d60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 >> 172.21.15.181:0/116067851 conn(0x7f9e200f81d0 msgr2=0x7f9e20103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 shutdown_connections 2024-04-03T08:30:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:42.104+0000 7f9e25600700 1 -- 172.21.15.181:0/116067851 wait complete. 2024-04-03T08:30:42.106 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:30:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:41 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:30:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:42 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:30:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:42 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:30:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:42 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/116067851' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:42 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:30:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:42 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:30:43.880 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:43.881 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:44.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:30:44.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-03T08:30:44.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:30:44.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:43 smithi157 ceph-mon[35083]: Deploying daemon crash.smithi181 on smithi181 2024-04-03T08:30:44.570 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:30:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:30:46.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.951+0000 7fdbb4000700 1 -- 172.21.15.181:0/3175600611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 msgr2=0x7fdbac102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:46.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.951+0000 7fdbb4000700 1 --2- 172.21.15.181:0/3175600611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac102e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdba00048c0 tx=0x7fdba0009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:46.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.952+0000 7fdbb4000700 1 -- 172.21.15.181:0/3175600611 shutdown_connections 2024-04-03T08:30:46.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.952+0000 7fdbb4000700 1 --2- 172.21.15.181:0/3175600611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac102e90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:46.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.952+0000 7fdbb4000700 1 -- 172.21.15.181:0/3175600611 >> 172.21.15.181:0/3175600611 conn(0x7fdbac0f85e0 msgr2=0x7fdbac0fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:46.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.952+0000 7fdbb4000700 1 -- 172.21.15.181:0/3175600611 shutdown_connections 2024-04-03T08:30:46.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.952+0000 7fdbb4000700 1 -- 172.21.15.181:0/3175600611 wait complete. 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.952+0000 7fdbb4000700 1 Processor -- start 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.953+0000 7fdbb4000700 1 -- start start 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.953+0000 7fdbb4000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac115370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.953+0000 7fdbb4000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1158b0 con 0x7fdbac102ac0 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.953+0000 7fdbb1600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac115370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.953+0000 7fdbb1600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac115370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:41198/0 (socket says 172.21.15.181:41198) 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.953+0000 7fdbb1600700 1 -- 172.21.15.181:0/700484977 learned_addr learned my addr 172.21.15.181:0/700484977 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdbb1600700 1 -- 172.21.15.181:0/700484977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0005040 con 0x7fdbac102ac0 2024-04-03T08:30:46.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdbb1600700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac115370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdba000b7f0 tx=0x7fdba0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:46.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba0009370 con 0x7fdbac102ac0 2024-04-03T08:30:46.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac115ab0 con 0x7fdbac102ac0 2024-04-03T08:30:46.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdba0013420 con 0x7fdbac102ac0 2024-04-03T08:30:46.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba001c590 con 0x7fdbac102ac0 2024-04-03T08:30:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.954+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac115fa0 con 0x7fdbac102ac0 2024-04-03T08:30:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.955+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac0fe1c0 con 0x7fdbac102ac0 2024-04-03T08:30:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.956+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fdba00094d0 con 0x7fdbac102ac0 2024-04-03T08:30:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.956+0000 7fdba9600700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdb94036970 0x7fdb94038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.956+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdba0049490 con 0x7fdbac102ac0 2024-04-03T08:30:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.956+0000 7fdbb0c00700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdb94036970 0x7fdb94038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.957+0000 7fdbb0c00700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdb94036970 0x7fdb94038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009990 tx=0x7fdb98006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:46.962+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdba0013590 con 0x7fdbac102ac0 2024-04-03T08:30:47.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.251+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdbac05f5f0 con 0x7fdbac102ac0 2024-04-03T08:30:47.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.252+0000 7fdba9600700 1 -- 172.21.15.181:0/700484977 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fdba0021030 con 0x7fdbac102ac0 2024-04-03T08:30:47.254 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:47.254 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdb94036970 msgr2=0x7fdb94038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdb94036970 0x7fdb94038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009990 tx=0x7fdb98006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 msgr2=0x7fdbac115370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac115370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdba000b7f0 tx=0x7fdba0009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 shutdown_connections 2024-04-03T08:30:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdb94036970 0x7fdb94038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 --2- 172.21.15.181:0/700484977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbac102ac0 0x7fdbac115370 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 >> 172.21.15.181:0/700484977 conn(0x7fdbac0f85e0 msgr2=0x7fdbac0f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 shutdown_connections 2024-04-03T08:30:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:47.255+0000 7fdbb4000700 1 -- 172.21.15.181:0/700484977 wait complete. 2024-04-03T08:30:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:47 smithi157 ceph-mon[35083]: Deploying daemon node-exporter.smithi181 on smithi181 2024-04-03T08:30:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:47 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/700484977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:48.954 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:48.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:49.412 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:30:51.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:51 smithi157 ceph-mon[35083]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:51.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:51 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 -- 172.21.15.181:0/726237774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 msgr2=0x7f6300102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 --2- 172.21.15.181:0/726237774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f6300102e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62f00048c0 tx=0x7f62f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 -- 172.21.15.181:0/726237774 shutdown_connections 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 --2- 172.21.15.181:0/726237774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f6300102e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 -- 172.21.15.181:0/726237774 >> 172.21.15.181:0/726237774 conn(0x7f63000f85e0 msgr2=0x7f63000fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 -- 172.21.15.181:0/726237774 shutdown_connections 2024-04-03T08:30:52.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.138+0000 7f6306600700 1 -- 172.21.15.181:0/726237774 wait complete. 2024-04-03T08:30:52.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.139+0000 7f6306600700 1 Processor -- start 2024-04-03T08:30:52.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.139+0000 7f6306600700 1 -- start start 2024-04-03T08:30:52.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.140+0000 7f6306600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f63000702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:52.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.140+0000 7f6306600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000722c0 con 0x7f6300102ac0 2024-04-03T08:30:52.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.140+0000 7f62ff400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f63000702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:52.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.140+0000 7f62ff400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f63000702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:41218/0 (socket says 172.21.15.181:41218) 2024-04-03T08:30:52.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.140+0000 7f62ff400700 1 -- 172.21.15.181:0/3927688836 learned_addr learned my addr 172.21.15.181:0/3927688836 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:52.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f62ff400700 1 -- 172.21.15.181:0/3927688836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0005040 con 0x7f6300102ac0 2024-04-03T08:30:52.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f62ff400700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f63000702c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62f000b820 tx=0x7f62f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:52.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62f00093c0 con 0x7f6300102ac0 2024-04-03T08:30:52.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62f0013420 con 0x7f6300102ac0 2024-04-03T08:30:52.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62f001c5b0 con 0x7f6300102ac0 2024-04-03T08:30:52.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300070860 con 0x7f6300102ac0 2024-04-03T08:30:52.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.141+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6300070d50 con 0x7f6300102ac0 2024-04-03T08:30:52.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.142+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63000fe1c0 con 0x7f6300102ac0 2024-04-03T08:30:52.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.143+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f62f0013a90 con 0x7f6300102ac0 2024-04-03T08:30:52.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.143+0000 7f62f7400700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f62e4036970 0x7f62e4038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:52.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.143+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f62f0049b50 con 0x7f6300102ac0 2024-04-03T08:30:52.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.144+0000 7f62fea00700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f62e4036970 0x7f62e4038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:52.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.144+0000 7f62fea00700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f62e4036970 0x7f62e4038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009990 tx=0x7f62ec006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:52.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.149+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f62f00098a0 con 0x7f6300102ac0 2024-04-03T08:30:52.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.424+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6300070ff0 con 0x7f6300102ac0 2024-04-03T08:30:52.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.425+0000 7f62f7400700 1 -- 172.21.15.181:0/3927688836 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f62f0011370 con 0x7f6300102ac0 2024-04-03T08:30:52.427 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:52.427 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f62e4036970 msgr2=0x7f62e4038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f62e4036970 0x7f62e4038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009990 tx=0x7f62ec006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 msgr2=0x7f63000702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f63000702c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62f000b820 tx=0x7f62f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 shutdown_connections 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f62e4036970 0x7f62e4038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.427+0000 7f6306600700 1 --2- 172.21.15.181:0/3927688836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6300102ac0 0x7f63000702c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.428+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 >> 172.21.15.181:0/3927688836 conn(0x7f63000f85e0 msgr2=0x7f63000f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.428+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 shutdown_connections 2024-04-03T08:30:52.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:52.428+0000 7f6306600700 1 -- 172.21.15.181:0/3927688836 wait complete. 2024-04-03T08:30:52.430 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:53.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:30:53.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-03T08:30:53.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:30:53.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:30:53.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: Deploying daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:30:53.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:53 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3927688836' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:54.145 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:30:54.145 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:30:54.602 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:30:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:55 smithi157 ceph-mon[35083]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:55 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 -- 172.21.15.181:0/1255252132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 msgr2=0x7f3770102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 --2- 172.21.15.181:0/1255252132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770102e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37600048c0 tx=0x7f3760009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 -- 172.21.15.181:0/1255252132 shutdown_connections 2024-04-03T08:30:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 --2- 172.21.15.181:0/1255252132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770102e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 -- 172.21.15.181:0/1255252132 >> 172.21.15.181:0/1255252132 conn(0x7f37700f85e0 msgr2=0x7f37700fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 -- 172.21.15.181:0/1255252132 shutdown_connections 2024-04-03T08:30:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.833+0000 7f3776e00700 1 -- 172.21.15.181:0/1255252132 wait complete. 2024-04-03T08:30:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.834+0000 7f3776e00700 1 Processor -- start 2024-04-03T08:30:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.834+0000 7f3776e00700 1 -- start start 2024-04-03T08:30:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.834+0000 7f3776e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770115370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.835+0000 7f3776e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37701158b0 con 0x7f3770102ac0 2024-04-03T08:30:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.835+0000 7f376fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770115370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.835+0000 7f376fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770115370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:33208/0 (socket says 172.21.15.181:33208) 2024-04-03T08:30:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.835+0000 7f376fe00700 1 -- 172.21.15.181:0/792521144 learned_addr learned my addr 172.21.15.181:0/792521144 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:30:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.835+0000 7f376fe00700 1 -- 172.21.15.181:0/792521144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760005040 con 0x7f3770102ac0 2024-04-03T08:30:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.836+0000 7f376fe00700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770115370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f376000b7f0 tx=0x7f3760009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.836+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3760009370 con 0x7f3770102ac0 2024-04-03T08:30:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.836+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3760013420 con 0x7f3770102ac0 2024-04-03T08:30:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.836+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f376001c590 con 0x7f3770102ac0 2024-04-03T08:30:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.836+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3770115ab0 con 0x7f3770102ac0 2024-04-03T08:30:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.836+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3770115fa0 con 0x7f3770102ac0 2024-04-03T08:30:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.837+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f37600094d0 con 0x7f3770102ac0 2024-04-03T08:30:56.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.837+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37700fe1c0 con 0x7f3770102ac0 2024-04-03T08:30:56.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.838+0000 7f3767e00700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f37540369c0 0x7f3754038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:30:56.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.838+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3760049430 con 0x7f3770102ac0 2024-04-03T08:30:56.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.838+0000 7f376f400700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f37540369c0 0x7f3754038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:30:56.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.839+0000 7f376f400700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f37540369c0 0x7f3754038e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f375c009990 tx=0x7f375c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:30:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:56.843+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3760013590 con 0x7f3770102ac0 2024-04-03T08:30:57.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.150+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f377005f5f0 con 0x7f3770102ac0 2024-04-03T08:30:57.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.151+0000 7f3767e00700 1 -- 172.21.15.181:0/792521144 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3760021030 con 0x7f3770102ac0 2024-04-03T08:30:57.151 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:30:57.152 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:27:59.169496Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-03T08:30:57.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f37540369c0 msgr2=0x7f3754038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f37540369c0 0x7f3754038e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f375c009990 tx=0x7f375c006e40 comp rx=0 tx=0).stop 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 msgr2=0x7f3770115370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770115370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f376000b7f0 tx=0x7f3760009e30 comp rx=0 tx=0).stop 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 shutdown_connections 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f37540369c0 0x7f3754038e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 --2- 172.21.15.181:0/792521144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3770102ac0 0x7f3770115370 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 >> 172.21.15.181:0/792521144 conn(0x7f37700f85e0 msgr2=0x7f37700f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 shutdown_connections 2024-04-03T08:30:57.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:30:57.153+0000 7f3776e00700 1 -- 172.21.15.181:0/792521144 wait complete. 2024-04-03T08:30:57.155 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:30:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:30:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: Deploying daemon mon.smithi181 on smithi181 2024-04-03T08:30:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:57 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/792521144' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:30:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:30:59 smithi157 ceph-mon[35083]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:00.015 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-03T08:31:00.016 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mon dump -f json 2024-04-03T08:31:00.484 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:31:00.694 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:00 smithi181 systemd[1]: Starting Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:31:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:01 smithi157 ceph-mon[35083]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:01 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:01 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:01.939 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: set uid:gid to 167:167 (ceph:ceph) 2024-04-03T08:31:01.939 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable), process ceph-mon, pid 8 2024-04-03T08:31:01.939 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: pidfile_write: ignore empty --pid-file 2024-04-03T08:31:01.939 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: load: jerasure load: lrc 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: RocksDB version: 6.15.5 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Compile date Apr 3 2024 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: DB SUMMARY 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: DB Session ID: HW171BW0YOXT48RHW4S7 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: CURRENT file: CURRENT 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: IDENTITY file: IDENTITY 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-03T08:31:01.940 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi181/store.db dir, Total Num: 0, files: 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi181/store.db: 000004.log size: 511 ; 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.error_if_exists: 0 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.create_if_missing: 0 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.paranoid_checks: 1 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.env: 0x55fe1d3dca80 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.fs: Posix File System 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.info_log: 0x55fe1efd1c00 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_file_opening_threads: 16 2024-04-03T08:31:01.941 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.statistics: (nil) 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.use_fsync: 0 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_log_file_size: 0 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.keep_log_file_num: 1000 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.recycle_log_file_num: 0 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.allow_fallocate: 1 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.allow_mmap_reads: 0 2024-04-03T08:31:01.942 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.allow_mmap_writes: 0 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.use_direct_reads: 0 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.create_missing_column_families: 0 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.db_log_dir: 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi181/store.db 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-03T08:31:01.943 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.advise_random_on_open: 1 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.db_write_buffer_size: 0 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.write_buffer_manager: 0x55fe1fd46990 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.rate_limiter: (nil) 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.wal_recovery_mode: 2 2024-04-03T08:31:01.944 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.enable_thread_tracking: 0 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.enable_pipelined_write: 0 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.unordered_write: 0 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.row_cache: None 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.wal_filter: None 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.allow_ingest_behind: 0 2024-04-03T08:31:01.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.preserve_deletes: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.two_write_queues: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.manual_wal_flush: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.atomic_flush: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.log_readahead_size: 0 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-03T08:31:01.946 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.best_efforts_recovery: 0 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.allow_data_in_errors: 0 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.db_host_id: __hostname__ 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_background_jobs: 2 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_background_compactions: -1 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_subcompactions: 1 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-03T08:31:01.947 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_total_wal_size: 0 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_open_files: -1 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bytes_per_sync: 0 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_readahead_size: 0 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_background_flushes: -1 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Compression algorithms supported: 2024-04-03T08:31:01.948 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kZSTD supported: 0 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kXpressCompression supported: 0 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kLZ4HCCompression supported: 1 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kZlibCompression supported: 1 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kSnappyCompression supported: 1 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kLZ4Compression supported: 1 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: kBZip2Compression supported: 0 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi181/store.db/MANIFEST-000003 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.merge_operator: 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_filter: None 2024-04-03T08:31:01.949 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_filter_factory: None 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.sst_partitioner_factory: None 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fe1f026f58) 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: index_type: 0 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: data_block_index_type: 0 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: index_shortening: 1 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-03T08:31:01.950 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: hash_index_allow_collision: 1 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: checksum: 1 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: no_block_cache: 0 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache: 0x55fe1f059090 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache_options: 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: capacity : 536870912 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: num_shard_bits : 4 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: strict_capacity_limit : 0 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache_compressed: (nil) 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: persistent_cache: (nil) 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_size: 4096 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_size_deviation: 10 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_restart_interval: 16 2024-04-03T08:31:01.951 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: index_block_restart_interval: 1 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: metadata_block_size: 4096 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: partition_filters: 0 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: use_delta_encoding: 1 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: whole_key_filtering: 1 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: verify_compression: 0 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: format_version: 4 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: enable_index_compression: 1 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_align: 0 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.write_buffer_size: 33554432 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_write_buffer_number: 2 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression: NoCompression 2024-04-03T08:31:01.952 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression: Disabled 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.prefix_extractor: nullptr 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.num_levels: 7 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:31:01.953 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.level: 32767 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.strategy: 0 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compression_opts.enabled: false 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-03T08:31:01.954 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.target_file_size_base: 67108864 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-03T08:31:01.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.arena_block_size: 4194304 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.disable_auto_compactions: 0 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-03T08:31:01.956 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.table_properties_collectors: 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.inplace_update_support: 0 2024-04-03T08:31:01.957 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.bloom_locality: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.max_successive_merges: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.paranoid_file_checks: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.force_consistency_checks: 1 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.report_bg_io_stats: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.ttl: 2592000 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-03T08:31:01.958 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.enable_blob_files: false 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.min_blob_size: 0 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.blob_file_size: 268435456 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi181/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133061899089, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133061899809, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1712133061, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "9724970b-d694-47a7-abdf-25aa07bedea4", "db_session_id": "HW171BW0YOXT48RHW4S7"}} 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-03T08:31:01.959 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133061900540, "job": 1, "event": "recovery_finished"} 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi181/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55fe1efed180 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: DB pointer 0x55fe1f0c2000 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** DB Stats ** 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.960 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** Compaction Stats [default] ** 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** Compaction Stats [default] ** 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:31:01.961 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** Compaction Stats [default] ** 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:31:01.962 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** Compaction Stats [default] ** 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:31:01.963 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181 does not exist in monmap, will attempt to join an existing cluster 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: using public_addr v2:172.21.15.181:0/0 -> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: starting mon.smithi181 rank -1 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi181 fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(???) e0 preinit fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).mds e1 new map 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).mds e1 print_map 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: e1 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: legacy client fscid: -1 2024-04-03T08:31:01.964 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: No filesystems configured 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-03T08:31:01.965 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:02.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:02.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:02.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:02.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 ceph-mon[44183]: mon.smithi181@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-03T08:31:02.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 bash[44110]: 5889d25b0b959af959985def17cecec4238a84525df6d03cd15a78a6cf0d072d 2024-04-03T08:31:02.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:01 smithi181 systemd[1]: Started Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:31:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:31:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: mon.smithi157 calling monitor election 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: mon.smithi181 calling monitor election 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: mon.smithi157 is new leader, mons smithi157,smithi181 in quorum (ranks 0,1) 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: monmap e2: 2 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],smithi181=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:31:07.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: fsmap 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: osdmap e5: 0 total, 0 up, 0 in 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: mgrmap e17: smithi157.qfvynr(active, since 36s) 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: overall HEALTH_OK 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:31:07.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:07.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:31:07.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: mon.smithi157 calling monitor election 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: mon.smithi181 calling monitor election 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: mon.smithi157 is new leader, mons smithi157,smithi181 in quorum (ranks 0,1) 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: monmap e2: 2 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],smithi181=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: fsmap 2024-04-03T08:31:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: osdmap e5: 0 total, 0 up, 0 in 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: mgrmap e17: smithi157.qfvynr(active, since 36s) 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: overall HEALTH_OK 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3564779582' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:31:07.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:07.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.386+0000 7f8d36c00700 1 -- 172.21.15.181:0/2161576547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d14003580 msgr2=0x7f8d14005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:07.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.386+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2161576547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d14003580 0x7f8d14005a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d30070290 tx=0x7f8d20002040 comp rx=0 tx=0).stop 2024-04-03T08:31:07.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.386+0000 7f8d36c00700 1 -- 172.21.15.181:0/2161576547 shutdown_connections 2024-04-03T08:31:07.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.386+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2161576547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d14003580 0x7f8d14005a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:07.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.386+0000 7f8d36c00700 1 -- 172.21.15.181:0/2161576547 >> 172.21.15.181:0/2161576547 conn(0x7f8d300f8730 msgr2=0x7f8d300fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:31:07.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.386+0000 7f8d36c00700 1 -- 172.21.15.181:0/2161576547 shutdown_connections 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.387+0000 7f8d36c00700 1 -- 172.21.15.181:0/2161576547 wait complete. 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.387+0000 7f8d36c00700 1 Processor -- start 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d36c00700 1 -- start start 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d36c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 0x7f8d30119930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d36c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 0x7f8d30113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d36c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3011a430 con 0x7f8d30119e70 2024-04-03T08:31:07.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d36c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30113e40 con 0x7f8d14003580 2024-04-03T08:31:07.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d2f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 0x7f8d30113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:07.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d2f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 0x7f8d30113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.181:55692/0 (socket says 172.21.15.181:55692) 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d2f400700 1 -- 172.21.15.181:0/2052833595 learned_addr learned my addr 172.21.15.181:0/2052833595 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.388+0000 7f8d2fe00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 0x7f8d30119930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2fe00700 1 -- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 msgr2=0x7f8d30119930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2fe00700 1 -- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 msgr2=0x7f8d30119930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2fe00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 0x7f8d30119930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2f400700 1 -- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 msgr2=0x7f8d30119930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2fe00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 0x7f8d30119930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2f400700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 0x7f8d30119930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2f400700 1 -- 172.21.15.181:0/2052833595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20005040 con 0x7f8d30119e70 2024-04-03T08:31:07.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.389+0000 7f8d2f400700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 0x7f8d30113900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00b790 tx=0x7f8d1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:31:07.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.390+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1c010870 con 0x7f8d30119e70 2024-04-03T08:31:07.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.390+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d1c00f3e0 con 0x7f8d30119e70 2024-04-03T08:31:07.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.390+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1c010ea0 con 0x7f8d30119e70 2024-04-03T08:31:07.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.390+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d30114120 con 0x7f8d30119e70 2024-04-03T08:31:07.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.390+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d30114660 con 0x7f8d30119e70 2024-04-03T08:31:07.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.391+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3010d750 con 0x7f8d30119e70 2024-04-03T08:31:07.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.392+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f8d1c00f550 con 0x7f8d30119e70 2024-04-03T08:31:07.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.393+0000 7f8d27e00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8d10069360 0x7f8d1006b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:07.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.393+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8d1c086650 con 0x7f8d30119e70 2024-04-03T08:31:07.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.393+0000 7f8d2fe00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8d10069360 0x7f8d1006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:07.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.394+0000 7f8d2fe00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8d10069360 0x7f8d1006b810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d200176c0 tx=0x7f8d20019040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:31:07.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.398+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8d1c057450 con 0x7f8d30119e70 2024-04-03T08:31:07.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.682+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8d3010af10 con 0x7f8d30119e70 2024-04-03T08:31:07.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.683+0000 7f8d27e00700 1 -- 172.21.15.181:0/2052833595 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f8d1c014410 con 0x7f8d30119e70 2024-04-03T08:31:07.683 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-03T08:31:07.683 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","modified":"2024-04-03T08:31:01.942218Z","created":"2024-04-03T08:27:59.169496Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi181","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.685+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8d10069360 msgr2=0x7f8d1006b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.685+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8d10069360 0x7f8d1006b810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d200176c0 tx=0x7f8d20019040 comp rx=0 tx=0).stop 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 msgr2=0x7f8d30113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 0x7f8d30113900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00b790 tx=0x7f8d1c009250 comp rx=0 tx=0).stop 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 shutdown_connections 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8d10069360 0x7f8d1006b810 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d14003580 0x7f8d30119930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 --2- 172.21.15.181:0/2052833595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d30119e70 0x7f8d30113900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:07.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 >> 172.21.15.181:0/2052833595 conn(0x7f8d300f8730 msgr2=0x7f8d301001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:31:07.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 shutdown_connections 2024-04-03T08:31:07.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:31:07.686+0000 7f8d36c00700 1 -- 172.21.15.181:0/2052833595 wait complete. 2024-04-03T08:31:07.687 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-04-03T08:31:08.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: mgrmap e18: smithi157.qfvynr(active, since 37s), standbys: smithi181.mfhidq 2024-04-03T08:31:08.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:31:08.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:08.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:08.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:08.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:31:08.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/2052833595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:31:08.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: mgrmap e18: smithi157.qfvynr(active, since 37s), standbys: smithi181.mfhidq 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/2052833595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-03T08:31:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:31:08.409 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-03T08:31:08.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-04-03T08:31:08.836 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:31:09.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:09 smithi157 ceph-mon[35083]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:09.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:09 smithi181 ceph-mon[44183]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:10.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.725+0000 7fc3ea000700 1 -- 172.21.15.157:0/3769596324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e40724f0 msgr2=0x7fc3e40728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:10.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.725+0000 7fc3ea000700 1 --2- 172.21.15.157:0/3769596324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e40724f0 0x7fc3e40728c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40048c0 tx=0x7fc3d4009e30 comp rx=0 tx=0).stop 2024-04-03T08:31:10.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.725+0000 7fc3ea000700 1 -- 172.21.15.157:0/3769596324 shutdown_connections 2024-04-03T08:31:10.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.725+0000 7fc3ea000700 1 --2- 172.21.15.157:0/3769596324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e40724f0 0x7fc3e40728c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:10.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.725+0000 7fc3ea000700 1 -- 172.21.15.157:0/3769596324 >> 172.21.15.157:0/3769596324 conn(0x7fc3e40fa950 msgr2=0x7fc3e40fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:31:10.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.726+0000 7fc3ea000700 1 -- 172.21.15.157:0/3769596324 shutdown_connections 2024-04-03T08:31:10.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.726+0000 7fc3ea000700 1 -- 172.21.15.157:0/3769596324 wait complete. 2024-04-03T08:31:10.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.727+0000 7fc3ea000700 1 Processor -- start 2024-04-03T08:31:10.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.727+0000 7fc3ea000700 1 -- start start 2024-04-03T08:31:10.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3ea000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 0x7fc3e4119820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:10.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3ea000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 0x7fc3e41137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:10.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3ea000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e411a320 con 0x7fc3e4119d60 2024-04-03T08:31:10.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3ea000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4113ce0 con 0x7fc3e40724f0 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 0x7fc3e41137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 0x7fc3e41137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35528/0 (socket says 172.21.15.157:35528) 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e2a00700 1 -- 172.21.15.157:0/1303851212 learned_addr learned my addr 172.21.15.157:0/1303851212 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e3400700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 0x7fc3e4119820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e3400700 1 -- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 msgr2=0x7fc3e4119820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e3400700 1 -- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 msgr2=0x7fc3e4119820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e3400700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 0x7fc3e4119820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.728+0000 7fc3e3400700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 0x7fc3e4119820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3e2a00700 1 -- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 msgr2=0x7fc3e4119820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3e2a00700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 0x7fc3e4119820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3e2a00700 1 -- 172.21.15.157:0/1303851212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d4005040 con 0x7fc3e4119d60 2024-04-03T08:31:10.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3e2a00700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 0x7fc3e41137a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000b790 tx=0x7fc3d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:31:10.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d0010870 con 0x7fc3e4119d60 2024-04-03T08:31:10.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3d000f3e0 con 0x7fc3e4119d60 2024-04-03T08:31:10.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d0010ea0 con 0x7fc3e4119d60 2024-04-03T08:31:10.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e4113fc0 con 0x7fc3e4119d60 2024-04-03T08:31:10.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.729+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e4114580 con 0x7fc3e4119d60 2024-04-03T08:31:10.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.730+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e410ab10 con 0x7fc3e4119d60 2024-04-03T08:31:10.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.732+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fc3d000f550 con 0x7fc3e4119d60 2024-04-03T08:31:10.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.733+0000 7fc3db400700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc3c8069360 0x7fc3c806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:10.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.733+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc3d0086690 con 0x7fc3e4119d60 2024-04-03T08:31:10.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.733+0000 7fc3e3400700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc3c8069360 0x7fc3c806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:10.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.734+0000 7fc3e3400700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc3c8069360 0x7fc3c806b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b3b0 tx=0x7fc3d4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:31:10.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.738+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc3d0057490 con 0x7fc3e4119d60 2024-04-03T08:31:10.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.986+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc3e410d390 con 0x7fc3e4119d60 2024-04-03T08:31:10.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.986+0000 7fc3db400700 1 -- 172.21.15.157:0/1303851212 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fc3d0014100 con 0x7fc3e4119d60 2024-04-03T08:31:10.987 INFO:teuthology.orchestra.run.smithi157.stdout:# minimal ceph.conf for af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:31:10.987 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-04-03T08:31:10.987 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:31:10.987 INFO:teuthology.orchestra.run.smithi157.stdout: mon_host = [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc3c8069360 msgr2=0x7fc3c806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc3c8069360 0x7fc3c806b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b3b0 tx=0x7fc3d4009e30 comp rx=0 tx=0).stop 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 msgr2=0x7fc3e41137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 0x7fc3e41137a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000b790 tx=0x7fc3d0009250 comp rx=0 tx=0).stop 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 shutdown_connections 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc3c8069360 0x7fc3c806b810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3e40724f0 0x7fc3e4119820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 --2- 172.21.15.157:0/1303851212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3e4119d60 0x7fc3e41137a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:10.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 >> 172.21.15.157:0/1303851212 conn(0x7fc3e40fa950 msgr2=0x7fc3e40fb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:31:10.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 shutdown_connections 2024-04-03T08:31:10.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:10.989+0000 7fc3ea000700 1 -- 172.21.15.157:0/1303851212 wait complete. 2024-04-03T08:31:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:31:11.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:31:11.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:31:11.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:31:11.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:31:11.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:11 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1303851212' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:11.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:11.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:11.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:11.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:31:11.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:11 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1303851212' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:11.721 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-03T08:31:11.722 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:31:11.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-04-03T08:31:11.792 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:31:11.792 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:31:11.903 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:31:11.903 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-04-03T08:31:11.973 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:31:11.974 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:31:12.080 INFO:tasks.cephadm:Deploying OSDs... 2024-04-03T08:31:12.081 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:31:12.081 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-04-03T08:31:12.127 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-03T08:31:12.127 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-04-03T08:31:12.218 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 448 Links: 1 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-03 08:30:19.705394600 +0000 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-03 08:19:57.227982115 +0000 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-03 08:19:57.227982115 +0000 2024-04-03T08:31:12.219 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-03 08:19:57.206982511 +0000 2024-04-03T08:31:12.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-03T08:31:12.286 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-03T08:31:12.286 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-03T08:31:12.286 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000184602 s, 2.8 MB/s 2024-04-03T08:31:12.289 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-03T08:31:12.334 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-04-03T08:31:12.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: Reconfiguring mon.smithi157 (unknown last config time)... 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:12 smithi181 ceph-mon[44183]: Reconfiguring daemon mon.smithi157 on smithi157 2024-04-03T08:31:12.378 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-03T08:31:12.378 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:12.378 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 454 Links: 1 2024-04-03T08:31:12.378 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:12.379 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:12.379 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-03 08:30:19.705394600 +0000 2024-04-03T08:31:12.379 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-03 08:19:57.700973203 +0000 2024-04-03T08:31:12.379 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-03 08:19:57.700973203 +0000 2024-04-03T08:31:12.379 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-03 08:19:57.677973637 +0000 2024-04-03T08:31:12.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-03T08:31:12.392 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.392 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.392 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: Reconfiguring mon.smithi157 (unknown last config time)... 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:12.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:12 smithi157 ceph-mon[35083]: Reconfiguring daemon mon.smithi157 on smithi157 2024-04-03T08:31:12.457 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-03T08:31:12.457 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-03T08:31:12.457 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000182312 s, 2.8 MB/s 2024-04-03T08:31:12.460 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-03T08:31:12.506 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-04-03T08:31:12.549 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 460 Links: 1 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-03 08:30:19.706394581 +0000 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-03 08:19:58.166964423 +0000 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-03 08:19:58.166964423 +0000 2024-04-03T08:31:12.550 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-03 08:19:58.147964781 +0000 2024-04-03T08:31:12.550 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-03T08:31:12.653 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-03T08:31:12.653 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-03T08:31:12.653 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000175948 s, 2.9 MB/s 2024-04-03T08:31:12.656 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-03T08:31:12.702 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-04-03T08:31:12.786 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 466 Links: 1 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-03 08:30:19.706394581 +0000 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-03 08:19:58.618955907 +0000 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-03 08:19:58.618955907 +0000 2024-04-03T08:31:12.787 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-03 08:19:58.599956264 +0000 2024-04-03T08:31:12.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-03T08:31:12.891 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-03T08:31:12.891 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-03T08:31:12.891 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000172745 s, 3.0 MB/s 2024-04-03T08:31:12.894 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-03T08:31:12.940 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:31:12.940 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-04-03T08:31:12.989 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-03T08:31:12.989 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 448 Links: 1 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-03 08:31:00.278645559 +0000 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-03 08:19:57.519539401 +0000 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-03 08:19:57.519539401 +0000 2024-04-03T08:31:13.036 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-03 08:19:57.495539876 +0000 2024-04-03T08:31:13.037 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-03T08:31:13.100 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-03T08:31:13.100 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-03T08:31:13.100 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000288426 s, 1.8 MB/s 2024-04-03T08:31:13.102 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-03T08:31:13.149 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-04-03T08:31:13.234 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-03T08:31:13.234 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 454 Links: 1 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-03 08:31:00.278645559 +0000 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-03 08:19:57.992530055 +0000 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-03 08:19:57.992530055 +0000 2024-04-03T08:31:13.235 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-03 08:19:57.966530568 +0000 2024-04-03T08:31:13.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-03T08:31:13.338 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-03T08:31:13.339 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-03T08:31:13.339 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000298403 s, 1.7 MB/s 2024-04-03T08:31:13.341 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-03T08:31:13.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:13 smithi181 ceph-mon[44183]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:13.386 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 460 Links: 1 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-03 08:31:00.278645559 +0000 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-03 08:19:58.467520669 +0000 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-03 08:19:58.467520669 +0000 2024-04-03T08:31:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-03 08:19:58.444521123 +0000 2024-04-03T08:31:13.471 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-03T08:31:13.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:13 smithi157 ceph-mon[35083]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:13.573 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-03T08:31:13.573 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-03T08:31:13.573 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000291049 s, 1.8 MB/s 2024-04-03T08:31:13.575 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-03T08:31:13.621 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 466 Links: 1 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-03 08:31:00.279645539 +0000 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-03 08:19:58.942511283 +0000 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-03 08:19:58.942511283 +0000 2024-04-03T08:31:13.705 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-03 08:19:58.918511757 +0000 2024-04-03T08:31:13.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-03T08:31:13.808 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-03T08:31:13.808 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-03T08:31:13.808 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000305915 s, 1.7 MB/s 2024-04-03T08:31:13.810 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-03T08:31:13.856 INFO:tasks.cephadm:Deploying osd.0 on smithi157 with /dev/vg_nvme/lv_4... 2024-04-03T08:31:13.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-03T08:31:14.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:14.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:14.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: Reconfiguring mgr.smithi157.qfvynr (unknown last config time)... 2024-04-03T08:31:14.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:31:14.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:31:14.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:14.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:14 smithi157 ceph-mon[35083]: Reconfiguring daemon mgr.smithi157.qfvynr on smithi157 2024-04-03T08:31:14.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: Reconfiguring mgr.smithi157.qfvynr (unknown last config time)... 2024-04-03T08:31:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:31:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:31:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:14 smithi181 ceph-mon[44183]: Reconfiguring daemon mgr.smithi157.qfvynr on smithi157 2024-04-03T08:31:14.753 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:31:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:15 smithi157 ceph-mon[35083]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:31:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:15.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:15 smithi181 ceph-mon[44183]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:15.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:31:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:16 smithi157 ceph-mon[35083]: Reconfiguring crash.smithi157 (monmap changed)... 2024-04-03T08:31:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:16 smithi157 ceph-mon[35083]: Reconfiguring daemon crash.smithi157 on smithi157 2024-04-03T08:31:16.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:16 smithi181 ceph-mon[44183]: Reconfiguring crash.smithi157 (monmap changed)... 2024-04-03T08:31:16.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:16 smithi181 ceph-mon[44183]: Reconfiguring daemon crash.smithi157 on smithi157 2024-04-03T08:31:17.207 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-03T08:31:17.207 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-03T08:31:17.207 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-04-03T08:31:17.207 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-04-03T08:31:17.208 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0554483 s, 189 MB/s 2024-04-03T08:31:17.208 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-04-03T08:31:17.471 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:17 smithi157 ceph-mon[35083]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:17.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:17 smithi181 ceph-mon[44183]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:18.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2024-04-03T08:31:18.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:18 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:18.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:18 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:18.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:18 smithi157 ceph-mon[35083]: Reconfiguring alertmanager.smithi157 (dependencies changed)... 2024-04-03T08:31:18.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:18 smithi157 ceph-mon[35083]: Reconfiguring daemon alertmanager.smithi157 on smithi157 2024-04-03T08:31:18.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:18 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:18.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:18 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:18.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:18 smithi181 ceph-mon[44183]: Reconfiguring alertmanager.smithi157 (dependencies changed)... 2024-04-03T08:31:18.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:18 smithi181 ceph-mon[44183]: Reconfiguring daemon alertmanager.smithi157 on smithi157 2024-04-03T08:31:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:19 smithi157 ceph-mon[35083]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:19.700 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:31:19.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:19 smithi181 ceph-mon[44183]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:21.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:21 smithi157 ceph-mon[35083]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:21.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:21 smithi181 ceph-mon[44183]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:22.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 -- 172.21.15.157:0/1934147144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fdfe0 msgr2=0x7fd9a40fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 --2- 172.21.15.157:0/1934147144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fdfe0 0x7fd9a40fe450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd990004940 tx=0x7fd990009e30 comp rx=0 tx=0).stop 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 -- 172.21.15.157:0/1934147144 shutdown_connections 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 --2- 172.21.15.157:0/1934147144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fdfe0 0x7fd9a40fe450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 --2- 172.21.15.157:0/1934147144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9a40fce70 0x7fd9a40fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 -- 172.21.15.157:0/1934147144 >> 172.21.15.157:0/1934147144 conn(0x7fd9a40f8550 msgr2=0x7fd9a40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 -- 172.21.15.157:0/1934147144 shutdown_connections 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.813+0000 7fd9ac600700 1 -- 172.21.15.157:0/1934147144 wait complete. 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.814+0000 7fd9ac600700 1 Processor -- start 2024-04-03T08:31:22.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.814+0000 7fd9ac600700 1 -- start start 2024-04-03T08:31:22.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9ac600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 0x7fd9a410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9ac600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9a40fdfe0 0x7fd9a4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9ac600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4110680 con 0x7fd9a40fce70 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9ac600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41107f0 con 0x7fd9a40fdfe0 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 0x7fd9a410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 0x7fd9a410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57544/0 (socket says 172.21.15.157:57544) 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 -- 172.21.15.157:0/3394406064 learned_addr learned my addr 172.21.15.157:0/3394406064 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 -- 172.21.15.157:0/3394406064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9a40fdfe0 msgr2=0x7fd9a4110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9a40fdfe0 0x7fd9a4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 -- 172.21.15.157:0/3394406064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd990005040 con 0x7fd9a40fce70 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.815+0000 7fd9a9c00700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 0x7fd9a410fb40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd998002a50 tx=0x7fd9980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.816+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd998007cc0 con 0x7fd9a40fce70 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.816+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd99800f040 con 0x7fd9a40fce70 2024-04-03T08:31:22.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.816+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a4115250 con 0x7fd9a40fce70 2024-04-03T08:31:22.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.816+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd998009640 con 0x7fd9a40fce70 2024-04-03T08:31:22.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.816+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a4115810 con 0x7fd9a40fce70 2024-04-03T08:31:22.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.817+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a4101970 con 0x7fd9a40fce70 2024-04-03T08:31:22.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.818+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fd9980097a0 con 0x7fd9a40fce70 2024-04-03T08:31:22.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.818+0000 7fd9a1600700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd98c069210 0x7fd98c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:31:22.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.818+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd998085e40 con 0x7fd9a40fce70 2024-04-03T08:31:22.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.819+0000 7fd9a9200700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd98c069210 0x7fd98c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:31:22.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.819+0000 7fd9a9200700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd98c069210 0x7fd98c06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd990004f90 tx=0x7fd990009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:31:22.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:22.823+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd998056c40 con 0x7fd9a40fce70 2024-04-03T08:31:23.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:23.032+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9a402b410 con 0x7fd98c069210 2024-04-03T08:31:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:23 smithi157 ceph-mon[35083]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:31:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:31:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:23.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:23 smithi181 ceph-mon[44183]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:23.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:31:23.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:31:23.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:24.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:24 smithi157 ceph-mon[35083]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:31:24.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:24 smithi181 ceph-mon[44183]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:31:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:25 smithi157 ceph-mon[35083]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:25.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:25 smithi181 ceph-mon[44183]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:26 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:26 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:26 smithi157 ceph-mon[35083]: Reconfiguring grafana.smithi157 (dependencies changed)... 2024-04-03T08:31:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:26 smithi157 ceph-mon[35083]: Reconfiguring daemon grafana.smithi157 on smithi157 2024-04-03T08:31:27.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:26 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:27.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:26 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:27.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:26 smithi181 ceph-mon[44183]: Reconfiguring grafana.smithi157 (dependencies changed)... 2024-04-03T08:31:27.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:26 smithi181 ceph-mon[44183]: Reconfiguring daemon grafana.smithi157 on smithi157 2024-04-03T08:31:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:27 smithi157 ceph-mon[35083]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:27 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1063101731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cacd9869-4ce2-4388-ac14-9b21c32f0173"}]: dispatch 2024-04-03T08:31:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:27 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1063101731' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cacd9869-4ce2-4388-ac14-9b21c32f0173"}]': finished 2024-04-03T08:31:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:27 smithi157 ceph-mon[35083]: osdmap e6: 1 total, 0 up, 1 in 2024-04-03T08:31:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:28.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:27 smithi181 ceph-mon[44183]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:27 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1063101731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cacd9869-4ce2-4388-ac14-9b21c32f0173"}]: dispatch 2024-04-03T08:31:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:27 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1063101731' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cacd9869-4ce2-4388-ac14-9b21c32f0173"}]': finished 2024-04-03T08:31:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:27 smithi181 ceph-mon[44183]: osdmap e6: 1 total, 0 up, 1 in 2024-04-03T08:31:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:29.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:28 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3368720837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:31:29.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:28 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/3368720837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:31:30.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:29 smithi157 ceph-mon[35083]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:30.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:29 smithi181 ceph-mon[44183]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:31.032 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:31.935 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:31 smithi157 ceph-mon[35083]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:32.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:31 smithi181 ceph-mon[44183]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:33 smithi157 ceph-mon[35083]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:34.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:33 smithi181 ceph-mon[44183]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:35.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:35 smithi157 ceph-mon[35083]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:36.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:35 smithi181 ceph-mon[44183]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:38.026 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:37 smithi157 ceph-mon[35083]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:38.026 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:37 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:38.026 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:37 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:37 smithi181 ceph-mon[44183]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:37 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:37 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:38 smithi157 ceph-mon[35083]: Reconfiguring prometheus.smithi157 (dependencies changed)... 2024-04-03T08:31:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:38 smithi157 ceph-mon[35083]: Reconfiguring daemon prometheus.smithi157 on smithi157 2024-04-03T08:31:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-03T08:31:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:38 smithi181 ceph-mon[44183]: Reconfiguring prometheus.smithi157 (dependencies changed)... 2024-04-03T08:31:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:38 smithi181 ceph-mon[44183]: Reconfiguring daemon prometheus.smithi157 on smithi157 2024-04-03T08:31:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:38 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-03T08:31:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:38 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:39 smithi157 ceph-mon[35083]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:39 smithi157 ceph-mon[35083]: Deploying daemon osd.0 on smithi157 2024-04-03T08:31:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:39 smithi181 ceph-mon[44183]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:39 smithi181 ceph-mon[44183]: Deploying daemon osd.0 on smithi157 2024-04-03T08:31:42.005 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:41 smithi157 ceph-mon[35083]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:42.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:41 smithi181 ceph-mon[44183]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:43 smithi157 ceph-mon[35083]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:31:43.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:43 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:44.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:43 smithi181 ceph-mon[44183]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:43 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:43 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:43 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:31:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:43 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:44.783 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:44 smithi157 ceph-mon[35083]: Reconfiguring crash.smithi181 (monmap changed)... 2024-04-03T08:31:44.783 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:44 smithi157 ceph-mon[35083]: Reconfiguring daemon crash.smithi181 on smithi181 2024-04-03T08:31:45.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:44 smithi181 ceph-mon[44183]: Reconfiguring crash.smithi181 (monmap changed)... 2024-04-03T08:31:45.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:44 smithi181 ceph-mon[44183]: Reconfiguring daemon crash.smithi181 on smithi181 2024-04-03T08:31:45.995 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:45.996 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:45.996 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:45.996 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:45.996 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:31:45.996 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:31:45.996 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:31:46.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:47.021 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:46 smithi181 ceph-mon[44183]: Reconfiguring mgr.smithi181.mfhidq (monmap changed)... 2024-04-03T08:31:47.022 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:46 smithi181 ceph-mon[44183]: Reconfiguring daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:31:47.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:46 smithi157 ceph-mon[35083]: Reconfiguring mgr.smithi181.mfhidq (monmap changed)... 2024-04-03T08:31:47.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:46 smithi157 ceph-mon[35083]: Reconfiguring daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:31:48.018 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:47 smithi181 ceph-mon[44183]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:48.018 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:47 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:48.018 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:47 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:48.018 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:47 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:31:48.018 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:47 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:31:48.018 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:47 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:47 smithi157 ceph-mon[35083]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:31:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:31:48.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:47 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:31:48.949 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:48 smithi157 ceph-mon[35083]: Reconfiguring mon.smithi181 (monmap changed)... 2024-04-03T08:31:48.949 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:48 smithi157 ceph-mon[35083]: Reconfiguring daemon mon.smithi181 on smithi181 2024-04-03T08:31:49.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:48 smithi181 ceph-mon[44183]: Reconfiguring mon.smithi181 (monmap changed)... 2024-04-03T08:31:49.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:48 smithi181 ceph-mon[44183]: Reconfiguring daemon mon.smithi181 on smithi181 2024-04-03T08:31:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi157.front.sepia.ceph.com:9093"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:49 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi157.front.sepia.ceph.com:9093"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:49 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:50.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:50 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:31:50.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:50 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi157.front.sepia.ceph.com:9093"}]: dispatch 2024-04-03T08:31:50.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:50 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:31:50.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:50 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-04-03T08:31:50.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:50 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:31:50.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:50 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-04-03T08:31:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:50 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:31:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:50 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi157.front.sepia.ceph.com:9093"}]: dispatch 2024-04-03T08:31:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:50 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:31:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:50 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-04-03T08:31:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:50 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:31:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:50 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-04-03T08:31:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:51 smithi157 ceph-mon[35083]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:51 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:51 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:51 smithi181 ceph-mon[44183]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:51 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:51 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:54.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:53 smithi157 ceph-mon[35083]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:54.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:53 smithi157 ceph-mon[35083]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-03T08:31:54.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:53 smithi181 ceph-mon[44183]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:54.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:53 smithi181 ceph-mon[44183]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-03T08:31:54.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.524+0000 7fd9a1600700 1 -- 172.21.15.157:0/3394406064 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd9a402b410 con 0x7fd98c069210 2024-04-03T08:31:54.525 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 0 on host 'smithi157' 2024-04-03T08:31:54.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.526+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd98c069210 msgr2=0x7fd98c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:54.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.526+0000 7fd9ac600700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd98c069210 0x7fd98c06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd990004f90 tx=0x7fd990009e30 comp rx=0 tx=0).stop 2024-04-03T08:31:54.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.526+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 msgr2=0x7fd9a410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:31:54.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.526+0000 7fd9ac600700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 0x7fd9a410fb40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd998002a50 tx=0x7fd9980046b0 comp rx=0 tx=0).stop 2024-04-03T08:31:54.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 shutdown_connections 2024-04-03T08:31:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9a40fce70 0x7fd9a410fb40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd98c069210 0x7fd98c06b6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 --2- 172.21.15.157:0/3394406064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9a40fdfe0 0x7fd9a4110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:31:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 >> 172.21.15.157:0/3394406064 conn(0x7fd9a40f8550 msgr2=0x7fd9a40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:31:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 shutdown_connections 2024-04-03T08:31:54.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:31:54.527+0000 7fd9ac600700 1 -- 172.21.15.157:0/3394406064 wait complete. 2024-04-03T08:31:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-03T08:31:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: osdmap e7: 1 total, 0 up, 1 in 2024-04-03T08:31:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:31:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-04-03T08:31:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: osdmap e8: 1 total, 0 up, 1 in 2024-04-03T08:31:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:54 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:55.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-03T08:31:55.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: osdmap e7: 1 total, 0 up, 1 in 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: osdmap e8: 1 total, 0 up, 1 in 2024-04-03T08:31:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:54 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:55.685 DEBUG:teuthology.orchestra.run.smithi157:osd.0> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.0.service 2024-04-03T08:31:55.689 INFO:tasks.cephadm:Deploying osd.1 on smithi157 with /dev/vg_nvme/lv_3... 2024-04-03T08:31:55.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-03T08:31:55.764 INFO:journalctl@ceph.osd.0.smithi157.stdout:-- Logs begin at Wed 2024-04-03 08:13:04 UTC. -- 2024-04-03T08:31:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:55 smithi157 ceph-mon[35083]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:55 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:56.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:55 smithi181 ceph-mon[44183]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:56.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:55 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:56.593 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:31:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: purged_snaps scrub starts 2024-04-03T08:31:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: purged_snaps scrub ok 2024-04-03T08:31:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] boot 2024-04-03T08:31:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: osdmap e9: 1 total, 1 up, 1 in 2024-04-03T08:31:57.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:57.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:57.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:57.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:56 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:57.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: purged_snaps scrub starts 2024-04-03T08:31:57.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: purged_snaps scrub ok 2024-04-03T08:31:57.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:57.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: osd.0 [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] boot 2024-04-03T08:31:57.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: osdmap e9: 1 total, 1 up, 1 in 2024-04-03T08:31:57.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:31:57.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-03T08:31:57.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:57.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:56 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:31:58.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:57 smithi157 ceph-mon[35083]: osdmap e10: 1 total, 1 up, 1 in 2024-04-03T08:31:58.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:57 smithi181 ceph-mon[44183]: osdmap e10: 1 total, 1 up, 1 in 2024-04-03T08:31:58.997 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-03T08:31:58.998 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-03T08:31:58.998 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-04-03T08:31:58.998 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-04-03T08:31:58.998 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0401964 s, 261 MB/s 2024-04-03T08:31:58.998 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-04-03T08:31:59.034 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:31:58 smithi157 ceph-mon[35083]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:31:59.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:31:58 smithi181 ceph-mon[44183]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:00.168 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2024-04-03T08:32:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:32:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:01 smithi157 ceph-mon[35083]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:01 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:01.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:01 smithi181 ceph-mon[44183]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:01.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:01 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 -- 172.21.15.157:0/1707736920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fe0d0 msgr2=0x7f41600fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 --2- 172.21.15.157:0/1707736920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fe0d0 0x7f41600fe540 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f414c004940 tx=0x7f414c009e30 comp rx=0 tx=0).stop 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 -- 172.21.15.157:0/1707736920 shutdown_connections 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 --2- 172.21.15.157:0/1707736920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fe0d0 0x7f41600fe540 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 --2- 172.21.15.157:0/1707736920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fcee0 0x7f41600fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 -- 172.21.15.157:0/1707736920 >> 172.21.15.157:0/1707736920 conn(0x7f41600f8560 msgr2=0x7f41600fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:32:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 -- 172.21.15.157:0/1707736920 shutdown_connections 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.930+0000 7f4167c00700 1 -- 172.21.15.157:0/1707736920 wait complete. 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.931+0000 7f4167c00700 1 Processor -- start 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.931+0000 7f4167c00700 1 -- start start 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.931+0000 7f4167c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 0x7f4160071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.931+0000 7f4167c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fe0d0 0x7f4160070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.931+0000 7f4167c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600708a0 con 0x7f41600fcee0 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.931+0000 7f4167c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600709e0 con 0x7f41600fe0d0 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 0x7f4160071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 0x7f4160071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37350/0 (socket says 172.21.15.157:37350) 2024-04-03T08:32:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 -- 172.21.15.157:0/2469054387 learned_addr learned my addr 172.21.15.157:0/2469054387 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 -- 172.21.15.157:0/2469054387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fe0d0 msgr2=0x7f4160070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f415fe00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fe0d0 0x7f4160070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fe0d0 0x7f4160070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 -- 172.21.15.157:0/2469054387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c005040 con 0x7f41600fcee0 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f415fe00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fe0d0 0x7f4160070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f4165200700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 0x7f4160071dd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f415400c8b0 tx=0x7f4154004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.932+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f415400a760 con 0x7f41600fcee0 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.933+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4160070c90 con 0x7f41600fcee0 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.933+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f415400ad90 con 0x7f41600fcee0 2024-04-03T08:32:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.933+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41540113a0 con 0x7f41600fcee0 2024-04-03T08:32:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.933+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160115af0 con 0x7f41600fcee0 2024-04-03T08:32:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.934+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416005f5f0 con 0x7f41600fcee0 2024-04-03T08:32:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.935+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f4154012400 con 0x7f41600fcee0 2024-04-03T08:32:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.935+0000 7f415cc00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f4148069210 0x7f414806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:32:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.935+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f4154086400 con 0x7f41600fcee0 2024-04-03T08:32:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.936+0000 7f415fe00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f4148069210 0x7f414806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:32:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.936+0000 7f415fe00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f4148069210 0x7f414806b6c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f414c00b7a0 tx=0x7f414c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:32:02.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:02.940+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4154053510 con 0x7f41600fcee0 2024-04-03T08:32:03.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:03.150+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f41601024e0 con 0x7f4148069210 2024-04-03T08:32:03.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:03 smithi157 ceph-mon[35083]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:03.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:03 smithi181 ceph-mon[44183]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:32:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:32:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:32:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: Detected new or changed devices on smithi157 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi157 to 13046M 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:04.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: Detected new or changed devices on smithi157 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi157 to 13046M 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:04.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:05.513 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:05 smithi157 ceph-mon[35083]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:05.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:05 smithi181 ceph-mon[44183]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:06 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1746483952' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6"}]: dispatch 2024-04-03T08:32:07.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:06 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1746483952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6"}]': finished 2024-04-03T08:32:07.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:06 smithi157 ceph-mon[35083]: osdmap e11: 2 total, 1 up, 2 in 2024-04-03T08:32:07.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:07.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:07.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:07.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:06 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1746483952' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6"}]: dispatch 2024-04-03T08:32:07.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:06 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1746483952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6"}]': finished 2024-04-03T08:32:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:06 smithi181 ceph-mon[44183]: osdmap e11: 2 total, 1 up, 2 in 2024-04-03T08:32:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:07.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:07 smithi157 ceph-mon[35083]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:07.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:07 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1229061517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:32:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:07 smithi181 ceph-mon[44183]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:07 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1229061517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:32:10.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:09 smithi157 ceph-mon[35083]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:10.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:09 smithi181 ceph-mon[44183]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:11.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:11.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:11.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:11.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:11.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:11.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:11 smithi157 ceph-mon[35083]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:11 smithi181 ceph-mon[44183]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:14.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:13 smithi157 ceph-mon[35083]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:13 smithi181 ceph-mon[44183]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:15.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-03T08:32:15.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:14 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:15.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-03T08:32:15.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:14 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:15 smithi157 ceph-mon[35083]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:15 smithi157 ceph-mon[35083]: Deploying daemon osd.1 on smithi157 2024-04-03T08:32:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:15 smithi181 ceph-mon[44183]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:15 smithi181 ceph-mon[44183]: Deploying daemon osd.1 on smithi157 2024-04-03T08:32:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:18.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:17 smithi157 ceph-mon[35083]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:18.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:17 smithi181 ceph-mon[44183]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:20.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:19 smithi157 ceph-mon[35083]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:20.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:19 smithi181 ceph-mon[44183]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:21.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:21 smithi157 ceph-mon[35083]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:21.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:21 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:21.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:21 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:21.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:21 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:22.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:21 smithi181 ceph-mon[44183]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:22.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:21 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:22.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:21 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:22.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:21 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:24.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:23 smithi157 ceph-mon[35083]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:24.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:24.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:24.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:23 smithi181 ceph-mon[44183]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:24.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:24.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:25.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:24 smithi157 ceph-mon[35083]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-03T08:32:25.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:24 smithi181 ceph-mon[44183]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-03T08:32:25.116 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 1 on host 'smithi157' 2024-04-03T08:32:25.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.115+0000 7f415cc00700 1 -- 172.21.15.157:0/2469054387 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f41601024e0 con 0x7f4148069210 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.118+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f4148069210 msgr2=0x7f414806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.118+0000 7f4167c00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f4148069210 0x7f414806b6c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f414c00b7a0 tx=0x7f414c009e30 comp rx=0 tx=0).stop 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.118+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 msgr2=0x7f4160071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.118+0000 7f4167c00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 0x7f4160071dd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f415400c8b0 tx=0x7f4154004470 comp rx=0 tx=0).stop 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 shutdown_connections 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41600fcee0 0x7f4160071dd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f4148069210 0x7f414806b6c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:25.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 --2- 172.21.15.157:0/2469054387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41600fe0d0 0x7f4160070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:25.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 >> 172.21.15.157:0/2469054387 conn(0x7f41600f8560 msgr2=0x7f41600f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:32:25.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 shutdown_connections 2024-04-03T08:32:25.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:25.119+0000 7f4167c00700 1 -- 172.21.15.157:0/2469054387 wait complete. 2024-04-03T08:32:26.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:26.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-03T08:32:26.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: osdmap e12: 2 total, 1 up, 2 in 2024-04-03T08:32:26.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:26.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:32:26.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:26.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:26.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:26.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-03T08:32:26.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: osdmap e12: 2 total, 1 up, 2 in 2024-04-03T08:32:26.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:26.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:32:26.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:26.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:26.195 DEBUG:teuthology.orchestra.run.smithi157:osd.1> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.1.service 2024-04-03T08:32:26.199 INFO:tasks.cephadm:Deploying osd.2 on smithi157 with /dev/vg_nvme/lv_2... 2024-04-03T08:32:26.199 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-03T08:32:26.277 INFO:journalctl@ceph.osd.1.smithi157.stdout:-- Logs begin at Wed 2024-04-03 08:13:04 UTC. -- 2024-04-03T08:32:26.820 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:32:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:26 smithi157 ceph-mon[35083]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-04-03T08:32:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:26 smithi157 ceph-mon[35083]: osdmap e13: 2 total, 1 up, 2 in 2024-04-03T08:32:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:26 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:26 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:27.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:26 smithi181 ceph-mon[44183]: from='osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-04-03T08:32:27.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:26 smithi181 ceph-mon[44183]: osdmap e13: 2 total, 1 up, 2 in 2024-04-03T08:32:27.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:26 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:27.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:26 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:28.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:27 smithi157 ceph-mon[35083]: purged_snaps scrub starts 2024-04-03T08:32:28.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:27 smithi157 ceph-mon[35083]: purged_snaps scrub ok 2024-04-03T08:32:28.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:27 smithi157 ceph-mon[35083]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:28.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:27 smithi157 ceph-mon[35083]: osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] boot 2024-04-03T08:32:28.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:27 smithi157 ceph-mon[35083]: osdmap e14: 2 total, 2 up, 2 in 2024-04-03T08:32:28.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:28.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:27 smithi181 ceph-mon[44183]: purged_snaps scrub starts 2024-04-03T08:32:28.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:27 smithi181 ceph-mon[44183]: purged_snaps scrub ok 2024-04-03T08:32:28.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:27 smithi181 ceph-mon[44183]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-03T08:32:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:27 smithi181 ceph-mon[44183]: osd.1 [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] boot 2024-04-03T08:32:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:27 smithi181 ceph-mon[44183]: osdmap e14: 2 total, 2 up, 2 in 2024-04-03T08:32:28.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:32:29.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:28 smithi157 ceph-mon[35083]: osdmap e15: 2 total, 2 up, 2 in 2024-04-03T08:32:29.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:28 smithi181 ceph-mon[44183]: osdmap e15: 2 total, 2 up, 2 in 2024-04-03T08:32:29.862 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-03T08:32:29.862 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-03T08:32:29.862 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-04-03T08:32:29.862 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-04-03T08:32:29.862 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0553722 s, 189 MB/s 2024-04-03T08:32:29.863 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 2024-04-03T08:32:29.863 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-04-03T08:32:30.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:29 smithi157 ceph-mon[35083]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:30.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:29 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:30.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:29 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:30.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:29 smithi181 ceph-mon[44183]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:30.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:29 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:30.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:29 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:31.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:31.018 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2024-04-03T08:32:31.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:31.549 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:32:32.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:31 smithi157 ceph-mon[35083]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:32.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:31 smithi181 ceph-mon[44183]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:33.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.629+0000 7f5519400700 1 -- 172.21.15.157:0/2424495114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 msgr2=0x7f55140fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.629+0000 7f5519400700 1 --2- 172.21.15.157:0/2424495114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f55140fd290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5504004940 tx=0x7f5504009e30 comp rx=0 tx=0).stop 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.629+0000 7f5519400700 1 -- 172.21.15.157:0/2424495114 shutdown_connections 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.629+0000 7f5519400700 1 --2- 172.21.15.157:0/2424495114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55140fdff0 0x7f55140fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.629+0000 7f5519400700 1 --2- 172.21.15.157:0/2424495114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f55140fd290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.629+0000 7f5519400700 1 -- 172.21.15.157:0/2424495114 >> 172.21.15.157:0/2424495114 conn(0x7f55140f8540 msgr2=0x7f55140fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.630+0000 7f5519400700 1 -- 172.21.15.157:0/2424495114 shutdown_connections 2024-04-03T08:32:33.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.630+0000 7f5519400700 1 -- 172.21.15.157:0/2424495114 wait complete. 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.631+0000 7f5519400700 1 Processor -- start 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.631+0000 7f5519400700 1 -- start start 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.631+0000 7f5519400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f551410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.631+0000 7f5519400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55140fdff0 0x7f5514110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.631+0000 7f5519400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514110760 con 0x7f55140fce80 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.631+0000 7f5519400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514110fb0 con 0x7f55140fdff0 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f551410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f551410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59512/0 (socket says 172.21.15.157:59512) 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 -- 172.21.15.157:0/3092750086 learned_addr learned my addr 172.21.15.157:0/3092750086 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:32:33.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f550be00700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55140fdff0 0x7f5514110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 -- 172.21.15.157:0/3092750086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55140fdff0 msgr2=0x7f5514110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55140fdff0 0x7f5514110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 -- 172.21.15.157:0/3092750086 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504005040 con 0x7f55140fce80 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f5512800700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f551410fc20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5504013870 tx=0x7f5504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.632+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f550400e070 con 0x7f55140fce80 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.633+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5514111230 con 0x7f55140fce80 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.633+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5504013de0 con 0x7f55140fce80 2024-04-03T08:32:33.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.633+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f550401cea0 con 0x7f55140fce80 2024-04-03T08:32:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.633+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5514111710 con 0x7f55140fce80 2024-04-03T08:32:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.634+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5514101980 con 0x7f55140fce80 2024-04-03T08:32:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.635+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f550401c690 con 0x7f55140fce80 2024-04-03T08:32:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.635+0000 7f550aa00700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f54f8069210 0x7f54f806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:32:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.636+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f5504087c30 con 0x7f55140fce80 2024-04-03T08:32:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.636+0000 7f550be00700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f54f8069210 0x7f54f806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:32:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.636+0000 7f550be00700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f54f8069210 0x7f54f806b6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009b80 tx=0x7f54fc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:32:33.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.642+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5504058620 con 0x7f55140fce80 2024-04-03T08:32:33.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:33.856+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5514105a50 con 0x7f54f8069210 2024-04-03T08:32:34.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:33 smithi157 ceph-mon[35083]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:34.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:33 smithi181 ceph-mon[44183]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:32:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:35.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:35.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:35.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:35.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:36.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:35 smithi157 ceph-mon[35083]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:32:36.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:35 smithi157 ceph-mon[35083]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:36.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:35 smithi157 ceph-mon[35083]: Detected new or changed devices on smithi157 2024-04-03T08:32:36.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:35 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi157 to 6523M 2024-04-03T08:32:36.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:35 smithi181 ceph-mon[44183]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:32:36.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:35 smithi181 ceph-mon[44183]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:36.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:35 smithi181 ceph-mon[44183]: Detected new or changed devices on smithi157 2024-04-03T08:32:36.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:35 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi157 to 6523M 2024-04-03T08:32:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:37 smithi157 ceph-mon[35083]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:37 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1273534072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763d371a-2aa7-44e2-8557-952c67342744"}]: dispatch 2024-04-03T08:32:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:37 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1273534072' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763d371a-2aa7-44e2-8557-952c67342744"}]': finished 2024-04-03T08:32:38.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:37 smithi157 ceph-mon[35083]: osdmap e16: 3 total, 2 up, 3 in 2024-04-03T08:32:38.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:37 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:37 smithi181 ceph-mon[44183]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:38.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:37 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1273534072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763d371a-2aa7-44e2-8557-952c67342744"}]: dispatch 2024-04-03T08:32:38.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:37 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1273534072' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763d371a-2aa7-44e2-8557-952c67342744"}]': finished 2024-04-03T08:32:38.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:37 smithi181 ceph-mon[44183]: osdmap e16: 3 total, 2 up, 3 in 2024-04-03T08:32:38.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:37 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1258413869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:32:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:38 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1258413869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:32:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:39 smithi157 ceph-mon[35083]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:39 smithi181 ceph-mon[44183]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:41.678 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:41 smithi157 ceph-mon[35083]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:41.678 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:41.679 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:41.679 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:41.679 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:41.679 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:41 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:41.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:41 smithi181 ceph-mon[44183]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:41 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:41 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:41 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:41 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:32:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:41 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:43.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:43 smithi181 ceph-mon[44183]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:44.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:43 smithi157 ceph-mon[35083]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:45.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:45 smithi181 ceph-mon[44183]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:45.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:45.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-03T08:32:45.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:46.056 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:45 smithi157 ceph-mon[35083]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:46.056 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:32:46.056 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-03T08:32:46.056 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:32:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:46 smithi157 ceph-mon[35083]: Deploying daemon osd.2 on smithi157 2024-04-03T08:32:47.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:46 smithi181 ceph-mon[44183]: Deploying daemon osd.2 on smithi157 2024-04-03T08:32:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:47 smithi157 ceph-mon[35083]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:48.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:47 smithi181 ceph-mon[44183]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:49 smithi157 ceph-mon[35083]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:50.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:49 smithi181 ceph-mon[44183]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:51.870 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:51 smithi157 ceph-mon[35083]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:51 smithi181 ceph-mon[44183]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:52 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:52 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:52 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:52 smithi157 ceph-mon[35083]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:53.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:52 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:52 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:52 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:32:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:52 smithi181 ceph-mon[44183]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:55.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:55 smithi157 ceph-mon[35083]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:55.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:55 smithi181 ceph-mon[44183]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:56 smithi157 ceph-mon[35083]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-03T08:32:56.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:56 smithi181 ceph-mon[44183]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-03T08:32:56.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.367+0000 7f550aa00700 1 -- 172.21.15.157:0/3092750086 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5514105a50 con 0x7f54f8069210 2024-04-03T08:32:56.368 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 2 on host 'smithi157' 2024-04-03T08:32:56.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f54f8069210 msgr2=0x7f54f806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:56.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f54f8069210 0x7f54f806b6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009b80 tx=0x7f54fc00b040 comp rx=0 tx=0).stop 2024-04-03T08:32:56.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 msgr2=0x7f551410fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:32:56.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f551410fc20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5504013870 tx=0x7f5504009e30 comp rx=0 tx=0).stop 2024-04-03T08:32:56.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 shutdown_connections 2024-04-03T08:32:56.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55140fce80 0x7f551410fc20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:56.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f54f8069210 0x7f54f806b6c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:56.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 --2- 172.21.15.157:0/3092750086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55140fdff0 0x7f5514110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:32:56.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 >> 172.21.15.157:0/3092750086 conn(0x7f55140f8540 msgr2=0x7f55140f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:32:56.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 shutdown_connections 2024-04-03T08:32:56.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:32:56.370+0000 7f5519400700 1 -- 172.21.15.157:0/3092750086 wait complete. 2024-04-03T08:32:57.181 DEBUG:teuthology.orchestra.run.smithi157:osd.2> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.2.service 2024-04-03T08:32:57.185 INFO:tasks.cephadm:Deploying osd.3 on smithi181 with /dev/vg_nvme/lv_4... 2024-04-03T08:32:57.185 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-03T08:32:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-03T08:32:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: osdmap e17: 3 total, 2 up, 3 in 2024-04-03T08:32:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:32:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:57.254 INFO:journalctl@ceph.osd.2.smithi157.stdout:-- Logs begin at Wed 2024-04-03 08:13:04 UTC. -- 2024-04-03T08:32:57.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:57.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-03T08:32:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: osdmap e17: 3 total, 2 up, 3 in 2024-04-03T08:32:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:32:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:32:57.600 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:32:58.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:58 smithi181 ceph-mon[44183]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-04-03T08:32:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:58 smithi181 ceph-mon[44183]: osdmap e18: 3 total, 2 up, 3 in 2024-04-03T08:32:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:58 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:58 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:58 smithi157 ceph-mon[35083]: from='osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-04-03T08:32:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:58 smithi157 ceph-mon[35083]: osdmap e18: 3 total, 2 up, 3 in 2024-04-03T08:32:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:58 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:58 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:59.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:59 smithi181 ceph-mon[44183]: purged_snaps scrub starts 2024-04-03T08:32:59.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:59 smithi181 ceph-mon[44183]: purged_snaps scrub ok 2024-04-03T08:32:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:59 smithi181 ceph-mon[44183]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:59 smithi181 ceph-mon[44183]: osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] boot 2024-04-03T08:32:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:59 smithi181 ceph-mon[44183]: osdmap e19: 3 total, 3 up, 3 in 2024-04-03T08:32:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:32:59 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:32:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:59 smithi157 ceph-mon[35083]: purged_snaps scrub starts 2024-04-03T08:32:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:59 smithi157 ceph-mon[35083]: purged_snaps scrub ok 2024-04-03T08:32:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:59 smithi157 ceph-mon[35083]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-03T08:32:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:59 smithi157 ceph-mon[35083]: osd.2 [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] boot 2024-04-03T08:32:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:59 smithi157 ceph-mon[35083]: osdmap e19: 3 total, 3 up, 3 in 2024-04-03T08:32:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:32:59 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:33:00.243 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-03T08:33:00.243 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-03T08:33:00.243 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-04-03T08:33:00.243 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-04-03T08:33:00.243 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0308573 s, 340 MB/s 2024-04-03T08:33:00.243 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-04-03T08:33:00.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:00 smithi181 ceph-mon[44183]: osdmap e20: 3 total, 3 up, 3 in 2024-04-03T08:33:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:00.923 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-04-03T08:33:01.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:00 smithi157 ceph-mon[35083]: osdmap e20: 3 total, 3 up, 3 in 2024-04-03T08:33:01.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:01.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:01.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:01.329 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:33:01.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:01 smithi181 ceph-mon[44183]: pgmap v83: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:01.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:01 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-03T08:33:01.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:01 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-03T08:33:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:01 smithi181 ceph-mon[44183]: osdmap e21: 3 total, 3 up, 3 in 2024-04-03T08:33:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:01 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-03T08:33:01.936 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:01 smithi157 ceph-mon[35083]: pgmap v83: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:01.936 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:01 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-03T08:33:01.936 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:01 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-03T08:33:01.936 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:01 smithi157 ceph-mon[35083]: osdmap e21: 3 total, 3 up, 3 in 2024-04-03T08:33:01.936 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:01 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-03T08:33:02.797 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:02 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-03T08:33:02.797 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:02 smithi181 ceph-mon[44183]: osdmap e22: 3 total, 3 up, 3 in 2024-04-03T08:33:03.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:02 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-03T08:33:03.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:02 smithi157 ceph-mon[35083]: osdmap e22: 3 total, 3 up, 3 in 2024-04-03T08:33:03.065 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:02 smithi157 sudo[80326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-03T08:33:03.065 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:02 smithi157 sudo[80326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:03.065 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:02 smithi157 sudo[80326]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:03.065 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:02 smithi157 sudo[80326]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:03.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 -- 172.21.15.181:0/1556401216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fe0d0 msgr2=0x7f5ce80fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:03.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 --2- 172.21.15.181:0/1556401216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fe0d0 0x7f5ce80fe540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4004970 tx=0x7f5cd4009e30 comp rx=0 tx=0).stop 2024-04-03T08:33:03.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 -- 172.21.15.181:0/1556401216 shutdown_connections 2024-04-03T08:33:03.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 --2- 172.21.15.181:0/1556401216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fe0d0 0x7f5ce80fe540 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:03.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 --2- 172.21.15.181:0/1556401216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce80fcee0 0x7f5ce80fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:03.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 -- 172.21.15.181:0/1556401216 >> 172.21.15.181:0/1556401216 conn(0x7f5ce80f8560 msgr2=0x7f5ce80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:33:03.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 -- 172.21.15.181:0/1556401216 shutdown_connections 2024-04-03T08:33:03.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.075+0000 7f5cef200700 1 -- 172.21.15.181:0/1556401216 wait complete. 2024-04-03T08:33:03.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.076+0000 7f5cef200700 1 Processor -- start 2024-04-03T08:33:03.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.076+0000 7f5cef200700 1 -- start start 2024-04-03T08:33:03.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5cef200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 0x7f5ce810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:33:03.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5cef200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce80fe0d0 0x7f5ce810df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:33:03.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5cef200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce810e540 con 0x7f5ce80fe0d0 2024-04-03T08:33:03.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5cef200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce810ed40 con 0x7f5ce80fcee0 2024-04-03T08:33:03.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 0x7f5ce810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:33:03.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 0x7f5ce810da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46100/0 (socket says 172.21.15.181:46100) 2024-04-03T08:33:03.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 -- 172.21.15.181:0/3751202049 learned_addr learned my addr 172.21.15.181:0/3751202049 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:33:03.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7400700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce80fe0d0 0x7f5ce810df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 -- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce80fe0d0 msgr2=0x7f5ce810df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce80fe0d0 0x7f5ce810df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 -- 172.21.15.181:0/3751202049 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4005040 con 0x7f5ce80fcee0 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.077+0000 7f5ce7e00700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 0x7f5ce810da00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800eb70 tx=0x7f5cd800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.078+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd8007cc0 con 0x7f5ce80fcee0 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.078+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cd800f040 con 0x7f5ce80fcee0 2024-04-03T08:33:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.078+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd800cb20 con 0x7f5ce80fcee0 2024-04-03T08:33:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.078+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce810efc0 con 0x7f5ce80fcee0 2024-04-03T08:33:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.078+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce810f500 con 0x7f5ce80fcee0 2024-04-03T08:33:03.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.079+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce805f5f0 con 0x7f5ce80fcee0 2024-04-03T08:33:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.080+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f5cd800cc80 con 0x7f5ce80fcee0 2024-04-03T08:33:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.080+0000 7f5cdfe00700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5ccc069210 0x7f5ccc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:33:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.081+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f5cd8086200 con 0x7f5ce80fcee0 2024-04-03T08:33:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.081+0000 7f5ce7400700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5ccc069210 0x7f5ccc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:33:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.081+0000 7f5ce7400700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5ccc069210 0x7f5ccc06b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400b790 tx=0x7f5cd4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:33:03.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.085+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5cd804e190 con 0x7f5ce80fcee0 2024-04-03T08:33:03.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:03.287+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ce810f8e0 con 0x7f5ccc069210 2024-04-03T08:33:03.564 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[80353]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-03T08:33:03.564 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[80353]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:03.564 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[80353]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:03.564 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[80353]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:04.051 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:03 smithi181 ceph-mon[44183]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:04.051 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:03 smithi181 ceph-mon[44183]: osdmap e23: 3 total, 3 up, 3 in 2024-04-03T08:33:04.051 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:03 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:04.051 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:03 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:33:04.051 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:03 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:33:04.051 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:03 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:03 smithi157 ceph-mon[35083]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:03 smithi157 ceph-mon[35083]: osdmap e23: 3 total, 3 up, 3 in 2024-04-03T08:33:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:03 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:04.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:03 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:33:04.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:03 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:33:04.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:03 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:04.065 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[83382]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-03T08:33:04.065 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[83382]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:04.065 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[83382]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:04.065 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:03 smithi157 sudo[83382]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:04.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83595]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-03T08:33:04.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83595]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:04.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83595]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:04.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83595]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:04.668+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5cd80532b0 con 0x7f5ce80fcee0 2024-04-03T08:33:04.921 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:04 smithi157 ceph-mon[35083]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:33:04.921 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:04.921 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:04.921 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:04.921 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:04 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:05.002 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:04 smithi181 ceph-mon[44183]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:33:05.002 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:05.002 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:05.003 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:05.003 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:04 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:05.314 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83636]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-03T08:33:05.314 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83636]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:05.314 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83636]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:05.314 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:04 smithi157 sudo[83636]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:05.814 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:05 smithi157 sudo[83760]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-03T08:33:05.814 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:05 smithi157 sudo[83760]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:05.814 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:05 smithi157 sudo[83760]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:05.814 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:33:05 smithi157 sudo[83760]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-03T08:33:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83830]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83830]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:06.873 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83915]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83915]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83915]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 sudo[83915]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: Detected new or changed devices on smithi157 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi157 to 4348M 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: mgrmap e19: smithi157.qfvynr(active, since 2m), standbys: smithi181.mfhidq 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:06.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:06.875 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:06.875 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:06.875 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:06.875 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:06 smithi157 ceph-mon[35083]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: Detected new or changed devices on smithi157 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi157 to 4348M 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: mgrmap e19: smithi157.qfvynr(active, since 2m), standbys: smithi181.mfhidq 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:07.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:07.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:06 smithi181 ceph-mon[44183]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-03T08:33:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48204]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-03T08:33:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48204]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48204]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48204]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: pgmap v89: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3080134728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "287ca3f3-1f42-4c40-bf6c-13d05fa77363"}]: dispatch 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "287ca3f3-1f42-4c40-bf6c-13d05fa77363"}]: dispatch 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:33:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "287ca3f3-1f42-4c40-bf6c-13d05fa77363"}]': finished 2024-04-03T08:33:08.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: osdmap e24: 4 total, 3 up, 4 in 2024-04-03T08:33:08.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:08.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:33:08.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:07 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:33:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48207]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-03T08:33:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48207]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-03T08:33:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48207]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 sudo[48207]: pam_unix(sudo:session): session closed for user root 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: pgmap v89: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/3080134728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "287ca3f3-1f42-4c40-bf6c-13d05fa77363"}]: dispatch 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "287ca3f3-1f42-4c40-bf6c-13d05fa77363"}]: dispatch 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "287ca3f3-1f42-4c40-bf6c-13d05fa77363"}]': finished 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: osdmap e24: 4 total, 3 up, 4 in 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:33:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:07 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:33:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:08 smithi157 ceph-mon[35083]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-03T08:33:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:08 smithi157 ceph-mon[35083]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-03T08:33:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:08 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/2258121246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:33:09.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:08 smithi181 ceph-mon[44183]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-03T08:33:09.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:08 smithi181 ceph-mon[44183]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-03T08:33:09.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:09.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:08 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/2258121246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:33:10.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:09 smithi157 ceph-mon[35083]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 6.7 KiB/s rd, 326 KiB/s wr, 22 op/s 2024-04-03T08:33:10.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:09 smithi181 ceph-mon[44183]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 6.7 KiB/s rd, 326 KiB/s wr, 22 op/s 2024-04-03T08:33:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:11 smithi157 ceph-mon[35083]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-04-03T08:33:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:11 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:11.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:11 smithi181 ceph-mon[44183]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-04-03T08:33:11.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:11.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:11 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:13.457 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:13 smithi181 ceph-mon[44183]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-04-03T08:33:13.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:13 smithi157 ceph-mon[35083]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-04-03T08:33:15.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:15 smithi181 ceph-mon[44183]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-03T08:33:15.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:15 smithi157 ceph-mon[35083]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-03T08:33:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:16.436 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-03T08:33:16.436 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:16.436 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:16 smithi181 ceph-mon[44183]: Deploying daemon osd.3 on smithi181 2024-04-03T08:33:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-03T08:33:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:16 smithi157 ceph-mon[35083]: Deploying daemon osd.3 on smithi181 2024-04-03T08:33:17.301 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:17 smithi181 ceph-mon[44183]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-03T08:33:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:17 smithi157 ceph-mon[35083]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-03T08:33:19.522 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:19 smithi181 ceph-mon[44183]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.4 KiB/s rd, 115 KiB/s wr, 7 op/s 2024-04-03T08:33:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:19 smithi157 ceph-mon[35083]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.4 KiB/s rd, 115 KiB/s wr, 7 op/s 2024-04-03T08:33:21.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:21 smithi181 ceph-mon[44183]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:21.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:21 smithi157 ceph-mon[35083]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:23 smithi181 ceph-mon[44183]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:23.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:23.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:23 smithi157 ceph-mon[35083]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:25.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:25 smithi181 ceph-mon[44183]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:25 smithi157 ceph-mon[35083]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:26.194 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:26 smithi181 ceph-mon[44183]: from='osd.3 [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:33:26.194 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:26 smithi181 ceph-mon[44183]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:33:26.262 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 3 on host 'smithi181' 2024-04-03T08:33:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.261+0000 7f5cdfe00700 1 -- 172.21.15.181:0/3751202049 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5ce810f8e0 con 0x7f5ccc069210 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5ccc069210 msgr2=0x7f5ccc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5ccc069210 0x7f5ccc06b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400b790 tx=0x7f5cd4009e30 comp rx=0 tx=0).stop 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 msgr2=0x7f5ce810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 0x7f5ce810da00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800eb70 tx=0x7f5cd800b040 comp rx=0 tx=0).stop 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 shutdown_connections 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5ccc069210 0x7f5ccc06b6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce80fcee0 0x7f5ce810da00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 --2- 172.21.15.181:0/3751202049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce80fe0d0 0x7f5ce810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.264+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 >> 172.21.15.181:0/3751202049 conn(0x7f5ce80f8560 msgr2=0x7f5ce80f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.265+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 shutdown_connections 2024-04-03T08:33:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:26.265+0000 7f5cef200700 1 -- 172.21.15.181:0/3751202049 wait complete. 2024-04-03T08:33:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:26 smithi157 ceph-mon[35083]: from='osd.3 [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:33:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:26 smithi157 ceph-mon[35083]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:33:26.930 DEBUG:teuthology.orchestra.run.smithi181:osd.3> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.3.service 2024-04-03T08:33:26.934 INFO:tasks.cephadm:Deploying osd.4 on smithi181 with /dev/vg_nvme/lv_3... 2024-04-03T08:33:26.934 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-03T08:33:27.012 INFO:journalctl@ceph.osd.3.smithi181.stdout:-- Logs begin at Wed 2024-04-03 08:12:25 UTC. -- 2024-04-03T08:33:27.176 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[50534]: 2024-04-03T08:33:27.089+0000 7efd02000700 -1 osd.3 0 waiting for initial osdmap 2024-04-03T08:33:27.176 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[50534]: 2024-04-03T08:33:27.097+0000 7efcfe400700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: osdmap e25: 4 total, 3 up, 4 in 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='osd.3 [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:27 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-03T08:33:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: osdmap e25: 4 total, 3 up, 4 in 2024-04-03T08:33:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='osd.3 [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:27 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:33:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:28 smithi181 ceph-mon[44183]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-04-03T08:33:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:28 smithi181 ceph-mon[44183]: osdmap e26: 4 total, 3 up, 4 in 2024-04-03T08:33:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:28 smithi157 ceph-mon[35083]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-04-03T08:33:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:28 smithi157 ceph-mon[35083]: osdmap e26: 4 total, 3 up, 4 in 2024-04-03T08:33:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:29.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: purged_snaps scrub starts 2024-04-03T08:33:29.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: purged_snaps scrub ok 2024-04-03T08:33:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: osd.3 [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] boot 2024-04-03T08:33:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: osdmap e27: 4 total, 4 up, 4 in 2024-04-03T08:33:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:29 smithi181 ceph-mon[44183]: osdmap e28: 4 total, 4 up, 4 in 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: purged_snaps scrub starts 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: purged_snaps scrub ok 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: osd.3 [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] boot 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: osdmap e27: 4 total, 4 up, 4 in 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:33:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:29 smithi157 ceph-mon[35083]: osdmap e28: 4 total, 4 up, 4 in 2024-04-03T08:33:30.726 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-03T08:33:30.726 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-03T08:33:30.726 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-04-03T08:33:30.726 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-04-03T08:33:30.726 INFO:teuthology.orchestra.run.smithi181.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0548467 s, 191 MB/s 2024-04-03T08:33:30.726 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-04-03T08:33:31.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:30 smithi157 ceph-mon[35083]: osdmap e29: 4 total, 4 up, 4 in 2024-04-03T08:33:31.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:30 smithi181 ceph-mon[44183]: osdmap e29: 4 total, 4 up, 4 in 2024-04-03T08:33:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:31.555 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-04-03T08:33:31.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:31 smithi181 ceph-mon[44183]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:31.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:31 smithi181 ceph-mon[44183]: osdmap e30: 4 total, 4 up, 4 in 2024-04-03T08:33:31.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:31 smithi157 ceph-mon[35083]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:31.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:31 smithi157 ceph-mon[35083]: osdmap e30: 4 total, 4 up, 4 in 2024-04-03T08:33:32.365 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: osdmap e31: 4 total, 4 up, 4 in 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:33.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:33.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:33.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:33.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:32 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: osdmap e31: 4 total, 4 up, 4 in 2024-04-03T08:33:33.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:33:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:32 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:33.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:33 smithi181 ceph-mon[44183]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:33.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:33 smithi181 ceph-mon[44183]: Detected new or changed devices on smithi181 2024-04-03T08:33:33.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:33 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi181 to 16118M 2024-04-03T08:33:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:33 smithi157 ceph-mon[35083]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:33 smithi157 ceph-mon[35083]: Detected new or changed devices on smithi181 2024-04-03T08:33:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:33 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi181 to 16118M 2024-04-03T08:33:34.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 -- 172.21.15.181:0/2911470535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fcc10 msgr2=0x7fe6840fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:34.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 --2- 172.21.15.181:0/2911470535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fcc10 0x7fe6840fd020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe674004940 tx=0x7fe674009e30 comp rx=0 tx=0).stop 2024-04-03T08:33:34.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 -- 172.21.15.181:0/2911470535 shutdown_connections 2024-04-03T08:33:34.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 --2- 172.21.15.181:0/2911470535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6840fdec0 0x7fe6840fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:34.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 --2- 172.21.15.181:0/2911470535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fcc10 0x7fe6840fd020 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:34.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 -- 172.21.15.181:0/2911470535 >> 172.21.15.181:0/2911470535 conn(0x7fe6840f83d0 msgr2=0x7fe6840fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:33:34.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 -- 172.21.15.181:0/2911470535 shutdown_connections 2024-04-03T08:33:34.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.269+0000 7fe689200700 1 -- 172.21.15.181:0/2911470535 wait complete. 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe689200700 1 Processor -- start 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe689200700 1 -- start start 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe689200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6840fcc10 0x7fe68410f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe689200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 0x7fe68410ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe689200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684110520 con 0x7fe6840fcc10 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe689200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684110d70 con 0x7fe6840fdec0 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe682a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 0x7fe68410ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe682a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 0x7fe68410ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33056/0 (socket says 172.21.15.181:33056) 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.270+0000 7fe682a00700 1 -- 172.21.15.181:0/2895585821 learned_addr learned my addr 172.21.15.181:0/2895585821 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe683400700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6840fcc10 0x7fe68410f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe682a00700 1 -- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6840fcc10 msgr2=0x7fe68410f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:34.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe682a00700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6840fcc10 0x7fe68410f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe682a00700 1 -- 172.21.15.181:0/2895585821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe674005040 con 0x7fe6840fdec0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe682a00700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 0x7fe68410ff20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe670002a80 tx=0x7fe6700046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe670007cc0 con 0x7fe6840fdec0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe67000f040 con 0x7fe6840fdec0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67000dac0 con 0x7fe6840fdec0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684111050 con 0x7fe6840fdec0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.271+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe684111590 con 0x7fe6840fdec0 2024-04-03T08:33:34.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.272+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe684101850 con 0x7fe6840fdec0 2024-04-03T08:33:34.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.273+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe67000dc20 con 0x7fe6840fdec0 2024-04-03T08:33:34.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.275+0000 7fe67b400700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe6680692b0 0x7fe66806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:33:34.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.275+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fe670086710 con 0x7fe6840fdec0 2024-04-03T08:33:34.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.275+0000 7fe683400700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe6680692b0 0x7fe66806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:33:34.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.276+0000 7fe683400700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe6680692b0 0x7fe66806b760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b3b0 tx=0x7fe674009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:33:34.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.280+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe670056ad0 con 0x7fe6840fdec0 2024-04-03T08:33:34.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:34.478+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe684111800 con 0x7fe6680692b0 2024-04-03T08:33:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:33:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:33:35.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:35.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:33:35.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:33:35.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:35.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:35 smithi181 ceph-mon[44183]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-04-03T08:33:35.945 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:35 smithi181 ceph-mon[44183]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:33:36.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:35 smithi157 ceph-mon[35083]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-04-03T08:33:36.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:35 smithi157 ceph-mon[35083]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:33:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:37 smithi157 ceph-mon[35083]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-03T08:33:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:37 smithi181 ceph-mon[44183]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-03T08:33:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/154716232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d591725b-596d-4c27-8ddc-a60269c46dbc"}]: dispatch 2024-04-03T08:33:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:38 smithi157 ceph-mon[35083]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d591725b-596d-4c27-8ddc-a60269c46dbc"}]: dispatch 2024-04-03T08:33:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:38 smithi157 ceph-mon[35083]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d591725b-596d-4c27-8ddc-a60269c46dbc"}]': finished 2024-04-03T08:33:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:38 smithi157 ceph-mon[35083]: osdmap e32: 5 total, 4 up, 5 in 2024-04-03T08:33:39.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:38 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:39.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/1766340773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:33:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:38 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/154716232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d591725b-596d-4c27-8ddc-a60269c46dbc"}]: dispatch 2024-04-03T08:33:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:38 smithi181 ceph-mon[44183]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d591725b-596d-4c27-8ddc-a60269c46dbc"}]: dispatch 2024-04-03T08:33:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:38 smithi181 ceph-mon[44183]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d591725b-596d-4c27-8ddc-a60269c46dbc"}]': finished 2024-04-03T08:33:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:38 smithi181 ceph-mon[44183]: osdmap e32: 5 total, 4 up, 5 in 2024-04-03T08:33:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:38 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:38 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/1766340773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:33:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:39 smithi157 ceph-mon[35083]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-03T08:33:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:39 smithi181 ceph-mon[44183]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-03T08:33:42.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:41 smithi157 ceph-mon[35083]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-03T08:33:42.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:41 smithi181 ceph-mon[44183]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-03T08:33:44.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:43 smithi157 ceph-mon[35083]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-03T08:33:44.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:43 smithi181 ceph-mon[44183]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-03T08:33:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:45 smithi157 ceph-mon[35083]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-03T08:33:46.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:45 smithi181 ceph-mon[44183]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:46.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:33:46.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-03T08:33:46.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:46 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:46.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:46 smithi181 ceph-mon[44183]: Deploying daemon osd.4 on smithi181 2024-04-03T08:33:47.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:46 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:33:47.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:46 smithi157 ceph-mon[35083]: Deploying daemon osd.4 on smithi181 2024-04-03T08:33:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:47 smithi157 ceph-mon[35083]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:48.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:47 smithi181 ceph-mon[44183]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:49.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:49 smithi181 ceph-mon[44183]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:49 smithi157 ceph-mon[35083]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:51 smithi157 ceph-mon[35083]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:52.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:51 smithi181 ceph-mon[44183]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:53.780 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:53 smithi181 ceph-mon[44183]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:53.780 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:53.780 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:53.780 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:53 smithi157 ceph-mon[35083]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:33:55.769 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:55 smithi181 ceph-mon[44183]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:55 smithi157 ceph-mon[35083]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:56.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:56 smithi157 ceph-mon[35083]: from='osd.4 [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:33:56.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:56 smithi157 ceph-mon[35083]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:33:56.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:56 smithi181 ceph-mon[44183]: from='osd.4 [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:33:56.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:56 smithi181 ceph-mon[44183]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:33:56.907 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 4 on host 'smithi181' 2024-04-03T08:33:56.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.906+0000 7fe67b400700 1 -- 172.21.15.181:0/2895585821 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe684111800 con 0x7fe6680692b0 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe6680692b0 msgr2=0x7fe66806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe6680692b0 0x7fe66806b760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b3b0 tx=0x7fe674009e30 comp rx=0 tx=0).stop 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 msgr2=0x7fe68410ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 0x7fe68410ff20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe670002a80 tx=0x7fe6700046b0 comp rx=0 tx=0).stop 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 shutdown_connections 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6840fcc10 0x7fe68410f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe6680692b0 0x7fe66806b760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 --2- 172.21.15.181:0/2895585821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6840fdec0 0x7fe68410ff20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 >> 172.21.15.181:0/2895585821 conn(0x7fe6840f83d0 msgr2=0x7fe6840f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 shutdown_connections 2024-04-03T08:33:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:33:56.909+0000 7fe689200700 1 -- 172.21.15.181:0/2895585821 wait complete. 2024-04-03T08:33:57.689 DEBUG:teuthology.orchestra.run.smithi181:osd.4> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.4.service 2024-04-03T08:33:57.693 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_2... 2024-04-03T08:33:57.693 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-03T08:33:57.764 INFO:journalctl@ceph.osd.4.smithi181.stdout:-- Logs begin at Wed 2024-04-03 08:12:25 UTC. -- 2024-04-03T08:33:57.796 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:57.796 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-03T08:33:57.796 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: osdmap e33: 5 total, 4 up, 5 in 2024-04-03T08:33:57.796 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:57.796 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='osd.4 [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:57.796 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:57.797 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.797 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.797 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.797 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-03T08:33:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: osdmap e33: 5 total, 4 up, 5 in 2024-04-03T08:33:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='osd.4 [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:33:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:33:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:58 smithi157 ceph-mon[35083]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-04-03T08:33:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:58 smithi157 ceph-mon[35083]: osdmap e34: 5 total, 4 up, 5 in 2024-04-03T08:33:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:58 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:58 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:58.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:58 smithi181 ceph-mon[44183]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-04-03T08:33:58.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:58 smithi181 ceph-mon[44183]: osdmap e34: 5 total, 4 up, 5 in 2024-04-03T08:33:58.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:58 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:58.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:58 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:59.640 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:59 smithi181 ceph-mon[44183]: purged_snaps scrub starts 2024-04-03T08:33:59.640 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:59 smithi181 ceph-mon[44183]: purged_snaps scrub ok 2024-04-03T08:33:59.640 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:59 smithi181 ceph-mon[44183]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:59.640 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:59 smithi181 ceph-mon[44183]: osd.4 [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] boot 2024-04-03T08:33:59.640 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:59 smithi181 ceph-mon[44183]: osdmap e35: 5 total, 5 up, 5 in 2024-04-03T08:33:59.640 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:33:59 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:33:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:59 smithi157 ceph-mon[35083]: purged_snaps scrub starts 2024-04-03T08:33:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:59 smithi157 ceph-mon[35083]: purged_snaps scrub ok 2024-04-03T08:33:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:59 smithi157 ceph-mon[35083]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-03T08:33:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:59 smithi157 ceph-mon[35083]: osd.4 [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] boot 2024-04-03T08:33:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:59 smithi157 ceph-mon[35083]: osdmap e35: 5 total, 5 up, 5 in 2024-04-03T08:33:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:33:59 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:34:00.776 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:00 smithi181 ceph-mon[44183]: osdmap e36: 5 total, 5 up, 5 in 2024-04-03T08:34:00.776 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:00 smithi157 ceph-mon[35083]: osdmap e36: 5 total, 5 up, 5 in 2024-04-03T08:34:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:01.615 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-03T08:34:01.616 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-03T08:34:01.616 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-04-03T08:34:01.616 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-04-03T08:34:01.616 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0437658 s, 240 MB/s 2024-04-03T08:34:01.616 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-04-03T08:34:01.654 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:01 smithi181 ceph-mon[44183]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:01.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:01 smithi157 ceph-mon[35083]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:02.394 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-04-03T08:34:02.906 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:34:03.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:03 smithi157 ceph-mon[35083]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:03.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:03 smithi181 ceph-mon[44183]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:05.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 -- 172.21.15.181:0/4091534712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 msgr2=0x7fa0d40fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:05.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 --2- 172.21.15.181:0/4091534712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d40fd310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4004970 tx=0x7fa0c4009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:05.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 -- 172.21.15.181:0/4091534712 shutdown_connections 2024-04-03T08:34:05.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 --2- 172.21.15.181:0/4091534712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d40fe0d0 0x7fa0d40fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:05.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 --2- 172.21.15.181:0/4091534712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d40fd310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:05.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 -- 172.21.15.181:0/4091534712 >> 172.21.15.181:0/4091534712 conn(0x7fa0d40f8560 msgr2=0x7fa0d40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:05.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 -- 172.21.15.181:0/4091534712 shutdown_connections 2024-04-03T08:34:05.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.316+0000 7fa0da200700 1 -- 172.21.15.181:0/4091534712 wait complete. 2024-04-03T08:34:05.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.318+0000 7fa0da200700 1 Processor -- start 2024-04-03T08:34:05.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.318+0000 7fa0da200700 1 -- start start 2024-04-03T08:34:05.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.318+0000 7fa0da200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:05.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.318+0000 7fa0da200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d40fe0d0 0x7fa0d410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:05.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.318+0000 7fa0da200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d410e540 con 0x7fa0d40fe0d0 2024-04-03T08:34:05.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.318+0000 7fa0da200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d410ed40 con 0x7fa0d40fcee0 2024-04-03T08:34:05.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32784/0 (socket says 172.21.15.181:32784) 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 -- 172.21.15.181:0/4069542869 learned_addr learned my addr 172.21.15.181:0/4069542869 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d2a00700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d40fe0d0 0x7fa0d410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 -- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d40fe0d0 msgr2=0x7fa0d410df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d40fe0d0 0x7fa0d410df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 -- 172.21.15.181:0/4069542869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4005040 con 0x7fa0d40fcee0 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.319+0000 7fa0d3400700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d410da00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400b370 tx=0x7fa0c4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:05.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.320+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c400e040 con 0x7fa0d40fcee0 2024-04-03T08:34:05.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.320+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0c4013420 con 0x7fa0d40fcee0 2024-04-03T08:34:05.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.320+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d410efc0 con 0x7fa0d40fcee0 2024-04-03T08:34:05.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.320+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c401c630 con 0x7fa0d40fcee0 2024-04-03T08:34:05.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.320+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d410f500 con 0x7fa0d40fcee0 2024-04-03T08:34:05.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.321+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d405f5f0 con 0x7fa0d40fcee0 2024-04-03T08:34:05.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.322+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa0c4013a00 con 0x7fa0d40fcee0 2024-04-03T08:34:05.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.323+0000 7fa0cb400700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa0b80692b0 0x7fa0b806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:05.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.323+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fa0c4087fb0 con 0x7fa0d40fcee0 2024-04-03T08:34:05.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.323+0000 7fa0d2a00700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa0b80692b0 0x7fa0b806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:05.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.324+0000 7fa0d2a00700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa0b80692b0 0x7fa0b806b760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009b80 tx=0x7fa0c000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:05.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.327+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa0c40ba190 con 0x7fa0d40fcee0 2024-04-03T08:34:05.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:05.536+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0d410f8f0 con 0x7fa0b80692b0 2024-04-03T08:34:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: Detected new or changed devices on smithi181 2024-04-03T08:34:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi181 to 8059M 2024-04-03T08:34:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: Detected new or changed devices on smithi181 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi181 to 8059M 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:05.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:05.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:34:06.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='client.24183 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:34:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:34:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:34:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:06 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='client.24183 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-03T08:34:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:06 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:07 smithi181 ceph-mon[44183]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:07.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:07 smithi157 ceph-mon[35083]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:09 smithi157 ceph-mon[35083]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:09 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/177734832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207d01dc-ee38-4806-b4c8-646cf217f628"}]: dispatch 2024-04-03T08:34:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:09 smithi157 ceph-mon[35083]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207d01dc-ee38-4806-b4c8-646cf217f628"}]: dispatch 2024-04-03T08:34:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:09 smithi157 ceph-mon[35083]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "207d01dc-ee38-4806-b4c8-646cf217f628"}]': finished 2024-04-03T08:34:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:09 smithi157 ceph-mon[35083]: osdmap e37: 6 total, 5 up, 6 in 2024-04-03T08:34:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:09 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:09.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:09 smithi181 ceph-mon[44183]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:09.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:09 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/177734832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207d01dc-ee38-4806-b4c8-646cf217f628"}]: dispatch 2024-04-03T08:34:09.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:09 smithi181 ceph-mon[44183]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207d01dc-ee38-4806-b4c8-646cf217f628"}]: dispatch 2024-04-03T08:34:09.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:09 smithi181 ceph-mon[44183]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "207d01dc-ee38-4806-b4c8-646cf217f628"}]': finished 2024-04-03T08:34:09.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:09 smithi181 ceph-mon[44183]: osdmap e37: 6 total, 5 up, 6 in 2024-04-03T08:34:09.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:09 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:10 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3943592823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:34:10.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:10 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/3943592823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-03T08:34:11.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:11 smithi157 ceph-mon[35083]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:11.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:11 smithi181 ceph-mon[44183]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:13.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:13 smithi181 ceph-mon[44183]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:13.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:13 smithi157 ceph-mon[35083]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:15.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:15 smithi181 ceph-mon[44183]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:15.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:15 smithi157 ceph-mon[35083]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:15.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:17.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:17 smithi181 ceph-mon[44183]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:17 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-03T08:34:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:17 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:17 smithi157 ceph-mon[35083]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:17 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-03T08:34:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:17 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:18.537 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:18 smithi181 ceph-mon[44183]: Deploying daemon osd.5 on smithi181 2024-04-03T08:34:18.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:18 smithi157 ceph-mon[35083]: Deploying daemon osd.5 on smithi181 2024-04-03T08:34:19.734 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:19 smithi181 ceph-mon[44183]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:19.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:19 smithi157 ceph-mon[35083]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:21 smithi181 ceph-mon[44183]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:21.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:21 smithi157 ceph-mon[35083]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:23.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:23 smithi181 ceph-mon[44183]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:23.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:23 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:34:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:23 smithi157 ceph-mon[35083]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:23.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:23 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:34:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:25 smithi157 ceph-mon[35083]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:25.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:25 smithi181 ceph-mon[44183]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:27.772 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:27 smithi181 ceph-mon[44183]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:27.772 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:27 smithi181 ceph-mon[44183]: from='osd.5 [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:34:27.772 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:27 smithi181 ceph-mon[44183]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:34:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:27 smithi157 ceph-mon[35083]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:27 smithi157 ceph-mon[35083]: from='osd.5 [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:34:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:27 smithi157 ceph-mon[35083]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:34:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.815+0000 7fa0cb400700 1 -- 172.21.15.181:0/4069542869 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa0d410f8f0 con 0x7fa0b80692b0 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa0b80692b0 msgr2=0x7fa0b806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa0b80692b0 0x7fa0b806b760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009b80 tx=0x7fa0c000b040 comp rx=0 tx=0).stop 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 msgr2=0x7fa0d410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d410da00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400b370 tx=0x7fa0c4009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 shutdown_connections 2024-04-03T08:34:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa0b80692b0 0x7fa0b806b760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0d40fcee0 0x7fa0d410da00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 --2- 172.21.15.181:0/4069542869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d40fe0d0 0x7fa0d410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 >> 172.21.15.181:0/4069542869 conn(0x7fa0d40f8560 msgr2=0x7fa0d40f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 shutdown_connections 2024-04-03T08:34:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:27.818+0000 7fa0da200700 1 -- 172.21.15.181:0/4069542869 wait complete. 2024-04-03T08:34:28.448 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-03T08:34:28.448 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: osdmap e38: 6 total, 5 up, 6 in 2024-04-03T08:34:28.534 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.5.service 2024-04-03T08:34:28.538 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-03T08:34:28.539 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd stat -f json 2024-04-03T08:34:28.607 INFO:journalctl@ceph.osd.5.smithi181.stdout:-- Logs begin at Wed 2024-04-03 08:12:25 UTC. -- 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: osdmap e38: 6 total, 5 up, 6 in 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='osd.5 [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:28 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:28.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='osd.5 [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:34:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:34:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:28 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:28.972 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:29 smithi157 ceph-mon[35083]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:29 smithi157 ceph-mon[35083]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-04-03T08:34:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:29 smithi157 ceph-mon[35083]: osdmap e39: 6 total, 5 up, 6 in 2024-04-03T08:34:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:29 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:29 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:29.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:29 smithi181 ceph-mon[44183]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:29 smithi181 ceph-mon[44183]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-04-03T08:34:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:29 smithi181 ceph-mon[44183]: osdmap e39: 6 total, 5 up, 6 in 2024-04-03T08:34:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:29 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:29 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:30 smithi157 ceph-mon[35083]: purged_snaps scrub starts 2024-04-03T08:34:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:30 smithi157 ceph-mon[35083]: purged_snaps scrub ok 2024-04-03T08:34:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:30 smithi157 ceph-mon[35083]: osd.5 [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] boot 2024-04-03T08:34:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:30 smithi157 ceph-mon[35083]: osdmap e40: 6 total, 6 up, 6 in 2024-04-03T08:34:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:30 smithi181 ceph-mon[44183]: purged_snaps scrub starts 2024-04-03T08:34:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:30 smithi181 ceph-mon[44183]: purged_snaps scrub ok 2024-04-03T08:34:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:30 smithi181 ceph-mon[44183]: osd.5 [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] boot 2024-04-03T08:34:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:30 smithi181 ceph-mon[44183]: osdmap e40: 6 total, 6 up, 6 in 2024-04-03T08:34:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:34:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:30.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 -- 172.21.15.157:0/3235973705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 msgr2=0x7f5ca80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:30.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 --2- 172.21.15.157:0/3235973705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca80fd310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c98004940 tx=0x7f5c98009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 -- 172.21.15.157:0/3235973705 shutdown_connections 2024-04-03T08:34:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 --2- 172.21.15.157:0/3235973705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ca80fe0d0 0x7f5ca80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 --2- 172.21.15.157:0/3235973705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca80fd310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 -- 172.21.15.157:0/3235973705 >> 172.21.15.157:0/3235973705 conn(0x7f5ca80f8560 msgr2=0x7f5ca80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 -- 172.21.15.157:0/3235973705 shutdown_connections 2024-04-03T08:34:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.941+0000 7f5cad200700 1 -- 172.21.15.157:0/3235973705 wait complete. 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5cad200700 1 Processor -- start 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5cad200700 1 -- start start 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5cad200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5cad200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ca80fe0d0 0x7f5ca8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5cad200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80708c0 con 0x7f5ca80fcee0 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5cad200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8070a30 con 0x7f5ca80fe0d0 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5ca5e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:30.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5ca5e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:51918/0 (socket says 172.21.15.157:51918) 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.943+0000 7f5ca5e00700 1 -- 172.21.15.157:0/1962620832 learned_addr learned my addr 172.21.15.157:0/1962620832 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5ca5400700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ca80fe0d0 0x7f5ca8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5ca5e00700 1 -- 172.21.15.157:0/1962620832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ca80fe0d0 msgr2=0x7f5ca8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5ca5e00700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ca80fe0d0 0x7f5ca8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5ca5e00700 1 -- 172.21.15.157:0/1962620832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98005040 con 0x7f5ca80fcee0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5ca5e00700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca8071e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c980040d0 tx=0x7f5c98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c9800e070 con 0x7f5ca80fcee0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c9801c400 con 0x7f5ca80fcee0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca8070cb0 con 0x7f5ca80fcee0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.944+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c9800b610 con 0x7f5ca80fcee0 2024-04-03T08:34:30.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.945+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca8071190 con 0x7f5ca80fcee0 2024-04-03T08:34:30.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.946+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca805f5f0 con 0x7f5ca80fcee0 2024-04-03T08:34:30.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.946+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5c9801ca50 con 0x7f5ca80fcee0 2024-04-03T08:34:30.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.947+0000 7f5c9e000700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5c8c0692b0 0x7f5c8c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:30.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.947+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5c980884a0 con 0x7f5ca80fcee0 2024-04-03T08:34:30.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.948+0000 7f5ca5400700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5c8c0692b0 0x7f5c8c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:30.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.948+0000 7f5ca5400700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5c8c0692b0 0x7f5c8c06b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c94004fd0 tx=0x7f5c9400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:30.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:30.952+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5c98054b10 con 0x7f5ca80fcee0 2024-04-03T08:34:31.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.147+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5ca8115c50 con 0x7f5ca80fcee0 2024-04-03T08:34:31.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.148+0000 7f5c9e000700 1 -- 172.21.15.157:0/1962620832 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f5c98058130 con 0x7f5ca80fcee0 2024-04-03T08:34:31.148 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5c8c0692b0 msgr2=0x7f5c8c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5c8c0692b0 0x7f5c8c06b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c94004fd0 tx=0x7f5c9400b040 comp rx=0 tx=0).stop 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 msgr2=0x7f5ca8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca8071e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c980040d0 tx=0x7f5c98009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 shutdown_connections 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca80fcee0 0x7f5ca8071e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5c8c0692b0 0x7f5c8c06b760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 --2- 172.21.15.157:0/1962620832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ca80fe0d0 0x7f5ca8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 >> 172.21.15.157:0/1962620832 conn(0x7f5ca80f8560 msgr2=0x7f5ca80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 shutdown_connections 2024-04-03T08:34:31.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:31.150+0000 7f5cad200700 1 -- 172.21.15.157:0/1962620832 wait complete. 2024-04-03T08:34:31.790 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:31 smithi181 ceph-mon[44183]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:31.790 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:31 smithi181 ceph-mon[44183]: osdmap e41: 6 total, 6 up, 6 in 2024-04-03T08:34:31.790 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:31 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1962620832' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-03T08:34:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:31 smithi157 ceph-mon[35083]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-03T08:34:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:31 smithi157 ceph-mon[35083]: osdmap e41: 6 total, 6 up, 6 in 2024-04-03T08:34:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:31 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1962620832' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-03T08:34:31.844 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1712133269,"num_in_osds":6,"osd_in_since":1712133248,"num_remapped_pgs":0} 2024-04-03T08:34:31.845 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-03T08:34:32.271 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 -- 172.21.15.157:0/2101043518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6501037a0 msgr2=0x7ff6500fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 --2- 172.21.15.157:0/2101043518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6501037a0 0x7ff6500fce10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff63c004940 tx=0x7ff63c009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 -- 172.21.15.157:0/2101043518 shutdown_connections 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 --2- 172.21.15.157:0/2101043518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6501037a0 0x7ff6500fce10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 --2- 172.21.15.157:0/2101043518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650102e00 0x7ff6501031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 -- 172.21.15.157:0/2101043518 >> 172.21.15.157:0/2101043518 conn(0x7ff6500f89b0 msgr2=0x7ff6500fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 -- 172.21.15.157:0/2101043518 shutdown_connections 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.045+0000 7ff655e00700 1 -- 172.21.15.157:0/2101043518 wait complete. 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.046+0000 7ff655e00700 1 Processor -- start 2024-04-03T08:34:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.046+0000 7ff655e00700 1 -- start start 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.046+0000 7ff655e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 0x7ff6500702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.046+0000 7ff655e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6501037a0 0x7ff650070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.046+0000 7ff655e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650072210 con 0x7ff650102e00 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.046+0000 7ff655e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650070d40 con 0x7ff6501037a0 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 0x7ff6500702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 0x7ff6500702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41310/0 (socket says 172.21.15.157:41310) 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 -- 172.21.15.157:0/2229591771 learned_addr learned my addr 172.21.15.157:0/2229591771 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64e000700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6501037a0 0x7ff650070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 -- 172.21.15.157:0/2229591771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6501037a0 msgr2=0x7ff650070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6501037a0 0x7ff650070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 -- 172.21.15.157:0/2229591771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c005040 con 0x7ff650102e00 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.047+0000 7ff64ea00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 0x7ff6500702c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff640002a80 tx=0x7ff6400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.048+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff640007cc0 con 0x7ff650102e00 2024-04-03T08:34:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.048+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff64000f040 con 0x7ff650102e00 2024-04-03T08:34:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.048+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64000dac0 con 0x7ff650102e00 2024-04-03T08:34:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.048+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff650071020 con 0x7ff650102e00 2024-04-03T08:34:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.048+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65011a090 con 0x7ff650102e00 2024-04-03T08:34:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.049+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6501052d0 con 0x7ff650102e00 2024-04-03T08:34:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.050+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff64000dc20 con 0x7ff650102e00 2024-04-03T08:34:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.051+0000 7ff646a00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff6340692a0 0x7ff63406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.051+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff640086a80 con 0x7ff650102e00 2024-04-03T08:34:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.051+0000 7ff64e000700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff6340692a0 0x7ff63406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.052+0000 7ff64e000700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff6340692a0 0x7ff63406b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6500719f0 tx=0x7ff63c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:34.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.056+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff640053050 con 0x7ff650102e00 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: Detected new or changed devices on smithi181 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi181 to 5372M 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:34:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:34.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: Detected new or changed devices on smithi181 2024-04-03T08:34:34.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi181 to 5372M 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:34:34.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:34:34.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.254+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6500717a0 con 0x7ff650102e00 2024-04-03T08:34:34.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.254+0000 7ff646a00700 1 -- 172.21.15.157:0/2229591771 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11121 (secure 0 0 0) 0x7ff640056670 con 0x7ff650102e00 2024-04-03T08:34:34.255 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:34:34.255 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":41,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","created":"2024-04-03T08:28:02.650813+0000","modified":"2024-04-03T08:34:30.454284+0000","last_up_change":"2024-04-03T08:34:29.447305+0000","last_in_change":"2024-04-03T08:34:08.784371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T08:33:00.599229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cacd9869-4ce2-4388-ac14-9b21c32f0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6803","nonce":2915442369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6805","nonce":2915442369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6809","nonce":2915442369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6807","nonce":2915442369}]},"public_addr":"172.21.15.157:6803/2915442369","cluster_addr":"172.21.15.157:6805/2915442369","heartbeat_back_addr":"172.21.15.157:6809/2915442369","heartbeat_front_addr":"172.21.15.157:6807/2915442369","state":["exists","up"]},{"osd":1,"uuid":"cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6811","nonce":1324598270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6813","nonce":1324598270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6817","nonce":1324598270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6815","nonce":1324598270}]},"public_addr":"172.21.15.157:6811/1324598270","cluster_addr":"172.21.15.157:6813/1324598270","heartbeat_back_addr":"172.21.15.157:6817/1324598270","heartbeat_front_addr":"172.21.15.157:6815/1324598270","state":["exists","up"]},{"osd":2,"uuid":"763d371a-2aa7-44e2-8557-952c67342744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6819","nonce":525302994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6821","nonce":525302994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6825","nonce":525302994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6823","nonce":525302994}]},"public_addr":"172.21.15.157:6819/525302994","cluster_addr":"172.21.15.157:6821/525302994","heartbeat_back_addr":"172.21.15.157:6825/525302994","heartbeat_front_addr":"172.21.15.157:6823/525302994","state":["exists","up"]},{"osd":3,"uuid":"287ca3f3-1f42-4c40-bf6c-13d05fa77363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6801","nonce":4270332752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6803","nonce":4270332752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6807","nonce":4270332752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6805","nonce":4270332752}]},"public_addr":"172.21.15.181:6801/4270332752","cluster_addr":"172.21.15.181:6803/4270332752","heartbeat_back_addr":"172.21.15.181:6807/4270332752","heartbeat_front_addr":"172.21.15.181:6805/4270332752","state":["exists","up"]},{"osd":4,"uuid":"d591725b-596d-4c27-8ddc-a60269c46dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6809","nonce":788220804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6811","nonce":788220804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6815","nonce":788220804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6813","nonce":788220804}]},"public_addr":"172.21.15.181:6809/788220804","cluster_addr":"172.21.15.181:6811/788220804","heartbeat_back_addr":"172.21.15.181:6815/788220804","heartbeat_front_addr":"172.21.15.181:6813/788220804","state":["exists","up"]},{"osd":5,"uuid":"207d01dc-ee38-4806-b4c8-646cf217f628","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6817","nonce":2854623884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6819","nonce":2854623884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6823","nonce":2854623884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6821","nonce":2854623884}]},"public_addr":"172.21.15.181:6817/2854623884","cluster_addr":"172.21.15.181:6819/2854623884","heartbeat_back_addr":"172.21.15.181:6823/2854623884","heartbeat_front_addr":"172.21.15.181:6821/2854623884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:31:54.508321+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:25.748219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:56.905029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:27.040063+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:57.486375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:34:28.274823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:0/2148643282":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6800/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6801/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2911968524":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2176602566":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/2095236671":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/2296154399":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/448863526":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1447290828":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6801/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6801/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1509492716":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/3654712566":"2024-04-04T08:28:38.706124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T08:34:34.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff6340692a0 msgr2=0x7ff63406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:34.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff6340692a0 0x7ff63406b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6500719f0 tx=0x7ff63c009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:34.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 msgr2=0x7ff6500702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 0x7ff6500702c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff640002a80 tx=0x7ff6400046b0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 shutdown_connections 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff650102e00 0x7ff6500702c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff6340692a0 0x7ff63406b750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 --2- 172.21.15.157:0/2229591771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6501037a0 0x7ff650070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 >> 172.21.15.157:0/2229591771 conn(0x7ff6500f89b0 msgr2=0x7ff650102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 shutdown_connections 2024-04-03T08:34:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:34.257+0000 7ff655e00700 1 -- 172.21.15.157:0/2229591771 wait complete. 2024-04-03T08:34:35.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:34 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2229591771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:34:35.047 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-03T08:33:00.599229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-03T08:34:35.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-04-03T08:34:35.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:34 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2229591771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:34:35.475 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:36.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:35 smithi157 ceph-mon[35083]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:36.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:35 smithi181 ceph-mon[44183]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 -- 172.21.15.157:0/986723995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 msgr2=0x7f84dc0fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 --2- 172.21.15.157:0/986723995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc0fce30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84c8004940 tx=0x7f84c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 -- 172.21.15.157:0/986723995 shutdown_connections 2024-04-03T08:34:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 --2- 172.21.15.157:0/986723995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc0fce30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 --2- 172.21.15.157:0/986723995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84dc102e20 0x7f84dc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 -- 172.21.15.157:0/986723995 >> 172.21.15.157:0/986723995 conn(0x7f84dc0f89d0 msgr2=0x7f84dc0fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:37.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 -- 172.21.15.157:0/986723995 shutdown_connections 2024-04-03T08:34:37.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.304+0000 7f84e3800700 1 -- 172.21.15.157:0/986723995 wait complete. 2024-04-03T08:34:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.305+0000 7f84e3800700 1 Processor -- start 2024-04-03T08:34:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.305+0000 7f84e3800700 1 -- start start 2024-04-03T08:34:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84e3800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84dc102e20 0x7f84dc115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84e3800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc1162f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84e3800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc1169d0 con 0x7f84dc1037c0 2024-04-03T08:34:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84e3800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc10fd10 con 0x7f84dc102e20 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84dbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc1162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84dbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc1162f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41330/0 (socket says 172.21.15.157:41330) 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84dbe00700 1 -- 172.21.15.157:0/1295989500 learned_addr learned my addr 172.21.15.157:0/1295989500 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84e0e00700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84dc102e20 0x7f84dc115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84dbe00700 1 -- 172.21.15.157:0/1295989500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84dc102e20 msgr2=0x7f84dc115db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84dbe00700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84dc102e20 0x7f84dc115db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.306+0000 7f84dbe00700 1 -- 172.21.15.157:0/1295989500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8005040 con 0x7f84dc1037c0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.307+0000 7f84dbe00700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc1162f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009180 tx=0x7f84c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.307+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c800e040 con 0x7f84dc1037c0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.307+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84c800bbc0 con 0x7f84dc1037c0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.307+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c801c3f0 con 0x7f84dc1037c0 2024-04-03T08:34:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.307+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc10ff30 con 0x7f84dc1037c0 2024-04-03T08:34:37.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.307+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc1104f0 con 0x7f84dc1037c0 2024-04-03T08:34:37.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.308+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc0fe570 con 0x7f84dc1037c0 2024-04-03T08:34:37.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.309+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f84c800bd30 con 0x7f84dc1037c0 2024-04-03T08:34:37.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.310+0000 7f84d8c00700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84c40692a0 0x7f84c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:37.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.310+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84c8088140 con 0x7f84dc1037c0 2024-04-03T08:34:37.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.310+0000 7f84e0e00700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84c40692a0 0x7f84c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:37.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.310+0000 7f84e0e00700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84c40692a0 0x7f84c406b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84d0006fd0 tx=0x7f84d0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.314+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f84c80582d0 con 0x7f84dc1037c0 2024-04-03T08:34:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.507+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84dc04bed0 con 0x7f84dc1037c0 2024-04-03T08:34:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.507+0000 7f84d8c00700 1 -- 172.21.15.157:0/1295989500 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84c8057e60 con 0x7f84dc1037c0 2024-04-03T08:34:37.508 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-03T08:34:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84c40692a0 msgr2=0x7f84c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84c40692a0 0x7f84c406b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84d0006fd0 tx=0x7f84d0008040 comp rx=0 tx=0).stop 2024-04-03T08:34:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 msgr2=0x7f84dc1162f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc1162f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009180 tx=0x7f84c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 shutdown_connections 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84c40692a0 0x7f84c406b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84dc102e20 0x7f84dc115db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 --2- 172.21.15.157:0/1295989500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84dc1037c0 0x7f84dc1162f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 >> 172.21.15.157:0/1295989500 conn(0x7f84dc0f89d0 msgr2=0x7f84dc071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 shutdown_connections 2024-04-03T08:34:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:37.510+0000 7f84e3800700 1 -- 172.21.15.157:0/1295989500 wait complete. 2024-04-03T08:34:37.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:37 smithi157 ceph-mon[35083]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:37.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:37 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1295989500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-03T08:34:38.076 INFO:tasks.cephadm:Setting up client nodes... 2024-04-03T08:34:38.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-03T08:34:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:37 smithi181 ceph-mon[44183]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:38.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:37 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1295989500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-03T08:34:38.500 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:39 smithi157 ceph-mon[35083]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:39 smithi181 ceph-mon[44183]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:40.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.531+0000 7fe95b400700 1 -- 172.21.15.157:0/1253685035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe954071ea0 msgr2=0x7fe9540703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:40.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.531+0000 7fe95b400700 1 --2- 172.21.15.157:0/1253685035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe954071ea0 0x7fe9540703b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe948004940 tx=0x7fe948009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 -- 172.21.15.157:0/1253685035 shutdown_connections 2024-04-03T08:34:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 --2- 172.21.15.157:0/1253685035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9540708f0 0x7fe954070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 --2- 172.21.15.157:0/1253685035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe954071ea0 0x7fe9540703b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 -- 172.21.15.157:0/1253685035 >> 172.21.15.157:0/1253685035 conn(0x7fe9540f8540 msgr2=0x7fe9540fa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 -- 172.21.15.157:0/1253685035 shutdown_connections 2024-04-03T08:34:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 -- 172.21.15.157:0/1253685035 wait complete. 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.532+0000 7fe95b400700 1 Processor -- start 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe95b400700 1 -- start start 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe95b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 0x7fe95410fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe95b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe954071ea0 0x7fe954110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe95b400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954110620 con 0x7fe9540708f0 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe95b400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954110790 con 0x7fe954071ea0 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe958a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 0x7fe95410fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe958a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 0x7fe95410fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41350/0 (socket says 172.21.15.157:41350) 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe958a00700 1 -- 172.21.15.157:0/480589665 learned_addr learned my addr 172.21.15.157:0/480589665 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.533+0000 7fe953e00700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe954071ea0 0x7fe954110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe958a00700 1 -- 172.21.15.157:0/480589665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe954071ea0 msgr2=0x7fe954110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe958a00700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe954071ea0 0x7fe954110020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe958a00700 1 -- 172.21.15.157:0/480589665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948005040 con 0x7fe9540708f0 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe958a00700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 0x7fe95410fae0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe9480040d0 tx=0x7fe948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe94800e070 con 0x7fe9540708f0 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe94801c400 con 0x7fe9540708f0 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe94800b650 con 0x7fe9540708f0 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe954115190 con 0x7fe9540708f0 2024-04-03T08:34:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.534+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe954115670 con 0x7fe9540708f0 2024-04-03T08:34:40.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.535+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95404c710 con 0x7fe9540708f0 2024-04-03T08:34:40.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.536+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe94801c9e0 con 0x7fe9540708f0 2024-04-03T08:34:40.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.537+0000 7fe950c00700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe93c0692b0 0x7fe93c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:40.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.537+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe9480884f0 con 0x7fe9540708f0 2024-04-03T08:34:40.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.537+0000 7fe953e00700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe93c0692b0 0x7fe93c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:40.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.538+0000 7fe953e00700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe93c0692b0 0x7fe93c06b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe940004600 tx=0x7fe94000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:40.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.542+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe9480585d0 con 0x7fe9540708f0 2024-04-03T08:34:40.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.813+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe954107b20 con 0x7fe9540708f0 2024-04-03T08:34:40.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.817+0000 7fe950c00700 1 -- 172.21.15.157:0/480589665 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe948058160 con 0x7fe9540708f0 2024-04-03T08:34:40.818 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-04-03T08:34:40.818 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCgFA1mJXeSMBAAUeV6y0dgAhKVOm2tF7v5+g== 2024-04-03T08:34:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe93c0692b0 msgr2=0x7fe93c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe93c0692b0 0x7fe93c06b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe940004600 tx=0x7fe94000b040 comp rx=0 tx=0).stop 2024-04-03T08:34:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 msgr2=0x7fe95410fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 0x7fe95410fae0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe9480040d0 tx=0x7fe948009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 shutdown_connections 2024-04-03T08:34:40.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9540708f0 0x7fe95410fae0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:40.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe93c0692b0 0x7fe93c06b760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:40.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 --2- 172.21.15.157:0/480589665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe954071ea0 0x7fe954110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:40.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.819+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 >> 172.21.15.157:0/480589665 conn(0x7fe9540f8540 msgr2=0x7fe9540f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:40.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.820+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 shutdown_connections 2024-04-03T08:34:40.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:40.820+0000 7fe95b400700 1 -- 172.21.15.157:0/480589665 wait complete. 2024-04-03T08:34:41.583 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:34:41.584 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-03T08:34:41.584 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-03T08:34:41.678 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-03T08:34:41.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:41 smithi157 ceph-mon[35083]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:41.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:41 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/480589665' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-03T08:34:41.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:41 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/480589665' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-03T08:34:42.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:41 smithi181 ceph-mon[44183]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:42.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:41 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/480589665' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-03T08:34:42.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:41 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/480589665' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-03T08:34:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi181/config 2024-04-03T08:34:43.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 -- 172.21.15.181:0/454787596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 msgr2=0x7ff6a40fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:43.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 --2- 172.21.15.181:0/454787596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a40fe4e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff690004940 tx=0x7ff690009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:43.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 -- 172.21.15.181:0/454787596 shutdown_connections 2024-04-03T08:34:43.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 --2- 172.21.15.181:0/454787596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a40fe4e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 --2- 172.21.15.181:0/454787596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6a40fce70 0x7ff6a40fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 -- 172.21.15.181:0/454787596 >> 172.21.15.181:0/454787596 conn(0x7ff6a40f8540 msgr2=0x7ff6a40fa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 -- 172.21.15.181:0/454787596 shutdown_connections 2024-04-03T08:34:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.948+0000 7ff6ab600700 1 -- 172.21.15.181:0/454787596 wait complete. 2024-04-03T08:34:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.949+0000 7ff6ab600700 1 Processor -- start 2024-04-03T08:34:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.949+0000 7ff6ab600700 1 -- start start 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.949+0000 7ff6ab600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6a40fce70 0x7ff6a4071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.949+0000 7ff6ab600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a4070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.949+0000 7ff6ab600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4072260 con 0x7ff6a40fce70 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.949+0000 7ff6ab600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4070850 con 0x7ff6a40fe070 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a4070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51384/0 (socket says 172.21.15.181:51384) 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 -- 172.21.15.181:0/3113489188 learned_addr learned my addr 172.21.15.181:0/3113489188 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a8c00700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6a40fce70 0x7ff6a4071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 -- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6a40fce70 msgr2=0x7ff6a4071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6a40fce70 0x7ff6a4071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 -- 172.21.15.181:0/3113489188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690005040 con 0x7ff6a40fe070 2024-04-03T08:34:43.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a3e00700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a4070310 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff690009150 tx=0x7ff690009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69000e040 con 0x7ff6a40fe070 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff69000bbf0 con 0x7ff6a40fe070 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69001c630 con 0x7ff6a40fe070 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.950+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a4070aa0 con 0x7ff6a40fe070 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.951+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a4071060 con 0x7ff6a40fe070 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.952+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a404c710 con 0x7ff6a40fe070 2024-04-03T08:34:43.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.952+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff69000bd60 con 0x7ff6a40fe070 2024-04-03T08:34:43.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.954+0000 7ff6a0c00700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff68c0692b0 0x7ff68c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:43.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.954+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff690088250 con 0x7ff6a40fe070 2024-04-03T08:34:43.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.954+0000 7ff6a8c00700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff68c0692b0 0x7ff68c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:43.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.955+0000 7ff6a8c00700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff68c0692b0 0x7ff68c06b760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40fdbe0 tx=0x7ff69800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:43.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:43.959+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff690058360 con 0x7ff6a40fe070 2024-04-03T08:34:44.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:43 smithi157 ceph-mon[35083]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:44.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:43 smithi181 ceph-mon[44183]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:44.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.224+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff6a4105900 con 0x7ff6a40fe070 2024-04-03T08:34:44.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.231+0000 7ff6a0c00700 1 -- 172.21.15.181:0/3113489188 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff690013e60 con 0x7ff6a40fe070 2024-04-03T08:34:44.232 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-04-03T08:34:44.232 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCkFA1me/p8DRAAI+RkJpdngrQAWAZ2nNGnxw== 2024-04-03T08:34:44.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff68c0692b0 msgr2=0x7ff68c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:44.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff68c0692b0 0x7ff68c06b760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40fdbe0 tx=0x7ff69800b040 comp rx=0 tx=0).stop 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 msgr2=0x7ff6a4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a4070310 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff690009150 tx=0x7ff690009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 shutdown_connections 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6a40fce70 0x7ff6a4071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff68c0692b0 0x7ff68c06b760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 --2- 172.21.15.181:0/3113489188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6a40fe070 0x7ff6a4070310 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 >> 172.21.15.181:0/3113489188 conn(0x7ff6a40f8540 msgr2=0x7ff6a40f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 shutdown_connections 2024-04-03T08:34:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:34:44.234+0000 7ff6ab600700 1 -- 172.21.15.181:0/3113489188 wait complete. 2024-04-03T08:34:44.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:44 smithi181 ceph-mon[44183]: from='client.? 172.21.15.181:0/3113489188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-03T08:34:44.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:44 smithi181 ceph-mon[44183]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-03T08:34:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:44 smithi181 ceph-mon[44183]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-03T08:34:44.900 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:34:44.900 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-03T08:34:44.900 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-03T08:34:44.992 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-03T08:34:44.993 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-03T08:34:44.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph mgr dump --format=json 2024-04-03T08:34:45.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:44 smithi157 ceph-mon[35083]: from='client.? 172.21.15.181:0/3113489188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-03T08:34:45.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:44 smithi157 ceph-mon[35083]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-03T08:34:45.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:44 smithi157 ceph-mon[35083]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-03T08:34:45.423 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:45 smithi157 ceph-mon[35083]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:46.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:45 smithi181 ceph-mon[44183]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:46.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:34:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.307+0000 7f153a000700 1 -- 172.21.15.157:0/1949760106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 msgr2=0x7f15341031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.307+0000 7f153a000700 1 --2- 172.21.15.157:0/1949760106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f15341031d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1524004940 tx=0x7f1524009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:47.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.308+0000 7f153a000700 1 -- 172.21.15.157:0/1949760106 shutdown_connections 2024-04-03T08:34:47.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.308+0000 7f153a000700 1 --2- 172.21.15.157:0/1949760106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15341037a0 0x7f15340fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.308+0000 7f153a000700 1 --2- 172.21.15.157:0/1949760106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f15341031d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.308+0000 7f153a000700 1 -- 172.21.15.157:0/1949760106 >> 172.21.15.157:0/1949760106 conn(0x7f15340f89b0 msgr2=0x7f15340fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:47.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.308+0000 7f153a000700 1 -- 172.21.15.157:0/1949760106 shutdown_connections 2024-04-03T08:34:47.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.308+0000 7f153a000700 1 -- 172.21.15.157:0/1949760106 wait complete. 2024-04-03T08:34:47.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.309+0000 7f153a000700 1 Processor -- start 2024-04-03T08:34:47.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.309+0000 7f153a000700 1 -- start start 2024-04-03T08:34:47.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.309+0000 7f153a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f1534113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:47.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.309+0000 7f153a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15341037a0 0x7f15341140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:47.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f153a000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534114730 con 0x7f1534102e00 2024-04-03T08:34:47.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f153a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153410db70 con 0x7f15341037a0 2024-04-03T08:34:47.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f1534113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:47.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f1534113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40270/0 (socket says 172.21.15.157:40270) 2024-04-03T08:34:47.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 -- 172.21.15.157:0/1210150425 learned_addr learned my addr 172.21.15.157:0/1210150425 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:47.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 -- 172.21.15.157:0/1210150425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15341037a0 msgr2=0x7f15341140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:47.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15341037a0 0x7f15341140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 -- 172.21.15.157:0/1210150425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524005040 con 0x7f1534102e00 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.310+0000 7f1533400700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f1534113ba0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1524009150 tx=0x7f1524009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.311+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152400e040 con 0x7f1534102e00 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.311+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1524013420 con 0x7f1534102e00 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.311+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153410ddf0 con 0x7f1534102e00 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.311+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152401c630 con 0x7f1534102e00 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.311+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153410e3b0 con 0x7f1534102e00 2024-04-03T08:34:47.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.312+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1534100110 con 0x7f1534102e00 2024-04-03T08:34:47.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.313+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1524013590 con 0x7f1534102e00 2024-04-03T08:34:47.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.314+0000 7f152b400700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f15180692b0 0x7f151806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:47.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.314+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1524088160 con 0x7f1534102e00 2024-04-03T08:34:47.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.314+0000 7f1532a00700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f15180692b0 0x7f151806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:47.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.315+0000 7f1532a00700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f15180692b0 0x7f151806b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f153410ece0 tx=0x7f1520007cc0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:47.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.319+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f15240581c0 con 0x7f1534102e00 2024-04-03T08:34:47.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.568+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f153410f250 con 0x7f1534102e00 2024-04-03T08:34:47.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.571+0000 7f152b400700 1 -- 172.21.15.157:0/1210150425 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167177 (secure 0 0 0) 0x7f1524057d50 con 0x7f1534102e00 2024-04-03T08:34:47.574 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:34:47.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f15180692b0 msgr2=0x7f151806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:47.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f15180692b0 0x7f151806b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f153410ece0 tx=0x7f1520007cc0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 msgr2=0x7f1534113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:47.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f1534113ba0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1524009150 tx=0x7f1524009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 shutdown_connections 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1534102e00 0x7f1534113ba0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f15180692b0 0x7f151806b760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.574+0000 7f153a000700 1 --2- 172.21.15.157:0/1210150425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15341037a0 0x7f15341140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.575+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 >> 172.21.15.157:0/1210150425 conn(0x7f15340f89b0 msgr2=0x7f15341073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.575+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 shutdown_connections 2024-04-03T08:34:47.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:47.575+0000 7f153a000700 1 -- 172.21.15.157:0/1210150425 wait complete. 2024-04-03T08:34:47.937 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:47 smithi157 ceph-mon[35083]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:47.938 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:47 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1210150425' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-03T08:34:48.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:47 smithi181 ceph-mon[44183]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:48.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:47 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1210150425' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-03T08:34:48.339 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi157.qfvynr","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1088955929},{"type":"v1","addr":"172.21.15.157:6801","nonce":1088955929}]},"active_addr":"172.21.15.157:6801/1088955929","active_change":"2024-04-03T08:30:29.978830+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14230,"name":"smithi181.mfhidq","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.157:8443/","prometheus":"http://172.21.15.157:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":510051537}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3743587418}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":1522499030}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3147627682}]}]} 2024-04-03T08:34:48.343 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-03T08:34:48.343 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-03T08:34:48.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-03T08:34:48.766 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:49.978 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:49 smithi157 ceph-mon[35083]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:50.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:49 smithi181 ceph-mon[44183]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.590+0000 7fdc99800700 1 -- 172.21.15.157:0/1938803874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc941037a0 msgr2=0x7fdc940fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.590+0000 7fdc99800700 1 --2- 172.21.15.157:0/1938803874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc941037a0 0x7fdc940fce10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc80004940 tx=0x7fdc80009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 -- 172.21.15.157:0/1938803874 shutdown_connections 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 --2- 172.21.15.157:0/1938803874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc941037a0 0x7fdc940fce10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 --2- 172.21.15.157:0/1938803874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc94102e00 0x7fdc941031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 -- 172.21.15.157:0/1938803874 >> 172.21.15.157:0/1938803874 conn(0x7fdc940f89b0 msgr2=0x7fdc940fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 -- 172.21.15.157:0/1938803874 shutdown_connections 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 -- 172.21.15.157:0/1938803874 wait complete. 2024-04-03T08:34:50.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.591+0000 7fdc99800700 1 Processor -- start 2024-04-03T08:34:50.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc99800700 1 -- start start 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc99800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 0x7fdc94115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc99800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc941037a0 0x7fdc94116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc99800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94116970 con 0x7fdc94102e00 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc99800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9410fd40 con 0x7fdc941037a0 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc92a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 0x7fdc94115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc92a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 0x7fdc94115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40288/0 (socket says 172.21.15.157:40288) 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc92a00700 1 -- 172.21.15.157:0/2332813013 learned_addr learned my addr 172.21.15.157:0/2332813013 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:50.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.592+0000 7fdc92000700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc941037a0 0x7fdc94116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc92a00700 1 -- 172.21.15.157:0/2332813013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc941037a0 msgr2=0x7fdc94116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc92a00700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc941037a0 0x7fdc94116320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc92a00700 1 -- 172.21.15.157:0/2332813013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80005040 con 0x7fdc94102e00 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc92a00700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 0x7fdc94115de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc84002a50 tx=0x7fdc840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc84007cc0 con 0x7fdc94102e00 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc8400f040 con 0x7fdc94102e00 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94110020 con 0x7fdc94102e00 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8400da30 con 0x7fdc94102e00 2024-04-03T08:34:50.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.593+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc941105e0 con 0x7fdc94102e00 2024-04-03T08:34:50.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.594+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc941018c0 con 0x7fdc94102e00 2024-04-03T08:34:50.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.595+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdc8400db90 con 0x7fdc94102e00 2024-04-03T08:34:50.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.596+0000 7fdc8aa00700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc780692b0 0x7fdc7806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:50.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.596+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdc84086ca0 con 0x7fdc94102e00 2024-04-03T08:34:50.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.596+0000 7fdc92000700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc780692b0 0x7fdc7806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:50.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.597+0000 7fdc92000700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc780692b0 0x7fdc7806b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc94111680 tx=0x7fdc80009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:50.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.600+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdc84056c80 con 0x7fdc94102e00 2024-04-03T08:34:50.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.799+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc9404bed0 con 0x7fdc94102e00 2024-04-03T08:34:50.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.800+0000 7fdc8aa00700 1 -- 172.21.15.157:0/2332813013 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11121 (secure 0 0 0) 0x7fdc84056810 con 0x7fdc94102e00 2024-04-03T08:34:50.801 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:34:50.801 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":41,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","created":"2024-04-03T08:28:02.650813+0000","modified":"2024-04-03T08:34:30.454284+0000","last_up_change":"2024-04-03T08:34:29.447305+0000","last_in_change":"2024-04-03T08:34:08.784371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T08:33:00.599229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cacd9869-4ce2-4388-ac14-9b21c32f0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6803","nonce":2915442369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6805","nonce":2915442369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6809","nonce":2915442369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6807","nonce":2915442369}]},"public_addr":"172.21.15.157:6803/2915442369","cluster_addr":"172.21.15.157:6805/2915442369","heartbeat_back_addr":"172.21.15.157:6809/2915442369","heartbeat_front_addr":"172.21.15.157:6807/2915442369","state":["exists","up"]},{"osd":1,"uuid":"cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6811","nonce":1324598270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6813","nonce":1324598270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6817","nonce":1324598270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6815","nonce":1324598270}]},"public_addr":"172.21.15.157:6811/1324598270","cluster_addr":"172.21.15.157:6813/1324598270","heartbeat_back_addr":"172.21.15.157:6817/1324598270","heartbeat_front_addr":"172.21.15.157:6815/1324598270","state":["exists","up"]},{"osd":2,"uuid":"763d371a-2aa7-44e2-8557-952c67342744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6819","nonce":525302994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6821","nonce":525302994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6825","nonce":525302994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6823","nonce":525302994}]},"public_addr":"172.21.15.157:6819/525302994","cluster_addr":"172.21.15.157:6821/525302994","heartbeat_back_addr":"172.21.15.157:6825/525302994","heartbeat_front_addr":"172.21.15.157:6823/525302994","state":["exists","up"]},{"osd":3,"uuid":"287ca3f3-1f42-4c40-bf6c-13d05fa77363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6801","nonce":4270332752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6803","nonce":4270332752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6807","nonce":4270332752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6805","nonce":4270332752}]},"public_addr":"172.21.15.181:6801/4270332752","cluster_addr":"172.21.15.181:6803/4270332752","heartbeat_back_addr":"172.21.15.181:6807/4270332752","heartbeat_front_addr":"172.21.15.181:6805/4270332752","state":["exists","up"]},{"osd":4,"uuid":"d591725b-596d-4c27-8ddc-a60269c46dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6809","nonce":788220804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6811","nonce":788220804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6815","nonce":788220804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6813","nonce":788220804}]},"public_addr":"172.21.15.181:6809/788220804","cluster_addr":"172.21.15.181:6811/788220804","heartbeat_back_addr":"172.21.15.181:6815/788220804","heartbeat_front_addr":"172.21.15.181:6813/788220804","state":["exists","up"]},{"osd":5,"uuid":"207d01dc-ee38-4806-b4c8-646cf217f628","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6817","nonce":2854623884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6819","nonce":2854623884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6823","nonce":2854623884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6821","nonce":2854623884}]},"public_addr":"172.21.15.181:6817/2854623884","cluster_addr":"172.21.15.181:6819/2854623884","heartbeat_back_addr":"172.21.15.181:6823/2854623884","heartbeat_front_addr":"172.21.15.181:6821/2854623884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:31:54.508321+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:25.748219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:56.905029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:27.040063+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:57.486375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:34:28.274823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:0/2148643282":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6800/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6801/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2911968524":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2176602566":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/2095236671":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/2296154399":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/448863526":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1447290828":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6801/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6801/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1509492716":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/3654712566":"2024-04-04T08:28:38.706124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc780692b0 msgr2=0x7fdc7806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc780692b0 0x7fdc7806b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc94111680 tx=0x7fdc80009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 msgr2=0x7fdc94115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 0x7fdc94115de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc84002a50 tx=0x7fdc840046b0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 shutdown_connections 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc94102e00 0x7fdc94115de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc780692b0 0x7fdc7806b760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 --2- 172.21.15.157:0/2332813013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc941037a0 0x7fdc94116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:50.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.802+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 >> 172.21.15.157:0/2332813013 conn(0x7fdc940f89b0 msgr2=0x7fdc94102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:50.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.803+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 shutdown_connections 2024-04-03T08:34:50.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:50.803+0000 7fdc99800700 1 -- 172.21.15.157:0/2332813013 wait complete. 2024-04-03T08:34:51.391 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-03T08:34:51.392 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-03T08:34:51.817 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:51 smithi157 ceph-mon[35083]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:51 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2332813013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:34:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:51 smithi181 ceph-mon[44183]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:51 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2332813013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:34:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 -- 172.21.15.157:0/1889731284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 msgr2=0x7f92e40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1889731284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e40fe250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f92d4004940 tx=0x7f92d4009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 -- 172.21.15.157:0/1889731284 shutdown_connections 2024-04-03T08:34:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1889731284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e40fe820 0x7f92e4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1889731284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e40fe250 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 -- 172.21.15.157:0/1889731284 >> 172.21.15.157:0/1889731284 conn(0x7f92e40f7870 msgr2=0x7f92e40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 -- 172.21.15.157:0/1889731284 shutdown_connections 2024-04-03T08:34:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.577+0000 7f92e9e00700 1 -- 172.21.15.157:0/1889731284 wait complete. 2024-04-03T08:34:53.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.579+0000 7f92e9e00700 1 Processor -- start 2024-04-03T08:34:53.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.579+0000 7f92e9e00700 1 -- start start 2024-04-03T08:34:53.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.579+0000 7f92e9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e4115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:53.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.579+0000 7f92e9e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e40fe820 0x7f92e4116080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.579+0000 7f92e9e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e41166d0 con 0x7f92e40fde80 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.579+0000 7f92e9e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e410fcb0 con 0x7f92e40fe820 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e4115b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e4115b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43288/0 (socket says 172.21.15.157:43288) 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 -- 172.21.15.157:0/1648390773 learned_addr learned my addr 172.21.15.157:0/1648390773 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2000700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e40fe820 0x7f92e4116080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 -- 172.21.15.157:0/1648390773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e40fe820 msgr2=0x7f92e4116080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e40fe820 0x7f92e4116080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 -- 172.21.15.157:0/1648390773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4005040 con 0x7f92e40fde80 2024-04-03T08:34:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e2a00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e4115b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009180 tx=0x7f92d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d400e040 con 0x7f92e40fde80 2024-04-03T08:34:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92d4013420 con 0x7f92e40fde80 2024-04-03T08:34:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d401c630 con 0x7f92e40fde80 2024-04-03T08:34:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.580+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e410ff90 con 0x7f92e40fde80 2024-04-03T08:34:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.581+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e41104d0 con 0x7f92e40fde80 2024-04-03T08:34:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.582+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e4066af0 con 0x7f92e40fde80 2024-04-03T08:34:53.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.582+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f92d4013590 con 0x7f92e40fde80 2024-04-03T08:34:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.583+0000 7f92daa00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f92c80692a0 0x7f92c806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:34:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.583+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f92d4087fe0 con 0x7f92e40fde80 2024-04-03T08:34:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.584+0000 7f92e2000700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f92c80692a0 0x7f92c806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:34:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.584+0000 7f92e2000700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f92c80692a0 0x7f92c806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92e41113e0 tx=0x7f92d000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:34:53.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.588+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f92d4058120 con 0x7f92e40fde80 2024-04-03T08:34:53.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.786+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92e4109e70 con 0x7f92e40fde80 2024-04-03T08:34:53.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.787+0000 7f92daa00700 1 -- 172.21.15.157:0/1648390773 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f92d4057cb0 con 0x7f92e40fde80 2024-04-03T08:34:53.787 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:34:53.787 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":41,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","created":"2024-04-03T08:28:02.650813+0000","modified":"2024-04-03T08:34:30.454284+0000","last_up_change":"2024-04-03T08:34:29.447305+0000","last_in_change":"2024-04-03T08:34:08.784371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T08:33:00.599229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cacd9869-4ce2-4388-ac14-9b21c32f0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6803","nonce":2915442369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6805","nonce":2915442369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6809","nonce":2915442369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6807","nonce":2915442369}]},"public_addr":"172.21.15.157:6803/2915442369","cluster_addr":"172.21.15.157:6805/2915442369","heartbeat_back_addr":"172.21.15.157:6809/2915442369","heartbeat_front_addr":"172.21.15.157:6807/2915442369","state":["exists","up"]},{"osd":1,"uuid":"cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6811","nonce":1324598270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6813","nonce":1324598270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6817","nonce":1324598270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6815","nonce":1324598270}]},"public_addr":"172.21.15.157:6811/1324598270","cluster_addr":"172.21.15.157:6813/1324598270","heartbeat_back_addr":"172.21.15.157:6817/1324598270","heartbeat_front_addr":"172.21.15.157:6815/1324598270","state":["exists","up"]},{"osd":2,"uuid":"763d371a-2aa7-44e2-8557-952c67342744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6819","nonce":525302994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6821","nonce":525302994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6825","nonce":525302994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6823","nonce":525302994}]},"public_addr":"172.21.15.157:6819/525302994","cluster_addr":"172.21.15.157:6821/525302994","heartbeat_back_addr":"172.21.15.157:6825/525302994","heartbeat_front_addr":"172.21.15.157:6823/525302994","state":["exists","up"]},{"osd":3,"uuid":"287ca3f3-1f42-4c40-bf6c-13d05fa77363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6801","nonce":4270332752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6803","nonce":4270332752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6807","nonce":4270332752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6805","nonce":4270332752}]},"public_addr":"172.21.15.181:6801/4270332752","cluster_addr":"172.21.15.181:6803/4270332752","heartbeat_back_addr":"172.21.15.181:6807/4270332752","heartbeat_front_addr":"172.21.15.181:6805/4270332752","state":["exists","up"]},{"osd":4,"uuid":"d591725b-596d-4c27-8ddc-a60269c46dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6809","nonce":788220804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6811","nonce":788220804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6815","nonce":788220804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6813","nonce":788220804}]},"public_addr":"172.21.15.181:6809/788220804","cluster_addr":"172.21.15.181:6811/788220804","heartbeat_back_addr":"172.21.15.181:6815/788220804","heartbeat_front_addr":"172.21.15.181:6813/788220804","state":["exists","up"]},{"osd":5,"uuid":"207d01dc-ee38-4806-b4c8-646cf217f628","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6817","nonce":2854623884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6819","nonce":2854623884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6823","nonce":2854623884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6821","nonce":2854623884}]},"public_addr":"172.21.15.181:6817/2854623884","cluster_addr":"172.21.15.181:6819/2854623884","heartbeat_back_addr":"172.21.15.181:6823/2854623884","heartbeat_front_addr":"172.21.15.181:6821/2854623884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:31:54.508321+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:25.748219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:56.905029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:27.040063+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:57.486375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:34:28.274823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:0/2148643282":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6800/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6801/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2911968524":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2176602566":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/2095236671":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/2296154399":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/448863526":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1447290828":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6801/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6801/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1509492716":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/3654712566":"2024-04-04T08:28:38.706124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T08:34:53.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f92c80692a0 msgr2=0x7f92c806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f92c80692a0 0x7f92c806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92e41113e0 tx=0x7f92d000b040 comp rx=0 tx=0).stop 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 msgr2=0x7f92e4115b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e4115b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009180 tx=0x7f92d4009e30 comp rx=0 tx=0).stop 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 shutdown_connections 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40fde80 0x7f92e4115b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f92c80692a0 0x7f92c806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 --2- 172.21.15.157:0/1648390773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e40fe820 0x7f92e4116080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 >> 172.21.15.157:0/1648390773 conn(0x7f92e40f7870 msgr2=0x7f92e40fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 shutdown_connections 2024-04-03T08:34:53.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:53.789+0000 7f92e9e00700 1 -- 172.21.15.157:0/1648390773 wait complete. 2024-04-03T08:34:54.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:53 smithi157 ceph-mon[35083]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:54.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:53 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1648390773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:34:54.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:53 smithi181 ceph-mon[44183]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:54.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:53 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1648390773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:34:54.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-04-03T08:34:54.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-04-03T08:34:54.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-04-03T08:34:54.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-04-03T08:34:54.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-04-03T08:34:54.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-04-03T08:34:55.030 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:55.078 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:34:55.890 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:55 smithi157 ceph-mon[35083]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:56.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:55 smithi181 ceph-mon[44183]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:58.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:57 smithi157 ceph-mon[35083]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:34:58.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:57 smithi181 ceph-mon[44183]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:00.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:34:59 smithi157 ceph-mon[35083]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:00.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:34:59 smithi181 ceph-mon[44183]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 -- 172.21.15.157:0/3042389404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da0102e00 msgr2=0x7f9da01031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 --2- 172.21.15.157:0/3042389404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da0102e00 0x7f9da01031d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d90004940 tx=0x7f9d90009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 -- 172.21.15.157:0/3042389404 shutdown_connections 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 --2- 172.21.15.157:0/3042389404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da01037a0 0x7f9da00fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 --2- 172.21.15.157:0/3042389404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da0102e00 0x7f9da01031d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 -- 172.21.15.157:0/3042389404 >> 172.21.15.157:0/3042389404 conn(0x7f9da00f89b0 msgr2=0x7f9da00fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 -- 172.21.15.157:0/3042389404 shutdown_connections 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.332+0000 7f9da6200700 1 -- 172.21.15.157:0/3042389404 wait complete. 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9da6200700 1 Processor -- start 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9da6200700 1 -- start start 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9da6200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da0102e00 0x7f9da0115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9da6200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 0x7f9da01162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9da6200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0116910 con 0x7f9da01037a0 2024-04-03T08:35:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9da6200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da010fce0 con 0x7f9da0102e00 2024-04-03T08:35:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.333+0000 7f9d9ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 0x7f9da01162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 0x7f9da01162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43308/0 (socket says 172.21.15.157:43308) 2024-04-03T08:35:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9ea00700 1 -- 172.21.15.157:0/2735251219 learned_addr learned my addr 172.21.15.157:0/2735251219 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9f400700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da0102e00 0x7f9da0115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9ea00700 1 -- 172.21.15.157:0/2735251219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da0102e00 msgr2=0x7f9da0115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9ea00700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da0102e00 0x7f9da0115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9ea00700 1 -- 172.21.15.157:0/2735251219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90005040 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d9ea00700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 0x7f9da01162c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00c890 tx=0x7f9d8c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8c00a700 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d8c00ad30 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da010ffc0 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.334+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8c0113a0 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.335+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0110580 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.335+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9da0110ac0 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.336+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9d8c012400 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.337+0000 7f9d97400700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9d840692b0 0x7f9d8406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.337+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9d8c086f00 con 0x7f9da01037a0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.337+0000 7f9d9f400700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9d840692b0 0x7f9d8406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.337+0000 7f9d97400700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] conn(0x7f9d8406ef80 0x7f9d84071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.337+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 --> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d84071a40 con 0x7f9d8406ef80 2024-04-03T08:35:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.337+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d8c08c500 con 0x7f9da01037a0 2024-04-03T08:35:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.338+0000 7f9d9fe00700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] conn(0x7f9d8406ef80 0x7f9d84071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.338+0000 7f9d9f400700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9d840692b0 0x7f9d8406b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000b3b0 tx=0x7f9d90009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.338+0000 7f9d9fe00700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] conn(0x7f9d8406ef80 0x7f9d84071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.339+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== osd.1 v2:172.21.15.157:6810/1324598270 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9d84071a40 con 0x7f9d8406ef80 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.355+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 --> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9da005e700 con 0x7f9d8406ef80 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.355+0000 7f9d97400700 1 -- 172.21.15.157:0/2735251219 <== osd.1 v2:172.21.15.157:6810/1324598270 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9da005e700 con 0x7f9d8406ef80 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] conn(0x7f9d8406ef80 msgr2=0x7f9d84071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] conn(0x7f9d8406ef80 0x7f9d84071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9d840692b0 msgr2=0x7f9d8406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9d840692b0 0x7f9d8406b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000b3b0 tx=0x7f9d90009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 msgr2=0x7f9da01162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 0x7f9da01162c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00c890 tx=0x7f9d8c0044c0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 shutdown_connections 2024-04-03T08:35:00.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6810/1324598270,v1:172.21.15.157:6811/1324598270] conn(0x7f9d8406ef80 0x7f9d84071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9d840692b0 0x7f9d8406b760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da0102e00 0x7f9da0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 --2- 172.21.15.157:0/2735251219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9da01037a0 0x7f9da01162c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 >> 172.21.15.157:0/2735251219 conn(0x7f9da00f89b0 msgr2=0x7f9da0070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.356+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 shutdown_connections 2024-04-03T08:35:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:34:58.357+0000 7f9da6200700 1 -- 172.21.15.157:0/2735251219 wait complete. 2024-04-03T08:35:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:01.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:01.392 INFO:teuthology.orchestra.run.smithi157.stdout:60129542178 2024-04-03T08:35:01.393 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-04-03T08:35:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:01 smithi157 ceph-mon[35083]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:02.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:01 smithi181 ceph-mon[44183]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:02.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 -- 172.21.15.157:0/933901814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 msgr2=0x7f7f400706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 --2- 172.21.15.157:0/933901814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f400706d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7f30004970 tx=0x7f7f30009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:02.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 -- 172.21.15.157:0/933901814 shutdown_connections 2024-04-03T08:35:02.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 --2- 172.21.15.157:0/933901814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f40070c10 0x7f7f40109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 --2- 172.21.15.157:0/933901814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f400706d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 -- 172.21.15.157:0/933901814 >> 172.21.15.157:0/933901814 conn(0x7f7f400f8970 msgr2=0x7f7f400fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:02.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 -- 172.21.15.157:0/933901814 shutdown_connections 2024-04-03T08:35:02.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.433+0000 7f7f47000700 1 -- 172.21.15.157:0/933901814 wait complete. 2024-04-03T08:35:02.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.434+0000 7f7f47000700 1 Processor -- start 2024-04-03T08:35:02.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.434+0000 7f7f47000700 1 -- start start 2024-04-03T08:35:02.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f47000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f40115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f47000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f40070c10 0x7f7f40116280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f47000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401168d0 con 0x7f7f40070300 2024-04-03T08:35:02.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f47000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4010fca0 con 0x7f7f40070c10 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f40115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f40115d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38532/0 (socket says 172.21.15.157:38532) 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 -- 172.21.15.157:0/570260189 learned_addr learned my addr 172.21.15.157:0/570260189 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3f400700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f40070c10 0x7f7f40116280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 -- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f40070c10 msgr2=0x7f7f40116280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f40070c10 0x7f7f40116280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 -- 172.21.15.157:0/570260189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30005040 con 0x7f7f40070300 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.435+0000 7f7f3fe00700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f40115d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f30004f50 tx=0x7f7f30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.436+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f3000e040 con 0x7f7f40070300 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.436+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4010ff20 con 0x7f7f40070300 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.436+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f30009400 con 0x7f7f40070300 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.436+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f3001c3f0 con 0x7f7f40070300 2024-04-03T08:35:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.436+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f40110460 con 0x7f7f40070300 2024-04-03T08:35:02.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.437+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f40110940 con 0x7f7f40070300 2024-04-03T08:35:02.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.438+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7f30013420 con 0x7f7f40070300 2024-04-03T08:35:02.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f37e00700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7f240692b0 0x7f7f2406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7f300881c0 con 0x7f7f40070300 2024-04-03T08:35:02.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f3f400700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7f240692b0 0x7f7f2406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f37e00700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] conn(0x7f7f2406ef80 0x7f7f24071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 --> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f24071a40 con 0x7f7f2406ef80 2024-04-03T08:35:02.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f3008a710 con 0x7f7f40070300 2024-04-03T08:35:02.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f3f400700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7f240692b0 0x7f7f2406b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f401115e0 tx=0x7f7f2c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:02.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.439+0000 7f7f45000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] conn(0x7f7f2406ef80 0x7f7f24071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.440+0000 7f7f45000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] conn(0x7f7f2406ef80 0x7f7f24071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:02.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.441+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== osd.3 v2:172.21.15.181:6800/4270332752 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7f24071a40 con 0x7f7f2406ef80 2024-04-03T08:35:02.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.457+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 --> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f40110b00 con 0x7f7f2406ef80 2024-04-03T08:35:02.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.457+0000 7f7f37e00700 1 -- 172.21.15.157:0/570260189 <== osd.3 v2:172.21.15.181:6800/4270332752 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7f40110b00 con 0x7f7f2406ef80 2024-04-03T08:35:02.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] conn(0x7f7f2406ef80 msgr2=0x7f7f24071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] conn(0x7f7f2406ef80 0x7f7f24071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7f240692b0 msgr2=0x7f7f2406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7f240692b0 0x7f7f2406b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f401115e0 tx=0x7f7f2c00b040 comp rx=0 tx=0).stop 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 msgr2=0x7f7f40115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f40115d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f30004f50 tx=0x7f7f30009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 shutdown_connections 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f40070300 0x7f7f40115d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:6800/4270332752,v1:172.21.15.181:6801/4270332752] conn(0x7f7f2406ef80 0x7f7f24071390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7f240692b0 0x7f7f2406b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 --2- 172.21.15.157:0/570260189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f40070c10 0x7f7f40116280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 >> 172.21.15.157:0/570260189 conn(0x7f7f400f8970 msgr2=0x7f7f40103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:02.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 shutdown_connections 2024-04-03T08:35:02.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.458+0000 7f7f47000700 1 -- 172.21.15.157:0/570260189 wait complete. 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.618+0000 7fcc91c00700 1 -- 172.21.15.157:0/3655028423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 msgr2=0x7fcc8c0706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.618+0000 7fcc91c00700 1 --2- 172.21.15.157:0/3655028423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c0706d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c004970 tx=0x7fcc7c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.619+0000 7fcc91c00700 1 -- 172.21.15.157:0/3655028423 shutdown_connections 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.619+0000 7fcc91c00700 1 --2- 172.21.15.157:0/3655028423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 0x7fcc8c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.619+0000 7fcc91c00700 1 --2- 172.21.15.157:0/3655028423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c0706d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.619+0000 7fcc91c00700 1 -- 172.21.15.157:0/3655028423 >> 172.21.15.157:0/3655028423 conn(0x7fcc8c0f87e0 msgr2=0x7fcc8c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.619+0000 7fcc91c00700 1 -- 172.21.15.157:0/3655028423 shutdown_connections 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.619+0000 7fcc91c00700 1 -- 172.21.15.157:0/3655028423 wait complete. 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc91c00700 1 Processor -- start 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc91c00700 1 -- start start 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc91c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc91c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 0x7fcc8c1160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc91c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c116710 con 0x7fcc8c070300 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc91c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c10fb50 con 0x7fcc8c070c10 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc8be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc8be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38556/0 (socket says 172.21.15.157:38556) 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.620+0000 7fcc8be00700 1 -- 172.21.15.157:0/2939801144 learned_addr learned my addr 172.21.15.157:0/2939801144 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc8b400700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 0x7fcc8c1160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc8be00700 1 -- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 msgr2=0x7fcc8c1160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc8be00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 0x7fcc8c1160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc8be00700 1 -- 172.21.15.157:0/2939801144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c005040 con 0x7fcc8c070300 2024-04-03T08:35:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc8b400700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 0x7fcc8c1160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:35:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc8be00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c115b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c004f50 tx=0x7fcc7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7c00e040 con 0x7fcc8c070300 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc7c00bc10 con 0x7fcc8c070300 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c10fdd0 con 0x7fcc8c070300 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7c01c630 con 0x7fcc8c070300 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.621+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c110310 con 0x7fcc8c070300 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.622+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc8c110940 con 0x7fcc8c070300 2024-04-03T08:35:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.624+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcc7c013420 con 0x7fcc8c070300 2024-04-03T08:35:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc83e00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcc700692b0 0x7fcc7006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcc7c088b50 con 0x7fcc8c070300 2024-04-03T08:35:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc8b400700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcc700692b0 0x7fcc7006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc83e00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] conn(0x7fcc7006ef80 0x7fcc70071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 --> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc70071a40 con 0x7fcc7006ef80 2024-04-03T08:35:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc7c088e90 con 0x7fcc8c070300 2024-04-03T08:35:02.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc8b400700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcc700692b0 0x7fcc7006b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007fd0 tx=0x7fcc78009f60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:02.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.625+0000 7fcc91200700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] conn(0x7fcc7006ef80 0x7fcc70071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:02.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.626+0000 7fcc91200700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] conn(0x7fcc7006ef80 0x7fcc70071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.627+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== osd.4 v2:172.21.15.181:6808/788220804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcc70071a40 con 0x7fcc7006ef80 2024-04-03T08:35:02.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.642+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 --> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcc8c1044d0 con 0x7fcc7006ef80 2024-04-03T08:35:02.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.643+0000 7fcc83e00700 1 -- 172.21.15.157:0/2939801144 <== osd.4 v2:172.21.15.181:6808/788220804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcc8c1044d0 con 0x7fcc7006ef80 2024-04-03T08:35:02.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.643+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] conn(0x7fcc7006ef80 msgr2=0x7fcc70071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.643+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] conn(0x7fcc7006ef80 0x7fcc70071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcc700692b0 msgr2=0x7fcc7006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcc700692b0 0x7fcc7006b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007fd0 tx=0x7fcc78009f60 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 msgr2=0x7fcc8c115b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c115b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c004f50 tx=0x7fcc7c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 shutdown_connections 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:6808/788220804,v1:172.21.15.181:6809/788220804] conn(0x7fcc7006ef80 0x7fcc70071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc8c070300 0x7fcc8c115b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcc700692b0 0x7fcc7006b760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 --2- 172.21.15.157:0/2939801144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc8c070c10 0x7fcc8c1160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 >> 172.21.15.157:0/2939801144 conn(0x7fcc8c0f87e0 msgr2=0x7fcc8c105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 shutdown_connections 2024-04-03T08:35:02.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:02.644+0000 7fcc91c00700 1 -- 172.21.15.157:0/2939801144 wait complete. 2024-04-03T08:35:03.484 INFO:teuthology.orchestra.run.smithi157.stdout:150323855374 2024-04-03T08:35:03.485 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-04-03T08:35:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:03 smithi157 ceph-mon[35083]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:04.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:03 smithi181 ceph-mon[44183]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.029+0000 7f8888600700 1 -- 172.21.15.157:0/2104711786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880102710 msgr2=0x7f88800fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.029+0000 7f8888600700 1 --2- 172.21.15.157:0/2104711786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880102710 0x7f88800fbd80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f886c004940 tx=0x7f886c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.029+0000 7f8888600700 1 -- 172.21.15.157:0/2104711786 shutdown_connections 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.029+0000 7f8888600700 1 --2- 172.21.15.157:0/2104711786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880102710 0x7f88800fbd80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.029+0000 7f8888600700 1 --2- 172.21.15.157:0/2104711786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8880101d70 0x7f8880102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.029+0000 7f8888600700 1 -- 172.21.15.157:0/2104711786 >> 172.21.15.157:0/2104711786 conn(0x7f8880072bc0 msgr2=0x7f8880072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.030+0000 7f8888600700 1 -- 172.21.15.157:0/2104711786 shutdown_connections 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.030+0000 7f8888600700 1 -- 172.21.15.157:0/2104711786 wait complete. 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.030+0000 7f8888600700 1 Processor -- start 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8888600700 1 -- start start 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8888600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 0x7f88801118e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8888600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8880102710 0x7f8880111e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8888600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880112470 con 0x7f8880101d70 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8888600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888010b860 con 0x7f8880102710 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8885c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 0x7f88801118e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8885c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 0x7f88801118e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38570/0 (socket says 172.21.15.157:38570) 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8885c00700 1 -- 172.21.15.157:0/1357554558 learned_addr learned my addr 172.21.15.157:0/1357554558 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.031+0000 7f8885200700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8880102710 0x7f8880111e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f8885c00700 1 -- 172.21.15.157:0/1357554558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8880102710 msgr2=0x7f8880111e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f8885c00700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8880102710 0x7f8880111e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f8885c00700 1 -- 172.21.15.157:0/1357554558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c005040 con 0x7f8880101d70 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f8885c00700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 0x7f88801118e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8874009700 tx=0x7f8874009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887400ead0 con 0x7f8880101d70 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888010bae0 con 0x7f8880101d70 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f887400ec30 con 0x7f8880101d70 2024-04-03T08:35:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88740105f0 con 0x7f8880101d70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.032+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888010c0a0 con 0x7f8880101d70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.033+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f888010c610 con 0x7f8880101d70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.034+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8874011450 con 0x7f8880101d70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.035+0000 7f887d600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f88680692a0 0x7f886806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.035+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f88740874a0 con 0x7f8880101d70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.035+0000 7f8885200700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f88680692a0 0x7f886806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.035+0000 7f887d600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] conn(0x7f886806ef70 0x7f8868071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.035+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 --> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8868071a30 con 0x7f886806ef70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.035+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8874089af0 con 0x7f8880101d70 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.036+0000 7f8886600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] conn(0x7f886806ef70 0x7f8868071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.036+0000 7f8885200700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f88680692a0 0x7f886806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f888010ca20 tx=0x7f886c003040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:04.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.036+0000 7f8886600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] conn(0x7f886806ef70 0x7f8868071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:04.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.037+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== osd.0 v2:172.21.15.157:6802/2915442369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8868071a30 con 0x7f886806ef70 2024-04-03T08:35:04.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.053+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 --> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f888005e6c0 con 0x7f886806ef70 2024-04-03T08:35:04.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.053+0000 7f887d600700 1 -- 172.21.15.157:0/1357554558 <== osd.0 v2:172.21.15.157:6802/2915442369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f888005e6c0 con 0x7f886806ef70 2024-04-03T08:35:04.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] conn(0x7f886806ef70 msgr2=0x7f8868071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] conn(0x7f886806ef70 0x7f8868071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f88680692a0 msgr2=0x7f886806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f88680692a0 0x7f886806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f888010ca20 tx=0x7f886c003040 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 msgr2=0x7f88801118e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 0x7f88801118e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8874009700 tx=0x7f8874009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 shutdown_connections 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6802/2915442369,v1:172.21.15.157:6803/2915442369] conn(0x7f886806ef70 0x7f8868071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880101d70 0x7f88801118e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f88680692a0 0x7f886806b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 --2- 172.21.15.157:0/1357554558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8880102710 0x7f8880111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 >> 172.21.15.157:0/1357554558 conn(0x7f8880072bc0 msgr2=0x7f88800faf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 shutdown_connections 2024-04-03T08:35:04.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.054+0000 7f8888600700 1 -- 172.21.15.157:0/1357554558 wait complete. 2024-04-03T08:35:04.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.150+0000 7f956f400700 1 -- 172.21.15.157:0/3162166187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 msgr2=0x7f9568070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.150+0000 7f956f400700 1 --2- 172.21.15.157:0/3162166187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f9568070360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f955c004970 tx=0x7f955c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.150+0000 7f956f400700 1 -- 172.21.15.157:0/3162166187 shutdown_connections 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.150+0000 7f956f400700 1 --2- 172.21.15.157:0/3162166187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95680708a0 0x7f9568070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.150+0000 7f956f400700 1 --2- 172.21.15.157:0/3162166187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f9568070360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.150+0000 7f956f400700 1 -- 172.21.15.157:0/3162166187 >> 172.21.15.157:0/3162166187 conn(0x7f95680f89b0 msgr2=0x7f95680fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.151+0000 7f956f400700 1 -- 172.21.15.157:0/3162166187 shutdown_connections 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.151+0000 7f956f400700 1 -- 172.21.15.157:0/3162166187 wait complete. 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.151+0000 7f956f400700 1 Processor -- start 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.151+0000 7f956f400700 1 -- start start 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f956f400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95680708a0 0x7f956811a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f956f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f956811a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f956f400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956811ad30 con 0x7f9568071f90 2024-04-03T08:35:04.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f956f400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568114100 con 0x7f95680708a0 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f9567e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f956811a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f9567e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f956811a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38582/0 (socket says 172.21.15.157:38582) 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f9567e00700 1 -- 172.21.15.157:0/634707529 learned_addr learned my addr 172.21.15.157:0/634707529 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f956ca00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95680708a0 0x7f956811a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f9567e00700 1 -- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95680708a0 msgr2=0x7f956811a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f9567e00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95680708a0 0x7f956811a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.152+0000 7f9567e00700 1 -- 172.21.15.157:0/634707529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c005040 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.153+0000 7f9567e00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f956811a6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f955400eb40 tx=0x7f955400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.153+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9554007cc0 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.153+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f955400f040 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.153+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9554009620 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.153+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9568114380 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.153+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95681148c0 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.154+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9568114df0 con 0x7f9568071f90 2024-04-03T08:35:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.155+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9554009780 con 0x7f9568071f90 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.156+0000 7f9564c00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95500692b0 0x7f955006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.156+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9554086a60 con 0x7f9568071f90 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.156+0000 7f956ca00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95500692b0 0x7f955006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.157+0000 7f9564c00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] conn(0x7f955006ef80 0x7f9550071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.157+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 --> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9550071a40 con 0x7f955006ef80 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.157+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f955408b220 con 0x7f9568071f90 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.157+0000 7f956ca00700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95500692b0 0x7f955006b760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f955c009fd0 tx=0x7f955c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.157+0000 7f956d400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] conn(0x7f955006ef80 0x7f9550071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.158+0000 7f956d400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] conn(0x7f955006ef80 0x7f9550071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.159+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== osd.5 v2:172.21.15.181:6816/2854623884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9550071a40 con 0x7f955006ef80 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.174+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 --> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95680fa430 con 0x7f955006ef80 2024-04-03T08:35:04.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.175+0000 7f9564c00700 1 -- 172.21.15.157:0/634707529 <== osd.5 v2:172.21.15.181:6816/2854623884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f95680fa430 con 0x7f955006ef80 2024-04-03T08:35:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.175+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] conn(0x7f955006ef80 msgr2=0x7f9550071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] conn(0x7f955006ef80 0x7f9550071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95500692b0 msgr2=0x7f955006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95500692b0 0x7f955006b760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f955c009fd0 tx=0x7f955c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 msgr2=0x7f956811a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f956811a6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f955400eb40 tx=0x7f955400b040 comp rx=0 tx=0).stop 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 shutdown_connections 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95500692b0 0x7f955006b760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95680708a0 0x7f956811a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.181:6816/2854623884,v1:172.21.15.181:6817/2854623884] conn(0x7f955006ef80 0x7f9550071390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 --2- 172.21.15.157:0/634707529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9568071f90 0x7f956811a6e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 >> 172.21.15.157:0/634707529 conn(0x7f95680f89b0 msgr2=0x7f95680f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 shutdown_connections 2024-04-03T08:35:04.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:04.176+0000 7f956f400700 1 -- 172.21.15.157:0/634707529 wait complete. 2024-04-03T08:35:04.879 INFO:teuthology.orchestra.run.smithi157.stdout:115964117013 2024-04-03T08:35:04.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-04-03T08:35:06.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:05 smithi157 ceph-mon[35083]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:06.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:05 smithi181 ceph-mon[44183]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:06.100 INFO:teuthology.orchestra.run.smithi157.stdout:38654705704 2024-04-03T08:35:06.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-04-03T08:35:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:06.546 INFO:teuthology.orchestra.run.smithi157.stdout:171798691850 2024-04-03T08:35:06.546 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.253+0000 7f3e2ea00700 1 -- 172.21.15.157:0/2903411165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070300 msgr2=0x7f3e280706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.253+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/2903411165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070300 0x7f3e280706d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e18004970 tx=0x7f3e18009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 -- 172.21.15.157:0/2903411165 shutdown_connections 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/2903411165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e28070c10 0x7f3e28109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/2903411165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070300 0x7f3e280706d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 -- 172.21.15.157:0/2903411165 >> 172.21.15.157:0/2903411165 conn(0x7f3e280f89d0 msgr2=0x7f3e280fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 -- 172.21.15.157:0/2903411165 shutdown_connections 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 -- 172.21.15.157:0/2903411165 wait complete. 2024-04-03T08:35:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.254+0000 7f3e2ea00700 1 Processor -- start 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e2ea00700 1 -- start start 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e2ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e28070300 0x7f3e28115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e2ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 0x7f3e281162d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e2ea00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28116920 con 0x7f3e28070c10 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e2ea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2810fcf0 con 0x7f3e28070300 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e27400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 0x7f3e281162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e27400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 0x7f3e281162d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38606/0 (socket says 172.21.15.157:38606) 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e27400700 1 -- 172.21.15.157:0/1085004359 learned_addr learned my addr 172.21.15.157:0/1085004359 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e27e00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e28070300 0x7f3e28115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.255+0000 7f3e27400700 1 -- 172.21.15.157:0/1085004359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e28070300 msgr2=0x7f3e28115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e27400700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e28070300 0x7f3e28115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e27400700 1 -- 172.21.15.157:0/1085004359 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18005040 con 0x7f3e28070c10 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e27400700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 0x7f3e281162d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400eb40 tx=0x7f3e1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e14007cc0 con 0x7f3e28070c10 2024-04-03T08:35:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e1400f040 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2810ff70 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e14009620 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.256+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e281104b0 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.257+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e28110990 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.258+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3e14009780 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.259+0000 7f3e1fe00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3e0c0692a0 0x7f3e0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.259+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3e14086b60 con 0x7f3e28070c10 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.259+0000 7f3e27e00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3e0c0692a0 0x7f3e0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.260+0000 7f3e1fe00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] conn(0x7f3e0c06ef70 0x7f3e0c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.260+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 --> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e0c071a30 con 0x7f3e0c06ef70 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.260+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e1408b220 con 0x7f3e28070c10 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.260+0000 7f3e2ca00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] conn(0x7f3e0c06ef70 0x7f3e0c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.260+0000 7f3e27e00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3e0c0692a0 0x7f3e0c06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b370 tx=0x7f3e18009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.260+0000 7f3e2ca00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] conn(0x7f3e0c06ef70 0x7f3e0c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.261+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== osd.2 v2:172.21.15.157:6818/525302994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3e0c071a30 con 0x7f3e0c06ef70 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.277+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 --> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e280fa870 con 0x7f3e0c06ef70 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e1fe00700 1 -- 172.21.15.157:0/1085004359 <== osd.2 v2:172.21.15.157:6818/525302994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e280fa870 con 0x7f3e0c06ef70 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] conn(0x7f3e0c06ef70 msgr2=0x7f3e0c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] conn(0x7f3e0c06ef70 0x7f3e0c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3e0c0692a0 msgr2=0x7f3e0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3e0c0692a0 0x7f3e0c06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b370 tx=0x7f3e18009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 msgr2=0x7f3e281162d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.278+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 0x7f3e281162d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400eb40 tx=0x7f3e1400b040 comp rx=0 tx=0).stop 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 shutdown_connections 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6818/525302994,v1:172.21.15.157:6819/525302994] conn(0x7f3e0c06ef70 0x7f3e0c071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3e0c0692a0 0x7f3e0c06b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e28070300 0x7f3e28115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 --2- 172.21.15.157:0/1085004359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e28070c10 0x7f3e281162d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 >> 172.21.15.157:0/1085004359 conn(0x7f3e280f89d0 msgr2=0x7f3e280f9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 shutdown_connections 2024-04-03T08:35:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:07.279+0000 7f3e2ea00700 1 -- 172.21.15.157:0/1085004359 wait complete. 2024-04-03T08:35:07.334 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:07.784 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:07 smithi181 ceph-mon[44183]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:08.190 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:07 smithi157 ceph-mon[35083]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:08.194 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:09.832 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:09.854 INFO:teuthology.orchestra.run.smithi157.stdout:81604378651 2024-04-03T08:35:09.855 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-04-03T08:35:10.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.078+0000 7f70f6e00700 1 -- 172.21.15.157:0/1864415122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 msgr2=0x7f70f0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:10.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.078+0000 7f70f6e00700 1 --2- 172.21.15.157:0/1864415122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0106e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70dc004940 tx=0x7f70dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:10.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.078+0000 7f70f6e00700 1 -- 172.21.15.157:0/1864415122 shutdown_connections 2024-04-03T08:35:10.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.078+0000 7f70f6e00700 1 --2- 172.21.15.157:0/1864415122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0106e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:10.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.078+0000 7f70f6e00700 1 --2- 172.21.15.157:0/1864415122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f00fde80 0x7f70f00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:10.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.079+0000 7f70f6e00700 1 -- 172.21.15.157:0/1864415122 >> 172.21.15.157:0/1864415122 conn(0x7f70f00f7870 msgr2=0x7f70f00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:10.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.079+0000 7f70f6e00700 1 -- 172.21.15.157:0/1864415122 shutdown_connections 2024-04-03T08:35:10.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.079+0000 7f70f6e00700 1 -- 172.21.15.157:0/1864415122 wait complete. 2024-04-03T08:35:10.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.079+0000 7f70f6e00700 1 Processor -- start 2024-04-03T08:35:10.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70f6e00700 1 -- start start 2024-04-03T08:35:10.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70f6e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f00fde80 0x7f70f0115af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:10.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70f6e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0116030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:10.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70f6e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0116680 con 0x7f70f00fe820 2024-04-03T08:35:10.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70f6e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f010fc60 con 0x7f70f00fde80 2024-04-03T08:35:10.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70ef400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0116030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:10.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70ef400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0116030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38630/0 (socket says 172.21.15.157:38630) 2024-04-03T08:35:10.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70ef400700 1 -- 172.21.15.157:0/2975612768 learned_addr learned my addr 172.21.15.157:0/2975612768 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:10.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.080+0000 7f70efe00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f00fde80 0x7f70f0115af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:10.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70ef400700 1 -- 172.21.15.157:0/2975612768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f00fde80 msgr2=0x7f70f0115af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:10.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70ef400700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f00fde80 0x7f70f0115af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:10.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70ef400700 1 -- 172.21.15.157:0/2975612768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc005040 con 0x7f70f00fe820 2024-04-03T08:35:10.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70ef400700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0116030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009180 tx=0x7f70dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:10.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70dc00e040 con 0x7f70f00fe820 2024-04-03T08:35:10.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70dc013420 con 0x7f70f00fe820 2024-04-03T08:35:10.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70dc01c630 con 0x7f70f00fe820 2024-04-03T08:35:10.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f010ff40 con 0x7f70f00fe820 2024-04-03T08:35:10.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.081+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f0110480 con 0x7f70f00fe820 2024-04-03T08:35:10.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.083+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f0066af0 con 0x7f70f00fe820 2024-04-03T08:35:10.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.083+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f70dc013590 con 0x7f70f00fe820 2024-04-03T08:35:10.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.084+0000 7f70e7e00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f70d40692a0 0x7f70d406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:10.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.084+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f70dc087fe0 con 0x7f70f00fe820 2024-04-03T08:35:10.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.085+0000 7f70efe00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f70d40692a0 0x7f70d406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:10.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.085+0000 7f70efe00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f70d40692a0 0x7f70d406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009fd0 tx=0x7f70e000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:10.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.089+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f70dc058120 con 0x7f70f00fe820 2024-04-03T08:35:10.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:09 smithi181 ceph-mon[44183]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:10.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:09 smithi157 ceph-mon[35083]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:10.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.313+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70f004c710 con 0x7f70f00fe820 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stdout:60129542180 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.314+0000 7f70e7e00700 1 -- 172.21.15.157:0/2975612768 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70dc057cb0 con 0x7f70f00fe820 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f70d40692a0 msgr2=0x7f70d406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f70d40692a0 0x7f70d406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009fd0 tx=0x7f70e000b040 comp rx=0 tx=0).stop 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 msgr2=0x7f70f0116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0116030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009180 tx=0x7f70dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 shutdown_connections 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f70d40692a0 0x7f70d406b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:10.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f00fde80 0x7f70f0115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:10.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 --2- 172.21.15.157:0/2975612768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f00fe820 0x7f70f0116030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:10.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 >> 172.21.15.157:0/2975612768 conn(0x7f70f00f7870 msgr2=0x7f70f00f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:10.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 shutdown_connections 2024-04-03T08:35:10.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:10.316+0000 7f70f6e00700 1 -- 172.21.15.157:0/2975612768 wait complete. 2024-04-03T08:35:11.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:10 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2975612768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-03T08:35:11.102 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:10 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2975612768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-03T08:35:11.769 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542178 got 60129542180 for osd.1 2024-04-03T08:35:11.769 DEBUG:teuthology.parallel:result is None 2024-04-03T08:35:12.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:11 smithi157 ceph-mon[35083]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:11 smithi181 ceph-mon[44183]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 -- 172.21.15.157:0/2223062286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 msgr2=0x7feeb01031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 --2- 172.21.15.157:0/2223062286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb01031d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feea4004940 tx=0x7feea4009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 -- 172.21.15.157:0/2223062286 shutdown_connections 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 --2- 172.21.15.157:0/2223062286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb01037a0 0x7feeb00fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 --2- 172.21.15.157:0/2223062286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb01031d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 -- 172.21.15.157:0/2223062286 >> 172.21.15.157:0/2223062286 conn(0x7feeb00f89b0 msgr2=0x7feeb00fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 -- 172.21.15.157:0/2223062286 shutdown_connections 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.377+0000 7feeb7e00700 1 -- 172.21.15.157:0/2223062286 wait complete. 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.378+0000 7feeb7e00700 1 Processor -- start 2024-04-03T08:35:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.378+0000 7feeb7e00700 1 -- start start 2024-04-03T08:35:13.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb0113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb01037a0 0x7feeb01140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0114730 con 0x7feeb0102e00 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb010db70 con 0x7feeb01037a0 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb0113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb0113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49970/0 (socket says 172.21.15.157:49970) 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 -- 172.21.15.157:0/1252884586 learned_addr learned my addr 172.21.15.157:0/1252884586 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 -- 172.21.15.157:0/1252884586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb01037a0 msgr2=0x7feeb01140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb01037a0 0x7feeb01140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 -- 172.21.15.157:0/1252884586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4005040 con 0x7feeb0102e00 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.379+0000 7feeb5400700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb0113ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feea4009150 tx=0x7feea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.380+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea400e040 con 0x7feeb0102e00 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.380+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feea4013420 con 0x7feeb0102e00 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.380+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb010ddf0 con 0x7feeb0102e00 2024-04-03T08:35:13.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.380+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea401c630 con 0x7feeb0102e00 2024-04-03T08:35:13.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.380+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb010e3b0 con 0x7feeb0102e00 2024-04-03T08:35:13.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.381+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0100110 con 0x7feeb0102e00 2024-04-03T08:35:13.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.382+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7feea4013590 con 0x7feeb0102e00 2024-04-03T08:35:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.383+0000 7feead600700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fee980692b0 0x7fee9806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.383+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7feea4087fe0 con 0x7feeb0102e00 2024-04-03T08:35:13.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.383+0000 7feeb4a00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fee980692b0 0x7fee9806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:13.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.383+0000 7feeb4a00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fee980692b0 0x7fee9806b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feeb010ece0 tx=0x7fee9c007cc0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:13.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.387+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7feea4058180 con 0x7feeb0102e00 2024-04-03T08:35:13.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.617+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feeb010f1f0 con 0x7feeb0102e00 2024-04-03T08:35:13.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.617+0000 7feead600700 1 -- 172.21.15.157:0/1252884586 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feea4057d10 con 0x7feeb0102e00 2024-04-03T08:35:13.618 INFO:teuthology.orchestra.run.smithi157.stdout:38654705706 2024-04-03T08:35:13.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fee980692b0 msgr2=0x7fee9806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:13.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fee980692b0 0x7fee9806b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feeb010ece0 tx=0x7fee9c007cc0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 msgr2=0x7feeb0113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:13.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb0113ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feea4009150 tx=0x7feea4009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 shutdown_connections 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb0102e00 0x7feeb0113ba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fee980692b0 0x7fee9806b760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 --2- 172.21.15.157:0/1252884586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb01037a0 0x7feeb01140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 >> 172.21.15.157:0/1252884586 conn(0x7feeb00f89b0 msgr2=0x7feeb01073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 shutdown_connections 2024-04-03T08:35:13.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:13.620+0000 7feeb7e00700 1 -- 172.21.15.157:0/1252884586 wait complete. 2024-04-03T08:35:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:13 smithi157 ceph-mon[35083]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:13 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1252884586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-03T08:35:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:13 smithi181 ceph-mon[44183]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:14.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:13 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1252884586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-03T08:35:15.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 -- 172.21.15.157:0/2831638414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c81037a0 msgr2=0x7f84c80fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 --2- 172.21.15.157:0/2831638414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c81037a0 0x7f84c80fce10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84b4004940 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:15.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 -- 172.21.15.157:0/2831638414 shutdown_connections 2024-04-03T08:35:15.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 --2- 172.21.15.157:0/2831638414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c81037a0 0x7f84c80fce10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 --2- 172.21.15.157:0/2831638414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c8102e00 0x7f84c81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 -- 172.21.15.157:0/2831638414 >> 172.21.15.157:0/2831638414 conn(0x7f84c80f89b0 msgr2=0x7f84c80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 -- 172.21.15.157:0/2831638414 shutdown_connections 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.991+0000 7f84cfa00700 1 -- 172.21.15.157:0/2831638414 wait complete. 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cfa00700 1 Processor -- start 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cfa00700 1 -- start start 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cfa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 0x7f84c8115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cfa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c81037a0 0x7f84c8116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cfa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8116760 con 0x7f84c8102e00 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cfa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c810fd40 con 0x7f84c81037a0 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.992+0000 7f84cd000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 0x7f84c8115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cd000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 0x7f84c8115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49980/0 (socket says 172.21.15.157:49980) 2024-04-03T08:35:15.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cd000700 1 -- 172.21.15.157:0/1227992091 learned_addr learned my addr 172.21.15.157:0/1227992091 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84c7e00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c81037a0 0x7f84c8116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cd000700 1 -- 172.21.15.157:0/1227992091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c81037a0 msgr2=0x7f84c8116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cd000700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c81037a0 0x7f84c8116110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cd000700 1 -- 172.21.15.157:0/1227992091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4005040 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84c7e00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c81037a0 0x7f84c8116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cd000700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 0x7f84c8115bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f84bc002a50 tx=0x7f84bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84bc007cc0 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8110020 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84bc00f040 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84bc009640 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.993+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c8110560 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.995+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c8102120 con 0x7f84c8102e00 2024-04-03T08:35:15.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.996+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f84bc0097c0 con 0x7f84c8102e00 2024-04-03T08:35:15.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.997+0000 7f84c4c00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84b00692a0 0x7f84b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:15.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.997+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84bc086c40 con 0x7f84c8102e00 2024-04-03T08:35:15.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.997+0000 7f84c7e00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84b00692a0 0x7f84b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:15.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:14.998+0000 7f84c7e00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84b00692a0 0x7f84b006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84c8111470 tx=0x7f84b4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:15.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.006+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f84bc056cc0 con 0x7f84c8102e00 2024-04-03T08:35:15.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 -- 172.21.15.157:0/2921239019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 msgr2=0x7f388c108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 --2- 172.21.15.157:0/2921239019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c108f50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3878004970 tx=0x7f3878009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 -- 172.21.15.157:0/2921239019 shutdown_connections 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 --2- 172.21.15.157:0/2921239019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c108f50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 --2- 172.21.15.157:0/2921239019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c070360 0x7f388c070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 -- 172.21.15.157:0/2921239019 >> 172.21.15.157:0/2921239019 conn(0x7f388c0f8830 msgr2=0x7f388c0fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 -- 172.21.15.157:0/2921239019 shutdown_connections 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.075+0000 7f3890a00700 1 -- 172.21.15.157:0/2921239019 wait complete. 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.076+0000 7f3890a00700 1 Processor -- start 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.076+0000 7f3890a00700 1 -- start start 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.076+0000 7f3890a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c070360 0x7f388c115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.076+0000 7f3890a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:15.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.076+0000 7f3890a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c116700 con 0x7f388c070c70 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.076+0000 7f3890a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c10fb40 con 0x7f388c070360 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c1160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c1160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49998/0 (socket says 172.21.15.157:49998) 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 -- 172.21.15.157:0/1822224160 learned_addr learned my addr 172.21.15.157:0/1822224160 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388b400700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c070360 0x7f388c115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 -- 172.21.15.157:0/1822224160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c070360 msgr2=0x7f388c115b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c070360 0x7f388c115b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 -- 172.21.15.157:0/1822224160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878005040 con 0x7f388c070c70 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f388aa00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c1160b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3878000c00 tx=0x7f3878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387800e040 con 0x7f388c070c70 2024-04-03T08:35:15.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3878009400 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.077+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c10fdc0 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.078+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387801c3f0 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.078+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c110300 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.079+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c071aa0 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.080+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f387800bc10 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.080+0000 7f3883400700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f38700692a0 0x7f387006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.080+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3878088130 con 0x7f388c070c70 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.081+0000 7f388b400700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f38700692a0 0x7f387006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.081+0000 7f388b400700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f38700692a0 0x7f387006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f387c004f40 tx=0x7f387c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:15.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.085+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3878058240 con 0x7f388c070c70 2024-04-03T08:35:15.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.232+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f84c80fe550 con 0x7f84c8102e00 2024-04-03T08:35:15.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.232+0000 7f84c4c00700 1 -- 172.21.15.157:0/1227992091 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84bc056850 con 0x7f84c8102e00 2024-04-03T08:35:15.233 INFO:teuthology.orchestra.run.smithi157.stdout:171798691852 2024-04-03T08:35:15.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.234+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84b00692a0 msgr2=0x7f84b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.234+0000 7f84cfa00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84b00692a0 0x7f84b006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84c8111470 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:15.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.234+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 msgr2=0x7f84c8115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.234+0000 7f84cfa00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 0x7f84c8115bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f84bc002a50 tx=0x7f84bc0046b0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 shutdown_connections 2024-04-03T08:35:15.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c8102e00 0x7f84c8115bd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84b00692a0 0x7f84b006b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 --2- 172.21.15.157:0/1227992091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84c81037a0 0x7f84c8116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 >> 172.21.15.157:0/1227992091 conn(0x7f84c80f89b0 msgr2=0x7f84c8070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:15.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 shutdown_connections 2024-04-03T08:35:15.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.235+0000 7f84cfa00700 1 -- 172.21.15.157:0/1227992091 wait complete. 2024-04-03T08:35:15.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.312+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f388c05f5f0 con 0x7f388c070c70 2024-04-03T08:35:15.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.313+0000 7f3883400700 1 -- 172.21.15.157:0/1822224160 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3878057dd0 con 0x7f388c070c70 2024-04-03T08:35:15.313 INFO:teuthology.orchestra.run.smithi157.stdout:150323855377 2024-04-03T08:35:15.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f38700692a0 msgr2=0x7f387006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f38700692a0 0x7f387006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f387c004f40 tx=0x7f387c00b040 comp rx=0 tx=0).stop 2024-04-03T08:35:15.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 msgr2=0x7f388c1160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:15.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c1160b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3878000c00 tx=0x7f3878009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 shutdown_connections 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f38700692a0 0x7f387006b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c070360 0x7f388c115b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 --2- 172.21.15.157:0/1822224160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f388c070c70 0x7f388c1160b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.315+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 >> 172.21.15.157:0/1822224160 conn(0x7f388c0f8830 msgr2=0x7f388c105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.316+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 shutdown_connections 2024-04-03T08:35:15.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:15.316+0000 7f3890a00700 1 -- 172.21.15.157:0/1822224160 wait complete. 2024-04-03T08:35:15.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705704 got 38654705706 for osd.0 2024-04-03T08:35:15.804 DEBUG:teuthology.parallel:result is None 2024-04-03T08:35:16.003 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:16.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:15 smithi157 ceph-mon[35083]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:16.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:16.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:15 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1227992091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-03T08:35:16.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:15 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1822224160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-03T08:35:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:15 smithi181 ceph-mon[44183]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:15 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1227992091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-03T08:35:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:15 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1822224160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-03T08:35:16.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855374 got 150323855377 for osd.4 2024-04-03T08:35:16.875 DEBUG:teuthology.parallel:result is None 2024-04-03T08:35:17.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 -- 172.21.15.157:0/2598364738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 msgr2=0x7f7c200fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 --2- 172.21.15.157:0/2598364738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c200fce10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c004940 tx=0x7f7c0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 -- 172.21.15.157:0/2598364738 shutdown_connections 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 --2- 172.21.15.157:0/2598364738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c200fce10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 --2- 172.21.15.157:0/2598364738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c20102e00 0x7f7c201031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 -- 172.21.15.157:0/2598364738 >> 172.21.15.157:0/2598364738 conn(0x7f7c200f89b0 msgr2=0x7f7c200fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 -- 172.21.15.157:0/2598364738 shutdown_connections 2024-04-03T08:35:17.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.132+0000 7f7c25800700 1 -- 172.21.15.157:0/2598364738 wait complete. 2024-04-03T08:35:17.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.133+0000 7f7c25800700 1 Processor -- start 2024-04-03T08:35:17.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.133+0000 7f7c25800700 1 -- start start 2024-04-03T08:35:17.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.133+0000 7f7c25800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c20102e00 0x7f7c200702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:17.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c25800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c20070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c25800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20070d90 con 0x7f7c201037a0 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c25800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20070ed0 con 0x7f7c20102e00 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c20070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c20070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50020/0 (socket says 172.21.15.157:50020) 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1e000700 1 -- 172.21.15.157:0/3704504981 learned_addr learned my addr 172.21.15.157:0/3704504981 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1ea00700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c20102e00 0x7f7c200702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1e000700 1 -- 172.21.15.157:0/3704504981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c20102e00 msgr2=0x7f7c200702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1e000700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c20102e00 0x7f7c200702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.134+0000 7f7c1e000700 1 -- 172.21.15.157:0/3704504981 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c005040 con 0x7f7c201037a0 2024-04-03T08:35:17.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.135+0000 7f7c1e000700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c20070800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009100 tx=0x7f7c0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.135+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c0c00e040 con 0x7f7c201037a0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.135+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c0c013420 con 0x7f7c201037a0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.135+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c0c01c630 con 0x7f7c201037a0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.135+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20071120 con 0x7f7c201037a0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.135+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2011a290 con 0x7f7c201037a0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.136+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c201052d0 con 0x7f7c201037a0 2024-04-03T08:35:17.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.137+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7c0c013a00 con 0x7f7c201037a0 2024-04-03T08:35:17.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.138+0000 7f7c16a00700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7c040692b0 0x7f7c0406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:17.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.138+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c0c087ff0 con 0x7f7c201037a0 2024-04-03T08:35:17.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.138+0000 7f7c1ea00700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7c040692b0 0x7f7c0406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:17.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.138+0000 7f7c1ea00700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7c040692b0 0x7f7c0406b760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c100041d0 tx=0x7f7c100043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:17.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.142+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7c0c0ba190 con 0x7f7c201037a0 2024-04-03T08:35:17.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.347+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c200719e0 con 0x7f7c201037a0 2024-04-03T08:35:17.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.348+0000 7f7c16a00700 1 -- 172.21.15.157:0/3704504981 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c0c0545c0 con 0x7f7c201037a0 2024-04-03T08:35:17.349 INFO:teuthology.orchestra.run.smithi157.stdout:115964117016 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7c040692b0 msgr2=0x7f7c0406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7c040692b0 0x7f7c0406b760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c100041d0 tx=0x7f7c100043c0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 msgr2=0x7f7c20070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c20070800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009100 tx=0x7f7c0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 shutdown_connections 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7c040692b0 0x7f7c0406b760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c20102e00 0x7f7c200702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 --2- 172.21.15.157:0/3704504981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c201037a0 0x7f7c20070800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:17.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 >> 172.21.15.157:0/3704504981 conn(0x7f7c200f89b0 msgr2=0x7f7c201021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:17.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 shutdown_connections 2024-04-03T08:35:17.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:17.350+0000 7f7c25800700 1 -- 172.21.15.157:0/3704504981 wait complete. 2024-04-03T08:35:17.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691852 for osd.5 2024-04-03T08:35:17.434 DEBUG:teuthology.parallel:result is None 2024-04-03T08:35:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:17 smithi157 ceph-mon[35083]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:17 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3704504981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-03T08:35:18.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:17 smithi181 ceph-mon[44183]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:18.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:17 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/3704504981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-03T08:35:18.345 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117013 got 115964117016 for osd.3 2024-04-03T08:35:18.345 DEBUG:teuthology.parallel:result is None 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.905+0000 7f20a4a00700 1 -- 172.21.15.157:0/3477078984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 msgr2=0x7f20a00fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.905+0000 7f20a4a00700 1 --2- 172.21.15.157:0/3477078984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a00fce30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f208c004940 tx=0x7f208c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.906+0000 7f20a4a00700 1 -- 172.21.15.157:0/3477078984 shutdown_connections 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.906+0000 7f20a4a00700 1 --2- 172.21.15.157:0/3477078984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a00fce30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.906+0000 7f20a4a00700 1 --2- 172.21.15.157:0/3477078984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20a0102e20 0x7f20a01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.906+0000 7f20a4a00700 1 -- 172.21.15.157:0/3477078984 >> 172.21.15.157:0/3477078984 conn(0x7f20a00f89d0 msgr2=0x7f20a00fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.906+0000 7f20a4a00700 1 -- 172.21.15.157:0/3477078984 shutdown_connections 2024-04-03T08:35:19.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.906+0000 7f20a4a00700 1 -- 172.21.15.157:0/3477078984 wait complete. 2024-04-03T08:35:19.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f20a4a00700 1 Processor -- start 2024-04-03T08:35:19.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f20a4a00700 1 -- start start 2024-04-03T08:35:19.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f20a4a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20a0102e20 0x7f20a0113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:19.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f20a4a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a01140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:19.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f20a4a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0114740 con 0x7f20a01037c0 2024-04-03T08:35:19.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f20a4a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a010db30 con 0x7f20a0102e20 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f209d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a01140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f209d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a01140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50040/0 (socket says 172.21.15.157:50040) 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.907+0000 7f209d400700 1 -- 172.21.15.157:0/1580725822 learned_addr learned my addr 172.21.15.157:0/1580725822 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f209de00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20a0102e20 0x7f20a0113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f209d400700 1 -- 172.21.15.157:0/1580725822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20a0102e20 msgr2=0x7f20a0113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f209d400700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20a0102e20 0x7f20a0113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f209d400700 1 -- 172.21.15.157:0/1580725822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c005040 con 0x7f20a01037c0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f209d400700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a01140f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f208c009100 tx=0x7f208c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208c00e040 con 0x7f20a01037c0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f208c013420 con 0x7f20a01037c0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a010ddb0 con 0x7f20a01037c0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208c01c630 con 0x7f20a01037c0 2024-04-03T08:35:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.908+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a010e370 con 0x7f20a01037c0 2024-04-03T08:35:19.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.910+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a01052f0 con 0x7f20a01037c0 2024-04-03T08:35:19.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.910+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f208c013590 con 0x7f20a01037c0 2024-04-03T08:35:19.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.911+0000 7f2096000700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f20840692b0 0x7f208406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:19.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.911+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f208c087fd0 con 0x7f20a01037c0 2024-04-03T08:35:19.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.912+0000 7f209de00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f20840692b0 0x7f208406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:19.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.912+0000 7f209de00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f20840692b0 0x7f208406b760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2090007fd0 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:19.916+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f208c058170 con 0x7f20a01037c0 2024-04-03T08:35:20.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:19 smithi157 ceph-mon[35083]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:20.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:19 smithi181 ceph-mon[44183]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:20.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.116+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20a010f200 con 0x7f20a01037c0 2024-04-03T08:35:20.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.116+0000 7f2096000700 1 -- 172.21.15.157:0/1580725822 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f208c057d00 con 0x7f20a01037c0 2024-04-03T08:35:20.117 INFO:teuthology.orchestra.run.smithi157.stdout:81604378653 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f20840692b0 msgr2=0x7f208406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f20840692b0 0x7f208406b760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2090007fd0 tx=0x7f2090009040 comp rx=0 tx=0).stop 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 msgr2=0x7f20a01140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a01140f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f208c009100 tx=0x7f208c009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 shutdown_connections 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f20840692b0 0x7f208406b760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20a0102e20 0x7f20a0113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 --2- 172.21.15.157:0/1580725822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a01037c0 0x7f20a01140f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:20.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 >> 172.21.15.157:0/1580725822 conn(0x7f20a00f89d0 msgr2=0x7f20a00fac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:20.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 shutdown_connections 2024-04-03T08:35:20.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:20.119+0000 7f20a4a00700 1 -- 172.21.15.157:0/1580725822 wait complete. 2024-04-03T08:35:20.784 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378651 got 81604378653 for osd.2 2024-04-03T08:35:20.784 DEBUG:teuthology.parallel:result is None 2024-04-03T08:35:20.784 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-03T08:35:20.784 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-03T08:35:21.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:20 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1580725822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-03T08:35:21.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:20 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1580725822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-03T08:35:21.210 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:22.281 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:21 smithi157 ceph-mon[35083]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:22.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:21 smithi181 ceph-mon[44183]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 -- 172.21.15.157:0/1336146148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec102e00 msgr2=0x7f9fec1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/1336146148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec102e00 0x7f9fec1031d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc004940 tx=0x7f9fdc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 -- 172.21.15.157:0/1336146148 shutdown_connections 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/1336146148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec1037a0 0x7f9fec0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/1336146148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec102e00 0x7f9fec1031d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 -- 172.21.15.157:0/1336146148 >> 172.21.15.157:0/1336146148 conn(0x7f9fec0f89b0 msgr2=0x7f9fec0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 -- 172.21.15.157:0/1336146148 shutdown_connections 2024-04-03T08:35:22.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.955+0000 7f9ff2a00700 1 -- 172.21.15.157:0/1336146148 wait complete. 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.956+0000 7f9ff2a00700 1 Processor -- start 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.956+0000 7f9ff2a00700 1 -- start start 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.956+0000 7f9ff2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec102e00 0x7f9fec0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.956+0000 7f9ff2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 0x7f9fec070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.956+0000 7f9ff2a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec070d40 con 0x7f9fec1037a0 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.956+0000 7f9ff2a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec070e80 con 0x7f9fec102e00 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 0x7f9fec070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:22.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 0x7f9fec070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59414/0 (socket says 172.21.15.157:59414) 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 -- 172.21.15.157:0/2845657905 learned_addr learned my addr 172.21.15.157:0/2845657905 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9febe00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec102e00 0x7f9fec0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 -- 172.21.15.157:0/2845657905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec102e00 msgr2=0x7f9fec0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec102e00 0x7f9fec0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 -- 172.21.15.157:0/2845657905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc005040 con 0x7f9fec1037a0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9febe00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec102e00 0x7f9fec0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9feb400700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 0x7f9fec070800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c890 tx=0x7f9fd80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.957+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd800a7d0 con 0x7f9fec1037a0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.958+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fd800ae00 con 0x7f9fec1037a0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.958+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec071130 con 0x7f9fec1037a0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.958+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd80113a0 con 0x7f9fec1037a0 2024-04-03T08:35:22.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.958+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec11a320 con 0x7f9fec1037a0 2024-04-03T08:35:22.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.959+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec100110 con 0x7f9fec1037a0 2024-04-03T08:35:22.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.960+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9fd8012400 con 0x7f9fec1037a0 2024-04-03T08:35:22.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.961+0000 7f9fe3e00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9fd00692b0 0x7f9fd006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:22.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.961+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9fd8086d60 con 0x7f9fec1037a0 2024-04-03T08:35:22.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.961+0000 7f9febe00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9fd00692b0 0x7f9fd006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:22.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.961+0000 7f9febe00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9fd00692b0 0x7f9fd006b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc000c00 tx=0x7f9fdc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:22.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:22.965+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9fd808b070 con 0x7f9fec1037a0 2024-04-03T08:35:23.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.155+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fec071130 con 0x7f9fd00692b0 2024-04-03T08:35:23.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.156+0000 7f9fe3e00700 1 -- 172.21.15.157:0/2845657905 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28057 (secure 0 0 0) 0x7f9fec071130 con 0x7f9fd00692b0 2024-04-03T08:35:23.157 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:35:23.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9fd00692b0 msgr2=0x7f9fd006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:23.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9fd00692b0 0x7f9fd006b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc000c00 tx=0x7f9fdc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:23.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 msgr2=0x7f9fec070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:23.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 0x7f9fec070800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c890 tx=0x7f9fd80044c0 comp rx=0 tx=0).stop 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 shutdown_connections 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9fd00692b0 0x7f9fd006b760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec102e00 0x7f9fec0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 --2- 172.21.15.157:0/2845657905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fec1037a0 0x7f9fec070800 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 >> 172.21.15.157:0/2845657905 conn(0x7f9fec0f89b0 msgr2=0x7f9fec1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 shutdown_connections 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:23.159+0000 7f9ff2a00700 1 -- 172.21.15.157:0/2845657905 wait complete. 2024-04-03T08:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-03T08:35:23.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:22 smithi157 ceph-mon[35083]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:22 smithi181 ceph-mon[44183]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:23.753 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-04-03T08:35:22.033111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788080,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682832,"statfs":{"total":575970213888,"available":574139219968,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001967"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-03T08:34:29.452749+0000","last_change":"2024-04-03T08:33:58.519546+0000","last_active":"2024-04-03T08:34:29.452749+0000","last_peered":"2024-04-03T08:34:29.452749+0000","last_clean":"2024-04-03T08:34:29.452749+0000","last_became_active":"2024-04-03T08:33:58.519171+0000","last_became_peered":"2024-04-03T08:33:58.519171+0000","last_unstale":"2024-04-03T08:34:29.452749+0000","last_undegraded":"2024-04-03T08:34:29.452749+0000","last_fullsized":"2024-04-03T08:34:29.452749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T08:33:00.649392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T08:33:00.649392+0000","last_clean_scrub_stamp":"2024-04-03T08:33:00.649392+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:26:11.520566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.504}]},{"osd":1,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.443},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117017,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298308,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446844,"statfs":{"total":95995035648,"available":95689568256,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.62}]},{"osd":4,"last update":"Wed Apr 3 08:35:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.433,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36499999999999999}]},{"osd":3,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.28899999999999998}]},{"osd":2,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45400000000000001,"15min":0.46100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.629}]},{"osd":4,"last update":"Wed Apr 3 08:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52200000000000002,"5min":0.746,"15min":0.746},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Apr 3 08:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.58899999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64200000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38800000000000001}]},{"osd":3,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Apr 3 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T08:35:23.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-03T08:35:24.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:23 smithi157 ceph-mon[35083]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-03T08:35:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:24.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:23 smithi181 ceph-mon[44183]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-03T08:35:25.183 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:24 smithi157 ceph-mon[35083]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:25.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:24 smithi181 ceph-mon[44183]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:25.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 -- 172.21.15.157:0/1929778913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 msgr2=0x7fa1901031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:25.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 --2- 172.21.15.157:0/1929778913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa1901031f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa180004940 tx=0x7fa180009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:25.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 -- 172.21.15.157:0/1929778913 shutdown_connections 2024-04-03T08:35:25.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 --2- 172.21.15.157:0/1929778913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1901037c0 0x7fa1900fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:25.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 --2- 172.21.15.157:0/1929778913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa1901031f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:25.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 -- 172.21.15.157:0/1929778913 >> 172.21.15.157:0/1929778913 conn(0x7fa1900f89d0 msgr2=0x7fa1900fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:25.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 -- 172.21.15.157:0/1929778913 shutdown_connections 2024-04-03T08:35:25.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.804+0000 7fa196200700 1 -- 172.21.15.157:0/1929778913 wait complete. 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.805+0000 7fa196200700 1 Processor -- start 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa196200700 1 -- start start 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa196200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa190115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa196200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1901037c0 0x7fa190116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa196200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190116880 con 0x7fa190102e20 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa196200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19010fca0 con 0x7fa1901037c0 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa18f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa190115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa18f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa190115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59442/0 (socket says 172.21.15.157:59442) 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.806+0000 7fa18f400700 1 -- 172.21.15.157:0/2219013635 learned_addr learned my addr 172.21.15.157:0/2219013635 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa18f400700 1 -- 172.21.15.157:0/2219013635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1901037c0 msgr2=0x7fa190116230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:25.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa18f400700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1901037c0 0x7fa190116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa18f400700 1 -- 172.21.15.157:0/2219013635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180005040 con 0x7fa190102e20 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa18f400700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa190115cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa1800090d0 tx=0x7fa180009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa180021070 con 0x7fa190102e20 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa180013c00 con 0x7fa190102e20 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19010ff20 con 0x7fa190102e20 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18000e070 con 0x7fa190102e20 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.807+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa190110480 con 0x7fa190102e20 2024-04-03T08:35:25.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.809+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190107320 con 0x7fa190102e20 2024-04-03T08:35:25.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.809+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa18001c400 con 0x7fa190102e20 2024-04-03T08:35:25.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.810+0000 7fa187400700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa1740692b0 0x7fa17406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:25.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.810+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa1800883f0 con 0x7fa190102e20 2024-04-03T08:35:25.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.810+0000 7fa18ea00700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa1740692b0 0x7fa17406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:25.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.811+0000 7fa18ea00700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa1740692b0 0x7fa17406b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa190111590 tx=0x7fa17c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:25.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:25.815+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa1800584f0 con 0x7fa190102e20 2024-04-03T08:35:26.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.005+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1901113d0 con 0x7fa1740692b0 2024-04-03T08:35:26.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.007+0000 7fa187400700 1 -- 172.21.15.157:0/2219013635 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28072 (secure 0 0 0) 0x7fa1901113d0 con 0x7fa1740692b0 2024-04-03T08:35:26.007 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa1740692b0 msgr2=0x7fa17406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa1740692b0 0x7fa17406b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa190111590 tx=0x7fa17c00b040 comp rx=0 tx=0).stop 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 msgr2=0x7fa190115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa190115cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa1800090d0 tx=0x7fa180009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 shutdown_connections 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa190102e20 0x7fa190115cf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa1740692b0 0x7fa17406b760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 --2- 172.21.15.157:0/2219013635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1901037c0 0x7fa190116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 >> 172.21.15.157:0/2219013635 conn(0x7fa1900f89d0 msgr2=0x7fa190070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:26.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 shutdown_connections 2024-04-03T08:35:26.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:26.009+0000 7fa196200700 1 -- 172.21.15.157:0/2219013635 wait complete. 2024-04-03T08:35:26.011 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-03T08:35:26.691 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-03T08:35:24.033384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788080,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682832,"statfs":{"total":575970213888,"available":574139219968,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001936"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-03T08:34:29.452749+0000","last_change":"2024-04-03T08:33:58.519546+0000","last_active":"2024-04-03T08:34:29.452749+0000","last_peered":"2024-04-03T08:34:29.452749+0000","last_clean":"2024-04-03T08:34:29.452749+0000","last_became_active":"2024-04-03T08:33:58.519171+0000","last_became_peered":"2024-04-03T08:33:58.519171+0000","last_unstale":"2024-04-03T08:34:29.452749+0000","last_undegraded":"2024-04-03T08:34:29.452749+0000","last_fullsized":"2024-04-03T08:34:29.452749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T08:33:00.649392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T08:33:00.649392+0000","last_clean_scrub_stamp":"2024-04-03T08:33:00.649392+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:26:11.520566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":4,"up_from":35,"seq":150323855379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.504},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.69499999999999995}]},{"osd":3,"last update":"Wed Apr 3 08:35:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":3,"up_from":27,"seq":115964117017,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298308,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446844,"statfs":{"total":95995035648,"available":95689568256,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.62}]},{"osd":4,"last update":"Wed Apr 3 08:35:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.433,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36499999999999999}]},{"osd":3,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Apr 3 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.28899999999999998}]},{"osd":2,"last update":"Wed Apr 3 08:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45400000000000001,"15min":0.46100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.629}]},{"osd":4,"last update":"Wed Apr 3 08:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52200000000000002,"5min":0.746,"15min":0.746},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed Apr 3 08:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.58899999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64200000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Apr 3 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Wed Apr 3 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T08:35:26.692 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-03T08:35:26.692 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-03T08:35:26.693 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-03T08:35:26.693 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph health --format=json 2024-04-03T08:35:27.114 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:27.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:27 smithi181 ceph-mon[44183]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-03T08:35:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:27 smithi181 ceph-mon[44183]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:27.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:27 smithi157 ceph-mon[35083]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-03T08:35:27.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:27 smithi157 ceph-mon[35083]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 -- 172.21.15.157:0/750253358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 msgr2=0x7fe5801031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 --2- 172.21.15.157:0/750253358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe5801031d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe570004940 tx=0x7fe570009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 -- 172.21.15.157:0/750253358 shutdown_connections 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 --2- 172.21.15.157:0/750253358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5801037a0 0x7fe5800fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 --2- 172.21.15.157:0/750253358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe5801031d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 -- 172.21.15.157:0/750253358 >> 172.21.15.157:0/750253358 conn(0x7fe5800f89b0 msgr2=0x7fe5800fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 -- 172.21.15.157:0/750253358 shutdown_connections 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.808+0000 7fe585c00700 1 -- 172.21.15.157:0/750253358 wait complete. 2024-04-03T08:35:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.809+0000 7fe585c00700 1 Processor -- start 2024-04-03T08:35:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.809+0000 7fe585c00700 1 -- start start 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe585c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe580115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe585c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5801037a0 0x7fe5801162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe585c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580116910 con 0x7fe580102e00 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe585c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58010fce0 con 0x7fe5801037a0 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe57ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe580115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe57ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe580115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59460/0 (socket says 172.21.15.157:59460) 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe57ea00700 1 -- 172.21.15.157:0/1167995507 learned_addr learned my addr 172.21.15.157:0/1167995507 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe57ea00700 1 -- 172.21.15.157:0/1167995507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5801037a0 msgr2=0x7fe5801162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe57ea00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5801037a0 0x7fe5801162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.810+0000 7fe57ea00700 1 -- 172.21.15.157:0/1167995507 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570005040 con 0x7fe580102e00 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.811+0000 7fe57ea00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe580115d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe570009180 tx=0x7fe570009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.811+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57000e040 con 0x7fe580102e00 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.811+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe57000bbc0 con 0x7fe580102e00 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.811+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58010ff60 con 0x7fe580102e00 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.811+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57001c630 con 0x7fe580102e00 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.811+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe580110520 con 0x7fe580102e00 2024-04-03T08:35:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.812+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580106a70 con 0x7fe580102e00 2024-04-03T08:35:28.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.813+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe57000bd30 con 0x7fe580102e00 2024-04-03T08:35:28.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.814+0000 7fe576a00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5640692b0 0x7fe56406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:28.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.814+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe570088200 con 0x7fe580102e00 2024-04-03T08:35:28.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.814+0000 7fe57e000700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5640692b0 0x7fe56406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:28.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.815+0000 7fe57e000700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5640692b0 0x7fe56406b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe580111620 tx=0x7fe56c009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:28.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:28.818+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe5700582e0 con 0x7fe580102e00 2024-04-03T08:35:29.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.056+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5800fe550 con 0x7fe580102e00 2024-04-03T08:35:29.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.057+0000 7fe576a00700 1 -- 172.21.15.157:0/1167995507 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe570057e70 con 0x7fe580102e00 2024-04-03T08:35:29.057 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:35:29.057 INFO:teuthology.orchestra.run.smithi157.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-03T08:35:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5640692b0 msgr2=0x7fe56406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5640692b0 0x7fe56406b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe580111620 tx=0x7fe56c009ce0 comp rx=0 tx=0).stop 2024-04-03T08:35:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 msgr2=0x7fe580115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe580115d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe570009180 tx=0x7fe570009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 shutdown_connections 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe580102e00 0x7fe580115d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5640692b0 0x7fe56406b760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 --2- 172.21.15.157:0/1167995507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5801037a0 0x7fe5801162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 >> 172.21.15.157:0/1167995507 conn(0x7fe5800f89b0 msgr2=0x7fe5801073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 shutdown_connections 2024-04-03T08:35:29.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:29.059+0000 7fe585c00700 1 -- 172.21.15.157:0/1167995507 wait complete. 2024-04-03T08:35:29.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:29 smithi181 ceph-mon[44183]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:29 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1167995507' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-03T08:35:29.392 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:29 smithi157 ceph-mon[35083]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:29.392 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:29 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1167995507' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-03T08:35:29.703 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-03T08:35:29.703 INFO:tasks.cephadm:Setup complete, yielding 2024-04-03T08:35:29.703 INFO:teuthology.run_tasks:Running task print... 2024-04-03T08:35:29.712 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-03T08:35:29.712 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:35:29.765 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:35:29.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-03T08:35:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:30.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:30.455 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:31.302 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:31 smithi157 ceph-mon[35083]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:31.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:31 smithi181 ceph-mon[44183]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 -- 172.21.15.157:0/1285546002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 msgr2=0x7fd904070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 --2- 172.21.15.157:0/1285546002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd904070d00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0004940 tx=0x7fd8f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 -- 172.21.15.157:0/1285546002 shutdown_connections 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 --2- 172.21.15.157:0/1285546002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd904070d00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 --2- 172.21.15.157:0/1285546002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd904071e40 0x7fd904070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 -- 172.21.15.157:0/1285546002 >> 172.21.15.157:0/1285546002 conn(0x7fd9040f8540 msgr2=0x7fd9040fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 -- 172.21.15.157:0/1285546002 shutdown_connections 2024-04-03T08:35:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.954+0000 7fd90be00700 1 -- 172.21.15.157:0/1285546002 wait complete. 2024-04-03T08:35:31.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.955+0000 7fd90be00700 1 Processor -- start 2024-04-03T08:35:31.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.955+0000 7fd90be00700 1 -- start start 2024-04-03T08:35:31.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.955+0000 7fd90be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd90410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:31.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.955+0000 7fd90be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd904071e40 0x7fd9041100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:31.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.955+0000 7fd90be00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9041106f0 con 0x7fd904070890 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.955+0000 7fd90be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd904110f40 con 0x7fd904071e40 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd90410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd90410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59482/0 (socket says 172.21.15.157:59482) 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 -- 172.21.15.157:0/3181912807 learned_addr learned my addr 172.21.15.157:0/3181912807 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd908a00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd904071e40 0x7fd9041100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 -- 172.21.15.157:0/3181912807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd904071e40 msgr2=0x7fd9041100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd904071e40 0x7fd9041100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 -- 172.21.15.157:0/3181912807 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0005040 con 0x7fd904070890 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.956+0000 7fd909400700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd90410fbb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800eb70 tx=0x7fd8f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.957+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f8007cc0 con 0x7fd904070890 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.957+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8f800f040 con 0x7fd904070890 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.957+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9041111c0 con 0x7fd904070890 2024-04-03T08:35:31.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.957+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f800cbd0 con 0x7fd904070890 2024-04-03T08:35:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.957+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd904111700 con 0x7fd904070890 2024-04-03T08:35:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.958+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90405f5f0 con 0x7fd904070890 2024-04-03T08:35:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.959+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd8f800cd30 con 0x7fd904070890 2024-04-03T08:35:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.960+0000 7fd901600700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd8ec0692b0 0x7fd8ec06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.960+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd8f8086940 con 0x7fd904070890 2024-04-03T08:35:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.960+0000 7fd908a00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd8ec0692b0 0x7fd8ec06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.960+0000 7fd908a00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd8ec0692b0 0x7fd8ec06b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000b0d0 tx=0x7fd8f0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:31.964+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd8f804e190 con 0x7fd904070890 2024-04-03T08:35:32.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.161+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fd90404bed0 con 0x7fd904070890 2024-04-03T08:35:32.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.166+0000 7fd901600700 1 -- 172.21.15.157:0/3181912807 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd8f8056a50 con 0x7fd904070890 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd8ec0692b0 msgr2=0x7fd8ec06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd8ec0692b0 0x7fd8ec06b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000b0d0 tx=0x7fd8f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 msgr2=0x7fd90410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd90410fbb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800eb70 tx=0x7fd8f800b040 comp rx=0 tx=0).stop 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 shutdown_connections 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd904070890 0x7fd90410fbb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd8ec0692b0 0x7fd8ec06b760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 --2- 172.21.15.157:0/3181912807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd904071e40 0x7fd9041100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.168+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 >> 172.21.15.157:0/3181912807 conn(0x7fd9040f8540 msgr2=0x7fd9040f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:32.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.169+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 shutdown_connections 2024-04-03T08:35:32.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:32.169+0000 7fd90be00700 1 -- 172.21.15.157:0/3181912807 wait complete. 2024-04-03T08:35:32.791 INFO:teuthology.run_tasks:Running task print... 2024-04-03T08:35:32.800 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-03T08:35:32.801 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:35:32.831 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:35:32.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph orch status' 2024-04-03T08:35:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:33.525 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:33 smithi157 ceph-mon[35083]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:33.525 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:33 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3181912807' entity='client.admin' 2024-04-03T08:35:33.525 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:35:33.525 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:33.526 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:33 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:35:33.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:33 smithi181 ceph-mon[44183]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:33 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/3181912807' entity='client.admin' 2024-04-03T08:35:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:35:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:33 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:35:34.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:34 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:34.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:34 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 -- 172.21.15.157:0/3008795903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 msgr2=0x7f81300fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 --2- 172.21.15.157:0/3008795903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f81300fd020 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8120004940 tx=0x7f8120009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 -- 172.21.15.157:0/3008795903 shutdown_connections 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 --2- 172.21.15.157:0/3008795903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 0x7f81300fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 --2- 172.21.15.157:0/3008795903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f81300fd020 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 -- 172.21.15.157:0/3008795903 >> 172.21.15.157:0/3008795903 conn(0x7f81300f83d0 msgr2=0x7f81300fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 -- 172.21.15.157:0/3008795903 shutdown_connections 2024-04-03T08:35:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.938+0000 7f8135a00700 1 -- 172.21.15.157:0/3008795903 wait complete. 2024-04-03T08:35:34.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.939+0000 7f8135a00700 1 Processor -- start 2024-04-03T08:35:34.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.939+0000 7f8135a00700 1 -- start start 2024-04-03T08:35:34.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f8135a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f8130071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:34.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f8135a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 0x7f8130070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:34.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f8135a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301114d0 con 0x7f81300fcc10 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f8135a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8130111640 con 0x7f81300fdec0 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f8130071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f8130071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47260/0 (socket says 172.21.15.157:47260) 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 -- 172.21.15.157:0/2564525622 learned_addr learned my addr 172.21.15.157:0/2564525622 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812f400700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 0x7f8130070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 -- 172.21.15.157:0/2564525622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 msgr2=0x7f8130070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 0x7f8130070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 -- 172.21.15.157:0/2564525622 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120005040 con 0x7f81300fcc10 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812f400700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 0x7f8130070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.940+0000 7f812fe00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f8130071e40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f812000b3b0 tx=0x7f8120009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.941+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f812000e040 con 0x7f81300fcc10 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.941+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8120004290 con 0x7f81300fcc10 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.941+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8130070910 con 0x7f81300fcc10 2024-04-03T08:35:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.941+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f812001c630 con 0x7f81300fcc10 2024-04-03T08:35:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.941+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8130070e80 con 0x7f81300fcc10 2024-04-03T08:35:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.942+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813005f5f0 con 0x7f81300fcc10 2024-04-03T08:35:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.943+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f812000bbf0 con 0x7f81300fcc10 2024-04-03T08:35:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.944+0000 7f8127e00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f81140692b0 0x7f811406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.944+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f81200882c0 con 0x7f81300fcc10 2024-04-03T08:35:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.944+0000 7f812f400700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f81140692b0 0x7f811406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:34.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.944+0000 7f812f400700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f81140692b0 0x7f811406b760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f811c0095c0 tx=0x7f811c007f20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:34.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:34.948+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8120054910 con 0x7f81300fcc10 2024-04-03T08:35:35.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.161+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81301021d0 con 0x7f81140692b0 2024-04-03T08:35:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.162+0000 7f8127e00700 1 -- 172.21.15.157:0/2564525622 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f81301021d0 con 0x7f81140692b0 2024-04-03T08:35:35.163 INFO:teuthology.orchestra.run.smithi157.stdout:Backend: cephadm 2024-04-03T08:35:35.163 INFO:teuthology.orchestra.run.smithi157.stdout:Available: Yes 2024-04-03T08:35:35.163 INFO:teuthology.orchestra.run.smithi157.stdout:Paused: No 2024-04-03T08:35:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.164+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f81140692b0 msgr2=0x7f811406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.164+0000 7f8135a00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f81140692b0 0x7f811406b760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f811c0095c0 tx=0x7f811c007f20 comp rx=0 tx=0).stop 2024-04-03T08:35:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.164+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 msgr2=0x7f8130071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.164+0000 7f8135a00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f8130071e40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f812000b3b0 tx=0x7f8120009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 shutdown_connections 2024-04-03T08:35:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81300fcc10 0x7f8130071e40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f81140692b0 0x7f811406b760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 --2- 172.21.15.157:0/2564525622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81300fdec0 0x7f8130070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 >> 172.21.15.157:0/2564525622 conn(0x7f81300f83d0 msgr2=0x7f81300f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 shutdown_connections 2024-04-03T08:35:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:35.165+0000 7f8135a00700 1 -- 172.21.15.157:0/2564525622 wait complete. 2024-04-03T08:35:35.467 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:35 smithi157 ceph-mon[35083]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:35.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:35 smithi181 ceph-mon[44183]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:35.778 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph orch ps' 2024-04-03T08:35:36.202 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:36.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:36 smithi157 ceph-mon[35083]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:36.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:36 smithi181 ceph-mon[44183]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:37.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:37 smithi157 ceph-mon[35083]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:37.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:37 smithi181 ceph-mon[44183]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:37.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.915+0000 7ff85da00700 1 -- 172.21.15.157:0/3886951511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fe0d0 msgr2=0x7ff8580fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:37.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.915+0000 7ff85da00700 1 --2- 172.21.15.157:0/3886951511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fe0d0 0x7ff8580fe540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff844004940 tx=0x7ff844009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:37.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.915+0000 7ff85da00700 1 -- 172.21.15.157:0/3886951511 shutdown_connections 2024-04-03T08:35:37.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.915+0000 7ff85da00700 1 --2- 172.21.15.157:0/3886951511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fe0d0 0x7ff8580fe540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:37.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.915+0000 7ff85da00700 1 --2- 172.21.15.157:0/3886951511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8580fcee0 0x7ff8580fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:37.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.915+0000 7ff85da00700 1 -- 172.21.15.157:0/3886951511 >> 172.21.15.157:0/3886951511 conn(0x7ff8580f8560 msgr2=0x7ff8580fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:37.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.916+0000 7ff85da00700 1 -- 172.21.15.157:0/3886951511 shutdown_connections 2024-04-03T08:35:37.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.916+0000 7ff85da00700 1 -- 172.21.15.157:0/3886951511 wait complete. 2024-04-03T08:35:37.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.916+0000 7ff85da00700 1 Processor -- start 2024-04-03T08:35:37.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.916+0000 7ff85da00700 1 -- start start 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff85da00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 0x7ff858071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff85da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8580fe0d0 0x7ff858070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff85da00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580708c0 con 0x7ff8580fcee0 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff85da00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858070a30 con 0x7ff8580fe0d0 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 0x7ff858071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 0x7ff858071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47284/0 (socket says 172.21.15.157:47284) 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856a00700 1 -- 172.21.15.157:0/3347519584 learned_addr learned my addr 172.21.15.157:0/3347519584 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856000700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8580fe0d0 0x7ff858070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856a00700 1 -- 172.21.15.157:0/3347519584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8580fe0d0 msgr2=0x7ff858070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856a00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8580fe0d0 0x7ff858070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.917+0000 7ff856a00700 1 -- 172.21.15.157:0/3347519584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844005040 con 0x7ff8580fcee0 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.918+0000 7ff856a00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 0x7ff858071e40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c8e0 tx=0x7ff8480044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:37.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.918+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff84800a940 con 0x7ff8580fcee0 2024-04-03T08:35:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.918+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff84800ce80 con 0x7ff8580fcee0 2024-04-03T08:35:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.918+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8480113a0 con 0x7ff8580fcee0 2024-04-03T08:35:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.918+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff858070d10 con 0x7ff8580fcee0 2024-04-03T08:35:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.918+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff858115aa0 con 0x7ff8580fcee0 2024-04-03T08:35:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.919+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85805f5f0 con 0x7ff8580fcee0 2024-04-03T08:35:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.920+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff848012400 con 0x7ff8580fcee0 2024-04-03T08:35:37.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.921+0000 7ff84ea00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff83c0692b0 0x7ff83c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:37.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.921+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff848086ff0 con 0x7ff8580fcee0 2024-04-03T08:35:37.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.922+0000 7ff856000700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff83c0692b0 0x7ff83c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:37.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.922+0000 7ff856000700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff83c0692b0 0x7ff83c06b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff844004f90 tx=0x7ff844009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:37.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:37.925+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff8480535c0 con 0x7ff8580fcee0 2024-04-03T08:35:38.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.131+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff858102430 con 0x7ff83c0692b0 2024-04-03T08:35:38.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.140+0000 7ff84ea00700 1 -- 172.21.15.157:0/3347519584 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7ff858102430 con 0x7ff83c0692b0 2024-04-03T08:35:38.140 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:35:38.140 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (4m) 2m ago 5m 13.4M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:35:38.140 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (6m) 2m ago 6m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (4m) 70s ago 4m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (4m) 2m ago 5m 73.1M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (7m) 2m ago 7m 473M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (4m) 70s ago 4m 431M - 17.2.7-805-g6fda41ff a49113eacc58 ef09dfea7a47 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (7m) 2m ago 7m 42.0M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (4m) 70s ago 4m 37.6M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 2m ago 5m 7365k - 1.5.0 0da6a335fe13 2baa04300c28 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (4m) 70s ago 4m 7499k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (3m) 2m ago 3m 38.3M 4348M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (3m) 2m ago 3m 38.1M 4348M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (2m) 2m ago 2m 39.1M 4348M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (2m) 70s ago 2m 38.2M 5372M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (106s) 70s ago 105s 36.4M 5372M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:35:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (75s) 70s ago 74s 10.5M 5372M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:35:38.142 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (3m) 2m ago 5m 34.4M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff83c0692b0 msgr2=0x7ff83c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff83c0692b0 0x7ff83c06b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff844004f90 tx=0x7ff844009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 msgr2=0x7ff858071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 0x7ff858071e40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c8e0 tx=0x7ff8480044c0 comp rx=0 tx=0).stop 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 shutdown_connections 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8580fcee0 0x7ff858071e40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff83c0692b0 0x7ff83c06b760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 --2- 172.21.15.157:0/3347519584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8580fe0d0 0x7ff858070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 >> 172.21.15.157:0/3347519584 conn(0x7ff8580f8560 msgr2=0x7ff8580f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 shutdown_connections 2024-04-03T08:35:38.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:38.142+0000 7ff85da00700 1 -- 172.21.15.157:0/3347519584 wait complete. 2024-04-03T08:35:38.755 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph orch ls' 2024-04-03T08:35:39.175 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:39.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:39 smithi157 ceph-mon[35083]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:39.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:39 smithi157 ceph-mon[35083]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:39.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:39 smithi181 ceph-mon[44183]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:39.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:39 smithi181 ceph-mon[44183]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 -- 172.21.15.157:0/1000698297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 msgr2=0x7f3cc80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 --2- 172.21.15.157:0/1000698297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc80fd310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc004940 tx=0x7f3cbc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 -- 172.21.15.157:0/1000698297 shutdown_connections 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 --2- 172.21.15.157:0/1000698297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 0x7f3cc80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 --2- 172.21.15.157:0/1000698297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc80fd310 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 -- 172.21.15.157:0/1000698297 >> 172.21.15.157:0/1000698297 conn(0x7f3cc80f8560 msgr2=0x7f3cc80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 -- 172.21.15.157:0/1000698297 shutdown_connections 2024-04-03T08:35:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.936+0000 7f3cd0200700 1 -- 172.21.15.157:0/1000698297 wait complete. 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.937+0000 7f3cd0200700 1 Processor -- start 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.937+0000 7f3cd0200700 1 -- start start 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.937+0000 7f3cd0200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3cd0200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 0x7f3cc8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3cd0200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80708c0 con 0x7f3cc80fcee0 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3cd0200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8070a30 con 0x7f3cc80fe0d0 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47306/0 (socket says 172.21.15.157:47306) 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 -- 172.21.15.157:0/3320506962 learned_addr learned my addr 172.21.15.157:0/3320506962 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccce00700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 0x7f3cc8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 -- 172.21.15.157:0/3320506962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 msgr2=0x7f3cc8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 0x7f3cc8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 -- 172.21.15.157:0/3320506962 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc005040 con 0x7f3cc80fcee0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccce00700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 0x7f3cc8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.938+0000 7f3ccd800700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc8071e40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00b970 tx=0x7f3cbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.939+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cbc00e040 con 0x7f3cc80fcee0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.939+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cbc00bbf0 con 0x7f3cc80fcee0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.939+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cbc01c630 con 0x7f3cc80fcee0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.939+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc8070cb0 con 0x7f3cc80fcee0 2024-04-03T08:35:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.939+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc8115a90 con 0x7f3cc80fcee0 2024-04-03T08:35:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.940+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc805f5f0 con 0x7f3cc80fcee0 2024-04-03T08:35:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.941+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3cbc00bd60 con 0x7f3cc80fcee0 2024-04-03T08:35:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.941+0000 7f3cc5600700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3cb00692b0 0x7f3cb006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.942+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3cbc088200 con 0x7f3cc80fcee0 2024-04-03T08:35:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.942+0000 7f3ccce00700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3cb00692b0 0x7f3cb006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.942+0000 7f3ccce00700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3cb00692b0 0x7f3cb006b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40095c0 tx=0x7f3cb4007f20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:40.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:40.946+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3cbc054900 con 0x7f3cc80fcee0 2024-04-03T08:35:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.151+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cc81024e0 con 0x7f3cb00692b0 2024-04-03T08:35:41.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.156+0000 7f3cc5600700 1 -- 172.21.15.157:0/3320506962 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7f3cc81024e0 con 0x7f3cb00692b0 2024-04-03T08:35:41.156 INFO:teuthology.orchestra.run.smithi157.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-03T08:35:41.156 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-04-03T08:35:41.156 INFO:teuthology.orchestra.run.smithi157.stdout:crash 2/2 2m ago 6m * 2024-04-03T08:35:41.157 INFO:teuthology.orchestra.run.smithi157.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-04-03T08:35:41.157 INFO:teuthology.orchestra.run.smithi157.stdout:mgr 2/2 2m ago 6m count:2 2024-04-03T08:35:41.157 INFO:teuthology.orchestra.run.smithi157.stdout:mon 2/2 2m ago 5m smithi157:172.21.15.157=smithi157;smithi181:172.21.15.181=smithi181;count:2 2024-04-03T08:35:41.157 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-04-03T08:35:41.157 INFO:teuthology.orchestra.run.smithi157.stdout:osd 6 2m ago - 2024-04-03T08:35:41.157 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3cb00692b0 msgr2=0x7f3cb006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3cb00692b0 0x7f3cb006b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40095c0 tx=0x7f3cb4007f20 comp rx=0 tx=0).stop 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 msgr2=0x7f3cc8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc8071e40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00b970 tx=0x7f3cbc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 shutdown_connections 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80fcee0 0x7f3cc8071e40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3cb00692b0 0x7f3cb006b760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 --2- 172.21.15.157:0/3320506962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cc80fe0d0 0x7f3cc8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.158+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 >> 172.21.15.157:0/3320506962 conn(0x7f3cc80f8560 msgr2=0x7f3cc80f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.159+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 shutdown_connections 2024-04-03T08:35:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:41.159+0000 7f3cd0200700 1 -- 172.21.15.157:0/3320506962 wait complete. 2024-04-03T08:35:41.509 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:41 smithi157 ceph-mon[35083]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:41.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:41 smithi181 ceph-mon[44183]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:41.836 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph orch host ls' 2024-04-03T08:35:42.262 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:42.513 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:42 smithi157 ceph-mon[35083]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:42 smithi181 ceph-mon[44183]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:43.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:43 smithi157 ceph-mon[35083]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:43.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:43 smithi181 ceph-mon[44183]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 -- 172.21.15.157:0/2412322867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fcee0 msgr2=0x7fe5fc0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 --2- 172.21.15.157:0/2412322867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fcee0 0x7fe5fc0fd310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec004940 tx=0x7fe5ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 -- 172.21.15.157:0/2412322867 shutdown_connections 2024-04-03T08:35:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 --2- 172.21.15.157:0/2412322867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 --2- 172.21.15.157:0/2412322867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fcee0 0x7fe5fc0fd310 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 -- 172.21.15.157:0/2412322867 >> 172.21.15.157:0/2412322867 conn(0x7fe5fc0f8560 msgr2=0x7fe5fc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 -- 172.21.15.157:0/2412322867 shutdown_connections 2024-04-03T08:35:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:43.999+0000 7fe601600700 1 -- 172.21.15.157:0/2412322867 wait complete. 2024-04-03T08:35:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.000+0000 7fe601600700 1 Processor -- start 2024-04-03T08:35:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe601600700 1 -- start start 2024-04-03T08:35:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe601600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5fc0fcee0 0x7fe5fc10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe601600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe601600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc110720 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe601600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc110f70 con 0x7fe5fc0fcee0 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe5fa000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe5fa000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38848/0 (socket says 172.21.15.157:38848) 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.001+0000 7fe5fa000700 1 -- 172.21.15.157:0/1627308608 learned_addr learned my addr 172.21.15.157:0/1627308608 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5faa00700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5fc0fcee0 0x7fe5fc10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5fa000700 1 -- 172.21.15.157:0/1627308608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5fc0fcee0 msgr2=0x7fe5fc10fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5fa000700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5fc0fcee0 0x7fe5fc10fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5fa000700 1 -- 172.21.15.157:0/1627308608 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec005040 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5fa000700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc110120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8002a80 tx=0x7fe5e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e8007cc0 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5e800f040 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc111250 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e800dac0 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.002+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc111790 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.004+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc101a60 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.004+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe5e800dc20 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.005+0000 7fe5f2a00700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5e00692b0 0x7fe5e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.005+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe5e80869d0 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.006+0000 7fe5faa00700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5e00692b0 0x7fe5e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.006+0000 7fe5faa00700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5e00692b0 0x7fe5e006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00b3b0 tx=0x7fe5ec009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:44.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.010+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe5e8056ad0 con 0x7fe5fc0fe0d0 2024-04-03T08:35:44.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.212+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5fc111a00 con 0x7fe5e00692b0 2024-04-03T08:35:44.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.214+0000 7fe5f2a00700 1 -- 172.21.15.157:0/1627308608 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fe5fc111a00 con 0x7fe5e00692b0 2024-04-03T08:35:44.214 INFO:teuthology.orchestra.run.smithi157.stdout:HOST ADDR LABELS STATUS 2024-04-03T08:35:44.215 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157 172.21.15.157 2024-04-03T08:35:44.215 INFO:teuthology.orchestra.run.smithi157.stdout:smithi181 172.21.15.181 2024-04-03T08:35:44.215 INFO:teuthology.orchestra.run.smithi157.stdout:2 hosts in cluster 2024-04-03T08:35:44.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.216+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5e00692b0 msgr2=0x7fe5e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:44.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.216+0000 7fe601600700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5e00692b0 0x7fe5e006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00b3b0 tx=0x7fe5ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:44.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.216+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 msgr2=0x7fe5fc110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:44.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.216+0000 7fe601600700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc110120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8002a80 tx=0x7fe5e80046b0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 shutdown_connections 2024-04-03T08:35:44.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe5e00692b0 0x7fe5e006b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5fc0fcee0 0x7fe5fc10fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 --2- 172.21.15.157:0/1627308608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc0fe0d0 0x7fe5fc110120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:44.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 >> 172.21.15.157:0/1627308608 conn(0x7fe5fc0f8560 msgr2=0x7fe5fc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:44.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 shutdown_connections 2024-04-03T08:35:44.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:44.217+0000 7fe601600700 1 -- 172.21.15.157:0/1627308608 wait complete. 2024-04-03T08:35:44.826 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph orch device ls' 2024-04-03T08:35:45.251 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:45.469 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:45 smithi157 ceph-mon[35083]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:45.469 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:45 smithi157 ceph-mon[35083]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:45.469 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:45.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:45 smithi181 ceph-mon[44183]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:45.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:45 smithi181 ceph-mon[44183]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:35:47.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 -- 172.21.15.157:0/2731247607 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fcee0 msgr2=0x7f3cb80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:47.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 --2- 172.21.15.157:0/2731247607 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fcee0 0x7f3cb80fd310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8004940 tx=0x7f3ca8009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:47.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 -- 172.21.15.157:0/2731247607 shutdown_connections 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 --2- 172.21.15.157:0/2731247607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 --2- 172.21.15.157:0/2731247607 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fcee0 0x7f3cb80fd310 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 -- 172.21.15.157:0/2731247607 >> 172.21.15.157:0/2731247607 conn(0x7f3cb80f8560 msgr2=0x7f3cb80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 -- 172.21.15.157:0/2731247607 shutdown_connections 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.072+0000 7f3cbce00700 1 -- 172.21.15.157:0/2731247607 wait complete. 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.073+0000 7f3cbce00700 1 Processor -- start 2024-04-03T08:35:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.073+0000 7f3cbce00700 1 -- start start 2024-04-03T08:35:47.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.073+0000 7f3cbce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cb80fcee0 0x7f3cb810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.073+0000 7f3cbce00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb8110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.073+0000 7f3cbce00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8110860 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.073+0000 7f3cbce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8110fa0 con 0x7f3cb80fcee0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb8110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb8110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38856/0 (socket says 172.21.15.157:38856) 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 -- 172.21.15.157:0/1225005949 learned_addr learned my addr 172.21.15.157:0/1225005949 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5e00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cb80fcee0 0x7f3cb810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 -- 172.21.15.157:0/1225005949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cb80fcee0 msgr2=0x7f3cb810fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cb80fcee0 0x7f3cb810fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 -- 172.21.15.157:0/1225005949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8005040 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cb5400700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb8110260 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4002a50 tx=0x7f3ca40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.074+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ca4007cc0 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.075+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ca400f040 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.075+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb8111280 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.075+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ca400da30 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.075+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8111840 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.076+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb8101a60 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.076+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3ca400db90 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.077+0000 7f3cae000700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3c9c0692b0 0x7f3c9c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.077+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3ca4086ca0 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.078+0000 7f3cb5e00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3c9c0692b0 0x7f3c9c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.078+0000 7f3cb5e00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3c9c0692b0 0x7f3c9c06b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000c00 tx=0x7f3ca8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:47.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.081+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3ca4056c80 con 0x7f3cb80fe0d0 2024-04-03T08:35:47.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.285+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cb8111a60 con 0x7f3c9c0692b0 2024-04-03T08:35:47.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.287+0000 7f3cae000700 1 -- 172.21.15.157:0/1225005949 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f3cb8111a60 con 0x7f3c9c0692b0 2024-04-03T08:35:47.288 INFO:teuthology.orchestra.run.smithi157.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-03T08:35:47.288 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-04-03T08:35:47.288 INFO:teuthology.orchestra.run.smithi157.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 74s ago Has a FileSystem, LVM detected 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.289+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3c9c0692b0 msgr2=0x7f3c9c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.289+0000 7f3cbce00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3c9c0692b0 0x7f3c9c06b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000c00 tx=0x7f3ca8009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.289+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 msgr2=0x7f3cb8110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.289+0000 7f3cbce00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb8110260 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4002a50 tx=0x7f3ca40046b0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 shutdown_connections 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f3c9c0692b0 0x7f3c9c06b760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cb80fcee0 0x7f3cb810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 --2- 172.21.15.157:0/1225005949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80fe0d0 0x7f3cb8110260 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 >> 172.21.15.157:0/1225005949 conn(0x7f3cb80f8560 msgr2=0x7f3cb80f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 shutdown_connections 2024-04-03T08:35:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:47.290+0000 7f3cbce00700 1 -- 172.21.15.157:0/1225005949 wait complete. 2024-04-03T08:35:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:47 smithi157 ceph-mon[35083]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:47.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:47 smithi181 ceph-mon[44183]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:47.947 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:35:47.957 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:35:47.957 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-03T08:35:48.381 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:48.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:48 smithi157 ceph-mon[35083]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:48.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:48 smithi181 ceph-mon[44183]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:49 smithi157 ceph-mon[35083]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:49.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:49 smithi181 ceph-mon[44183]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:50.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.085+0000 7fecc7e00700 1 -- 172.21.15.157:0/3702228764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 msgr2=0x7fecc80fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:50.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3702228764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc80fe330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fecb4004940 tx=0x7fecb4009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:50.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 -- 172.21.15.157:0/3702228764 shutdown_connections 2024-04-03T08:35:50.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3702228764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc80fe330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:50.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3702228764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecc80fcc10 0x7fecc80fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:50.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 -- 172.21.15.157:0/3702228764 >> 172.21.15.157:0/3702228764 conn(0x7fecc80f83d0 msgr2=0x7fecc80fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:50.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 -- 172.21.15.157:0/3702228764 shutdown_connections 2024-04-03T08:35:50.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 -- 172.21.15.157:0/3702228764 wait complete. 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.086+0000 7fecc7e00700 1 Processor -- start 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc7e00700 1 -- start start 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecc80fcc10 0x7fecc810f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc810ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc8110520 con 0x7fecc80fdec0 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc8110d70 con 0x7fecc80fcc10 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc6000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc810ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc6000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc810ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38876/0 (socket says 172.21.15.157:38876) 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc6000700 1 -- 172.21.15.157:0/3710550677 learned_addr learned my addr 172.21.15.157:0/3710550677 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.087+0000 7fecc6a00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecc80fcc10 0x7fecc810f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecc6000700 1 -- 172.21.15.157:0/3710550677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecc80fcc10 msgr2=0x7fecc810f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecc6000700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecc80fcc10 0x7fecc810f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecc6000700 1 -- 172.21.15.157:0/3710550677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4005040 con 0x7fecc80fdec0 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecc6000700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc810ff20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b0d0 tx=0x7fecb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb400e030 con 0x7fecc80fdec0 2024-04-03T08:35:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecb401c400 con 0x7fecc80fdec0 2024-04-03T08:35:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb400b630 con 0x7fecc80fdec0 2024-04-03T08:35:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc8110ff0 con 0x7fecc80fdec0 2024-04-03T08:35:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.088+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc8111530 con 0x7fecc80fdec0 2024-04-03T08:35:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.089+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc8101850 con 0x7fecc80fdec0 2024-04-03T08:35:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.090+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fecb401c570 con 0x7fecc80fdec0 2024-04-03T08:35:50.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.091+0000 7fecbea00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fecac0692a0 0x7fecac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:50.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.091+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fecb40887f0 con 0x7fecc80fdec0 2024-04-03T08:35:50.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.091+0000 7fecc6a00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fecac0692a0 0x7fecac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:50.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.092+0000 7fecc6a00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fecac0692a0 0x7fecac06b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009b80 tx=0x7fecb800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:50.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.095+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fecb40588d0 con 0x7fecc80fdec0 2024-04-03T08:35:50.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:50.325+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fecc81117a0 con 0x7fecac0692a0 2024-04-03T08:35:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:51 smithi157 ceph-mon[35083]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:51 smithi157 ceph-mon[35083]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:51 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-03T08:35:51.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:51 smithi181 ceph-mon[44183]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:51.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:51 smithi181 ceph-mon[44183]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:35:51.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:51 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-03T08:35:52.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.265+0000 7fecbea00700 1 -- 172.21.15.157:0/3710550677 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fecc81117a0 con 0x7fecac0692a0 2024-04-03T08:35:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.268+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fecac0692a0 msgr2=0x7fecac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.268+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fecac0692a0 0x7fecac06b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009b80 tx=0x7fecb800b040 comp rx=0 tx=0).stop 2024-04-03T08:35:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.268+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 msgr2=0x7fecc810ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.268+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc810ff20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b0d0 tx=0x7fecb4009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 shutdown_connections 2024-04-03T08:35:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fecac0692a0 0x7fecac06b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecc80fcc10 0x7fecc810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 --2- 172.21.15.157:0/3710550677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc80fdec0 0x7fecc810ff20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 >> 172.21.15.157:0/3710550677 conn(0x7fecc80f83d0 msgr2=0x7fecc80f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 shutdown_connections 2024-04-03T08:35:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:52.269+0000 7fecc7e00700 1 -- 172.21.15.157:0/3710550677 wait complete. 2024-04-03T08:35:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:52 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-03T08:35:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:52 smithi157 ceph-mon[35083]: osdmap e42: 6 total, 6 up, 6 in 2024-04-03T08:35:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:52 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-03T08:35:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:52 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[35060]: 2024-04-03T08:35:52.238+0000 7f64b8000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:35:52.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:52 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-03T08:35:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:52 smithi181 ceph-mon[44183]: osdmap e42: 6 total, 6 up, 6 in 2024-04-03T08:35:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:52 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-03T08:35:52.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-03T08:35:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: pgmap v191: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-03T08:35:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-03T08:35:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: osdmap e43: 6 total, 6 up, 6 in 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: osdmap e44: 6 total, 6 up, 6 in 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: fsmap cephfs:0 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: Saving service mds.cephfs spec with placement count:4 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:53.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:53 smithi157 ceph-mon[35083]: Deploying daemon mds.cephfs.smithi157.sodwui on smithi157 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: pgmap v191: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: osdmap e43: 6 total, 6 up, 6 in 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: osdmap e44: 6 total, 6 up, 6 in 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: fsmap cephfs:0 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: Saving service mds.cephfs spec with placement count:4 2024-04-03T08:35:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:53.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:53 smithi181 ceph-mon[44183]: Deploying daemon mds.cephfs.smithi157.sodwui on smithi157 2024-04-03T08:35:54.279 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:54.554 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:54 smithi157 ceph-mon[35083]: osdmap e45: 6 total, 6 up, 6 in 2024-04-03T08:35:54.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:54 smithi181 ceph-mon[44183]: osdmap e45: 6 total, 6 up, 6 in 2024-04-03T08:35:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:55 smithi157 ceph-mon[35083]: pgmap v195: 65 pgs: 8 creating+peering, 14 active+clean, 43 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:55 smithi157 ceph-mon[35083]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-03T08:35:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:55 smithi157 ceph-mon[35083]: osdmap e46: 6 total, 6 up, 6 in 2024-04-03T08:35:55.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:55 smithi181 ceph-mon[44183]: pgmap v195: 65 pgs: 8 creating+peering, 14 active+clean, 43 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:55.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:55 smithi181 ceph-mon[44183]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-03T08:35:55.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:55 smithi181 ceph-mon[44183]: osdmap e46: 6 total, 6 up, 6 in 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 -- 172.21.15.157:0/1924044463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fcee0 msgr2=0x7fb1200fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 --2- 172.21.15.157:0/1924044463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fcee0 0x7fb1200fd310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb110004940 tx=0x7fb110009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 -- 172.21.15.157:0/1924044463 shutdown_connections 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 --2- 172.21.15.157:0/1924044463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fe0d0 0x7fb1200fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 --2- 172.21.15.157:0/1924044463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fcee0 0x7fb1200fd310 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 -- 172.21.15.157:0/1924044463 >> 172.21.15.157:0/1924044463 conn(0x7fb1200f8560 msgr2=0x7fb1200fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 -- 172.21.15.157:0/1924044463 shutdown_connections 2024-04-03T08:35:56.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.678+0000 7fb124a00700 1 -- 172.21.15.157:0/1924044463 wait complete. 2024-04-03T08:35:56.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.679+0000 7fb124a00700 1 Processor -- start 2024-04-03T08:35:56.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.679+0000 7fb124a00700 1 -- start start 2024-04-03T08:35:56.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.679+0000 7fb124a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fcee0 0x7fb12010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:56.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.679+0000 7fb124a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fe0d0 0x7fb120110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:56.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.679+0000 7fb124a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120110720 con 0x7fb1200fe0d0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.679+0000 7fb124a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120110f70 con 0x7fb1200fcee0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fe0d0 0x7fb120110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fcee0 0x7fb12010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fe0d0 0x7fb120110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60736/0 (socket says 172.21.15.157:60736) 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11d400700 1 -- 172.21.15.157:0/2348160493 learned_addr learned my addr 172.21.15.157:0/2348160493 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11de00700 1 -- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fe0d0 msgr2=0x7fb120110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11de00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fe0d0 0x7fb120110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11de00700 1 -- 172.21.15.157:0/2348160493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb110005040 con 0x7fb1200fcee0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb11de00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fcee0 0x7fb12010fbe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb110000c00 tx=0x7fb110009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.680+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb11000e030 con 0x7fb1200fcee0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.681+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb110009430 con 0x7fb1200fcee0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.681+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb11001ce50 con 0x7fb1200fcee0 2024-04-03T08:35:56.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.681+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1201111f0 con 0x7fb1200fcee0 2024-04-03T08:35:56.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.681+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1201116e0 con 0x7fb1200fcee0 2024-04-03T08:35:56.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.682+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb120101a60 con 0x7fb1200fcee0 2024-04-03T08:35:56.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.683+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb11001c400 con 0x7fb1200fcee0 2024-04-03T08:35:56.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.684+0000 7fb116000700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb1040692a0 0x7fb10406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:56.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.684+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb1100885c0 con 0x7fb1200fcee0 2024-04-03T08:35:56.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.684+0000 7fb11d400700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb1040692a0 0x7fb10406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:56.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.684+0000 7fb11d400700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb1040692a0 0x7fb10406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb10c008fd0 tx=0x7fb10c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:56.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.689+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb110058360 con 0x7fb1200fcee0 2024-04-03T08:35:56.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.927+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb120105ab0 con 0x7fb1200fcee0 2024-04-03T08:35:56.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.928+0000 7fb116000700 1 -- 172.21.15.157:0/2348160493 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fb110057ef0 con 0x7fb1200fcee0 2024-04-03T08:35:56.929 INFO:teuthology.orchestra.run.smithi157.stdout:e2 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 2 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:35:52.239205+0000 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:35:56.930 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 0 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:in 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:up {} 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:35:56.931 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:35:56.932 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:35:56.932 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:35:56.932 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:35:56.932 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 0 2024-04-03T08:35:56.932 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:35:56.932 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb1040692a0 msgr2=0x7fb10406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb1040692a0 0x7fb10406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb10c008fd0 tx=0x7fb10c00b040 comp rx=0 tx=0).stop 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fcee0 msgr2=0x7fb12010fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fcee0 0x7fb12010fbe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb110000c00 tx=0x7fb110009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 shutdown_connections 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb1040692a0 0x7fb10406b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1200fcee0 0x7fb12010fbe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 --2- 172.21.15.157:0/2348160493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1200fe0d0 0x7fb120110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 >> 172.21.15.157:0/2348160493 conn(0x7fb1200f8560 msgr2=0x7fb1200f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 shutdown_connections 2024-04-03T08:35:56.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:56.930+0000 7fb124a00700 1 -- 172.21.15.157:0/2348160493 wait complete. 2024-04-03T08:35:56.934 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 2 2024-04-03T08:35:57.484 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: pgmap v197: 65 pgs: 8 creating+peering, 51 active+clean, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: Deploying daemon mds.cephfs.smithi181.ecaerp on smithi181 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2348160493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6826/2196255510,v1:172.21.15.157:6827/2196255510] up:boot 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: daemon mds.cephfs.smithi157.sodwui assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-03T08:35:57.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-03T08:35:57.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: Cluster is now healthy 2024-04-03T08:35:57.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: fsmap cephfs:0 1 up:standby 2024-04-03T08:35:57.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:35:57.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:creating} 2024-04-03T08:35:57.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:57 smithi157 ceph-mon[35083]: daemon mds.cephfs.smithi157.sodwui is now active in filesystem cephfs as rank 0 2024-04-03T08:35:57.509 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:35:57.519 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:35:57.519 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-03T08:35:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: pgmap v197: 65 pgs: 8 creating+peering, 51 active+clean, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-03T08:35:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:35:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:35:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: Deploying daemon mds.cephfs.smithi181.ecaerp on smithi181 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2348160493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6826/2196255510,v1:172.21.15.157:6827/2196255510] up:boot 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: daemon mds.cephfs.smithi157.sodwui assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: Cluster is now healthy 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: fsmap cephfs:0 1 up:standby 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:35:57.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:creating} 2024-04-03T08:35:57.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:57 smithi181 ceph-mon[44183]: daemon mds.cephfs.smithi157.sodwui is now active in filesystem cephfs as rank 0 2024-04-03T08:35:57.948 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:35:59.453 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:59 smithi157 ceph-mon[35083]: pgmap v198: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 352 B/s wr, 0 op/s 2024-04-03T08:35:59.453 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:59 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6826/2196255510,v1:172.21.15.157:6827/2196255510] up:active 2024-04-03T08:35:59.453 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:35:59 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2024-04-03T08:35:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:59 smithi181 ceph-mon[44183]: pgmap v198: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 352 B/s wr, 0 op/s 2024-04-03T08:35:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:59 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6826/2196255510,v1:172.21.15.157:6827/2196255510] up:active 2024-04-03T08:35:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:35:59 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 -- 172.21.15.157:0/2517675574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c071f50 msgr2=0x7fb50c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 --2- 172.21.15.157:0/2517675574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c071f50 0x7fb50c070460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc004940 tx=0x7fb4fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 -- 172.21.15.157:0/2517675574 shutdown_connections 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 --2- 172.21.15.157:0/2517675574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50c0709a0 0x7fb50c070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 --2- 172.21.15.157:0/2517675574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c071f50 0x7fb50c070460 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 -- 172.21.15.157:0/2517675574 >> 172.21.15.157:0/2517675574 conn(0x7fb50c0f8560 msgr2=0x7fb50c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 -- 172.21.15.157:0/2517675574 shutdown_connections 2024-04-03T08:35:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.717+0000 7fb511a00700 1 -- 172.21.15.157:0/2517675574 wait complete. 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.718+0000 7fb511a00700 1 Processor -- start 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.718+0000 7fb511a00700 1 -- start start 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.718+0000 7fb511a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 0x7fb50c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb511a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50c071f50 0x7fb50c110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb511a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c110770 con 0x7fb50c0709a0 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb511a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c110f70 con 0x7fb50c071f50 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 0x7fb50c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 0x7fb50c10fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60754/0 (socket says 172.21.15.157:60754) 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 -- 172.21.15.157:0/2002324592 learned_addr learned my addr 172.21.15.157:0/2002324592 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb503e00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50c071f50 0x7fb50c110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 -- 172.21.15.157:0/2002324592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50c071f50 msgr2=0x7fb50c110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50c071f50 0x7fb50c110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:35:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 -- 172.21.15.157:0/2002324592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc005040 con 0x7fb50c0709a0 2024-04-03T08:35:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.719+0000 7fb50aa00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 0x7fb50c10fc30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000c00 tx=0x7fb4fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.720+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4fc00e070 con 0x7fb50c0709a0 2024-04-03T08:35:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.720+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4fc01c400 con 0x7fb50c0709a0 2024-04-03T08:35:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.720+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4fc00b650 con 0x7fb50c0709a0 2024-04-03T08:35:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.720+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c1111f0 con 0x7fb50c0709a0 2024-04-03T08:35:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.720+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c1116d0 con 0x7fb50c0709a0 2024-04-03T08:35:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.721+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c05f5f0 con 0x7fb50c0709a0 2024-04-03T08:35:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.722+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb4fc01c570 con 0x7fb50c0709a0 2024-04-03T08:35:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.723+0000 7fb502a00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb4f00692a0 0x7fb4f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:35:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.723+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb4fc088700 con 0x7fb50c0709a0 2024-04-03T08:35:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.723+0000 7fb503e00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb4f00692a0 0x7fb4f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:35:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.724+0000 7fb503e00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb4f00692a0 0x7fb4f006b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b80 tx=0x7fb4f400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:35:59.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:35:59.728+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb4fc0584a0 con 0x7fb50c0709a0 2024-04-03T08:36:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.005+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fb50c111aa0 con 0x7fb50c0709a0 2024-04-03T08:36:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.271+0000 7fb502a00700 1 -- 172.21.15.157:0/2002324592 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb4fc004490 con 0x7fb50c0709a0 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb4f00692a0 msgr2=0x7fb4f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb4f00692a0 0x7fb4f006b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b80 tx=0x7fb4f400b040 comp rx=0 tx=0).stop 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 msgr2=0x7fb50c10fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 0x7fb50c10fc30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000c00 tx=0x7fb4fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 shutdown_connections 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c0709a0 0x7fb50c10fc30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fb4f00692a0 0x7fb4f006b750 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b80 tx=0x7fb4f400b040 comp rx=0 tx=0).stop 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 --2- 172.21.15.157:0/2002324592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50c071f50 0x7fb50c110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:00.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.274+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 >> 172.21.15.157:0/2002324592 conn(0x7fb50c0f8560 msgr2=0x7fb50c0f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:00.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.275+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 shutdown_connections 2024-04-03T08:36:00.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:00.275+0000 7fb511a00700 1 -- 172.21.15.157:0/2002324592 wait complete. 2024-04-03T08:36:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:36:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:36:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: Deploying daemon mds.cephfs.smithi157.zlscrk on smithi157 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2002324592' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.181:6824/2137410352,v1:172.21.15.181:6825/2137410352] up:boot 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2002324592' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:36:00.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:00 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby 2024-04-03T08:36:00.929 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:36:00.939 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:36:01.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-03T08:36:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:36:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:36:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: Deploying daemon mds.cephfs.smithi157.zlscrk on smithi157 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2002324592' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.181:6824/2137410352,v1:172.21.15.181:6825/2137410352] up:boot 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2002324592' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:36:01.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:00 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby 2024-04-03T08:36:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:01 smithi157 ceph-mon[35083]: pgmap v199: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 788 B/s wr, 4 op/s 2024-04-03T08:36:02.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:01 smithi181 ceph-mon[44183]: pgmap v199: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 788 B/s wr, 4 op/s 2024-04-03T08:36:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:03.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:03 smithi157 ceph-mon[35083]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-04-03T08:36:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:03 smithi181 ceph-mon[44183]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-04-03T08:36:04.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 -- 172.21.15.157:0/4245709190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 msgr2=0x7fd1800fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:04.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 --2- 172.21.15.157:0/4245709190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd1800fd310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd174004940 tx=0x7fd174009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:04.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 -- 172.21.15.157:0/4245709190 shutdown_connections 2024-04-03T08:36:04.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 --2- 172.21.15.157:0/4245709190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1800fe0d0 0x7fd1800fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 --2- 172.21.15.157:0/4245709190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd1800fd310 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 -- 172.21.15.157:0/4245709190 >> 172.21.15.157:0/4245709190 conn(0x7fd1800f8560 msgr2=0x7fd1800fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:04.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 -- 172.21.15.157:0/4245709190 shutdown_connections 2024-04-03T08:36:04.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.326+0000 7fd188400700 1 -- 172.21.15.157:0/4245709190 wait complete. 2024-04-03T08:36:04.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.327+0000 7fd188400700 1 Processor -- start 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.327+0000 7fd188400700 1 -- start start 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd188400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd18010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd188400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1800fe0d0 0x7fd180110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd188400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180110860 con 0x7fd1800fcee0 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd188400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180110fa0 con 0x7fd1800fe0d0 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd185a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd18010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd185a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd18010fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48814/0 (socket says 172.21.15.157:48814) 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd185a00700 1 -- 172.21.15.157:0/2506384636 learned_addr learned my addr 172.21.15.157:0/2506384636 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd185a00700 1 -- 172.21.15.157:0/2506384636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1800fe0d0 msgr2=0x7fd180110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd185a00700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1800fe0d0 0x7fd180110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.328+0000 7fd185a00700 1 -- 172.21.15.157:0/2506384636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174005040 con 0x7fd1800fcee0 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.329+0000 7fd185a00700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd18010fd20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b970 tx=0x7fd174009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:04.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.329+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17400e040 con 0x7fd1800fcee0 2024-04-03T08:36:04.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.329+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd174004290 con 0x7fd1800fcee0 2024-04-03T08:36:04.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.329+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17401c630 con 0x7fd1800fcee0 2024-04-03T08:36:04.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.329+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd180111220 con 0x7fd1800fcee0 2024-04-03T08:36:04.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.329+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1801117e0 con 0x7fd1800fcee0 2024-04-03T08:36:04.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.330+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd180101a60 con 0x7fd1800fcee0 2024-04-03T08:36:04.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.331+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd17400bbf0 con 0x7fd1800fcee0 2024-04-03T08:36:04.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.332+0000 7fd17d600700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd1680692b0 0x7fd16806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:04.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.332+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd174088510 con 0x7fd1800fcee0 2024-04-03T08:36:04.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.332+0000 7fd185000700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd1680692b0 0x7fd16806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:04.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.333+0000 7fd185000700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd1680692b0 0x7fd16806b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd16c004d00 tx=0x7fd16c009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:04.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.337+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd1740582b0 con 0x7fd1800fcee0 2024-04-03T08:36:04.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.585+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fd18005f5f0 con 0x7fd1800fcee0 2024-04-03T08:36:04.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.790+0000 7fd17d600700 1 -- 172.21.15.157:0/2506384636 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd174013e60 con 0x7fd1800fcee0 2024-04-03T08:36:04.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.793+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd1680692b0 msgr2=0x7fd16806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:04.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.793+0000 7fd188400700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd1680692b0 0x7fd16806b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd16c004d00 tx=0x7fd16c009ce0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.793+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 msgr2=0x7fd18010fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:04.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.793+0000 7fd188400700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd18010fd20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b970 tx=0x7fd174009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 shutdown_connections 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800fcee0 0x7fd18010fd20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd1680692b0 0x7fd16806b760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 --2- 172.21.15.157:0/2506384636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1800fe0d0 0x7fd180110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 >> 172.21.15.157:0/2506384636 conn(0x7fd1800f8560 msgr2=0x7fd1800f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 shutdown_connections 2024-04-03T08:36:04.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:04.794+0000 7fd188400700 1 -- 172.21.15.157:0/2506384636 wait complete. 2024-04-03T08:36:05.454 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:36:05.464 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:36:05.464 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-03T08:36:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-03T08:36:05.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:36:05.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: Deploying daemon mds.cephfs.smithi181.wksnwz on smithi181 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2506384636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:boot 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2506384636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2 up:standby 2024-04-03T08:36:05.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:36:05.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 1 up:standby 2024-04-03T08:36:05.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:05 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: Deploying daemon mds.cephfs.smithi181.wksnwz on smithi181 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2506384636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:boot 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2506384636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2 up:standby 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 1 up:standby 2024-04-03T08:36:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:05 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:05.897 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:07.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:07 smithi157 ceph-mon[35083]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-03T08:36:07.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:07 smithi181 ceph-mon[44183]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 -- 172.21.15.157:0/4225575610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 msgr2=0x7f93880ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 --2- 172.21.15.157:0/4225575610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f93880ff9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f937c004940 tx=0x7f937c009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 -- 172.21.15.157:0/4225575610 shutdown_connections 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 --2- 172.21.15.157:0/4225575610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 --2- 172.21.15.157:0/4225575610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f93880ff9c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 -- 172.21.15.157:0/4225575610 >> 172.21.15.157:0/4225575610 conn(0x7f93880f7430 msgr2=0x7f93880f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 -- 172.21.15.157:0/4225575610 shutdown_connections 2024-04-03T08:36:07.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.880+0000 7f9390600700 1 -- 172.21.15.157:0/4225575610 wait complete. 2024-04-03T08:36:07.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.881+0000 7f9390600700 1 Processor -- start 2024-04-03T08:36:07.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.881+0000 7f9390600700 1 -- start start 2024-04-03T08:36:07.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.881+0000 7f9390600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f938810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:07.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.881+0000 7f9390600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.881+0000 7f9390600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388110770 con 0x7f93880662e0 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.881+0000 7f9390600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388110f70 con 0x7f93880fff00 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938d200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f938810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938d200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:44976/0 (socket says 172.21.15.157:44976) 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938d200700 1 -- 172.21.15.157:0/399990750 learned_addr learned my addr 172.21.15.157:0/399990750 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938dc00700 1 -- 172.21.15.157:0/399990750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 msgr2=0x7f9388110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938dc00700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938dc00700 1 -- 172.21.15.157:0/399990750 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c005040 con 0x7f93880662e0 2024-04-03T08:36:07.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938d200700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.882+0000 7f938dc00700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f938810fc30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c00 tx=0x7f937c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.883+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c00e070 con 0x7f93880662e0 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.883+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f937c013de0 con 0x7f93880662e0 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.883+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93881111f0 con 0x7f93880662e0 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.883+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c00be30 con 0x7f93880662e0 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.883+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9388111700 con 0x7f93880662e0 2024-04-03T08:36:07.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.884+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938805f5f0 con 0x7f93880662e0 2024-04-03T08:36:07.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.885+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f937c00b680 con 0x7f93880662e0 2024-04-03T08:36:07.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.886+0000 7f9385600700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f93700692b0 0x7f937006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:07.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.886+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f937c087a00 con 0x7f93880662e0 2024-04-03T08:36:07.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.886+0000 7f938d200700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f93700692b0 0x7f937006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:07.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.887+0000 7f938d200700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f93700692b0 0x7f937006b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93740041d0 tx=0x7f937400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:07.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:07.891+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f937c057850 con 0x7f93880662e0 2024-04-03T08:36:08.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.143+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f938804bed0 con 0x7f93880662e0 2024-04-03T08:36:08.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.649+0000 7f9385600700 1 -- 172.21.15.157:0/399990750 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7f937c022020 con 0x7f93880662e0 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f93700692b0 msgr2=0x7f937006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f93700692b0 0x7f937006b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93740041d0 tx=0x7f937400b040 comp rx=0 tx=0).stop 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 msgr2=0x7f938810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f938810fc30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c00 tx=0x7f937c009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 shutdown_connections 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93880662e0 0x7f938810fc30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f93700692b0 0x7f937006b760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 --2- 172.21.15.157:0/399990750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93880fff00 0x7f9388110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 >> 172.21.15.157:0/399990750 conn(0x7f93880f7430 msgr2=0x7f9388100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:08.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 shutdown_connections 2024-04-03T08:36:08.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:08.652+0000 7f9390600700 1 -- 172.21.15.157:0/399990750 wait complete. 2024-04-03T08:36:08.654 INFO:teuthology.orchestra.run.smithi157.stderr:inline data disabled 2024-04-03T08:36:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] up:boot 2024-04-03T08:36:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:36:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:36:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:36:08.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:08 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/399990750' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-03T08:36:08.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] up:boot 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:36:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:08 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/399990750' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-03T08:36:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-03T08:36:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/399990750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-03T08:36:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:standby 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: Dropping low affinity standby-replay daemon mds.cephfs.smithi181.ecaerp in favor of higher affinity standby. 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: Dropping low affinity active daemon mds.cephfs.smithi157.sodwui in favor of higher affinity standby. 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: Replacing daemon mds.cephfs.smithi157.sodwui as rank 0 with standby daemon mds.cephfs.smithi157.zlscrk 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 1 up:standby 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: osdmap e47: 6 total, 6 up, 6 in 2024-04-03T08:36:09.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:09 smithi157 ceph-mon[35083]: fsmap cephfs:1/1 {0=cephfs.smithi157.zlscrk=up:replay} 1 up:standby 2024-04-03T08:36:09.883 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:36:09.896 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:36:09.896 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-03T08:36:10.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-03T08:36:10.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/399990750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:standby 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: Dropping low affinity standby-replay daemon mds.cephfs.smithi181.ecaerp in favor of higher affinity standby. 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: Dropping low affinity active daemon mds.cephfs.smithi157.sodwui in favor of higher affinity standby. 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: Replacing daemon mds.cephfs.smithi157.sodwui as rank 0 with standby daemon mds.cephfs.smithi157.zlscrk 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 1 up:standby 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: osdmap e47: 6 total, 6 up, 6 in 2024-04-03T08:36:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:09 smithi181 ceph-mon[44183]: fsmap cephfs:1/1 {0=cephfs.smithi157.zlscrk=up:replay} 1 up:standby 2024-04-03T08:36:10.696 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:10.983 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:reconnect 2024-04-03T08:36:10.983 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:boot 2024-04-03T08:36:10.983 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] up:boot 2024-04-03T08:36:10.983 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: fsmap cephfs:1/1 {0=cephfs.smithi157.zlscrk=up:reconnect} 3 up:standby 2024-04-03T08:36:10.983 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:36:10.984 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:36:10.984 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:10.984 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:10.984 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:10 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:reconnect 2024-04-03T08:36:11.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:boot 2024-04-03T08:36:11.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] up:boot 2024-04-03T08:36:11.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: fsmap cephfs:1/1 {0=cephfs.smithi157.zlscrk=up:reconnect} 3 up:standby 2024-04-03T08:36:11.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:36:11.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:36:11.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:11.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:11.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:10 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:11.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:11 smithi157 ceph-mon[35083]: pgmap v205: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-03T08:36:11.974 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:11 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:rejoin 2024-04-03T08:36:11.974 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:11 smithi157 ceph-mon[35083]: fsmap cephfs:1/1 {0=cephfs.smithi157.zlscrk=up:rejoin} 3 up:standby 2024-04-03T08:36:11.974 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:11 smithi157 ceph-mon[35083]: daemon mds.cephfs.smithi157.zlscrk is now active in filesystem cephfs as rank 0 2024-04-03T08:36:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:11 smithi181 ceph-mon[44183]: pgmap v205: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-03T08:36:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:11 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:rejoin 2024-04-03T08:36:12.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:11 smithi181 ceph-mon[44183]: fsmap cephfs:1/1 {0=cephfs.smithi157.zlscrk=up:rejoin} 3 up:standby 2024-04-03T08:36:12.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:11 smithi181 ceph-mon[44183]: daemon mds.cephfs.smithi157.zlscrk is now active in filesystem cephfs as rank 0 2024-04-03T08:36:12.939 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:12 smithi157 ceph-mon[35083]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-03T08:36:12.940 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:12 smithi157 ceph-mon[35083]: Cluster is now healthy 2024-04-03T08:36:12.940 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:12 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:active 2024-04-03T08:36:12.940 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:12 smithi157 ceph-mon[35083]: mds.? [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] up:standby 2024-04-03T08:36:12.940 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:12 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 3 up:standby 2024-04-03T08:36:12.940 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:12 smithi157 ceph-mon[35083]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:36:13.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:12 smithi181 ceph-mon[44183]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-03T08:36:13.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:12 smithi181 ceph-mon[44183]: Cluster is now healthy 2024-04-03T08:36:13.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:12 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] up:active 2024-04-03T08:36:13.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:12 smithi181 ceph-mon[44183]: mds.? [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] up:standby 2024-04-03T08:36:13.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:12 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 3 up:standby 2024-04-03T08:36:13.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:12 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:36:13.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 -- 172.21.15.157:0/735977359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 msgr2=0x7f68940fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:13.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 --2- 172.21.15.157:0/735977359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f68940fd290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6884004940 tx=0x7f6884009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 -- 172.21.15.157:0/735977359 shutdown_connections 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 --2- 172.21.15.157:0/735977359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68940fdff0 0x7f68940fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 --2- 172.21.15.157:0/735977359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f68940fd290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 -- 172.21.15.157:0/735977359 >> 172.21.15.157:0/735977359 conn(0x7f68940f8560 msgr2=0x7f68940fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 -- 172.21.15.157:0/735977359 shutdown_connections 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.351+0000 7f689a400700 1 -- 172.21.15.157:0/735977359 wait complete. 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.352+0000 7f689a400700 1 Processor -- start 2024-04-03T08:36:13.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.352+0000 7f689a400700 1 -- start start 2024-04-03T08:36:13.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f689a400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f689410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:13.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f689a400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68940fdff0 0x7f689410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:13.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f689a400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689410e4f0 con 0x7f68940fce80 2024-04-03T08:36:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f689a400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689410ed40 con 0x7f68940fdff0 2024-04-03T08:36:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6893400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f689410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6893400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f689410d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54968/0 (socket says 172.21.15.157:54968) 2024-04-03T08:36:13.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6893400700 1 -- 172.21.15.157:0/4121861693 learned_addr learned my addr 172.21.15.157:0/4121861693 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6893400700 1 -- 172.21.15.157:0/4121861693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68940fdff0 msgr2=0x7f689410def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6892a00700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68940fdff0 0x7f689410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6893400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68940fdff0 0x7f689410def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.353+0000 7f6893400700 1 -- 172.21.15.157:0/4121861693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884005040 con 0x7f68940fce80 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.354+0000 7f6893400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f689410d9b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6884013870 tx=0x7f6884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.354+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688400e070 con 0x7f68940fce80 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.354+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689410efc0 con 0x7f68940fce80 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.354+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f688401c400 con 0x7f68940fce80 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.354+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688400b630 con 0x7f68940fce80 2024-04-03T08:36:13.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.354+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689410f4a0 con 0x7f68940fce80 2024-04-03T08:36:13.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.356+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689405f5f0 con 0x7f68940fce80 2024-04-03T08:36:13.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.356+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f688401c570 con 0x7f68940fce80 2024-04-03T08:36:13.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.357+0000 7f688b400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f68780692b0 0x7f687806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:13.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.357+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6884088950 con 0x7f68940fce80 2024-04-03T08:36:13.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.357+0000 7f6892a00700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f68780692b0 0x7f687806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:13.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.358+0000 7f6892a00700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f68780692b0 0x7f687806b760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6880004600 tx=0x7f688000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:13.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.362+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f68840586a0 con 0x7f68940fce80 2024-04-03T08:36:13.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.611+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f689410f710 con 0x7f68940fce80 2024-04-03T08:36:13.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.612+0000 7f688b400700 1 -- 172.21.15.157:0/4121861693 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6884058230 con 0x7f68940fce80 2024-04-03T08:36:13.612 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:36:13.612 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:36:13.613 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:36:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:36:13.615 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:36:13.616 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:36:13.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f68780692b0 msgr2=0x7f687806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:13.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f68780692b0 0x7f687806b760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6880004600 tx=0x7f688000b040 comp rx=0 tx=0).stop 2024-04-03T08:36:13.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 msgr2=0x7f689410d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f689410d9b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6884013870 tx=0x7f6884009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 shutdown_connections 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940fce80 0x7f689410d9b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f68780692b0 0x7f687806b760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 --2- 172.21.15.157:0/4121861693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68940fdff0 0x7f689410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 >> 172.21.15.157:0/4121861693 conn(0x7f68940f8560 msgr2=0x7f68940f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 shutdown_connections 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:13.614+0000 7f689a400700 1 -- 172.21.15.157:0/4121861693 wait complete. 2024-04-03T08:36:13.617 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:36:13.928 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:13 smithi157 ceph-mon[35083]: pgmap v206: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-03T08:36:13.928 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:13 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4121861693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:36:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:13 smithi181 ceph-mon[44183]: pgmap v206: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-03T08:36:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:13 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/4121861693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:36:14.287 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-03T08:36:15.028 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:15.939 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:15 smithi157 ceph-mon[35083]: pgmap v207: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 4 op/s 2024-04-03T08:36:15.939 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:15 smithi181 ceph-mon[44183]: pgmap v207: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 4 op/s 2024-04-03T08:36:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:16.914 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 -- 172.21.15.157:0/70708698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fce80 msgr2=0x7f86f40fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 --2- 172.21.15.157:0/70708698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fce80 0x7f86f40fd290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86e4004940 tx=0x7f86e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 -- 172.21.15.157:0/70708698 shutdown_connections 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 --2- 172.21.15.157:0/70708698 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fdff0 0x7f86f40fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 --2- 172.21.15.157:0/70708698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fce80 0x7f86f40fd290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 -- 172.21.15.157:0/70708698 >> 172.21.15.157:0/70708698 conn(0x7f86f40f8560 msgr2=0x7f86f40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:16.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 -- 172.21.15.157:0/70708698 shutdown_connections 2024-04-03T08:36:16.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.977+0000 7f86f9a00700 1 -- 172.21.15.157:0/70708698 wait complete. 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.978+0000 7f86f9a00700 1 Processor -- start 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.978+0000 7f86f9a00700 1 -- start start 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f9a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fce80 0x7f86f410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 0x7f86f41100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f9a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41106e0 con 0x7f86f40fdff0 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f9a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4110f30 con 0x7f86f40fce80 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 0x7f86f41100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 0x7f86f41100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54992/0 (socket says 172.21.15.157:54992) 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2000700 1 -- 172.21.15.157:0/1350631719 learned_addr learned my addr 172.21.15.157:0/1350631719 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fce80 0x7f86f410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:16.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2000700 1 -- 172.21.15.157:0/1350631719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fce80 msgr2=0x7f86f410fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:16.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2000700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fce80 0x7f86f410fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:16.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2000700 1 -- 172.21.15.157:0/1350631719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4005040 con 0x7f86f40fdff0 2024-04-03T08:36:16.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.979+0000 7f86f2a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fce80 0x7f86f410fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:36:16.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.980+0000 7f86f2000700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 0x7f86f41100e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f86e000eb40 tx=0x7f86e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:16.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.980+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e0007cc0 con 0x7f86f40fdff0 2024-04-03T08:36:16.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.980+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86e000f040 con 0x7f86f40fdff0 2024-04-03T08:36:16.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.980+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f41111b0 con 0x7f86f40fdff0 2024-04-03T08:36:16.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.980+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e0009620 con 0x7f86f40fdff0 2024-04-03T08:36:16.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.980+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41116f0 con 0x7f86f40fdff0 2024-04-03T08:36:16.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.982+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f4101980 con 0x7f86f40fdff0 2024-04-03T08:36:16.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.982+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f86e0009780 con 0x7f86f40fdff0 2024-04-03T08:36:16.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.983+0000 7f86eaa00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f86d80692b0 0x7f86d806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:16.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.984+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f86e0086ef0 con 0x7f86f40fdff0 2024-04-03T08:36:16.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.984+0000 7f86f2a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f86d80692b0 0x7f86d806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:16.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.984+0000 7f86f2a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f86d80692b0 0x7f86d806b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b0d0 tx=0x7f86e4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:16.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:16.988+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f86e004e190 con 0x7f86f40fdff0 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: pgmap v208: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.5 KiB/s rd, 8 op/s 2024-04-03T08:36:17.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:16 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:36:17.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.253+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86f405f5f0 con 0x7f86f40fdff0 2024-04-03T08:36:17.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.254+0000 7f86eaa00700 1 -- 172.21.15.157:0/1350631719 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f86e0056bf0 con 0x7f86f40fdff0 2024-04-03T08:36:17.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f86d80692b0 msgr2=0x7f86d806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:17.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f86d80692b0 0x7f86d806b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b0d0 tx=0x7f86e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 msgr2=0x7f86f41100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 0x7f86f41100e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f86e000eb40 tx=0x7f86e000b040 comp rx=0 tx=0).stop 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 shutdown_connections 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f86d80692b0 0x7f86d806b760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f40fce80 0x7f86f410fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 --2- 172.21.15.157:0/1350631719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86f40fdff0 0x7f86f41100e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 >> 172.21.15.157:0/1350631719 conn(0x7f86f40f8560 msgr2=0x7f86f40f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 shutdown_connections 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:17.256+0000 7f86f9a00700 1 -- 172.21.15.157:0/1350631719 wait complete. 2024-04-03T08:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:36:17.272 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:36:17.280 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:17.280 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:17.280 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:36:17.280 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:17.280 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: pgmap v208: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.5 KiB/s rd, 8 op/s 2024-04-03T08:36:17.280 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:16 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:36:18.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:17 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1350631719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-03T08:36:18.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:17 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1350631719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-03T08:36:18.473 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-03T08:36:19.596 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:20.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:19 smithi181 ceph-mon[44183]: pgmap v209: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-03T08:36:20.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:19 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:20.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:19 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:20.124 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:19 smithi157 ceph-mon[35083]: pgmap v209: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-03T08:36:20.124 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:19 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:20.124 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:19 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:22.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:21 smithi181 ceph-mon[44183]: pgmap v210: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.248+0000 7f5151600700 1 -- 172.21.15.157:0/1678921842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fcee0 msgr2=0x7f514c0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.248+0000 7f5151600700 1 --2- 172.21.15.157:0/1678921842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fcee0 0x7f514c0fd310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f513c004940 tx=0x7f513c009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 -- 172.21.15.157:0/1678921842 shutdown_connections 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 --2- 172.21.15.157:0/1678921842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fe0d0 0x7f514c0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 --2- 172.21.15.157:0/1678921842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fcee0 0x7f514c0fd310 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 -- 172.21.15.157:0/1678921842 >> 172.21.15.157:0/1678921842 conn(0x7f514c0f8560 msgr2=0x7f514c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 -- 172.21.15.157:0/1678921842 shutdown_connections 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 -- 172.21.15.157:0/1678921842 wait complete. 2024-04-03T08:36:22.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.249+0000 7f5151600700 1 Processor -- start 2024-04-03T08:36:22.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f5151600700 1 -- start start 2024-04-03T08:36:22.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f5151600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fcee0 0x7f514c10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:22.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f5151600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 0x7f514c110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f5151600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c110860 con 0x7f514c0fe0d0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f5151600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c110fa0 con 0x7f514c0fcee0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f514a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 0x7f514c110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f514a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 0x7f514c110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55002/0 (socket says 172.21.15.157:55002) 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f514a000700 1 -- 172.21.15.157:0/1736531414 learned_addr learned my addr 172.21.15.157:0/1736531414 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.250+0000 7f514aa00700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fcee0 0x7f514c10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f514a000700 1 -- 172.21.15.157:0/1736531414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fcee0 msgr2=0x7f514c10fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f514a000700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fcee0 0x7f514c10fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f514a000700 1 -- 172.21.15.157:0/1736531414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c005040 con 0x7f514c0fe0d0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f514aa00700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fcee0 0x7f514c10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f514a000700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 0x7f514c110260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5138002a50 tx=0x7f51380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5138007cc0 con 0x7f514c0fe0d0 2024-04-03T08:36:22.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f513800f040 con 0x7f514c0fe0d0 2024-04-03T08:36:22.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c111280 con 0x7f514c0fe0d0 2024-04-03T08:36:22.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5138009640 con 0x7f514c0fe0d0 2024-04-03T08:36:22.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.251+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c111840 con 0x7f514c0fe0d0 2024-04-03T08:36:22.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.252+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c101a60 con 0x7f514c0fe0d0 2024-04-03T08:36:22.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.253+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f51380097a0 con 0x7f514c0fe0d0 2024-04-03T08:36:22.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.254+0000 7f5142a00700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f51300692b0 0x7f513006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:22.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.254+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f51380870b0 con 0x7f514c0fe0d0 2024-04-03T08:36:22.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.254+0000 7f514aa00700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f51300692b0 0x7f513006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:22.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.255+0000 7f514aa00700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f51300692b0 0x7f513006b760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b3b0 tx=0x7f513c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:22.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.258+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5138056d00 con 0x7f514c0fe0d0 2024-04-03T08:36:22.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:21 smithi157 ceph-mon[35083]: pgmap v210: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-03T08:36:22.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.549+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f514c05f5f0 con 0x7f514c0fe0d0 2024-04-03T08:36:22.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.549+0000 7f5142a00700 1 -- 172.21.15.157:0/1736531414 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v17) v1 ==== 78+0+99 (secure 0 0 0) 0x7f5138056890 con 0x7f514c0fe0d0 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f51300692b0 msgr2=0x7f513006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f51300692b0 0x7f513006b760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b3b0 tx=0x7f513c009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 msgr2=0x7f514c110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 0x7f514c110260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5138002a50 tx=0x7f51380046b0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 shutdown_connections 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f51300692b0 0x7f513006b760 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c0fcee0 0x7f514c10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 --2- 172.21.15.157:0/1736531414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f514c0fe0d0 0x7f514c110260 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 >> 172.21.15.157:0/1736531414 conn(0x7f514c0f8560 msgr2=0x7f514c0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 shutdown_connections 2024-04-03T08:36:22.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:22.552+0000 7f5151600700 1 -- 172.21.15.157:0/1736531414 wait complete. 2024-04-03T08:36:22.567 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:36:23.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:22 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1736531414' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-03T08:36:23.192 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:22 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1736531414' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-03T08:36:24.036 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-03T08:36:24.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-03T08:36:24.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:23 smithi181 ceph-mon[44183]: pgmap v211: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-03T08:36:24.115 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:23 smithi157 ceph-mon[35083]: pgmap v211: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-03T08:36:24.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.278+0000 7f1631000700 1 -- 172.21.15.157:0/486996300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c0febd0 msgr2=0x7f162c0ff040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.278+0000 7f1631000700 1 --2- 172.21.15.157:0/486996300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c0febd0 0x7f162c0ff040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1618004940 tx=0x7f1618009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:24.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.278+0000 7f1631000700 1 -- 172.21.15.157:0/486996300 shutdown_connections 2024-04-03T08:36:24.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.278+0000 7f1631000700 1 --2- 172.21.15.157:0/486996300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c0febd0 0x7f162c0ff040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.278+0000 7f1631000700 1 --2- 172.21.15.157:0/486996300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c1005e0 0x7f162c1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.278+0000 7f1631000700 1 -- 172.21.15.157:0/486996300 >> 172.21.15.157:0/486996300 conn(0x7f162c0fa790 msgr2=0x7f162c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:24.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.279+0000 7f1631000700 1 -- 172.21.15.157:0/486996300 shutdown_connections 2024-04-03T08:36:24.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.279+0000 7f1631000700 1 -- 172.21.15.157:0/486996300 wait complete. 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1631000700 1 Processor -- start 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1631000700 1 -- start start 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1631000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c0febd0 0x7f162c10f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1631000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 0x7f162c10fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1631000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1104e0 con 0x7f162c1005e0 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1631000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c110650 con 0x7f162c0febd0 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1629400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 0x7f162c10fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1629400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 0x7f162c10fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48102/0 (socket says 172.21.15.157:48102) 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.280+0000 7f1629400700 1 -- 172.21.15.157:0/888379063 learned_addr learned my addr 172.21.15.157:0/888379063 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1629e00700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c0febd0 0x7f162c10f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1629400700 1 -- 172.21.15.157:0/888379063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c0febd0 msgr2=0x7f162c10f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1629400700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c0febd0 0x7f162c10f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1629400700 1 -- 172.21.15.157:0/888379063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618005040 con 0x7f162c1005e0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1629e00700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c0febd0 0x7f162c10f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1629400700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 0x7f162c10fee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1618013870 tx=0x7f1618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f161800e070 con 0x7f162c1005e0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c115050 con 0x7f162c1005e0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f161801c400 con 0x7f162c1005e0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f161800b630 con 0x7f162c1005e0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.281+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c115530 con 0x7f162c1005e0 2024-04-03T08:36:24.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.283+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c064970 con 0x7f162c1005e0 2024-04-03T08:36:24.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.283+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f161801c570 con 0x7f162c1005e0 2024-04-03T08:36:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.284+0000 7f1622000700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f16100692a0 0x7f161006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.284+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1618088a40 con 0x7f162c1005e0 2024-04-03T08:36:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.285+0000 7f1629e00700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f16100692a0 0x7f161006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:24.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.285+0000 7f1629e00700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f16100692a0 0x7f161006b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f161c004600 tx=0x7f161c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:24.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.289+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1618058710 con 0x7f162c1005e0 2024-04-03T08:36:24.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.508+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f162c115810 con 0x7f162c1005e0 2024-04-03T08:36:24.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.508+0000 7f1622000700 1 -- 172.21.15.157:0/888379063 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14438 (secure 0 0 0) 0x7f16180582a0 con 0x7f162c1005e0 2024-04-03T08:36:24.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:36:24.509 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":47,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","created":"2024-04-03T08:28:02.650813+0000","modified":"2024-04-03T08:36:08.655969+0000","last_up_change":"2024-04-03T08:34:29.447305+0000","last_in_change":"2024-04-03T08:34:08.784371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T08:33:00.599229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-03T08:35:50.819927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-03T08:35:51.729332+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cacd9869-4ce2-4388-ac14-9b21c32f0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6803","nonce":2915442369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6805","nonce":2915442369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6809","nonce":2915442369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2915442369},{"type":"v1","addr":"172.21.15.157:6807","nonce":2915442369}]},"public_addr":"172.21.15.157:6803/2915442369","cluster_addr":"172.21.15.157:6805/2915442369","heartbeat_back_addr":"172.21.15.157:6809/2915442369","heartbeat_front_addr":"172.21.15.157:6807/2915442369","state":["exists","up"]},{"osd":1,"uuid":"cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6811","nonce":1324598270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6813","nonce":1324598270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6817","nonce":1324598270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1324598270},{"type":"v1","addr":"172.21.15.157:6815","nonce":1324598270}]},"public_addr":"172.21.15.157:6811/1324598270","cluster_addr":"172.21.15.157:6813/1324598270","heartbeat_back_addr":"172.21.15.157:6817/1324598270","heartbeat_front_addr":"172.21.15.157:6815/1324598270","state":["exists","up"]},{"osd":2,"uuid":"763d371a-2aa7-44e2-8557-952c67342744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6819","nonce":525302994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6821","nonce":525302994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6825","nonce":525302994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":525302994},{"type":"v1","addr":"172.21.15.157:6823","nonce":525302994}]},"public_addr":"172.21.15.157:6819/525302994","cluster_addr":"172.21.15.157:6821/525302994","heartbeat_back_addr":"172.21.15.157:6825/525302994","heartbeat_front_addr":"172.21.15.157:6823/525302994","state":["exists","up"]},{"osd":3,"uuid":"287ca3f3-1f42-4c40-bf6c-13d05fa77363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6801","nonce":4270332752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6803","nonce":4270332752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6807","nonce":4270332752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":4270332752},{"type":"v1","addr":"172.21.15.181:6805","nonce":4270332752}]},"public_addr":"172.21.15.181:6801/4270332752","cluster_addr":"172.21.15.181:6803/4270332752","heartbeat_back_addr":"172.21.15.181:6807/4270332752","heartbeat_front_addr":"172.21.15.181:6805/4270332752","state":["exists","up"]},{"osd":4,"uuid":"d591725b-596d-4c27-8ddc-a60269c46dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6809","nonce":788220804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6811","nonce":788220804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6815","nonce":788220804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":788220804},{"type":"v1","addr":"172.21.15.181:6813","nonce":788220804}]},"public_addr":"172.21.15.181:6809/788220804","cluster_addr":"172.21.15.181:6811/788220804","heartbeat_back_addr":"172.21.15.181:6815/788220804","heartbeat_front_addr":"172.21.15.181:6813/788220804","state":["exists","up"]},{"osd":5,"uuid":"207d01dc-ee38-4806-b4c8-646cf217f628","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6817","nonce":2854623884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6819","nonce":2854623884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6823","nonce":2854623884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2854623884},{"type":"v1","addr":"172.21.15.181:6821","nonce":2854623884}]},"public_addr":"172.21.15.181:6817/2854623884","cluster_addr":"172.21.15.181:6819/2854623884","heartbeat_back_addr":"172.21.15.181:6823/2854623884","heartbeat_front_addr":"172.21.15.181:6821/2854623884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:31:54.508321+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:25.748219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:56.905029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:27.040063+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:57.486375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:34:28.274823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6827/2196255510":"2024-04-04T08:36:08.655936+0000","172.21.15.157:0/3654712566":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1509492716":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6801/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6801/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/1447290828":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/448863526":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/2296154399":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2095236671":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/2176602566":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/2911968524":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6801/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6800/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/2148643282":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6800/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6826/2196255510":"2024-04-04T08:36:08.655936+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T08:36:24.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f16100692a0 msgr2=0x7f161006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f16100692a0 0x7f161006b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f161c004600 tx=0x7f161c00b040 comp rx=0 tx=0).stop 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 msgr2=0x7f162c10fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 0x7f162c10fee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1618013870 tx=0x7f1618009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 shutdown_connections 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f16100692a0 0x7f161006b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f162c0febd0 0x7f162c10f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 --2- 172.21.15.157:0/888379063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f162c1005e0 0x7f162c10fee0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 >> 172.21.15.157:0/888379063 conn(0x7f162c0fa790 msgr2=0x7f162c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 shutdown_connections 2024-04-03T08:36:24.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.511+0000 7f1631000700 1 -- 172.21.15.157:0/888379063 wait complete. 2024-04-03T08:36:24.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-03T08:33:00.599229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-03T08:35:50.819927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-03T08:35:51.729332+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-03T08:36:24.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-03T08:36:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 -- 172.21.15.157:0/321790251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 msgr2=0x7f7b940fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 --2- 172.21.15.157:0/321790251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b940fd0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b84004940 tx=0x7f7b84009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 -- 172.21.15.157:0/321790251 shutdown_connections 2024-04-03T08:36:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 --2- 172.21.15.157:0/321790251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b940fdf60 0x7f7b940fe3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 --2- 172.21.15.157:0/321790251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b940fd0c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 -- 172.21.15.157:0/321790251 >> 172.21.15.157:0/321790251 conn(0x7f7b940f8430 msgr2=0x7f7b940fa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:24.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 -- 172.21.15.157:0/321790251 shutdown_connections 2024-04-03T08:36:24.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.733+0000 7f7b9b200700 1 -- 172.21.15.157:0/321790251 wait complete. 2024-04-03T08:36:24.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.734+0000 7f7b9b200700 1 Processor -- start 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.734+0000 7f7b9b200700 1 -- start start 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.734+0000 7f7b9b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b9410f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.734+0000 7f7b9b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b940fdf60 0x7f7b9410feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.734+0000 7f7b9b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941104b0 con 0x7f7b940fccb0 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.734+0000 7f7b9b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94110620 con 0x7f7b940fdf60 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b9410f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b9410f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48132/0 (socket says 172.21.15.157:48132) 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 -- 172.21.15.157:0/1139176285 learned_addr learned my addr 172.21.15.157:0/1139176285 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93400700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b940fdf60 0x7f7b9410feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 -- 172.21.15.157:0/1139176285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b940fdf60 msgr2=0x7f7b9410feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b940fdf60 0x7f7b9410feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 -- 172.21.15.157:0/1139176285 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84005040 con 0x7f7b940fccb0 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b93e00700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b9410f970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400b0d0 tx=0x7f7b84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:24.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.735+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8400e070 con 0x7f7b940fccb0 2024-04-03T08:36:24.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.736+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94115020 con 0x7f7b940fccb0 2024-04-03T08:36:24.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.736+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b8400b410 con 0x7f7b940fccb0 2024-04-03T08:36:24.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.736+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b840125e0 con 0x7f7b940fccb0 2024-04-03T08:36:24.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.736+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b941155e0 con 0x7f7b940fccb0 2024-04-03T08:36:24.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.737+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b941018f0 con 0x7f7b940fccb0 2024-04-03T08:36:24.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.737+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7b8400b580 con 0x7f7b940fccb0 2024-04-03T08:36:24.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.738+0000 7f7b8be00700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7b780692a0 0x7f7b7806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:24.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.738+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7b84087f90 con 0x7f7b940fccb0 2024-04-03T08:36:24.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.738+0000 7f7b93400700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7b780692a0 0x7f7b7806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:24.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.739+0000 7f7b93400700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7b780692a0 0x7f7b7806b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009b80 tx=0x7f7b8000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:24.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.742+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7b84057d00 con 0x7f7b940fccb0 2024-04-03T08:36:24.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.941+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b94064970 con 0x7f7b940fccb0 2024-04-03T08:36:24.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.941+0000 7f7b8be00700 1 -- 172.21.15.157:0/1139176285 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b94064970 con 0x7f7b940fccb0 2024-04-03T08:36:24.942 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-03T08:36:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7b780692a0 msgr2=0x7f7b7806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7b780692a0 0x7f7b7806b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009b80 tx=0x7f7b8000b040 comp rx=0 tx=0).stop 2024-04-03T08:36:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 msgr2=0x7f7b9410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b9410f970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400b0d0 tx=0x7f7b84009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 shutdown_connections 2024-04-03T08:36:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b940fccb0 0x7f7b9410f970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f7b780692a0 0x7f7b7806b750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 --2- 172.21.15.157:0/1139176285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b940fdf60 0x7f7b9410feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:24.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 >> 172.21.15.157:0/1139176285 conn(0x7f7b940f8430 msgr2=0x7f7b940f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:24.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 shutdown_connections 2024-04-03T08:36:24.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:24.944+0000 7f7b9b200700 1 -- 172.21.15.157:0/1139176285 wait complete. 2024-04-03T08:36:24.963 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-03T08:36:25.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 -- 172.21.15.157:0/2178894503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304071e20 msgr2=0x7f5304070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 --2- 172.21.15.157:0/2178894503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304071e20 0x7f5304070330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52f8004940 tx=0x7f52f8009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 -- 172.21.15.157:0/2178894503 shutdown_connections 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 --2- 172.21.15.157:0/2178894503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5304070870 0x7f5304070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 --2- 172.21.15.157:0/2178894503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304071e20 0x7f5304070330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 -- 172.21.15.157:0/2178894503 >> 172.21.15.157:0/2178894503 conn(0x7f53040f8440 msgr2=0x7f53040fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 -- 172.21.15.157:0/2178894503 shutdown_connections 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.155+0000 7f530b400700 1 -- 172.21.15.157:0/2178894503 wait complete. 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f530b400700 1 Processor -- start 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f530b400700 1 -- start start 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f530b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 0x7f530410fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f530b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5304071e20 0x7f530410ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f530b400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5304110580 con 0x7f5304070870 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f530b400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53041106f0 con 0x7f5304071e20 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f5308a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 0x7f530410fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f5308a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 0x7f530410fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48144/0 (socket says 172.21.15.157:48144) 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f5308a00700 1 -- 172.21.15.157:0/1506429354 learned_addr learned my addr 172.21.15.157:0/1506429354 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.156+0000 7f5303e00700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5304071e20 0x7f530410ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5308a00700 1 -- 172.21.15.157:0/1506429354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5304071e20 msgr2=0x7f530410ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5308a00700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5304071e20 0x7f530410ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5308a00700 1 -- 172.21.15.157:0/1506429354 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f8005040 con 0x7f5304070870 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5308a00700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 0x7f530410fa40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52f800b970 tx=0x7f52f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52f800e040 con 0x7f5304070870 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52f8004290 con 0x7f5304070870 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53041150f0 con 0x7f5304070870 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52f801c3f0 con 0x7f5304070870 2024-04-03T08:36:25.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.157+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53041156b0 con 0x7f5304070870 2024-04-03T08:36:25.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.158+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5304064970 con 0x7f5304070870 2024-04-03T08:36:25.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.159+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f52f800bbf0 con 0x7f5304070870 2024-04-03T08:36:25.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.160+0000 7f5300c00700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f52ec0692a0 0x7f52ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.160+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f52f8088530 con 0x7f5304070870 2024-04-03T08:36:25.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.160+0000 7f5303e00700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f52ec0692a0 0x7f52ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.161+0000 7f5303e00700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f52ec0692a0 0x7f52ec06b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52f0004f40 tx=0x7f52f000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:25.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.164+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f52f8058200 con 0x7f5304070870 2024-04-03T08:36:25.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.366+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f53041079c0 con 0x7f5304070870 2024-04-03T08:36:25.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.366+0000 7f5300c00700 1 -- 172.21.15.157:0/1506429354 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f52f8057d90 con 0x7f5304070870 2024-04-03T08:36:25.367 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-03T08:36:25.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f52ec0692a0 msgr2=0x7f52ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f52ec0692a0 0x7f52ec06b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52f0004f40 tx=0x7f52f000b040 comp rx=0 tx=0).stop 2024-04-03T08:36:25.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 msgr2=0x7f530410fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 0x7f530410fa40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52f800b970 tx=0x7f52f8009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 shutdown_connections 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5304070870 0x7f530410fa40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f52ec0692a0 0x7f52ec06b750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 --2- 172.21.15.157:0/1506429354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5304071e20 0x7f530410ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 >> 172.21.15.157:0/1506429354 conn(0x7f53040f8440 msgr2=0x7f53040f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 shutdown_connections 2024-04-03T08:36:25.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.369+0000 7f530b400700 1 -- 172.21.15.157:0/1506429354 wait complete. 2024-04-03T08:36:25.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 -- 172.21.15.157:0/3149847265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec071e40 msgr2=0x7f11ec070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 --2- 172.21.15.157:0/3149847265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec071e40 0x7f11ec070350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f11e0004940 tx=0x7f11e0009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 -- 172.21.15.157:0/3149847265 shutdown_connections 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 --2- 172.21.15.157:0/3149847265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11ec070890 0x7f11ec070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 --2- 172.21.15.157:0/3149847265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec071e40 0x7f11ec070350 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 -- 172.21.15.157:0/3149847265 >> 172.21.15.157:0/3149847265 conn(0x7f11ec0f8440 msgr2=0x7f11ec0fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.578+0000 7f11f4600700 1 -- 172.21.15.157:0/3149847265 shutdown_connections 2024-04-03T08:36:25.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.579+0000 7f11f4600700 1 -- 172.21.15.157:0/3149847265 wait complete. 2024-04-03T08:36:25.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.579+0000 7f11f4600700 1 Processor -- start 2024-04-03T08:36:25.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.579+0000 7f11f4600700 1 -- start start 2024-04-03T08:36:25.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f4600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 0x7f11ec10fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f4600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11ec071e40 0x7f11ec10ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f4600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec110580 con 0x7f11ec070890 2024-04-03T08:36:25.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f4600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec1106f0 con 0x7f11ec071e40 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 0x7f11ec10fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 0x7f11ec10fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48168/0 (socket says 172.21.15.157:48168) 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 -- 172.21.15.157:0/1053612673 learned_addr learned my addr 172.21.15.157:0/1053612673 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 -- 172.21.15.157:0/1053612673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11ec071e40 msgr2=0x7f11ec10ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11ec071e40 0x7f11ec10ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 -- 172.21.15.157:0/1053612673 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0005040 con 0x7f11ec070890 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.580+0000 7f11f1c00700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 0x7f11ec10fa40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f11e000b970 tx=0x7f11e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.581+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e000e040 con 0x7f11ec070890 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.581+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11e0004290 con 0x7f11ec070890 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.581+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec1150f0 con 0x7f11ec070890 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.581+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e001c630 con 0x7f11ec070890 2024-04-03T08:36:25.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.581+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec1156b0 con 0x7f11ec070890 2024-04-03T08:36:25.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.582+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec064970 con 0x7f11ec070890 2024-04-03T08:36:25.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.583+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f11e000bbf0 con 0x7f11ec070890 2024-04-03T08:36:25.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.583+0000 7f11e9600700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f11d40692a0 0x7f11d406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.583+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f11e0088560 con 0x7f11ec070890 2024-04-03T08:36:25.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.584+0000 7f11f1200700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f11d40692a0 0x7f11d406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.584+0000 7f11f1200700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f11d40692a0 0x7f11d406b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11d8004d00 tx=0x7f11d8009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:25.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.587+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f11e00582b0 con 0x7f11ec070890 2024-04-03T08:36:25.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.781+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f11ec1079c0 con 0x7f11ec070890 2024-04-03T08:36:25.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.782+0000 7f11e9600700 1 -- 172.21.15.157:0/1053612673 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f11e0013e60 con 0x7f11ec070890 2024-04-03T08:36:25.782 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f11d40692a0 msgr2=0x7f11d406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f11d40692a0 0x7f11d406b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11d8004d00 tx=0x7f11d8009ce0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 msgr2=0x7f11ec10fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 0x7f11ec10fa40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f11e000b970 tx=0x7f11e0009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 shutdown_connections 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11ec070890 0x7f11ec10fa40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f11d40692a0 0x7f11d406b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 --2- 172.21.15.157:0/1053612673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11ec071e40 0x7f11ec10ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 >> 172.21.15.157:0/1053612673 conn(0x7f11ec0f8440 msgr2=0x7f11ec0f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 shutdown_connections 2024-04-03T08:36:25.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.784+0000 7f11f4600700 1 -- 172.21.15.157:0/1053612673 wait complete. 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: pgmap v212: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/888379063' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:36:25.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1139176285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-03T08:36:25.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:25 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1506429354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-03T08:36:25.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: pgmap v212: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/888379063' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1139176285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-03T08:36:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:25 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1506429354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-03T08:36:25.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 -- 172.21.15.157:0/2165777498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 msgr2=0x7fba54070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 --2- 172.21.15.157:0/2165777498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba54070350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba44004940 tx=0x7fba44009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:25.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 -- 172.21.15.157:0/2165777498 shutdown_connections 2024-04-03T08:36:25.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 --2- 172.21.15.157:0/2165777498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 0x7fba54070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 --2- 172.21.15.157:0/2165777498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba54070350 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 -- 172.21.15.157:0/2165777498 >> 172.21.15.157:0/2165777498 conn(0x7fba540f8440 msgr2=0x7fba540fa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:25.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 -- 172.21.15.157:0/2165777498 shutdown_connections 2024-04-03T08:36:25.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 -- 172.21.15.157:0/2165777498 wait complete. 2024-04-03T08:36:25.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.990+0000 7fba59a00700 1 Processor -- start 2024-04-03T08:36:25.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba59a00700 1 -- start start 2024-04-03T08:36:25.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba59a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 0x7fba5410fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba59a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba5410ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba59a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba54110580 con 0x7fba54071e40 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba59a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba541106f0 con 0x7fba54070890 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba5410ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba5410ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48186/0 (socket says 172.21.15.157:48186) 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52000700 1 -- 172.21.15.157:0/4058326799 learned_addr learned my addr 172.21.15.157:0/4058326799 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 0x7fba5410fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52000700 1 -- 172.21.15.157:0/4058326799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 msgr2=0x7fba5410fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52000700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 0x7fba5410fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52000700 1 -- 172.21.15.157:0/4058326799 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44005040 con 0x7fba54071e40 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.991+0000 7fba52a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 0x7fba5410fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.992+0000 7fba52000700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba5410ff80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fba40002a50 tx=0x7fba400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.992+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba40007cc0 con 0x7fba54071e40 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.992+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba4000f040 con 0x7fba54071e40 2024-04-03T08:36:25.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.992+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba54115150 con 0x7fba54071e40 2024-04-03T08:36:25.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.992+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba40009640 con 0x7fba54071e40 2024-04-03T08:36:25.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.992+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba54115710 con 0x7fba54071e40 2024-04-03T08:36:25.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.993+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba54064970 con 0x7fba54071e40 2024-04-03T08:36:25.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.994+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fba400097a0 con 0x7fba54071e40 2024-04-03T08:36:25.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.995+0000 7fba4aa00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fba380692a0 0x7fba3806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:25.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.995+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fba40086fa0 con 0x7fba54071e40 2024-04-03T08:36:25.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.995+0000 7fba52a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fba380692a0 0x7fba3806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:25.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.995+0000 7fba52a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fba380692a0 0x7fba3806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba44009fd0 tx=0x7fba44009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:25.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:25.999+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fba40056c70 con 0x7fba54071e40 2024-04-03T08:36:26.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.238+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba541079e0 con 0x7fba54071e40 2024-04-03T08:36:26.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.239+0000 7fba4aa00700 1 -- 172.21.15.157:0/4058326799 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fba40056800 con 0x7fba54071e40 2024-04-03T08:36:26.239 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:36:26.239 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24327,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/4237807179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":4237807179},{"type":"v1","addr":"172.21.15.157:6827","nonce":4237807179}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:36:11.675475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi157.zlscrk","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6829/2668059844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2668059844},{"type":"v1","addr":"172.21.15.157:6829","nonce":2668059844}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24315":{"gid":24315,"name":"cephfs.smithi181.wksnwz","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.181:6827/3566324146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3566324146},{"type":"v1","addr":"172.21.15.181:6827","nonce":3566324146}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-03T08:36:26.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fba380692a0 msgr2=0x7fba3806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fba380692a0 0x7fba3806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba44009fd0 tx=0x7fba44009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 msgr2=0x7fba5410ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba5410ff80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fba40002a50 tx=0x7fba400046b0 comp rx=0 tx=0).stop 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 shutdown_connections 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fba380692a0 0x7fba3806b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54070890 0x7fba5410fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 --2- 172.21.15.157:0/4058326799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba54071e40 0x7fba5410ff80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 >> 172.21.15.157:0/4058326799 conn(0x7fba540f8440 msgr2=0x7fba540f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 shutdown_connections 2024-04-03T08:36:26.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:26.241+0000 7fba59a00700 1 -- 172.21.15.157:0/4058326799 wait complete. 2024-04-03T08:36:26.243 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:36:26.259 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 1, 'flags': 50} 2024-04-03T08:36:26.259 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-03T08:36:26.326 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-03T08:36:26.326 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-03T08:36:26.326 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-03T08:36:26.326 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-03T08:36:26.326 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:26.326 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-03T08:36:26.326 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-03T08:36:26.326 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:26.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:26.327 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-03T08:36:26.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:26.373 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-04-03T08:36:26.483 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2024-04-03T08:36:26.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T08:36:26.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:26.487 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-04-03T08:36:26.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:26.540 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-04-03T08:36:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:26 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1053612673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-03T08:36:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:26 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4058326799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-03T08:36:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-04-03T08:36:26.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T08:36:26.621 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-03T08:36:26.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph fs ls 2024-04-03T08:36:26.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:26 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1053612673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-03T08:36:26.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:26 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/4058326799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-03T08:36:27.041 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:27.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:27 smithi157 ceph-mon[35083]: pgmap v213: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-03T08:36:27.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:27 smithi181 ceph-mon[44183]: pgmap v213: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-03T08:36:28.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.806+0000 7fec6e800700 1 -- 172.21.15.157:0/4016886378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 msgr2=0x7fec68109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:28.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.806+0000 7fec6e800700 1 --2- 172.21.15.157:0/4016886378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec68109110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fec54004970 tx=0x7fec54009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:28.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.806+0000 7fec6e800700 1 -- 172.21.15.157:0/4016886378 shutdown_connections 2024-04-03T08:36:28.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.806+0000 7fec6e800700 1 --2- 172.21.15.157:0/4016886378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec68109110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:28.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.806+0000 7fec6e800700 1 --2- 172.21.15.157:0/4016886378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec68070360 0x7fec68070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:28.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.806+0000 7fec6e800700 1 -- 172.21.15.157:0/4016886378 >> 172.21.15.157:0/4016886378 conn(0x7fec680f89b0 msgr2=0x7fec680fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:28.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.807+0000 7fec6e800700 1 -- 172.21.15.157:0/4016886378 shutdown_connections 2024-04-03T08:36:28.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.807+0000 7fec6e800700 1 -- 172.21.15.157:0/4016886378 wait complete. 2024-04-03T08:36:28.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.807+0000 7fec6e800700 1 Processor -- start 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec6e800700 1 -- start start 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec6e800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec68070360 0x7fec68115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec6e800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec681162b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec6e800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec68116900 con 0x7fec68070c70 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec6e800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6810fcd0 con 0x7fec68070360 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec66a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec681162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec66a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec681162b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48204/0 (socket says 172.21.15.157:48204) 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec66a00700 1 -- 172.21.15.157:0/1246169246 learned_addr learned my addr 172.21.15.157:0/1246169246 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec67400700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec68070360 0x7fec68115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.808+0000 7fec66a00700 1 -- 172.21.15.157:0/1246169246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec68070360 msgr2=0x7fec68115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec66a00700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec68070360 0x7fec68115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec66a00700 1 -- 172.21.15.157:0/1246169246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54005040 con 0x7fec68070c70 2024-04-03T08:36:28.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec66a00700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec681162b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec54004f50 tx=0x7fec54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5400e040 con 0x7fec68070c70 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6810ff50 con 0x7fec68070c70 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec54004290 con 0x7fec68070c70 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5401c3f0 con 0x7fec68070c70 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.809+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec68110490 con 0x7fec68070c70 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.810+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec68071aa0 con 0x7fec68070c70 2024-04-03T08:36:28.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.811+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fec5400bc10 con 0x7fec68070c70 2024-04-03T08:36:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.812+0000 7fec5f400700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fec4c0692b0 0x7fec4c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:28.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.812+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fec54088540 con 0x7fec68070c70 2024-04-03T08:36:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.812+0000 7fec67400700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fec4c0692b0 0x7fec4c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:28.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.813+0000 7fec67400700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fec4c0692b0 0x7fec4c06b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec58004990 tx=0x7fec58009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:28.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:28.817+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fec540582c0 con 0x7fec68070c70 2024-04-03T08:36:29.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.055+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fec6805f5f0 con 0x7fec68070c70 2024-04-03T08:36:29.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.056+0000 7fec5f400700 1 -- 172.21.15.157:0/1246169246 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7fec54057e50 con 0x7fec68070c70 2024-04-03T08:36:29.056 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-03T08:36:29.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fec4c0692b0 msgr2=0x7fec4c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fec4c0692b0 0x7fec4c06b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec58004990 tx=0x7fec58009ee0 comp rx=0 tx=0).stop 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 msgr2=0x7fec681162b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec681162b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec54004f50 tx=0x7fec54009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 shutdown_connections 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fec4c0692b0 0x7fec4c06b760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec68070360 0x7fec68115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 --2- 172.21.15.157:0/1246169246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec68070c70 0x7fec681162b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 >> 172.21.15.157:0/1246169246 conn(0x7fec680f89b0 msgr2=0x7fec680f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 shutdown_connections 2024-04-03T08:36:29.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29.058+0000 7fec6e800700 1 -- 172.21.15.157:0/1246169246 wait complete. 2024-04-03T08:36:29.758 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:29 smithi157 ceph-mon[35083]: pgmap v214: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-04-03T08:36:29.759 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:29 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1246169246' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-03T08:36:29.783 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-03T08:36:29.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:29.784 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-03T08:36:29.831 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f0 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f1 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 41812sec preferred_lft 41812sec 2024-04-03T08:36:29.832 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-04-03T08:36:29.833 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-03T08:36:29.833 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-03T08:36:29.833 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:29.833 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-03T08:36:29.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2024-04-03T08:36:29.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2024-04-03T08:36:29.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2024-04-03T08:36:29.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-03T08:36:29.834 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-03T08:36:29.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:29 smithi181 ceph-mon[44183]: pgmap v214: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-04-03T08:36:29.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:29 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1246169246' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-03T08:36:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:30.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:30.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:30.314 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-03T08:36:30.380 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-04-03T08:36:30.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:30.384 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-04-03T08:36:30.444 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-04-03T08:36:30.444 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-03T08:36:30.444 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-03T08:36:30.444 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-03T08:36:30.444 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-03T08:36:30.445 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:30.445 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-03T08:36:30.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-03T08:36:30.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-03T08:36:30.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-03T08:36:30.446 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-03T08:36:30.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:30.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:30.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:31.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:31.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:31.139 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-03T08:36:31.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:31.186 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-04-03T08:36:31.272 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:31.272 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-03T08:36:31.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:31.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-03T08:36:31.272 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-03T08:36:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:31.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:31.502 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-03T08:36:31.502 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-03T08:36:31.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:31.708 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:31 smithi157 ceph-mon[35083]: pgmap v215: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:36:31.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:31.820 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:31.820 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-03T08:36:31.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2024-04-03T08:36:31.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2024-04-03T08:36:31.820 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-03T08:36:31.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:31 smithi181 ceph-mon[44183]: pgmap v215: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:36:31.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:32.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:32.040 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-03T08:36:32.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-03T08:36:32.040 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:32.087 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-03T08:36:32.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-03T08:36:32.087 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:32.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-03T08:36:32.240 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2024-04-03T08:36:32.287 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2024-04-03T08:36:32.287 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2024-04-03T08:36:32.287 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/systemd 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/freezer 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/cpuset 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-03T08:36:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/perf_event 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/devices 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/pids 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/hugetlb 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/memory 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/blkio 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/selinux 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2024-04-03T08:36:32.289 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/nfs/rpc_pipefs 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/1fcacce74efedd586c68b14f5e42245413219496f3d655999c195cbcc3ffa2f1/merged 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/457ea3774f0d4d514d42ea2cccae05cbe18fdc9c333967adb89a58bc3a621839/merged 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/0 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/05db7e5bdd439017e93af2e7d1ddbfc3a99121e3235e6578c2f30bbd1c216d91/merged 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/0a58c65d105bf916636aa7df9dd35b7112da3d07f2332b6c0bf810564ae3ecf3/merged 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/0ac7dec08b350e66d6fa451f890a315ece40484a6335b6388a4666a517c2bd12/merged 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/b7d7e22547ebe3dd8b6ef86e3b100d4aa6be01937b4f5bf0eaa9b6a56dcf60cc/merged 2024-04-03T08:36:32.290 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/2a1b6c11d9216228d54152bb264e2c3e59d47a8d40f68ecfabfdeb772a1297fd/merged 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/f141790dc524d742a341c9c2ab5a1c719b40bec40afe1e6b06b1d4840067de63/merged 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/cd25ea92e9d9c14b5c8410df85ae4710ce5560ae62a39ef4040fe899d224b481/merged 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/50218a7a6a6368e802530eda2562661ef311d820e4f8cf771d3d8d115d297784/merged 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/49aa8f03d1d1f1b344125edee833702d7425d00322f074b90d9ee9b92fe44e90/merged 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/ec6ce778cec1d77bd3d62e16d1e55257898b9456d6d9858c2e2fc71a35d62710/merged 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:32.291 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:32.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:32.292 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-03T08:36:32.337 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-03T08:36:32.337 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-03T08:36:32.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-03T08:36:32.450 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2024-04-03T08:36:32.497 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/systemd 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/freezer 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/cpuset 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/perf_event 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/devices 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/pids 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/hugetlb 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/memory 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/blkio 2024-04-03T08:36:32.498 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/selinux 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/nfs/rpc_pipefs 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay 2024-04-03T08:36:32.499 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/1fcacce74efedd586c68b14f5e42245413219496f3d655999c195cbcc3ffa2f1/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/457ea3774f0d4d514d42ea2cccae05cbe18fdc9c333967adb89a58bc3a621839/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/0 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/05db7e5bdd439017e93af2e7d1ddbfc3a99121e3235e6578c2f30bbd1c216d91/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/0a58c65d105bf916636aa7df9dd35b7112da3d07f2332b6c0bf810564ae3ecf3/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/0ac7dec08b350e66d6fa451f890a315ece40484a6335b6388a4666a517c2bd12/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/b7d7e22547ebe3dd8b6ef86e3b100d4aa6be01937b4f5bf0eaa9b6a56dcf60cc/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/2a1b6c11d9216228d54152bb264e2c3e59d47a8d40f68ecfabfdeb772a1297fd/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/f141790dc524d742a341c9c2ab5a1c719b40bec40afe1e6b06b1d4840067de63/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/cd25ea92e9d9c14b5c8410df85ae4710ce5560ae62a39ef4040fe899d224b481/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/50218a7a6a6368e802530eda2562661ef311d820e4f8cf771d3d8d115d297784/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/49aa8f03d1d1f1b344125edee833702d7425d00322f074b90d9ee9b92fe44e90/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/ec6ce778cec1d77bd3d62e16d1e55257898b9456d6d9858c2e2fc71a35d62710/merged 2024-04-03T08:36:32.500 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2024-04-03T08:36:32.501 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:32.501 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:32.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:32.502 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-03T08:36:32.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:2024-04-03T08:36:32.574+0000 7f2c56c5d540 -1 init, newargv = 0x5636e1609290 newargc=15 2024-04-03T08:36:32.575 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:ceph-fuse[96053]: starting ceph client 2024-04-03T08:36:32.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:ceph-fuse[96053]: starting fuse 2024-04-03T08:36:33.650 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-03T08:36:33.725 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2024-04-03T08:36:33.773 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2024-04-03T08:36:33.773 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2024-04-03T08:36:33.773 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2024-04-03T08:36:33.773 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/systemd 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2024-04-03T08:36:33.774 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/freezer 2024-04-03T08:36:33.775 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/cpuset 2024-04-03T08:36:33.775 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-03T08:36:33.775 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-03T08:36:33.775 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/perf_event 2024-04-03T08:36:33.775 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/devices 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/pids 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/hugetlb 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/memory 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup/blkio 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/selinux 2024-04-03T08:36:33.776 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/nfs/rpc_pipefs 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2024-04-03T08:36:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/1fcacce74efedd586c68b14f5e42245413219496f3d655999c195cbcc3ffa2f1/merged 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/457ea3774f0d4d514d42ea2cccae05cbe18fdc9c333967adb89a58bc3a621839/merged 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/0 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/05db7e5bdd439017e93af2e7d1ddbfc3a99121e3235e6578c2f30bbd1c216d91/merged 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/0a58c65d105bf916636aa7df9dd35b7112da3d07f2332b6c0bf810564ae3ecf3/merged 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/0ac7dec08b350e66d6fa451f890a315ece40484a6335b6388a4666a517c2bd12/merged 2024-04-03T08:36:33.778 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/b7d7e22547ebe3dd8b6ef86e3b100d4aa6be01937b4f5bf0eaa9b6a56dcf60cc/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/2a1b6c11d9216228d54152bb264e2c3e59d47a8d40f68ecfabfdeb772a1297fd/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/f141790dc524d742a341c9c2ab5a1c719b40bec40afe1e6b06b1d4840067de63/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/cd25ea92e9d9c14b5c8410df85ae4710ce5560ae62a39ef4040fe899d224b481/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/50218a7a6a6368e802530eda2562661ef311d820e4f8cf771d3d8d115d297784/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/49aa8f03d1d1f1b344125edee833702d7425d00322f074b90d9ee9b92fe44e90/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/ec6ce778cec1d77bd3d62e16d1e55257898b9456d6d9858c2e2fc71a35d62710/merged 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:33.779 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-03T08:36:33.780 INFO:teuthology.orchestra.run.smithi157.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:33.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:33.781 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-03T08:36:33.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:33 smithi157 ceph-mon[35083]: pgmap v216: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:36:33.826 INFO:teuthology.orchestra.run.smithi157.stdout:159 2024-04-03T08:36:33.827 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [159] 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> sudo stdin-killer -- python3 -c ' 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> import glob 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> import re 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> import os 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> import subprocess 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> def _find_admin_socket(client_name): 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> files = glob.glob(asok_path) 2024-04-03T08:36:33.827 DEBUG:teuthology.orchestra.run.smithi157:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> # Given a non-glob path, it better be there 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> if "*" not in asok_path: 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> assert(len(files) == 1) 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> return files[0] 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> for f in files: 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> contents = proc_f.read() 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> if mountpoint in contents: 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> return f 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-03T08:36:33.828 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-03T08:36:33.829 DEBUG:teuthology.orchestra.run.smithi157:> print(_find_admin_socket("client.0")) 2024-04-03T08:36:33.829 DEBUG:teuthology.orchestra.run.smithi157:> ' 2024-04-03T08:36:33.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:33 smithi181 ceph-mon[44183]: pgmap v216: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:36:34.007 INFO:teuthology.orchestra.run.smithi157.stdout:/var/run/ceph/ceph-client.0.96053.asok 2024-04-03T08:36:34.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:34.020 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96053.asok 2024-04-03T08:36:34.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:34.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96053.asok status 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout: "metadata": { 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_sha1": "6fda41ff74b7f038ecae6f40cc5fca107a3d4207", 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)", 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout: "entity_id": "0", 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout: "hostname": "smithi157", 2024-04-03T08:36:34.237 INFO:teuthology.orchestra.run.smithi157.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "pid": "96053", 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "root": "/" 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_count": 0, 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_pinned_count": 0, 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 14544, 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "inst": { 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "name": { 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "client", 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: "num": 14544 2024-04-03T08:36:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:36:34.239 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-03T08:36:34.239 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-03T08:36:34.239 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-04-03T08:36:34.239 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 68447184 2024-04-03T08:36:34.239 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:36:34.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 68447184 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "inst_str": "client.14544 192.168.0.1:0/68447184", 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "addr_str": "192.168.0.1:0/68447184", 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "inode_count": 1, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_epoch": 17, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch": 47, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch_barrier": 0, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "blocklisted": false, 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs" 2024-04-03T08:36:34.240 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:36:34.251 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- ceph fs ls 2024-04-03T08:36:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:35.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:35 smithi157 ceph-mon[35083]: pgmap v217: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:36:35.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:35 smithi181 ceph-mon[44183]: pgmap v217: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:36:36.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 -- 172.21.15.157:0/1486876818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c60102e00 msgr2=0x7f9c601031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 --2- 172.21.15.157:0/1486876818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c60102e00 0x7f9c601031d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c50004940 tx=0x7f9c50009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 -- 172.21.15.157:0/1486876818 shutdown_connections 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 --2- 172.21.15.157:0/1486876818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c601037a0 0x7f9c600fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 --2- 172.21.15.157:0/1486876818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c60102e00 0x7f9c601031d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 -- 172.21.15.157:0/1486876818 >> 172.21.15.157:0/1486876818 conn(0x7f9c600f89b0 msgr2=0x7f9c600fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 -- 172.21.15.157:0/1486876818 shutdown_connections 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.506+0000 7f9c67200700 1 -- 172.21.15.157:0/1486876818 wait complete. 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.507+0000 7f9c67200700 1 Processor -- start 2024-04-03T08:36:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.507+0000 7f9c67200700 1 -- start start 2024-04-03T08:36:36.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c67200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c60102e00 0x7f9c60115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:36.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c67200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 0x7f9c601162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c67200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60116910 con 0x7f9c601037a0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c67200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6010fce0 con 0x7f9c60102e00 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 0x7f9c601162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 0x7f9c601162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35164/0 (socket says 172.21.15.157:35164) 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5f400700 1 -- 172.21.15.157:0/1851989512 learned_addr learned my addr 172.21.15.157:0/1851989512 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5fe00700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c60102e00 0x7f9c60115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5f400700 1 -- 172.21.15.157:0/1851989512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c60102e00 msgr2=0x7f9c60115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5f400700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c60102e00 0x7f9c60115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.508+0000 7f9c5f400700 1 -- 172.21.15.157:0/1851989512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50005040 con 0x7f9c601037a0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.509+0000 7f9c5f400700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 0x7f9c601162c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c002a50 tx=0x7f9c4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.509+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4c007cc0 con 0x7f9c601037a0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.509+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c4c00f040 con 0x7f9c601037a0 2024-04-03T08:36:36.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.509+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6010ffc0 con 0x7f9c601037a0 2024-04-03T08:36:36.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.509+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4c00d9c0 con 0x7f9c601037a0 2024-04-03T08:36:36.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.509+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c60110580 con 0x7f9c601037a0 2024-04-03T08:36:36.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.510+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c60107300 con 0x7f9c601037a0 2024-04-03T08:36:36.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.511+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9c4c009730 con 0x7f9c601037a0 2024-04-03T08:36:36.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.512+0000 7f9c57e00700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9c440692b0 0x7f9c4406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:36.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.512+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9c4c086f70 con 0x7f9c601037a0 2024-04-03T08:36:36.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.512+0000 7f9c5fe00700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9c440692b0 0x7f9c4406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:36.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.513+0000 7f9c5fe00700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9c440692b0 0x7f9c4406b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009fd0 tx=0x7f9c50009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:36.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.516+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9c4c056bc0 con 0x7f9c601037a0 2024-04-03T08:36:36.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.754+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c601113d0 con 0x7f9c601037a0 2024-04-03T08:36:36.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.755+0000 7f9c57e00700 1 -- 172.21.15.157:0/1851989512 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7f9c4c056750 con 0x7f9c601037a0 2024-04-03T08:36:36.756 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-03T08:36:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.757+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9c440692b0 msgr2=0x7f9c4406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.757+0000 7f9c67200700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9c440692b0 0x7f9c4406b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009fd0 tx=0x7f9c50009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.757+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 msgr2=0x7f9c601162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.757+0000 7f9c67200700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 0x7f9c601162c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c002a50 tx=0x7f9c4c004600 comp rx=0 tx=0).stop 2024-04-03T08:36:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 shutdown_connections 2024-04-03T08:36:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9c440692b0 0x7f9c4406b760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c60102e00 0x7f9c60115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 --2- 172.21.15.157:0/1851989512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c601037a0 0x7f9c601162c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 >> 172.21.15.157:0/1851989512 conn(0x7f9c600f89b0 msgr2=0x7f9c60070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 shutdown_connections 2024-04-03T08:36:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:36.758+0000 7f9c67200700 1 -- 172.21.15.157:0/1851989512 wait complete. 2024-04-03T08:36:37.483 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-03T08:36:37.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-03T08:36:37.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-04-03T08:36:37.483 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-03T08:36:37.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:37.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-03T08:36:37.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-03T08:36:37.484 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-03T08:36:37.484 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-03T08:36:37.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:37.485 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-04-03T08:36:37.538 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-03T08:36:37.538 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-03T08:36:37.539 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-04-03T08:36:37.539 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-04-03T08:36:37.539 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-04-03T08:36:37.539 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-04-03T08:36:37.539 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-03T08:36:37.539 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:37.540 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-04-03T08:36:37.540 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-03T08:36:37.540 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:37.540 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-04-03T08:36:37.540 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 41764sec preferred_lft 41764sec 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-04-03T08:36:37.541 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-04-03T08:36:37.542 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-03T08:36:37.542 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:37.542 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-04-03T08:36:37.547 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add name ceph-brx type bridge 2024-04-03T08:36:37.547 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr flush dev ceph-brx 2024-04-03T08:36:37.547 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set ceph-brx up 2024-04-03T08:36:37.547 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-03T08:36:37.547 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-04-03T08:36:37.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:37.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:37 smithi157 ceph-mon[35083]: pgmap v218: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-03T08:36:37.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:37 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1851989512' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-03T08:36:37.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:37 smithi181 ceph-mon[44183]: pgmap v218: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-03T08:36:37.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:37 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1851989512' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-03T08:36:37.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:38.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:38.009 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-03T08:36:38.077 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-04-03T08:36:38.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:38.080 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-04-03T08:36:38.165 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-04-03T08:36:38.165 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-03T08:36:38.165 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-03T08:36:38.165 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-03T08:36:38.165 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-03T08:36:38.165 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:38.166 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-04-03T08:36:38.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-03T08:36:38.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-03T08:36:38.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-03T08:36:38.166 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-04-03T08:36:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:38.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:38.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:38.908 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-04-03T08:36:38.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:38.954 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-04-03T08:36:39.039 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:39.039 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-04-03T08:36:39.040 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:39.040 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-03T08:36:39.040 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-04-03T08:36:39.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:39.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:39.269 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-03T08:36:39.269 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:39.269 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-04-03T08:36:39.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-03T08:36:39.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-03T08:36:39.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-03T08:36:39.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-03T08:36:39.270 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-03T08:36:39.270 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-04-03T08:36:39.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:39.614 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-03T08:36:39.614 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-04-03T08:36:39.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-04-03T08:36:39.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.0 master ceph-brx 2024-04-03T08:36:39.614 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-04-03T08:36:39.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-03T08:36:39.757 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:39 smithi181 ceph-mon[44183]: pgmap v219: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-03T08:36:39.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:39 smithi157 ceph-mon[35083]: pgmap v219: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-03T08:36:39.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:39.832 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-03T08:36:39.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-03T08:36:39.832 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-03T08:36:39.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-03T08:36:39.878 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:39.921 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-04-03T08:36:40.030 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-04-03T08:36:40.075 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/systemd 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/devices 2024-04-03T08:36:40.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/blkio 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/freezer 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/pids 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/perf_event 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/hugetlb 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/cpuset 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/memory 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-04-03T08:36:40.077 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/0 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/576c05783f8c6d3d563f0b7b4386663812b448cc9fd4b9e31fcec1baa8c3ffb2/merged 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/f30605a3287bf4782497a9162c5f559b2c44362039565d7be002f7c5c0856c5f/merged 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/d4a2bcd4bc7dacb4a8583f580e1d838ed865dca4424bda6362554290a0c1b670/merged 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/237ccf93cbc7afc103e9994438a45075b0d73c3320be2379bedba5eb2afdd2dc/merged 2024-04-03T08:36:40.078 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/0d97c3364edc0bc3df5c4677df202eed77300b3845ce4615c8486e73c3bbe499/merged 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/b75a0602cdfddbdda92048106875cd80a252d5eee0041e31bc736e29ea027d59/merged 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/258200be1ad17d56bccc087cc24d24d34de90fe1126f08f2bbe7167b7ef3a1f5/merged 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/ea8fe6b768eefcd9293db9d1ebe80a1c13d90604f1059d6c3c5f19904788f553/merged 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/3d28a676a03c578f1c08c420cf1326aaf5d0badc7868b857ecc528f40b7d7a06/merged 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:40.079 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:40.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:40.080 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-04-03T08:36:40.164 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-03T08:36:40.164 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-03T08:36:40.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-04-03T08:36:40.278 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-04-03T08:36:40.324 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/systemd 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/devices 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/blkio 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/freezer 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/pids 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/perf_event 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/hugetlb 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/cpuset 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/memory 2024-04-03T08:36:40.325 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-04-03T08:36:40.326 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/0 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/576c05783f8c6d3d563f0b7b4386663812b448cc9fd4b9e31fcec1baa8c3ffb2/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/f30605a3287bf4782497a9162c5f559b2c44362039565d7be002f7c5c0856c5f/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/d4a2bcd4bc7dacb4a8583f580e1d838ed865dca4424bda6362554290a0c1b670/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/237ccf93cbc7afc103e9994438a45075b0d73c3320be2379bedba5eb2afdd2dc/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/0d97c3364edc0bc3df5c4677df202eed77300b3845ce4615c8486e73c3bbe499/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/b75a0602cdfddbdda92048106875cd80a252d5eee0041e31bc736e29ea027d59/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/258200be1ad17d56bccc087cc24d24d34de90fe1126f08f2bbe7167b7ef3a1f5/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/ea8fe6b768eefcd9293db9d1ebe80a1c13d90604f1059d6c3c5f19904788f553/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/3d28a676a03c578f1c08c420cf1326aaf5d0badc7868b857ecc528f40b7d7a06/merged 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-04-03T08:36:40.327 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:40.328 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:40.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:40.329 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-04-03T08:36:40.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi181.stderr:2024-04-03T08:36:40.393+0000 7f0985ceb540 -1 init, newargv = 0x55721d3d2f90 newargc=15 2024-04-03T08:36:40.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi181.stderr:ceph-fuse[75626]: starting ceph client 2024-04-03T08:36:40.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi181.stderr:ceph-fuse[75626]: starting fuse 2024-04-03T08:36:41.478 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-04-03T08:36:41.553 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-04-03T08:36:41.600 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-04-03T08:36:41.600 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-04-03T08:36:41.600 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-04-03T08:36:41.600 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/systemd 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/devices 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/blkio 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/freezer 2024-04-03T08:36:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/pids 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/perf_event 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/hugetlb 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/cpuset 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup/memory 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-04-03T08:36:41.602 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/0 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/576c05783f8c6d3d563f0b7b4386663812b448cc9fd4b9e31fcec1baa8c3ffb2/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/f30605a3287bf4782497a9162c5f559b2c44362039565d7be002f7c5c0856c5f/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/d4a2bcd4bc7dacb4a8583f580e1d838ed865dca4424bda6362554290a0c1b670/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/237ccf93cbc7afc103e9994438a45075b0d73c3320be2379bedba5eb2afdd2dc/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/0d97c3364edc0bc3df5c4677df202eed77300b3845ce4615c8486e73c3bbe499/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/b75a0602cdfddbdda92048106875cd80a252d5eee0041e31bc736e29ea027d59/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/258200be1ad17d56bccc087cc24d24d34de90fe1126f08f2bbe7167b7ef3a1f5/merged 2024-04-03T08:36:41.603 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/ea8fe6b768eefcd9293db9d1ebe80a1c13d90604f1059d6c3c5f19904788f553/merged 2024-04-03T08:36:41.604 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/containers/storage/overlay/3d28a676a03c578f1c08c420cf1326aaf5d0badc7868b857ecc528f40b7d7a06/merged 2024-04-03T08:36:41.604 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-04-03T08:36:41.604 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:41.604 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-03T08:36:41.604 INFO:teuthology.orchestra.run.smithi181.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:41.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:41.605 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-04-03T08:36:41.649 INFO:teuthology.orchestra.run.smithi181.stdout:123 2024-04-03T08:36:41.650 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [123] 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-04-03T08:36:41.650 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-04-03T08:36:41.651 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-04-03T08:36:41.652 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-04-03T08:36:41.652 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-03T08:36:41.652 DEBUG:teuthology.orchestra.run.smithi181:> 2024-04-03T08:36:41.652 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.1")) 2024-04-03T08:36:41.652 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-04-03T08:36:41.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:41 smithi157 ceph-mon[35083]: pgmap v220: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-03T08:36:41.829 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.1.75626.asok 2024-04-03T08:36:41.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-03T08:36:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-03T08:36:41.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:41 smithi181 ceph-mon[44183]: pgmap v220: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-03T08:36:41.843 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.75626.asok 2024-04-03T08:36:41.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:41.843 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.75626.asok status 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "6fda41ff74b7f038ecae6f40cc5fca107a3d4207", 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)", 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "1", 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "75626", 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-04-03T08:36:42.061 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 24365, 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 24365 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 2560883670 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-04-03T08:36:42.062 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 2560883670 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.24365 192.168.0.1:0/2560883670", 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/2560883670", 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 17, 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 47, 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-04-03T08:36:42.063 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-04-03T08:36:42.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:42.075 DEBUG:teuthology.orchestra.run.smithi157:> stat --file-system '--printf=%T 2024-04-03T08:36:42.076 DEBUG:teuthology.orchestra.run.smithi157:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:42.130 INFO:teuthology.orchestra.run.smithi157.stdout:fuseblk 2024-04-03T08:36:42.130 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:42.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:42.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:42.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:42.208 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-04-03T08:36:42.208 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:42.255 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-04-03T08:36:42.255 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:42.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-03T08:36:42.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:42.366 INFO:teuthology.run_tasks:Running task print... 2024-04-03T08:36:42.387 INFO:teuthology.task.print:**** done client 2024-04-03T08:36:42.387 INFO:teuthology.run_tasks:Running task parallel... 2024-04-03T08:36:42.424 INFO:teuthology.task.parallel:starting parallel... 2024-04-03T08:36:42.424 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-03T08:36:42.425 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-03T08:36:42.425 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:36:42.425 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-03T08:36:42.426 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-03T08:36:42.426 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-03T08:36:42.429 INFO:tasks.workunit:Pulling workunits from ref 2be5a1775aca69fcf233a1e71f017149db5077bf 2024-04-03T08:36:42.430 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-03T08:36:42.430 INFO:tasks.workunit:timeout=3h 2024-04-03T08:36:42.430 INFO:tasks.workunit:cleanup=True 2024-04-03T08:36:42.430 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:42.482 INFO:teuthology.orchestra.run.smithi157.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:42.482 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-03T08:36:42.482 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 9fh/159d Inode: 1 Links: 2 2024-04-03T08:36:42.482 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:36:42.482 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-03T08:36:42.483 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-03T08:36:42.483 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-03 08:35:57.267261059 +0000 2024-04-03T08:36:42.483 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-03 08:36:42.204117958 +0000 2024-04-03T08:36:42.483 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-03T08:36:42.483 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-03T08:36:42.483 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-03T08:36:42.600 DEBUG:teuthology.orchestra.run.smithi181:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-03T08:36:42.647 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 7bh/123d Inode: 1 Links: 3 2024-04-03T08:36:42.647 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T08:36:42.647 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-03T08:36:42.647 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-03T08:36:42.648 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-03 08:36:42.591590152 +0000 2024-04-03T08:36:42.648 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-03 08:36:42.591590152 +0000 2024-04-03T08:36:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-04-03T08:36:42.648 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-03T08:36:42.648 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-03T08:36:42.722 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/vshankar/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 2be5a1775aca69fcf233a1e71f017149db5077bf 2024-04-03T08:36:42.722 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/vshankar/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 2be5a1775aca69fcf233a1e71f017149db5077bf 2024-04-03T08:36:42.770 INFO:tasks.workunit.client.1.smithi181.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-03T08:36:42.772 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-03T08:36:42.869 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:43.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:43 smithi157 ceph-mon[35083]: pgmap v221: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-03T08:36:43.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:43 smithi181 ceph-mon[44183]: pgmap v221: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-03T08:36:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 -- 172.21.15.157:0/3341129619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa804071f50 msgr2=0x7fa804070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 --2- 172.21.15.157:0/3341129619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa804071f50 0x7fa804070460 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4004940 tx=0x7fa7f4009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 -- 172.21.15.157:0/3341129619 shutdown_connections 2024-04-03T08:36:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 --2- 172.21.15.157:0/3341129619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8040709a0 0x7fa804070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 --2- 172.21.15.157:0/3341129619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa804071f50 0x7fa804070460 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 -- 172.21.15.157:0/3341129619 >> 172.21.15.157:0/3341129619 conn(0x7fa8040f8560 msgr2=0x7fa8040fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 -- 172.21.15.157:0/3341129619 shutdown_connections 2024-04-03T08:36:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.788+0000 7fa809400700 1 -- 172.21.15.157:0/3341129619 wait complete. 2024-04-03T08:36:44.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.789+0000 7fa809400700 1 Processor -- start 2024-04-03T08:36:44.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.789+0000 7fa809400700 1 -- start start 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa809400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040709a0 0x7fa804113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa809400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa804071f50 0x7fa8041144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa809400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804114af0 con 0x7fa8040709a0 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa809400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804115340 con 0x7fa804071f50 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa802800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040709a0 0x7fa804113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa802800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040709a0 0x7fa804113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55004/0 (socket says 172.21.15.157:55004) 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa802800700 1 -- 172.21.15.157:0/1511421302 learned_addr learned my addr 172.21.15.157:0/1511421302 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.790+0000 7fa801e00700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa804071f50 0x7fa8041144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa802800700 1 -- 172.21.15.157:0/1511421302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa804071f50 msgr2=0x7fa8041144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa802800700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa804071f50 0x7fa8041144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa802800700 1 -- 172.21.15.157:0/1511421302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4005040 con 0x7fa8040709a0 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa801e00700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa804071f50 0x7fa8041144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa802800700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8040709a0 0x7fa804113fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400b0d0 tx=0x7fa7f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f400e070 con 0x7fa8040709a0 2024-04-03T08:36:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7f4013de0 con 0x7fa8040709a0 2024-04-03T08:36:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa809400700 1 -- 172.21.15.157:0/1511421302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8041155c0 con 0x7fa8040709a0 2024-04-03T08:36:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f400be30 con 0x7fa8040709a0 2024-04-03T08:36:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.791+0000 7fa809400700 1 -- 172.21.15.157:0/1511421302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa804115b00 con 0x7fa8040709a0 2024-04-03T08:36:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.793+0000 7fa809400700 1 -- 172.21.15.157:0/1511421302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80405f5f0 con 0x7fa8040709a0 2024-04-03T08:36:44.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.794+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa7f4013910 con 0x7fa8040709a0 2024-04-03T08:36:44.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.795+0000 7fa7faa00700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa7e80692b0 0x7fa7e806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:44.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.795+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa7f4087f70 con 0x7fa8040709a0 2024-04-03T08:36:44.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.795+0000 7fa801e00700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa7e80692b0 0x7fa7e806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:44.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.796+0000 7fa801e00700 1 --2- 172.21.15.157:0/1511421302 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa7e80692b0 0x7fa7e806b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009b80 tx=0x7fa7f000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:44.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:44.800+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa7f4057cc0 con 0x7fa8040709a0 2024-04-03T08:36:45.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:45.006+0000 7fa809400700 1 -- 172.21.15.157:0/1511421302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fa80404bed0 con 0x7fa8040709a0 2024-04-03T08:36:45.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:45.006+0000 7fa7faa00700 1 -- 172.21.15.157:0/1511421302 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7fa7f40220c0 con 0x7fa8040709a0 2024-04-03T08:36:45.010 INFO:teuthology.orchestra.run.smithi157.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-03T08:36:45.751 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:45 smithi157 ceph-mon[35083]: pgmap v222: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-03T08:36:45.751 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:45.774 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-03T08:36:45.774 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:36:45.774 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-03T08:36:45.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:45 smithi181 ceph-mon[44183]: pgmap v222: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-03T08:36:45.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:36:46.213 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:47 smithi157 ceph-mon[35083]: pgmap v223: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-03T08:36:47.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:47 smithi181 ceph-mon[44183]: pgmap v223: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-03T08:36:48.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.229+0000 7f847fe00700 1 -- 172.21.15.157:0/2634299337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 msgr2=0x7f8480102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:48.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.229+0000 7f847fe00700 1 --2- 172.21.15.157:0/2634299337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f8480102180 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f846c004940 tx=0x7f846c009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:48.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.230+0000 7f847fe00700 1 -- 172.21.15.157:0/2634299337 shutdown_connections 2024-04-03T08:36:48.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.230+0000 7f847fe00700 1 --2- 172.21.15.157:0/2634299337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f8480102180 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:48.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.230+0000 7f847fe00700 1 --2- 172.21.15.157:0/2634299337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 0x7f84800ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:48.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.230+0000 7f847fe00700 1 -- 172.21.15.157:0/2634299337 >> 172.21.15.157:0/2634299337 conn(0x7f84800f7270 msgr2=0x7f84800f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:48.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.230+0000 7f847fe00700 1 -- 172.21.15.157:0/2634299337 shutdown_connections 2024-04-03T08:36:48.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.230+0000 7f847fe00700 1 -- 172.21.15.157:0/2634299337 wait complete. 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847fe00700 1 Processor -- start 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847fe00700 1 -- start start 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 0x7f848010fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f848010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847fe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84801105b0 con 0x7f84800ffda0 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480110db0 con 0x7f8480066280 2024-04-03T08:36:48.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.231+0000 7f847e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f848010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 0x7f848010fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f848010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55016/0 (socket says 172.21.15.157:55016) 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847e000700 1 -- 172.21.15.157:0/1532386157 learned_addr learned my addr 172.21.15.157:0/1532386157 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847ea00700 1 -- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 msgr2=0x7f848010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847ea00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f848010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847ea00700 1 -- 172.21.15.157:0/1532386157 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470005040 con 0x7f8480066280 2024-04-03T08:36:48.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847e000700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f848010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:36:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.232+0000 7f847ea00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 0x7f848010fa70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8470009fd0 tx=0x7f8470009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.233+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8470012570 con 0x7f8480066280 2024-04-03T08:36:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.233+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f847000f040 con 0x7f8480066280 2024-04-03T08:36:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.233+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8470013c00 con 0x7f8480066280 2024-04-03T08:36:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.233+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c005040 con 0x7f8480066280 2024-04-03T08:36:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.233+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8480111440 con 0x7f8480066280 2024-04-03T08:36:48.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.234+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848005f5f0 con 0x7f8480066280 2024-04-03T08:36:48.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.235+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f847001c410 con 0x7f8480066280 2024-04-03T08:36:48.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.236+0000 7f8476a00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84640692b0 0x7f846406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:48.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.236+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8470086ec0 con 0x7f8480066280 2024-04-03T08:36:48.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.236+0000 7f847e000700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84640692b0 0x7f846406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:48.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.236+0000 7f847e000700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84640692b0 0x7f846406b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f846c009fd0 tx=0x7f846c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:48.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.241+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8470056b90 con 0x7f8480066280 2024-04-03T08:36:48.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.464+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f8480111810 con 0x7f8480066280 2024-04-03T08:36:48.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.465+0000 7f8476a00700 1 -- 172.21.15.157:0/1532386157 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8470056720 con 0x7f8480066280 2024-04-03T08:36:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84640692b0 msgr2=0x7f846406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84640692b0 0x7f846406b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f846c009fd0 tx=0x7f846c009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 msgr2=0x7f848010fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 0x7f848010fa70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8470009fd0 tx=0x7f8470009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 shutdown_connections 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f84640692b0 0x7f846406b760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8480066280 0x7f848010fa70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 --2- 172.21.15.157:0/1532386157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84800ffda0 0x7f848010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 >> 172.21.15.157:0/1532386157 conn(0x7f84800f7270 msgr2=0x7f84800fb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 shutdown_connections 2024-04-03T08:36:48.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:48.468+0000 7f847fe00700 1 -- 172.21.15.157:0/1532386157 wait complete. 2024-04-03T08:36:49.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-03T08:36:49.786 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:49.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:49 smithi157 ceph-mon[35083]: pgmap v224: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-03T08:36:49.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:49 smithi181 ceph-mon[44183]: pgmap v224: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-03T08:36:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:51 smithi157 ceph-mon[35083]: pgmap v225: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.830+0000 7fd3efe00700 1 -- 172.21.15.157:0/307573930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 msgr2=0x7fd3f0102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.830+0000 7fd3efe00700 1 --2- 172.21.15.157:0/307573930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f0102180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc004940 tx=0x7fd3dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.830+0000 7fd3efe00700 1 -- 172.21.15.157:0/307573930 shutdown_connections 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.830+0000 7fd3efe00700 1 --2- 172.21.15.157:0/307573930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f0102180 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.830+0000 7fd3efe00700 1 --2- 172.21.15.157:0/307573930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 0x7fd3f00ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.830+0000 7fd3efe00700 1 -- 172.21.15.157:0/307573930 >> 172.21.15.157:0/307573930 conn(0x7fd3f00f7270 msgr2=0x7fd3f00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.831+0000 7fd3efe00700 1 -- 172.21.15.157:0/307573930 shutdown_connections 2024-04-03T08:36:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.831+0000 7fd3efe00700 1 -- 172.21.15.157:0/307573930 wait complete. 2024-04-03T08:36:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.831+0000 7fd3efe00700 1 Processor -- start 2024-04-03T08:36:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.831+0000 7fd3efe00700 1 -- start start 2024-04-03T08:36:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3efe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 0x7fd3f00fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3efe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f00fb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3efe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01114a0 con 0x7fd3f00ffda0 2024-04-03T08:36:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3efe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01115e0 con 0x7fd3f0066280 2024-04-03T08:36:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3ee000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f00fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3ee000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f00fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55042/0 (socket says 172.21.15.157:55042) 2024-04-03T08:36:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3ee000700 1 -- 172.21.15.157:0/3695469908 learned_addr learned my addr 172.21.15.157:0/3695469908 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.832+0000 7fd3eea00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 0x7fd3f00fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3ee000700 1 -- 172.21.15.157:0/3695469908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 msgr2=0x7fd3f00fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3ee000700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 0x7fd3f00fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3ee000700 1 -- 172.21.15.157:0/3695469908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc005040 con 0x7fd3f00ffda0 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3eea00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 0x7fd3f00fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3ee000700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f00fb760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00b0d0 tx=0x7fd3dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc00e070 con 0x7fd3f00ffda0 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3dc00b410 con 0x7fd3f00ffda0 2024-04-03T08:36:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc0125e0 con 0x7fd3f00ffda0 2024-04-03T08:36:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.833+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00fbd00 con 0x7fd3f00ffda0 2024-04-03T08:36:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.834+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f00fc2c0 con 0x7fd3f00ffda0 2024-04-03T08:36:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.835+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f005f5f0 con 0x7fd3f00ffda0 2024-04-03T08:36:51.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.835+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd3dc00b580 con 0x7fd3f00ffda0 2024-04-03T08:36:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.836+0000 7fd3e6a00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd3d40692b0 0x7fd3d406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.836+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd3dc087f50 con 0x7fd3f00ffda0 2024-04-03T08:36:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.837+0000 7fd3eea00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd3d40692b0 0x7fd3d406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.837+0000 7fd3eea00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd3d40692b0 0x7fd3d406b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00fcfd0 tx=0x7fd3e000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:51.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:51.841+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd3dc054210 con 0x7fd3f00ffda0 2024-04-03T08:36:51.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:51 smithi181 ceph-mon[44183]: pgmap v225: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-03T08:36:52.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.056+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd3f004bed0 con 0x7fd3f00ffda0 2024-04-03T08:36:52.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.056+0000 7fd3e6a00700 1 -- 172.21.15.157:0/3695469908 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd3dc022020 con 0x7fd3f00ffda0 2024-04-03T08:36:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.058+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd3d40692b0 msgr2=0x7fd3d406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.058+0000 7fd3efe00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd3d40692b0 0x7fd3d406b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00fcfd0 tx=0x7fd3e000b040 comp rx=0 tx=0).stop 2024-04-03T08:36:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 msgr2=0x7fd3f00fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f00fb760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00b0d0 tx=0x7fd3dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 shutdown_connections 2024-04-03T08:36:52.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd3d40692b0 0x7fd3d406b760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:52.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3f0066280 0x7fd3f00fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:52.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 --2- 172.21.15.157:0/3695469908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f00ffda0 0x7fd3f00fb760 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:52.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 >> 172.21.15.157:0/3695469908 conn(0x7fd3f00f7270 msgr2=0x7fd3f00f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:52.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 shutdown_connections 2024-04-03T08:36:52.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:52.059+0000 7fd3efe00700 1 -- 172.21.15.157:0/3695469908 wait complete. 2024-04-03T08:36:52.944 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-03T08:36:53.422 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:53 smithi157 ceph-mon[35083]: pgmap v226: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-03T08:36:53.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:53 smithi181 ceph-mon[44183]: pgmap v226: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 -- 172.21.15.157:0/4110351830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c066260 msgr2=0x7fea0c101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 --2- 172.21.15.157:0/4110351830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c066260 0x7fea0c101c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc004940 tx=0x7fe9fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 -- 172.21.15.157:0/4110351830 shutdown_connections 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 --2- 172.21.15.157:0/4110351830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c1021c0 0x7fea0c1045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 --2- 172.21.15.157:0/4110351830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c066260 0x7fea0c101c80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 -- 172.21.15.157:0/4110351830 >> 172.21.15.157:0/4110351830 conn(0x7fea0c0f7270 msgr2=0x7fea0c0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 -- 172.21.15.157:0/4110351830 shutdown_connections 2024-04-03T08:36:55.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.520+0000 7fea0be00700 1 -- 172.21.15.157:0/4110351830 wait complete. 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.521+0000 7fea0be00700 1 Processor -- start 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.521+0000 7fea0be00700 1 -- start start 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.521+0000 7fea0be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c066260 0x7fea0c10fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.521+0000 7fea0be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 0x7fea0c110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.521+0000 7fea0be00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c110610 con 0x7fea0c1021c0 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.521+0000 7fea0be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c110e10 con 0x7fea0c066260 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 0x7fea0c110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 0x7fea0c110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42600/0 (socket says 172.21.15.157:42600) 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0a000700 1 -- 172.21.15.157:0/1235401130 learned_addr learned my addr 172.21.15.157:0/1235401130 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0aa00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c066260 0x7fea0c10fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0aa00700 1 -- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 msgr2=0x7fea0c110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:55.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0aa00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 0x7fea0c110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:55.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0aa00700 1 -- 172.21.15.157:0/1235401130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc005040 con 0x7fea0c066260 2024-04-03T08:36:55.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0a000700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 0x7fea0c110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:36:55.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.522+0000 7fea0aa00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c066260 0x7fea0c10fad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc000c00 tx=0x7fe9fc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:55.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.523+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9fc00e040 con 0x7fea0c066260 2024-04-03T08:36:55.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.523+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c111090 con 0x7fea0c066260 2024-04-03T08:36:55.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.523+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9fc00bb90 con 0x7fea0c066260 2024-04-03T08:36:55.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.523+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9fc01c3f0 con 0x7fea0c066260 2024-04-03T08:36:55.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.523+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0c1115d0 con 0x7fea0c066260 2024-04-03T08:36:55.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.524+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0c05f5f0 con 0x7fea0c066260 2024-04-03T08:36:55.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.525+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe9fc00bd00 con 0x7fea0c066260 2024-04-03T08:36:55.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.526+0000 7fea02a00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe9f00692b0 0x7fe9f006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:55.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.526+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe9fc087ea0 con 0x7fea0c066260 2024-04-03T08:36:55.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.526+0000 7fea0a000700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe9f00692b0 0x7fe9f006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:55.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.527+0000 7fea0a000700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe9f00692b0 0x7fe9f006b760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800e5e0 tx=0x7fe9f800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:55.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.531+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe9fc057b70 con 0x7fea0c066260 2024-04-03T08:36:55.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.732+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fea0c04bed0 con 0x7fea0c066260 2024-04-03T08:36:55.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.733+0000 7fea02a00700 1 -- 172.21.15.157:0/1235401130 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe9fc057700 con 0x7fea0c066260 2024-04-03T08:36:55.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe9f00692b0 msgr2=0x7fe9f006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:55.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe9f00692b0 0x7fe9f006b760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800e5e0 tx=0x7fe9f800b040 comp rx=0 tx=0).stop 2024-04-03T08:36:55.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c066260 msgr2=0x7fea0c10fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c066260 0x7fea0c10fad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc000c00 tx=0x7fe9fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 shutdown_connections 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe9f00692b0 0x7fe9f006b760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea0c066260 0x7fea0c10fad0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 --2- 172.21.15.157:0/1235401130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea0c1021c0 0x7fea0c110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 >> 172.21.15.157:0/1235401130 conn(0x7fea0c0f7270 msgr2=0x7fea0c0f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 shutdown_connections 2024-04-03T08:36:55.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:55.736+0000 7fea0be00700 1 -- 172.21.15.157:0/1235401130 wait complete. 2024-04-03T08:36:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:55 smithi157 ceph-mon[35083]: pgmap v227: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-03T08:36:55.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:55 smithi181 ceph-mon[44183]: pgmap v227: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-03T08:36:56.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-03T08:36:56.874 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:36:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:57 smithi157 ceph-mon[35083]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-03T08:36:57.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:57 smithi181 ceph-mon[44183]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 -- 172.21.15.157:0/1937084498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fdec0 msgr2=0x7f00d40fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 --2- 172.21.15.157:0/1937084498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fdec0 0x7f00d40fe330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00c0004940 tx=0x7f00c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 -- 172.21.15.157:0/1937084498 shutdown_connections 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 --2- 172.21.15.157:0/1937084498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fdec0 0x7f00d40fe330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 --2- 172.21.15.157:0/1937084498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00d40fcc10 0x7f00d40fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 -- 172.21.15.157:0/1937084498 >> 172.21.15.157:0/1937084498 conn(0x7f00d40f83d0 msgr2=0x7f00d40fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 -- 172.21.15.157:0/1937084498 shutdown_connections 2024-04-03T08:36:58.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.890+0000 7f00dac00700 1 -- 172.21.15.157:0/1937084498 wait complete. 2024-04-03T08:36:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00dac00700 1 Processor -- start 2024-04-03T08:36:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00dac00700 1 -- start start 2024-04-03T08:36:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00dac00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 0x7f00d410f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00dac00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00d40fdec0 0x7f00d410ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00dac00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4110530 con 0x7f00d40fcc10 2024-04-03T08:36:58.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00dac00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4110d80 con 0x7f00d40fdec0 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.891+0000 7f00d9800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 0x7f00d410f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d9800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 0x7f00d410f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42614/0 (socket says 172.21.15.157:42614) 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d9800700 1 -- 172.21.15.157:0/2522557366 learned_addr learned my addr 172.21.15.157:0/2522557366 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d8e00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00d40fdec0 0x7f00d410ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d9800700 1 -- 172.21.15.157:0/2522557366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00d40fdec0 msgr2=0x7f00d410ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d9800700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00d40fdec0 0x7f00d410ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d9800700 1 -- 172.21.15.157:0/2522557366 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0005040 con 0x7f00d40fcc10 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d9800700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 0x7f00d410f9f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f00c800eb40 tx=0x7f00c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00c8007cc0 con 0x7f00d40fcc10 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.893+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00c800f040 con 0x7f00d40fcc10 2024-04-03T08:36:58.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.892+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4111000 con 0x7f00d40fcc10 2024-04-03T08:36:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.893+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00c800ca10 con 0x7f00d40fcc10 2024-04-03T08:36:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.893+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d4111540 con 0x7f00d40fcc10 2024-04-03T08:36:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.894+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d4101850 con 0x7f00d40fcc10 2024-04-03T08:36:58.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.894+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f00c800cc80 con 0x7f00d40fcc10 2024-04-03T08:36:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.895+0000 7f00d1600700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f00bc0692b0 0x7f00bc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:36:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.895+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f00c8086e70 con 0x7f00d40fcc10 2024-04-03T08:36:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.896+0000 7f00d8e00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f00bc0692b0 0x7f00bc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:36:58.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.896+0000 7f00d8e00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f00bc0692b0 0x7f00bc06b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b0d0 tx=0x7f00c0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:36:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:58.900+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f00c804e190 con 0x7f00d40fcc10 2024-04-03T08:36:59.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.120+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d4111760 con 0x7f00bc0692b0 2024-04-03T08:36:59.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.126+0000 7f00d1600700 1 -- 172.21.15.157:0/2522557366 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f00d4111760 con 0x7f00bc0692b0 2024-04-03T08:36:59.126 INFO:teuthology.orchestra.run.smithi157.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f00bc0692b0 msgr2=0x7f00bc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f00bc0692b0 0x7f00bc06b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b0d0 tx=0x7f00c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 msgr2=0x7f00d410f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 0x7f00d410f9f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f00c800eb40 tx=0x7f00c800b040 comp rx=0 tx=0).stop 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 shutdown_connections 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00d40fcc10 0x7f00d410f9f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f00bc0692b0 0x7f00bc06b760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 --2- 172.21.15.157:0/2522557366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00d40fdec0 0x7f00d410ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 >> 172.21.15.157:0/2522557366 conn(0x7f00d40f83d0 msgr2=0x7f00d40f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.128+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 shutdown_connections 2024-04-03T08:36:59.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:36:59.129+0000 7f00dac00700 1 -- 172.21.15.157:0/2522557366 wait complete. 2024-04-03T08:36:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:59 smithi157 ceph-mon[35083]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-03T08:36:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:59 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:36:59 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:36:59.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:59 smithi181 ceph-mon[44183]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-03T08:36:59.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:59 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:36:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:36:59 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:36:59.992 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-03T08:36:59.993 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:36:59.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-03T08:37:00.505 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:37:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:00 smithi157 ceph-mon[35083]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:00 smithi157 ceph-mon[35083]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:37:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:37:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:37:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:37:00.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:00 smithi181 ceph-mon[44183]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:00.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:00 smithi181 ceph-mon[44183]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:37:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:37:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:37:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:37:01.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:01 smithi157 ceph-mon[35083]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-03T08:37:01.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:01 smithi157 ceph-mon[35083]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:37:01.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:01 smithi181 ceph-mon[44183]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-03T08:37:01.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:01 smithi181 ceph-mon[44183]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-04-03T08:37:02.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.680+0000 7fcd4fe00700 1 -- 172.21.15.157:0/1129754818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd50100090 msgr2=0x7fcd50100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.680+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/1129754818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd50100090 0x7fcd50100500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c004940 tx=0x7fcd3c009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.680+0000 7fcd4fe00700 1 -- 172.21.15.157:0/1129754818 shutdown_connections 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.680+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/1129754818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd50100090 0x7fcd50100500 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.680+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/1129754818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd500fee90 0x7fcd500ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.680+0000 7fcd4fe00700 1 -- 172.21.15.157:0/1129754818 >> 172.21.15.157:0/1129754818 conn(0x7fcd500fa790 msgr2=0x7fcd500fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.681+0000 7fcd4fe00700 1 -- 172.21.15.157:0/1129754818 shutdown_connections 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.681+0000 7fcd4fe00700 1 -- 172.21.15.157:0/1129754818 wait complete. 2024-04-03T08:37:02.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.682+0000 7fcd4fe00700 1 Processor -- start 2024-04-03T08:37:02.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.682+0000 7fcd4fe00700 1 -- start start 2024-04-03T08:37:02.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd500fee90 0x7fcd5010f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:02.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd50100090 0x7fcd5010ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:02.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4fe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50110500 con 0x7fcd500fee90 2024-04-03T08:37:02.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50110d50 con 0x7fcd50100090 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd50100090 0x7fcd5010ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd500fee90 0x7fcd5010f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd50100090 0x7fcd5010ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:59638/0 (socket says 172.21.15.157:59638) 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4e000700 1 -- 172.21.15.157:0/3078228698 learned_addr learned my addr 172.21.15.157:0/3078228698 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4ea00700 1 -- 172.21.15.157:0/3078228698 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd50100090 msgr2=0x7fcd5010ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4ea00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd50100090 0x7fcd5010ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:02.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.683+0000 7fcd4ea00700 1 -- 172.21.15.157:0/3078228698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c005040 con 0x7fcd500fee90 2024-04-03T08:37:02.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.684+0000 7fcd4ea00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd500fee90 0x7fcd5010f9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ffc00 tx=0x7fcd4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:02.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.684+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd40004e90 con 0x7fcd500fee90 2024-04-03T08:37:02.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.684+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd4000f040 con 0x7fcd500fee90 2024-04-03T08:37:02.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.684+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd50110fd0 con 0x7fcd500fee90 2024-04-03T08:37:02.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.684+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4000c980 con 0x7fcd500fee90 2024-04-03T08:37:02.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.684+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd50111510 con 0x7fcd500fee90 2024-04-03T08:37:02.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.686+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd500fe290 con 0x7fcd500fee90 2024-04-03T08:37:02.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.686+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcd40007cc0 con 0x7fcd500fee90 2024-04-03T08:37:02.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.687+0000 7fcd46a00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcd340692a0 0x7fcd3406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:02.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.687+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcd40086a60 con 0x7fcd500fee90 2024-04-03T08:37:02.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.688+0000 7fcd4e000700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcd340692a0 0x7fcd3406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:02.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.688+0000 7fcd4e000700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcd340692a0 0x7fcd3406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009fd0 tx=0x7fcd3c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:02.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.692+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcd4004e190 con 0x7fcd500fee90 2024-04-03T08:37:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.937+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd501118f0 con 0x7fcd340692a0 2024-04-03T08:37:02.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.938+0000 7fcd46a00700 1 -- 172.21.15.157:0/3078228698 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fcd501118f0 con 0x7fcd340692a0 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcd340692a0 msgr2=0x7fcd3406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcd340692a0 0x7fcd3406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009fd0 tx=0x7fcd3c009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd500fee90 msgr2=0x7fcd5010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd500fee90 0x7fcd5010f9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ffc00 tx=0x7fcd4000b040 comp rx=0 tx=0).stop 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 shutdown_connections 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd500fee90 0x7fcd5010f9c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcd340692a0 0x7fcd3406b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:02.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 --2- 172.21.15.157:0/3078228698 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd50100090 0x7fcd5010ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:02.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.940+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 >> 172.21.15.157:0/3078228698 conn(0x7fcd500fa790 msgr2=0x7fcd500fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:02.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.941+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 shutdown_connections 2024-04-03T08:37:02.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:02.941+0000 7fcd4fe00700 1 -- 172.21.15.157:0/3078228698 wait complete. 2024-04-03T08:37:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 -- 172.21.15.157:0/572896391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 msgr2=0x7f95280fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 --2- 172.21.15.157:0/572896391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f95280fe540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9514004940 tx=0x7f9514009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 -- 172.21.15.157:0/572896391 shutdown_connections 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 --2- 172.21.15.157:0/572896391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f95280fe540 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 --2- 172.21.15.157:0/572896391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95280fcee0 0x7f95280fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 -- 172.21.15.157:0/572896391 >> 172.21.15.157:0/572896391 conn(0x7f95280f8560 msgr2=0x7f95280fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 -- 172.21.15.157:0/572896391 shutdown_connections 2024-04-03T08:37:03.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.102+0000 7f952fe00700 1 -- 172.21.15.157:0/572896391 wait complete. 2024-04-03T08:37:03.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.103+0000 7f952fe00700 1 Processor -- start 2024-04-03T08:37:03.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.103+0000 7f952fe00700 1 -- start start 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95280fcee0 0x7f9528071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f9528070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952fe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280708a0 con 0x7f95280fe0d0 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280709e0 con 0x7f95280fcee0 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952ca00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f9528070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952ca00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f9528070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34638/0 (socket says 172.21.15.157:34638) 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952ca00700 1 -- 172.21.15.157:0/2803494462 learned_addr learned my addr 172.21.15.157:0/2803494462 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952d400700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95280fcee0 0x7f9528071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952ca00700 1 -- 172.21.15.157:0/2803494462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95280fcee0 msgr2=0x7f9528071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952ca00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95280fcee0 0x7f9528071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.104+0000 7f952ca00700 1 -- 172.21.15.157:0/2803494462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514005040 con 0x7f95280fe0d0 2024-04-03T08:37:03.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.105+0000 7f952ca00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f9528070310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f951400b3b0 tx=0x7f9514009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:03.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.105+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951400e040 con 0x7f95280fe0d0 2024-04-03T08:37:03.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.105+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9528070c30 con 0x7f95280fe0d0 2024-04-03T08:37:03.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.105+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9514004290 con 0x7f95280fe0d0 2024-04-03T08:37:03.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.105+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951401c3f0 con 0x7f95280fe0d0 2024-04-03T08:37:03.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.105+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528115af0 con 0x7f95280fe0d0 2024-04-03T08:37:03.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.107+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952805f5f0 con 0x7f95280fe0d0 2024-04-03T08:37:03.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.107+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f951400bbf0 con 0x7f95280fe0d0 2024-04-03T08:37:03.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.109+0000 7f9525600700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95100692b0 0x7f951006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.109+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9514088500 con 0x7f95280fe0d0 2024-04-03T08:37:03.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.109+0000 7f952d400700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95100692b0 0x7f951006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.110+0000 7f952d400700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95100692b0 0x7f951006b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9528071b60 tx=0x7f951c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:03.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.113+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f95140547c0 con 0x7f95280fe0d0 2024-04-03T08:37:03.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.352+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95281024e0 con 0x7f95100692b0 2024-04-03T08:37:03.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.353+0000 7f9525600700 1 -- 172.21.15.157:0/2803494462 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f95281024e0 con 0x7f95100692b0 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95100692b0 msgr2=0x7f951006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95100692b0 0x7f951006b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9528071b60 tx=0x7f951c009040 comp rx=0 tx=0).stop 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 msgr2=0x7f9528070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f9528070310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f951400b3b0 tx=0x7f9514009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 shutdown_connections 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f95100692b0 0x7f951006b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95280fcee0 0x7f9528071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 --2- 172.21.15.157:0/2803494462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95280fe0d0 0x7f9528070310 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 >> 172.21.15.157:0/2803494462 conn(0x7f95280f8560 msgr2=0x7f95280f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:03.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 shutdown_connections 2024-04-03T08:37:03.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.356+0000 7f952fe00700 1 -- 172.21.15.157:0/2803494462 wait complete. 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 -- 172.21.15.157:0/4223155765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fcee0 msgr2=0x7eff440fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 --2- 172.21.15.157:0/4223155765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fcee0 0x7eff440fd310 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7eff34004940 tx=0x7eff34009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 -- 172.21.15.157:0/4223155765 shutdown_connections 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 --2- 172.21.15.157:0/4223155765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fe0d0 0x7eff440fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 --2- 172.21.15.157:0/4223155765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fcee0 0x7eff440fd310 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 -- 172.21.15.157:0/4223155765 >> 172.21.15.157:0/4223155765 conn(0x7eff440f8560 msgr2=0x7eff440fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 -- 172.21.15.157:0/4223155765 shutdown_connections 2024-04-03T08:37:03.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.508+0000 7eff4a400700 1 -- 172.21.15.157:0/4223155765 wait complete. 2024-04-03T08:37:03.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.509+0000 7eff4a400700 1 Processor -- start 2024-04-03T08:37:03.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.509+0000 7eff4a400700 1 -- start start 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff4a400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 0x7eff44071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff4a400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fe0d0 0x7eff44070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff4a400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff440708c0 con 0x7eff440fe0d0 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff4a400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff44070a30 con 0x7eff440fcee0 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff42a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fe0d0 0x7eff44070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff43400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 0x7eff44071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff43400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 0x7eff44071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:59666/0 (socket says 172.21.15.157:59666) 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff42a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fe0d0 0x7eff44070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34652/0 (socket says 172.21.15.157:34652) 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.510+0000 7eff43400700 1 -- 172.21.15.157:0/2536131988 learned_addr learned my addr 172.21.15.157:0/2536131988 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff43400700 1 -- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fe0d0 msgr2=0x7eff44070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff43400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fe0d0 0x7eff44070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff43400700 1 -- 172.21.15.157:0/2536131988 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34005040 con 0x7eff440fcee0 2024-04-03T08:37:03.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff43400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 0x7eff44071e40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff340040d0 tx=0x7eff34009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:03.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3400e070 con 0x7eff440fcee0 2024-04-03T08:37:03.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff3401c400 con 0x7eff440fcee0 2024-04-03T08:37:03.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3400b650 con 0x7eff440fcee0 2024-04-03T08:37:03.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44070cb0 con 0x7eff440fcee0 2024-04-03T08:37:03.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.511+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff44071190 con 0x7eff440fcee0 2024-04-03T08:37:03.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.513+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4405f5f0 con 0x7eff440fcee0 2024-04-03T08:37:03.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.513+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7eff3401ca90 con 0x7eff440fcee0 2024-04-03T08:37:03.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.514+0000 7eff3b400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7eff280692b0 0x7eff2806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.514+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7eff34088820 con 0x7eff440fcee0 2024-04-03T08:37:03.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.514+0000 7eff42a00700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7eff280692b0 0x7eff2806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.515+0000 7eff42a00700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7eff280692b0 0x7eff2806b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff30004fd0 tx=0x7eff3000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:03.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.519+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7eff34054ae0 con 0x7eff440fcee0 2024-04-03T08:37:03.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.751+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff441023e0 con 0x7eff280692b0 2024-04-03T08:37:03.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.762+0000 7eff3b400700 1 -- 172.21.15.157:0/2536131988 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7eff441023e0 con 0x7eff280692b0 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (5m) 39s ago 7m 12.9M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (7m) 39s ago 7m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (6m) 44s ago 6m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (5m) 39s ago 6m 72.2M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (68s) 39s ago 67s 10.5M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (60s) 39s ago 59s 12.7M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (64s) 44s ago 64s 10.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (56s) 44s ago 56s 11.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:37:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (8m) 39s ago 8m 481M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (6m) 44s ago 6m 431M - 17.2.7-805-g6fda41ff a49113eacc58 ef09dfea7a47 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (8m) 39s ago 9m 44.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (6m) 44s ago 6m 35.3M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (7m) 39s ago 7m 7948k - 1.5.0 0da6a335fe13 2baa04300c28 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (6m) 44s ago 6m 7633k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (5m) 39s ago 5m 44.0M 4348M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (4m) 39s ago 4m 44.4M 4348M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:37:03.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (4m) 39s ago 4m 43.3M 4348M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:37:03.765 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (3m) 44s ago 3m 42.7M 5372M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:37:03.765 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (3m) 44s ago 3m 40.8M 5372M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:37:03.765 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (2m) 44s ago 2m 40.1M 5372M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:37:03.765 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (5m) 39s ago 6m 44.9M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:37:03.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7eff280692b0 msgr2=0x7eff2806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7eff280692b0 0x7eff2806b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff30004fd0 tx=0x7eff3000b040 comp rx=0 tx=0).stop 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 msgr2=0x7eff44071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 0x7eff44071e40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff340040d0 tx=0x7eff34009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 shutdown_connections 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7eff280692b0 0x7eff2806b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff440fcee0 0x7eff44071e40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 --2- 172.21.15.157:0/2536131988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff440fe0d0 0x7eff44070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 >> 172.21.15.157:0/2536131988 conn(0x7eff440f8560 msgr2=0x7eff440f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:03.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 shutdown_connections 2024-04-03T08:37:03.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.765+0000 7eff4a400700 1 -- 172.21.15.157:0/2536131988 wait complete. 2024-04-03T08:37:03.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:03 smithi181 ceph-mon[44183]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 -- 172.21.15.157:0/1588280816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 msgr2=0x7f0b94070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 --2- 172.21.15.157:0/1588280816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b94070d00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0b80004880 tx=0x7f0b80009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 -- 172.21.15.157:0/1588280816 shutdown_connections 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 --2- 172.21.15.157:0/1588280816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b94070d00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 --2- 172.21.15.157:0/1588280816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b94071e40 0x7f0b94070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 -- 172.21.15.157:0/1588280816 >> 172.21.15.157:0/1588280816 conn(0x7f0b940f83a0 msgr2=0x7f0b940fa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 -- 172.21.15.157:0/1588280816 shutdown_connections 2024-04-03T08:37:03.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.925+0000 7f0b9a000700 1 -- 172.21.15.157:0/1588280816 wait complete. 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.926+0000 7f0b9a000700 1 Processor -- start 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.926+0000 7f0b9a000700 1 -- start start 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.926+0000 7f0b9a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b9410fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.926+0000 7f0b9a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b94071e40 0x7f0b9410fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.926+0000 7f0b9a000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b941105f0 con 0x7f0b94070890 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.926+0000 7f0b9a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94110e40 con 0x7f0b94071e40 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b9410fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b9410fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34656/0 (socket says 172.21.15.157:34656) 2024-04-03T08:37:03.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 -- 172.21.15.157:0/330319641 learned_addr learned my addr 172.21.15.157:0/330319641 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b92a00700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b94071e40 0x7f0b9410fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 -- 172.21.15.157:0/330319641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b94071e40 msgr2=0x7f0b9410fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b94071e40 0x7f0b9410fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 -- 172.21.15.157:0/330319641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84005040 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.927+0000 7f0b93400700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b9410fab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0b840096b0 tx=0x7f0b84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.928+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b8400e840 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.928+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b8400f040 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.928+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b80005040 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.928+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b84013dc0 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.928+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b94111470 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.929+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9405f5f0 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.930+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f0b8400e9a0 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.931+0000 7f0b8b400700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f0b780692a0 0x7f0b7806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.931+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0b840871b0 con 0x7f0b94070890 2024-04-03T08:37:03.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.931+0000 7f0b92a00700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f0b780692a0 0x7f0b7806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:03.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.932+0000 7f0b92a00700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f0b780692a0 0x7f0b7806b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009fd0 tx=0x7f0b80009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:03.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:03.936+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0b84056e00 con 0x7f0b94070890 2024-04-03T08:37:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:03 smithi157 ceph-mon[35083]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-03T08:37:04.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.271+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0b94111790 con 0x7f0b94070890 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.272+0000 7f0b8b400700 1 -- 172.21.15.157:0/330319641 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f0b84056990 con 0x7f0b94070890 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:37:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 14 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:37:04.273 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:37:04.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f0b780692a0 msgr2=0x7f0b7806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f0b780692a0 0x7f0b7806b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009fd0 tx=0x7f0b80009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 msgr2=0x7f0b9410fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b9410fab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0b840096b0 tx=0x7f0b84009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 shutdown_connections 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b94070890 0x7f0b9410fab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f0b780692a0 0x7f0b7806b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 --2- 172.21.15.157:0/330319641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b94071e40 0x7f0b9410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 >> 172.21.15.157:0/330319641 conn(0x7f0b940f83a0 msgr2=0x7f0b940f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 shutdown_connections 2024-04-03T08:37:04.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.275+0000 7f0b9a000700 1 -- 172.21.15.157:0/330319641 wait complete. 2024-04-03T08:37:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 -- 172.21.15.157:0/2484961271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 msgr2=0x7fc7a00fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 --2- 172.21.15.157:0/2484961271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a00fd310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc790004940 tx=0x7fc790009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:04.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 -- 172.21.15.157:0/2484961271 shutdown_connections 2024-04-03T08:37:04.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 --2- 172.21.15.157:0/2484961271 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 0x7fc7a00fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 --2- 172.21.15.157:0/2484961271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a00fd310 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 -- 172.21.15.157:0/2484961271 >> 172.21.15.157:0/2484961271 conn(0x7fc7a00f8560 msgr2=0x7fc7a00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:04.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 -- 172.21.15.157:0/2484961271 shutdown_connections 2024-04-03T08:37:04.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.415+0000 7fc7a6800700 1 -- 172.21.15.157:0/2484961271 wait complete. 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.416+0000 7fc7a6800700 1 Processor -- start 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.416+0000 7fc7a6800700 1 -- start start 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc7a6800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc7a6800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 0x7fc7a0110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc7a6800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a0110860 con 0x7fc7a00fcee0 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc7a6800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a0110fa0 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a010fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34670/0 (socket says 172.21.15.157:34670) 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79f400700 1 -- 172.21.15.157:0/3327135752 learned_addr learned my addr 172.21.15.157:0/3327135752 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:04.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79ea00700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 0x7fc7a0110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79ea00700 1 -- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 msgr2=0x7fc7a010fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79ea00700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a010fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.417+0000 7fc79ea00700 1 -- 172.21.15.157:0/3327135752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc790005040 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.418+0000 7fc79ea00700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 0x7fc7a0110260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc78c002820 tx=0x7fc78c004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.418+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78c007cc0 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.418+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc78c00f040 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.418+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78c013920 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.418+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a0111280 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.418+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a0111840 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.419+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a0101a60 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.420+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc78c01c400 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.421+0000 7fc797400700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc7840692b0 0x7fc78406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:04.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.421+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc78c086fd0 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.421+0000 7fc79f400700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc7840692b0 0x7fc78406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:04.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.422+0000 7fc79f400700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc7840692b0 0x7fc78406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc790009fd0 tx=0x7fc790009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:04.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.426+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc78c056c20 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.702+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7a005f5f0 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.703+0000 7fc797400700 1 -- 172.21.15.157:0/3327135752 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc78c0567b0 con 0x7fc7a00fe0d0 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:37:04.704 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:37:04.705 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:37:04.705 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:37:04.705 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:37:04.705 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:37:04.705 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:37:04.705 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:37:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:04.707 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:04.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.705+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc7840692b0 msgr2=0x7fc78406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.705+0000 7fc7a6800700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc7840692b0 0x7fc78406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc790009fd0 tx=0x7fc790009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:04.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.705+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 msgr2=0x7fc7a0110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 0x7fc7a0110260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc78c002820 tx=0x7fc78c004570 comp rx=0 tx=0).stop 2024-04-03T08:37:04.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 shutdown_connections 2024-04-03T08:37:04.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7a00fcee0 0x7fc7a010fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc7840692b0 0x7fc78406b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 --2- 172.21.15.157:0/3327135752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a00fe0d0 0x7fc7a0110260 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 >> 172.21.15.157:0/3327135752 conn(0x7fc7a00f8560 msgr2=0x7fc7a00f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:04.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 shutdown_connections 2024-04-03T08:37:04.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.706+0000 7fc7a6800700 1 -- 172.21.15.157:0/3327135752 wait complete. 2024-04-03T08:37:04.709 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:37:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:04 smithi181 ceph-mon[44183]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:04 smithi181 ceph-mon[44183]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:04 smithi181 ceph-mon[44183]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:04 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/330319641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:37:04.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 -- 172.21.15.157:0/2047617273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 msgr2=0x7fdc440fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 --2- 172.21.15.157:0/2047617273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc440fe450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc30004940 tx=0x7fdc30009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 -- 172.21.15.157:0/2047617273 shutdown_connections 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 --2- 172.21.15.157:0/2047617273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc440fe450 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 --2- 172.21.15.157:0/2047617273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc440fce70 0x7fdc440fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 -- 172.21.15.157:0/2047617273 >> 172.21.15.157:0/2047617273 conn(0x7fdc440f8550 msgr2=0x7fdc440fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 -- 172.21.15.157:0/2047617273 shutdown_connections 2024-04-03T08:37:04.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.855+0000 7fdc49a00700 1 -- 172.21.15.157:0/2047617273 wait complete. 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc49a00700 1 Processor -- start 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc49a00700 1 -- start start 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc49a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc440fce70 0x7fdc44071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc49a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc44070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc49a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44072260 con 0x7fdc440fdfe0 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc49a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44070850 con 0x7fdc440fce70 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.856+0000 7fdc42000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc44070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc44070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34684/0 (socket says 172.21.15.157:34684) 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42000700 1 -- 172.21.15.157:0/3754048477 learned_addr learned my addr 172.21.15.157:0/3754048477 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:04.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc440fce70 0x7fdc44071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42000700 1 -- 172.21.15.157:0/3754048477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc440fce70 msgr2=0x7fdc44071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42000700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc440fce70 0x7fdc44071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42000700 1 -- 172.21.15.157:0/3754048477 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30005040 con 0x7fdc440fdfe0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc42000700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc44070310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000b0d0 tx=0x7fdc30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc3000e070 con 0x7fdc440fdfe0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc44070aa0 con 0x7fdc440fdfe0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc3000b410 con 0x7fdc440fdfe0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.857+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc300125e0 con 0x7fdc440fdfe0 2024-04-03T08:37:04.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.858+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc44071060 con 0x7fdc440fdfe0 2024-04-03T08:37:04.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.859+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4404c710 con 0x7fdc440fdfe0 2024-04-03T08:37:04.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.860+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdc3000b580 con 0x7fdc440fdfe0 2024-04-03T08:37:04.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.862+0000 7fdc3aa00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc280692a0 0x7fdc2806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:04.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.862+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdc30087ff0 con 0x7fdc440fdfe0 2024-04-03T08:37:04.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.863+0000 7fdc42a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc280692a0 0x7fdc2806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:04.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.864+0000 7fdc42a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc280692a0 0x7fdc2806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009b80 tx=0x7fdc3400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:04.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:04.867+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdc30057d00 con 0x7fdc440fdfe0 2024-04-03T08:37:05.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:04 smithi157 ceph-mon[35083]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:05.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:04 smithi157 ceph-mon[35083]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:05.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:04 smithi157 ceph-mon[35083]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:05.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:04 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/330319641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:37:05.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.116+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc441022b0 con 0x7fdc280692a0 2024-04-03T08:37:05.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.118+0000 7fdc3aa00700 1 -- 172.21.15.157:0/3754048477 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fdc441022b0 con 0x7fdc280692a0 2024-04-03T08:37:05.118 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:37:05.118 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", 2024-04-03T08:37:05.118 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:37:05.118 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:37:05.118 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:37:05.119 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "", 2024-04-03T08:37:05.119 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 image", 2024-04-03T08:37:05.119 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:37:05.119 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:37:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc280692a0 msgr2=0x7fdc2806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc280692a0 0x7fdc2806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009b80 tx=0x7fdc3400b040 comp rx=0 tx=0).stop 2024-04-03T08:37:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 msgr2=0x7fdc44070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc44070310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000b0d0 tx=0x7fdc30009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 shutdown_connections 2024-04-03T08:37:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fdc280692a0 0x7fdc2806b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc440fce70 0x7fdc44071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 --2- 172.21.15.157:0/3754048477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc440fdfe0 0x7fdc44070310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 >> 172.21.15.157:0/3754048477 conn(0x7fdc440f8550 msgr2=0x7fdc440f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 shutdown_connections 2024-04-03T08:37:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.120+0000 7fdc49a00700 1 -- 172.21.15.157:0/3754048477 wait complete. 2024-04-03T08:37:05.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 -- 172.21.15.157:0/118718546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 msgr2=0x7f4190104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:05.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 --2- 172.21.15.157:0/118718546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190104580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f417c004940 tx=0x7f417c009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:05.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 -- 172.21.15.157:0/118718546 shutdown_connections 2024-04-03T08:37:05.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 --2- 172.21.15.157:0/118718546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190104580 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 --2- 172.21.15.157:0/118718546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4190066280 0x7f4190101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 -- 172.21.15.157:0/118718546 >> 172.21.15.157:0/118718546 conn(0x7f41900f7270 msgr2=0x7f41900f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:05.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.267+0000 7f4195200700 1 -- 172.21.15.157:0/118718546 shutdown_connections 2024-04-03T08:37:05.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.268+0000 7f4195200700 1 -- 172.21.15.157:0/118718546 wait complete. 2024-04-03T08:37:05.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.269+0000 7f4195200700 1 Processor -- start 2024-04-03T08:37:05.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.269+0000 7f4195200700 1 -- start start 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f4195200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4190066280 0x7f4190113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f4195200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f4195200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41901151b0 con 0x7f41901021a0 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f4195200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4190115320 con 0x7f4190066280 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f418ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f418ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34694/0 (socket says 172.21.15.157:34694) 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.270+0000 7f418ea00700 1 -- 172.21.15.157:0/326082765 learned_addr learned my addr 172.21.15.157:0/326082765 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.271+0000 7f418f400700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4190066280 0x7f4190113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.271+0000 7f418ea00700 1 -- 172.21.15.157:0/326082765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4190066280 msgr2=0x7f4190113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.271+0000 7f418ea00700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4190066280 0x7f4190113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.271+0000 7f418ea00700 1 -- 172.21.15.157:0/326082765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c005040 con 0x7f41901021a0 2024-04-03T08:37:05.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.271+0000 7f418ea00700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190114440 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b3b0 tx=0x7f417c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:05.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.272+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417c00e040 con 0x7f41901021a0 2024-04-03T08:37:05.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.272+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f417c004290 con 0x7f41901021a0 2024-04-03T08:37:05.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.272+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417c01c3f0 con 0x7f41901021a0 2024-04-03T08:37:05.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.272+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4190115540 con 0x7f41901021a0 2024-04-03T08:37:05.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.273+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4190115b00 con 0x7f41901021a0 2024-04-03T08:37:05.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.274+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419005f5f0 con 0x7f41901021a0 2024-04-03T08:37:05.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.275+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f417c01c660 con 0x7f41901021a0 2024-04-03T08:37:05.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.276+0000 7f4187400700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f41740692b0 0x7f417406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:05.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.276+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f417c0884a0 con 0x7f41901021a0 2024-04-03T08:37:05.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.276+0000 7f418f400700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f41740692b0 0x7f417406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:05.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.277+0000 7f418f400700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f41740692b0 0x7f417406b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4190113c70 tx=0x7f418000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.282+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f417c0547d0 con 0x7f41901021a0 2024-04-03T08:37:05.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.592+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f419004bed0 con 0x7f41901021a0 2024-04-03T08:37:05.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.592+0000 7f4187400700 1 -- 172.21.15.157:0/326082765 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f417c057df0 con 0x7f41901021a0 2024-04-03T08:37:05.593 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f41740692b0 msgr2=0x7f417406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f41740692b0 0x7f417406b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4190113c70 tx=0x7f418000b040 comp rx=0 tx=0).stop 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 msgr2=0x7f4190114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190114440 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b3b0 tx=0x7f417c009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 shutdown_connections 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f41740692b0 0x7f417406b760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4190066280 0x7f4190113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 --2- 172.21.15.157:0/326082765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41901021a0 0x7f4190114440 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 >> 172.21.15.157:0/326082765 conn(0x7f41900f7270 msgr2=0x7f41900f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 shutdown_connections 2024-04-03T08:37:05.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:05.596+0000 7f4195200700 1 -- 172.21.15.157:0/326082765 wait complete. 2024-04-03T08:37:05.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:05 smithi181 ceph-mon[44183]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-03T08:37:05.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:05 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/3327135752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:37:06.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:05 smithi157 ceph-mon[35083]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-03T08:37:06.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:05 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3327135752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:37:06.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:06 smithi181 ceph-mon[44183]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:06 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/326082765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:37:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:06 smithi157 ceph-mon[35083]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:06 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/326082765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:37:07.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:07 smithi181 ceph-mon[44183]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-03T08:37:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:07 smithi157 ceph-mon[35083]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-03T08:37:09.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:09 smithi181 ceph-mon[44183]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:10.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:09 smithi157 ceph-mon[35083]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:11.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:11 smithi181 ceph-mon[44183]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:11.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:11 smithi157 ceph-mon[35083]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:13 smithi181 ceph-mon[44183]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:13 smithi157 ceph-mon[35083]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:15.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:15 smithi181 ceph-mon[44183]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:15.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:15 smithi157 ceph-mon[35083]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:17.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:17 smithi181 ceph-mon[44183]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:18.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:17 smithi157 ceph-mon[35083]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:20.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:19 smithi157 ceph-mon[35083]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:20.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:19 smithi181 ceph-mon[44183]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:21.974 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:21 smithi157 ceph-mon[35083]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:22.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:21 smithi181 ceph-mon[44183]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:24.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:23 smithi157 ceph-mon[35083]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:24.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:23 smithi181 ceph-mon[44183]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:26.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:25 smithi157 ceph-mon[35083]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:26.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:25 smithi181 ceph-mon[44183]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:28.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:27 smithi157 ceph-mon[35083]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:28.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:27 smithi181 ceph-mon[44183]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:30.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:29 smithi157 ceph-mon[35083]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:30.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:29 smithi181 ceph-mon[44183]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:31.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:31.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:31 smithi157 ceph-mon[35083]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:32.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:31 smithi181 ceph-mon[44183]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:34.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:33 smithi157 ceph-mon[35083]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:34.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:33 smithi181 ceph-mon[44183]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 -- 172.21.15.157:0/2143595422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc066280 msgr2=0x7faebc0ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 --2- 172.21.15.157:0/2143595422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc066280 0x7faebc0ffa20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faeac004940 tx=0x7faeac009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 -- 172.21.15.157:0/2143595422 shutdown_connections 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 --2- 172.21.15.157:0/2143595422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faebc0fff60 0x7faebc102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 --2- 172.21.15.157:0/2143595422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc066280 0x7faebc0ffa20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 -- 172.21.15.157:0/2143595422 >> 172.21.15.157:0/2143595422 conn(0x7faebc0f7430 msgr2=0x7faebc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:35.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 -- 172.21.15.157:0/2143595422 shutdown_connections 2024-04-03T08:37:35.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.795+0000 7faec4000700 1 -- 172.21.15.157:0/2143595422 wait complete. 2024-04-03T08:37:35.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.797+0000 7faec4000700 1 Processor -- start 2024-04-03T08:37:35.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.797+0000 7faec4000700 1 -- start start 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.797+0000 7faec4000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faebc066280 0x7faebc0fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.797+0000 7faec4000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 0x7faebc0fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.797+0000 7faec4000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1116f0 con 0x7faebc0fff60 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.797+0000 7faec4000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc111860 con 0x7faebc066280 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.798+0000 7faec0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 0x7faebc0fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.798+0000 7faec0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 0x7faebc0fb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48488/0 (socket says 172.21.15.157:48488) 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.798+0000 7faec0c00700 1 -- 172.21.15.157:0/4166236379 learned_addr learned my addr 172.21.15.157:0/4166236379 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.798+0000 7faec1600700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faebc066280 0x7faebc0fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.799+0000 7faec0c00700 1 -- 172.21.15.157:0/4166236379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faebc066280 msgr2=0x7faebc0fd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.799+0000 7faec0c00700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faebc066280 0x7faebc0fd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.799+0000 7faec0c00700 1 -- 172.21.15.157:0/4166236379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac005040 con 0x7faebc0fff60 2024-04-03T08:37:35.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.799+0000 7faec0c00700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 0x7faebc0fb920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faeb0002a50 tx=0x7faeb00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:35.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.800+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeb0007cc0 con 0x7faebc0fff60 2024-04-03T08:37:35.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.800+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faeb000f040 con 0x7faebc0fff60 2024-04-03T08:37:35.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.800+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeb000d9c0 con 0x7faebc0fff60 2024-04-03T08:37:35.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.800+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc111b40 con 0x7faebc0fff60 2024-04-03T08:37:35.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.800+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc112100 con 0x7faebc0fff60 2024-04-03T08:37:35.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.803+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc05f5f0 con 0x7faebc0fff60 2024-04-03T08:37:35.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.804+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7faeb0009730 con 0x7faebc0fff60 2024-04-03T08:37:35.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.805+0000 7faeb9600700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7faea4069300 0x7faea406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:35.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.805+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faeb0086f20 con 0x7faebc0fff60 2024-04-03T08:37:35.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.806+0000 7faec1600700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7faea4069300 0x7faea406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:35.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.807+0000 7faec1600700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7faea4069300 0x7faea406b7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faebc0fd1e0 tx=0x7faeac009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:35.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:35.813+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7faeb0053160 con 0x7faebc0fff60 2024-04-03T08:37:36.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.055+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faebc0f8f70 con 0x7faea4069300 2024-04-03T08:37:36.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.056+0000 7faeb9600700 1 -- 172.21.15.157:0/4166236379 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7faebc0f8f70 con 0x7faea4069300 2024-04-03T08:37:36.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.059+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7faea4069300 msgr2=0x7faea406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.059+0000 7faec4000700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7faea4069300 0x7faea406b7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faebc0fd1e0 tx=0x7faeac009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:36.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.059+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 msgr2=0x7faebc0fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.059+0000 7faec4000700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 0x7faebc0fb920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faeb0002a50 tx=0x7faeb00046b0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 shutdown_connections 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7faea4069300 0x7faea406b7b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faebc066280 0x7faebc0fd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 --2- 172.21.15.157:0/4166236379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fff60 0x7faebc0fb920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 >> 172.21.15.157:0/4166236379 conn(0x7faebc0f7430 msgr2=0x7faebc0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 shutdown_connections 2024-04-03T08:37:36.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.060+0000 7faec4000700 1 -- 172.21.15.157:0/4166236379 wait complete. 2024-04-03T08:37:36.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:35 smithi157 ceph-mon[35083]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:36.078 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:37:36.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:35 smithi181 ceph-mon[44183]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:36.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.243+0000 7f409ae00700 1 -- 172.21.15.157:0/2349709632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fcee0 msgr2=0x7f40940fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.243+0000 7f409ae00700 1 --2- 172.21.15.157:0/2349709632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fcee0 0x7f40940fd310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40840048b0 tx=0x7f4084009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:36.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.243+0000 7f409ae00700 1 -- 172.21.15.157:0/2349709632 shutdown_connections 2024-04-03T08:37:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.243+0000 7f409ae00700 1 --2- 172.21.15.157:0/2349709632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40940fe0d0 0x7f40940fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.243+0000 7f409ae00700 1 --2- 172.21.15.157:0/2349709632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fcee0 0x7f40940fd310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.243+0000 7f409ae00700 1 -- 172.21.15.157:0/2349709632 >> 172.21.15.157:0/2349709632 conn(0x7f40940f8560 msgr2=0x7f40940fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.244+0000 7f409ae00700 1 -- 172.21.15.157:0/2349709632 shutdown_connections 2024-04-03T08:37:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.244+0000 7f409ae00700 1 -- 172.21.15.157:0/2349709632 wait complete. 2024-04-03T08:37:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.244+0000 7f409ae00700 1 Processor -- start 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f409ae00700 1 -- start start 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f409ae00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40940fcee0 0x7f409406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f409ae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 0x7f409406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f409ae00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409406ff20 con 0x7f40940fcee0 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f409ae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4094070060 con 0x7f40940fe0d0 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f4093400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 0x7f409406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f4093400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 0x7f409406e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:53910/0 (socket says 172.21.15.157:53910) 2024-04-03T08:37:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.245+0000 7f4093400700 1 -- 172.21.15.157:0/1137547158 learned_addr learned my addr 172.21.15.157:0/1137547158 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.246+0000 7f4093400700 1 -- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40940fcee0 msgr2=0x7f409406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.246+0000 7f4093400700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40940fcee0 0x7f409406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.246+0000 7f4093400700 1 -- 172.21.15.157:0/1137547158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080005040 con 0x7f40940fe0d0 2024-04-03T08:37:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.246+0000 7f4093400700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 0x7f409406e820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f40800096b0 tx=0x7f4080009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.246+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4080017070 con 0x7f40940fe0d0 2024-04-03T08:37:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.246+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4084005040 con 0x7f40940fe0d0 2024-04-03T08:37:36.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.247+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f408000f040 con 0x7f40940fe0d0 2024-04-03T08:37:36.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.247+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4080013c20 con 0x7f40940fe0d0 2024-04-03T08:37:36.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.247+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409411be00 con 0x7f40940fe0d0 2024-04-03T08:37:36.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.248+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409405f5f0 con 0x7f40940fe0d0 2024-04-03T08:37:36.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.251+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4080013400 con 0x7f40940fe0d0 2024-04-03T08:37:36.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.252+0000 7f408be00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f40780692b0 0x7f407806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:36.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.252+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4080086f30 con 0x7f40940fe0d0 2024-04-03T08:37:36.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.252+0000 7f4093e00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f40780692b0 0x7f407806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:36.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.253+0000 7f4093e00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f40780692b0 0x7f407806b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4084013870 tx=0x7f4084009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:36.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.260+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4080053210 con 0x7f40940fe0d0 2024-04-03T08:37:36.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.557+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40941023b0 con 0x7f40780692b0 2024-04-03T08:37:36.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.558+0000 7f408be00700 1 -- 172.21.15.157:0/1137547158 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f40941023b0 con 0x7f40780692b0 2024-04-03T08:37:36.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f40780692b0 msgr2=0x7f407806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f40780692b0 0x7f407806b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4084013870 tx=0x7f4084009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:36.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 msgr2=0x7f409406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 0x7f409406e820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f40800096b0 tx=0x7f4080009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:36.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 shutdown_connections 2024-04-03T08:37:36.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40940fcee0 0x7f409406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f40780692b0 0x7f407806b760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 --2- 172.21.15.157:0/1137547158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40940fe0d0 0x7f409406e820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.562+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 >> 172.21.15.157:0/1137547158 conn(0x7f40940f8560 msgr2=0x7f40940f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:36.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.563+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 shutdown_connections 2024-04-03T08:37:36.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.563+0000 7f409ae00700 1 -- 172.21.15.157:0/1137547158 wait complete. 2024-04-03T08:37:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.773+0000 7f32b7e00700 1 -- 172.21.15.157:0/1239688988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 msgr2=0x7f32b80fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.773+0000 7f32b7e00700 1 --2- 172.21.15.157:0/1239688988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b80fd230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32a4004940 tx=0x7f32a4009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.774+0000 7f32b7e00700 1 -- 172.21.15.157:0/1239688988 shutdown_connections 2024-04-03T08:37:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.774+0000 7f32b7e00700 1 --2- 172.21.15.157:0/1239688988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b80fd230 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.774+0000 7f32b7e00700 1 --2- 172.21.15.157:0/1239688988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 0x7f32b80fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.774+0000 7f32b7e00700 1 -- 172.21.15.157:0/1239688988 >> 172.21.15.157:0/1239688988 conn(0x7f32b80f7270 msgr2=0x7f32b80f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.774+0000 7f32b7e00700 1 -- 172.21.15.157:0/1239688988 shutdown_connections 2024-04-03T08:37:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.774+0000 7f32b7e00700 1 -- 172.21.15.157:0/1239688988 wait complete. 2024-04-03T08:37:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.775+0000 7f32b7e00700 1 Processor -- start 2024-04-03T08:37:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.776+0000 7f32b7e00700 1 -- start start 2024-04-03T08:37:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.776+0000 7f32b7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 0x7f32b8113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.776+0000 7f32b7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b8114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.776+0000 7f32b7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8115120 con 0x7f32b80fbb10 2024-04-03T08:37:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.776+0000 7f32b7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8115290 con 0x7f32b80fcdc0 2024-04-03T08:37:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.777+0000 7f32b6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b8114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.777+0000 7f32b6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b8114400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:53922/0 (socket says 172.21.15.157:53922) 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.777+0000 7f32b6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 0x7f32b8113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.777+0000 7f32b6000700 1 -- 172.21.15.157:0/408976196 learned_addr learned my addr 172.21.15.157:0/408976196 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.777+0000 7f32b6000700 1 -- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 msgr2=0x7f32b8113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.778+0000 7f32b6000700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 0x7f32b8113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.778+0000 7f32b6000700 1 -- 172.21.15.157:0/408976196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4005040 con 0x7f32b80fcdc0 2024-04-03T08:37:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.778+0000 7f32b6a00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 0x7f32b8113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:37:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.778+0000 7f32b6000700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b8114400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f32a4013870 tx=0x7f32a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.779+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a400e070 con 0x7f32b80fcdc0 2024-04-03T08:37:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.779+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32a4013de0 con 0x7f32b80fcdc0 2024-04-03T08:37:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.779+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a401ce70 con 0x7f32b80fcdc0 2024-04-03T08:37:36.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.779+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b81154b0 con 0x7f32b80fcdc0 2024-04-03T08:37:36.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.780+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b8115990 con 0x7f32b80fcdc0 2024-04-03T08:37:36.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.782+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8101750 con 0x7f32b80fcdc0 2024-04-03T08:37:36.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.783+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f32a4013910 con 0x7f32b80fcdc0 2024-04-03T08:37:36.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.784+0000 7f32aea00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f329c0692b0 0x7f329c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:36.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.784+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f32a4088930 con 0x7f32b80fcdc0 2024-04-03T08:37:36.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.785+0000 7f32b6a00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f329c0692b0 0x7f329c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:36.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.786+0000 7f32b6a00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f329c0692b0 0x7f329c06b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32b8113c30 tx=0x7f32a800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:36.793+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f32a4054b70 con 0x7f32b80fcdc0 2024-04-03T08:37:37.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.092+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b8104710 con 0x7f329c0692b0 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.109+0000 7f32aea00700 1 -- 172.21.15.157:0/408976196 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f32b8104710 con 0x7f329c0692b0 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (6m) 72s ago 7m 12.9M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (8m) 72s ago 8m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (6m) 78s ago 6m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (6m) 72s ago 7m 72.2M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (101s) 72s ago 100s 10.5M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (93s) 72s ago 92s 12.7M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:37:37.111 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (97s) 78s ago 97s 10.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (90s) 78s ago 89s 11.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (9m) 72s ago 9m 481M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (6m) 78s ago 6m 431M - 17.2.7-805-g6fda41ff a49113eacc58 ef09dfea7a47 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (9m) 72s ago 9m 44.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (6m) 78s ago 6m 35.3M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (7m) 72s ago 7m 7948k - 1.5.0 0da6a335fe13 2baa04300c28 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (6m) 78s ago 6m 7633k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (5m) 72s ago 5m 44.0M 4348M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (5m) 72s ago 5m 44.4M 4348M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (4m) 72s ago 4m 43.3M 4348M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (4m) 78s ago 4m 42.7M 5372M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (3m) 78s ago 3m 40.8M 5372M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:37:37.112 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (3m) 78s ago 3m 40.1M 5372M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:37:37.113 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (5m) 72s ago 7m 44.9M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.112+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f329c0692b0 msgr2=0x7f329c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.112+0000 7f32b7e00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f329c0692b0 0x7f329c06b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32b8113c30 tx=0x7f32a800b040 comp rx=0 tx=0).stop 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.112+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 msgr2=0x7f32b8114400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.112+0000 7f32b7e00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b8114400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f32a4013870 tx=0x7f32a4009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 shutdown_connections 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32b80fbb10 0x7f32b8113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f329c0692b0 0x7f329c06b760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 --2- 172.21.15.157:0/408976196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b80fcdc0 0x7f32b8114400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 >> 172.21.15.157:0/408976196 conn(0x7f32b80f7270 msgr2=0x7f32b8065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:37.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 shutdown_connections 2024-04-03T08:37:37.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.113+0000 7f32b7e00700 1 -- 172.21.15.157:0/408976196 wait complete. 2024-04-03T08:37:37.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.311+0000 7f6f90400700 1 -- 172.21.15.157:0/3550948784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 msgr2=0x7f6f880fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.311+0000 7f6f90400700 1 --2- 172.21.15.157:0/3550948784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f880fd310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f78004970 tx=0x7f6f78009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.312+0000 7f6f90400700 1 -- 172.21.15.157:0/3550948784 shutdown_connections 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.312+0000 7f6f90400700 1 --2- 172.21.15.157:0/3550948784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 0x7f6f880fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.312+0000 7f6f90400700 1 --2- 172.21.15.157:0/3550948784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f880fd310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.312+0000 7f6f90400700 1 -- 172.21.15.157:0/3550948784 >> 172.21.15.157:0/3550948784 conn(0x7f6f880f8560 msgr2=0x7f6f880fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.312+0000 7f6f90400700 1 -- 172.21.15.157:0/3550948784 shutdown_connections 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.312+0000 7f6f90400700 1 -- 172.21.15.157:0/3550948784 wait complete. 2024-04-03T08:37:37.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.313+0000 7f6f90400700 1 Processor -- start 2024-04-03T08:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.314+0000 7f6f90400700 1 -- start start 2024-04-03T08:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.314+0000 7f6f90400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f88071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.314+0000 7f6f90400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 0x7f6f88070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.314+0000 7f6f90400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880708a0 con 0x7f6f880fe0d0 2024-04-03T08:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.314+0000 7f6f90400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880709e0 con 0x7f6f880fcee0 2024-04-03T08:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f88071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f88071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:53940/0 (socket says 172.21.15.157:53940) 2024-04-03T08:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8da00700 1 -- 172.21.15.157:0/1595890014 learned_addr learned my addr 172.21.15.157:0/1595890014 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8d000700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 0x7f6f88070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8d000700 1 -- 172.21.15.157:0/1595890014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 msgr2=0x7f6f88071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8d000700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f88071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.315+0000 7f6f8d000700 1 -- 172.21.15.157:0/1595890014 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78005040 con 0x7f6f880fe0d0 2024-04-03T08:37:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.316+0000 7f6f8d000700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 0x7f6f88070310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009fd0 tx=0x7f6f7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:37.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.316+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c004e90 con 0x7f6f880fe0d0 2024-04-03T08:37:37.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.316+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f88070c60 con 0x7f6f880fe0d0 2024-04-03T08:37:37.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.316+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f88115a30 con 0x7f6f880fe0d0 2024-04-03T08:37:37.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.316+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f7c00f040 con 0x7f6f880fe0d0 2024-04-03T08:37:37.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.316+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c00ca50 con 0x7f6f880fe0d0 2024-04-03T08:37:37.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.318+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0052e0 con 0x7f6f880fe0d0 2024-04-03T08:37:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.318+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6f7c007cc0 con 0x7f6f880fe0d0 2024-04-03T08:37:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.319+0000 7f6f85600700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f6f700692b0 0x7f6f7006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:37.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.319+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6f7c059b90 con 0x7f6f880fe0d0 2024-04-03T08:37:37.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.319+0000 7f6f8da00700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f6f700692b0 0x7f6f7006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:37.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.320+0000 7f6f8da00700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f6f700692b0 0x7f6f7006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f78000c00 tx=0x7f6f78009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:37.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.324+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6f7c053410 con 0x7f6f880fe0d0 2024-04-03T08:37:37.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.750+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f6c005860 con 0x7f6f880fe0d0 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.750+0000 7f6f85600700 1 -- 172.21.15.157:0/1595890014 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f6f7c019020 con 0x7f6f880fe0d0 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:37.752 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 14 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:37:37.753 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:37:37.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f6f700692b0 msgr2=0x7f6f7006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f6f700692b0 0x7f6f7006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f78000c00 tx=0x7f6f78009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:37.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 msgr2=0x7f6f88070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 0x7f6f88070310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009fd0 tx=0x7f6f7c00b040 comp rx=0 tx=0).stop 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 shutdown_connections 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f6f700692b0 0x7f6f7006b760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f880fcee0 0x7f6f88071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 --2- 172.21.15.157:0/1595890014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f880fe0d0 0x7f6f88070310 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 >> 172.21.15.157:0/1595890014 conn(0x7f6f880f8560 msgr2=0x7f6f880f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 shutdown_connections 2024-04-03T08:37:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.753+0000 7f6f90400700 1 -- 172.21.15.157:0/1595890014 wait complete. 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 -- 172.21.15.157:0/574736715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 msgr2=0x7f76cc0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 --2- 172.21.15.157:0/574736715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 0x7f76cc0fe540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76b8004940 tx=0x7f76b8009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 -- 172.21.15.157:0/574736715 shutdown_connections 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 --2- 172.21.15.157:0/574736715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 0x7f76cc0fe540 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 --2- 172.21.15.157:0/574736715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 -- 172.21.15.157:0/574736715 >> 172.21.15.157:0/574736715 conn(0x7f76cc0f8560 msgr2=0x7f76cc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 -- 172.21.15.157:0/574736715 shutdown_connections 2024-04-03T08:37:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.941+0000 7f76d1c00700 1 -- 172.21.15.157:0/574736715 wait complete. 2024-04-03T08:37:37.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.942+0000 7f76d1c00700 1 Processor -- start 2024-04-03T08:37:37.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.943+0000 7f76d1c00700 1 -- start start 2024-04-03T08:37:37.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.943+0000 7f76d1c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:37.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.943+0000 7f76d1c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 0x7f76cc10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:37.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.943+0000 7f76d1c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc10e550 con 0x7f76cc0fe0d0 2024-04-03T08:37:37.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.943+0000 7f76d1c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc10ed50 con 0x7f76cc0fcee0 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76ca000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 0x7f76cc10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76caa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76caa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:53954/0 (socket says 172.21.15.157:53954) 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76caa00700 1 -- 172.21.15.157:0/437398070 learned_addr learned my addr 172.21.15.157:0/437398070 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76caa00700 1 -- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 msgr2=0x7f76cc10df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76caa00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 0x7f76cc10df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.944+0000 7f76caa00700 1 -- 172.21.15.157:0/437398070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8005040 con 0x7f76cc0fcee0 2024-04-03T08:37:37.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.945+0000 7f76caa00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc10da10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00eb70 tx=0x7f76bc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:37.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.945+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76bc007cc0 con 0x7f76cc0fcee0 2024-04-03T08:37:37.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.945+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76bc00f040 con 0x7f76cc0fcee0 2024-04-03T08:37:37.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.945+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc10efd0 con 0x7f76cc0fcee0 2024-04-03T08:37:37.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.945+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc10f510 con 0x7f76cc0fcee0 2024-04-03T08:37:37.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.945+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76bc00cb50 con 0x7f76cc0fcee0 2024-04-03T08:37:37.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.946+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac0052e0 con 0x7f76cc0fcee0 2024-04-03T08:37:37.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.948+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f76bc009830 con 0x7f76cc0fcee0 2024-04-03T08:37:37.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.949+0000 7f76c2a00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f76b00692b0 0x7f76b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:37.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.949+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f76bc086f60 con 0x7f76cc0fcee0 2024-04-03T08:37:37.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.950+0000 7f76ca000700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f76b00692b0 0x7f76b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:37.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.950+0000 7f76ca000700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f76b00692b0 0x7f76b006b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009fd0 tx=0x7f76b8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:37.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:37.952+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f76bc056d60 con 0x7f76cc0fcee0 2024-04-03T08:37:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:37 smithi157 ceph-mon[35083]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:37 smithi157 ceph-mon[35083]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:38.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:37 smithi157 ceph-mon[35083]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:37 smithi181 ceph-mon[44183]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:37 smithi181 ceph-mon[44183]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:37 smithi181 ceph-mon[44183]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.321+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76ac005860 con 0x7f76cc0fcee0 2024-04-03T08:37:38.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.322+0000 7f76c2a00700 1 -- 172.21.15.157:0/437398070 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f76bc019750 con 0x7f76cc0fcee0 2024-04-03T08:37:38.323 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:37:38.323 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:37:38.323 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:37:38.324 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:37:38.325 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:37:38.326 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:37:38.327 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:38.327 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f76b00692b0 msgr2=0x7f76b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f76b00692b0 0x7f76b006b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009fd0 tx=0x7f76b8009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 msgr2=0x7f76cc10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc10da10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00eb70 tx=0x7f76bc00b040 comp rx=0 tx=0).stop 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 shutdown_connections 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f76b00692b0 0x7f76b006b760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76cc0fcee0 0x7f76cc10da10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 --2- 172.21.15.157:0/437398070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc0fe0d0 0x7f76cc10df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.324+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 >> 172.21.15.157:0/437398070 conn(0x7f76cc0f8560 msgr2=0x7f76cc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.325+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 shutdown_connections 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.325+0000 7f76d1c00700 1 -- 172.21.15.157:0/437398070 wait complete. 2024-04-03T08:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:37:38.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 -- 172.21.15.157:0/2124282664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd590071f50 msgr2=0x7fd590070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 --2- 172.21.15.157:0/2124282664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd590071f50 0x7fd590070460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd584004940 tx=0x7fd584009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 -- 172.21.15.157:0/2124282664 shutdown_connections 2024-04-03T08:37:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 --2- 172.21.15.157:0/2124282664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5900709a0 0x7fd590070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 --2- 172.21.15.157:0/2124282664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd590071f50 0x7fd590070460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 -- 172.21.15.157:0/2124282664 >> 172.21.15.157:0/2124282664 conn(0x7fd5900f8560 msgr2=0x7fd5900fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 -- 172.21.15.157:0/2124282664 shutdown_connections 2024-04-03T08:37:38.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.504+0000 7fd597a00700 1 -- 172.21.15.157:0/2124282664 wait complete. 2024-04-03T08:37:38.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.506+0000 7fd597a00700 1 Processor -- start 2024-04-03T08:37:38.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.507+0000 7fd597a00700 1 -- start start 2024-04-03T08:37:38.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.507+0000 7fd597a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 0x7fd59006e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:38.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.507+0000 7fd597a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 0x7fd59006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:38.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.507+0000 7fd597a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59006ff40 con 0x7fd590071f50 2024-04-03T08:37:38.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.507+0000 7fd597a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590070080 con 0x7fd5900709a0 2024-04-03T08:37:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.508+0000 7fd58fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 0x7fd59006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.508+0000 7fd58fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 0x7fd59006e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48578/0 (socket says 172.21.15.157:48578) 2024-04-03T08:37:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.508+0000 7fd595000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 0x7fd59006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:38.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.508+0000 7fd595000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 0x7fd59006e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:53970/0 (socket says 172.21.15.157:53970) 2024-04-03T08:37:38.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.508+0000 7fd595000700 1 -- 172.21.15.157:0/2596286878 learned_addr learned my addr 172.21.15.157:0/2596286878 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:38.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.509+0000 7fd595000700 1 -- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 msgr2=0x7fd59006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:38.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.509+0000 7fd595000700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 0x7fd59006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.510+0000 7fd595000700 1 -- 172.21.15.157:0/2596286878 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c005040 con 0x7fd5900709a0 2024-04-03T08:37:38.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.510+0000 7fd58fe00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 0x7fd59006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:37:38.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.510+0000 7fd595000700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 0x7fd59006e350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd584004090 tx=0x7fd584009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:38.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.511+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd58400e030 con 0x7fd5900709a0 2024-04-03T08:37:38.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.511+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd58401c400 con 0x7fd5900709a0 2024-04-03T08:37:38.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.511+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd58400b610 con 0x7fd5900709a0 2024-04-03T08:37:38.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.511+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd584005040 con 0x7fd5900709a0 2024-04-03T08:37:38.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.511+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59011dff0 con 0x7fd5900709a0 2024-04-03T08:37:38.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.514+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59005f5f0 con 0x7fd5900709a0 2024-04-03T08:37:38.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.515+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd58401ca50 con 0x7fd5900709a0 2024-04-03T08:37:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.516+0000 7fd58cc00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd578069360 0x7fd57806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.516+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd58401b360 con 0x7fd5900709a0 2024-04-03T08:37:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.517+0000 7fd58fe00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd578069360 0x7fd57806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:38.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.520+0000 7fd58fe00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd578069360 0x7fd57806b810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009fd0 tx=0x7fd57c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:38.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.521+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd584055600 con 0x7fd5900709a0 2024-04-03T08:37:38.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.884+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd590103e00 con 0x7fd578069360 2024-04-03T08:37:38.892 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:37:38.892 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", 2024-04-03T08:37:38.892 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:37:38.892 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:37:38.892 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:37:38.892 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "", 2024-04-03T08:37:38.893 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 image", 2024-04-03T08:37:38.893 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:37:38.893 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:37:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.887+0000 7fd58cc00700 1 -- 172.21.15.157:0/2596286878 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd590103e00 con 0x7fd578069360 2024-04-03T08:37:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.890+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd578069360 msgr2=0x7fd57806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.890+0000 7fd597a00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd578069360 0x7fd57806b810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009fd0 tx=0x7fd57c00b040 comp rx=0 tx=0).stop 2024-04-03T08:37:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.890+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 msgr2=0x7fd59006e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.890+0000 7fd597a00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 0x7fd59006e350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd584004090 tx=0x7fd584009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 shutdown_connections 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fd578069360 0x7fd57806b810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5900709a0 0x7fd59006e350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 --2- 172.21.15.157:0/2596286878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590071f50 0x7fd59006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 >> 172.21.15.157:0/2596286878 conn(0x7fd5900f8560 msgr2=0x7fd5900f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 shutdown_connections 2024-04-03T08:37:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:38.891+0000 7fd597a00700 1 -- 172.21.15.157:0/2596286878 wait complete. 2024-04-03T08:37:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:38 smithi157 ceph-mon[35083]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1595890014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:37:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/437398070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:37:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:38 smithi181 ceph-mon[44183]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:39.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:38 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1595890014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:37:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:38 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/437398070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:37:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.111+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2101861442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc071e40 msgr2=0x7ff5cc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.111+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2101861442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc071e40 0x7ff5cc070350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0004970 tx=0x7ff5c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.112+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2101861442 shutdown_connections 2024-04-03T08:37:39.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.112+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2101861442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5cc070890 0x7ff5cc070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:39.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.112+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2101861442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc071e40 0x7ff5cc070350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:39.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.112+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2101861442 >> 172.21.15.157:0/2101861442 conn(0x7ff5cc0f83a0 msgr2=0x7ff5cc0fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:39.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.112+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2101861442 shutdown_connections 2024-04-03T08:37:39.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.112+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2101861442 wait complete. 2024-04-03T08:37:39.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.113+0000 7ff5d2a00700 1 Processor -- start 2024-04-03T08:37:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.113+0000 7ff5d2a00700 1 -- start start 2024-04-03T08:37:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.113+0000 7ff5d2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 0x7ff5cc10fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.113+0000 7ff5d2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5cc071e40 0x7ff5cc10ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.113+0000 7ff5d2a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc110540 con 0x7ff5cc071e40 2024-04-03T08:37:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.113+0000 7ff5d2a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc110d90 con 0x7ff5cc070890 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d1600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 0x7ff5cc10fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5cc071e40 0x7ff5cc10ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d1600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 0x7ff5cc10fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:53982/0 (socket says 172.21.15.157:53982) 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d1600700 1 -- 172.21.15.157:0/2747053855 learned_addr learned my addr 172.21.15.157:0/2747053855 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d1600700 1 -- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5cc071e40 msgr2=0x7ff5cc10ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d1600700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5cc071e40 0x7ff5cc10ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.114+0000 7ff5d1600700 1 -- 172.21.15.157:0/2747053855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8005040 con 0x7ff5cc070890 2024-04-03T08:37:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.115+0000 7ff5d1600700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 0x7ff5cc10fa00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009360 tx=0x7ff5c0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.115+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c000e040 con 0x7ff5cc070890 2024-04-03T08:37:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.115+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5c000b580 con 0x7ff5cc070890 2024-04-03T08:37:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.115+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c001c630 con 0x7ff5cc070890 2024-04-03T08:37:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.115+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0005040 con 0x7ff5cc070890 2024-04-03T08:37:39.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.116+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc111370 con 0x7ff5cc070890 2024-04-03T08:37:39.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.117+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc05f5f0 con 0x7ff5cc070890 2024-04-03T08:37:39.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.118+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff5c001c820 con 0x7ff5cc070890 2024-04-03T08:37:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.119+0000 7ff5c9600700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff5b40692a0 0x7ff5b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:37:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.119+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff5c00881f0 con 0x7ff5cc070890 2024-04-03T08:37:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.119+0000 7ff5d0c00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff5b40692a0 0x7ff5b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:37:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.120+0000 7ff5d0c00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff5b40692a0 0x7ff5b406b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009fd0 tx=0x7ff5b800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:37:39.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.126+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff5c0057ec0 con 0x7ff5cc070890 2024-04-03T08:37:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.548+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff5cc04bed0 con 0x7ff5cc070890 2024-04-03T08:37:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.549+0000 7ff5c9600700 1 -- 172.21.15.157:0/2747053855 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff5c0057a50 con 0x7ff5cc070890 2024-04-03T08:37:39.551 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:37:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.552+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff5b40692a0 msgr2=0x7ff5b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.552+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff5b40692a0 0x7ff5b406b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009fd0 tx=0x7ff5b800b040 comp rx=0 tx=0).stop 2024-04-03T08:37:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.552+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 msgr2=0x7ff5cc10fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:37:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.552+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 0x7ff5cc10fa00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009360 tx=0x7ff5c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:37:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 shutdown_connections 2024-04-03T08:37:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff5b40692a0 0x7ff5b406b750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:39.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5cc070890 0x7ff5cc10fa00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:39.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 --2- 172.21.15.157:0/2747053855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5cc071e40 0x7ff5cc10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:37:39.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 >> 172.21.15.157:0/2747053855 conn(0x7ff5cc0f83a0 msgr2=0x7ff5cc0f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:37:39.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 shutdown_connections 2024-04-03T08:37:39.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:37:39.553+0000 7ff5d2a00700 1 -- 172.21.15.157:0/2747053855 wait complete. 2024-04-03T08:37:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:39 smithi157 ceph-mon[35083]: pgmap v249: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:40.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:39 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2747053855' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:37:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:39 smithi181 ceph-mon[44183]: pgmap v249: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:39 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2747053855' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:37:41.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:40 smithi157 ceph-mon[35083]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:41.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:40 smithi181 ceph-mon[44183]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:37:41.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:41 smithi157 ceph-mon[35083]: pgmap v250: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:42.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:41 smithi181 ceph-mon[44183]: pgmap v250: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:43.370 INFO:tasks.workunit.client.1.smithi181.stderr:Updating files: 78% (8919/11369) Updating files: 79% (8982/11369) Updating files: 80% (9096/11369) Updating files: 81% (9209/11369) Updating files: 82% (9323/11369) Updating files: 83% (9437/11369) Updating files: 84% (9550/11369) Updating files: 85% (9664/11369) Updating files: 86% (9778/11369) Updating files: 87% (9892/11369) Updating files: 88% (10005/11369) Updating files: 89% (10119/11369) Updating files: 90% (10233/11369) Updating files: 91% (10346/11369) Updating files: 92% (10460/11369) Updating files: 93% (10574/11369) Updating files: 94% (10687/11369) Updating files: 95% (10801/11369) Updating files: 96% (10915/11369) Updating files: 97% (11028/11369) Updating files: 98% (11142/11369) Updating files: 99% (11256/11369) Updating files: 100% (11369/11369) Updating files: 100% (11369/11369), done. 2024-04-03T08:37:44.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:43 smithi157 ceph-mon[35083]: pgmap v251: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:44.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:43 smithi181 ceph-mon[44183]: pgmap v251: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr:Note: switching to '2be5a1775aca69fcf233a1e71f017149db5077bf'. 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.670 INFO:tasks.workunit.client.1.smithi181.stderr: git switch -c 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr:Or undo this operation with: 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr: git switch - 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr: 2024-04-03T08:37:44.671 INFO:tasks.workunit.client.1.smithi181.stderr:HEAD is now at 2be5a1775ac qa: run fs:upgrade:mds_upgrade_sequence with centos8.stream 2024-04-03T08:37:44.681 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-03T08:37:44.732 INFO:tasks.workunit.client.1.smithi181.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T08:37:44.737 INFO:tasks.workunit.client.1.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-03T08:37:44.737 INFO:tasks.workunit.client.1.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T08:37:45.366 INFO:tasks.workunit.client.1.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T08:37:45.477 INFO:tasks.workunit.client.1.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T08:37:45.541 INFO:tasks.workunit.client.1.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-03T08:37:45.545 INFO:tasks.workunit.client.1.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-03T08:37:45.545 INFO:tasks.workunit.client.1.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T08:37:45.608 INFO:tasks.workunit.client.1.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-03T08:37:45.616 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-03T08:37:45.616 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-03T08:37:45.660 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-03T08:37:45.663 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-03T08:37:45.663 DEBUG:teuthology.orchestra.run.smithi181:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2be5a1775aca69fcf233a1e71f017149db5077bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-03T08:37:45.767 INFO:tasks.workunit.client.1.smithi181.stderr:+ mkdir -p fsstress 2024-04-03T08:37:45.772 INFO:tasks.workunit.client.1.smithi181.stderr:+ pushd fsstress 2024-04-03T08:37:45.774 INFO:tasks.workunit.client.1.smithi181.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-03T08:37:45.774 INFO:tasks.workunit.client.1.smithi181.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-03T08:37:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:45 smithi157 ceph-mon[35083]: pgmap v252: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:46.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:46.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:45 smithi181 ceph-mon[44183]: pgmap v252: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:37:46.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:37:46.528 INFO:tasks.workunit.client.0.smithi157.stderr:Updating files: 68% (7758/11369) Updating files: 69% (7845/11369) Updating files: 70% (7959/11369) Updating files: 71% (8072/11369) Updating files: 72% (8186/11369) Updating files: 73% (8300/11369) Updating files: 74% (8414/11369) Updating files: 75% (8527/11369) Updating files: 76% (8641/11369) Updating files: 77% (8755/11369) Updating files: 78% (8868/11369) Updating files: 79% (8982/11369) Updating files: 80% (9096/11369) Updating files: 81% (9209/11369) Updating files: 82% (9323/11369) Updating files: 83% (9437/11369) Updating files: 84% (9550/11369) Updating files: 85% (9664/11369) Updating files: 86% (9778/11369) Updating files: 87% (9892/11369) Updating files: 88% (10005/11369) Updating files: 89% (10119/11369) Updating files: 90% (10233/11369) Updating files: 91% (10346/11369) Updating files: 92% (10460/11369) Updating files: 93% (10574/11369) Updating files: 94% (10687/11369) Updating files: 95% (10801/11369) Updating files: 96% (10915/11369) Updating files: 97% (11028/11369) Updating files: 98% (11142/11369) Updating files: 99% (11256/11369) Updating files: 100% (11369/11369) Updating files: 100% (11369/11369), done. 2024-04-03T08:37:46.782 INFO:tasks.workunit.client.1.smithi181.stderr:+ tar xzf ltp-full.tgz 2024-04-03T08:37:48.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:47 smithi157 ceph-mon[35083]: pgmap v253: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:48.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:47 smithi181 ceph-mon[44183]: pgmap v253: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:37:48.176 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to '2be5a1775aca69fcf233a1e71f017149db5077bf'. 2024-04-03T08:37:48.176 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T08:37:48.178 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-03T08:37:48.178 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at 2be5a1775ac qa: run fs:upgrade:mds_upgrade_sequence with centos8.stream 2024-04-03T08:37:48.190 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-03T08:37:48.250 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T08:37:48.257 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T08:37:48.257 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T08:37:48.931 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T08:37:49.284 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T08:37:49.358 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T08:37:49.363 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T08:37:49.363 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T08:37:49.441 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T08:37:49.451 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-03T08:37:49.451 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-03T08:37:49.508 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-03T08:37:49.509 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-03T08:37:49.510 DEBUG:teuthology.orchestra.run.smithi157:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2be5a1775aca69fcf233a1e71f017149db5077bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-03T08:37:49.596 INFO:tasks.workunit.client.0.smithi157.stderr:+ mkdir -p fsstress 2024-04-03T08:37:49.601 INFO:tasks.workunit.client.0.smithi157.stderr:+ pushd fsstress 2024-04-03T08:37:49.604 INFO:tasks.workunit.client.0.smithi157.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-03T08:37:49.605 INFO:tasks.workunit.client.0.smithi157.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-03T08:37:50.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:49 smithi157 ceph-mon[35083]: pgmap v254: 65 pgs: 65 active+clean; 7.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 548 KiB/s wr, 5 op/s 2024-04-03T08:37:50.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:49 smithi181 ceph-mon[44183]: pgmap v254: 65 pgs: 65 active+clean; 7.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 548 KiB/s wr, 5 op/s 2024-04-03T08:37:51.026 INFO:tasks.workunit.client.0.smithi157.stderr:+ tar xzf ltp-full.tgz 2024-04-03T08:37:51.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:51 smithi157 ceph-mon[35083]: pgmap v255: 65 pgs: 65 active+clean; 8.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 720 KiB/s wr, 23 op/s 2024-04-03T08:37:52.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:51 smithi181 ceph-mon[44183]: pgmap v255: 65 pgs: 65 active+clean; 8.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 720 KiB/s wr, 23 op/s 2024-04-03T08:37:54.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:53 smithi157 ceph-mon[35083]: pgmap v256: 65 pgs: 65 active+clean; 18 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 1.5 MiB/s wr, 57 op/s 2024-04-03T08:37:54.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:53 smithi181 ceph-mon[44183]: pgmap v256: 65 pgs: 65 active+clean; 18 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 1.5 MiB/s wr, 57 op/s 2024-04-03T08:37:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:55 smithi157 ceph-mon[35083]: pgmap v257: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-04-03T08:37:56.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:55 smithi181 ceph-mon[44183]: pgmap v257: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-04-03T08:37:58.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:57 smithi157 ceph-mon[35083]: pgmap v258: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.7 MiB/s wr, 159 op/s 2024-04-03T08:37:58.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:57 smithi181 ceph-mon[44183]: pgmap v258: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.7 MiB/s wr, 159 op/s 2024-04-03T08:38:00.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:37:59 smithi157 ceph-mon[35083]: pgmap v259: 65 pgs: 65 active+clean; 37 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s rd, 3.2 MiB/s wr, 206 op/s 2024-04-03T08:38:00.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:37:59 smithi181 ceph-mon[44183]: pgmap v259: 65 pgs: 65 active+clean; 37 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s rd, 3.2 MiB/s wr, 206 op/s 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc'] 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: Upgrade: Need to upgrade myself (mgr.smithi157.qfvynr) 2024-04-03T08:38:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:01.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-04-03T08:38:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc'] 2024-04-03T08:38:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:38:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: Upgrade: Need to upgrade myself (mgr.smithi157.qfvynr) 2024-04-03T08:38:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:01 smithi157 ceph-mon[35083]: pgmap v260: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s rd, 3.2 MiB/s wr, 257 op/s 2024-04-03T08:38:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:01 smithi157 ceph-mon[35083]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc on smithi181 2024-04-03T08:38:02.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:01 smithi181 ceph-mon[44183]: pgmap v260: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s rd, 3.2 MiB/s wr, 257 op/s 2024-04-03T08:38:02.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:01 smithi181 ceph-mon[44183]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc on smithi181 2024-04-03T08:38:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:03 smithi157 ceph-mon[35083]: pgmap v261: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 824 KiB/s rd, 3.7 MiB/s wr, 304 op/s 2024-04-03T08:38:04.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:03 smithi181 ceph-mon[44183]: pgmap v261: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 824 KiB/s rd, 3.7 MiB/s wr, 304 op/s 2024-04-03T08:38:06.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:05 smithi157 ceph-mon[35083]: pgmap v262: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 824 KiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-04-03T08:38:06.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:05 smithi181 ceph-mon[44183]: pgmap v262: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 824 KiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-04-03T08:38:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:07 smithi157 ceph-mon[35083]: pgmap v263: 65 pgs: 65 active+clean; 56 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2024-04-03T08:38:08.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:07 smithi181 ceph-mon[44183]: pgmap v263: 65 pgs: 65 active+clean; 56 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.755+0000 7f9a43e00700 1 -- 172.21.15.157:0/3805030654 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a38013bf0 con 0x7f9a4406fda0 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.755+0000 7f9a4c200700 1 -- 172.21.15.157:0/3805030654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 msgr2=0x7f9a4406e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.755+0000 7f9a4c200700 1 --2- 172.21.15.157:0/3805030654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4406e600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a38004880 tx=0x7f9a38009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.756+0000 7f9a4c200700 1 -- 172.21.15.157:0/3805030654 shutdown_connections 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.756+0000 7f9a4c200700 1 --2- 172.21.15.157:0/3805030654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a4406eb40 0x7f9a4406ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.756+0000 7f9a4c200700 1 --2- 172.21.15.157:0/3805030654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4406e600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.756+0000 7f9a4c200700 1 -- 172.21.15.157:0/3805030654 >> 172.21.15.157:0/3805030654 conn(0x7f9a4406a380 msgr2=0x7f9a4406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.756+0000 7f9a4c200700 1 -- 172.21.15.157:0/3805030654 shutdown_connections 2024-04-03T08:38:09.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.756+0000 7f9a4c200700 1 -- 172.21.15.157:0/3805030654 wait complete. 2024-04-03T08:38:09.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.757+0000 7f9a4c200700 1 Processor -- start 2024-04-03T08:38:09.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.758+0000 7f9a4c200700 1 -- start start 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.758+0000 7f9a4c200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a4406eb40 0x7f9a4411c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.758+0000 7f9a4c200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4411cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.758+0000 7f9a4c200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4411d1a0 con 0x7f9a4406eb40 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.758+0000 7f9a4c200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4411d310 con 0x7f9a4406fda0 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4411cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4411cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:57776/0 (socket says 172.21.15.157:57776) 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 -- 172.21.15.157:0/2647429483 learned_addr learned my addr 172.21.15.157:0/2647429483 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a49800700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a4406eb40 0x7f9a4411c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 -- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a4406eb40 msgr2=0x7f9a4411c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a4406eb40 0x7f9a4411c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 -- 172.21.15.157:0/2647429483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38005040 con 0x7f9a4406fda0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.759+0000 7f9a48e00700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4411cba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a30002a50 tx=0x7f9a30004630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.760+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a30007cc0 con 0x7f9a4406fda0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.760+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a3000f040 con 0x7f9a4406fda0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.760+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3000da30 con 0x7f9a4406fda0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.760+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a44121d70 con 0x7f9a4406fda0 2024-04-03T08:38:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.760+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a44122330 con 0x7f9a4406fda0 2024-04-03T08:38:09.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.762+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a441088c0 con 0x7f9a4406fda0 2024-04-03T08:38:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.764+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9a3000db90 con 0x7f9a4406fda0 2024-04-03T08:38:09.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.766+0000 7f9a41600700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9a2c0692a0 0x7f9a2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:09.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.766+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9a30086820 con 0x7f9a4406fda0 2024-04-03T08:38:09.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.767+0000 7f9a49800700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9a2c0692a0 0x7f9a2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.768+0000 7f9a49800700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9a2c0692a0 0x7f9a2c06b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a38013740 tx=0x7f9a38009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:09.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:09.771+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9a3004c190 con 0x7f9a4406fda0 2024-04-03T08:38:10.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:09 smithi157 ceph-mon[35083]: pgmap v264: 65 pgs: 65 active+clean; 61 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.7 MiB/s wr, 342 op/s 2024-04-03T08:38:10.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.092+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a4402b410 con 0x7f9a2c0692a0 2024-04-03T08:38:10.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.094+0000 7f9a41600700 1 -- 172.21.15.157:0/2647429483 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9a4402b410 con 0x7f9a2c0692a0 2024-04-03T08:38:10.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:09 smithi181 ceph-mon[44183]: pgmap v264: 65 pgs: 65 active+clean; 61 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.7 MiB/s wr, 342 op/s 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9a2c0692a0 msgr2=0x7f9a2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9a2c0692a0 0x7f9a2c06b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a38013740 tx=0x7f9a38009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 msgr2=0x7f9a4411cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4411cba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a30002a50 tx=0x7f9a30004630 comp rx=0 tx=0).stop 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 shutdown_connections 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a4406eb40 0x7f9a4411c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9a2c0692a0 0x7f9a2c06b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 --2- 172.21.15.157:0/2647429483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a4406fda0 0x7f9a4411cba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 >> 172.21.15.157:0/2647429483 conn(0x7f9a4406a380 msgr2=0x7f9a4410f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 shutdown_connections 2024-04-03T08:38:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.098+0000 7f9a4c200700 1 -- 172.21.15.157:0/2647429483 wait complete. 2024-04-03T08:38:10.117 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:38:10.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.294+0000 7fa652400700 1 -- 172.21.15.157:0/970734306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fcee0 msgr2=0x7fa64c0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.294+0000 7fa652400700 1 --2- 172.21.15.157:0/970734306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fcee0 0x7fa64c0fd310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa63c004940 tx=0x7fa63c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.294+0000 7fa652400700 1 -- 172.21.15.157:0/970734306 shutdown_connections 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.294+0000 7fa652400700 1 --2- 172.21.15.157:0/970734306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.294+0000 7fa652400700 1 --2- 172.21.15.157:0/970734306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fcee0 0x7fa64c0fd310 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.294+0000 7fa652400700 1 -- 172.21.15.157:0/970734306 >> 172.21.15.157:0/970734306 conn(0x7fa64c0f8560 msgr2=0x7fa64c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.295+0000 7fa652400700 1 -- 172.21.15.157:0/970734306 shutdown_connections 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.295+0000 7fa652400700 1 -- 172.21.15.157:0/970734306 wait complete. 2024-04-03T08:38:10.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.295+0000 7fa652400700 1 Processor -- start 2024-04-03T08:38:10.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa652400700 1 -- start start 2024-04-03T08:38:10.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa652400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa64c0fcee0 0x7fa64c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:10.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa652400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:10.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa652400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0708c0 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa652400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c070a30 con 0x7fa64c0fcee0 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa64aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa64aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39504/0 (socket says 172.21.15.157:39504) 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.296+0000 7fa64aa00700 1 -- 172.21.15.157:0/585995391 learned_addr learned my addr 172.21.15.157:0/585995391 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.297+0000 7fa64b400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa64c0fcee0 0x7fa64c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.297+0000 7fa64aa00700 1 -- 172.21.15.157:0/585995391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa64c0fcee0 msgr2=0x7fa64c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.297+0000 7fa64aa00700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa64c0fcee0 0x7fa64c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.297+0000 7fa64aa00700 1 -- 172.21.15.157:0/585995391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c005040 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.297+0000 7fa64aa00700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c070310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa63800eb40 tx=0x7fa63800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:10.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.298+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa638007cc0 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.298+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c070cb0 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.298+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa63800f040 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.298+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa63800ca10 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.298+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c115a00 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.299+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c0052e0 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.302+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa63800cb70 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.302+0000 7fa643400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa6300692b0 0x7fa63006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:10.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.303+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa638086cf0 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.303+0000 7fa64b400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa6300692b0 0x7fa63006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:10.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.303+0000 7fa64b400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa6300692b0 0x7fa63006b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa63c013740 tx=0x7fa63c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:10.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.307+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa638056af0 con 0x7fa64c0fe0d0 2024-04-03T08:38:10.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.606+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa62c000bf0 con 0x7fa6300692b0 2024-04-03T08:38:10.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.608+0000 7fa643400700 1 -- 172.21.15.157:0/585995391 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fa62c000bf0 con 0x7fa6300692b0 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.610+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa6300692b0 msgr2=0x7fa63006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.610+0000 7fa652400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa6300692b0 0x7fa63006b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa63c013740 tx=0x7fa63c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.610+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 msgr2=0x7fa64c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.610+0000 7fa652400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c070310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa63800eb40 tx=0x7fa63800b040 comp rx=0 tx=0).stop 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 shutdown_connections 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fa6300692b0 0x7fa63006b760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa64c0fcee0 0x7fa64c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 --2- 172.21.15.157:0/585995391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa64c0fe0d0 0x7fa64c070310 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 >> 172.21.15.157:0/585995391 conn(0x7fa64c0f8560 msgr2=0x7fa64c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:10.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 shutdown_connections 2024-04-03T08:38:10.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.611+0000 7fa652400700 1 -- 172.21.15.157:0/585995391 wait complete. 2024-04-03T08:38:10.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 -- 172.21.15.157:0/3047635665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 msgr2=0x7f8b6c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 --2- 172.21.15.157:0/3047635665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c0fe540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c004970 tx=0x7f8b5c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 -- 172.21.15.157:0/3047635665 shutdown_connections 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 --2- 172.21.15.157:0/3047635665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c0fe540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 --2- 172.21.15.157:0/3047635665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0fcee0 0x7f8b6c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 -- 172.21.15.157:0/3047635665 >> 172.21.15.157:0/3047635665 conn(0x7f8b6c0f8560 msgr2=0x7f8b6c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 -- 172.21.15.157:0/3047635665 shutdown_connections 2024-04-03T08:38:10.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.800+0000 7f8b74000700 1 -- 172.21.15.157:0/3047635665 wait complete. 2024-04-03T08:38:10.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.801+0000 7f8b74000700 1 Processor -- start 2024-04-03T08:38:10.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.801+0000 7f8b74000700 1 -- start start 2024-04-03T08:38:10.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.802+0000 7f8b74000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0fcee0 0x7f8b6c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:10.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.802+0000 7f8b74000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:10.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.802+0000 7f8b74000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1107f0 con 0x7f8b6c0fcee0 2024-04-03T08:38:10.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.802+0000 7f8b74000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c110fe0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b70c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:10.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b71600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0fcee0 0x7f8b6c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:10.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b70c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:57822/0 (socket says 172.21.15.157:57822) 2024-04-03T08:38:10.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b70c00700 1 -- 172.21.15.157:0/2258653337 learned_addr learned my addr 172.21.15.157:0/2258653337 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:10.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b70c00700 1 -- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0fcee0 msgr2=0x7f8b6c10fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:10.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b70c00700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0fcee0 0x7f8b6c10fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:10.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.803+0000 7f8b70c00700 1 -- 172.21.15.157:0/2258653337 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c005040 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.804+0000 7f8b70c00700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c110160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c004f50 tx=0x7f8b5c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:10.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.804+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5c00e040 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.804+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c111260 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.804+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b5c00bce0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.804+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5c01c630 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.804+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c1117a0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.806+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c1095c0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.808+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8b5c0139f0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.809+0000 7f8b69600700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8b54069380 0x7f8b5406b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:10.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.809+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8b5c0884c0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:10.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.809+0000 7f8b71600700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8b54069380 0x7f8b5406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:10.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.810+0000 7f8b71600700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8b54069380 0x7f8b5406b830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0fcc20 tx=0x7f8b640091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:10.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:10.814+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8b5c0582c0 con 0x7f8b6c0fe0d0 2024-04-03T08:38:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.081+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b6c111b40 con 0x7f8b54069380 2024-04-03T08:38:11.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.094+0000 7f8b69600700 1 -- 172.21.15.157:0/2258653337 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f8b6c111b40 con 0x7f8b54069380 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (6m) 106s ago 8m 12.9M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (8m) 106s ago 8m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (7m) 112s ago 7m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (6m) 106s ago 8m 72.2M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (2m) 106s ago 2m 10.5M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (2m) 106s ago 2m 12.7M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (2m) 112s ago 2m 10.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (2m) 112s ago 2m 11.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (10m) 106s ago 10m 481M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:38:11.095 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (7m) 112s ago 7m 431M - 17.2.7-805-g6fda41ff a49113eacc58 ef09dfea7a47 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (10m) 106s ago 10m 44.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (7m) 112s ago 7m 35.3M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (8m) 106s ago 8m 7948k - 1.5.0 0da6a335fe13 2baa04300c28 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (7m) 112s ago 7m 7633k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (6m) 106s ago 6m 44.0M 4348M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (5m) 106s ago 5m 44.4M 4348M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (5m) 106s ago 5m 43.3M 4348M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (4m) 112s ago 4m 42.7M 5372M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (4m) 112s ago 4m 40.8M 5372M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (3m) 112s ago 3m 40.1M 5372M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:38:11.096 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (6m) 106s ago 7m 44.9M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:38:11.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.097+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8b54069380 msgr2=0x7f8b5406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.097+0000 7f8b74000700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8b54069380 0x7f8b5406b830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0fcc20 tx=0x7f8b640091a0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.097+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 msgr2=0x7f8b6c110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.097+0000 7f8b74000700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c110160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c004f50 tx=0x7f8b5c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 shutdown_connections 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0fcee0 0x7f8b6c10fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8b54069380 0x7f8b5406b830 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 --2- 172.21.15.157:0/2258653337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c0fe0d0 0x7f8b6c110160 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 >> 172.21.15.157:0/2258653337 conn(0x7f8b6c0f8560 msgr2=0x7f8b6c101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 shutdown_connections 2024-04-03T08:38:11.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.098+0000 7f8b74000700 1 -- 172.21.15.157:0/2258653337 wait complete. 2024-04-03T08:38:11.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.275+0000 7f1547400700 1 -- 172.21.15.157:0/1508624545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 msgr2=0x7f15400fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.275+0000 7f1547400700 1 --2- 172.21.15.157:0/1508624545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f15400fe460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f152c004940 tx=0x7f152c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:11.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.276+0000 7f1547400700 1 -- 172.21.15.157:0/1508624545 shutdown_connections 2024-04-03T08:38:11.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.276+0000 7f1547400700 1 --2- 172.21.15.157:0/1508624545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f15400fe460 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.276+0000 7f1547400700 1 --2- 172.21.15.157:0/1508624545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 0x7f15400fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.276+0000 7f1547400700 1 -- 172.21.15.157:0/1508624545 >> 172.21.15.157:0/1508624545 conn(0x7f15400f8560 msgr2=0x7f15400fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:11.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.276+0000 7f1547400700 1 -- 172.21.15.157:0/1508624545 shutdown_connections 2024-04-03T08:38:11.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.276+0000 7f1547400700 1 -- 172.21.15.157:0/1508624545 wait complete. 2024-04-03T08:38:11.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.277+0000 7f1547400700 1 Processor -- start 2024-04-03T08:38:11.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.277+0000 7f1547400700 1 -- start start 2024-04-03T08:38:11.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1547400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 0x7f154010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:11.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1547400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f1540110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:11.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1547400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540110720 con 0x7f15400fdff0 2024-04-03T08:38:11.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1547400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540110f70 con 0x7f15400fce80 2024-04-03T08:38:11.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1544a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 0x7f154010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:11.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1544a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 0x7f154010fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:57838/0 (socket says 172.21.15.157:57838) 2024-04-03T08:38:11.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f1544a00700 1 -- 172.21.15.157:0/2289875333 learned_addr learned my addr 172.21.15.157:0/2289875333 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:11.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.278+0000 7f153fe00700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f1540110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:11.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.279+0000 7f153fe00700 1 -- 172.21.15.157:0/2289875333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 msgr2=0x7f154010fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.279+0000 7f153fe00700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 0x7f154010fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.279+0000 7f153fe00700 1 -- 172.21.15.157:0/2289875333 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c005040 con 0x7f15400fdff0 2024-04-03T08:38:11.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.279+0000 7f153fe00700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f1540110120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f152c009fd0 tx=0x7f152c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:11.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.280+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152c021070 con 0x7f15400fdff0 2024-04-03T08:38:11.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.280+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f152c01c400 con 0x7f15400fdff0 2024-04-03T08:38:11.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.280+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152c00e070 con 0x7f15400fdff0 2024-04-03T08:38:11.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.280+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15401111f0 con 0x7f15400fdff0 2024-04-03T08:38:11.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.281+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15401116d0 con 0x7f15400fdff0 2024-04-03T08:38:11.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.283+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f152c01ca20 con 0x7f15400fdff0 2024-04-03T08:38:11.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.284+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1540101980 con 0x7f15400fdff0 2024-04-03T08:38:11.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.285+0000 7f153cc00700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f1528069360 0x7f152806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:11.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.285+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f152c088290 con 0x7f15400fdff0 2024-04-03T08:38:11.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.286+0000 7f1544a00700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f1528069360 0x7f152806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:11.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.287+0000 7f1544a00700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f1528069360 0x7f152806b810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1534004bc0 tx=0x7f153400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:11.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.291+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f152c0580a0 con 0x7f15400fdff0 2024-04-03T08:38:11.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.689+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f154005f5f0 con 0x7f15400fdff0 2024-04-03T08:38:11.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.690+0000 7f153cc00700 1 -- 172.21.15.157:0/2289875333 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f152c057c30 con 0x7f15400fdff0 2024-04-03T08:38:11.691 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:38:11.691 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:38:11.691 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:38:11.691 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:11.691 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:38:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 14 2024-04-03T08:38:11.693 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:38:11.693 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:38:11.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f1528069360 msgr2=0x7f152806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f1528069360 0x7f152806b810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1534004bc0 tx=0x7f153400b040 comp rx=0 tx=0).stop 2024-04-03T08:38:11.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 msgr2=0x7f1540110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f1540110120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f152c009fd0 tx=0x7f152c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 shutdown_connections 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f1528069360 0x7f152806b810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15400fce80 0x7f154010fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 --2- 172.21.15.157:0/2289875333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15400fdff0 0x7f1540110120 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.693+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 >> 172.21.15.157:0/2289875333 conn(0x7f15400f8560 msgr2=0x7f15400f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.694+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 shutdown_connections 2024-04-03T08:38:11.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.694+0000 7f1547400700 1 -- 172.21.15.157:0/2289875333 wait complete. 2024-04-03T08:38:11.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.898+0000 7efc7de00700 1 -- 172.21.15.157:0/1149980893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 msgr2=0x7efc780fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.898+0000 7efc7de00700 1 --2- 172.21.15.157:0/1149980893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc780fe4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc64004e90 tx=0x7efc64004990 comp rx=0 tx=0).stop 2024-04-03T08:38:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.898+0000 7efc7de00700 1 -- 172.21.15.157:0/1149980893 shutdown_connections 2024-04-03T08:38:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.898+0000 7efc7de00700 1 --2- 172.21.15.157:0/1149980893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc780fe4e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.898+0000 7efc7de00700 1 --2- 172.21.15.157:0/1149980893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 0x7efc780fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.898+0000 7efc7de00700 1 -- 172.21.15.157:0/1149980893 >> 172.21.15.157:0/1149980893 conn(0x7efc780f85a0 msgr2=0x7efc780fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.899+0000 7efc7de00700 1 -- 172.21.15.157:0/1149980893 shutdown_connections 2024-04-03T08:38:11.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.899+0000 7efc7de00700 1 -- 172.21.15.157:0/1149980893 wait complete. 2024-04-03T08:38:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.899+0000 7efc7de00700 1 Processor -- start 2024-04-03T08:38:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc7de00700 1 -- start start 2024-04-03T08:38:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc7de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 0x7efc7810b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc7de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc7810bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc7de00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7810c2f0 con 0x7efc780fe070 2024-04-03T08:38:11.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc7de00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7810cb40 con 0x7efc780fcf00 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc76000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc7810bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc76a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 0x7efc7810b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc76000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc7810bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39578/0 (socket says 172.21.15.157:39578) 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc76a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 0x7efc7810b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:57850/0 (socket says 172.21.15.157:57850) 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.900+0000 7efc76000700 1 -- 172.21.15.157:0/2389541554 learned_addr learned my addr 172.21.15.157:0/2389541554 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.901+0000 7efc76000700 1 -- 172.21.15.157:0/2389541554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 msgr2=0x7efc7810b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.901+0000 7efc76000700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 0x7efc7810b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:11.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.901+0000 7efc76000700 1 -- 172.21.15.157:0/2389541554 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64005040 con 0x7efc780fe070 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.901+0000 7efc76000700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc7810bcf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc64004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.901+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc64012050 con 0x7efc780fe070 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.902+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7810cdc0 con 0x7efc780fe070 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.902+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7810d300 con 0x7efc780fe070 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.902+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc64017d60 con 0x7efc780fe070 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.902+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc6401fd60 con 0x7efc780fe070 2024-04-03T08:38:11.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.903+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc580052e0 con 0x7efc780fe070 2024-04-03T08:38:11.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.904+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7efc64017890 con 0x7efc780fe070 2024-04-03T08:38:11.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.905+0000 7efc6ea00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7efc5c0692b0 0x7efc5c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:11.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.905+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efc6408cef0 con 0x7efc780fe070 2024-04-03T08:38:11.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.906+0000 7efc76a00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7efc5c0692b0 0x7efc5c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.906+0000 7efc76a00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7efc5c0692b0 0x7efc5c06b760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efc68009b80 tx=0x7efc6800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:11.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:11.914+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7efc6405cc40 con 0x7efc780fe070 2024-04-03T08:38:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:11 smithi157 ceph-mon[35083]: pgmap v265: 65 pgs: 65 active+clean; 75 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-04-03T08:38:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:11 smithi157 ceph-mon[35083]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:11 smithi157 ceph-mon[35083]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:11 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2289875333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:38:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:11 smithi181 ceph-mon[44183]: pgmap v265: 65 pgs: 65 active+clean; 75 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-04-03T08:38:12.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:11 smithi181 ceph-mon[44183]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:12.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:11 smithi181 ceph-mon[44183]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:12.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:11 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2289875333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:38:12.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.269+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc58005da0 con 0x7efc780fe070 2024-04-03T08:38:12.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.270+0000 7efc6ea00700 1 -- 172.21.15.157:0/2389541554 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7efc64023750 con 0x7efc780fe070 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:38:12.271 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:38:12.272 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:12.273 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:12.274 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:12.274 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:38:12.274 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:12.274 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:12.274 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.272+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7efc5c0692b0 msgr2=0x7efc5c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.272+0000 7efc7de00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7efc5c0692b0 0x7efc5c06b760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efc68009b80 tx=0x7efc6800b040 comp rx=0 tx=0).stop 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.272+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 msgr2=0x7efc7810bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.272+0000 7efc7de00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc7810bcf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc64004990 comp rx=0 tx=0).stop 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 shutdown_connections 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7efc5c0692b0 0x7efc5c06b760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc780fcf00 0x7efc7810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 --2- 172.21.15.157:0/2389541554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc780fe070 0x7efc7810bcf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 >> 172.21.15.157:0/2389541554 conn(0x7efc780f85a0 msgr2=0x7efc780f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:12.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 shutdown_connections 2024-04-03T08:38:12.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.273+0000 7efc7de00700 1 -- 172.21.15.157:0/2389541554 wait complete. 2024-04-03T08:38:12.276 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 -- 172.21.15.157:0/82473378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8073180 msgr2=0x7fcfd8073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/82473378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8073180 0x7fcfd8073b40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0004880 tx=0x7fcfc0009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 -- 172.21.15.157:0/82473378 shutdown_connections 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/82473378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8073180 0x7fcfd8073b40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/82473378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd8072830 0x7fcfd8072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 -- 172.21.15.157:0/82473378 >> 172.21.15.157:0/82473378 conn(0x7fcfd80fa5d0 msgr2=0x7fcfd80fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 -- 172.21.15.157:0/82473378 shutdown_connections 2024-04-03T08:38:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.465+0000 7fcfdcc00700 1 -- 172.21.15.157:0/82473378 wait complete. 2024-04-03T08:38:12.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.467+0000 7fcfdcc00700 1 Processor -- start 2024-04-03T08:38:12.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.468+0000 7fcfdcc00700 1 -- start start 2024-04-03T08:38:12.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfdcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 0x7fcfd8113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:12.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfdcc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd8073180 0x7fcfd8114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:12.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfdcc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd81151b0 con 0x7fcfd8072830 2024-04-03T08:38:12.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfdcc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd8115320 con 0x7fcfd8073180 2024-04-03T08:38:12.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfd7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 0x7fcfd8113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:12.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfd7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 0x7fcfd8113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52512/0 (socket says 172.21.15.157:52512) 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.469+0000 7fcfd7400700 1 -- 172.21.15.157:0/481771513 learned_addr learned my addr 172.21.15.157:0/481771513 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.470+0000 7fcfd7400700 1 -- 172.21.15.157:0/481771513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd8073180 msgr2=0x7fcfd8114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.470+0000 7fcfd7400700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd8073180 0x7fcfd8114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.470+0000 7fcfd7400700 1 -- 172.21.15.157:0/481771513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0005040 con 0x7fcfd8072830 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.470+0000 7fcfd7400700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 0x7fcfd8113f00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800eb40 tx=0x7fcfc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.471+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc8007cc0 con 0x7fcfd8072830 2024-04-03T08:38:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.471+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfc800f040 con 0x7fcfd8072830 2024-04-03T08:38:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.471+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc8009680 con 0x7fcfd8072830 2024-04-03T08:38:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.471+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd81155a0 con 0x7fcfd8072830 2024-04-03T08:38:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.471+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd8115b60 con 0x7fcfd8072830 2024-04-03T08:38:12.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.473+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd805f5f0 con 0x7fcfd8072830 2024-04-03T08:38:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.473+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcfc80097e0 con 0x7fcfd8072830 2024-04-03T08:38:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.474+0000 7fcfcf400700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcfbc0692b0 0x7fcfbc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.475+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcfc8086c20 con 0x7fcfd8072830 2024-04-03T08:38:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.475+0000 7fcfd6a00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcfbc0692b0 0x7fcfbc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:12.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.475+0000 7fcfd6a00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcfbc0692b0 0x7fcfbc06b760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00138f0 tx=0x7fcfc0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:12.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.483+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcfc804e190 con 0x7fcfd8072830 2024-04-03T08:38:12.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.818+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfd8115e40 con 0x7fcfbc0692b0 2024-04-03T08:38:12.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.820+0000 7fcfcf400700 1 -- 172.21.15.157:0/481771513 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fcfd8115e40 con 0x7fcfbc0692b0 2024-04-03T08:38:12.820 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:38:12.820 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:38:12.820 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:38:12.820 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:38:12.820 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:38:12.821 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "0/21 daemons upgraded", 2024-04-03T08:38:12.821 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc image on host smithi181", 2024-04-03T08:38:12.821 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:38:12.821 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:38:12.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.822+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcfbc0692b0 msgr2=0x7fcfbc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:12.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.822+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcfbc0692b0 0x7fcfbc06b760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00138f0 tx=0x7fcfc0009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:12.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.822+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 msgr2=0x7fcfd8113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:12.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.822+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 0x7fcfd8113f00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800eb40 tx=0x7fcfc800b040 comp rx=0 tx=0).stop 2024-04-03T08:38:12.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 shutdown_connections 2024-04-03T08:38:12.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfd8072830 0x7fcfd8113f00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fcfbc0692b0 0x7fcfbc06b760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 --2- 172.21.15.157:0/481771513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd8073180 0x7fcfd8114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:12.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 >> 172.21.15.157:0/481771513 conn(0x7fcfd80fa5d0 msgr2=0x7fcfd80fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:12.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 shutdown_connections 2024-04-03T08:38:12.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:12.823+0000 7fcfdcc00700 1 -- 172.21.15.157:0/481771513 wait complete. 2024-04-03T08:38:13.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 -- 172.21.15.157:0/145032542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 msgr2=0x7f8f1c102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:13.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 --2- 172.21.15.157:0/145032542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c102320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c004940 tx=0x7f8f0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 -- 172.21.15.157:0/145032542 shutdown_connections 2024-04-03T08:38:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 --2- 172.21.15.157:0/145032542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c102320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 --2- 172.21.15.157:0/145032542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 -- 172.21.15.157:0/145032542 >> 172.21.15.157:0/145032542 conn(0x7f8f1c0f7430 msgr2=0x7f8f1c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 -- 172.21.15.157:0/145032542 shutdown_connections 2024-04-03T08:38:13.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.040+0000 7f8f21400700 1 -- 172.21.15.157:0/145032542 wait complete. 2024-04-03T08:38:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.041+0000 7f8f21400700 1 Processor -- start 2024-04-03T08:38:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.041+0000 7f8f21400700 1 -- start start 2024-04-03T08:38:13.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f21400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c10fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f21400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f21400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c110750 con 0x7f8f1c0fff00 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f21400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c110fa0 con 0x7f8f1c0662e0 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f1a800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c10fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f19e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f1a800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c10fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:54414/0 (socket says 172.21.15.157:54414) 2024-04-03T08:38:13.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.042+0000 7f8f1a800700 1 -- 172.21.15.157:0/1739956372 learned_addr learned my addr 172.21.15.157:0/1739956372 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:13.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.043+0000 7f8f19e00700 1 -- 172.21.15.157:0/1739956372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 msgr2=0x7f8f1c10fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:13.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.043+0000 7f8f19e00700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c10fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:13.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.043+0000 7f8f19e00700 1 -- 172.21.15.157:0/1739956372 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c005040 con 0x7f8f1c0fff00 2024-04-03T08:38:13.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.043+0000 7f8f1a800700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c10fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:38:13.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.043+0000 7f8f19e00700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c110150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00b0d0 tx=0x7f8f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:13.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.043+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0c00e070 con 0x7f8f1c0fff00 2024-04-03T08:38:13.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.044+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f0c013de0 con 0x7f8f1c0fff00 2024-04-03T08:38:13.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.044+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0c00be30 con 0x7f8f1c0fff00 2024-04-03T08:38:13.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.044+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c111220 con 0x7f8f1c0fff00 2024-04-03T08:38:13.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.044+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c111760 con 0x7f8f1c0fff00 2024-04-03T08:38:13.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.046+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c05f5f0 con 0x7f8f1c0fff00 2024-04-03T08:38:13.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.047+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8f0c00b680 con 0x7f8f1c0fff00 2024-04-03T08:38:13.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.048+0000 7f8f12a00700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8f000692b0 0x7f8f0006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:13.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.048+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8f0c087b10 con 0x7f8f1c0fff00 2024-04-03T08:38:13.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.049+0000 7f8f1a800700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8f000692b0 0x7f8f0006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:13.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.050+0000 7f8f1a800700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8f000692b0 0x7f8f0006b760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f14004fd0 tx=0x7f8f1400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:13.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.054+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8f0c057860 con 0x7f8f1c0fff00 2024-04-03T08:38:13.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:12 smithi157 ceph-mon[35083]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:13.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:12 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2389541554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:38:13.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:12 smithi181 ceph-mon[44183]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:13.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:12 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2389541554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:38:13.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.495+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8f1c111a20 con 0x7f8f1c0fff00 2024-04-03T08:38:13.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.496+0000 7f8f12a00700 1 -- 172.21.15.157:0/1739956372 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8f0c022020 con 0x7f8f1c0fff00 2024-04-03T08:38:13.497 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:38:13.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.499+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8f000692b0 msgr2=0x7f8f0006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:13.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.499+0000 7f8f21400700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8f000692b0 0x7f8f0006b760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f14004fd0 tx=0x7f8f1400b040 comp rx=0 tx=0).stop 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 msgr2=0x7f8f1c110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c110150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00b0d0 tx=0x7f8f0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 shutdown_connections 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f8f000692b0 0x7f8f0006b760 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f1c0662e0 0x7f8f1c10fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 --2- 172.21.15.157:0/1739956372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f1c0fff00 0x7f8f1c110150 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 >> 172.21.15.157:0/1739956372 conn(0x7f8f1c0f7430 msgr2=0x7f8f1c0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 shutdown_connections 2024-04-03T08:38:13.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:13.500+0000 7f8f21400700 1 -- 172.21.15.157:0/1739956372 wait complete. 2024-04-03T08:38:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:13 smithi157 ceph-mon[35083]: pgmap v266: 65 pgs: 65 active+clean; 80 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 369 op/s 2024-04-03T08:38:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:13 smithi157 ceph-mon[35083]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:13 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1739956372' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:38:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:13 smithi181 ceph-mon[44183]: pgmap v266: 65 pgs: 65 active+clean; 80 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 369 op/s 2024-04-03T08:38:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:13 smithi181 ceph-mon[44183]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:14.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:13 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1739956372' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:38:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:15 smithi157 ceph-mon[35083]: pgmap v267: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 336 op/s 2024-04-03T08:38:16.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:15 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:15 smithi181 ceph-mon[44183]: pgmap v267: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 336 op/s 2024-04-03T08:38:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:15 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:18.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:17 smithi157 ceph-mon[35083]: pgmap v268: 65 pgs: 65 active+clean; 96 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 374 op/s 2024-04-03T08:38:18.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:17 smithi181 ceph-mon[44183]: pgmap v268: 65 pgs: 65 active+clean; 96 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 374 op/s 2024-04-03T08:38:20.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:19 smithi157 ceph-mon[35083]: pgmap v269: 65 pgs: 65 active+clean; 98 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 338 op/s 2024-04-03T08:38:20.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:19 smithi181 ceph-mon[44183]: pgmap v269: 65 pgs: 65 active+clean; 98 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 338 op/s 2024-04-03T08:38:22.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:21 smithi157 ceph-mon[35083]: pgmap v270: 65 pgs: 65 active+clean; 104 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 350 op/s 2024-04-03T08:38:22.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:21 smithi181 ceph-mon[44183]: pgmap v270: 65 pgs: 65 active+clean; 104 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 350 op/s 2024-04-03T08:38:24.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:23 smithi157 ceph-mon[35083]: pgmap v271: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 346 op/s 2024-04-03T08:38:24.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:23 smithi181 ceph-mon[44183]: pgmap v271: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 346 op/s 2024-04-03T08:38:26.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:25 smithi157 ceph-mon[35083]: pgmap v272: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 316 op/s 2024-04-03T08:38:26.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:25 smithi181 ceph-mon[44183]: pgmap v272: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 316 op/s 2024-04-03T08:38:28.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:27 smithi181 ceph-mon[44183]: pgmap v273: 65 pgs: 65 active+clean; 116 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 361 op/s 2024-04-03T08:38:28.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:27 smithi157 ceph-mon[35083]: pgmap v273: 65 pgs: 65 active+clean; 116 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 361 op/s 2024-04-03T08:38:30.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:29 smithi181 ceph-mon[44183]: pgmap v274: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 329 op/s 2024-04-03T08:38:30.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:29 smithi157 ceph-mon[35083]: pgmap v274: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 329 op/s 2024-04-03T08:38:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:30 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:30 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:32.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:31 smithi181 ceph-mon[44183]: pgmap v275: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 340 op/s 2024-04-03T08:38:32.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:31 smithi157 ceph-mon[35083]: pgmap v275: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 340 op/s 2024-04-03T08:38:34.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:33 smithi181 ceph-mon[44183]: pgmap v276: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-04-03T08:38:34.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:33 smithi157 ceph-mon[35083]: pgmap v276: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-04-03T08:38:36.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:35 smithi181 ceph-mon[44183]: pgmap v277: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 308 op/s 2024-04-03T08:38:36.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:35 smithi157 ceph-mon[35083]: pgmap v277: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 308 op/s 2024-04-03T08:38:38.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:37 smithi181 ceph-mon[44183]: pgmap v278: 65 pgs: 65 active+clean; 144 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2024-04-03T08:38:38.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:37 smithi157 ceph-mon[35083]: pgmap v278: 65 pgs: 65 active+clean; 144 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2024-04-03T08:38:40.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:39 smithi181 ceph-mon[44183]: pgmap v279: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 318 op/s 2024-04-03T08:38:40.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:39 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:40.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:39 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:38:40.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:39 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:38:40.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:39 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:38:40.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:39 smithi157 ceph-mon[35083]: pgmap v279: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 318 op/s 2024-04-03T08:38:40.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:40 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:40.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:40 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:38:40.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:40 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:38:40.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:40 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:38:41.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:40 smithi181 ceph-mon[44183]: Upgrade: Updating mgr.smithi181.mfhidq 2024-04-03T08:38:41.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:40 smithi181 ceph-mon[44183]: Deploying daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:38:41.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:40 smithi157 ceph-mon[35083]: Upgrade: Updating mgr.smithi181.mfhidq 2024-04-03T08:38:41.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:40 smithi157 ceph-mon[35083]: Deploying daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:38:42.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:41 smithi181 ceph-mon[44183]: pgmap v280: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 328 op/s 2024-04-03T08:38:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:41 smithi157 ceph-mon[35083]: pgmap v280: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 328 op/s 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 -- 172.21.15.157:0/3436847386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 msgr2=0x7ff0b0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 --2- 172.21.15.157:0/3436847386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0070350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0004970 tx=0x7ff0a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 -- 172.21.15.157:0/3436847386 shutdown_connections 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 --2- 172.21.15.157:0/3436847386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0b0070890 0x7ff0b0070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 --2- 172.21.15.157:0/3436847386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0070350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 -- 172.21.15.157:0/3436847386 >> 172.21.15.157:0/3436847386 conn(0x7ff0b00f8540 msgr2=0x7ff0b00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 -- 172.21.15.157:0/3436847386 shutdown_connections 2024-04-03T08:38:43.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.720+0000 7ff0b6400700 1 -- 172.21.15.157:0/3436847386 wait complete. 2024-04-03T08:38:43.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.721+0000 7ff0b6400700 1 Processor -- start 2024-04-03T08:38:43.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.722+0000 7ff0b6400700 1 -- start start 2024-04-03T08:38:43.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.722+0000 7ff0b6400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0b0070890 0x7ff0b0114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:43.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.722+0000 7ff0b6400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:43.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.722+0000 7ff0b6400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b0114b90 con 0x7ff0b0070890 2024-04-03T08:38:43.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.722+0000 7ff0b6400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01153e0 con 0x7ff0b0071e40 2024-04-03T08:38:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.723+0000 7ff0aea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.723+0000 7ff0aea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0114590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:47214/0 (socket says 172.21.15.157:47214) 2024-04-03T08:38:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.723+0000 7ff0aea00700 1 -- 172.21.15.157:0/358354387 learned_addr learned my addr 172.21.15.157:0/358354387 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.723+0000 7ff0aea00700 1 -- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0b0070890 msgr2=0x7ff0b0114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.723+0000 7ff0aea00700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0b0070890 0x7ff0b0114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.723+0000 7ff0aea00700 1 -- 172.21.15.157:0/358354387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0005040 con 0x7ff0b0071e40 2024-04-03T08:38:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.724+0000 7ff0aea00700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0114590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff09c002a80 tx=0x7ff09c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.725+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09c007cc0 con 0x7ff0b0071e40 2024-04-03T08:38:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.725+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff09c00f040 con 0x7ff0b0071e40 2024-04-03T08:38:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.725+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b01156c0 con 0x7ff0b0071e40 2024-04-03T08:38:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.725+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09c0096f0 con 0x7ff0b0071e40 2024-04-03T08:38:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.726+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b0115c00 con 0x7ff0b0071e40 2024-04-03T08:38:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.727+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b0103610 con 0x7ff0b0071e40 2024-04-03T08:38:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.728+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff09c01c400 con 0x7ff0b0071e40 2024-04-03T08:38:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.729+0000 7ff0a7400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff094069360 0x7ff09406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.729+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff09c0868c0 con 0x7ff0b0071e40 2024-04-03T08:38:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.730+0000 7ff0af400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff094069360 0x7ff09406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:43.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.731+0000 7ff0af400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff094069360 0x7ff09406b810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000b370 tx=0x7ff0a0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:43.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:43.734+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff09c04d190 con 0x7ff0b0071e40 2024-04-03T08:38:44.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.085+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0b00fdc00 con 0x7ff094069360 2024-04-03T08:38:44.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.087+0000 7ff0a7400700 1 -- 172.21.15.157:0/358354387 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff0a0008d60 con 0x7ff094069360 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff094069360 msgr2=0x7ff09406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff094069360 0x7ff09406b810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000b370 tx=0x7ff0a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 msgr2=0x7ff0b0114590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0114590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff09c002a80 tx=0x7ff09c0046b0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 shutdown_connections 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0b0070890 0x7ff0b0114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7ff094069360 0x7ff09406b810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 --2- 172.21.15.157:0/358354387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b0071e40 0x7ff0b0114590 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff09c002a80 tx=0x7ff09c0046b0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.090+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 >> 172.21.15.157:0/358354387 conn(0x7ff0b00f8540 msgr2=0x7ff0b00f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:44.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.092+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 shutdown_connections 2024-04-03T08:38:44.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.092+0000 7ff0b6400700 1 -- 172.21.15.157:0/358354387 wait complete. 2024-04-03T08:38:44.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:43 smithi181 ceph-mon[44183]: pgmap v281: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 334 op/s 2024-04-03T08:38:44.112 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:38:44.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 -- 172.21.15.157:0/1913417347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 msgr2=0x7fe8700703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 --2- 172.21.15.157:0/1913417347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe8700703b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe860004880 tx=0x7fe860009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:44.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 -- 172.21.15.157:0/1913417347 shutdown_connections 2024-04-03T08:38:44.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 --2- 172.21.15.157:0/1913417347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 0x7fe870070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 --2- 172.21.15.157:0/1913417347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe8700703b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 -- 172.21.15.157:0/1913417347 >> 172.21.15.157:0/1913417347 conn(0x7fe8700f83d0 msgr2=0x7fe8700fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:44.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 -- 172.21.15.157:0/1913417347 shutdown_connections 2024-04-03T08:38:44.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.283+0000 7fe86fe00700 1 -- 172.21.15.157:0/1913417347 wait complete. 2024-04-03T08:38:44.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.284+0000 7fe86fe00700 1 Processor -- start 2024-04-03T08:38:44.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.285+0000 7fe86fe00700 1 -- start start 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.285+0000 7fe86fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 0x7fe870113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.285+0000 7fe86fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe870114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.285+0000 7fe86fe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870114a00 con 0x7fe8700708f0 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.285+0000 7fe86fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870115250 con 0x7fe870071ea0 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.285+0000 7fe86ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 0x7fe870113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe870114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe870114400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:47228/0 (socket says 172.21.15.157:47228) 2024-04-03T08:38:44.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86e000700 1 -- 172.21.15.157:0/3261964650 learned_addr learned my addr 172.21.15.157:0/3261964650 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:44.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86ea00700 1 -- 172.21.15.157:0/3261964650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 msgr2=0x7fe870114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86ea00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe870114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86ea00700 1 -- 172.21.15.157:0/3261964650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858005040 con 0x7fe8700708f0 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.286+0000 7fe86e000700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe870114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.287+0000 7fe86ea00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 0x7fe870113ec0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe8600137c0 tx=0x7fe860009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.287+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86000e030 con 0x7fe8700708f0 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.287+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe860005040 con 0x7fe8700708f0 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.287+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870115880 con 0x7fe8700708f0 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.287+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe860013e60 con 0x7fe8700708f0 2024-04-03T08:38:44.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.287+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8600123c0 con 0x7fe8700708f0 2024-04-03T08:38:44.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.289+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c0052e0 con 0x7fe8700708f0 2024-04-03T08:38:44.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.291+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe860013990 con 0x7fe8700708f0 2024-04-03T08:38:44.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.292+0000 7fe866a00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe8540692b0 0x7fe85406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:44.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.292+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe860088f80 con 0x7fe8700708f0 2024-04-03T08:38:44.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.294+0000 7fe86e000700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe8540692b0 0x7fe85406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:44.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.295+0000 7fe86e000700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe8540692b0 0x7fe85406b760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8580045a0 tx=0x7fe858009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:44.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.300+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe860058d90 con 0x7fe8700708f0 2024-04-03T08:38:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:43 smithi157 ceph-mon[35083]: pgmap v281: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 334 op/s 2024-04-03T08:38:44.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.593+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe84c000bf0 con 0x7fe8540692b0 2024-04-03T08:38:44.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.595+0000 7fe866a00700 1 -- 172.21.15.157:0/3261964650 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe84c000bf0 con 0x7fe8540692b0 2024-04-03T08:38:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe8540692b0 msgr2=0x7fe85406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe8540692b0 0x7fe85406b760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8580045a0 tx=0x7fe858009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 msgr2=0x7fe870113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 0x7fe870113ec0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe8600137c0 tx=0x7fe860009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:44.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 shutdown_connections 2024-04-03T08:38:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8700708f0 0x7fe870113ec0 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe8600137c0 tx=0x7fe860009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.598+0000 7fe86fe00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fe8540692b0 0x7fe85406b760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.599+0000 7fe86fe00700 1 --2- 172.21.15.157:0/3261964650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe870071ea0 0x7fe870114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.599+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 >> 172.21.15.157:0/3261964650 conn(0x7fe8700f83d0 msgr2=0x7fe8700f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.599+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 shutdown_connections 2024-04-03T08:38:44.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.599+0000 7fe86fe00700 1 -- 172.21.15.157:0/3261964650 wait complete. 2024-04-03T08:38:44.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.788+0000 7f5f26000700 1 -- 172.21.15.157:0/4289403000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 msgr2=0x7f5f20100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.788+0000 7f5f26000700 1 --2- 172.21.15.157:0/4289403000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20100710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c004940 tx=0x7f5f0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.789+0000 7f5f26000700 1 -- 172.21.15.157:0/4289403000 shutdown_connections 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.789+0000 7f5f26000700 1 --2- 172.21.15.157:0/4289403000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20100710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.789+0000 7f5f26000700 1 --2- 172.21.15.157:0/4289403000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f200ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.789+0000 7f5f26000700 1 -- 172.21.15.157:0/4289403000 >> 172.21.15.157:0/4289403000 conn(0x7f5f200fa950 msgr2=0x7f5f200fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.790+0000 7f5f26000700 1 -- 172.21.15.157:0/4289403000 shutdown_connections 2024-04-03T08:38:44.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.790+0000 7f5f26000700 1 -- 172.21.15.157:0/4289403000 wait complete. 2024-04-03T08:38:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.791+0000 7f5f26000700 1 Processor -- start 2024-04-03T08:38:44.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.791+0000 7f5f26000700 1 -- start start 2024-04-03T08:38:44.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.792+0000 7f5f26000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f2010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:44.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.792+0000 7f5f26000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:44.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.792+0000 7f5f26000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20110740 con 0x7f5f200feff0 2024-04-03T08:38:44.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.792+0000 7f5f26000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20110f40 con 0x7f5f201002a0 2024-04-03T08:38:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.792+0000 7f5f1f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f2010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.793+0000 7f5f1ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.792+0000 7f5f1f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f2010fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39220/0 (socket says 172.21.15.157:39220) 2024-04-03T08:38:44.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.793+0000 7f5f1f400700 1 -- 172.21.15.157:0/1181341186 learned_addr learned my addr 172.21.15.157:0/1181341186 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.793+0000 7f5f1ea00700 1 -- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 msgr2=0x7f5f2010fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.793+0000 7f5f1ea00700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f2010fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.793+0000 7f5f1ea00700 1 -- 172.21.15.157:0/1181341186 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c005040 con 0x7f5f201002a0 2024-04-03T08:38:44.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.794+0000 7f5f1f400700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f2010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:38:44.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.794+0000 7f5f1ea00700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20110140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00b0d0 tx=0x7f5f0c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:44.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.794+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c00e070 con 0x7f5f201002a0 2024-04-03T08:38:44.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.795+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f201111c0 con 0x7f5f201002a0 2024-04-03T08:38:44.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.795+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f0c013de0 con 0x7f5f201002a0 2024-04-03T08:38:44.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.795+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f20111700 con 0x7f5f201002a0 2024-04-03T08:38:44.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.795+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c00e070 con 0x7f5f201002a0 2024-04-03T08:38:44.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.796+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2005f5f0 con 0x7f5f201002a0 2024-04-03T08:38:44.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.798+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5f0c00b680 con 0x7f5f201002a0 2024-04-03T08:38:44.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.799+0000 7f5f17400700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5f04069300 0x7f5f0406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:44.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.799+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5f0c087b20 con 0x7f5f201002a0 2024-04-03T08:38:44.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.799+0000 7f5f1f400700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5f04069300 0x7f5f0406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:44.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.800+0000 7f5f1f400700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5f04069300 0x7f5f0406b7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f100041d0 tx=0x7f5f1000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:44.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:44.802+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5f0c057920 con 0x7f5f201002a0 2024-04-03T08:38:45.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.139+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f20111b40 con 0x7f5f04069300 2024-04-03T08:38:45.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.155+0000 7f5f17400700 1 -- 172.21.15.157:0/1181341186 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f5f20111b40 con 0x7f5f04069300 2024-04-03T08:38:45.159 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:38:45.159 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (7m) 2m ago 8m 12.9M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:38:45.159 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (9m) 2m ago 9m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:38:45.159 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (7m) 2m ago 7m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (7m) 2m ago 8m 72.2M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (2m) 2m ago 2m 10.5M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (2m) 2m ago 2m 12.7M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (2m) 2m ago 2m 10.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (2m) 2m ago 2m 11.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (10m) 2m ago 10m 481M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (7m) 2m ago 7m 431M - 17.2.7-805-g6fda41ff a49113eacc58 ef09dfea7a47 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (10m) 2m ago 10m 44.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (7m) 2m ago 7m 35.3M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (9m) 2m ago 9m 7948k - 1.5.0 0da6a335fe13 2baa04300c28 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (7m) 2m ago 7m 7633k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (6m) 2m ago 6m 44.0M 4348M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (6m) 2m ago 6m 44.4M 4348M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:38:45.160 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (5m) 2m ago 5m 43.3M 4348M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (5m) 2m ago 5m 42.7M 5372M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (4m) 2m ago 4m 40.8M 5372M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (4m) 2m ago 4m 40.1M 5372M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (7m) 2m ago 8m 44.9M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.158+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5f04069300 msgr2=0x7f5f0406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.158+0000 7f5f26000700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5f04069300 0x7f5f0406b7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f100041d0 tx=0x7f5f1000b040 comp rx=0 tx=0).stop 2024-04-03T08:38:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.158+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 msgr2=0x7f5f20110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.158+0000 7f5f26000700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20110140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00b0d0 tx=0x7f5f0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.158+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 shutdown_connections 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.158+0000 7f5f26000700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f200feff0 0x7f5f2010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.159+0000 7f5f26000700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f5f04069300 0x7f5f0406b7b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.159+0000 7f5f26000700 1 --2- 172.21.15.157:0/1181341186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f201002a0 0x7f5f20110140 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.159+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 >> 172.21.15.157:0/1181341186 conn(0x7f5f200fa950 msgr2=0x7f5f200fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.159+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 shutdown_connections 2024-04-03T08:38:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.159+0000 7f5f26000700 1 -- 172.21.15.157:0/1181341186 wait complete. 2024-04-03T08:38:45.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 -- 172.21.15.157:0/771190270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 msgr2=0x7f9ab80fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 --2- 172.21.15.157:0/771190270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab80fd280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9aac004880 tx=0x7f9aac009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:45.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 -- 172.21.15.157:0/771190270 shutdown_connections 2024-04-03T08:38:45.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 --2- 172.21.15.157:0/771190270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab80fdfe0 0x7f9ab80fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 --2- 172.21.15.157:0/771190270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab80fd280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 -- 172.21.15.157:0/771190270 >> 172.21.15.157:0/771190270 conn(0x7f9ab80f8550 msgr2=0x7f9ab80fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:45.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 -- 172.21.15.157:0/771190270 shutdown_connections 2024-04-03T08:38:45.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.342+0000 7f9abf800700 1 -- 172.21.15.157:0/771190270 wait complete. 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.343+0000 7f9abf800700 1 Processor -- start 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.343+0000 7f9abf800700 1 -- start start 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.344+0000 7f9abf800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab810d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.344+0000 7f9abf800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab80fdfe0 0x7f9ab810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.344+0000 7f9abf800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab810e490 con 0x7f9ab80fdfe0 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.344+0000 7f9abf800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab810e600 con 0x7f9ab80fce70 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.344+0000 7f9abce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab810d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:45.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.344+0000 7f9abce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab810d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:47264/0 (socket says 172.21.15.157:47264) 2024-04-03T08:38:45.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.345+0000 7f9abce00700 1 -- 172.21.15.157:0/2435842708 learned_addr learned my addr 172.21.15.157:0/2435842708 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:45.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.345+0000 7f9ab7e00700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab80fdfe0 0x7f9ab810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:45.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.345+0000 7f9abce00700 1 -- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab80fdfe0 msgr2=0x7f9ab810de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.345+0000 7f9abce00700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab80fdfe0 0x7f9ab810de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.345+0000 7f9abce00700 1 -- 172.21.15.157:0/2435842708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac005040 con 0x7f9ab80fce70 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.345+0000 7f9abce00700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab810d950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9aac008cd0 tx=0x7f9aac009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.346+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aac00e030 con 0x7f9ab80fce70 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.346+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aac013e60 con 0x7f9ab80fce70 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.346+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aac0123c0 con 0x7f9ab80fce70 2024-04-03T08:38:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.346+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab8113000 con 0x7f9ab80fce70 2024-04-03T08:38:45.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.346+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81135c0 con 0x7f9ab80fce70 2024-04-03T08:38:45.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.348+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab804c710 con 0x7f9ab80fce70 2024-04-03T08:38:45.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.349+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9aac01c400 con 0x7f9ab80fce70 2024-04-03T08:38:45.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.350+0000 7f9ab4c00700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9aa00692a0 0x7f9aa006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:45.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.350+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9aac088bd0 con 0x7f9ab80fce70 2024-04-03T08:38:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.350+0000 7f9ab7e00700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9aa00692a0 0x7f9aa006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.351+0000 7f9ab7e00700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9aa00692a0 0x7f9aa006b750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40046c0 tx=0x7f9aa400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.354+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9aac058920 con 0x7f9ab80fce70 2024-04-03T08:38:45.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.740+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ab8113a70 con 0x7f9ab80fce70 2024-04-03T08:38:45.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.741+0000 7f9ab4c00700 1 -- 172.21.15.157:0/2435842708 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f9aac0584b0 con 0x7f9ab80fce70 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:45.742 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 14 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:38:45.743 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:38:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9aa00692a0 msgr2=0x7f9aa006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9aa00692a0 0x7f9aa006b750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40046c0 tx=0x7f9aa400b040 comp rx=0 tx=0).stop 2024-04-03T08:38:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 msgr2=0x7f9ab810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab810d950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9aac008cd0 tx=0x7f9aac009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 shutdown_connections 2024-04-03T08:38:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f9aa00692a0 0x7f9aa006b750 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ab80fce70 0x7f9ab810d950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 --2- 172.21.15.157:0/2435842708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab80fdfe0 0x7f9ab810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 >> 172.21.15.157:0/2435842708 conn(0x7f9ab80f8550 msgr2=0x7f9ab80f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 shutdown_connections 2024-04-03T08:38:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.745+0000 7f9abf800700 1 -- 172.21.15.157:0/2435842708 wait complete. 2024-04-03T08:38:45.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 -- 172.21.15.157:0/1963153428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 msgr2=0x7f02d4070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 --2- 172.21.15.157:0/1963153428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4070e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f02c0004940 tx=0x7f02c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 -- 172.21.15.157:0/1963153428 shutdown_connections 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 --2- 172.21.15.157:0/1963153428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4070e10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 --2- 172.21.15.157:0/1963153428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02d4071f50 0x7f02d4070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 -- 172.21.15.157:0/1963153428 >> 172.21.15.157:0/1963153428 conn(0x7f02d40f8560 msgr2=0x7f02d40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 -- 172.21.15.157:0/1963153428 shutdown_connections 2024-04-03T08:38:45.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.929+0000 7f02d8a00700 1 -- 172.21.15.157:0/1963153428 wait complete. 2024-04-03T08:38:45.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.930+0000 7f02d8a00700 1 Processor -- start 2024-04-03T08:38:45.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.930+0000 7f02d8a00700 1 -- start start 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d8a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d8a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02d4071f50 0x7f02d41144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d8a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4114ac0 con 0x7f02d40709a0 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d8a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4115310 con 0x7f02d4071f50 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39254/0 (socket says 172.21.15.157:39254) 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d1e00700 1 -- 172.21.15.157:0/4232718889 learned_addr learned my addr 172.21.15.157:0/4232718889 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:45.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.931+0000 7f02d1400700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02d4071f50 0x7f02d41144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02d1e00700 1 -- 172.21.15.157:0/4232718889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02d4071f50 msgr2=0x7f02d41144c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02d1e00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02d4071f50 0x7f02d41144c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02d1e00700 1 -- 172.21.15.157:0/4232718889 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0005040 con 0x7f02d40709a0 2024-04-03T08:38:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02d1e00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4113f80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02c400eb70 tx=0x7f02c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c4007cc0 con 0x7f02d40709a0 2024-04-03T08:38:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02c400f040 con 0x7f02d40709a0 2024-04-03T08:38:45.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c400cb50 con 0x7f02d40709a0 2024-04-03T08:38:45.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d4115590 con 0x7f02d40709a0 2024-04-03T08:38:45.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.932+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d4115ad0 con 0x7f02d40709a0 2024-04-03T08:38:45.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.934+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d405f5f0 con 0x7f02d40709a0 2024-04-03T08:38:45.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.935+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f02c400ccb0 con 0x7f02d40709a0 2024-04-03T08:38:45.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.936+0000 7f02ca000700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f02b80693c0 0x7f02b806b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:45.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.936+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f02c4086c50 con 0x7f02d40709a0 2024-04-03T08:38:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.936+0000 7f02d1400700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f02b80693c0 0x7f02b806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:45.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.937+0000 7f02d1400700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f02b80693c0 0x7f02b806b870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02c000b0d0 tx=0x7f02c0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:45.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:45.942+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f02c404e190 con 0x7f02d40709a0 2024-04-03T08:38:46.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:45 smithi181 ceph-mon[44183]: pgmap v282: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 305 op/s 2024-04-03T08:38:46.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:45 smithi181 ceph-mon[44183]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:46.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:45 smithi181 ceph-mon[44183]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:46.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:45 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:46.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:45 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2435842708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:38:46.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.306+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02d4115720 con 0x7f02d40709a0 2024-04-03T08:38:46.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.307+0000 7f02ca000700 1 -- 172.21.15.157:0/4232718889 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f02c4019750 con 0x7f02d40709a0 2024-04-03T08:38:46.307 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:38:46.307 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:38:46.307 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:38:46.307 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:38:46.307 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:38:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:38:46.309 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:46.310 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f02b80693c0 msgr2=0x7f02b806b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f02b80693c0 0x7f02b806b870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02c000b0d0 tx=0x7f02c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 msgr2=0x7f02d4113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4113f80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02c400eb70 tx=0x7f02c400b040 comp rx=0 tx=0).stop 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 shutdown_connections 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02d40709a0 0x7f02d4113f80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7f02b80693c0 0x7f02b806b870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 --2- 172.21.15.157:0/4232718889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02d4071f50 0x7f02d41144c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 >> 172.21.15.157:0/4232718889 conn(0x7f02d40f8560 msgr2=0x7f02d40f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:46.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 shutdown_connections 2024-04-03T08:38:46.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.310+0000 7f02d8a00700 1 -- 172.21.15.157:0/4232718889 wait complete. 2024-04-03T08:38:46.313 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:38:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:45 smithi157 ceph-mon[35083]: pgmap v282: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 305 op/s 2024-04-03T08:38:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:45 smithi157 ceph-mon[35083]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:45 smithi157 ceph-mon[35083]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:45 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:38:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:45 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2435842708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.495+0000 7fc346400700 1 -- 172.21.15.157:0/2409575171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc340100320 msgr2=0x7fc340100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.495+0000 7fc346400700 1 --2- 172.21.15.157:0/2409575171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc340100320 0x7fc340100790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc32c004880 tx=0x7fc32c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.496+0000 7fc346400700 1 -- 172.21.15.157:0/2409575171 shutdown_connections 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.496+0000 7fc346400700 1 --2- 172.21.15.157:0/2409575171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc340100320 0x7fc340100790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.496+0000 7fc346400700 1 --2- 172.21.15.157:0/2409575171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3400ff070 0x7fc3400ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.496+0000 7fc346400700 1 -- 172.21.15.157:0/2409575171 >> 172.21.15.157:0/2409575171 conn(0x7fc3400fab10 msgr2=0x7fc3400fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.496+0000 7fc346400700 1 -- 172.21.15.157:0/2409575171 shutdown_connections 2024-04-03T08:38:46.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.496+0000 7fc346400700 1 -- 172.21.15.157:0/2409575171 wait complete. 2024-04-03T08:38:46.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.497+0000 7fc346400700 1 Processor -- start 2024-04-03T08:38:46.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.498+0000 7fc346400700 1 -- start start 2024-04-03T08:38:46.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.498+0000 7fc346400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3400ff070 0x7fc3400727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:46.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.499+0000 7fc346400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc340100320 0x7fc340072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:46.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.499+0000 7fc33f400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3400ff070 0x7fc3400727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:46.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.499+0000 7fc33f400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3400ff070 0x7fc3400727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:47308/0 (socket says 172.21.15.157:47308) 2024-04-03T08:38:46.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.499+0000 7fc33f400700 1 -- 172.21.15.157:0/1987274161 learned_addr learned my addr 172.21.15.157:0/1987274161 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:46.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.499+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc340073340 con 0x7fc340100320 2024-04-03T08:38:46.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.499+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc340073b90 con 0x7fc3400ff070 2024-04-03T08:38:46.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.500+0000 7fc33ea00700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc340100320 0x7fc340072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:46.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.500+0000 7fc33ea00700 1 -- 172.21.15.157:0/1987274161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3400ff070 msgr2=0x7fc3400727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:46.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.500+0000 7fc33ea00700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3400ff070 0x7fc3400727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.500+0000 7fc33ea00700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c005040 con 0x7fc340100320 2024-04-03T08:38:46.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.501+0000 7fc33ea00700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc340100320 0x7fc340072cf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0138f0 tx=0x7fc32c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:46.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.501+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32c00e030 con 0x7fc340100320 2024-04-03T08:38:46.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.501+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc32c013e60 con 0x7fc340100320 2024-04-03T08:38:46.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.501+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc340073e10 con 0x7fc340100320 2024-04-03T08:38:46.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.502+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32c01ce10 con 0x7fc340100320 2024-04-03T08:38:46.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.502+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3400743d0 con 0x7fc340100320 2024-04-03T08:38:46.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.503+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34005f5f0 con 0x7fc340100320 2024-04-03T08:38:46.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.507+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc32c01c620 con 0x7fc340100320 2024-04-03T08:38:46.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.508+0000 7fc337400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc324069380 0x7fc32406b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:46.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.509+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc32c088ac0 con 0x7fc340100320 2024-04-03T08:38:46.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.509+0000 7fc33f400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc324069380 0x7fc32406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:46.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.510+0000 7fc33f400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc324069380 0x7fc32406b830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc340072540 tx=0x7fc33000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:46.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.516+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc32c08ae60 con 0x7fc340100320 2024-04-03T08:38:46.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.914+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 --> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3400746b0 con 0x7fc324069380 2024-04-03T08:38:46.917 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "", 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading mgr daemons", 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:38:46.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.916+0000 7fc337400700 1 -- 172.21.15.157:0/1987274161 <== mgr.14208 v2:172.21.15.157:6800/1088955929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc3400746b0 con 0x7fc324069380 2024-04-03T08:38:46.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc324069380 msgr2=0x7fc32406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:46.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc324069380 0x7fc32406b830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc340072540 tx=0x7fc33000b040 comp rx=0 tx=0).stop 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc340100320 msgr2=0x7fc340072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc340100320 0x7fc340072cf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0138f0 tx=0x7fc32c009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 shutdown_connections 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7fc324069380 0x7fc32406b830 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3400ff070 0x7fc3400727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 --2- 172.21.15.157:0/1987274161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc340100320 0x7fc340072cf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.920+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 >> 172.21.15.157:0/1987274161 conn(0x7fc3400fab10 msgr2=0x7fc3400fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:46.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.921+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 shutdown_connections 2024-04-03T08:38:46.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:46.921+0000 7fc346400700 1 -- 172.21.15.157:0/1987274161 wait complete. 2024-04-03T08:38:47.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.126+0000 7effdf000700 1 -- 172.21.15.157:0/241715751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 msgr2=0x7effd80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:47.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.126+0000 7effdf000700 1 --2- 172.21.15.157:0/241715751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd80fd310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7effc8004970 tx=0x7effc8009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:47.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.127+0000 7effdf000700 1 -- 172.21.15.157:0/241715751 shutdown_connections 2024-04-03T08:38:47.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.127+0000 7effdf000700 1 --2- 172.21.15.157:0/241715751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd80fe0d0 0x7effd80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:47.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.127+0000 7effdf000700 1 --2- 172.21.15.157:0/241715751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd80fd310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:47.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.127+0000 7effdf000700 1 -- 172.21.15.157:0/241715751 >> 172.21.15.157:0/241715751 conn(0x7effd80f8560 msgr2=0x7effd80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:47.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.127+0000 7effdf000700 1 -- 172.21.15.157:0/241715751 shutdown_connections 2024-04-03T08:38:47.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.127+0000 7effdf000700 1 -- 172.21.15.157:0/241715751 wait complete. 2024-04-03T08:38:47.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.128+0000 7effdf000700 1 Processor -- start 2024-04-03T08:38:47.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.128+0000 7effdf000700 1 -- start start 2024-04-03T08:38:47.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effdf000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd81036c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:47.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effdf000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd80fe0d0 0x7effd8103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:47.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effdf000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8104250 con 0x7effd80fe0d0 2024-04-03T08:38:47.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effdf000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8104a50 con 0x7effd80fcee0 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd81036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd81036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:47318/0 (socket says 172.21.15.157:47318) 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7e00700 1 -- 172.21.15.157:0/2916102850 learned_addr learned my addr 172.21.15.157:0/2916102850 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7400700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd80fe0d0 0x7effd8103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7e00700 1 -- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd80fe0d0 msgr2=0x7effd8103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7e00700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd80fe0d0 0x7effd8103c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.129+0000 7effd7e00700 1 -- 172.21.15.157:0/2916102850 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8005040 con 0x7effd80fcee0 2024-04-03T08:38:47.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.130+0000 7effd7e00700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd81036c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effc800b370 tx=0x7effc8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:47.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.131+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc800e040 con 0x7effd80fcee0 2024-04-03T08:38:47.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.131+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd8104cd0 con 0x7effd80fcee0 2024-04-03T08:38:47.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.131+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd8105290 con 0x7effd80fcee0 2024-04-03T08:38:47.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.131+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effc8013420 con 0x7effd80fcee0 2024-04-03T08:38:47.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.131+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc800e040 con 0x7effd80fcee0 2024-04-03T08:38:47.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.134+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd805f5f0 con 0x7effd80fcee0 2024-04-03T08:38:47.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.135+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7effc8025400 con 0x7effd80fcee0 2024-04-03T08:38:47.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.136+0000 7effcfe00700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7effbc0693e0 0x7effbc06b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:38:47.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.136+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7effc8088070 con 0x7effd80fcee0 2024-04-03T08:38:47.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.136+0000 7effd7400700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7effbc0693e0 0x7effbc06b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:38:47.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.137+0000 7effd7400700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7effbc0693e0 0x7effbc06b890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7effc4009b80 tx=0x7effc400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:38:47.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.143+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7effc80543a0 con 0x7effd80fcee0 2024-04-03T08:38:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:46 smithi157 ceph-mon[35083]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:46 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:46 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:46 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:38:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:46 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4232718889' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:38:47.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:46 smithi181 ceph-mon[44183]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:47.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:46 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:47.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:46 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:47.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:46 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:38:47.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:46 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/4232718889' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:38:47.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.532+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7effd804bed0 con 0x7effd80fcee0 2024-04-03T08:38:47.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.532+0000 7effcfe00700 1 -- 172.21.15.157:0/2916102850 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7effc80579c0 con 0x7effd80fcee0 2024-04-03T08:38:47.533 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7effbc0693e0 msgr2=0x7effbc06b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7effbc0693e0 0x7effbc06b890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7effc4009b80 tx=0x7effc400b040 comp rx=0 tx=0).stop 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 msgr2=0x7effd81036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd81036c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effc800b370 tx=0x7effc8009e30 comp rx=0 tx=0).stop 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 shutdown_connections 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:6800/1088955929,v1:172.21.15.157:6801/1088955929] conn(0x7effbc0693e0 0x7effbc06b890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd80fcee0 0x7effd81036c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 --2- 172.21.15.157:0/2916102850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd80fe0d0 0x7effd8103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 >> 172.21.15.157:0/2916102850 conn(0x7effd80f8560 msgr2=0x7effd80f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 shutdown_connections 2024-04-03T08:38:47.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:38:47.536+0000 7effdf000700 1 -- 172.21.15.157:0/2916102850 wait complete. 2024-04-03T08:38:48.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:47 smithi181 ceph-mon[44183]: pgmap v283: 65 pgs: 65 active+clean; 175 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2024-04-03T08:38:48.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:47 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2916102850' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:38:48.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:47 smithi157 ceph-mon[35083]: pgmap v283: 65 pgs: 65 active+clean; 175 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2024-04-03T08:38:48.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:47 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2916102850' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:38:49.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:48 smithi157 ceph-mon[35083]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:49.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:48 smithi181 ceph-mon[44183]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:38:50.246 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:49 smithi181 ceph-mon[44183]: pgmap v284: 65 pgs: 65 active+clean; 177 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 302 op/s 2024-04-03T08:38:50.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:49 smithi157 ceph-mon[35083]: pgmap v284: 65 pgs: 65 active+clean; 177 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 302 op/s 2024-04-03T08:38:51.791 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:51 smithi181 ceph-mon[44183]: pgmap v285: 65 pgs: 65 active+clean; 184 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 308 op/s 2024-04-03T08:38:51.791 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:51 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:51.791 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:51 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:51 smithi157 ceph-mon[35083]: pgmap v285: 65 pgs: 65 active+clean; 184 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 308 op/s 2024-04-03T08:38:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:51 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:51 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:53.236 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:53 smithi181 ceph-mon[44183]: pgmap v286: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2024-04-03T08:38:53.237 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:53.237 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:53 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:53 smithi157 ceph-mon[35083]: pgmap v286: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2024-04-03T08:38:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:53 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:38:53.841 INFO:tasks.workunit.client.1.smithi181.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-03T08:38:53.853 INFO:tasks.workunit.client.1.smithi181.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-03T08:38:53.854 INFO:tasks.workunit.client.1.smithi181.stderr:+ make 2024-04-03T08:38:54.505 INFO:tasks.workunit.client.1.smithi181.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-03T08:38:55.263 INFO:tasks.workunit.client.0.smithi157.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-03T08:38:55.271 INFO:tasks.workunit.client.0.smithi157.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-03T08:38:55.272 INFO:tasks.workunit.client.0.smithi157.stderr:+ make 2024-04-03T08:38:55.456 INFO:tasks.workunit.client.0.smithi157.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-03T08:38:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:55 smithi157 ceph-mon[35083]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 281 op/s 2024-04-03T08:38:55.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:55 smithi181 ceph-mon[44183]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 281 op/s 2024-04-03T08:38:55.963 INFO:tasks.workunit.client.0.smithi157.stderr:++ readlink -f fsstress 2024-04-03T08:38:55.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-03T08:38:55.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ popd 2024-04-03T08:38:55.968 INFO:tasks.workunit.client.0.smithi157.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-03T08:38:55.969 INFO:tasks.workunit.client.0.smithi157.stderr:+ popd 2024-04-03T08:38:55.970 INFO:tasks.workunit.client.0.smithi157.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-03T08:38:55.970 INFO:tasks.workunit.client.0.smithi157.stderr:++ mktemp -d -p . 2024-04-03T08:38:55.974 INFO:tasks.workunit.client.0.smithi157.stderr:+ T=./tmp.gdQsQELSAJ 2024-04-03T08:38:55.974 INFO:tasks.workunit.client.0.smithi157.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gdQsQELSAJ -l 1 -n 1000 -p 10 -v 2024-04-03T08:38:55.979 INFO:tasks.workunit.client.0.smithi157.stdout:seed = 1711530283 2024-04-03T08:38:55.985 INFO:tasks.workunit.client.0.smithi157.stdout:0/0: mkdir d0 0 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:0/1: dread - no filename 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:0/2: truncate - no filename 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:1/0: dwrite - no filename 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:1/1: dwrite - no filename 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:1/2: write - no filename 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:1/3: rename - no filename 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:1/4: unlink - no file 2024-04-03T08:38:55.986 INFO:tasks.workunit.client.0.smithi157.stdout:0/3: stat d0 0 2024-04-03T08:38:55.987 INFO:tasks.workunit.client.0.smithi157.stdout:0/4: fsync - no filename 2024-04-03T08:38:55.987 INFO:tasks.workunit.client.0.smithi157.stdout:0/5: dwrite - no filename 2024-04-03T08:38:55.987 INFO:tasks.workunit.client.0.smithi157.stdout:2/0: readlink - no filename 2024-04-03T08:38:55.988 INFO:tasks.workunit.client.0.smithi157.stdout:2/1: readlink - no filename 2024-04-03T08:38:55.988 INFO:tasks.workunit.client.0.smithi157.stdout:1/5: creat f0 x:0 0 0 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:0/6: mknod d0/c1 0 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/0: write - no filename 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/1: write - no filename 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/2: dwrite - no filename 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/3: dwrite - no filename 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/4: dwrite - no filename 2024-04-03T08:38:55.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/5: chown . 178516 1 2024-04-03T08:38:55.991 INFO:tasks.workunit.client.0.smithi157.stdout:1/6: creat f1 x:0 0 0 2024-04-03T08:38:55.993 INFO:tasks.workunit.client.0.smithi157.stdout:2/2: symlink l0 0 2024-04-03T08:38:55.993 INFO:tasks.workunit.client.0.smithi157.stdout:2/3: dwrite - no filename 2024-04-03T08:38:55.994 INFO:tasks.workunit.client.0.smithi157.stdout:0/7: unlink d0/c1 0 2024-04-03T08:38:55.996 INFO:tasks.workunit.client.0.smithi157.stdout:1/7: unlink f1 0 2024-04-03T08:38:55.997 INFO:tasks.workunit.client.0.smithi157.stdout:5/0: dwrite - no filename 2024-04-03T08:38:55.999 INFO:tasks.workunit.client.0.smithi157.stdout:2/4: unlink l0 0 2024-04-03T08:38:55.999 INFO:tasks.workunit.client.0.smithi157.stdout:2/5: dwrite - no filename 2024-04-03T08:38:56.001 INFO:tasks.workunit.client.0.smithi157.stdout:1/8: mkdir d2 0 2024-04-03T08:38:56.002 INFO:tasks.workunit.client.0.smithi157.stdout:4/0: symlink l0 0 2024-04-03T08:38:56.002 INFO:tasks.workunit.client.0.smithi157.stdout:4/1: dread - no filename 2024-04-03T08:38:56.002 INFO:tasks.workunit.client.0.smithi157.stdout:4/2: fdatasync - no filename 2024-04-03T08:38:56.002 INFO:tasks.workunit.client.0.smithi157.stdout:1/9: fdatasync f0 0 2024-04-03T08:38:56.003 INFO:tasks.workunit.client.0.smithi157.stdout:4/3: stat l0 0 2024-04-03T08:38:56.004 INFO:tasks.workunit.client.0.smithi157.stdout:6/0: rmdir - no directory 2024-04-03T08:38:56.004 INFO:tasks.workunit.client.0.smithi157.stdout:2/6: mknod c1 0 2024-04-03T08:38:56.007 INFO:tasks.workunit.client.0.smithi157.stdout:7/0: chown . 96426 1 2024-04-03T08:38:56.007 INFO:tasks.workunit.client.0.smithi157.stdout:7/1: dread - no filename 2024-04-03T08:38:56.008 INFO:tasks.workunit.client.0.smithi157.stdout:1/10: creat d2/f3 x:0 0 0 2024-04-03T08:38:56.010 INFO:tasks.workunit.client.0.smithi157.stdout:2/7: rename c1 to c2 0 2024-04-03T08:38:56.010 INFO:tasks.workunit.client.0.smithi157.stdout:2/8: fdatasync - no filename 2024-04-03T08:38:56.012 INFO:tasks.workunit.client.0.smithi157.stdout:8/0: dwrite - no filename 2024-04-03T08:38:56.012 INFO:tasks.workunit.client.0.smithi157.stdout:8/1: fdatasync - no filename 2024-04-03T08:38:56.013 INFO:tasks.workunit.client.0.smithi157.stdout:6/1: getdents . 0 2024-04-03T08:38:56.014 INFO:tasks.workunit.client.0.smithi157.stdout:1/11: mknod d2/c4 0 2024-04-03T08:38:56.014 INFO:tasks.workunit.client.0.smithi157.stdout:1/12: fdatasync d2/f3 0 2024-04-03T08:38:56.017 INFO:tasks.workunit.client.0.smithi157.stdout:1/13: write d2/f3 [338265,25826] 0 2024-04-03T08:38:56.018 INFO:tasks.workunit.client.0.smithi157.stdout:7/2: mkdir d0 0 2024-04-03T08:38:56.025 INFO:tasks.workunit.client.0.smithi157.stdout:7/3: rename d0 to d0/d1 22 2024-04-03T08:38:56.025 INFO:tasks.workunit.client.0.smithi157.stdout:7/4: truncate - no filename 2024-04-03T08:38:56.025 INFO:tasks.workunit.client.0.smithi157.stdout:6/2: symlink l0 0 2024-04-03T08:38:56.025 INFO:tasks.workunit.client.0.smithi157.stdout:6/3: write - no filename 2024-04-03T08:38:56.025 INFO:tasks.workunit.client.0.smithi157.stdout:6/4: dwrite - no filename 2024-04-03T08:38:56.025 INFO:tasks.workunit.client.0.smithi157.stdout:6/5: dread - no filename 2024-04-03T08:38:56.026 INFO:tasks.workunit.client.0.smithi157.stdout:6/6: chown l0 14218 1 2024-04-03T08:38:56.028 INFO:tasks.workunit.client.0.smithi157.stdout:1/14: dread d2/f3 [0,4194304] 0 2024-04-03T08:38:56.029 INFO:tasks.workunit.client.0.smithi157.stdout:9/0: symlink l0 0 2024-04-03T08:38:56.029 INFO:tasks.workunit.client.0.smithi157.stdout:9/1: dwrite - no filename 2024-04-03T08:38:56.030 INFO:tasks.workunit.client.0.smithi157.stdout:1/15: fsync f0 0 2024-04-03T08:38:56.031 INFO:tasks.workunit.client.0.smithi157.stdout:6/7: mkdir d1 0 2024-04-03T08:38:56.031 INFO:tasks.workunit.client.0.smithi157.stdout:6/8: dwrite - no filename 2024-04-03T08:38:56.031 INFO:tasks.workunit.client.0.smithi157.stdout:6/9: read - no filename 2024-04-03T08:38:56.033 INFO:tasks.workunit.client.0.smithi157.stdout:9/2: mkdir d1 0 2024-04-03T08:38:56.034 INFO:tasks.workunit.client.0.smithi157.stdout:7/5: creat d0/f2 x:0 0 0 2024-04-03T08:38:56.035 INFO:tasks.workunit.client.0.smithi157.stdout:7/6: dread - d0/f2 zero size 2024-04-03T08:38:56.035 INFO:tasks.workunit.client.0.smithi157.stdout:1/16: creat d2/f5 x:0 0 0 2024-04-03T08:38:56.037 INFO:tasks.workunit.client.0.smithi157.stdout:7/7: chown d0 0 1 2024-04-03T08:38:56.038 INFO:tasks.workunit.client.0.smithi157.stdout:6/10: mknod d1/c2 0 2024-04-03T08:38:56.040 INFO:tasks.workunit.client.0.smithi157.stdout:1/17: mkdir d2/d6 0 2024-04-03T08:38:56.040 INFO:tasks.workunit.client.0.smithi157.stdout:1/18: dread - f0 zero size 2024-04-03T08:38:56.042 INFO:tasks.workunit.client.0.smithi157.stdout:7/8: mknod d0/c3 0 2024-04-03T08:38:56.043 INFO:tasks.workunit.client.0.smithi157.stdout:4/4: getdents . 0 2024-04-03T08:38:56.043 INFO:tasks.workunit.client.0.smithi157.stdout:4/5: dread - no filename 2024-04-03T08:38:56.043 INFO:tasks.workunit.client.0.smithi157.stdout:4/6: dread - no filename 2024-04-03T08:38:56.044 INFO:tasks.workunit.client.0.smithi157.stdout:1/19: dread d2/f3 [0,4194304] 0 2024-04-03T08:38:56.044 INFO:tasks.workunit.client.0.smithi157.stdout:9/3: creat d1/f2 x:0 0 0 2024-04-03T08:38:56.044 INFO:tasks.workunit.client.0.smithi157.stdout:1/20: stat d2 0 2024-04-03T08:38:56.045 INFO:tasks.workunit.client.0.smithi157.stdout:6/11: creat d1/f3 x:0 0 0 2024-04-03T08:38:56.047 INFO:tasks.workunit.client.0.smithi157.stdout:0/8: rmdir d0 0 2024-04-03T08:38:56.047 INFO:tasks.workunit.client.0.smithi157.stdout:0/9: chown . 0 1 2024-04-03T08:38:56.049 INFO:tasks.workunit.client.0.smithi157.stdout:4/7: creat f1 x:0 0 0 2024-04-03T08:38:56.051 INFO:tasks.workunit.client.0.smithi157.stdout:4/8: dread - f1 zero size 2024-04-03T08:38:56.051 INFO:tasks.workunit.client.0.smithi157.stdout:6/12: symlink d1/l4 0 2024-04-03T08:38:56.053 INFO:tasks.workunit.client.0.smithi157.stdout:0/10: mkdir d2 0 2024-04-03T08:38:56.053 INFO:tasks.workunit.client.0.smithi157.stdout:0/11: dread - no filename 2024-04-03T08:38:56.054 INFO:tasks.workunit.client.0.smithi157.stdout:6/13: read - d1/f3 zero size 2024-04-03T08:38:56.055 INFO:tasks.workunit.client.0.smithi157.stdout:2/9: chown c2 523677 1 2024-04-03T08:38:56.055 INFO:tasks.workunit.client.0.smithi157.stdout:2/10: fdatasync - no filename 2024-04-03T08:38:56.055 INFO:tasks.workunit.client.0.smithi157.stdout:0/12: chown d2 16832 1 2024-04-03T08:38:56.056 INFO:tasks.workunit.client.0.smithi157.stdout:4/9: rename l0 to l2 0 2024-04-03T08:38:56.056 INFO:tasks.workunit.client.0.smithi157.stdout:6/14: chown d1 1 1 2024-04-03T08:38:56.059 INFO:tasks.workunit.client.0.smithi157.stdout:6/15: dread - d1/f3 zero size 2024-04-03T08:38:56.060 INFO:tasks.workunit.client.0.smithi157.stdout:4/10: symlink l3 0 2024-04-03T08:38:56.062 INFO:tasks.workunit.client.0.smithi157.stdout:6/16: stat l0 0 2024-04-03T08:38:56.063 INFO:tasks.workunit.client.0.smithi157.stdout:9/4: fsync d1/f2 0 2024-04-03T08:38:56.064 INFO:tasks.workunit.client.0.smithi157.stdout:0/13: creat d2/f3 x:0 0 0 2024-04-03T08:38:56.065 INFO:tasks.workunit.client.0.smithi157.stdout:4/11: creat f4 x:0 0 0 2024-04-03T08:38:56.068 INFO:tasks.workunit.client.0.smithi157.stdout:9/5: stat d1/f2 0 2024-04-03T08:38:56.070 INFO:tasks.workunit.client.0.smithi157.stdout:6/17: write d1/f3 [885216,101228] 0 2024-04-03T08:38:56.070 INFO:tasks.workunit.client.0.smithi157.stdout:0/14: write d2/f3 [759503,28432] 0 2024-04-03T08:38:56.071 INFO:tasks.workunit.client.0.smithi157.stdout:4/12: symlink l5 0 2024-04-03T08:38:56.071 INFO:tasks.workunit.client.0.smithi157.stdout:9/6: chown d1 699712 1 2024-04-03T08:38:56.073 INFO:tasks.workunit.client.0.smithi157.stdout:7/9: dwrite d0/f2 [0,4194304] 0 2024-04-03T08:38:56.074 INFO:tasks.workunit.client.0.smithi157.stdout:0/15: creat d2/f4 x:0 0 0 2024-04-03T08:38:56.075 INFO:tasks.workunit.client.0.smithi157.stdout:4/13: readlink l2 0 2024-04-03T08:38:56.075 INFO:tasks.workunit.client.0.smithi157.stdout:6/18: fdatasync d1/f3 0 2024-04-03T08:38:56.076 INFO:tasks.workunit.client.0.smithi157.stdout:4/14: dread - f4 zero size 2024-04-03T08:38:56.077 INFO:tasks.workunit.client.0.smithi157.stdout:9/7: rename d1/f2 to d1/f3 0 2024-04-03T08:38:56.078 INFO:tasks.workunit.client.0.smithi157.stdout:7/10: mkdir d0/d4 0 2024-04-03T08:38:56.078 INFO:tasks.workunit.client.0.smithi157.stdout:9/8: chown d1/f3 838960 1 2024-04-03T08:38:56.079 INFO:tasks.workunit.client.0.smithi157.stdout:0/16: rename d2/f4 to d2/f5 0 2024-04-03T08:38:56.081 INFO:tasks.workunit.client.0.smithi157.stdout:7/11: mkdir d0/d5 0 2024-04-03T08:38:56.082 INFO:tasks.workunit.client.0.smithi157.stdout:0/17: creat d2/f6 x:0 0 0 2024-04-03T08:38:56.091 INFO:tasks.workunit.client.0.smithi157.stdout:0/18: rename d2/f5 to d2/f7 0 2024-04-03T08:38:56.097 INFO:tasks.workunit.client.0.smithi157.stdout:0/19: creat d2/f8 x:0 0 0 2024-04-03T08:38:56.102 INFO:tasks.workunit.client.0.smithi157.stdout:0/20: mkdir d2/d9 0 2024-04-03T08:38:56.104 INFO:tasks.workunit.client.0.smithi157.stdout:6/19: dwrite d1/f3 [0,4194304] 0 2024-04-03T08:38:56.106 INFO:tasks.workunit.client.0.smithi157.stdout:7/12: fsync d0/f2 0 2024-04-03T08:38:56.110 INFO:tasks.workunit.client.0.smithi157.stdout:9/9: dwrite d1/f3 [0,4194304] 0 2024-04-03T08:38:56.115 INFO:tasks.workunit.client.0.smithi157.stdout:9/10: symlink d1/l4 0 2024-04-03T08:38:56.115 INFO:tasks.workunit.client.0.smithi157.stdout:7/13: symlink d0/d4/l6 0 2024-04-03T08:38:56.121 INFO:tasks.workunit.client.0.smithi157.stdout:7/14: chown d0/d5 147800661 1 2024-04-03T08:38:56.121 INFO:tasks.workunit.client.0.smithi157.stdout:9/11: write d1/f3 [300503,127863] 0 2024-04-03T08:38:56.129 INFO:tasks.workunit.client.0.smithi157.stdout:9/12: write d1/f3 [4144179,64689] 0 2024-04-03T08:38:56.134 INFO:tasks.workunit.client.0.smithi157.stdout:9/13: read d1/f3 [2341436,35060] 0 2024-04-03T08:38:56.135 INFO:tasks.workunit.client.0.smithi157.stdout:7/15: rename d0/d4/l6 to d0/l7 0 2024-04-03T08:38:56.139 INFO:tasks.workunit.client.0.smithi157.stdout:6/20: dread d1/f3 [0,4194304] 0 2024-04-03T08:38:56.140 INFO:tasks.workunit.client.0.smithi157.stdout:0/21: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:38:56.140 INFO:tasks.workunit.client.0.smithi157.stdout:9/14: creat d1/f5 x:0 0 0 2024-04-03T08:38:56.143 INFO:tasks.workunit.client.0.smithi157.stdout:6/21: mkdir d1/d5 0 2024-04-03T08:38:56.144 INFO:tasks.workunit.client.0.smithi157.stdout:9/15: symlink d1/l6 0 2024-04-03T08:38:56.144 INFO:tasks.workunit.client.0.smithi157.stdout:0/22: truncate d2/f7 296007 0 2024-04-03T08:38:56.147 INFO:tasks.workunit.client.0.smithi157.stdout:0/23: write d2/f3 [313164,12284] 0 2024-04-03T08:38:56.149 INFO:tasks.workunit.client.0.smithi157.stdout:0/24: fsync d2/f8 0 2024-04-03T08:38:56.150 INFO:tasks.workunit.client.0.smithi157.stdout:9/16: write d1/f3 [3056556,112015] 0 2024-04-03T08:38:56.152 INFO:tasks.workunit.client.0.smithi157.stdout:6/22: rmdir d1 39 2024-04-03T08:38:56.155 INFO:tasks.workunit.client.0.smithi157.stdout:0/25: dread d2/f7 [0,4194304] 0 2024-04-03T08:38:56.158 INFO:tasks.workunit.client.0.smithi157.stdout:7/16: link d0/l7 d0/d4/l8 0 2024-04-03T08:38:56.159 INFO:tasks.workunit.client.0.smithi157.stdout:7/17: stat d0/f2 0 2024-04-03T08:38:56.159 INFO:tasks.workunit.client.0.smithi157.stdout:0/26: creat d2/fa x:0 0 0 2024-04-03T08:38:56.161 INFO:tasks.workunit.client.0.smithi157.stdout:6/23: mknod d1/d5/c6 0 2024-04-03T08:38:56.164 INFO:tasks.workunit.client.0.smithi157.stdout:0/27: symlink d2/d9/lb 0 2024-04-03T08:38:56.165 INFO:tasks.workunit.client.0.smithi157.stdout:6/24: creat d1/d5/f7 x:0 0 0 2024-04-03T08:38:56.167 INFO:tasks.workunit.client.0.smithi157.stdout:7/18: link d0/c3 d0/d5/c9 0 2024-04-03T08:38:56.168 INFO:tasks.workunit.client.0.smithi157.stdout:0/28: dread d2/f7 [0,4194304] 0 2024-04-03T08:38:56.170 INFO:tasks.workunit.client.0.smithi157.stdout:6/25: unlink d1/d5/c6 0 2024-04-03T08:38:56.171 INFO:tasks.workunit.client.0.smithi157.stdout:7/19: symlink d0/la 0 2024-04-03T08:38:56.175 INFO:tasks.workunit.client.0.smithi157.stdout:7/20: symlink d0/d4/lb 0 2024-04-03T08:38:56.183 INFO:tasks.workunit.client.0.smithi157.stdout:9/17: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:38:56.185 INFO:tasks.workunit.client.0.smithi157.stdout:7/21: link d0/c3 d0/cc 0 2024-04-03T08:38:56.190 INFO:tasks.workunit.client.0.smithi157.stdout:7/22: write d0/f2 [1562659,26178] 0 2024-04-03T08:38:56.193 INFO:tasks.workunit.client.0.smithi157.stdout:6/26: dread d1/f3 [0,4194304] 0 2024-04-03T08:38:56.199 INFO:tasks.workunit.client.0.smithi157.stdout:6/27: mknod d1/c8 0 2024-04-03T08:38:56.201 INFO:tasks.workunit.client.0.smithi157.stdout:6/28: stat d1/l4 0 2024-04-03T08:38:56.202 INFO:tasks.workunit.client.0.smithi157.stdout:0/29: dwrite d2/f8 [0,4194304] 0 2024-04-03T08:38:56.207 INFO:tasks.workunit.client.0.smithi157.stdout:6/29: rename d1/l4 to d1/l9 0 2024-04-03T08:38:56.207 INFO:tasks.workunit.client.0.smithi157.stdout:9/18: dread d1/f5 [0,4194304] 0 2024-04-03T08:38:56.209 INFO:tasks.workunit.client.0.smithi157.stdout:6/30: chown d1/f3 71843898 1 2024-04-03T08:38:56.213 INFO:tasks.workunit.client.0.smithi157.stdout:0/30: getdents d2/d9 0 2024-04-03T08:38:56.214 INFO:tasks.workunit.client.0.smithi157.stdout:6/31: chown d1/c8 19546 1 2024-04-03T08:38:56.214 INFO:tasks.workunit.client.0.smithi157.stdout:6/32: stat l0 0 2024-04-03T08:38:56.216 INFO:tasks.workunit.client.0.smithi157.stdout:0/31: read d2/f7 [188385,55208] 0 2024-04-03T08:38:56.216 INFO:tasks.workunit.client.0.smithi157.stdout:7/23: dwrite d0/f2 [0,4194304] 0 2024-04-03T08:38:56.223 INFO:tasks.workunit.client.0.smithi157.stdout:9/19: truncate d1/f5 1572509 0 2024-04-03T08:38:56.228 INFO:tasks.workunit.client.0.smithi157.stdout:9/20: symlink d1/l7 0 2024-04-03T08:38:56.229 INFO:tasks.workunit.client.0.smithi157.stdout:9/21: fdatasync d1/f3 0 2024-04-03T08:38:56.230 INFO:tasks.workunit.client.0.smithi157.stdout:6/33: link d1/l9 d1/d5/la 0 2024-04-03T08:38:56.233 INFO:tasks.workunit.client.0.smithi157.stdout:6/34: chown d1/c2 987 1 2024-04-03T08:38:56.233 INFO:tasks.workunit.client.0.smithi157.stdout:9/22: write d1/f3 [2783074,6604] 0 2024-04-03T08:38:56.239 INFO:tasks.workunit.client.0.smithi157.stdout:6/35: write d1/f3 [2137696,125194] 0 2024-04-03T08:38:56.241 INFO:tasks.workunit.client.0.smithi157.stdout:7/24: dread d0/f2 [0,4194304] 0 2024-04-03T08:38:56.243 INFO:tasks.workunit.client.0.smithi157.stdout:0/32: dwrite d2/f8 [4194304,4194304] 0 2024-04-03T08:38:56.246 INFO:tasks.workunit.client.0.smithi157.stdout:6/36: creat d1/fb x:0 0 0 2024-04-03T08:38:56.247 INFO:tasks.workunit.client.0.smithi157.stdout:7/25: creat d0/d4/fd x:0 0 0 2024-04-03T08:38:56.247 INFO:tasks.workunit.client.0.smithi157.stdout:0/33: mkdir d2/d9/dc 0 2024-04-03T08:38:56.250 INFO:tasks.workunit.client.0.smithi157.stdout:6/37: creat d1/fc x:0 0 0 2024-04-03T08:38:56.250 INFO:tasks.workunit.client.0.smithi157.stdout:0/34: write d2/fa [386159,13126] 0 2024-04-03T08:38:56.250 INFO:tasks.workunit.client.0.smithi157.stdout:7/26: mknod d0/d4/ce 0 2024-04-03T08:38:56.251 INFO:tasks.workunit.client.0.smithi157.stdout:6/38: dread - d1/d5/f7 zero size 2024-04-03T08:38:56.253 INFO:tasks.workunit.client.0.smithi157.stdout:7/27: creat d0/d4/ff x:0 0 0 2024-04-03T08:38:56.253 INFO:tasks.workunit.client.0.smithi157.stdout:6/39: chown d1/c8 65 1 2024-04-03T08:38:56.253 INFO:tasks.workunit.client.0.smithi157.stdout:7/28: chown d0/d5 102640813 1 2024-04-03T08:38:56.256 INFO:tasks.workunit.client.0.smithi157.stdout:7/29: chown d0/l7 114 1 2024-04-03T08:38:56.257 INFO:tasks.workunit.client.0.smithi157.stdout:6/40: symlink d1/ld 0 2024-04-03T08:38:56.260 INFO:tasks.workunit.client.0.smithi157.stdout:6/41: mkdir d1/d5/de 0 2024-04-03T08:38:56.262 INFO:tasks.workunit.client.0.smithi157.stdout:6/42: creat d1/ff x:0 0 0 2024-04-03T08:38:56.266 INFO:tasks.workunit.client.0.smithi157.stdout:6/43: rename d1/d5/de to d1/d5/d10 0 2024-04-03T08:38:56.268 INFO:tasks.workunit.client.0.smithi157.stdout:6/44: mknod d1/c11 0 2024-04-03T08:38:56.270 INFO:tasks.workunit.client.0.smithi157.stdout:6/45: write d1/f3 [3542171,65362] 0 2024-04-03T08:38:56.273 INFO:tasks.workunit.client.0.smithi157.stdout:6/46: link d1/fc d1/d5/f12 0 2024-04-03T08:38:56.275 INFO:tasks.workunit.client.0.smithi157.stdout:6/47: write d1/fc [935049,27713] 0 2024-04-03T08:38:56.291 INFO:tasks.workunit.client.0.smithi157.stdout:6/48: dwrite d1/f3 [4194304,4194304] 0 2024-04-03T08:38:56.294 INFO:tasks.workunit.client.0.smithi157.stdout:6/49: chown d1/l9 3903 1 2024-04-03T08:38:56.367 INFO:tasks.workunit.client.0.smithi157.stdout:7/30: fdatasync d0/f2 0 2024-04-03T08:38:56.369 INFO:tasks.workunit.client.0.smithi157.stdout:9/23: dread d1/f5 [0,4194304] 0 2024-04-03T08:38:56.370 INFO:tasks.workunit.client.0.smithi157.stdout:9/24: chown d1 366770677 1 2024-04-03T08:38:56.374 INFO:tasks.workunit.client.0.smithi157.stdout:9/25: symlink d1/l8 0 2024-04-03T08:38:56.377 INFO:tasks.workunit.client.0.smithi157.stdout:7/31: dread d0/f2 [0,4194304] 0 2024-04-03T08:38:56.377 INFO:tasks.workunit.client.0.smithi157.stdout:0/35: truncate d2/f3 359264 0 2024-04-03T08:38:56.378 INFO:tasks.workunit.client.0.smithi157.stdout:0/36: readlink d2/d9/lb 0 2024-04-03T08:38:56.384 INFO:tasks.workunit.client.0.smithi157.stdout:7/32: creat d0/d4/f10 x:0 0 0 2024-04-03T08:38:56.389 INFO:tasks.workunit.client.0.smithi157.stdout:6/50: rmdir d1/d5 39 2024-04-03T08:38:56.391 INFO:tasks.workunit.client.0.smithi157.stdout:7/33: mkdir d0/d11 0 2024-04-03T08:38:56.392 INFO:tasks.workunit.client.0.smithi157.stdout:7/34: readlink d0/d4/lb 0 2024-04-03T08:38:56.393 INFO:tasks.workunit.client.0.smithi157.stdout:7/35: dread - d0/d4/f10 zero size 2024-04-03T08:38:56.402 INFO:tasks.workunit.client.0.smithi157.stdout:6/51: getdents d1 0 2024-04-03T08:38:56.412 INFO:tasks.workunit.client.0.smithi157.stdout:7/36: dwrite d0/d4/ff [0,4194304] 0 2024-04-03T08:38:56.421 INFO:tasks.workunit.client.0.smithi157.stdout:7/37: symlink d0/d11/l12 0 2024-04-03T08:38:56.472 INFO:tasks.workunit.client.0.smithi157.stdout:9/26: write d1/f5 [1531896,35167] 0 2024-04-03T08:38:56.475 INFO:tasks.workunit.client.0.smithi157.stdout:9/27: rename d1/l6 to d1/l9 0 2024-04-03T08:38:56.499 INFO:tasks.workunit.client.0.smithi157.stdout:9/28: rmdir d1 39 2024-04-03T08:38:56.516 INFO:tasks.workunit.client.0.smithi157.stdout:0/37: write d2/f3 [1047986,97628] 0 2024-04-03T08:38:56.517 INFO:tasks.workunit.client.0.smithi157.stdout:9/29: write d1/f3 [4170887,51388] 0 2024-04-03T08:38:56.519 INFO:tasks.workunit.client.0.smithi157.stdout:9/30: write d1/f3 [945587,108741] 0 2024-04-03T08:38:56.538 INFO:tasks.workunit.client.0.smithi157.stdout:9/31: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:38:56.539 INFO:tasks.workunit.client.0.smithi157.stdout:9/32: chown d1/l8 5537 1 2024-04-03T08:38:56.668 INFO:tasks.workunit.client.0.smithi157.stdout:9/33: truncate d1/f3 1495912 0 2024-04-03T08:38:56.676 INFO:tasks.workunit.client.0.smithi157.stdout:9/34: link d1/f3 d1/fa 0 2024-04-03T08:38:56.678 INFO:tasks.workunit.client.0.smithi157.stdout:9/35: creat d1/fb x:0 0 0 2024-04-03T08:38:57.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: pgmap v288: 65 pgs: 65 active+clean; 213 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 328 op/s 2024-04-03T08:38:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq restarted 2024-04-03T08:38:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:38:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:38:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:38:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:38:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:57 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: pgmap v288: 65 pgs: 65 active+clean; 213 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 328 op/s 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: Standby manager daemon smithi181.mfhidq restarted 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:38:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:57 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:38:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:58 smithi157 ceph-mon[35083]: mgrmap e20: smithi157.qfvynr(active, since 8m), standbys: smithi181.mfhidq 2024-04-03T08:38:58.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:58 smithi181 ceph-mon[44183]: mgrmap e20: smithi157.qfvynr(active, since 8m), standbys: smithi181.mfhidq 2024-04-03T08:38:59.312 INFO:tasks.workunit.client.1.smithi181.stderr:++ readlink -f fsstress 2024-04-03T08:38:59.316 INFO:tasks.workunit.client.1.smithi181.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-03T08:38:59.316 INFO:tasks.workunit.client.1.smithi181.stderr:+ popd 2024-04-03T08:38:59.319 INFO:tasks.workunit.client.1.smithi181.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-03T08:38:59.319 INFO:tasks.workunit.client.1.smithi181.stderr:+ popd 2024-04-03T08:38:59.321 INFO:tasks.workunit.client.1.smithi181.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-03T08:38:59.322 INFO:tasks.workunit.client.1.smithi181.stderr:++ mktemp -d -p . 2024-04-03T08:38:59.326 INFO:tasks.workunit.client.1.smithi181.stderr:+ T=./tmp.xoIbm6sGkM 2024-04-03T08:38:59.326 INFO:tasks.workunit.client.1.smithi181.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.xoIbm6sGkM -l 1 -n 1000 -p 10 -v 2024-04-03T08:38:59.332 INFO:tasks.workunit.client.1.smithi181.stdout:seed = 1711801028 2024-04-03T08:38:59.340 INFO:tasks.workunit.client.1.smithi181.stdout:1/0: write - no filename 2024-04-03T08:38:59.340 INFO:tasks.workunit.client.1.smithi181.stdout:1/1: chown . 12835692 1 2024-04-03T08:38:59.340 INFO:tasks.workunit.client.1.smithi181.stdout:1/2: stat - no entries 2024-04-03T08:38:59.341 INFO:tasks.workunit.client.1.smithi181.stdout:0/0: creat f0 x:0 0 0 2024-04-03T08:38:59.342 INFO:tasks.workunit.client.1.smithi181.stdout:0/1: write f0 [847458,79391] 0 2024-04-03T08:38:59.344 INFO:tasks.workunit.client.1.smithi181.stdout:1/3: creat f0 x:0 0 0 2024-04-03T08:38:59.345 INFO:tasks.workunit.client.1.smithi181.stdout:3/0: rename - no filename 2024-04-03T08:38:59.345 INFO:tasks.workunit.client.1.smithi181.stdout:3/1: dwrite - no filename 2024-04-03T08:38:59.345 INFO:tasks.workunit.client.1.smithi181.stdout:3/2: write - no filename 2024-04-03T08:38:59.346 INFO:tasks.workunit.client.1.smithi181.stdout:3/3: dread - no filename 2024-04-03T08:38:59.347 INFO:tasks.workunit.client.1.smithi181.stdout:1/4: creat f1 x:0 0 0 2024-04-03T08:38:59.349 INFO:tasks.workunit.client.1.smithi181.stdout:2/0: creat f0 x:0 0 0 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/4: getdents . 0 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/5: dread - no filename 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/6: link - no file 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/7: read - no filename 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:1/5: rename f1 to f2 0 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/8: unlink - no file 2024-04-03T08:38:59.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/9: dwrite - no filename 2024-04-03T08:38:59.353 INFO:tasks.workunit.client.1.smithi181.stdout:5/0: dwrite - no filename 2024-04-03T08:38:59.353 INFO:tasks.workunit.client.1.smithi181.stdout:5/1: rename - no filename 2024-04-03T08:38:59.354 INFO:tasks.workunit.client.1.smithi181.stdout:5/2: write - no filename 2024-04-03T08:38:59.354 INFO:tasks.workunit.client.1.smithi181.stdout:2/1: symlink l1 0 2024-04-03T08:38:59.355 INFO:tasks.workunit.client.1.smithi181.stdout:2/2: dread - f0 zero size 2024-04-03T08:38:59.355 INFO:tasks.workunit.client.1.smithi181.stdout:4/0: creat f0 x:0 0 0 2024-04-03T08:38:59.356 INFO:tasks.workunit.client.1.smithi181.stdout:4/1: fdatasync f0 0 2024-04-03T08:38:59.358 INFO:tasks.workunit.client.1.smithi181.stdout:5/3: mknod c0 0 2024-04-03T08:38:59.360 INFO:tasks.workunit.client.1.smithi181.stdout:7/0: rename - no filename 2024-04-03T08:38:59.360 INFO:tasks.workunit.client.1.smithi181.stdout:7/1: read - no filename 2024-04-03T08:38:59.361 INFO:tasks.workunit.client.1.smithi181.stdout:2/3: link f0 f2 0 2024-04-03T08:38:59.363 INFO:tasks.workunit.client.1.smithi181.stdout:5/4: creat f1 x:0 0 0 2024-04-03T08:38:59.365 INFO:tasks.workunit.client.1.smithi181.stdout:5/5: chown f1 167867557 1 2024-04-03T08:38:59.366 INFO:tasks.workunit.client.1.smithi181.stdout:6/0: symlink l0 0 2024-04-03T08:38:59.366 INFO:tasks.workunit.client.1.smithi181.stdout:6/1: dread - no filename 2024-04-03T08:38:59.366 INFO:tasks.workunit.client.1.smithi181.stdout:6/2: write - no filename 2024-04-03T08:38:59.366 INFO:tasks.workunit.client.1.smithi181.stdout:8/0: chown . 142590 1 2024-04-03T08:38:59.367 INFO:tasks.workunit.client.1.smithi181.stdout:8/1: rmdir - no directory 2024-04-03T08:38:59.367 INFO:tasks.workunit.client.1.smithi181.stdout:8/2: dread - no filename 2024-04-03T08:38:59.367 INFO:tasks.workunit.client.1.smithi181.stdout:8/3: dread - no filename 2024-04-03T08:38:59.369 INFO:tasks.workunit.client.1.smithi181.stdout:7/2: mkdir d0 0 2024-04-03T08:38:59.369 INFO:tasks.workunit.client.1.smithi181.stdout:7/3: link - no file 2024-04-03T08:38:59.369 INFO:tasks.workunit.client.1.smithi181.stdout:7/4: dread - no filename 2024-04-03T08:38:59.369 INFO:tasks.workunit.client.1.smithi181.stdout:7/5: read - no filename 2024-04-03T08:38:59.370 INFO:tasks.workunit.client.1.smithi181.stdout:6/3: readlink l0 0 2024-04-03T08:38:59.370 INFO:tasks.workunit.client.1.smithi181.stdout:6/4: dread - no filename 2024-04-03T08:38:59.373 INFO:tasks.workunit.client.1.smithi181.stdout:6/5: stat l0 0 2024-04-03T08:38:59.373 INFO:tasks.workunit.client.1.smithi181.stdout:6/6: dread - no filename 2024-04-03T08:38:59.373 INFO:tasks.workunit.client.1.smithi181.stdout:8/4: symlink l0 0 2024-04-03T08:38:59.373 INFO:tasks.workunit.client.1.smithi181.stdout:8/5: dwrite - no filename 2024-04-03T08:38:59.375 INFO:tasks.workunit.client.1.smithi181.stdout:5/6: link c0 c2 0 2024-04-03T08:38:59.393 INFO:tasks.workunit.client.1.smithi181.stdout:6/7: creat f1 x:0 0 0 2024-04-03T08:38:59.396 INFO:tasks.workunit.client.1.smithi181.stdout:9/0: creat f0 x:0 0 0 2024-04-03T08:38:59.397 INFO:tasks.workunit.client.1.smithi181.stdout:5/7: mknod c3 0 2024-04-03T08:38:59.398 INFO:tasks.workunit.client.1.smithi181.stdout:8/6: rename l0 to l1 0 2024-04-03T08:38:59.398 INFO:tasks.workunit.client.1.smithi181.stdout:8/7: dread - no filename 2024-04-03T08:38:59.398 INFO:tasks.workunit.client.1.smithi181.stdout:8/8: dwrite - no filename 2024-04-03T08:38:59.398 INFO:tasks.workunit.client.1.smithi181.stdout:8/9: rmdir - no directory 2024-04-03T08:38:59.405 INFO:tasks.workunit.client.1.smithi181.stdout:4/2: dwrite f0 [0,4194304] 0 2024-04-03T08:38:59.413 INFO:tasks.workunit.client.1.smithi181.stdout:2/4: dwrite f2 [0,4194304] 0 2024-04-03T08:38:59.439 INFO:tasks.workunit.client.1.smithi181.stdout:2/5: dwrite f2 [0,4194304] 0 2024-04-03T08:38:59.467 INFO:tasks.workunit.client.1.smithi181.stdout:6/8: unlink l0 0 2024-04-03T08:38:59.467 INFO:tasks.workunit.client.1.smithi181.stdout:6/9: readlink - no filename 2024-04-03T08:38:59.468 INFO:tasks.workunit.client.1.smithi181.stdout:5/8: mkdir d4 0 2024-04-03T08:38:59.468 INFO:tasks.workunit.client.1.smithi181.stdout:6/10: write f1 [98972,29620] 0 2024-04-03T08:38:59.470 INFO:tasks.workunit.client.1.smithi181.stdout:5/9: write f1 [161797,33346] 0 2024-04-03T08:38:59.470 INFO:tasks.workunit.client.1.smithi181.stdout:9/1: unlink f0 0 2024-04-03T08:38:59.472 INFO:tasks.workunit.client.1.smithi181.stdout:4/3: mkdir d1 0 2024-04-03T08:38:59.472 INFO:tasks.workunit.client.1.smithi181.stdout:4/4: readlink - no filename 2024-04-03T08:38:59.476 INFO:tasks.workunit.client.1.smithi181.stdout:6/11: mknod c2 0 2024-04-03T08:38:59.478 INFO:tasks.workunit.client.1.smithi181.stdout:9/2: mkdir d1 0 2024-04-03T08:38:59.478 INFO:tasks.workunit.client.1.smithi181.stdout:9/3: link - no file 2024-04-03T08:38:59.480 INFO:tasks.workunit.client.1.smithi181.stdout:9/4: rename d1 to d1/d2 22 2024-04-03T08:38:59.480 INFO:tasks.workunit.client.1.smithi181.stdout:9/5: truncate - no filename 2024-04-03T08:38:59.480 INFO:tasks.workunit.client.1.smithi181.stdout:5/10: creat d4/f5 x:0 0 0 2024-04-03T08:38:59.480 INFO:tasks.workunit.client.1.smithi181.stdout:6/12: mknod c3 0 2024-04-03T08:38:59.481 INFO:tasks.workunit.client.1.smithi181.stdout:4/5: mknod d1/c2 0 2024-04-03T08:38:59.483 INFO:tasks.workunit.client.1.smithi181.stdout:4/6: write f0 [2561803,47004] 0 2024-04-03T08:38:59.486 INFO:tasks.workunit.client.1.smithi181.stdout:9/6: symlink d1/l3 0 2024-04-03T08:38:59.487 INFO:tasks.workunit.client.1.smithi181.stdout:4/7: symlink d1/l3 0 2024-04-03T08:38:59.488 INFO:tasks.workunit.client.1.smithi181.stdout:6/13: link c2 c4 0 2024-04-03T08:38:59.489 INFO:tasks.workunit.client.1.smithi181.stdout:9/7: mknod d1/c4 0 2024-04-03T08:38:59.489 INFO:tasks.workunit.client.1.smithi181.stdout:9/8: truncate - no filename 2024-04-03T08:38:59.489 INFO:tasks.workunit.client.1.smithi181.stdout:9/9: fdatasync - no filename 2024-04-03T08:38:59.490 INFO:tasks.workunit.client.1.smithi181.stdout:6/14: symlink l5 0 2024-04-03T08:38:59.494 INFO:tasks.workunit.client.1.smithi181.stdout:9/10: creat d1/f5 x:0 0 0 2024-04-03T08:38:59.494 INFO:tasks.workunit.client.1.smithi181.stdout:6/15: mkdir d6 0 2024-04-03T08:38:59.496 INFO:tasks.workunit.client.1.smithi181.stdout:6/16: truncate f1 577074 0 2024-04-03T08:38:59.497 INFO:tasks.workunit.client.1.smithi181.stdout:5/11: dwrite f1 [0,4194304] 0 2024-04-03T08:38:59.499 INFO:tasks.workunit.client.1.smithi181.stdout:5/12: write d4/f5 [813833,21176] 0 2024-04-03T08:38:59.500 INFO:tasks.workunit.client.1.smithi181.stdout:6/17: chown c2 511 1 2024-04-03T08:38:59.502 INFO:tasks.workunit.client.1.smithi181.stdout:4/8: dread f0 [0,4194304] 0 2024-04-03T08:38:59.503 INFO:tasks.workunit.client.1.smithi181.stdout:6/18: unlink f1 0 2024-04-03T08:38:59.504 INFO:tasks.workunit.client.1.smithi181.stdout:6/19: write - no filename 2024-04-03T08:38:59.504 INFO:tasks.workunit.client.1.smithi181.stdout:6/20: read - no filename 2024-04-03T08:38:59.510 INFO:tasks.workunit.client.1.smithi181.stdout:4/9: link d1/l3 d1/l4 0 2024-04-03T08:38:59.513 INFO:tasks.workunit.client.1.smithi181.stdout:5/13: dread f1 [0,4194304] 0 2024-04-03T08:38:59.518 INFO:tasks.workunit.client.1.smithi181.stdout:5/14: rename c2 to d4/c6 0 2024-04-03T08:38:59.521 INFO:tasks.workunit.client.1.smithi181.stdout:5/15: creat d4/f7 x:0 0 0 2024-04-03T08:38:59.524 INFO:tasks.workunit.client.1.smithi181.stdout:5/16: rename d4/f7 to d4/f8 0 2024-04-03T08:38:59.527 INFO:tasks.workunit.client.1.smithi181.stdout:5/17: rename c0 to d4/c9 0 2024-04-03T08:38:59.529 INFO:tasks.workunit.client.1.smithi181.stdout:5/18: mknod d4/ca 0 2024-04-03T08:38:59.544 INFO:tasks.workunit.client.1.smithi181.stdout:5/19: dwrite f1 [0,4194304] 0 2024-04-03T08:38:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:38:59 smithi157 ceph-mon[35083]: pgmap v289: 65 pgs: 65 active+clean; 227 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 294 op/s 2024-04-03T08:38:59.567 INFO:tasks.workunit.client.1.smithi181.stdout:5/20: dwrite d4/f8 [0,4194304] 0 2024-04-03T08:38:59.585 INFO:tasks.workunit.client.1.smithi181.stdout:5/21: dwrite f1 [0,4194304] 0 2024-04-03T08:38:59.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:38:59 smithi181 ceph-mon[44183]: pgmap v289: 65 pgs: 65 active+clean; 227 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 294 op/s 2024-04-03T08:38:59.598 INFO:tasks.workunit.client.1.smithi181.stdout:0/2: getdents . 0 2024-04-03T08:38:59.602 INFO:tasks.workunit.client.1.smithi181.stdout:0/3: rename f0 to f1 0 2024-04-03T08:38:59.606 INFO:tasks.workunit.client.1.smithi181.stdout:1/6: getdents . 0 2024-04-03T08:38:59.609 INFO:tasks.workunit.client.1.smithi181.stdout:0/4: creat f2 x:0 0 0 2024-04-03T08:38:59.609 INFO:tasks.workunit.client.1.smithi181.stdout:0/5: stat f2 0 2024-04-03T08:38:59.610 INFO:tasks.workunit.client.1.smithi181.stdout:1/7: fsync f2 0 2024-04-03T08:38:59.610 INFO:tasks.workunit.client.1.smithi181.stdout:0/6: chown f1 162008650 1 2024-04-03T08:38:59.612 INFO:tasks.workunit.client.1.smithi181.stdout:2/6: fsync f0 0 2024-04-03T08:38:59.613 INFO:tasks.workunit.client.1.smithi181.stdout:1/8: mknod c3 0 2024-04-03T08:38:59.615 INFO:tasks.workunit.client.1.smithi181.stdout:0/7: write f1 [918071,66671] 0 2024-04-03T08:38:59.616 INFO:tasks.workunit.client.1.smithi181.stdout:2/7: creat f3 x:0 0 0 2024-04-03T08:38:59.618 INFO:tasks.workunit.client.1.smithi181.stdout:1/9: creat f4 x:0 0 0 2024-04-03T08:38:59.620 INFO:tasks.workunit.client.1.smithi181.stdout:0/8: creat f3 x:0 0 0 2024-04-03T08:38:59.621 INFO:tasks.workunit.client.1.smithi181.stdout:0/9: write f3 [350174,25321] 0 2024-04-03T08:38:59.621 INFO:tasks.workunit.client.1.smithi181.stdout:2/8: symlink l4 0 2024-04-03T08:38:59.622 INFO:tasks.workunit.client.1.smithi181.stdout:0/10: dread - f2 zero size 2024-04-03T08:38:59.625 INFO:tasks.workunit.client.1.smithi181.stdout:2/9: mknod c5 0 2024-04-03T08:38:59.627 INFO:tasks.workunit.client.1.smithi181.stdout:8/10: unlink l1 0 2024-04-03T08:38:59.628 INFO:tasks.workunit.client.1.smithi181.stdout:2/10: write f2 [3530360,106634] 0 2024-04-03T08:38:59.634 INFO:tasks.workunit.client.1.smithi181.stdout:8/11: mknod c2 0 2024-04-03T08:38:59.635 INFO:tasks.workunit.client.1.smithi181.stdout:4/10: dwrite f0 [4194304,4194304] 0 2024-04-03T08:38:59.640 INFO:tasks.workunit.client.1.smithi181.stdout:8/12: creat f3 x:0 0 0 2024-04-03T08:38:59.642 INFO:tasks.workunit.client.1.smithi181.stdout:8/13: fdatasync f3 0 2024-04-03T08:38:59.643 INFO:tasks.workunit.client.1.smithi181.stdout:4/11: rename d1/l3 to d1/l5 0 2024-04-03T08:38:59.652 INFO:tasks.workunit.client.1.smithi181.stdout:4/12: symlink d1/l6 0 2024-04-03T08:38:59.655 INFO:tasks.workunit.client.1.smithi181.stdout:2/11: dwrite f3 [0,4194304] 0 2024-04-03T08:38:59.657 INFO:tasks.workunit.client.1.smithi181.stdout:2/12: stat f2 0 2024-04-03T08:38:59.659 INFO:tasks.workunit.client.1.smithi181.stdout:4/13: creat d1/f7 x:0 0 0 2024-04-03T08:38:59.662 INFO:tasks.workunit.client.1.smithi181.stdout:4/14: fdatasync d1/f7 0 2024-04-03T08:38:59.667 INFO:tasks.workunit.client.1.smithi181.stdout:4/15: write f0 [4050971,18598] 0 2024-04-03T08:38:59.669 INFO:tasks.workunit.client.1.smithi181.stdout:4/16: stat f0 0 2024-04-03T08:38:59.676 INFO:tasks.workunit.client.1.smithi181.stdout:8/14: dwrite f3 [0,4194304] 0 2024-04-03T08:38:59.677 INFO:tasks.workunit.client.1.smithi181.stdout:8/15: chown f3 1 1 2024-04-03T08:38:59.677 INFO:tasks.workunit.client.1.smithi181.stdout:4/17: rename f0 to d1/f8 0 2024-04-03T08:38:59.678 INFO:tasks.workunit.client.1.smithi181.stdout:8/16: write f3 [3386728,6996] 0 2024-04-03T08:38:59.697 INFO:tasks.workunit.client.1.smithi181.stdout:8/17: fdatasync f3 0 2024-04-03T08:38:59.744 INFO:tasks.workunit.client.1.smithi181.stdout:9/11: fsync d1/f5 0 2024-04-03T08:38:59.747 INFO:tasks.workunit.client.1.smithi181.stdout:9/12: creat d1/f6 x:0 0 0 2024-04-03T08:38:59.751 INFO:tasks.workunit.client.1.smithi181.stdout:9/13: creat d1/f7 x:0 0 0 2024-04-03T08:38:59.756 INFO:tasks.workunit.client.1.smithi181.stdout:9/14: creat d1/f8 x:0 0 0 2024-04-03T08:38:59.760 INFO:tasks.workunit.client.1.smithi181.stdout:9/15: mknod d1/c9 0 2024-04-03T08:38:59.761 INFO:tasks.workunit.client.1.smithi181.stdout:9/16: chown d1/f8 4843449 1 2024-04-03T08:38:59.762 INFO:tasks.workunit.client.1.smithi181.stdout:9/17: fdatasync d1/f8 0 2024-04-03T08:38:59.762 INFO:tasks.workunit.client.1.smithi181.stdout:9/18: readlink d1/l3 0 2024-04-03T08:38:59.767 INFO:tasks.workunit.client.1.smithi181.stdout:9/19: mkdir d1/da 0 2024-04-03T08:38:59.775 INFO:tasks.workunit.client.1.smithi181.stdout:9/20: creat d1/da/fb x:0 0 0 2024-04-03T08:38:59.778 INFO:tasks.workunit.client.1.smithi181.stdout:9/21: mknod d1/cc 0 2024-04-03T08:38:59.782 INFO:tasks.workunit.client.1.smithi181.stdout:9/22: mknod d1/da/cd 0 2024-04-03T08:38:59.784 INFO:tasks.workunit.client.1.smithi181.stdout:9/23: write d1/f5 [217051,106021] 0 2024-04-03T08:38:59.788 INFO:tasks.workunit.client.1.smithi181.stdout:9/24: mknod d1/da/ce 0 2024-04-03T08:38:59.793 INFO:tasks.workunit.client.1.smithi181.stdout:9/25: unlink d1/da/ce 0 2024-04-03T08:38:59.797 INFO:tasks.workunit.client.1.smithi181.stdout:9/26: symlink d1/da/lf 0 2024-04-03T08:38:59.802 INFO:tasks.workunit.client.1.smithi181.stdout:9/27: rename d1/l3 to d1/da/l10 0 2024-04-03T08:38:59.821 INFO:tasks.workunit.client.1.smithi181.stdout:5/22: truncate d4/f5 238831 0 2024-04-03T08:38:59.822 INFO:tasks.workunit.client.1.smithi181.stdout:5/23: truncate d4/f8 4516229 0 2024-04-03T08:38:59.823 INFO:tasks.workunit.client.1.smithi181.stdout:0/11: rename f1 to f4 0 2024-04-03T08:38:59.824 INFO:tasks.workunit.client.1.smithi181.stdout:0/12: chown f3 67 1 2024-04-03T08:38:59.868 INFO:tasks.workunit.client.1.smithi181.stdout:8/18: getdents . 0 2024-04-03T08:38:59.869 INFO:tasks.workunit.client.1.smithi181.stdout:4/18: readlink d1/l5 0 2024-04-03T08:38:59.869 INFO:tasks.workunit.client.1.smithi181.stdout:2/13: truncate f0 2552663 0 2024-04-03T08:38:59.872 INFO:tasks.workunit.client.1.smithi181.stdout:8/19: unlink c2 0 2024-04-03T08:38:59.873 INFO:tasks.workunit.client.1.smithi181.stdout:8/20: chown f3 3 1 2024-04-03T08:38:59.874 INFO:tasks.workunit.client.1.smithi181.stdout:4/19: mknod d1/c9 0 2024-04-03T08:38:59.877 INFO:tasks.workunit.client.1.smithi181.stdout:4/20: creat d1/fa x:0 0 0 2024-04-03T08:38:59.893 INFO:tasks.workunit.client.1.smithi181.stdout:4/21: dwrite d1/f7 [0,4194304] 0 2024-04-03T08:39:00.145 INFO:tasks.workunit.client.1.smithi181.stdout:9/28: rmdir d1/da 39 2024-04-03T08:39:00.145 INFO:tasks.workunit.client.1.smithi181.stdout:9/29: fsync d1/f8 0 2024-04-03T08:39:00.146 INFO:tasks.workunit.client.1.smithi181.stdout:9/30: stat d1/f6 0 2024-04-03T08:39:00.147 INFO:tasks.workunit.client.1.smithi181.stdout:9/31: dread - d1/f6 zero size 2024-04-03T08:39:00.164 INFO:tasks.workunit.client.1.smithi181.stdout:4/22: fsync d1/fa 0 2024-04-03T08:39:00.165 INFO:tasks.workunit.client.1.smithi181.stdout:5/24: truncate d4/f5 1121816 0 2024-04-03T08:39:00.169 INFO:tasks.workunit.client.1.smithi181.stdout:9/32: dwrite d1/f8 [0,4194304] 0 2024-04-03T08:39:00.174 INFO:tasks.workunit.client.1.smithi181.stdout:2/14: dread f0 [0,4194304] 0 2024-04-03T08:39:00.176 INFO:tasks.workunit.client.1.smithi181.stdout:0/13: dwrite f4 [0,4194304] 0 2024-04-03T08:39:00.177 INFO:tasks.workunit.client.1.smithi181.stdout:2/15: read f2 [2124602,56584] 0 2024-04-03T08:39:00.179 INFO:tasks.workunit.client.1.smithi181.stdout:9/33: rmdir d1/da 39 2024-04-03T08:39:00.180 INFO:tasks.workunit.client.1.smithi181.stdout:0/14: write f2 [885358,23008] 0 2024-04-03T08:39:00.180 INFO:tasks.workunit.client.1.smithi181.stdout:5/25: link d4/ca d4/cb 0 2024-04-03T08:39:00.183 INFO:tasks.workunit.client.1.smithi181.stdout:2/16: write f2 [3149373,117463] 0 2024-04-03T08:39:00.184 INFO:tasks.workunit.client.1.smithi181.stdout:0/15: mkdir d5 0 2024-04-03T08:39:00.185 INFO:tasks.workunit.client.1.smithi181.stdout:5/26: mknod d4/cc 0 2024-04-03T08:39:00.187 INFO:tasks.workunit.client.1.smithi181.stdout:9/34: creat d1/da/f11 x:0 0 0 2024-04-03T08:39:00.190 INFO:tasks.workunit.client.1.smithi181.stdout:9/35: dread - d1/f7 zero size 2024-04-03T08:39:00.190 INFO:tasks.workunit.client.1.smithi181.stdout:2/17: mknod c6 0 2024-04-03T08:39:00.193 INFO:tasks.workunit.client.1.smithi181.stdout:4/23: dwrite d1/f8 [0,4194304] 0 2024-04-03T08:39:00.193 INFO:tasks.workunit.client.1.smithi181.stdout:2/18: mkdir d7 0 2024-04-03T08:39:00.195 INFO:tasks.workunit.client.1.smithi181.stdout:4/24: fsync d1/fa 0 2024-04-03T08:39:00.198 INFO:tasks.workunit.client.1.smithi181.stdout:4/25: dread - d1/fa zero size 2024-04-03T08:39:00.198 INFO:tasks.workunit.client.1.smithi181.stdout:9/36: creat d1/da/f12 x:0 0 0 2024-04-03T08:39:00.202 INFO:tasks.workunit.client.1.smithi181.stdout:4/26: creat d1/fb x:0 0 0 2024-04-03T08:39:00.203 INFO:tasks.workunit.client.1.smithi181.stdout:9/37: mkdir d1/da/d13 0 2024-04-03T08:39:00.206 INFO:tasks.workunit.client.1.smithi181.stdout:4/27: write d1/fb [957370,101816] 0 2024-04-03T08:39:00.208 INFO:tasks.workunit.client.1.smithi181.stdout:2/19: truncate f0 22503 0 2024-04-03T08:39:00.211 INFO:tasks.workunit.client.1.smithi181.stdout:9/38: mknod d1/da/c14 0 2024-04-03T08:39:00.215 INFO:tasks.workunit.client.1.smithi181.stdout:0/16: dwrite f4 [0,4194304] 0 2024-04-03T08:39:00.217 INFO:tasks.workunit.client.1.smithi181.stdout:5/27: dread d4/f5 [0,4194304] 0 2024-04-03T08:39:00.218 INFO:tasks.workunit.client.1.smithi181.stdout:0/17: write f3 [692395,95817] 0 2024-04-03T08:39:00.229 INFO:tasks.workunit.client.1.smithi181.stdout:2/20: dread f0 [0,4194304] 0 2024-04-03T08:39:00.230 INFO:tasks.workunit.client.1.smithi181.stdout:5/28: write d4/f5 [1129663,960] 0 2024-04-03T08:39:00.231 INFO:tasks.workunit.client.1.smithi181.stdout:4/28: dread d1/f7 [0,4194304] 0 2024-04-03T08:39:00.236 INFO:tasks.workunit.client.1.smithi181.stdout:0/18: dread f4 [0,4194304] 0 2024-04-03T08:39:00.239 INFO:tasks.workunit.client.1.smithi181.stdout:0/19: write f3 [269408,83084] 0 2024-04-03T08:39:00.239 INFO:tasks.workunit.client.1.smithi181.stdout:9/39: dwrite d1/da/f12 [0,4194304] 0 2024-04-03T08:39:00.243 INFO:tasks.workunit.client.1.smithi181.stdout:9/40: chown d1/da/f12 0 1 2024-04-03T08:39:00.244 INFO:tasks.workunit.client.1.smithi181.stdout:0/20: symlink d5/l6 0 2024-04-03T08:39:00.249 INFO:tasks.workunit.client.1.smithi181.stdout:5/29: dread f1 [0,4194304] 0 2024-04-03T08:39:00.252 INFO:tasks.workunit.client.1.smithi181.stdout:0/21: read f3 [596983,129708] 0 2024-04-03T08:39:00.254 INFO:tasks.workunit.client.1.smithi181.stdout:5/30: read d4/f5 [265756,14867] 0 2024-04-03T08:39:00.259 INFO:tasks.workunit.client.1.smithi181.stdout:0/22: read f4 [1900587,85184] 0 2024-04-03T08:39:00.263 INFO:tasks.workunit.client.1.smithi181.stdout:0/23: stat d5 0 2024-04-03T08:39:00.263 INFO:tasks.workunit.client.1.smithi181.stdout:2/21: dwrite f0 [0,4194304] 0 2024-04-03T08:39:00.265 INFO:tasks.workunit.client.1.smithi181.stdout:2/22: readlink l1 0 2024-04-03T08:39:00.268 INFO:tasks.workunit.client.1.smithi181.stdout:4/29: dwrite d1/fb [0,4194304] 0 2024-04-03T08:39:00.269 INFO:tasks.workunit.client.1.smithi181.stdout:0/24: mknod d5/c7 0 2024-04-03T08:39:00.275 INFO:tasks.workunit.client.1.smithi181.stdout:0/25: rmdir d5 39 2024-04-03T08:39:00.275 INFO:tasks.workunit.client.1.smithi181.stdout:2/23: rmdir d7 0 2024-04-03T08:39:00.276 INFO:tasks.workunit.client.1.smithi181.stdout:9/41: dwrite d1/da/f12 [0,4194304] 0 2024-04-03T08:39:00.280 INFO:tasks.workunit.client.1.smithi181.stdout:0/26: unlink f3 0 2024-04-03T08:39:00.285 INFO:tasks.workunit.client.1.smithi181.stdout:4/30: truncate d1/f8 2469766 0 2024-04-03T08:39:00.285 INFO:tasks.workunit.client.1.smithi181.stdout:5/31: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:00.296 INFO:tasks.workunit.client.1.smithi181.stdout:9/42: dread d1/f5 [0,4194304] 0 2024-04-03T08:39:00.302 INFO:tasks.workunit.client.1.smithi181.stdout:2/24: truncate f3 3041047 0 2024-04-03T08:39:00.304 INFO:tasks.workunit.client.1.smithi181.stdout:4/31: getdents d1 0 2024-04-03T08:39:00.304 INFO:tasks.workunit.client.1.smithi181.stdout:0/27: truncate f2 793308 0 2024-04-03T08:39:00.309 INFO:tasks.workunit.client.1.smithi181.stdout:4/32: mknod d1/cc 0 2024-04-03T08:39:00.310 INFO:tasks.workunit.client.1.smithi181.stdout:0/28: chown d5/l6 283 1 2024-04-03T08:39:00.310 INFO:tasks.workunit.client.1.smithi181.stdout:5/32: dread d4/f8 [0,4194304] 0 2024-04-03T08:39:00.310 INFO:tasks.workunit.client.1.smithi181.stdout:4/33: chown d1/fa 3619 1 2024-04-03T08:39:00.311 INFO:tasks.workunit.client.1.smithi181.stdout:0/29: creat d5/f8 x:0 0 0 2024-04-03T08:39:00.313 INFO:tasks.workunit.client.1.smithi181.stdout:0/30: dread - d5/f8 zero size 2024-04-03T08:39:00.313 INFO:tasks.workunit.client.1.smithi181.stdout:4/34: mkdir d1/dd 0 2024-04-03T08:39:00.319 INFO:tasks.workunit.client.1.smithi181.stdout:0/31: write f4 [1370341,1097] 0 2024-04-03T08:39:00.319 INFO:tasks.workunit.client.1.smithi181.stdout:9/43: dwrite d1/f7 [0,4194304] 0 2024-04-03T08:39:00.319 INFO:tasks.workunit.client.1.smithi181.stdout:4/35: getdents d1/dd 0 2024-04-03T08:39:00.321 INFO:tasks.workunit.client.1.smithi181.stdout:2/25: truncate f3 1331825 0 2024-04-03T08:39:00.322 INFO:tasks.workunit.client.1.smithi181.stdout:5/33: truncate d4/f5 199328 0 2024-04-03T08:39:00.322 INFO:tasks.workunit.client.1.smithi181.stdout:5/34: readlink - no filename 2024-04-03T08:39:00.322 INFO:tasks.workunit.client.1.smithi181.stdout:0/32: mkdir d5/d9 0 2024-04-03T08:39:00.325 INFO:tasks.workunit.client.1.smithi181.stdout:2/26: symlink l8 0 2024-04-03T08:39:00.330 INFO:tasks.workunit.client.1.smithi181.stdout:5/35: rename d4/ca to d4/cd 0 2024-04-03T08:39:00.333 INFO:tasks.workunit.client.1.smithi181.stdout:4/36: getdents d1 0 2024-04-03T08:39:00.335 INFO:tasks.workunit.client.1.smithi181.stdout:5/36: chown d4/cb 47 1 2024-04-03T08:39:00.340 INFO:tasks.workunit.client.1.smithi181.stdout:0/33: dread f4 [0,4194304] 0 2024-04-03T08:39:00.341 INFO:tasks.workunit.client.1.smithi181.stdout:0/34: chown d5 77493281 1 2024-04-03T08:39:00.342 INFO:tasks.workunit.client.1.smithi181.stdout:5/37: write d4/f8 [1896179,100967] 0 2024-04-03T08:39:00.342 INFO:tasks.workunit.client.1.smithi181.stdout:9/44: dwrite d1/f8 [0,4194304] 0 2024-04-03T08:39:00.343 INFO:tasks.workunit.client.1.smithi181.stdout:0/35: readlink d5/l6 0 2024-04-03T08:39:00.346 INFO:tasks.workunit.client.1.smithi181.stdout:2/27: dread f0 [0,4194304] 0 2024-04-03T08:39:00.347 INFO:tasks.workunit.client.1.smithi181.stdout:5/38: mknod d4/ce 0 2024-04-03T08:39:00.347 INFO:tasks.workunit.client.1.smithi181.stdout:0/36: creat d5/fa x:0 0 0 2024-04-03T08:39:00.349 INFO:tasks.workunit.client.1.smithi181.stdout:9/45: symlink d1/l15 0 2024-04-03T08:39:00.350 INFO:tasks.workunit.client.1.smithi181.stdout:2/28: creat f9 x:0 0 0 2024-04-03T08:39:00.351 INFO:tasks.workunit.client.1.smithi181.stdout:5/39: creat d4/ff x:0 0 0 2024-04-03T08:39:00.354 INFO:tasks.workunit.client.1.smithi181.stdout:2/29: creat fa x:0 0 0 2024-04-03T08:39:00.355 INFO:tasks.workunit.client.1.smithi181.stdout:0/37: link d5/f8 d5/fb 0 2024-04-03T08:39:00.356 INFO:tasks.workunit.client.1.smithi181.stdout:4/37: dwrite d1/f7 [0,4194304] 0 2024-04-03T08:39:00.360 INFO:tasks.workunit.client.1.smithi181.stdout:2/30: creat fb x:0 0 0 2024-04-03T08:39:00.361 INFO:tasks.workunit.client.1.smithi181.stdout:0/38: mkdir d5/dc 0 2024-04-03T08:39:00.364 INFO:tasks.workunit.client.1.smithi181.stdout:4/38: truncate d1/f8 1773756 0 2024-04-03T08:39:00.369 INFO:tasks.workunit.client.1.smithi181.stdout:5/40: rmdir d4 39 2024-04-03T08:39:00.370 INFO:tasks.workunit.client.1.smithi181.stdout:0/39: rename d5/fa to d5/d9/fd 0 2024-04-03T08:39:00.371 INFO:tasks.workunit.client.1.smithi181.stdout:4/39: mknod d1/dd/ce 0 2024-04-03T08:39:00.371 INFO:tasks.workunit.client.1.smithi181.stdout:9/46: dwrite d1/f8 [0,4194304] 0 2024-04-03T08:39:00.375 INFO:tasks.workunit.client.1.smithi181.stdout:5/41: mknod d4/c10 0 2024-04-03T08:39:00.376 INFO:tasks.workunit.client.1.smithi181.stdout:9/47: mkdir d1/da/d16 0 2024-04-03T08:39:00.380 INFO:tasks.workunit.client.1.smithi181.stdout:9/48: write d1/da/f11 [390691,24562] 0 2024-04-03T08:39:00.382 INFO:tasks.workunit.client.1.smithi181.stdout:9/49: dread - d1/f6 zero size 2024-04-03T08:39:00.387 INFO:tasks.workunit.client.1.smithi181.stdout:5/42: link d4/cb d4/c11 0 2024-04-03T08:39:00.388 INFO:tasks.workunit.client.1.smithi181.stdout:9/50: mknod d1/da/d16/c17 0 2024-04-03T08:39:00.391 INFO:tasks.workunit.client.1.smithi181.stdout:2/31: dwrite f0 [0,4194304] 0 2024-04-03T08:39:00.398 INFO:tasks.workunit.client.1.smithi181.stdout:9/51: mknod d1/da/d13/c18 0 2024-04-03T08:39:00.400 INFO:tasks.workunit.client.1.smithi181.stdout:4/40: dwrite d1/f7 [0,4194304] 0 2024-04-03T08:39:00.402 INFO:tasks.workunit.client.1.smithi181.stdout:4/41: dread - d1/fa zero size 2024-04-03T08:39:00.404 INFO:tasks.workunit.client.1.smithi181.stdout:9/52: creat d1/da/f19 x:0 0 0 2024-04-03T08:39:00.404 INFO:tasks.workunit.client.1.smithi181.stdout:0/40: dwrite d5/f8 [0,4194304] 0 2024-04-03T08:39:00.406 INFO:tasks.workunit.client.1.smithi181.stdout:0/41: readlink d5/l6 0 2024-04-03T08:39:00.407 INFO:tasks.workunit.client.1.smithi181.stdout:0/42: readlink d5/l6 0 2024-04-03T08:39:00.410 INFO:tasks.workunit.client.1.smithi181.stdout:4/42: rmdir d1 39 2024-04-03T08:39:00.412 INFO:tasks.workunit.client.1.smithi181.stdout:2/32: truncate f0 2456916 0 2024-04-03T08:39:00.412 INFO:tasks.workunit.client.1.smithi181.stdout:9/53: mkdir d1/da/d1a 0 2024-04-03T08:39:00.413 INFO:tasks.workunit.client.1.smithi181.stdout:2/33: readlink l4 0 2024-04-03T08:39:00.413 INFO:tasks.workunit.client.1.smithi181.stdout:0/43: creat d5/fe x:0 0 0 2024-04-03T08:39:00.414 INFO:tasks.workunit.client.1.smithi181.stdout:5/43: dread d4/f8 [0,4194304] 0 2024-04-03T08:39:00.414 INFO:tasks.workunit.client.1.smithi181.stdout:5/44: readlink - no filename 2024-04-03T08:39:00.418 INFO:tasks.workunit.client.1.smithi181.stdout:0/44: chown d5/d9/fd 0 1 2024-04-03T08:39:00.418 INFO:tasks.workunit.client.1.smithi181.stdout:5/45: creat d4/f12 x:0 0 0 2024-04-03T08:39:00.420 INFO:tasks.workunit.client.1.smithi181.stdout:4/43: rename d1/fa to d1/ff 0 2024-04-03T08:39:00.423 INFO:tasks.workunit.client.1.smithi181.stdout:5/46: creat d4/f13 x:0 0 0 2024-04-03T08:39:00.425 INFO:tasks.workunit.client.1.smithi181.stdout:2/34: getdents . 0 2024-04-03T08:39:00.425 INFO:tasks.workunit.client.1.smithi181.stdout:0/45: creat d5/dc/ff x:0 0 0 2024-04-03T08:39:00.425 INFO:tasks.workunit.client.1.smithi181.stdout:5/47: chown c3 724289082 1 2024-04-03T08:39:00.426 INFO:tasks.workunit.client.1.smithi181.stdout:4/44: creat d1/dd/f10 x:0 0 0 2024-04-03T08:39:00.429 INFO:tasks.workunit.client.1.smithi181.stdout:2/35: rename l8 to lc 0 2024-04-03T08:39:00.431 INFO:tasks.workunit.client.1.smithi181.stdout:0/46: fsync f2 0 2024-04-03T08:39:00.431 INFO:tasks.workunit.client.1.smithi181.stdout:5/48: write d4/f8 [602949,117721] 0 2024-04-03T08:39:00.432 INFO:tasks.workunit.client.1.smithi181.stdout:9/54: dwrite d1/da/f12 [0,4194304] 0 2024-04-03T08:39:00.434 INFO:tasks.workunit.client.1.smithi181.stdout:2/36: symlink ld 0 2024-04-03T08:39:00.438 INFO:tasks.workunit.client.1.smithi181.stdout:5/49: symlink d4/l14 0 2024-04-03T08:39:00.439 INFO:tasks.workunit.client.1.smithi181.stdout:2/37: read f3 [142406,41580] 0 2024-04-03T08:39:00.439 INFO:tasks.workunit.client.1.smithi181.stdout:0/47: write d5/f8 [4148702,67257] 0 2024-04-03T08:39:00.443 INFO:tasks.workunit.client.1.smithi181.stdout:2/38: creat fe x:0 0 0 2024-04-03T08:39:00.445 INFO:tasks.workunit.client.1.smithi181.stdout:2/39: creat ff x:0 0 0 2024-04-03T08:39:00.448 INFO:tasks.workunit.client.1.smithi181.stdout:2/40: dread - fa zero size 2024-04-03T08:39:00.452 INFO:tasks.workunit.client.1.smithi181.stdout:4/45: dwrite d1/dd/f10 [0,4194304] 0 2024-04-03T08:39:00.454 INFO:tasks.workunit.client.1.smithi181.stdout:2/41: rename fb to f10 0 2024-04-03T08:39:00.459 INFO:tasks.workunit.client.1.smithi181.stdout:2/42: unlink l4 0 2024-04-03T08:39:00.460 INFO:tasks.workunit.client.1.smithi181.stdout:4/46: rename d1/dd to d1/dd/d11 22 2024-04-03T08:39:00.466 INFO:tasks.workunit.client.1.smithi181.stdout:2/43: creat f11 x:0 0 0 2024-04-03T08:39:00.469 INFO:tasks.workunit.client.1.smithi181.stdout:9/55: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:00.471 INFO:tasks.workunit.client.1.smithi181.stdout:4/47: write d1/ff [460868,100587] 0 2024-04-03T08:39:00.473 INFO:tasks.workunit.client.1.smithi181.stdout:2/44: write ff [81872,76886] 0 2024-04-03T08:39:00.475 INFO:tasks.workunit.client.1.smithi181.stdout:5/50: dwrite d4/ff [0,4194304] 0 2024-04-03T08:39:00.477 INFO:tasks.workunit.client.1.smithi181.stdout:0/48: dwrite d5/fe [0,4194304] 0 2024-04-03T08:39:00.479 INFO:tasks.workunit.client.1.smithi181.stdout:2/45: rename f2 to f12 0 2024-04-03T08:39:00.482 INFO:tasks.workunit.client.1.smithi181.stdout:2/46: mkdir d13 0 2024-04-03T08:39:00.486 INFO:tasks.workunit.client.1.smithi181.stdout:2/47: mknod d13/c14 0 2024-04-03T08:39:00.490 INFO:tasks.workunit.client.1.smithi181.stdout:4/48: dread d1/f7 [0,4194304] 0 2024-04-03T08:39:00.493 INFO:tasks.workunit.client.1.smithi181.stdout:4/49: creat d1/dd/f12 x:0 0 0 2024-04-03T08:39:00.493 INFO:tasks.workunit.client.1.smithi181.stdout:9/56: dread d1/f7 [0,4194304] 0 2024-04-03T08:39:00.496 INFO:tasks.workunit.client.1.smithi181.stdout:9/57: write d1/f7 [4111208,2311] 0 2024-04-03T08:39:00.497 INFO:tasks.workunit.client.1.smithi181.stdout:4/50: rename d1/ff to d1/dd/f13 0 2024-04-03T08:39:00.497 INFO:tasks.workunit.client.1.smithi181.stdout:9/58: write d1/da/fb [642075,17412] 0 2024-04-03T08:39:00.498 INFO:tasks.workunit.client.1.smithi181.stdout:4/51: chown d1/dd/f10 2375 1 2024-04-03T08:39:00.500 INFO:tasks.workunit.client.1.smithi181.stdout:9/59: creat d1/da/d16/f1b x:0 0 0 2024-04-03T08:39:00.500 INFO:tasks.workunit.client.1.smithi181.stdout:0/49: fdatasync d5/fe 0 2024-04-03T08:39:00.501 INFO:tasks.workunit.client.1.smithi181.stdout:4/52: mknod d1/c14 0 2024-04-03T08:39:00.502 INFO:tasks.workunit.client.1.smithi181.stdout:9/60: write d1/f8 [2576867,56848] 0 2024-04-03T08:39:00.502 INFO:tasks.workunit.client.1.smithi181.stdout:0/50: dread - d5/d9/fd zero size 2024-04-03T08:39:00.503 INFO:tasks.workunit.client.1.smithi181.stdout:4/53: mkdir d1/d15 0 2024-04-03T08:39:00.503 INFO:tasks.workunit.client.1.smithi181.stdout:9/61: fsync d1/da/f12 0 2024-04-03T08:39:00.504 INFO:tasks.workunit.client.1.smithi181.stdout:0/51: rmdir d5 39 2024-04-03T08:39:00.507 INFO:tasks.workunit.client.1.smithi181.stdout:0/52: unlink f4 0 2024-04-03T08:39:00.508 INFO:tasks.workunit.client.1.smithi181.stdout:9/62: symlink d1/l1c 0 2024-04-03T08:39:00.509 INFO:tasks.workunit.client.1.smithi181.stdout:9/63: chown d1/da/fb 388 1 2024-04-03T08:39:00.509 INFO:tasks.workunit.client.1.smithi181.stdout:0/53: chown d5/d9/fd 83 1 2024-04-03T08:39:00.511 INFO:tasks.workunit.client.1.smithi181.stdout:9/64: truncate d1/da/fb 929208 0 2024-04-03T08:39:00.514 INFO:tasks.workunit.client.1.smithi181.stdout:9/65: symlink d1/da/d13/l1d 0 2024-04-03T08:39:00.518 INFO:tasks.workunit.client.1.smithi181.stdout:9/66: write d1/da/fb [259253,21053] 0 2024-04-03T08:39:00.524 INFO:tasks.workunit.client.1.smithi181.stdout:9/67: write d1/da/fb [1861669,43187] 0 2024-04-03T08:39:00.530 INFO:tasks.workunit.client.1.smithi181.stdout:2/48: truncate f0 1303697 0 2024-04-03T08:39:00.531 INFO:tasks.workunit.client.1.smithi181.stdout:9/68: rename d1/da/f19 to d1/da/f1e 0 2024-04-03T08:39:00.533 INFO:tasks.workunit.client.1.smithi181.stdout:4/54: rename d1/dd to d1/d16 0 2024-04-03T08:39:00.534 INFO:tasks.workunit.client.1.smithi181.stdout:2/49: mknod d13/c15 0 2024-04-03T08:39:00.535 INFO:tasks.workunit.client.1.smithi181.stdout:0/54: dwrite d5/f8 [0,4194304] 0 2024-04-03T08:39:00.537 INFO:tasks.workunit.client.1.smithi181.stdout:2/50: stat lc 0 2024-04-03T08:39:00.538 INFO:tasks.workunit.client.1.smithi181.stdout:9/69: creat d1/da/d1a/f1f x:0 0 0 2024-04-03T08:39:00.541 INFO:tasks.workunit.client.1.smithi181.stdout:4/55: rename d1/d16/f10 to d1/d16/f17 0 2024-04-03T08:39:00.546 INFO:tasks.workunit.client.1.smithi181.stdout:2/51: symlink d13/l16 0 2024-04-03T08:39:00.546 INFO:tasks.workunit.client.1.smithi181.stdout:5/51: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:00.546 INFO:tasks.workunit.client.1.smithi181.stdout:9/70: write d1/f6 [44959,116968] 0 2024-04-03T08:39:00.554 INFO:tasks.workunit.client.1.smithi181.stdout:4/56: rename d1/f8 to d1/d16/f18 0 2024-04-03T08:39:00.556 INFO:tasks.workunit.client.1.smithi181.stdout:9/71: rmdir d1/da/d16 39 2024-04-03T08:39:00.558 INFO:tasks.workunit.client.1.smithi181.stdout:5/52: fsync f1 0 2024-04-03T08:39:00.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:00 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:00.565 INFO:tasks.workunit.client.1.smithi181.stdout:2/52: write f3 [793994,122297] 0 2024-04-03T08:39:00.573 INFO:tasks.workunit.client.1.smithi181.stdout:2/53: write f9 [759561,77730] 0 2024-04-03T08:39:00.579 INFO:tasks.workunit.client.1.smithi181.stdout:0/55: dwrite f2 [0,4194304] 0 2024-04-03T08:39:00.581 INFO:tasks.workunit.client.1.smithi181.stdout:2/54: truncate f11 766941 0 2024-04-03T08:39:00.585 INFO:tasks.workunit.client.1.smithi181.stdout:2/55: stat d13/c15 0 2024-04-03T08:39:00.588 INFO:tasks.workunit.client.1.smithi181.stdout:0/56: mkdir d5/dc/d10 0 2024-04-03T08:39:00.591 INFO:tasks.workunit.client.1.smithi181.stdout:9/72: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:00.593 INFO:tasks.workunit.client.1.smithi181.stdout:2/56: symlink d13/l17 0 2024-04-03T08:39:00.593 INFO:tasks.workunit.client.1.smithi181.stdout:5/53: dwrite f1 [0,4194304] 0 2024-04-03T08:39:00.595 INFO:tasks.workunit.client.1.smithi181.stdout:4/57: dwrite d1/d16/f13 [0,4194304] 0 2024-04-03T08:39:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:00 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:00.604 INFO:tasks.workunit.client.1.smithi181.stdout:2/57: mknod d13/c18 0 2024-04-03T08:39:00.615 INFO:tasks.workunit.client.1.smithi181.stdout:2/58: creat d13/f19 x:0 0 0 2024-04-03T08:39:00.617 INFO:tasks.workunit.client.1.smithi181.stdout:9/73: creat d1/f20 x:0 0 0 2024-04-03T08:39:00.626 INFO:tasks.workunit.client.1.smithi181.stdout:5/54: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:00.630 INFO:tasks.workunit.client.1.smithi181.stdout:0/57: dwrite f2 [4194304,4194304] 0 2024-04-03T08:39:00.639 INFO:tasks.workunit.client.1.smithi181.stdout:0/58: dread - d5/dc/ff zero size 2024-04-03T08:39:00.647 INFO:tasks.workunit.client.1.smithi181.stdout:0/59: mknod d5/c11 0 2024-04-03T08:39:00.651 INFO:tasks.workunit.client.1.smithi181.stdout:4/58: dwrite d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:00.656 INFO:tasks.workunit.client.1.smithi181.stdout:0/60: creat d5/dc/f12 x:0 0 0 2024-04-03T08:39:00.658 INFO:tasks.workunit.client.1.smithi181.stdout:4/59: fsync d1/f7 0 2024-04-03T08:39:00.659 INFO:tasks.workunit.client.1.smithi181.stdout:9/74: dwrite d1/f6 [0,4194304] 0 2024-04-03T08:39:00.662 INFO:tasks.workunit.client.1.smithi181.stdout:5/55: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:00.665 INFO:tasks.workunit.client.1.smithi181.stdout:5/56: dread d4/f8 [4194304,4194304] 0 2024-04-03T08:39:00.668 INFO:tasks.workunit.client.1.smithi181.stdout:2/59: write f12 [723987,98244] 0 2024-04-03T08:39:00.670 INFO:tasks.workunit.client.1.smithi181.stdout:2/60: chown d13/c18 700 1 2024-04-03T08:39:00.670 INFO:tasks.workunit.client.1.smithi181.stdout:5/57: write d4/f8 [3332663,9256] 0 2024-04-03T08:39:00.671 INFO:tasks.workunit.client.1.smithi181.stdout:2/61: chown fe 0 1 2024-04-03T08:39:00.685 INFO:tasks.workunit.client.1.smithi181.stdout:5/58: symlink d4/l15 0 2024-04-03T08:39:00.687 INFO:tasks.workunit.client.1.smithi181.stdout:2/62: symlink d13/l1a 0 2024-04-03T08:39:00.690 INFO:tasks.workunit.client.1.smithi181.stdout:9/75: link d1/f20 d1/da/f21 0 2024-04-03T08:39:00.692 INFO:tasks.workunit.client.1.smithi181.stdout:5/59: creat d4/f16 x:0 0 0 2024-04-03T08:39:00.694 INFO:tasks.workunit.client.1.smithi181.stdout:2/63: creat d13/f1b x:0 0 0 2024-04-03T08:39:00.706 INFO:tasks.workunit.client.1.smithi181.stdout:9/76: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:00.711 INFO:tasks.workunit.client.1.smithi181.stdout:5/60: dwrite d4/f13 [0,4194304] 0 2024-04-03T08:39:00.712 INFO:tasks.workunit.client.1.smithi181.stdout:5/61: write d4/f13 [3505261,101873] 0 2024-04-03T08:39:00.713 INFO:tasks.workunit.client.1.smithi181.stdout:9/77: mkdir d1/da/d13/d22 0 2024-04-03T08:39:00.713 INFO:tasks.workunit.client.1.smithi181.stdout:5/62: stat d4/f12 0 2024-04-03T08:39:00.714 INFO:tasks.workunit.client.1.smithi181.stdout:9/78: readlink d1/l15 0 2024-04-03T08:39:00.718 INFO:tasks.workunit.client.1.smithi181.stdout:5/63: mkdir d4/d17 0 2024-04-03T08:39:00.736 INFO:tasks.workunit.client.1.smithi181.stdout:5/64: dwrite d4/ff [0,4194304] 0 2024-04-03T08:39:00.740 INFO:tasks.workunit.client.1.smithi181.stdout:4/60: truncate d1/d16/f17 3426888 0 2024-04-03T08:39:00.754 INFO:tasks.workunit.client.1.smithi181.stdout:5/65: fsync d4/f16 0 2024-04-03T08:39:00.765 INFO:tasks.workunit.client.1.smithi181.stdout:5/66: dread f1 [0,4194304] 0 2024-04-03T08:39:00.769 INFO:tasks.workunit.client.1.smithi181.stdout:5/67: mkdir d4/d18 0 2024-04-03T08:39:00.772 INFO:tasks.workunit.client.1.smithi181.stdout:5/68: link f1 d4/d17/f19 0 2024-04-03T08:39:00.774 INFO:tasks.workunit.client.1.smithi181.stdout:5/69: mknod d4/d18/c1a 0 2024-04-03T08:39:00.777 INFO:tasks.workunit.client.1.smithi181.stdout:9/79: truncate d1/f6 1125212 0 2024-04-03T08:39:00.779 INFO:tasks.workunit.client.1.smithi181.stdout:9/80: chown d1/da/d16/f1b 225 1 2024-04-03T08:39:00.780 INFO:tasks.workunit.client.1.smithi181.stdout:9/81: read - d1/da/f21 zero size 2024-04-03T08:39:00.785 INFO:tasks.workunit.client.1.smithi181.stdout:9/82: mkdir d1/da/d13/d22/d23 0 2024-04-03T08:39:00.787 INFO:tasks.workunit.client.1.smithi181.stdout:5/70: dread d4/d17/f19 [0,4194304] 0 2024-04-03T08:39:00.788 INFO:tasks.workunit.client.1.smithi181.stdout:9/83: mknod d1/da/d16/c24 0 2024-04-03T08:39:00.791 INFO:tasks.workunit.client.1.smithi181.stdout:9/84: symlink d1/da/d13/l25 0 2024-04-03T08:39:00.791 INFO:tasks.workunit.client.1.smithi181.stdout:5/71: write d4/d17/f19 [2067978,14715] 0 2024-04-03T08:39:00.793 INFO:tasks.workunit.client.1.smithi181.stdout:9/85: fdatasync d1/f8 0 2024-04-03T08:39:00.794 INFO:tasks.workunit.client.1.smithi181.stdout:5/72: write d4/f13 [2657098,80172] 0 2024-04-03T08:39:00.797 INFO:tasks.workunit.client.1.smithi181.stdout:5/73: write d4/ff [380135,93927] 0 2024-04-03T08:39:00.798 INFO:tasks.workunit.client.1.smithi181.stdout:9/86: creat d1/da/d16/f26 x:0 0 0 2024-04-03T08:39:00.801 INFO:tasks.workunit.client.1.smithi181.stdout:9/87: fdatasync d1/da/f12 0 2024-04-03T08:39:00.801 INFO:tasks.workunit.client.1.smithi181.stdout:5/74: chown d4/l15 1043 1 2024-04-03T08:39:00.802 INFO:tasks.workunit.client.1.smithi181.stdout:5/75: readlink d4/l15 0 2024-04-03T08:39:00.804 INFO:tasks.workunit.client.1.smithi181.stdout:9/88: creat d1/da/d1a/f27 x:0 0 0 2024-04-03T08:39:00.804 INFO:tasks.workunit.client.1.smithi181.stdout:5/76: mknod d4/d18/c1b 0 2024-04-03T08:39:00.806 INFO:tasks.workunit.client.1.smithi181.stdout:4/61: dwrite d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:00.807 INFO:tasks.workunit.client.1.smithi181.stdout:9/89: mkdir d1/da/d28 0 2024-04-03T08:39:00.809 INFO:tasks.workunit.client.1.smithi181.stdout:4/62: mknod d1/c19 0 2024-04-03T08:39:00.810 INFO:tasks.workunit.client.1.smithi181.stdout:9/90: creat d1/da/d13/f29 x:0 0 0 2024-04-03T08:39:00.812 INFO:tasks.workunit.client.1.smithi181.stdout:9/91: chown d1/f20 783 1 2024-04-03T08:39:00.816 INFO:tasks.workunit.client.1.smithi181.stdout:9/92: creat d1/da/d16/f2a x:0 0 0 2024-04-03T08:39:00.817 INFO:tasks.workunit.client.1.smithi181.stdout:9/93: chown d1/da/d1a/f1f 32588 1 2024-04-03T08:39:00.819 INFO:tasks.workunit.client.1.smithi181.stdout:9/94: chown d1/da/d16/c17 876428 1 2024-04-03T08:39:00.821 INFO:tasks.workunit.client.1.smithi181.stdout:9/95: symlink d1/da/d13/d22/l2b 0 2024-04-03T08:39:00.821 INFO:tasks.workunit.client.1.smithi181.stdout:4/63: dread d1/fb [0,4194304] 0 2024-04-03T08:39:00.822 INFO:tasks.workunit.client.1.smithi181.stdout:9/96: chown d1/c4 286348 1 2024-04-03T08:39:00.823 INFO:tasks.workunit.client.1.smithi181.stdout:9/97: read - d1/da/d16/f26 zero size 2024-04-03T08:39:00.824 INFO:tasks.workunit.client.1.smithi181.stdout:4/64: creat d1/d15/f1a x:0 0 0 2024-04-03T08:39:00.828 INFO:tasks.workunit.client.1.smithi181.stdout:9/98: link d1/cc d1/da/c2c 0 2024-04-03T08:39:00.829 INFO:tasks.workunit.client.1.smithi181.stdout:9/99: fdatasync d1/da/d16/f1b 0 2024-04-03T08:39:00.831 INFO:tasks.workunit.client.1.smithi181.stdout:9/100: creat d1/da/d13/f2d x:0 0 0 2024-04-03T08:39:00.832 INFO:tasks.workunit.client.1.smithi181.stdout:9/101: chown d1/f8 6345035 1 2024-04-03T08:39:00.835 INFO:tasks.workunit.client.1.smithi181.stdout:9/102: creat d1/da/d13/d22/f2e x:0 0 0 2024-04-03T08:39:00.837 INFO:tasks.workunit.client.1.smithi181.stdout:4/65: dwrite d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:00.837 INFO:tasks.workunit.client.1.smithi181.stdout:9/103: dread - d1/da/d13/f2d zero size 2024-04-03T08:39:00.840 INFO:tasks.workunit.client.1.smithi181.stdout:9/104: creat d1/f2f x:0 0 0 2024-04-03T08:39:00.857 INFO:tasks.workunit.client.1.smithi181.stdout:9/105: dwrite d1/da/f21 [0,4194304] 0 2024-04-03T08:39:00.858 INFO:tasks.workunit.client.1.smithi181.stdout:9/106: write d1/f2f [733816,79863] 0 2024-04-03T08:39:00.876 INFO:tasks.workunit.client.1.smithi181.stdout:9/107: dwrite d1/f6 [0,4194304] 0 2024-04-03T08:39:00.880 INFO:tasks.workunit.client.1.smithi181.stdout:9/108: mkdir d1/da/d28/d30 0 2024-04-03T08:39:00.897 INFO:tasks.workunit.client.1.smithi181.stdout:9/109: dwrite d1/f2f [0,4194304] 0 2024-04-03T08:39:00.898 INFO:tasks.workunit.client.1.smithi181.stdout:9/110: stat d1/da/d16 0 2024-04-03T08:39:00.900 INFO:tasks.workunit.client.1.smithi181.stdout:9/111: write d1/da/d1a/f1f [725956,20474] 0 2024-04-03T08:39:00.918 INFO:tasks.workunit.client.1.smithi181.stdout:9/112: dwrite d1/da/fb [0,4194304] 0 2024-04-03T08:39:00.920 INFO:tasks.workunit.client.1.smithi181.stdout:9/113: write d1/da/d13/f29 [362754,110313] 0 2024-04-03T08:39:00.921 INFO:tasks.workunit.client.1.smithi181.stdout:9/114: fsync d1/da/d13/f2d 0 2024-04-03T08:39:00.933 INFO:tasks.workunit.client.1.smithi181.stdout:9/115: dread d1/f2f [0,4194304] 0 2024-04-03T08:39:00.952 INFO:tasks.workunit.client.1.smithi181.stdout:9/116: dwrite d1/da/d13/d22/f2e [0,4194304] 0 2024-04-03T08:39:00.956 INFO:tasks.workunit.client.1.smithi181.stdout:9/117: creat d1/da/d13/d22/f31 x:0 0 0 2024-04-03T08:39:00.957 INFO:tasks.workunit.client.1.smithi181.stdout:9/118: read d1/f8 [692763,96284] 0 2024-04-03T08:39:00.958 INFO:tasks.workunit.client.1.smithi181.stdout:9/119: dread - d1/da/f1e zero size 2024-04-03T08:39:00.965 INFO:tasks.workunit.client.1.smithi181.stdout:9/120: getdents d1/da/d13/d22 0 2024-04-03T08:39:00.967 INFO:tasks.workunit.client.1.smithi181.stdout:9/121: write d1/f5 [4919719,87208] 0 2024-04-03T08:39:00.969 INFO:tasks.workunit.client.1.smithi181.stdout:9/122: write d1/da/d1a/f1f [315077,88994] 0 2024-04-03T08:39:00.982 INFO:tasks.workunit.client.1.smithi181.stdout:9/123: dwrite d1/f20 [0,4194304] 0 2024-04-03T08:39:00.992 INFO:tasks.workunit.client.1.smithi181.stdout:9/124: truncate d1/f6 1421133 0 2024-04-03T08:39:00.994 INFO:tasks.workunit.client.1.smithi181.stdout:9/125: fdatasync d1/f2f 0 2024-04-03T08:39:00.996 INFO:tasks.workunit.client.1.smithi181.stdout:9/126: mkdir d1/da/d16/d32 0 2024-04-03T08:39:01.000 INFO:tasks.workunit.client.1.smithi181.stdout:9/127: unlink d1/f7 0 2024-04-03T08:39:01.001 INFO:tasks.workunit.client.1.smithi181.stdout:9/128: write d1/da/d16/f26 [929450,114982] 0 2024-04-03T08:39:01.003 INFO:tasks.workunit.client.1.smithi181.stdout:9/129: chown d1/da/d13/d22/f2e 525485449 1 2024-04-03T08:39:01.016 INFO:tasks.workunit.client.1.smithi181.stdout:9/130: dwrite d1/da/d13/d22/f2e [0,4194304] 0 2024-04-03T08:39:01.024 INFO:tasks.workunit.client.1.smithi181.stdout:9/131: truncate d1/da/fb 1398237 0 2024-04-03T08:39:01.026 INFO:tasks.workunit.client.1.smithi181.stdout:9/132: mkdir d1/da/d1a/d33 0 2024-04-03T08:39:01.031 INFO:tasks.workunit.client.1.smithi181.stdout:9/133: dread d1/da/d13/f29 [0,4194304] 0 2024-04-03T08:39:01.037 INFO:tasks.workunit.client.1.smithi181.stdout:9/134: rename d1/da/d1a/d33 to d1/d34 0 2024-04-03T08:39:01.038 INFO:tasks.workunit.client.1.smithi181.stdout:9/135: fdatasync d1/da/f21 0 2024-04-03T08:39:01.040 INFO:tasks.workunit.client.1.smithi181.stdout:9/136: write d1/da/d16/f2a [110555,92795] 0 2024-04-03T08:39:01.042 INFO:tasks.workunit.client.1.smithi181.stdout:9/137: truncate d1/da/f11 590140 0 2024-04-03T08:39:01.048 INFO:tasks.workunit.client.1.smithi181.stdout:9/138: fsync d1/da/fb 0 2024-04-03T08:39:01.052 INFO:tasks.workunit.client.1.smithi181.stdout:9/139: creat d1/f35 x:0 0 0 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:0/38: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:7/38: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:6/52: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:4/15: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:9/36: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:5/1: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:2/11: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:1/21: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:3/6: sync 2024-04-03T08:39:01.522 INFO:tasks.workunit.client.0.smithi157.stdout:8/2: sync 2024-04-03T08:39:01.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/3: read - no filename 2024-04-03T08:39:01.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/4: write - no filename 2024-04-03T08:39:01.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/5: write - no filename 2024-04-03T08:39:01.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/6: truncate - no filename 2024-04-03T08:39:01.525 INFO:tasks.workunit.client.0.smithi157.stdout:1/22: chown d2/c4 14 1 2024-04-03T08:39:01.525 INFO:tasks.workunit.client.0.smithi157.stdout:9/37: chown d1/fb 117 1 2024-04-03T08:39:01.526 INFO:tasks.workunit.client.0.smithi157.stdout:0/39: truncate d2/f7 1095587 0 2024-04-03T08:39:01.528 INFO:tasks.workunit.client.0.smithi157.stdout:2/12: mkdir d3 0 2024-04-03T08:39:01.528 INFO:tasks.workunit.client.0.smithi157.stdout:2/13: read - no filename 2024-04-03T08:39:01.528 INFO:tasks.workunit.client.0.smithi157.stdout:2/14: dwrite - no filename 2024-04-03T08:39:01.528 INFO:tasks.workunit.client.0.smithi157.stdout:2/15: dread - no filename 2024-04-03T08:39:01.528 INFO:tasks.workunit.client.0.smithi157.stdout:2/16: dwrite - no filename 2024-04-03T08:39:01.528 INFO:tasks.workunit.client.0.smithi157.stdout:5/2: symlink l0 0 2024-04-03T08:39:01.529 INFO:tasks.workunit.client.0.smithi157.stdout:3/7: creat f0 x:0 0 0 2024-04-03T08:39:01.531 INFO:tasks.workunit.client.0.smithi157.stdout:0/40: truncate d2/fa 417524 0 2024-04-03T08:39:01.533 INFO:tasks.workunit.client.0.smithi157.stdout:3/8: read - f0 zero size 2024-04-03T08:39:01.533 INFO:tasks.workunit.client.0.smithi157.stdout:5/3: symlink l1 0 2024-04-03T08:39:01.533 INFO:tasks.workunit.client.0.smithi157.stdout:5/4: dread - no filename 2024-04-03T08:39:01.534 INFO:tasks.workunit.client.0.smithi157.stdout:3/9: stat f0 0 2024-04-03T08:39:01.535 INFO:tasks.workunit.client.0.smithi157.stdout:8/7: creat f0 x:0 0 0 2024-04-03T08:39:01.537 INFO:tasks.workunit.client.0.smithi157.stdout:7/39: unlink d0/d5/c9 0 2024-04-03T08:39:01.538 INFO:tasks.workunit.client.0.smithi157.stdout:5/5: chown l1 1 1 2024-04-03T08:39:01.539 INFO:tasks.workunit.client.0.smithi157.stdout:8/8: read - f0 zero size 2024-04-03T08:39:01.540 INFO:tasks.workunit.client.0.smithi157.stdout:9/38: fdatasync d1/f3 0 2024-04-03T08:39:01.541 INFO:tasks.workunit.client.0.smithi157.stdout:2/17: creat d3/f4 x:0 0 0 2024-04-03T08:39:01.544 INFO:tasks.workunit.client.0.smithi157.stdout:3/10: mknod c1 0 2024-04-03T08:39:01.546 INFO:tasks.workunit.client.0.smithi157.stdout:4/16: link l3 l6 0 2024-04-03T08:39:01.548 INFO:tasks.workunit.client.0.smithi157.stdout:2/18: read - d3/f4 zero size 2024-04-03T08:39:01.549 INFO:tasks.workunit.client.0.smithi157.stdout:4/17: stat f4 0 2024-04-03T08:39:01.551 INFO:tasks.workunit.client.0.smithi157.stdout:8/9: rename f0 to f1 0 2024-04-03T08:39:01.554 INFO:tasks.workunit.client.0.smithi157.stdout:7/40: creat d0/d4/f13 x:0 0 0 2024-04-03T08:39:01.558 INFO:tasks.workunit.client.0.smithi157.stdout:2/19: fdatasync d3/f4 0 2024-04-03T08:39:01.563 INFO:tasks.workunit.client.0.smithi157.stdout:6/53: dwrite d1/fb [0,4194304] 0 2024-04-03T08:39:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:01 smithi157 ceph-mon[35083]: pgmap v290: 65 pgs: 65 active+clean; 251 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 7.0 MiB/s wr, 279 op/s 2024-04-03T08:39:01.564 INFO:tasks.workunit.client.0.smithi157.stdout:3/11: mknod c2 0 2024-04-03T08:39:01.566 INFO:tasks.workunit.client.0.smithi157.stdout:9/39: write d1/f3 [2124867,101325] 0 2024-04-03T08:39:01.567 INFO:tasks.workunit.client.0.smithi157.stdout:3/12: fsync f0 0 2024-04-03T08:39:01.568 INFO:tasks.workunit.client.0.smithi157.stdout:2/20: dread - d3/f4 zero size 2024-04-03T08:39:01.568 INFO:tasks.workunit.client.0.smithi157.stdout:4/18: creat f7 x:0 0 0 2024-04-03T08:39:01.568 INFO:tasks.workunit.client.0.smithi157.stdout:1/23: dwrite f0 [0,4194304] 0 2024-04-03T08:39:01.569 INFO:tasks.workunit.client.0.smithi157.stdout:8/10: mkdir d2 0 2024-04-03T08:39:01.570 INFO:tasks.workunit.client.0.smithi157.stdout:7/41: write d0/d4/f13 [935393,19904] 0 2024-04-03T08:39:01.576 INFO:tasks.workunit.client.0.smithi157.stdout:4/19: truncate f4 971612 0 2024-04-03T08:39:01.577 INFO:tasks.workunit.client.0.smithi157.stdout:2/21: write d3/f4 [472953,46358] 0 2024-04-03T08:39:01.580 INFO:tasks.workunit.client.0.smithi157.stdout:0/41: dwrite d2/f8 [4194304,4194304] 0 2024-04-03T08:39:01.588 INFO:tasks.workunit.client.0.smithi157.stdout:5/6: getdents . 0 2024-04-03T08:39:01.588 INFO:tasks.workunit.client.0.smithi157.stdout:5/7: dread - no filename 2024-04-03T08:39:01.589 INFO:tasks.workunit.client.0.smithi157.stdout:7/42: symlink d0/d5/l14 0 2024-04-03T08:39:01.594 INFO:tasks.workunit.client.0.smithi157.stdout:4/20: write f4 [1000573,80296] 0 2024-04-03T08:39:01.594 INFO:tasks.workunit.client.0.smithi157.stdout:2/22: write d3/f4 [1308798,60656] 0 2024-04-03T08:39:01.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:01 smithi181 ceph-mon[44183]: pgmap v290: 65 pgs: 65 active+clean; 251 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 7.0 MiB/s wr, 279 op/s 2024-04-03T08:39:01.598 INFO:tasks.workunit.client.0.smithi157.stdout:8/11: mknod d2/c3 0 2024-04-03T08:39:01.602 INFO:tasks.workunit.client.0.smithi157.stdout:1/24: mkdir d2/d6/d7 0 2024-04-03T08:39:01.604 INFO:tasks.workunit.client.0.smithi157.stdout:2/23: write d3/f4 [556012,55433] 0 2024-04-03T08:39:01.605 INFO:tasks.workunit.client.0.smithi157.stdout:7/43: mkdir d0/d11/d15 0 2024-04-03T08:39:01.607 INFO:tasks.workunit.client.0.smithi157.stdout:6/54: link d1/c8 d1/d5/d10/c13 0 2024-04-03T08:39:01.608 INFO:tasks.workunit.client.0.smithi157.stdout:7/44: stat d0/d4 0 2024-04-03T08:39:01.610 INFO:tasks.workunit.client.0.smithi157.stdout:5/8: link l0 l2 0 2024-04-03T08:39:01.611 INFO:tasks.workunit.client.0.smithi157.stdout:2/24: write d3/f4 [1125575,63010] 0 2024-04-03T08:39:01.615 INFO:tasks.workunit.client.0.smithi157.stdout:6/55: write d1/fb [4044082,82941] 0 2024-04-03T08:39:01.620 INFO:tasks.workunit.client.0.smithi157.stdout:7/45: chown d0/d4/lb 88 1 2024-04-03T08:39:01.623 INFO:tasks.workunit.client.0.smithi157.stdout:3/13: dwrite f0 [0,4194304] 0 2024-04-03T08:39:01.634 INFO:tasks.workunit.client.0.smithi157.stdout:7/46: write d0/d4/f13 [1432316,104096] 0 2024-04-03T08:39:01.645 INFO:tasks.workunit.client.0.smithi157.stdout:5/9: getdents . 0 2024-04-03T08:39:01.646 INFO:tasks.workunit.client.0.smithi157.stdout:5/10: dwrite - no filename 2024-04-03T08:39:01.646 INFO:tasks.workunit.client.0.smithi157.stdout:7/47: readlink d0/la 0 2024-04-03T08:39:01.655 INFO:tasks.workunit.client.0.smithi157.stdout:2/25: dread d3/f4 [0,4194304] 0 2024-04-03T08:39:01.662 INFO:tasks.workunit.client.0.smithi157.stdout:4/21: dwrite f7 [0,4194304] 0 2024-04-03T08:39:01.665 INFO:tasks.workunit.client.0.smithi157.stdout:0/42: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:01.666 INFO:tasks.workunit.client.0.smithi157.stdout:8/12: dwrite f1 [0,4194304] 0 2024-04-03T08:39:01.673 INFO:tasks.workunit.client.0.smithi157.stdout:5/11: chown l0 16308 1 2024-04-03T08:39:01.673 INFO:tasks.workunit.client.0.smithi157.stdout:5/12: write - no filename 2024-04-03T08:39:01.679 INFO:tasks.workunit.client.0.smithi157.stdout:2/26: creat d3/f5 x:0 0 0 2024-04-03T08:39:01.679 INFO:tasks.workunit.client.0.smithi157.stdout:2/27: readlink - no filename 2024-04-03T08:39:01.681 INFO:tasks.workunit.client.0.smithi157.stdout:4/22: rename f1 to f8 0 2024-04-03T08:39:01.682 INFO:tasks.workunit.client.0.smithi157.stdout:8/13: write f1 [2924594,106799] 0 2024-04-03T08:39:01.685 INFO:tasks.workunit.client.0.smithi157.stdout:1/25: dwrite d2/f5 [0,4194304] 0 2024-04-03T08:39:01.688 INFO:tasks.workunit.client.0.smithi157.stdout:9/40: sync 2024-04-03T08:39:01.690 INFO:tasks.workunit.client.0.smithi157.stdout:5/13: creat f3 x:0 0 0 2024-04-03T08:39:01.690 INFO:tasks.workunit.client.0.smithi157.stdout:0/43: write d2/f7 [1020910,107462] 0 2024-04-03T08:39:01.693 INFO:tasks.workunit.client.0.smithi157.stdout:1/26: stat d2/d6 0 2024-04-03T08:39:01.699 INFO:tasks.workunit.client.0.smithi157.stdout:3/14: dwrite f0 [0,4194304] 0 2024-04-03T08:39:01.700 INFO:tasks.workunit.client.0.smithi157.stdout:6/56: dwrite d1/fc [0,4194304] 0 2024-04-03T08:39:01.701 INFO:tasks.workunit.client.0.smithi157.stdout:5/14: read - f3 zero size 2024-04-03T08:39:01.702 INFO:tasks.workunit.client.0.smithi157.stdout:4/23: dread - f8 zero size 2024-04-03T08:39:01.703 INFO:tasks.workunit.client.0.smithi157.stdout:4/24: rmdir - no directory 2024-04-03T08:39:01.703 INFO:tasks.workunit.client.0.smithi157.stdout:8/14: rename d2/c3 to d2/c4 0 2024-04-03T08:39:01.704 INFO:tasks.workunit.client.0.smithi157.stdout:9/41: write d1/f3 [1924406,108926] 0 2024-04-03T08:39:01.709 INFO:tasks.workunit.client.0.smithi157.stdout:0/44: symlink d2/ld 0 2024-04-03T08:39:01.709 INFO:tasks.workunit.client.0.smithi157.stdout:3/15: write f0 [2431214,21247] 0 2024-04-03T08:39:01.710 INFO:tasks.workunit.client.0.smithi157.stdout:1/27: write d2/f5 [729689,2532] 0 2024-04-03T08:39:01.710 INFO:tasks.workunit.client.0.smithi157.stdout:2/28: write d3/f4 [1572019,62927] 0 2024-04-03T08:39:01.714 INFO:tasks.workunit.client.0.smithi157.stdout:6/57: write d1/fb [3016583,70169] 0 2024-04-03T08:39:01.716 INFO:tasks.workunit.client.0.smithi157.stdout:5/15: dread - f3 zero size 2024-04-03T08:39:01.724 INFO:tasks.workunit.client.0.smithi157.stdout:0/45: write d2/f3 [402260,128696] 0 2024-04-03T08:39:01.724 INFO:tasks.workunit.client.0.smithi157.stdout:4/25: mknod c9 0 2024-04-03T08:39:01.728 INFO:tasks.workunit.client.0.smithi157.stdout:5/16: chown l0 7988 1 2024-04-03T08:39:01.728 INFO:tasks.workunit.client.0.smithi157.stdout:2/29: creat d3/f6 x:0 0 0 2024-04-03T08:39:01.729 INFO:tasks.workunit.client.0.smithi157.stdout:3/16: rename c1 to c3 0 2024-04-03T08:39:01.729 INFO:tasks.workunit.client.0.smithi157.stdout:3/17: rmdir - no directory 2024-04-03T08:39:01.729 INFO:tasks.workunit.client.0.smithi157.stdout:1/28: mknod d2/d6/c8 0 2024-04-03T08:39:01.731 INFO:tasks.workunit.client.0.smithi157.stdout:7/48: dwrite d0/d4/ff [0,4194304] 0 2024-04-03T08:39:01.732 INFO:tasks.workunit.client.0.smithi157.stdout:4/26: mkdir da 0 2024-04-03T08:39:01.737 INFO:tasks.workunit.client.0.smithi157.stdout:0/46: readlink d2/d9/lb 0 2024-04-03T08:39:01.739 INFO:tasks.workunit.client.0.smithi157.stdout:4/27: chown l2 365141 1 2024-04-03T08:39:01.744 INFO:tasks.workunit.client.0.smithi157.stdout:2/30: creat d3/f7 x:0 0 0 2024-04-03T08:39:01.746 INFO:tasks.workunit.client.0.smithi157.stdout:0/47: fdatasync d2/f3 0 2024-04-03T08:39:01.747 INFO:tasks.workunit.client.0.smithi157.stdout:9/42: dread d1/f3 [0,4194304] 0 2024-04-03T08:39:01.751 INFO:tasks.workunit.client.0.smithi157.stdout:7/49: read d0/d4/f13 [477274,24828] 0 2024-04-03T08:39:01.753 INFO:tasks.workunit.client.0.smithi157.stdout:1/29: creat d2/d6/d7/f9 x:0 0 0 2024-04-03T08:39:01.753 INFO:tasks.workunit.client.0.smithi157.stdout:2/31: write d3/f7 [199732,101331] 0 2024-04-03T08:39:01.755 INFO:tasks.workunit.client.0.smithi157.stdout:4/28: creat da/fb x:0 0 0 2024-04-03T08:39:01.759 INFO:tasks.workunit.client.0.smithi157.stdout:9/43: creat d1/fc x:0 0 0 2024-04-03T08:39:01.764 INFO:tasks.workunit.client.0.smithi157.stdout:7/50: mkdir d0/d16 0 2024-04-03T08:39:01.767 INFO:tasks.workunit.client.0.smithi157.stdout:8/15: dwrite f1 [4194304,4194304] 0 2024-04-03T08:39:01.767 INFO:tasks.workunit.client.0.smithi157.stdout:2/32: rmdir d3 39 2024-04-03T08:39:01.771 INFO:tasks.workunit.client.0.smithi157.stdout:0/48: write d2/f6 [368727,29178] 0 2024-04-03T08:39:01.779 INFO:tasks.workunit.client.0.smithi157.stdout:3/18: dread f0 [0,4194304] 0 2024-04-03T08:39:01.779 INFO:tasks.workunit.client.0.smithi157.stdout:2/33: mkdir d3/d8 0 2024-04-03T08:39:01.779 INFO:tasks.workunit.client.0.smithi157.stdout:9/44: write d1/f3 [1467551,69729] 0 2024-04-03T08:39:01.779 INFO:tasks.workunit.client.0.smithi157.stdout:6/58: dwrite d1/fc [0,4194304] 0 2024-04-03T08:39:01.785 INFO:tasks.workunit.client.0.smithi157.stdout:3/19: read f0 [693428,94621] 0 2024-04-03T08:39:01.786 INFO:tasks.workunit.client.0.smithi157.stdout:7/51: mkdir d0/d11/d15/d17 0 2024-04-03T08:39:01.786 INFO:tasks.workunit.client.0.smithi157.stdout:5/17: dwrite f3 [0,4194304] 0 2024-04-03T08:39:01.786 INFO:tasks.workunit.client.0.smithi157.stdout:6/59: rename d1/c2 to d1/d5/d10/c14 0 2024-04-03T08:39:01.791 INFO:tasks.workunit.client.0.smithi157.stdout:4/29: truncate f4 365285 0 2024-04-03T08:39:01.794 INFO:tasks.workunit.client.0.smithi157.stdout:3/20: creat f4 x:0 0 0 2024-04-03T08:39:01.800 INFO:tasks.workunit.client.0.smithi157.stdout:0/49: getdents d2 0 2024-04-03T08:39:01.805 INFO:tasks.workunit.client.0.smithi157.stdout:3/21: symlink l5 0 2024-04-03T08:39:01.807 INFO:tasks.workunit.client.0.smithi157.stdout:8/16: fdatasync f1 0 2024-04-03T08:39:01.809 INFO:tasks.workunit.client.0.smithi157.stdout:0/50: chown d2/fa 260064057 1 2024-04-03T08:39:01.810 INFO:tasks.workunit.client.0.smithi157.stdout:1/30: dwrite d2/d6/d7/f9 [0,4194304] 0 2024-04-03T08:39:01.816 INFO:tasks.workunit.client.0.smithi157.stdout:3/22: truncate f4 949514 0 2024-04-03T08:39:01.818 INFO:tasks.workunit.client.0.smithi157.stdout:7/52: dread d0/d4/f13 [0,4194304] 0 2024-04-03T08:39:01.821 INFO:tasks.workunit.client.0.smithi157.stdout:0/51: creat d2/d9/fe x:0 0 0 2024-04-03T08:39:01.824 INFO:tasks.workunit.client.0.smithi157.stdout:8/17: creat d2/f5 x:0 0 0 2024-04-03T08:39:01.824 INFO:tasks.workunit.client.0.smithi157.stdout:1/31: mknod d2/d6/d7/ca 0 2024-04-03T08:39:01.825 INFO:tasks.workunit.client.0.smithi157.stdout:2/34: dwrite d3/f4 [0,4194304] 0 2024-04-03T08:39:01.825 INFO:tasks.workunit.client.0.smithi157.stdout:0/52: readlink d2/ld 0 2024-04-03T08:39:01.826 INFO:tasks.workunit.client.0.smithi157.stdout:6/60: write d1/f3 [6334987,4740] 0 2024-04-03T08:39:01.830 INFO:tasks.workunit.client.0.smithi157.stdout:2/35: fsync d3/f5 0 2024-04-03T08:39:01.837 INFO:tasks.workunit.client.0.smithi157.stdout:2/36: creat d3/f9 x:0 0 0 2024-04-03T08:39:01.838 INFO:tasks.workunit.client.0.smithi157.stdout:0/53: mkdir d2/d9/dc/df 0 2024-04-03T08:39:01.839 INFO:tasks.workunit.client.0.smithi157.stdout:5/18: dwrite f3 [4194304,4194304] 0 2024-04-03T08:39:01.839 INFO:tasks.workunit.client.0.smithi157.stdout:7/53: link d0/f2 d0/d4/f18 0 2024-04-03T08:39:01.840 INFO:tasks.workunit.client.0.smithi157.stdout:6/61: dread - d1/ff zero size 2024-04-03T08:39:01.856 INFO:tasks.workunit.client.0.smithi157.stdout:7/54: rename d0/d4/fd to d0/d11/d15/d17/f19 0 2024-04-03T08:39:01.857 INFO:tasks.workunit.client.0.smithi157.stdout:5/19: link l1 l4 0 2024-04-03T08:39:01.859 INFO:tasks.workunit.client.0.smithi157.stdout:3/23: dwrite f0 [0,4194304] 0 2024-04-03T08:39:01.860 INFO:tasks.workunit.client.0.smithi157.stdout:5/20: mknod c5 0 2024-04-03T08:39:01.865 INFO:tasks.workunit.client.0.smithi157.stdout:7/55: mknod d0/d11/d15/c1a 0 2024-04-03T08:39:01.865 INFO:tasks.workunit.client.0.smithi157.stdout:3/24: truncate f4 1478668 0 2024-04-03T08:39:01.865 INFO:tasks.workunit.client.0.smithi157.stdout:1/32: dwrite d2/f5 [0,4194304] 0 2024-04-03T08:39:01.866 INFO:tasks.workunit.client.0.smithi157.stdout:5/21: mknod c6 0 2024-04-03T08:39:01.867 INFO:tasks.workunit.client.0.smithi157.stdout:3/25: fsync f4 0 2024-04-03T08:39:01.868 INFO:tasks.workunit.client.0.smithi157.stdout:7/56: chown d0 3587 1 2024-04-03T08:39:01.870 INFO:tasks.workunit.client.0.smithi157.stdout:5/22: fdatasync f3 0 2024-04-03T08:39:01.870 INFO:tasks.workunit.client.0.smithi157.stdout:1/33: chown d2/d6/d7 1458 1 2024-04-03T08:39:01.871 INFO:tasks.workunit.client.0.smithi157.stdout:5/23: fdatasync f3 0 2024-04-03T08:39:01.876 INFO:tasks.workunit.client.0.smithi157.stdout:5/24: write f3 [6772536,7656] 0 2024-04-03T08:39:01.876 INFO:tasks.workunit.client.0.smithi157.stdout:7/57: mkdir d0/d11/d15/d1b 0 2024-04-03T08:39:01.877 INFO:tasks.workunit.client.0.smithi157.stdout:2/37: dwrite d3/f7 [0,4194304] 0 2024-04-03T08:39:01.879 INFO:tasks.workunit.client.0.smithi157.stdout:6/62: dread d1/f3 [4194304,4194304] 0 2024-04-03T08:39:01.879 INFO:tasks.workunit.client.0.smithi157.stdout:3/26: getdents . 0 2024-04-03T08:39:01.880 INFO:tasks.workunit.client.0.smithi157.stdout:5/25: read f3 [7167036,94765] 0 2024-04-03T08:39:01.888 INFO:tasks.workunit.client.0.smithi157.stdout:5/26: chown l4 1484674 1 2024-04-03T08:39:01.895 INFO:tasks.workunit.client.0.smithi157.stdout:6/63: symlink d1/l15 0 2024-04-03T08:39:01.896 INFO:tasks.workunit.client.0.smithi157.stdout:5/27: rename f3 to f7 0 2024-04-03T08:39:01.897 INFO:tasks.workunit.client.0.smithi157.stdout:1/34: truncate f0 1495070 0 2024-04-03T08:39:01.898 INFO:tasks.workunit.client.0.smithi157.stdout:2/38: link d3/f6 d3/d8/fa 0 2024-04-03T08:39:01.898 INFO:tasks.workunit.client.0.smithi157.stdout:2/39: readlink - no filename 2024-04-03T08:39:01.898 INFO:tasks.workunit.client.0.smithi157.stdout:2/40: readlink - no filename 2024-04-03T08:39:01.899 INFO:tasks.workunit.client.0.smithi157.stdout:5/28: chown l2 85297 1 2024-04-03T08:39:01.900 INFO:tasks.workunit.client.0.smithi157.stdout:7/58: write d0/f2 [3166244,71074] 0 2024-04-03T08:39:01.904 INFO:tasks.workunit.client.0.smithi157.stdout:2/41: mkdir d3/db 0 2024-04-03T08:39:01.907 INFO:tasks.workunit.client.0.smithi157.stdout:6/64: fsync d1/d5/f7 0 2024-04-03T08:39:01.907 INFO:tasks.workunit.client.0.smithi157.stdout:2/42: dread - d3/f6 zero size 2024-04-03T08:39:01.907 INFO:tasks.workunit.client.0.smithi157.stdout:1/35: symlink d2/d6/d7/lb 0 2024-04-03T08:39:01.909 INFO:tasks.workunit.client.0.smithi157.stdout:3/27: dwrite f0 [0,4194304] 0 2024-04-03T08:39:01.917 INFO:tasks.workunit.client.0.smithi157.stdout:3/28: mknod c6 0 2024-04-03T08:39:01.926 INFO:tasks.workunit.client.0.smithi157.stdout:6/65: rename d1/c8 to d1/d5/c16 0 2024-04-03T08:39:01.931 INFO:tasks.workunit.client.0.smithi157.stdout:9/45: sync 2024-04-03T08:39:01.931 INFO:tasks.workunit.client.0.smithi157.stdout:7/59: truncate d0/d4/ff 1151148 0 2024-04-03T08:39:01.934 INFO:tasks.workunit.client.0.smithi157.stdout:5/29: dwrite f7 [8388608,4194304] 0 2024-04-03T08:39:01.935 INFO:tasks.workunit.client.0.smithi157.stdout:6/66: mkdir d1/d5/d17 0 2024-04-03T08:39:01.937 INFO:tasks.workunit.client.0.smithi157.stdout:9/46: creat d1/fd x:0 0 0 2024-04-03T08:39:01.938 INFO:tasks.workunit.client.0.smithi157.stdout:2/43: dread d3/f7 [0,4194304] 0 2024-04-03T08:39:01.940 INFO:tasks.workunit.client.0.smithi157.stdout:2/44: read - d3/f6 zero size 2024-04-03T08:39:01.941 INFO:tasks.workunit.client.0.smithi157.stdout:7/60: mkdir d0/d11/d15/d17/d1c 0 2024-04-03T08:39:01.942 INFO:tasks.workunit.client.0.smithi157.stdout:1/36: dwrite d2/f5 [0,4194304] 0 2024-04-03T08:39:01.942 INFO:tasks.workunit.client.0.smithi157.stdout:3/29: dread f0 [0,4194304] 0 2024-04-03T08:39:01.944 INFO:tasks.workunit.client.0.smithi157.stdout:6/67: creat d1/d5/f18 x:0 0 0 2024-04-03T08:39:01.947 INFO:tasks.workunit.client.0.smithi157.stdout:2/45: mkdir d3/dc 0 2024-04-03T08:39:01.947 INFO:tasks.workunit.client.0.smithi157.stdout:1/37: chown d2/d6/d7/f9 1020290183 1 2024-04-03T08:39:01.951 INFO:tasks.workunit.client.0.smithi157.stdout:1/38: chown d2/f5 42480548 1 2024-04-03T08:39:01.951 INFO:tasks.workunit.client.0.smithi157.stdout:3/30: unlink c6 0 2024-04-03T08:39:01.957 INFO:tasks.workunit.client.0.smithi157.stdout:2/46: truncate d3/f6 147512 0 2024-04-03T08:39:01.957 INFO:tasks.workunit.client.0.smithi157.stdout:2/47: readlink - no filename 2024-04-03T08:39:01.960 INFO:tasks.workunit.client.0.smithi157.stdout:1/39: creat d2/fc x:0 0 0 2024-04-03T08:39:01.960 INFO:tasks.workunit.client.0.smithi157.stdout:5/30: dread f7 [4194304,4194304] 0 2024-04-03T08:39:01.962 INFO:tasks.workunit.client.0.smithi157.stdout:6/68: mknod d1/d5/d17/c19 0 2024-04-03T08:39:01.966 INFO:tasks.workunit.client.0.smithi157.stdout:3/31: link c3 c7 0 2024-04-03T08:39:01.966 INFO:tasks.workunit.client.0.smithi157.stdout:3/32: rmdir - no directory 2024-04-03T08:39:01.970 INFO:tasks.workunit.client.0.smithi157.stdout:2/48: creat d3/d8/fd x:0 0 0 2024-04-03T08:39:01.971 INFO:tasks.workunit.client.0.smithi157.stdout:3/33: chown f4 29 1 2024-04-03T08:39:01.973 INFO:tasks.workunit.client.0.smithi157.stdout:7/61: dwrite d0/d4/f18 [4194304,4194304] 0 2024-04-03T08:39:01.975 INFO:tasks.workunit.client.0.smithi157.stdout:7/62: chown d0/d11/d15 3377627 1 2024-04-03T08:39:01.977 INFO:tasks.workunit.client.0.smithi157.stdout:3/34: fsync f0 0 2024-04-03T08:39:01.977 INFO:tasks.workunit.client.0.smithi157.stdout:3/35: readlink l5 0 2024-04-03T08:39:01.978 INFO:tasks.workunit.client.0.smithi157.stdout:1/40: link d2/d6/d7/lb d2/d6/ld 0 2024-04-03T08:39:01.983 INFO:tasks.workunit.client.0.smithi157.stdout:5/31: truncate f7 9820838 0 2024-04-03T08:39:01.984 INFO:tasks.workunit.client.0.smithi157.stdout:5/32: stat l2 0 2024-04-03T08:39:01.985 INFO:tasks.workunit.client.0.smithi157.stdout:2/49: write d3/f6 [882432,65739] 0 2024-04-03T08:39:01.987 INFO:tasks.workunit.client.0.smithi157.stdout:6/69: dread d1/f3 [4194304,4194304] 0 2024-04-03T08:39:01.988 INFO:tasks.workunit.client.0.smithi157.stdout:7/63: rename d0/d4/ff to d0/d11/f1d 0 2024-04-03T08:39:01.989 INFO:tasks.workunit.client.0.smithi157.stdout:5/33: creat f8 x:0 0 0 2024-04-03T08:39:01.992 INFO:tasks.workunit.client.0.smithi157.stdout:2/50: creat d3/d8/fe x:0 0 0 2024-04-03T08:39:01.993 INFO:tasks.workunit.client.0.smithi157.stdout:6/70: fsync d1/d5/f7 0 2024-04-03T08:39:01.996 INFO:tasks.workunit.client.0.smithi157.stdout:2/51: stat d3/f4 0 2024-04-03T08:39:02.005 INFO:tasks.workunit.client.0.smithi157.stdout:3/36: dwrite f0 [4194304,4194304] 0 2024-04-03T08:39:02.007 INFO:tasks.workunit.client.0.smithi157.stdout:2/52: dread d3/d8/fa [0,4194304] 0 2024-04-03T08:39:02.008 INFO:tasks.workunit.client.0.smithi157.stdout:2/53: dread - d3/d8/fe zero size 2024-04-03T08:39:02.009 INFO:tasks.workunit.client.0.smithi157.stdout:3/37: mkdir d8 0 2024-04-03T08:39:02.012 INFO:tasks.workunit.client.0.smithi157.stdout:7/64: dread d0/d4/f18 [0,4194304] 0 2024-04-03T08:39:02.013 INFO:tasks.workunit.client.0.smithi157.stdout:2/54: rmdir d3/dc 0 2024-04-03T08:39:02.014 INFO:tasks.workunit.client.0.smithi157.stdout:5/34: dread f7 [0,4194304] 0 2024-04-03T08:39:02.017 INFO:tasks.workunit.client.0.smithi157.stdout:2/55: creat d3/d8/ff x:0 0 0 2024-04-03T08:39:02.018 INFO:tasks.workunit.client.0.smithi157.stdout:7/65: rename d0/d4/lb to d0/d11/l1e 0 2024-04-03T08:39:02.021 INFO:tasks.workunit.client.0.smithi157.stdout:5/35: rename l0 to l9 0 2024-04-03T08:39:02.021 INFO:tasks.workunit.client.0.smithi157.stdout:2/56: getdents d3/db 0 2024-04-03T08:39:02.022 INFO:tasks.workunit.client.0.smithi157.stdout:2/57: read - d3/d8/ff zero size 2024-04-03T08:39:02.024 INFO:tasks.workunit.client.0.smithi157.stdout:5/36: link f7 fa 0 2024-04-03T08:39:02.024 INFO:tasks.workunit.client.0.smithi157.stdout:2/58: write d3/d8/ff [633451,128951] 0 2024-04-03T08:39:02.027 INFO:tasks.workunit.client.0.smithi157.stdout:2/59: write d3/f7 [3292338,36072] 0 2024-04-03T08:39:02.032 INFO:tasks.workunit.client.0.smithi157.stdout:2/60: write d3/d8/fd [513949,89393] 0 2024-04-03T08:39:02.035 INFO:tasks.workunit.client.0.smithi157.stdout:5/37: fsync f7 0 2024-04-03T08:39:02.038 INFO:tasks.workunit.client.0.smithi157.stdout:5/38: stat l9 0 2024-04-03T08:39:02.040 INFO:tasks.workunit.client.0.smithi157.stdout:7/66: dwrite d0/d4/f13 [0,4194304] 0 2024-04-03T08:39:02.048 INFO:tasks.workunit.client.0.smithi157.stdout:8/18: sync 2024-04-03T08:39:02.048 INFO:tasks.workunit.client.0.smithi157.stdout:4/30: sync 2024-04-03T08:39:02.055 INFO:tasks.workunit.client.0.smithi157.stdout:4/31: truncate f7 5103097 0 2024-04-03T08:39:02.055 INFO:tasks.workunit.client.0.smithi157.stdout:8/19: rename f1 to d2/f6 0 2024-04-03T08:39:02.062 INFO:tasks.workunit.client.0.smithi157.stdout:2/61: dwrite d3/f9 [0,4194304] 0 2024-04-03T08:39:02.063 INFO:tasks.workunit.client.0.smithi157.stdout:8/20: write d2/f6 [2307935,55746] 0 2024-04-03T08:39:02.063 INFO:tasks.workunit.client.0.smithi157.stdout:8/21: readlink - no filename 2024-04-03T08:39:02.064 INFO:tasks.workunit.client.0.smithi157.stdout:7/67: dread d0/d4/f18 [4194304,4194304] 0 2024-04-03T08:39:02.069 INFO:tasks.workunit.client.0.smithi157.stdout:2/62: truncate d3/f5 1023295 0 2024-04-03T08:39:02.069 INFO:tasks.workunit.client.0.smithi157.stdout:2/63: readlink - no filename 2024-04-03T08:39:02.069 INFO:tasks.workunit.client.0.smithi157.stdout:8/22: symlink d2/l7 0 2024-04-03T08:39:02.070 INFO:tasks.workunit.client.0.smithi157.stdout:5/39: dwrite f8 [0,4194304] 0 2024-04-03T08:39:02.073 INFO:tasks.workunit.client.0.smithi157.stdout:2/64: chown d3/f4 216 1 2024-04-03T08:39:02.074 INFO:tasks.workunit.client.0.smithi157.stdout:7/68: truncate d0/d4/f10 528526 0 2024-04-03T08:39:02.076 INFO:tasks.workunit.client.0.smithi157.stdout:7/69: stat d0/d16 0 2024-04-03T08:39:02.077 INFO:tasks.workunit.client.0.smithi157.stdout:5/40: rename l4 to lb 0 2024-04-03T08:39:02.081 INFO:tasks.workunit.client.0.smithi157.stdout:2/65: creat d3/db/f10 x:0 0 0 2024-04-03T08:39:02.084 INFO:tasks.workunit.client.0.smithi157.stdout:7/70: creat d0/d11/d15/f1f x:0 0 0 2024-04-03T08:39:02.088 INFO:tasks.workunit.client.0.smithi157.stdout:4/32: dwrite da/fb [0,4194304] 0 2024-04-03T08:39:02.089 INFO:tasks.workunit.client.0.smithi157.stdout:7/71: stat d0/d4/l8 0 2024-04-03T08:39:02.097 INFO:tasks.workunit.client.0.smithi157.stdout:7/72: stat d0/d11/l1e 0 2024-04-03T08:39:02.099 INFO:tasks.workunit.client.0.smithi157.stdout:8/23: dwrite d2/f6 [0,4194304] 0 2024-04-03T08:39:02.101 INFO:tasks.workunit.client.0.smithi157.stdout:5/41: dread f8 [0,4194304] 0 2024-04-03T08:39:02.101 INFO:tasks.workunit.client.0.smithi157.stdout:7/73: creat d0/f20 x:0 0 0 2024-04-03T08:39:02.103 INFO:tasks.workunit.client.0.smithi157.stdout:8/24: creat d2/f8 x:0 0 0 2024-04-03T08:39:02.104 INFO:tasks.workunit.client.0.smithi157.stdout:5/42: mkdir dc 0 2024-04-03T08:39:02.105 INFO:tasks.workunit.client.0.smithi157.stdout:2/66: dread d3/f4 [0,4194304] 0 2024-04-03T08:39:02.109 INFO:tasks.workunit.client.0.smithi157.stdout:8/25: rename d2/f8 to d2/f9 0 2024-04-03T08:39:02.110 INFO:tasks.workunit.client.0.smithi157.stdout:8/26: readlink d2/l7 0 2024-04-03T08:39:02.112 INFO:tasks.workunit.client.0.smithi157.stdout:2/67: dread d3/d8/fa [0,4194304] 0 2024-04-03T08:39:02.113 INFO:tasks.workunit.client.0.smithi157.stdout:4/33: write f4 [176344,19810] 0 2024-04-03T08:39:02.117 INFO:tasks.workunit.client.0.smithi157.stdout:5/43: link f8 dc/fd 0 2024-04-03T08:39:02.117 INFO:tasks.workunit.client.0.smithi157.stdout:2/68: write d3/f9 [1849706,42102] 0 2024-04-03T08:39:02.118 INFO:tasks.workunit.client.0.smithi157.stdout:8/27: mknod d2/ca 0 2024-04-03T08:39:02.121 INFO:tasks.workunit.client.0.smithi157.stdout:5/44: mknod dc/ce 0 2024-04-03T08:39:02.123 INFO:tasks.workunit.client.0.smithi157.stdout:2/69: write d3/d8/fe [184093,113839] 0 2024-04-03T08:39:02.125 INFO:tasks.workunit.client.0.smithi157.stdout:8/28: rmdir d2 39 2024-04-03T08:39:02.128 INFO:tasks.workunit.client.0.smithi157.stdout:5/45: creat dc/ff x:0 0 0 2024-04-03T08:39:02.128 INFO:tasks.workunit.client.0.smithi157.stdout:2/70: creat d3/d8/f11 x:0 0 0 2024-04-03T08:39:02.128 INFO:tasks.workunit.client.0.smithi157.stdout:4/34: write f8 [248401,102453] 0 2024-04-03T08:39:02.128 INFO:tasks.workunit.client.0.smithi157.stdout:7/74: dwrite d0/d4/f18 [0,4194304] 0 2024-04-03T08:39:02.130 INFO:tasks.workunit.client.0.smithi157.stdout:5/46: chown l2 5 1 2024-04-03T08:39:02.131 INFO:tasks.workunit.client.0.smithi157.stdout:4/35: write f8 [951291,14142] 0 2024-04-03T08:39:02.134 INFO:tasks.workunit.client.0.smithi157.stdout:7/75: chown d0/cc 5708 1 2024-04-03T08:39:02.134 INFO:tasks.workunit.client.0.smithi157.stdout:4/36: fdatasync f8 0 2024-04-03T08:39:02.134 INFO:tasks.workunit.client.0.smithi157.stdout:2/71: write d3/f6 [831398,25656] 0 2024-04-03T08:39:02.135 INFO:tasks.workunit.client.0.smithi157.stdout:8/29: rename d2/f5 to d2/fb 0 2024-04-03T08:39:02.138 INFO:tasks.workunit.client.0.smithi157.stdout:5/47: rename lb to dc/l10 0 2024-04-03T08:39:02.141 INFO:tasks.workunit.client.0.smithi157.stdout:8/30: mknod d2/cc 0 2024-04-03T08:39:02.141 INFO:tasks.workunit.client.0.smithi157.stdout:2/72: dread - d3/db/f10 zero size 2024-04-03T08:39:02.141 INFO:tasks.workunit.client.0.smithi157.stdout:7/76: creat d0/d11/f21 x:0 0 0 2024-04-03T08:39:02.141 INFO:tasks.workunit.client.0.smithi157.stdout:4/37: creat da/fc x:0 0 0 2024-04-03T08:39:02.142 INFO:tasks.workunit.client.0.smithi157.stdout:5/48: creat dc/f11 x:0 0 0 2024-04-03T08:39:02.144 INFO:tasks.workunit.client.0.smithi157.stdout:8/31: truncate d2/f9 597899 0 2024-04-03T08:39:02.144 INFO:tasks.workunit.client.0.smithi157.stdout:5/49: read - dc/f11 zero size 2024-04-03T08:39:02.147 INFO:tasks.workunit.client.0.smithi157.stdout:8/32: write d2/fb [865152,96032] 0 2024-04-03T08:39:02.149 INFO:tasks.workunit.client.0.smithi157.stdout:8/33: write d2/fb [752061,21761] 0 2024-04-03T08:39:02.150 INFO:tasks.workunit.client.0.smithi157.stdout:2/73: rename d3/d8 to d3/d12 0 2024-04-03T08:39:02.150 INFO:tasks.workunit.client.0.smithi157.stdout:7/77: getdents d0/d5 0 2024-04-03T08:39:02.156 INFO:tasks.workunit.client.0.smithi157.stdout:2/74: mknod d3/db/c13 0 2024-04-03T08:39:02.159 INFO:tasks.workunit.client.0.smithi157.stdout:8/34: dread d2/f9 [0,4194304] 0 2024-04-03T08:39:02.160 INFO:tasks.workunit.client.0.smithi157.stdout:2/75: stat d3/d12/fd 0 2024-04-03T08:39:02.160 INFO:tasks.workunit.client.0.smithi157.stdout:7/78: symlink d0/d11/d15/d1b/l22 0 2024-04-03T08:39:02.164 INFO:tasks.workunit.client.0.smithi157.stdout:0/54: sync 2024-04-03T08:39:02.166 INFO:tasks.workunit.client.0.smithi157.stdout:4/38: dwrite f7 [0,4194304] 0 2024-04-03T08:39:02.167 INFO:tasks.workunit.client.0.smithi157.stdout:5/50: dread fa [0,4194304] 0 2024-04-03T08:39:02.168 INFO:tasks.workunit.client.0.smithi157.stdout:7/79: creat d0/d5/f23 x:0 0 0 2024-04-03T08:39:02.169 INFO:tasks.workunit.client.0.smithi157.stdout:2/76: mknod d3/d12/c14 0 2024-04-03T08:39:02.172 INFO:tasks.workunit.client.0.smithi157.stdout:7/80: write d0/f20 [965343,35481] 0 2024-04-03T08:39:02.174 INFO:tasks.workunit.client.0.smithi157.stdout:0/55: unlink d2/f8 0 2024-04-03T08:39:02.182 INFO:tasks.workunit.client.0.smithi157.stdout:2/77: rename d3/d12/ff to d3/d12/f15 0 2024-04-03T08:39:02.185 INFO:tasks.workunit.client.0.smithi157.stdout:0/56: dread d2/f7 [0,4194304] 0 2024-04-03T08:39:02.185 INFO:tasks.workunit.client.0.smithi157.stdout:7/81: fsync d0/d4/f10 0 2024-04-03T08:39:02.186 INFO:tasks.workunit.client.0.smithi157.stdout:2/78: mknod d3/c16 0 2024-04-03T08:39:02.191 INFO:tasks.workunit.client.0.smithi157.stdout:8/35: truncate d2/f6 1876988 0 2024-04-03T08:39:02.191 INFO:tasks.workunit.client.0.smithi157.stdout:0/57: chown d2/f6 4221106 1 2024-04-03T08:39:02.192 INFO:tasks.workunit.client.0.smithi157.stdout:2/79: symlink d3/l17 0 2024-04-03T08:39:02.194 INFO:tasks.workunit.client.0.smithi157.stdout:5/51: dwrite f7 [4194304,4194304] 0 2024-04-03T08:39:02.196 INFO:tasks.workunit.client.0.smithi157.stdout:0/58: chown d2/fa 237101446 1 2024-04-03T08:39:02.197 INFO:tasks.workunit.client.0.smithi157.stdout:2/80: fdatasync d3/d12/fa 0 2024-04-03T08:39:02.197 INFO:tasks.workunit.client.0.smithi157.stdout:8/36: creat d2/fd x:0 0 0 2024-04-03T08:39:02.197 INFO:tasks.workunit.client.0.smithi157.stdout:4/39: dwrite f4 [0,4194304] 0 2024-04-03T08:39:02.200 INFO:tasks.workunit.client.0.smithi157.stdout:7/82: creat d0/d11/d15/d17/d1c/f24 x:0 0 0 2024-04-03T08:39:02.201 INFO:tasks.workunit.client.0.smithi157.stdout:5/52: dread - dc/ff zero size 2024-04-03T08:39:02.204 INFO:tasks.workunit.client.0.smithi157.stdout:9/47: sync 2024-04-03T08:39:02.204 INFO:tasks.workunit.client.0.smithi157.stdout:6/71: sync 2024-04-03T08:39:02.204 INFO:tasks.workunit.client.0.smithi157.stdout:1/41: sync 2024-04-03T08:39:02.205 INFO:tasks.workunit.client.0.smithi157.stdout:3/38: sync 2024-04-03T08:39:02.209 INFO:tasks.workunit.client.0.smithi157.stdout:1/42: chown d2 2476647 1 2024-04-03T08:39:02.210 INFO:tasks.workunit.client.0.smithi157.stdout:0/59: dread d2/f7 [0,4194304] 0 2024-04-03T08:39:02.212 INFO:tasks.workunit.client.0.smithi157.stdout:2/81: creat d3/d12/f18 x:0 0 0 2024-04-03T08:39:02.215 INFO:tasks.workunit.client.0.smithi157.stdout:7/83: unlink d0/d4/ce 0 2024-04-03T08:39:02.219 INFO:tasks.workunit.client.0.smithi157.stdout:5/53: creat dc/f12 x:0 0 0 2024-04-03T08:39:02.223 INFO:tasks.workunit.client.0.smithi157.stdout:7/84: chown d0/d4/f18 363 1 2024-04-03T08:39:02.223 INFO:tasks.workunit.client.0.smithi157.stdout:5/54: read fa [1322648,21862] 0 2024-04-03T08:39:02.224 INFO:tasks.workunit.client.0.smithi157.stdout:1/43: creat d2/d6/d7/fe x:0 0 0 2024-04-03T08:39:02.225 INFO:tasks.workunit.client.0.smithi157.stdout:2/82: symlink d3/db/l19 0 2024-04-03T08:39:02.227 INFO:tasks.workunit.client.0.smithi157.stdout:3/39: creat d8/f9 x:0 0 0 2024-04-03T08:39:02.230 INFO:tasks.workunit.client.0.smithi157.stdout:2/83: stat d3/d12/fa 0 2024-04-03T08:39:02.232 INFO:tasks.workunit.client.0.smithi157.stdout:3/40: write f0 [1021171,25493] 0 2024-04-03T08:39:02.234 INFO:tasks.workunit.client.0.smithi157.stdout:1/44: creat d2/d6/ff x:0 0 0 2024-04-03T08:39:02.238 INFO:tasks.workunit.client.0.smithi157.stdout:8/37: dwrite d2/fb [0,4194304] 0 2024-04-03T08:39:02.239 INFO:tasks.workunit.client.0.smithi157.stdout:7/85: rename d0/d4/f18 to d0/d11/d15/d17/f25 0 2024-04-03T08:39:02.241 INFO:tasks.workunit.client.0.smithi157.stdout:3/41: read - d8/f9 zero size 2024-04-03T08:39:02.245 INFO:tasks.workunit.client.0.smithi157.stdout:7/86: symlink d0/l26 0 2024-04-03T08:39:02.246 INFO:tasks.workunit.client.0.smithi157.stdout:1/45: write d2/f5 [1946939,58237] 0 2024-04-03T08:39:02.248 INFO:tasks.workunit.client.0.smithi157.stdout:2/84: link d3/f4 d3/db/f1a 0 2024-04-03T08:39:02.249 INFO:tasks.workunit.client.0.smithi157.stdout:3/42: creat d8/fa x:0 0 0 2024-04-03T08:39:02.252 INFO:tasks.workunit.client.0.smithi157.stdout:1/46: chown d2/d6/d7 1990 1 2024-04-03T08:39:02.253 INFO:tasks.workunit.client.0.smithi157.stdout:2/85: fdatasync d3/f5 0 2024-04-03T08:39:02.258 INFO:tasks.workunit.client.0.smithi157.stdout:9/48: dwrite d1/fb [0,4194304] 0 2024-04-03T08:39:02.258 INFO:tasks.workunit.client.0.smithi157.stdout:3/43: fdatasync d8/fa 0 2024-04-03T08:39:02.260 INFO:tasks.workunit.client.0.smithi157.stdout:0/60: dwrite d2/f6 [0,4194304] 0 2024-04-03T08:39:02.263 INFO:tasks.workunit.client.0.smithi157.stdout:6/72: dwrite d1/fc [0,4194304] 0 2024-04-03T08:39:02.264 INFO:tasks.workunit.client.0.smithi157.stdout:7/87: fsync d0/d11/d15/d17/f19 0 2024-04-03T08:39:02.266 INFO:tasks.workunit.client.0.smithi157.stdout:0/61: write d2/fa [1460669,69029] 0 2024-04-03T08:39:02.266 INFO:tasks.workunit.client.0.smithi157.stdout:1/47: symlink d2/d6/d7/l10 0 2024-04-03T08:39:02.267 INFO:tasks.workunit.client.0.smithi157.stdout:6/73: read d1/fc [1743235,81420] 0 2024-04-03T08:39:02.271 INFO:tasks.workunit.client.0.smithi157.stdout:7/88: dread - d0/d11/d15/f1f zero size 2024-04-03T08:39:02.272 INFO:tasks.workunit.client.0.smithi157.stdout:2/86: rename d3/d12/f18 to d3/db/f1b 0 2024-04-03T08:39:02.275 INFO:tasks.workunit.client.0.smithi157.stdout:7/89: readlink d0/d11/l1e 0 2024-04-03T08:39:02.275 INFO:tasks.workunit.client.0.smithi157.stdout:1/48: mkdir d2/d11 0 2024-04-03T08:39:02.275 INFO:tasks.workunit.client.0.smithi157.stdout:2/87: dread - d3/db/f10 zero size 2024-04-03T08:39:02.276 INFO:tasks.workunit.client.0.smithi157.stdout:3/44: link l5 d8/lb 0 2024-04-03T08:39:02.276 INFO:tasks.workunit.client.0.smithi157.stdout:6/74: rmdir d1 39 2024-04-03T08:39:02.282 INFO:tasks.workunit.client.0.smithi157.stdout:7/90: unlink d0/f2 0 2024-04-03T08:39:02.283 INFO:tasks.workunit.client.0.smithi157.stdout:1/49: mknod d2/d6/d7/c12 0 2024-04-03T08:39:02.287 INFO:tasks.workunit.client.0.smithi157.stdout:9/49: dread d1/fb [0,4194304] 0 2024-04-03T08:39:02.289 INFO:tasks.workunit.client.0.smithi157.stdout:1/50: creat d2/d6/f13 x:0 0 0 2024-04-03T08:39:02.299 INFO:tasks.workunit.client.0.smithi157.stdout:9/50: link d1/f3 d1/fe 0 2024-04-03T08:39:02.305 INFO:tasks.workunit.client.0.smithi157.stdout:0/62: dwrite d2/fa [0,4194304] 0 2024-04-03T08:39:02.307 INFO:tasks.workunit.client.0.smithi157.stdout:3/45: dwrite d8/f9 [0,4194304] 0 2024-04-03T08:39:02.312 INFO:tasks.workunit.client.0.smithi157.stdout:0/63: mknod d2/c10 0 2024-04-03T08:39:02.315 INFO:tasks.workunit.client.0.smithi157.stdout:0/64: chown d2 138 1 2024-04-03T08:39:02.315 INFO:tasks.workunit.client.0.smithi157.stdout:2/88: dwrite d3/d12/fa [0,4194304] 0 2024-04-03T08:39:02.315 INFO:tasks.workunit.client.0.smithi157.stdout:3/46: creat d8/fc x:0 0 0 2024-04-03T08:39:02.325 INFO:tasks.workunit.client.0.smithi157.stdout:3/47: rename d8/lb to d8/ld 0 2024-04-03T08:39:02.325 INFO:tasks.workunit.client.0.smithi157.stdout:2/89: symlink d3/d12/l1c 0 2024-04-03T08:39:02.328 INFO:tasks.workunit.client.0.smithi157.stdout:2/90: truncate d3/db/f1b 750839 0 2024-04-03T08:39:02.329 INFO:tasks.workunit.client.0.smithi157.stdout:3/48: rename f0 to d8/fe 0 2024-04-03T08:39:02.332 INFO:tasks.workunit.client.0.smithi157.stdout:2/91: creat d3/db/f1d x:0 0 0 2024-04-03T08:39:02.336 INFO:tasks.workunit.client.0.smithi157.stdout:2/92: unlink d3/db/f1d 0 2024-04-03T08:39:02.337 INFO:tasks.workunit.client.0.smithi157.stdout:2/93: write d3/d12/fe [598693,16205] 0 2024-04-03T08:39:02.350 INFO:tasks.workunit.client.0.smithi157.stdout:4/40: truncate da/fb 124638 0 2024-04-03T08:39:02.353 INFO:tasks.workunit.client.0.smithi157.stdout:5/55: write f8 [5068810,85064] 0 2024-04-03T08:39:02.367 INFO:tasks.workunit.client.0.smithi157.stdout:8/38: dwrite d2/fb [4194304,4194304] 0 2024-04-03T08:39:02.369 INFO:tasks.workunit.client.0.smithi157.stdout:6/75: write d1/d5/f7 [376307,101266] 0 2024-04-03T08:39:02.373 INFO:tasks.workunit.client.0.smithi157.stdout:9/51: fsync d1/f3 0 2024-04-03T08:39:02.375 INFO:tasks.workunit.client.0.smithi157.stdout:1/51: truncate d2/f5 4089826 0 2024-04-03T08:39:02.377 INFO:tasks.workunit.client.0.smithi157.stdout:1/52: dread - d2/d6/f13 zero size 2024-04-03T08:39:02.380 INFO:tasks.workunit.client.0.smithi157.stdout:9/52: symlink d1/lf 0 2024-04-03T08:39:02.381 INFO:tasks.workunit.client.0.smithi157.stdout:0/65: getdents d2 0 2024-04-03T08:39:02.382 INFO:tasks.workunit.client.0.smithi157.stdout:1/53: rename d2/d6/d7/ca to d2/d11/c14 0 2024-04-03T08:39:02.384 INFO:tasks.workunit.client.0.smithi157.stdout:9/53: truncate d1/f5 1984075 0 2024-04-03T08:39:02.385 INFO:tasks.workunit.client.0.smithi157.stdout:1/54: truncate d2/d6/d7/fe 821805 0 2024-04-03T08:39:02.385 INFO:tasks.workunit.client.0.smithi157.stdout:9/54: fdatasync d1/fd 0 2024-04-03T08:39:02.386 INFO:tasks.workunit.client.0.smithi157.stdout:1/55: stat d2/f5 0 2024-04-03T08:39:02.386 INFO:tasks.workunit.client.0.smithi157.stdout:3/49: getdents d8 0 2024-04-03T08:39:02.387 INFO:tasks.workunit.client.0.smithi157.stdout:9/55: fdatasync d1/fc 0 2024-04-03T08:39:02.387 INFO:tasks.workunit.client.0.smithi157.stdout:0/66: symlink d2/d9/dc/df/l11 0 2024-04-03T08:39:02.389 INFO:tasks.workunit.client.0.smithi157.stdout:0/67: rename d2 to d2/d12 22 2024-04-03T08:39:02.389 INFO:tasks.workunit.client.0.smithi157.stdout:1/56: mknod d2/c15 0 2024-04-03T08:39:02.390 INFO:tasks.workunit.client.0.smithi157.stdout:0/68: readlink d2/d9/lb 0 2024-04-03T08:39:02.390 INFO:tasks.workunit.client.0.smithi157.stdout:3/50: symlink d8/lf 0 2024-04-03T08:39:02.391 INFO:tasks.workunit.client.0.smithi157.stdout:1/57: rename d2 to d2/d6/d16 22 2024-04-03T08:39:02.392 INFO:tasks.workunit.client.0.smithi157.stdout:9/56: symlink d1/l10 0 2024-04-03T08:39:02.392 INFO:tasks.workunit.client.0.smithi157.stdout:2/94: rmdir d3/db 39 2024-04-03T08:39:02.393 INFO:tasks.workunit.client.0.smithi157.stdout:0/69: truncate d2/d9/fe 202981 0 2024-04-03T08:39:02.394 INFO:tasks.workunit.client.0.smithi157.stdout:9/57: read d1/fe [509205,103056] 0 2024-04-03T08:39:02.401 INFO:tasks.workunit.client.0.smithi157.stdout:4/41: rmdir da 39 2024-04-03T08:39:02.401 INFO:tasks.workunit.client.0.smithi157.stdout:5/56: truncate f8 3979724 0 2024-04-03T08:39:02.402 INFO:tasks.workunit.client.0.smithi157.stdout:0/70: dread d2/d9/fe [0,4194304] 0 2024-04-03T08:39:02.405 INFO:tasks.workunit.client.0.smithi157.stdout:9/58: unlink d1/fa 0 2024-04-03T08:39:02.406 INFO:tasks.workunit.client.0.smithi157.stdout:6/76: truncate d1/f3 3561474 0 2024-04-03T08:39:02.413 INFO:tasks.workunit.client.0.smithi157.stdout:4/42: read - da/fc zero size 2024-04-03T08:39:02.415 INFO:tasks.workunit.client.0.smithi157.stdout:5/57: creat dc/f13 x:0 0 0 2024-04-03T08:39:02.430 INFO:tasks.workunit.client.0.smithi157.stdout:2/95: dwrite d3/f7 [4194304,4194304] 0 2024-04-03T08:39:02.434 INFO:tasks.workunit.client.0.smithi157.stdout:1/58: dwrite d2/d6/d7/f9 [0,4194304] 0 2024-04-03T08:39:02.436 INFO:tasks.workunit.client.0.smithi157.stdout:2/96: fsync d3/f5 0 2024-04-03T08:39:02.440 INFO:tasks.workunit.client.0.smithi157.stdout:6/77: write d1/ff [65322,59996] 0 2024-04-03T08:39:02.441 INFO:tasks.workunit.client.0.smithi157.stdout:8/39: dwrite d2/f6 [0,4194304] 0 2024-04-03T08:39:02.442 INFO:tasks.workunit.client.0.smithi157.stdout:0/71: dwrite d2/fa [0,4194304] 0 2024-04-03T08:39:02.446 INFO:tasks.workunit.client.0.smithi157.stdout:2/97: write d3/f7 [2535287,306] 0 2024-04-03T08:39:02.447 INFO:tasks.workunit.client.0.smithi157.stdout:5/58: write f8 [1720655,26505] 0 2024-04-03T08:39:02.453 INFO:tasks.workunit.client.0.smithi157.stdout:2/98: chown c2 446588663 1 2024-04-03T08:39:02.453 INFO:tasks.workunit.client.0.smithi157.stdout:9/59: dwrite d1/fd [0,4194304] 0 2024-04-03T08:39:02.456 INFO:tasks.workunit.client.0.smithi157.stdout:2/99: fsync d3/f5 0 2024-04-03T08:39:02.456 INFO:tasks.workunit.client.0.smithi157.stdout:4/43: truncate f7 209041 0 2024-04-03T08:39:02.457 INFO:tasks.workunit.client.0.smithi157.stdout:8/40: mkdir d2/de 0 2024-04-03T08:39:02.459 INFO:tasks.workunit.client.0.smithi157.stdout:6/78: creat d1/d5/f1a x:0 0 0 2024-04-03T08:39:02.460 INFO:tasks.workunit.client.0.smithi157.stdout:1/59: fsync f0 0 2024-04-03T08:39:02.462 INFO:tasks.workunit.client.0.smithi157.stdout:4/44: write da/fc [879773,83788] 0 2024-04-03T08:39:02.464 INFO:tasks.workunit.client.0.smithi157.stdout:2/100: unlink d3/f4 0 2024-04-03T08:39:02.464 INFO:tasks.workunit.client.0.smithi157.stdout:8/41: unlink d2/fd 0 2024-04-03T08:39:02.471 INFO:tasks.workunit.client.0.smithi157.stdout:6/79: mkdir d1/d5/d1b 0 2024-04-03T08:39:02.473 INFO:tasks.workunit.client.0.smithi157.stdout:4/45: readlink l6 0 2024-04-03T08:39:02.480 INFO:tasks.workunit.client.0.smithi157.stdout:6/80: unlink d1/d5/f7 0 2024-04-03T08:39:02.482 INFO:tasks.workunit.client.0.smithi157.stdout:2/101: dread d3/f7 [0,4194304] 0 2024-04-03T08:39:02.484 INFO:tasks.workunit.client.0.smithi157.stdout:1/60: rename d2/d6/d7/lb to d2/d6/d7/l17 0 2024-04-03T08:39:02.485 INFO:tasks.workunit.client.0.smithi157.stdout:8/42: dwrite d2/fb [4194304,4194304] 0 2024-04-03T08:39:02.489 INFO:tasks.workunit.client.0.smithi157.stdout:8/43: read d2/fb [5875882,97402] 0 2024-04-03T08:39:02.490 INFO:tasks.workunit.client.0.smithi157.stdout:4/46: dread f4 [0,4194304] 0 2024-04-03T08:39:02.492 INFO:tasks.workunit.client.0.smithi157.stdout:0/72: getdents d2/d9/dc 0 2024-04-03T08:39:02.494 INFO:tasks.workunit.client.0.smithi157.stdout:5/59: getdents dc 0 2024-04-03T08:39:02.498 INFO:tasks.workunit.client.0.smithi157.stdout:1/61: rename d2/fc to d2/f18 0 2024-04-03T08:39:02.499 INFO:tasks.workunit.client.0.smithi157.stdout:4/47: mknod da/cd 0 2024-04-03T08:39:02.502 INFO:tasks.workunit.client.0.smithi157.stdout:5/60: rmdir dc 39 2024-04-03T08:39:02.504 INFO:tasks.workunit.client.0.smithi157.stdout:8/44: creat d2/de/ff x:0 0 0 2024-04-03T08:39:02.504 INFO:tasks.workunit.client.0.smithi157.stdout:9/60: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:02.506 INFO:tasks.workunit.client.0.smithi157.stdout:4/48: unlink f8 0 2024-04-03T08:39:02.510 INFO:tasks.workunit.client.0.smithi157.stdout:2/102: dwrite d3/f6 [0,4194304] 0 2024-04-03T08:39:02.511 INFO:tasks.workunit.client.0.smithi157.stdout:1/62: write d2/f5 [1019017,587] 0 2024-04-03T08:39:02.513 INFO:tasks.workunit.client.0.smithi157.stdout:8/45: mkdir d2/de/d10 0 2024-04-03T08:39:02.514 INFO:tasks.workunit.client.0.smithi157.stdout:8/46: readlink d2/l7 0 2024-04-03T08:39:02.519 INFO:tasks.workunit.client.0.smithi157.stdout:4/49: rename l6 to da/le 0 2024-04-03T08:39:02.519 INFO:tasks.workunit.client.0.smithi157.stdout:0/73: dread d2/f6 [0,4194304] 0 2024-04-03T08:39:02.524 INFO:tasks.workunit.client.0.smithi157.stdout:5/61: readlink dc/l10 0 2024-04-03T08:39:02.530 INFO:tasks.workunit.client.0.smithi157.stdout:4/50: mkdir da/df 0 2024-04-03T08:39:02.531 INFO:tasks.workunit.client.0.smithi157.stdout:4/51: stat l5 0 2024-04-03T08:39:02.533 INFO:tasks.workunit.client.0.smithi157.stdout:2/103: mknod d3/c1e 0 2024-04-03T08:39:02.535 INFO:tasks.workunit.client.0.smithi157.stdout:4/52: fdatasync da/fc 0 2024-04-03T08:39:02.535 INFO:tasks.workunit.client.0.smithi157.stdout:5/62: symlink dc/l14 0 2024-04-03T08:39:02.536 INFO:tasks.workunit.client.0.smithi157.stdout:9/61: truncate d1/f5 2842835 0 2024-04-03T08:39:02.541 INFO:tasks.workunit.client.0.smithi157.stdout:8/47: dwrite d2/de/ff [0,4194304] 0 2024-04-03T08:39:02.543 INFO:tasks.workunit.client.0.smithi157.stdout:1/63: dwrite d2/d6/d7/f9 [0,4194304] 0 2024-04-03T08:39:02.544 INFO:tasks.workunit.client.0.smithi157.stdout:6/81: dwrite d1/f3 [0,4194304] 0 2024-04-03T08:39:02.545 INFO:tasks.workunit.client.0.smithi157.stdout:5/63: creat dc/f15 x:0 0 0 2024-04-03T08:39:02.545 INFO:tasks.workunit.client.0.smithi157.stdout:4/53: write f4 [3393555,90390] 0 2024-04-03T08:39:02.548 INFO:tasks.workunit.client.0.smithi157.stdout:0/74: getdents d2/d9/dc/df 0 2024-04-03T08:39:02.556 INFO:tasks.workunit.client.0.smithi157.stdout:5/64: mkdir dc/d16 0 2024-04-03T08:39:02.559 INFO:tasks.workunit.client.0.smithi157.stdout:2/104: link d3/f9 d3/db/f1f 0 2024-04-03T08:39:02.562 INFO:tasks.workunit.client.0.smithi157.stdout:9/62: getdents d1 0 2024-04-03T08:39:02.562 INFO:tasks.workunit.client.0.smithi157.stdout:6/82: creat d1/d5/d1b/f1c x:0 0 0 2024-04-03T08:39:02.563 INFO:tasks.workunit.client.0.smithi157.stdout:7/91: sync 2024-04-03T08:39:02.564 INFO:tasks.workunit.client.0.smithi157.stdout:4/54: creat da/df/f10 x:0 0 0 2024-04-03T08:39:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:2/105: creat d3/d12/f20 x:0 0 0 2024-04-03T08:39:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:6/83: truncate d1/d5/d1b/f1c 264758 0 2024-04-03T08:39:02.570 INFO:tasks.workunit.client.0.smithi157.stdout:5/65: symlink dc/d16/l17 0 2024-04-03T08:39:02.572 INFO:tasks.workunit.client.0.smithi157.stdout:8/48: dwrite d2/fb [8388608,4194304] 0 2024-04-03T08:39:02.573 INFO:tasks.workunit.client.0.smithi157.stdout:6/84: dread - d1/d5/f1a zero size 2024-04-03T08:39:02.574 INFO:tasks.workunit.client.0.smithi157.stdout:1/64: getdents d2/d6 0 2024-04-03T08:39:02.576 INFO:tasks.workunit.client.0.smithi157.stdout:5/66: write dc/fd [3607070,95164] 0 2024-04-03T08:39:02.578 INFO:tasks.workunit.client.0.smithi157.stdout:9/63: getdents d1 0 2024-04-03T08:39:02.579 INFO:tasks.workunit.client.0.smithi157.stdout:8/49: dread d2/f9 [0,4194304] 0 2024-04-03T08:39:02.582 INFO:tasks.workunit.client.0.smithi157.stdout:1/65: write d2/d6/d7/fe [1755829,32282] 0 2024-04-03T08:39:02.583 INFO:tasks.workunit.client.0.smithi157.stdout:5/67: mkdir dc/d16/d18 0 2024-04-03T08:39:02.586 INFO:tasks.workunit.client.0.smithi157.stdout:4/55: write da/fb [814129,18957] 0 2024-04-03T08:39:02.586 INFO:tasks.workunit.client.0.smithi157.stdout:5/68: stat l2 0 2024-04-03T08:39:02.587 INFO:tasks.workunit.client.0.smithi157.stdout:2/106: creat d3/f21 x:0 0 0 2024-04-03T08:39:02.588 INFO:tasks.workunit.client.0.smithi157.stdout:1/66: symlink d2/d6/d7/l19 0 2024-04-03T08:39:02.590 INFO:tasks.workunit.client.0.smithi157.stdout:5/69: fsync dc/f15 0 2024-04-03T08:39:02.592 INFO:tasks.workunit.client.0.smithi157.stdout:1/67: write d2/f5 [139759,127603] 0 2024-04-03T08:39:02.593 INFO:tasks.workunit.client.0.smithi157.stdout:5/70: rename dc/d16 to dc/d16/d19 22 2024-04-03T08:39:02.594 INFO:tasks.workunit.client.0.smithi157.stdout:1/68: chown d2/f18 7890164 1 2024-04-03T08:39:02.598 INFO:tasks.workunit.client.0.smithi157.stdout:6/85: dread d1/fc [0,4194304] 0 2024-04-03T08:39:02.598 INFO:tasks.workunit.client.0.smithi157.stdout:9/64: dread d1/f3 [0,4194304] 0 2024-04-03T08:39:02.599 INFO:tasks.workunit.client.0.smithi157.stdout:1/69: symlink d2/d6/l1a 0 2024-04-03T08:39:02.602 INFO:tasks.workunit.client.0.smithi157.stdout:7/92: write d0/d11/d15/d17/f19 [570125,23203] 0 2024-04-03T08:39:02.602 INFO:tasks.workunit.client.0.smithi157.stdout:1/70: stat d2/c4 0 2024-04-03T08:39:02.602 INFO:tasks.workunit.client.0.smithi157.stdout:9/65: symlink d1/l11 0 2024-04-03T08:39:02.604 INFO:tasks.workunit.client.0.smithi157.stdout:6/86: creat d1/d5/d17/f1d x:0 0 0 2024-04-03T08:39:02.606 INFO:tasks.workunit.client.0.smithi157.stdout:8/50: truncate d2/de/ff 3147172 0 2024-04-03T08:39:02.610 INFO:tasks.workunit.client.0.smithi157.stdout:1/71: mkdir d2/d6/d7/d1b 0 2024-04-03T08:39:02.613 INFO:tasks.workunit.client.0.smithi157.stdout:6/87: dread - d1/d5/f1a zero size 2024-04-03T08:39:02.615 INFO:tasks.workunit.client.0.smithi157.stdout:1/72: chown d2/d6 859084299 1 2024-04-03T08:39:02.615 INFO:tasks.workunit.client.0.smithi157.stdout:7/93: write d0/d11/d15/f1f [556989,11498] 0 2024-04-03T08:39:02.617 INFO:tasks.workunit.client.0.smithi157.stdout:4/56: dwrite da/df/f10 [0,4194304] 0 2024-04-03T08:39:02.617 INFO:tasks.workunit.client.0.smithi157.stdout:9/66: truncate d1/fe 233045 0 2024-04-03T08:39:02.618 INFO:tasks.workunit.client.0.smithi157.stdout:8/51: rename d2/de to d2/d11 0 2024-04-03T08:39:02.619 INFO:tasks.workunit.client.0.smithi157.stdout:2/107: dread d3/db/f1f [0,4194304] 0 2024-04-03T08:39:02.625 INFO:tasks.workunit.client.0.smithi157.stdout:5/71: dwrite dc/f12 [0,4194304] 0 2024-04-03T08:39:02.625 INFO:tasks.workunit.client.0.smithi157.stdout:6/88: read d1/fb [1958008,97910] 0 2024-04-03T08:39:02.627 INFO:tasks.workunit.client.0.smithi157.stdout:1/73: truncate d2/d6/ff 665302 0 2024-04-03T08:39:02.629 INFO:tasks.workunit.client.0.smithi157.stdout:2/108: truncate d3/d12/fe 1056314 0 2024-04-03T08:39:02.629 INFO:tasks.workunit.client.0.smithi157.stdout:4/57: write da/fb [647231,108954] 0 2024-04-03T08:39:02.629 INFO:tasks.workunit.client.0.smithi157.stdout:1/74: fsync d2/d6/d7/f9 0 2024-04-03T08:39:02.630 INFO:tasks.workunit.client.0.smithi157.stdout:8/52: rmdir d2/d11 39 2024-04-03T08:39:02.631 INFO:tasks.workunit.client.0.smithi157.stdout:7/94: dread d0/d4/f10 [0,4194304] 0 2024-04-03T08:39:02.636 INFO:tasks.workunit.client.0.smithi157.stdout:5/72: mkdir dc/d16/d1a 0 2024-04-03T08:39:02.636 INFO:tasks.workunit.client.0.smithi157.stdout:6/89: mknod d1/d5/c1e 0 2024-04-03T08:39:02.636 INFO:tasks.workunit.client.0.smithi157.stdout:7/95: chown d0/d11/d15/c1a 27604133 1 2024-04-03T08:39:02.636 INFO:tasks.workunit.client.0.smithi157.stdout:1/75: creat d2/d6/f1c x:0 0 0 2024-04-03T08:39:02.637 INFO:tasks.workunit.client.0.smithi157.stdout:4/58: mkdir da/df/d11 0 2024-04-03T08:39:02.639 INFO:tasks.workunit.client.0.smithi157.stdout:4/59: read f4 [3198828,94404] 0 2024-04-03T08:39:02.642 INFO:tasks.workunit.client.0.smithi157.stdout:2/109: mknod d3/d12/c22 0 2024-04-03T08:39:02.646 INFO:tasks.workunit.client.0.smithi157.stdout:5/73: mknod dc/d16/c1b 0 2024-04-03T08:39:02.647 INFO:tasks.workunit.client.0.smithi157.stdout:8/53: dread d2/f6 [0,4194304] 0 2024-04-03T08:39:02.652 INFO:tasks.workunit.client.0.smithi157.stdout:2/110: creat d3/d12/f23 x:0 0 0 2024-04-03T08:39:02.652 INFO:tasks.workunit.client.0.smithi157.stdout:8/54: chown d2/l7 1019 1 2024-04-03T08:39:02.654 INFO:tasks.workunit.client.0.smithi157.stdout:7/96: mknod d0/d16/c27 0 2024-04-03T08:39:02.658 INFO:tasks.workunit.client.0.smithi157.stdout:9/67: chown d1/f3 11559008 1 2024-04-03T08:39:02.660 INFO:tasks.workunit.client.0.smithi157.stdout:5/74: link f7 dc/d16/d18/f1c 0 2024-04-03T08:39:02.661 INFO:tasks.workunit.client.0.smithi157.stdout:2/111: creat d3/d12/f24 x:0 0 0 2024-04-03T08:39:02.663 INFO:tasks.workunit.client.0.smithi157.stdout:4/60: fsync da/df/f10 0 2024-04-03T08:39:02.665 INFO:tasks.workunit.client.0.smithi157.stdout:7/97: unlink d0/d5/l14 0 2024-04-03T08:39:02.666 INFO:tasks.workunit.client.0.smithi157.stdout:5/75: write dc/f11 [932711,27703] 0 2024-04-03T08:39:02.670 INFO:tasks.workunit.client.0.smithi157.stdout:8/55: mkdir d2/d11/d10/d12 0 2024-04-03T08:39:02.670 INFO:tasks.workunit.client.0.smithi157.stdout:6/90: dwrite d1/d5/d1b/f1c [0,4194304] 0 2024-04-03T08:39:02.673 INFO:tasks.workunit.client.0.smithi157.stdout:1/76: dwrite d2/d6/f13 [0,4194304] 0 2024-04-03T08:39:02.676 INFO:tasks.workunit.client.0.smithi157.stdout:4/61: symlink da/df/l12 0 2024-04-03T08:39:02.680 INFO:tasks.workunit.client.0.smithi157.stdout:5/76: creat dc/f1d x:0 0 0 2024-04-03T08:39:02.682 INFO:tasks.workunit.client.0.smithi157.stdout:4/62: rmdir da 39 2024-04-03T08:39:02.682 INFO:tasks.workunit.client.0.smithi157.stdout:7/98: creat d0/d11/d15/d17/d1c/f28 x:0 0 0 2024-04-03T08:39:02.683 INFO:tasks.workunit.client.0.smithi157.stdout:2/112: dread d3/f5 [0,4194304] 0 2024-04-03T08:39:02.684 INFO:tasks.workunit.client.0.smithi157.stdout:5/77: symlink dc/d16/l1e 0 2024-04-03T08:39:02.685 INFO:tasks.workunit.client.0.smithi157.stdout:2/113: read d3/f7 [5279791,114325] 0 2024-04-03T08:39:02.687 INFO:tasks.workunit.client.0.smithi157.stdout:7/99: symlink d0/d5/l29 0 2024-04-03T08:39:02.688 INFO:tasks.workunit.client.0.smithi157.stdout:7/100: stat d0/d11/d15 0 2024-04-03T08:39:02.689 INFO:tasks.workunit.client.0.smithi157.stdout:6/91: creat d1/f1f x:0 0 0 2024-04-03T08:39:02.691 INFO:tasks.workunit.client.0.smithi157.stdout:4/63: fdatasync f7 0 2024-04-03T08:39:02.691 INFO:tasks.workunit.client.0.smithi157.stdout:8/56: link d2/ca d2/d11/d10/d12/c13 0 2024-04-03T08:39:02.692 INFO:tasks.workunit.client.0.smithi157.stdout:6/92: rmdir d1/d5/d10 39 2024-04-03T08:39:02.695 INFO:tasks.workunit.client.0.smithi157.stdout:7/101: mknod d0/d11/d15/d1b/c2a 0 2024-04-03T08:39:02.696 INFO:tasks.workunit.client.0.smithi157.stdout:4/64: dread f7 [0,4194304] 0 2024-04-03T08:39:02.697 INFO:tasks.workunit.client.0.smithi157.stdout:8/57: rename d2/d11/d10 to d2/d11/d10/d12/d14 22 2024-04-03T08:39:02.699 INFO:tasks.workunit.client.0.smithi157.stdout:6/93: write d1/f3 [1682809,121125] 0 2024-04-03T08:39:02.701 INFO:tasks.workunit.client.0.smithi157.stdout:7/102: truncate d0/d5/f23 887985 0 2024-04-03T08:39:02.702 INFO:tasks.workunit.client.0.smithi157.stdout:5/78: write dc/d16/d18/f1c [5452272,95971] 0 2024-04-03T08:39:02.704 INFO:tasks.workunit.client.0.smithi157.stdout:8/58: mknod d2/d11/d10/c15 0 2024-04-03T08:39:02.705 INFO:tasks.workunit.client.0.smithi157.stdout:2/114: write d3/db/f1a [890133,31091] 0 2024-04-03T08:39:02.707 INFO:tasks.workunit.client.0.smithi157.stdout:6/94: symlink d1/l20 0 2024-04-03T08:39:02.707 INFO:tasks.workunit.client.0.smithi157.stdout:5/79: write fa [6777879,98686] 0 2024-04-03T08:39:02.712 INFO:tasks.workunit.client.0.smithi157.stdout:4/65: link da/df/l12 da/l13 0 2024-04-03T08:39:02.713 INFO:tasks.workunit.client.0.smithi157.stdout:2/115: dread d3/f5 [0,4194304] 0 2024-04-03T08:39:02.718 INFO:tasks.workunit.client.0.smithi157.stdout:6/95: mknod d1/d5/d10/c21 0 2024-04-03T08:39:02.721 INFO:tasks.workunit.client.0.smithi157.stdout:6/96: readlink d1/ld 0 2024-04-03T08:39:02.726 INFO:tasks.workunit.client.0.smithi157.stdout:6/97: mkdir d1/d22 0 2024-04-03T08:39:02.763 INFO:tasks.workunit.client.0.smithi157.stdout:3/51: sync 2024-04-03T08:39:02.817 INFO:tasks.workunit.client.0.smithi157.stdout:3/52: chown f4 69668 1 2024-04-03T08:39:02.818 INFO:tasks.workunit.client.0.smithi157.stdout:4/66: dread f4 [0,4194304] 0 2024-04-03T08:39:02.818 INFO:tasks.workunit.client.0.smithi157.stdout:6/98: write d1/fc [2157978,129920] 0 2024-04-03T08:39:02.823 INFO:tasks.workunit.client.0.smithi157.stdout:5/80: dwrite dc/fd [4194304,4194304] 0 2024-04-03T08:39:02.826 INFO:tasks.workunit.client.0.smithi157.stdout:8/59: dwrite d2/f9 [0,4194304] 0 2024-04-03T08:39:02.827 INFO:tasks.workunit.client.0.smithi157.stdout:3/53: mknod d8/c10 0 2024-04-03T08:39:02.829 INFO:tasks.workunit.client.0.smithi157.stdout:2/116: dwrite d3/f21 [0,4194304] 0 2024-04-03T08:39:02.833 INFO:tasks.workunit.client.0.smithi157.stdout:2/117: read d3/f5 [956656,56694] 0 2024-04-03T08:39:02.833 INFO:tasks.workunit.client.0.smithi157.stdout:3/54: write d8/f9 [2793878,5013] 0 2024-04-03T08:39:02.834 INFO:tasks.workunit.client.0.smithi157.stdout:8/60: rmdir d2/d11/d10/d12 39 2024-04-03T08:39:02.836 INFO:tasks.workunit.client.0.smithi157.stdout:4/67: creat da/df/f14 x:0 0 0 2024-04-03T08:39:02.844 INFO:tasks.workunit.client.0.smithi157.stdout:3/55: creat d8/f11 x:0 0 0 2024-04-03T08:39:02.848 INFO:tasks.workunit.client.0.smithi157.stdout:2/118: symlink d3/db/l25 0 2024-04-03T08:39:02.849 INFO:tasks.workunit.client.0.smithi157.stdout:3/56: dread - d8/f11 zero size 2024-04-03T08:39:02.850 INFO:tasks.workunit.client.0.smithi157.stdout:4/68: creat da/df/f15 x:0 0 0 2024-04-03T08:39:02.850 INFO:tasks.workunit.client.0.smithi157.stdout:6/99: link d1/d5/d17/c19 d1/c23 0 2024-04-03T08:39:02.853 INFO:tasks.workunit.client.0.smithi157.stdout:2/119: rmdir d3/d12 39 2024-04-03T08:39:02.854 INFO:tasks.workunit.client.0.smithi157.stdout:3/57: creat d8/f12 x:0 0 0 2024-04-03T08:39:02.858 INFO:tasks.workunit.client.0.smithi157.stdout:2/120: read - d3/d12/f23 zero size 2024-04-03T08:39:02.859 INFO:tasks.workunit.client.0.smithi157.stdout:6/100: mknod d1/d5/d17/c24 0 2024-04-03T08:39:02.862 INFO:tasks.workunit.client.0.smithi157.stdout:8/61: dread d2/fb [4194304,4194304] 0 2024-04-03T08:39:02.863 INFO:tasks.workunit.client.0.smithi157.stdout:3/58: fsync d8/f12 0 2024-04-03T08:39:02.864 INFO:tasks.workunit.client.0.smithi157.stdout:4/69: write f4 [4909227,109270] 0 2024-04-03T08:39:02.864 INFO:tasks.workunit.client.0.smithi157.stdout:5/81: dwrite dc/fd [4194304,4194304] 0 2024-04-03T08:39:02.865 INFO:tasks.workunit.client.0.smithi157.stdout:4/70: fdatasync da/fc 0 2024-04-03T08:39:02.877 INFO:tasks.workunit.client.0.smithi157.stdout:6/101: link d1/f3 d1/d5/d10/f25 0 2024-04-03T08:39:02.877 INFO:tasks.workunit.client.0.smithi157.stdout:8/62: write d2/d11/ff [3639849,4205] 0 2024-04-03T08:39:02.879 INFO:tasks.workunit.client.0.smithi157.stdout:5/82: link dc/d16/d18/f1c dc/f1f 0 2024-04-03T08:39:02.888 INFO:tasks.workunit.client.0.smithi157.stdout:6/102: read d1/d5/d1b/f1c [173935,36398] 0 2024-04-03T08:39:02.896 INFO:tasks.workunit.client.0.smithi157.stdout:8/63: creat d2/d11/d10/f16 x:0 0 0 2024-04-03T08:39:02.900 INFO:tasks.workunit.client.0.smithi157.stdout:6/103: chown d1/d5/f12 29899687 1 2024-04-03T08:39:02.904 INFO:tasks.workunit.client.0.smithi157.stdout:0/75: sync 2024-04-03T08:39:02.904 INFO:tasks.workunit.client.0.smithi157.stdout:3/59: dwrite d8/f12 [0,4194304] 0 2024-04-03T08:39:02.904 INFO:tasks.workunit.client.0.smithi157.stdout:2/121: dwrite d3/d12/f15 [0,4194304] 0 2024-04-03T08:39:02.908 INFO:tasks.workunit.client.0.smithi157.stdout:4/71: dwrite da/fc [0,4194304] 0 2024-04-03T08:39:02.911 INFO:tasks.workunit.client.0.smithi157.stdout:4/72: dread - da/df/f15 zero size 2024-04-03T08:39:02.915 INFO:tasks.workunit.client.0.smithi157.stdout:2/122: symlink d3/l26 0 2024-04-03T08:39:02.918 INFO:tasks.workunit.client.0.smithi157.stdout:4/73: creat da/f16 x:0 0 0 2024-04-03T08:39:02.919 INFO:tasks.workunit.client.0.smithi157.stdout:0/76: write d2/f7 [1803507,130949] 0 2024-04-03T08:39:02.923 INFO:tasks.workunit.client.0.smithi157.stdout:6/104: creat d1/d22/f26 x:0 0 0 2024-04-03T08:39:02.925 INFO:tasks.workunit.client.0.smithi157.stdout:8/64: getdents d2/d11/d10/d12 0 2024-04-03T08:39:02.925 INFO:tasks.workunit.client.0.smithi157.stdout:5/83: dwrite dc/f15 [0,4194304] 0 2024-04-03T08:39:02.927 INFO:tasks.workunit.client.0.smithi157.stdout:2/123: symlink d3/db/l27 0 2024-04-03T08:39:02.931 INFO:tasks.workunit.client.0.smithi157.stdout:4/74: symlink da/df/l17 0 2024-04-03T08:39:02.931 INFO:tasks.workunit.client.0.smithi157.stdout:5/84: readlink dc/d16/l1e 0 2024-04-03T08:39:02.934 INFO:tasks.workunit.client.0.smithi157.stdout:0/77: mkdir d2/d9/dc/d13 0 2024-04-03T08:39:02.934 INFO:tasks.workunit.client.0.smithi157.stdout:8/65: stat d2/d11/d10/f16 0 2024-04-03T08:39:02.934 INFO:tasks.workunit.client.0.smithi157.stdout:2/124: chown d3/db/f1f 488751 1 2024-04-03T08:39:02.939 INFO:tasks.workunit.client.0.smithi157.stdout:8/66: rmdir d2 39 2024-04-03T08:39:02.939 INFO:tasks.workunit.client.0.smithi157.stdout:5/85: dread - dc/ff zero size 2024-04-03T08:39:02.940 INFO:tasks.workunit.client.0.smithi157.stdout:4/75: write da/df/f15 [706610,83904] 0 2024-04-03T08:39:02.944 INFO:tasks.workunit.client.0.smithi157.stdout:2/125: write d3/f9 [1876159,23148] 0 2024-04-03T08:39:02.946 INFO:tasks.workunit.client.0.smithi157.stdout:0/78: truncate d2/f3 4305643 0 2024-04-03T08:39:02.947 INFO:tasks.workunit.client.0.smithi157.stdout:6/105: rename d1/d5/c16 to d1/d5/d10/c27 0 2024-04-03T08:39:02.947 INFO:tasks.workunit.client.0.smithi157.stdout:4/76: creat da/df/f18 x:0 0 0 2024-04-03T08:39:02.948 INFO:tasks.workunit.client.0.smithi157.stdout:3/60: dwrite d8/fe [4194304,4194304] 0 2024-04-03T08:39:02.951 INFO:tasks.workunit.client.0.smithi157.stdout:8/67: truncate d2/f6 5150910 0 2024-04-03T08:39:02.951 INFO:tasks.workunit.client.0.smithi157.stdout:6/106: chown d1/l9 1 1 2024-04-03T08:39:02.952 INFO:tasks.workunit.client.0.smithi157.stdout:2/126: mknod d3/d12/c28 0 2024-04-03T08:39:02.953 INFO:tasks.workunit.client.0.smithi157.stdout:3/61: truncate d8/fa 375740 0 2024-04-03T08:39:02.954 INFO:tasks.workunit.client.0.smithi157.stdout:0/79: symlink d2/d9/dc/df/l14 0 2024-04-03T08:39:02.954 INFO:tasks.workunit.client.0.smithi157.stdout:5/86: dread dc/d16/d18/f1c [8388608,4194304] 0 2024-04-03T08:39:02.956 INFO:tasks.workunit.client.0.smithi157.stdout:5/87: chown dc/ce 2631 1 2024-04-03T08:39:02.956 INFO:tasks.workunit.client.0.smithi157.stdout:4/77: mknod da/df/d11/c19 0 2024-04-03T08:39:02.957 INFO:tasks.workunit.client.0.smithi157.stdout:3/62: readlink d8/ld 0 2024-04-03T08:39:02.957 INFO:tasks.workunit.client.0.smithi157.stdout:5/88: dread - dc/ff zero size 2024-04-03T08:39:02.959 INFO:tasks.workunit.client.0.smithi157.stdout:6/107: chown d1/d5/d17/c19 146840 1 2024-04-03T08:39:02.960 INFO:tasks.workunit.client.0.smithi157.stdout:4/78: write da/df/f14 [63443,125038] 0 2024-04-03T08:39:02.960 INFO:tasks.workunit.client.0.smithi157.stdout:0/80: unlink d2/f7 0 2024-04-03T08:39:02.962 INFO:tasks.workunit.client.0.smithi157.stdout:8/68: rename d2/f6 to d2/d11/d10/d12/f17 0 2024-04-03T08:39:02.962 INFO:tasks.workunit.client.0.smithi157.stdout:3/63: truncate d8/f9 4729209 0 2024-04-03T08:39:02.963 INFO:tasks.workunit.client.0.smithi157.stdout:6/108: write d1/ff [637861,18387] 0 2024-04-03T08:39:02.963 INFO:tasks.workunit.client.0.smithi157.stdout:9/68: sync 2024-04-03T08:39:02.963 INFO:tasks.workunit.client.0.smithi157.stdout:2/127: symlink d3/d12/l29 0 2024-04-03T08:39:02.964 INFO:tasks.workunit.client.0.smithi157.stdout:5/89: rmdir dc 39 2024-04-03T08:39:02.966 INFO:tasks.workunit.client.0.smithi157.stdout:3/64: write d8/f9 [2792178,16810] 0 2024-04-03T08:39:02.966 INFO:tasks.workunit.client.0.smithi157.stdout:9/69: chown d1/f3 5833307 1 2024-04-03T08:39:02.967 INFO:tasks.workunit.client.0.smithi157.stdout:4/79: symlink da/l1a 0 2024-04-03T08:39:02.967 INFO:tasks.workunit.client.0.smithi157.stdout:2/128: stat d3/d12/fd 0 2024-04-03T08:39:02.971 INFO:tasks.workunit.client.0.smithi157.stdout:2/129: write d3/d12/f24 [417368,126949] 0 2024-04-03T08:39:02.973 INFO:tasks.workunit.client.0.smithi157.stdout:5/90: dread - dc/ff zero size 2024-04-03T08:39:02.975 INFO:tasks.workunit.client.0.smithi157.stdout:3/65: mkdir d8/d13 0 2024-04-03T08:39:02.976 INFO:tasks.workunit.client.0.smithi157.stdout:5/91: write dc/f13 [490918,6384] 0 2024-04-03T08:39:02.978 INFO:tasks.workunit.client.0.smithi157.stdout:9/70: mknod d1/c12 0 2024-04-03T08:39:02.980 INFO:tasks.workunit.client.0.smithi157.stdout:3/66: write d8/f9 [3994239,40196] 0 2024-04-03T08:39:02.981 INFO:tasks.workunit.client.0.smithi157.stdout:4/80: unlink da/fb 0 2024-04-03T08:39:02.981 INFO:tasks.workunit.client.0.smithi157.stdout:5/92: chown dc/d16/l1e 823 1 2024-04-03T08:39:02.985 INFO:tasks.workunit.client.0.smithi157.stdout:0/81: getdents d2/d9/dc/d13 0 2024-04-03T08:39:02.986 INFO:tasks.workunit.client.0.smithi157.stdout:8/69: dread d2/f9 [0,4194304] 0 2024-04-03T08:39:02.988 INFO:tasks.workunit.client.0.smithi157.stdout:5/93: fsync dc/f1f 0 2024-04-03T08:39:02.988 INFO:tasks.workunit.client.0.smithi157.stdout:6/109: dwrite d1/d5/f12 [0,4194304] 0 2024-04-03T08:39:02.989 INFO:tasks.workunit.client.0.smithi157.stdout:3/67: getdents d8/d13 0 2024-04-03T08:39:02.992 INFO:tasks.workunit.client.0.smithi157.stdout:8/70: dread - d2/d11/d10/f16 zero size 2024-04-03T08:39:02.993 INFO:tasks.workunit.client.0.smithi157.stdout:2/130: creat d3/db/f2a x:0 0 0 2024-04-03T08:39:02.993 INFO:tasks.workunit.client.0.smithi157.stdout:0/82: link d2/f3 d2/f15 0 2024-04-03T08:39:02.995 INFO:tasks.workunit.client.0.smithi157.stdout:8/71: dread - d2/d11/d10/f16 zero size 2024-04-03T08:39:02.995 INFO:tasks.workunit.client.0.smithi157.stdout:3/68: write d8/fe [5840934,36837] 0 2024-04-03T08:39:02.996 INFO:tasks.workunit.client.0.smithi157.stdout:6/110: unlink d1/d5/d17/c24 0 2024-04-03T08:39:02.999 INFO:tasks.workunit.client.0.smithi157.stdout:8/72: chown d2/d11/ff 236486 1 2024-04-03T08:39:02.999 INFO:tasks.workunit.client.0.smithi157.stdout:3/69: write f4 [2189401,120060] 0 2024-04-03T08:39:03.001 INFO:tasks.workunit.client.0.smithi157.stdout:5/94: link dc/ff dc/d16/f20 0 2024-04-03T08:39:03.003 INFO:tasks.workunit.client.0.smithi157.stdout:6/111: chown d1/ff 27288 1 2024-04-03T08:39:03.006 INFO:tasks.workunit.client.0.smithi157.stdout:8/73: mknod d2/c18 0 2024-04-03T08:39:03.006 INFO:tasks.workunit.client.0.smithi157.stdout:5/95: rmdir dc/d16 39 2024-04-03T08:39:03.006 INFO:tasks.workunit.client.0.smithi157.stdout:2/131: link d3/d12/l1c d3/d12/l2b 0 2024-04-03T08:39:03.007 INFO:tasks.workunit.client.0.smithi157.stdout:6/112: read - d1/d5/f18 zero size 2024-04-03T08:39:03.008 INFO:tasks.workunit.client.0.smithi157.stdout:3/70: creat d8/d13/f14 x:0 0 0 2024-04-03T08:39:03.009 INFO:tasks.workunit.client.0.smithi157.stdout:0/83: getdents d2/d9/dc/df 0 2024-04-03T08:39:03.012 INFO:tasks.workunit.client.0.smithi157.stdout:6/113: read d1/fc [2287699,14082] 0 2024-04-03T08:39:03.014 INFO:tasks.workunit.client.0.smithi157.stdout:2/132: write d3/db/f2a [517962,67374] 0 2024-04-03T08:39:03.016 INFO:tasks.workunit.client.0.smithi157.stdout:4/81: dwrite da/df/f14 [0,4194304] 0 2024-04-03T08:39:03.021 INFO:tasks.workunit.client.0.smithi157.stdout:2/133: dread - d3/d12/f23 zero size 2024-04-03T08:39:03.021 INFO:tasks.workunit.client.0.smithi157.stdout:0/84: mknod d2/d9/dc/df/c16 0 2024-04-03T08:39:03.026 INFO:tasks.workunit.client.0.smithi157.stdout:0/85: chown d2/d9/dc/df 301 1 2024-04-03T08:39:03.027 INFO:tasks.workunit.client.0.smithi157.stdout:6/114: fsync d1/d5/f12 0 2024-04-03T08:39:03.029 INFO:tasks.workunit.client.0.smithi157.stdout:4/82: readlink da/le 0 2024-04-03T08:39:03.032 INFO:tasks.workunit.client.0.smithi157.stdout:4/83: unlink f7 0 2024-04-03T08:39:03.034 INFO:tasks.workunit.client.0.smithi157.stdout:6/115: symlink d1/d22/l28 0 2024-04-03T08:39:03.036 INFO:tasks.workunit.client.0.smithi157.stdout:0/86: creat d2/d9/dc/f17 x:0 0 0 2024-04-03T08:39:03.036 INFO:tasks.workunit.client.0.smithi157.stdout:8/74: dwrite d2/d11/d10/f16 [0,4194304] 0 2024-04-03T08:39:03.036 INFO:tasks.workunit.client.0.smithi157.stdout:4/84: write f4 [3081535,64608] 0 2024-04-03T08:39:03.037 INFO:tasks.workunit.client.0.smithi157.stdout:5/96: dread dc/f15 [0,4194304] 0 2024-04-03T08:39:03.038 INFO:tasks.workunit.client.0.smithi157.stdout:3/71: truncate d8/f12 1812100 0 2024-04-03T08:39:03.045 INFO:tasks.workunit.client.0.smithi157.stdout:6/116: mkdir d1/d5/d17/d29 0 2024-04-03T08:39:03.046 INFO:tasks.workunit.client.0.smithi157.stdout:4/85: mknod da/df/c1b 0 2024-04-03T08:39:03.048 INFO:tasks.workunit.client.0.smithi157.stdout:2/134: dread d3/d12/fa [0,4194304] 0 2024-04-03T08:39:03.048 INFO:tasks.workunit.client.0.smithi157.stdout:8/75: rmdir d2/d11 39 2024-04-03T08:39:03.050 INFO:tasks.workunit.client.0.smithi157.stdout:8/76: readlink d2/l7 0 2024-04-03T08:39:03.050 INFO:tasks.workunit.client.0.smithi157.stdout:4/86: fsync da/df/f18 0 2024-04-03T08:39:03.052 INFO:tasks.workunit.client.0.smithi157.stdout:0/87: write d2/d9/fe [308641,99764] 0 2024-04-03T08:39:03.053 INFO:tasks.workunit.client.0.smithi157.stdout:5/97: mkdir dc/d16/d18/d21 0 2024-04-03T08:39:03.053 INFO:tasks.workunit.client.0.smithi157.stdout:4/87: fdatasync da/f16 0 2024-04-03T08:39:03.056 INFO:tasks.workunit.client.0.smithi157.stdout:0/88: readlink d2/ld 0 2024-04-03T08:39:03.058 INFO:tasks.workunit.client.0.smithi157.stdout:4/88: write da/f16 [237894,110978] 0 2024-04-03T08:39:03.060 INFO:tasks.workunit.client.0.smithi157.stdout:5/98: truncate dc/f13 540764 0 2024-04-03T08:39:03.064 INFO:tasks.workunit.client.0.smithi157.stdout:8/77: write d2/d11/d10/f16 [600091,59019] 0 2024-04-03T08:39:03.068 INFO:tasks.workunit.client.0.smithi157.stdout:0/89: write d2/fa [4607514,118075] 0 2024-04-03T08:39:03.068 INFO:tasks.workunit.client.0.smithi157.stdout:4/89: mknod da/df/d11/c1c 0 2024-04-03T08:39:03.072 INFO:tasks.workunit.client.0.smithi157.stdout:5/99: write dc/d16/d18/f1c [5239162,18890] 0 2024-04-03T08:39:03.073 INFO:tasks.workunit.client.0.smithi157.stdout:6/117: dread d1/d5/d1b/f1c [0,4194304] 0 2024-04-03T08:39:03.074 INFO:tasks.workunit.client.0.smithi157.stdout:3/72: dwrite d8/fc [0,4194304] 0 2024-04-03T08:39:03.075 INFO:tasks.workunit.client.0.smithi157.stdout:0/90: unlink d2/d9/lb 0 2024-04-03T08:39:03.076 INFO:tasks.workunit.client.0.smithi157.stdout:8/78: symlink d2/d11/l19 0 2024-04-03T08:39:03.076 INFO:tasks.workunit.client.0.smithi157.stdout:5/100: readlink dc/l10 0 2024-04-03T08:39:03.078 INFO:tasks.workunit.client.0.smithi157.stdout:2/135: dread d3/f9 [0,4194304] 0 2024-04-03T08:39:03.078 INFO:tasks.workunit.client.0.smithi157.stdout:6/118: chown d1/ff 105 1 2024-04-03T08:39:03.079 INFO:tasks.workunit.client.0.smithi157.stdout:4/90: link da/le da/l1d 0 2024-04-03T08:39:03.080 INFO:tasks.workunit.client.0.smithi157.stdout:8/79: truncate d2/f9 4574617 0 2024-04-03T08:39:03.081 INFO:tasks.workunit.client.0.smithi157.stdout:5/101: write dc/f13 [218845,113220] 0 2024-04-03T08:39:03.082 INFO:tasks.workunit.client.0.smithi157.stdout:2/136: read - d3/d12/f20 zero size 2024-04-03T08:39:03.085 INFO:tasks.workunit.client.0.smithi157.stdout:6/119: mkdir d1/d5/d17/d2a 0 2024-04-03T08:39:03.087 INFO:tasks.workunit.client.0.smithi157.stdout:4/91: rename da/df/f15 to da/f1e 0 2024-04-03T08:39:03.088 INFO:tasks.workunit.client.0.smithi157.stdout:5/102: rmdir dc 39 2024-04-03T08:39:03.091 INFO:tasks.workunit.client.0.smithi157.stdout:0/91: rename d2/d9/dc to d2/d9/dc/d13/d18 22 2024-04-03T08:39:03.091 INFO:tasks.workunit.client.0.smithi157.stdout:8/80: mknod d2/d11/d10/d12/c1a 0 2024-04-03T08:39:03.091 INFO:tasks.workunit.client.0.smithi157.stdout:4/92: chown l2 2062148 1 2024-04-03T08:39:03.092 INFO:tasks.workunit.client.0.smithi157.stdout:6/120: truncate d1/fb 3567983 0 2024-04-03T08:39:03.094 INFO:tasks.workunit.client.0.smithi157.stdout:4/93: readlink da/df/l12 0 2024-04-03T08:39:03.095 INFO:tasks.workunit.client.0.smithi157.stdout:8/81: mknod d2/d11/c1b 0 2024-04-03T08:39:03.096 INFO:tasks.workunit.client.0.smithi157.stdout:5/103: creat dc/d16/f22 x:0 0 0 2024-04-03T08:39:03.098 INFO:tasks.workunit.client.0.smithi157.stdout:6/121: creat d1/d5/d10/f2b x:0 0 0 2024-04-03T08:39:03.101 INFO:tasks.workunit.client.0.smithi157.stdout:3/73: dread d8/fc [0,4194304] 0 2024-04-03T08:39:03.102 INFO:tasks.workunit.client.0.smithi157.stdout:5/104: rename dc/d16/d1a to dc/d16/d23 0 2024-04-03T08:39:03.102 INFO:tasks.workunit.client.0.smithi157.stdout:3/74: readlink l5 0 2024-04-03T08:39:03.103 INFO:tasks.workunit.client.0.smithi157.stdout:4/94: chown da/l1d 0 1 2024-04-03T08:39:03.103 INFO:tasks.workunit.client.0.smithi157.stdout:6/122: write d1/d5/f18 [921979,76372] 0 2024-04-03T08:39:03.105 INFO:tasks.workunit.client.0.smithi157.stdout:3/75: write d8/f11 [747317,6990] 0 2024-04-03T08:39:03.107 INFO:tasks.workunit.client.0.smithi157.stdout:5/105: symlink dc/l24 0 2024-04-03T08:39:03.110 INFO:tasks.workunit.client.0.smithi157.stdout:4/95: creat da/df/d11/f1f x:0 0 0 2024-04-03T08:39:03.110 INFO:tasks.workunit.client.0.smithi157.stdout:2/137: dread d3/f7 [4194304,4194304] 0 2024-04-03T08:39:03.111 INFO:tasks.workunit.client.0.smithi157.stdout:3/76: chown d8/d13/f14 817 1 2024-04-03T08:39:03.111 INFO:tasks.workunit.client.0.smithi157.stdout:6/123: mkdir d1/d5/d1b/d2c 0 2024-04-03T08:39:03.113 INFO:tasks.workunit.client.0.smithi157.stdout:0/92: dread d2/f3 [0,4194304] 0 2024-04-03T08:39:03.113 INFO:tasks.workunit.client.0.smithi157.stdout:7/103: sync 2024-04-03T08:39:03.113 INFO:tasks.workunit.client.0.smithi157.stdout:1/77: sync 2024-04-03T08:39:03.113 INFO:tasks.workunit.client.0.smithi157.stdout:4/96: mknod da/df/c20 0 2024-04-03T08:39:03.114 INFO:tasks.workunit.client.0.smithi157.stdout:8/82: dread d2/fb [0,4194304] 0 2024-04-03T08:39:03.115 INFO:tasks.workunit.client.0.smithi157.stdout:3/77: write d8/fa [132719,130625] 0 2024-04-03T08:39:03.116 INFO:tasks.workunit.client.0.smithi157.stdout:2/138: symlink d3/db/l2c 0 2024-04-03T08:39:03.120 INFO:tasks.workunit.client.0.smithi157.stdout:7/104: truncate d0/d5/f23 1178907 0 2024-04-03T08:39:03.120 INFO:tasks.workunit.client.0.smithi157.stdout:4/97: mknod da/c21 0 2024-04-03T08:39:03.120 INFO:tasks.workunit.client.0.smithi157.stdout:5/106: dread dc/f11 [0,4194304] 0 2024-04-03T08:39:03.121 INFO:tasks.workunit.client.0.smithi157.stdout:3/78: creat d8/d13/f15 x:0 0 0 2024-04-03T08:39:03.122 INFO:tasks.workunit.client.0.smithi157.stdout:5/107: chown f8 5755 1 2024-04-03T08:39:03.124 INFO:tasks.workunit.client.0.smithi157.stdout:6/124: rename d1/c11 to d1/d5/d17/d29/c2d 0 2024-04-03T08:39:03.124 INFO:tasks.workunit.client.0.smithi157.stdout:5/108: read - dc/d16/f22 zero size 2024-04-03T08:39:03.126 INFO:tasks.workunit.client.0.smithi157.stdout:8/83: creat d2/d11/d10/d12/f1c x:0 0 0 2024-04-03T08:39:03.126 INFO:tasks.workunit.client.0.smithi157.stdout:5/109: read f7 [2886556,98045] 0 2024-04-03T08:39:03.127 INFO:tasks.workunit.client.0.smithi157.stdout:2/139: symlink d3/db/l2d 0 2024-04-03T08:39:03.129 INFO:tasks.workunit.client.0.smithi157.stdout:4/98: symlink da/df/l22 0 2024-04-03T08:39:03.131 INFO:tasks.workunit.client.0.smithi157.stdout:3/79: symlink d8/l16 0 2024-04-03T08:39:03.135 INFO:tasks.workunit.client.0.smithi157.stdout:3/80: truncate d8/fa 458163 0 2024-04-03T08:39:03.135 INFO:tasks.workunit.client.0.smithi157.stdout:1/78: rename d2/f18 to d2/d6/d7/f1d 0 2024-04-03T08:39:03.137 INFO:tasks.workunit.client.0.smithi157.stdout:6/125: creat d1/d22/f2e x:0 0 0 2024-04-03T08:39:03.139 INFO:tasks.workunit.client.0.smithi157.stdout:1/79: chown d2/d6/d7/d1b 845879285 1 2024-04-03T08:39:03.140 INFO:tasks.workunit.client.0.smithi157.stdout:8/84: creat d2/d11/f1d x:0 0 0 2024-04-03T08:39:03.140 INFO:tasks.workunit.client.0.smithi157.stdout:3/81: write d8/fe [5561908,81479] 0 2024-04-03T08:39:03.141 INFO:tasks.workunit.client.0.smithi157.stdout:5/110: symlink dc/d16/l25 0 2024-04-03T08:39:03.142 INFO:tasks.workunit.client.0.smithi157.stdout:4/99: symlink da/df/d11/l23 0 2024-04-03T08:39:03.142 INFO:tasks.workunit.client.0.smithi157.stdout:8/85: chown d2 5 1 2024-04-03T08:39:03.145 INFO:tasks.workunit.client.0.smithi157.stdout:7/105: dwrite d0/d11/f21 [0,4194304] 0 2024-04-03T08:39:03.146 INFO:tasks.workunit.client.0.smithi157.stdout:8/86: fsync d2/d11/d10/f16 0 2024-04-03T08:39:03.147 INFO:tasks.workunit.client.0.smithi157.stdout:2/140: mkdir d3/d2e 0 2024-04-03T08:39:03.148 INFO:tasks.workunit.client.0.smithi157.stdout:7/106: readlink d0/d11/d15/d1b/l22 0 2024-04-03T08:39:03.149 INFO:tasks.workunit.client.0.smithi157.stdout:5/111: dread dc/f11 [0,4194304] 0 2024-04-03T08:39:03.154 INFO:tasks.workunit.client.0.smithi157.stdout:0/93: truncate d2/fa 4150248 0 2024-04-03T08:39:03.154 INFO:tasks.workunit.client.0.smithi157.stdout:3/82: creat d8/f17 x:0 0 0 2024-04-03T08:39:03.158 INFO:tasks.workunit.client.0.smithi157.stdout:3/83: truncate d8/d13/f15 16189 0 2024-04-03T08:39:03.160 INFO:tasks.workunit.client.0.smithi157.stdout:8/87: mknod d2/d11/d10/d12/c1e 0 2024-04-03T08:39:03.165 INFO:tasks.workunit.client.0.smithi157.stdout:5/112: creat dc/d16/f26 x:0 0 0 2024-04-03T08:39:03.166 INFO:tasks.workunit.client.0.smithi157.stdout:7/107: rmdir d0/d11/d15 39 2024-04-03T08:39:03.169 INFO:tasks.workunit.client.0.smithi157.stdout:3/84: symlink d8/l18 0 2024-04-03T08:39:03.170 INFO:tasks.workunit.client.0.smithi157.stdout:2/141: mknod d3/d2e/c2f 0 2024-04-03T08:39:03.172 INFO:tasks.workunit.client.0.smithi157.stdout:4/100: rmdir da 39 2024-04-03T08:39:03.173 INFO:tasks.workunit.client.0.smithi157.stdout:9/71: sync 2024-04-03T08:39:03.173 INFO:tasks.workunit.client.0.smithi157.stdout:5/113: creat dc/d16/f27 x:0 0 0 2024-04-03T08:39:03.173 INFO:tasks.workunit.client.0.smithi157.stdout:9/72: stat d1 0 2024-04-03T08:39:03.174 INFO:tasks.workunit.client.0.smithi157.stdout:7/108: symlink d0/d5/l2b 0 2024-04-03T08:39:03.176 INFO:tasks.workunit.client.0.smithi157.stdout:5/114: write dc/f1d [502756,112234] 0 2024-04-03T08:39:03.178 INFO:tasks.workunit.client.0.smithi157.stdout:3/85: creat d8/f19 x:0 0 0 2024-04-03T08:39:03.178 INFO:tasks.workunit.client.0.smithi157.stdout:1/80: write d2/f3 [839081,88040] 0 2024-04-03T08:39:03.181 INFO:tasks.workunit.client.0.smithi157.stdout:2/142: symlink d3/d12/l30 0 2024-04-03T08:39:03.182 INFO:tasks.workunit.client.0.smithi157.stdout:9/73: creat d1/f13 x:0 0 0 2024-04-03T08:39:03.184 INFO:tasks.workunit.client.0.smithi157.stdout:2/143: fdatasync d3/d12/fd 0 2024-04-03T08:39:03.184 INFO:tasks.workunit.client.0.smithi157.stdout:6/126: truncate d1/ff 570853 0 2024-04-03T08:39:03.186 INFO:tasks.workunit.client.0.smithi157.stdout:4/101: truncate da/f16 810868 0 2024-04-03T08:39:03.187 INFO:tasks.workunit.client.0.smithi157.stdout:5/115: creat dc/d16/f28 x:0 0 0 2024-04-03T08:39:03.187 INFO:tasks.workunit.client.0.smithi157.stdout:5/116: stat c5 0 2024-04-03T08:39:03.188 INFO:tasks.workunit.client.0.smithi157.stdout:9/74: symlink d1/l14 0 2024-04-03T08:39:03.190 INFO:tasks.workunit.client.0.smithi157.stdout:8/88: getdents d2/d11/d10/d12 0 2024-04-03T08:39:03.192 INFO:tasks.workunit.client.0.smithi157.stdout:7/109: mknod d0/d11/d15/d17/d1c/c2c 0 2024-04-03T08:39:03.196 INFO:tasks.workunit.client.0.smithi157.stdout:4/102: mkdir da/df/d24 0 2024-04-03T08:39:03.198 INFO:tasks.workunit.client.0.smithi157.stdout:0/94: write d2/fa [890359,91753] 0 2024-04-03T08:39:03.200 INFO:tasks.workunit.client.0.smithi157.stdout:3/86: link d8/fe d8/d13/f1a 0 2024-04-03T08:39:03.201 INFO:tasks.workunit.client.0.smithi157.stdout:9/75: mkdir d1/d15 0 2024-04-03T08:39:03.203 INFO:tasks.workunit.client.0.smithi157.stdout:0/95: fdatasync d2/d9/dc/f17 0 2024-04-03T08:39:03.206 INFO:tasks.workunit.client.0.smithi157.stdout:7/110: creat d0/d4/f2d x:0 0 0 2024-04-03T08:39:03.206 INFO:tasks.workunit.client.0.smithi157.stdout:0/96: chown d2/f3 77531666 1 2024-04-03T08:39:03.206 INFO:tasks.workunit.client.0.smithi157.stdout:1/81: dwrite d2/d6/d7/f9 [0,4194304] 0 2024-04-03T08:39:03.208 INFO:tasks.workunit.client.0.smithi157.stdout:4/103: unlink l5 0 2024-04-03T08:39:03.208 INFO:tasks.workunit.client.0.smithi157.stdout:0/97: readlink d2/d9/dc/df/l11 0 2024-04-03T08:39:03.208 INFO:tasks.workunit.client.0.smithi157.stdout:1/82: dread - d2/d6/f1c zero size 2024-04-03T08:39:03.210 INFO:tasks.workunit.client.0.smithi157.stdout:3/87: mkdir d8/d13/d1b 0 2024-04-03T08:39:03.211 INFO:tasks.workunit.client.0.smithi157.stdout:6/127: write d1/f3 [4284177,118168] 0 2024-04-03T08:39:03.212 INFO:tasks.workunit.client.0.smithi157.stdout:8/89: dread d2/d11/ff [0,4194304] 0 2024-04-03T08:39:03.214 INFO:tasks.workunit.client.0.smithi157.stdout:2/144: creat d3/db/f31 x:0 0 0 2024-04-03T08:39:03.215 INFO:tasks.workunit.client.0.smithi157.stdout:6/128: chown d1/d5/d1b/d2c 0 1 2024-04-03T08:39:03.218 INFO:tasks.workunit.client.0.smithi157.stdout:7/111: creat d0/d11/d15/f2e x:0 0 0 2024-04-03T08:39:03.219 INFO:tasks.workunit.client.0.smithi157.stdout:5/117: rmdir dc/d16/d23 0 2024-04-03T08:39:03.224 INFO:tasks.workunit.client.0.smithi157.stdout:2/145: dread - d3/d12/f23 zero size 2024-04-03T08:39:03.224 INFO:tasks.workunit.client.0.smithi157.stdout:3/88: creat d8/d13/f1c x:0 0 0 2024-04-03T08:39:03.227 INFO:tasks.workunit.client.0.smithi157.stdout:0/98: rename d2/d9/dc/df/l14 to d2/d9/dc/d13/l19 0 2024-04-03T08:39:03.230 INFO:tasks.workunit.client.0.smithi157.stdout:8/90: rmdir d2/d11/d10 39 2024-04-03T08:39:03.230 INFO:tasks.workunit.client.0.smithi157.stdout:2/146: write d3/db/f31 [625604,92564] 0 2024-04-03T08:39:03.230 INFO:tasks.workunit.client.0.smithi157.stdout:4/104: dread da/fc [0,4194304] 0 2024-04-03T08:39:03.230 INFO:tasks.workunit.client.0.smithi157.stdout:9/76: write d1/f3 [365336,23888] 0 2024-04-03T08:39:03.235 INFO:tasks.workunit.client.0.smithi157.stdout:7/112: mknod d0/d11/c2f 0 2024-04-03T08:39:03.236 INFO:tasks.workunit.client.0.smithi157.stdout:4/105: chown da/fc 964363722 1 2024-04-03T08:39:03.241 INFO:tasks.workunit.client.0.smithi157.stdout:1/83: dwrite d2/d6/ff [0,4194304] 0 2024-04-03T08:39:03.243 INFO:tasks.workunit.client.0.smithi157.stdout:9/77: mkdir d1/d15/d16 0 2024-04-03T08:39:03.244 INFO:tasks.workunit.client.0.smithi157.stdout:2/147: dread d3/f5 [0,4194304] 0 2024-04-03T08:39:03.245 INFO:tasks.workunit.client.0.smithi157.stdout:1/84: write d2/f5 [4800260,111218] 0 2024-04-03T08:39:03.247 INFO:tasks.workunit.client.0.smithi157.stdout:9/78: write d1/fe [816845,81947] 0 2024-04-03T08:39:03.247 INFO:tasks.workunit.client.0.smithi157.stdout:6/129: dread d1/d5/d10/f25 [0,4194304] 0 2024-04-03T08:39:03.251 INFO:tasks.workunit.client.0.smithi157.stdout:1/85: write d2/d6/ff [4780447,28214] 0 2024-04-03T08:39:03.253 INFO:tasks.workunit.client.0.smithi157.stdout:5/118: truncate f8 608547 0 2024-04-03T08:39:03.260 INFO:tasks.workunit.client.0.smithi157.stdout:4/106: rename da/c21 to da/c25 0 2024-04-03T08:39:03.261 INFO:tasks.workunit.client.0.smithi157.stdout:4/107: chown da/df/d11/l23 9683 1 2024-04-03T08:39:03.263 INFO:tasks.workunit.client.0.smithi157.stdout:9/79: creat d1/f17 x:0 0 0 2024-04-03T08:39:03.264 INFO:tasks.workunit.client.0.smithi157.stdout:3/89: getdents d8/d13 0 2024-04-03T08:39:03.266 INFO:tasks.workunit.client.0.smithi157.stdout:7/113: truncate d0/d11/f1d 291315 0 2024-04-03T08:39:03.267 INFO:tasks.workunit.client.0.smithi157.stdout:3/90: fdatasync d8/f19 0 2024-04-03T08:39:03.267 INFO:tasks.workunit.client.0.smithi157.stdout:2/148: dread d3/f7 [0,4194304] 0 2024-04-03T08:39:03.269 INFO:tasks.workunit.client.0.smithi157.stdout:0/99: getdents d2/d9/dc/df 0 2024-04-03T08:39:03.269 INFO:tasks.workunit.client.0.smithi157.stdout:8/91: creat d2/d11/d10/f1f x:0 0 0 2024-04-03T08:39:03.271 INFO:tasks.workunit.client.0.smithi157.stdout:9/80: creat d1/f18 x:0 0 0 2024-04-03T08:39:03.275 INFO:tasks.workunit.client.0.smithi157.stdout:8/92: fsync d2/d11/f1d 0 2024-04-03T08:39:03.277 INFO:tasks.workunit.client.0.smithi157.stdout:2/149: readlink d3/db/l2d 0 2024-04-03T08:39:03.279 INFO:tasks.workunit.client.0.smithi157.stdout:5/119: write dc/f1f [6843825,121185] 0 2024-04-03T08:39:03.281 INFO:tasks.workunit.client.0.smithi157.stdout:8/93: fsync d2/d11/f1d 0 2024-04-03T08:39:03.285 INFO:tasks.workunit.client.0.smithi157.stdout:0/100: symlink d2/d9/l1a 0 2024-04-03T08:39:03.290 INFO:tasks.workunit.client.0.smithi157.stdout:9/81: link d1/fc d1/f19 0 2024-04-03T08:39:03.290 INFO:tasks.workunit.client.0.smithi157.stdout:1/86: dwrite d2/d6/ff [0,4194304] 0 2024-04-03T08:39:03.291 INFO:tasks.workunit.client.0.smithi157.stdout:3/91: getdents d8/d13/d1b 0 2024-04-03T08:39:03.291 INFO:tasks.workunit.client.0.smithi157.stdout:7/114: fdatasync d0/d11/d15/d17/f25 0 2024-04-03T08:39:03.294 INFO:tasks.workunit.client.0.smithi157.stdout:8/94: mkdir d2/d20 0 2024-04-03T08:39:03.298 INFO:tasks.workunit.client.0.smithi157.stdout:2/150: dread d3/db/f2a [0,4194304] 0 2024-04-03T08:39:03.301 INFO:tasks.workunit.client.0.smithi157.stdout:1/87: unlink d2/d6/ff 0 2024-04-03T08:39:03.302 INFO:tasks.workunit.client.0.smithi157.stdout:6/130: dwrite d1/f3 [0,4194304] 0 2024-04-03T08:39:03.303 INFO:tasks.workunit.client.0.smithi157.stdout:4/108: dwrite da/df/f18 [0,4194304] 0 2024-04-03T08:39:03.306 INFO:tasks.workunit.client.0.smithi157.stdout:2/151: truncate d3/d12/fe 1935589 0 2024-04-03T08:39:03.307 INFO:tasks.workunit.client.0.smithi157.stdout:4/109: write f4 [5140467,116389] 0 2024-04-03T08:39:03.307 INFO:tasks.workunit.client.0.smithi157.stdout:1/88: write d2/d6/d7/f9 [1245720,719] 0 2024-04-03T08:39:03.309 INFO:tasks.workunit.client.0.smithi157.stdout:0/101: mkdir d2/d9/dc/df/d1b 0 2024-04-03T08:39:03.311 INFO:tasks.workunit.client.0.smithi157.stdout:8/95: mknod d2/c21 0 2024-04-03T08:39:03.313 INFO:tasks.workunit.client.0.smithi157.stdout:7/115: symlink d0/l30 0 2024-04-03T08:39:03.315 INFO:tasks.workunit.client.0.smithi157.stdout:6/131: truncate d1/d5/f1a 518842 0 2024-04-03T08:39:03.315 INFO:tasks.workunit.client.0.smithi157.stdout:4/110: fdatasync da/f1e 0 2024-04-03T08:39:03.320 INFO:tasks.workunit.client.0.smithi157.stdout:4/111: fdatasync da/df/f10 0 2024-04-03T08:39:03.320 INFO:tasks.workunit.client.0.smithi157.stdout:9/82: link d1/f18 d1/d15/f1a 0 2024-04-03T08:39:03.320 INFO:tasks.workunit.client.0.smithi157.stdout:7/116: fdatasync d0/d11/d15/d17/d1c/f24 0 2024-04-03T08:39:03.321 INFO:tasks.workunit.client.0.smithi157.stdout:8/96: read - d2/d11/f1d zero size 2024-04-03T08:39:03.325 INFO:tasks.workunit.client.0.smithi157.stdout:0/102: mknod d2/d9/dc/df/d1b/c1c 0 2024-04-03T08:39:03.327 INFO:tasks.workunit.client.0.smithi157.stdout:9/83: write d1/fd [1418793,12137] 0 2024-04-03T08:39:03.329 INFO:tasks.workunit.client.0.smithi157.stdout:4/112: fsync da/df/f14 0 2024-04-03T08:39:03.331 INFO:tasks.workunit.client.0.smithi157.stdout:9/84: read d1/f3 [429388,15194] 0 2024-04-03T08:39:03.333 INFO:tasks.workunit.client.0.smithi157.stdout:8/97: fdatasync d2/fb 0 2024-04-03T08:39:03.333 INFO:tasks.workunit.client.0.smithi157.stdout:7/117: symlink d0/d11/l31 0 2024-04-03T08:39:03.333 INFO:tasks.workunit.client.0.smithi157.stdout:0/103: creat d2/f1d x:0 0 0 2024-04-03T08:39:03.334 INFO:tasks.workunit.client.0.smithi157.stdout:3/92: dwrite f4 [0,4194304] 0 2024-04-03T08:39:03.335 INFO:tasks.workunit.client.0.smithi157.stdout:4/113: fsync da/df/f14 0 2024-04-03T08:39:03.338 INFO:tasks.workunit.client.0.smithi157.stdout:1/89: dread d2/f5 [0,4194304] 0 2024-04-03T08:39:03.338 INFO:tasks.workunit.client.0.smithi157.stdout:0/104: read d2/d9/fe [78450,113369] 0 2024-04-03T08:39:03.338 INFO:tasks.workunit.client.0.smithi157.stdout:6/132: rename d1/d22/l28 to d1/d5/d1b/d2c/l2f 0 2024-04-03T08:39:03.338 INFO:tasks.workunit.client.0.smithi157.stdout:7/118: chown d0/d4/f2d 248 1 2024-04-03T08:39:03.340 INFO:tasks.workunit.client.0.smithi157.stdout:0/105: read d2/f3 [3629096,100380] 0 2024-04-03T08:39:03.341 INFO:tasks.workunit.client.0.smithi157.stdout:4/114: write da/f16 [1483895,1436] 0 2024-04-03T08:39:03.341 INFO:tasks.workunit.client.0.smithi157.stdout:9/85: creat d1/f1b x:0 0 0 2024-04-03T08:39:03.344 INFO:tasks.workunit.client.0.smithi157.stdout:1/90: readlink d2/d6/d7/l10 0 2024-04-03T08:39:03.345 INFO:tasks.workunit.client.0.smithi157.stdout:3/93: fsync d8/d13/f1a 0 2024-04-03T08:39:03.346 INFO:tasks.workunit.client.0.smithi157.stdout:4/115: write f4 [4386812,103426] 0 2024-04-03T08:39:03.347 INFO:tasks.workunit.client.0.smithi157.stdout:7/119: write d0/d11/d15/d17/f25 [4272440,56567] 0 2024-04-03T08:39:03.350 INFO:tasks.workunit.client.0.smithi157.stdout:8/98: mknod d2/d11/c22 0 2024-04-03T08:39:03.350 INFO:tasks.workunit.client.0.smithi157.stdout:0/106: mknod d2/c1e 0 2024-04-03T08:39:03.350 INFO:tasks.workunit.client.0.smithi157.stdout:7/120: readlink d0/d5/l29 0 2024-04-03T08:39:03.352 INFO:tasks.workunit.client.0.smithi157.stdout:2/152: truncate d3/db/f1f 1049560 0 2024-04-03T08:39:03.352 INFO:tasks.workunit.client.0.smithi157.stdout:4/116: chown da/df/f14 531 1 2024-04-03T08:39:03.353 INFO:tasks.workunit.client.0.smithi157.stdout:9/86: fsync d1/fb 0 2024-04-03T08:39:03.358 INFO:tasks.workunit.client.0.smithi157.stdout:3/94: chown d8/f12 30 1 2024-04-03T08:39:03.358 INFO:tasks.workunit.client.0.smithi157.stdout:3/95: readlink l5 0 2024-04-03T08:39:03.362 INFO:tasks.workunit.client.0.smithi157.stdout:7/121: creat d0/d11/d15/d1b/f32 x:0 0 0 2024-04-03T08:39:03.362 INFO:tasks.workunit.client.0.smithi157.stdout:4/117: mkdir da/d26 0 2024-04-03T08:39:03.367 INFO:tasks.workunit.client.0.smithi157.stdout:8/99: mkdir d2/d20/d23 0 2024-04-03T08:39:03.367 INFO:tasks.workunit.client.0.smithi157.stdout:1/91: write f0 [694977,115070] 0 2024-04-03T08:39:03.371 INFO:tasks.workunit.client.0.smithi157.stdout:2/153: truncate d3/f5 679084 0 2024-04-03T08:39:03.371 INFO:tasks.workunit.client.0.smithi157.stdout:8/100: write d2/d11/d10/d12/f1c [565071,113069] 0 2024-04-03T08:39:03.372 INFO:tasks.workunit.client.0.smithi157.stdout:0/107: dwrite d2/fa [0,4194304] 0 2024-04-03T08:39:03.372 INFO:tasks.workunit.client.0.smithi157.stdout:9/87: symlink d1/d15/d16/l1c 0 2024-04-03T08:39:03.376 INFO:tasks.workunit.client.0.smithi157.stdout:4/118: rename da/f16 to da/df/d11/f27 0 2024-04-03T08:39:03.376 INFO:tasks.workunit.client.0.smithi157.stdout:8/101: readlink d2/d11/l19 0 2024-04-03T08:39:03.377 INFO:tasks.workunit.client.0.smithi157.stdout:1/92: mknod d2/d6/d7/c1e 0 2024-04-03T08:39:03.380 INFO:tasks.workunit.client.0.smithi157.stdout:1/93: dread - d2/d6/d7/f1d zero size 2024-04-03T08:39:03.382 INFO:tasks.workunit.client.0.smithi157.stdout:6/133: truncate d1/d5/d1b/f1c 2794757 0 2024-04-03T08:39:03.384 INFO:tasks.workunit.client.0.smithi157.stdout:0/108: creat d2/d9/dc/df/d1b/f1f x:0 0 0 2024-04-03T08:39:03.385 INFO:tasks.workunit.client.0.smithi157.stdout:6/134: stat d1/d5/d17/c19 0 2024-04-03T08:39:03.388 INFO:tasks.workunit.client.0.smithi157.stdout:4/119: rename da/df/c20 to da/df/c28 0 2024-04-03T08:39:03.390 INFO:tasks.workunit.client.0.smithi157.stdout:6/135: stat d1/d5/f12 0 2024-04-03T08:39:03.392 INFO:tasks.workunit.client.0.smithi157.stdout:7/122: getdents d0 0 2024-04-03T08:39:03.393 INFO:tasks.workunit.client.0.smithi157.stdout:9/88: dread d1/fe [0,4194304] 0 2024-04-03T08:39:03.396 INFO:tasks.workunit.client.0.smithi157.stdout:4/120: chown da/df/d11/f27 1774198 1 2024-04-03T08:39:03.396 INFO:tasks.workunit.client.0.smithi157.stdout:9/89: chown d1/fd 1 1 2024-04-03T08:39:03.397 INFO:tasks.workunit.client.0.smithi157.stdout:6/136: read - d1/d22/f26 zero size 2024-04-03T08:39:03.399 INFO:tasks.workunit.client.0.smithi157.stdout:1/94: rmdir d2/d6/d7 39 2024-04-03T08:39:03.399 INFO:tasks.workunit.client.0.smithi157.stdout:0/109: creat d2/d9/dc/d13/f20 x:0 0 0 2024-04-03T08:39:03.399 INFO:tasks.workunit.client.0.smithi157.stdout:7/123: write d0/d5/f23 [979171,99326] 0 2024-04-03T08:39:03.402 INFO:tasks.workunit.client.0.smithi157.stdout:4/121: fdatasync da/df/f10 0 2024-04-03T08:39:03.405 INFO:tasks.workunit.client.0.smithi157.stdout:9/90: write d1/f1b [956492,80965] 0 2024-04-03T08:39:03.405 INFO:tasks.workunit.client.0.smithi157.stdout:1/95: write d2/f3 [1817521,115569] 0 2024-04-03T08:39:03.406 INFO:tasks.workunit.client.0.smithi157.stdout:0/110: dread - d2/f1d zero size 2024-04-03T08:39:03.409 INFO:tasks.workunit.client.0.smithi157.stdout:3/96: dwrite d8/f12 [0,4194304] 0 2024-04-03T08:39:03.409 INFO:tasks.workunit.client.0.smithi157.stdout:8/102: dwrite d2/d11/f1d [0,4194304] 0 2024-04-03T08:39:03.416 INFO:tasks.workunit.client.0.smithi157.stdout:0/111: creat d2/f21 x:0 0 0 2024-04-03T08:39:03.416 INFO:tasks.workunit.client.0.smithi157.stdout:3/97: chown d8/fe 402982 1 2024-04-03T08:39:03.416 INFO:tasks.workunit.client.0.smithi157.stdout:2/154: write d3/db/f1f [1441552,10195] 0 2024-04-03T08:39:03.422 INFO:tasks.workunit.client.0.smithi157.stdout:2/155: chown d3/db/f2a 797473 1 2024-04-03T08:39:03.425 INFO:tasks.workunit.client.0.smithi157.stdout:0/112: creat d2/f22 x:0 0 0 2024-04-03T08:39:03.434 INFO:tasks.workunit.client.0.smithi157.stdout:4/122: link da/cd da/d26/c29 0 2024-04-03T08:39:03.436 INFO:tasks.workunit.client.0.smithi157.stdout:7/124: getdents d0 0 2024-04-03T08:39:03.437 INFO:tasks.workunit.client.0.smithi157.stdout:0/113: dread - d2/d9/dc/d13/f20 zero size 2024-04-03T08:39:03.441 INFO:tasks.workunit.client.0.smithi157.stdout:4/123: creat da/df/f2a x:0 0 0 2024-04-03T08:39:03.448 INFO:tasks.workunit.client.0.smithi157.stdout:8/103: dread d2/d11/d10/d12/f17 [0,4194304] 0 2024-04-03T08:39:03.451 INFO:tasks.workunit.client.0.smithi157.stdout:9/91: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:03.453 INFO:tasks.workunit.client.0.smithi157.stdout:3/98: dread d8/fc [0,4194304] 0 2024-04-03T08:39:03.453 INFO:tasks.workunit.client.0.smithi157.stdout:7/125: symlink d0/d11/d15/d17/l33 0 2024-04-03T08:39:03.455 INFO:tasks.workunit.client.0.smithi157.stdout:4/124: mknod da/d26/c2b 0 2024-04-03T08:39:03.458 INFO:tasks.workunit.client.0.smithi157.stdout:1/96: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:03.462 INFO:tasks.workunit.client.0.smithi157.stdout:9/92: truncate d1/f13 722790 0 2024-04-03T08:39:03.469 INFO:tasks.workunit.client.0.smithi157.stdout:8/104: mkdir d2/d11/d10/d24 0 2024-04-03T08:39:03.469 INFO:tasks.workunit.client.0.smithi157.stdout:2/156: dwrite d3/d12/f15 [4194304,4194304] 0 2024-04-03T08:39:03.470 INFO:tasks.workunit.client.0.smithi157.stdout:3/99: chown d8/d13/f15 53261199 1 2024-04-03T08:39:03.474 INFO:tasks.workunit.client.0.smithi157.stdout:7/126: creat d0/d11/f34 x:0 0 0 2024-04-03T08:39:03.475 INFO:tasks.workunit.client.0.smithi157.stdout:6/137: dwrite d1/d5/d1b/f1c [0,4194304] 0 2024-04-03T08:39:03.476 INFO:tasks.workunit.client.0.smithi157.stdout:0/114: dread d2/f3 [0,4194304] 0 2024-04-03T08:39:03.478 INFO:tasks.workunit.client.0.smithi157.stdout:0/115: stat d2/c10 0 2024-04-03T08:39:03.480 INFO:tasks.workunit.client.0.smithi157.stdout:6/138: dread d1/d5/f1a [0,4194304] 0 2024-04-03T08:39:03.483 INFO:tasks.workunit.client.0.smithi157.stdout:1/97: getdents d2/d6 0 2024-04-03T08:39:03.489 INFO:tasks.workunit.client.0.smithi157.stdout:2/157: mkdir d3/d2e/d32 0 2024-04-03T08:39:03.491 INFO:tasks.workunit.client.0.smithi157.stdout:7/127: mkdir d0/d11/d15/d35 0 2024-04-03T08:39:03.491 INFO:tasks.workunit.client.0.smithi157.stdout:0/116: symlink d2/d9/dc/d13/l23 0 2024-04-03T08:39:03.493 INFO:tasks.workunit.client.0.smithi157.stdout:8/105: creat d2/f25 x:0 0 0 2024-04-03T08:39:03.495 INFO:tasks.workunit.client.0.smithi157.stdout:3/100: write d8/fe [1623853,97729] 0 2024-04-03T08:39:03.496 INFO:tasks.workunit.client.0.smithi157.stdout:1/98: fsync d2/d6/d7/f1d 0 2024-04-03T08:39:03.497 INFO:tasks.workunit.client.0.smithi157.stdout:6/139: mkdir d1/d5/d17/d2a/d30 0 2024-04-03T08:39:03.498 INFO:tasks.workunit.client.0.smithi157.stdout:0/117: symlink d2/d9/dc/l24 0 2024-04-03T08:39:03.503 INFO:tasks.workunit.client.0.smithi157.stdout:4/125: dwrite da/df/d11/f27 [0,4194304] 0 2024-04-03T08:39:03.505 INFO:tasks.workunit.client.0.smithi157.stdout:0/118: chown d2/c1e 31 1 2024-04-03T08:39:03.506 INFO:tasks.workunit.client.0.smithi157.stdout:1/99: read d2/d6/d7/f9 [2286506,108130] 0 2024-04-03T08:39:03.508 INFO:tasks.workunit.client.0.smithi157.stdout:2/158: creat d3/db/f33 x:0 0 0 2024-04-03T08:39:03.508 INFO:tasks.workunit.client.0.smithi157.stdout:6/140: symlink d1/d5/d17/l31 0 2024-04-03T08:39:03.510 INFO:tasks.workunit.client.0.smithi157.stdout:0/119: creat d2/f25 x:0 0 0 2024-04-03T08:39:03.511 INFO:tasks.workunit.client.0.smithi157.stdout:8/106: write d2/d11/d10/d12/f17 [442464,34833] 0 2024-04-03T08:39:03.516 INFO:tasks.workunit.client.0.smithi157.stdout:4/126: mknod da/df/d24/c2c 0 2024-04-03T08:39:03.518 INFO:tasks.workunit.client.0.smithi157.stdout:6/141: symlink d1/d22/l32 0 2024-04-03T08:39:03.519 INFO:tasks.workunit.client.0.smithi157.stdout:8/107: symlink d2/d20/l26 0 2024-04-03T08:39:03.523 INFO:tasks.workunit.client.0.smithi157.stdout:6/142: fsync d1/d5/d10/f2b 0 2024-04-03T08:39:03.523 INFO:tasks.workunit.client.0.smithi157.stdout:4/127: chown da/c25 35161359 1 2024-04-03T08:39:03.528 INFO:tasks.workunit.client.0.smithi157.stdout:8/108: write d2/d11/d10/f16 [1851810,33846] 0 2024-04-03T08:39:03.529 INFO:tasks.workunit.client.0.smithi157.stdout:3/101: dwrite f4 [0,4194304] 0 2024-04-03T08:39:03.532 INFO:tasks.workunit.client.0.smithi157.stdout:7/128: dwrite d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:03.534 INFO:tasks.workunit.client.0.smithi157.stdout:1/100: truncate d2/d6/d7/fe 1301821 0 2024-04-03T08:39:03.541 INFO:tasks.workunit.client.0.smithi157.stdout:7/129: dread - d0/d11/d15/d17/d1c/f24 zero size 2024-04-03T08:39:03.542 INFO:tasks.workunit.client.0.smithi157.stdout:3/102: dread d8/fa [0,4194304] 0 2024-04-03T08:39:03.543 INFO:tasks.workunit.client.0.smithi157.stdout:1/101: chown d2/d6/d7/l17 5106 1 2024-04-03T08:39:03.544 INFO:tasks.workunit.client.0.smithi157.stdout:0/120: dwrite d2/fa [4194304,4194304] 0 2024-04-03T08:39:03.551 INFO:tasks.workunit.client.0.smithi157.stdout:0/121: write d2/d9/dc/f17 [45535,100785] 0 2024-04-03T08:39:03.552 INFO:tasks.workunit.client.0.smithi157.stdout:7/130: mkdir d0/d4/d36 0 2024-04-03T08:39:03.556 INFO:tasks.workunit.client.0.smithi157.stdout:4/128: dread da/df/f18 [0,4194304] 0 2024-04-03T08:39:03.557 INFO:tasks.workunit.client.0.smithi157.stdout:0/122: write d2/f22 [255959,120659] 0 2024-04-03T08:39:03.564 INFO:tasks.workunit.client.0.smithi157.stdout:3/103: creat d8/d13/d1b/f1d x:0 0 0 2024-04-03T08:39:03.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:03 smithi157 ceph-mon[35083]: pgmap v291: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 232 op/s 2024-04-03T08:39:03.566 INFO:tasks.workunit.client.0.smithi157.stdout:4/129: mknod da/d26/c2d 0 2024-04-03T08:39:03.567 INFO:tasks.workunit.client.0.smithi157.stdout:7/131: creat d0/d11/d15/d17/d1c/f37 x:0 0 0 2024-04-03T08:39:03.568 INFO:tasks.workunit.client.0.smithi157.stdout:8/109: dwrite d2/f9 [0,4194304] 0 2024-04-03T08:39:03.568 INFO:tasks.workunit.client.0.smithi157.stdout:3/104: mkdir d8/d1e 0 2024-04-03T08:39:03.571 INFO:tasks.workunit.client.0.smithi157.stdout:3/105: fdatasync d8/fe 0 2024-04-03T08:39:03.573 INFO:tasks.workunit.client.0.smithi157.stdout:1/102: dwrite f0 [0,4194304] 0 2024-04-03T08:39:03.573 INFO:tasks.workunit.client.0.smithi157.stdout:7/132: write d0/d4/f2d [61594,68249] 0 2024-04-03T08:39:03.577 INFO:tasks.workunit.client.0.smithi157.stdout:7/133: chown d0/d11/d15/d17/f19 0 1 2024-04-03T08:39:03.582 INFO:tasks.workunit.client.0.smithi157.stdout:8/110: symlink d2/l27 0 2024-04-03T08:39:03.582 INFO:tasks.workunit.client.0.smithi157.stdout:0/123: write d2/d9/fe [922439,40196] 0 2024-04-03T08:39:03.583 INFO:tasks.workunit.client.0.smithi157.stdout:3/106: creat d8/d13/f1f x:0 0 0 2024-04-03T08:39:03.590 INFO:tasks.workunit.client.0.smithi157.stdout:1/103: unlink d2/d6/c8 0 2024-04-03T08:39:03.591 INFO:tasks.workunit.client.0.smithi157.stdout:8/111: creat d2/d11/d10/d12/f28 x:0 0 0 2024-04-03T08:39:03.593 INFO:tasks.workunit.client.0.smithi157.stdout:8/112: chown d2 82343 1 2024-04-03T08:39:03.593 INFO:tasks.workunit.client.0.smithi157.stdout:7/134: write d0/d4/f10 [1467997,119944] 0 2024-04-03T08:39:03.595 INFO:tasks.workunit.client.0.smithi157.stdout:4/130: dread da/df/f10 [0,4194304] 0 2024-04-03T08:39:03.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:03 smithi181 ceph-mon[44183]: pgmap v291: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 232 op/s 2024-04-03T08:39:03.596 INFO:tasks.workunit.client.0.smithi157.stdout:8/113: chown d2/d11/d10/f16 8260221 1 2024-04-03T08:39:03.597 INFO:tasks.workunit.client.0.smithi157.stdout:1/104: write d2/d6/f13 [1738802,128183] 0 2024-04-03T08:39:03.598 INFO:tasks.workunit.client.0.smithi157.stdout:3/107: creat d8/d1e/f20 x:0 0 0 2024-04-03T08:39:03.605 INFO:tasks.workunit.client.0.smithi157.stdout:0/124: getdents d2 0 2024-04-03T08:39:03.606 INFO:tasks.workunit.client.0.smithi157.stdout:3/108: rmdir d8/d13 39 2024-04-03T08:39:03.608 INFO:tasks.workunit.client.0.smithi157.stdout:1/105: creat d2/d6/f1f x:0 0 0 2024-04-03T08:39:03.610 INFO:tasks.workunit.client.0.smithi157.stdout:3/109: read f4 [2862801,103899] 0 2024-04-03T08:39:03.611 INFO:tasks.workunit.client.0.smithi157.stdout:0/125: symlink d2/d9/dc/d13/l26 0 2024-04-03T08:39:03.615 INFO:tasks.workunit.client.0.smithi157.stdout:1/106: mknod d2/d6/c20 0 2024-04-03T08:39:03.617 INFO:tasks.workunit.client.0.smithi157.stdout:7/135: dwrite d0/d4/f10 [0,4194304] 0 2024-04-03T08:39:03.617 INFO:tasks.workunit.client.0.smithi157.stdout:0/126: mknod d2/d9/dc/d13/c27 0 2024-04-03T08:39:03.617 INFO:tasks.workunit.client.0.smithi157.stdout:4/131: dread da/df/f10 [0,4194304] 0 2024-04-03T08:39:03.620 INFO:tasks.workunit.client.0.smithi157.stdout:5/120: sync 2024-04-03T08:39:03.622 INFO:tasks.workunit.client.0.smithi157.stdout:1/107: write d2/d6/f1f [388742,61418] 0 2024-04-03T08:39:03.623 INFO:tasks.workunit.client.0.smithi157.stdout:8/114: dwrite d2/d11/d10/f1f [0,4194304] 0 2024-04-03T08:39:03.629 INFO:tasks.workunit.client.0.smithi157.stdout:0/127: truncate d2/d9/dc/f17 835719 0 2024-04-03T08:39:03.632 INFO:tasks.workunit.client.0.smithi157.stdout:5/121: mkdir dc/d29 0 2024-04-03T08:39:03.637 INFO:tasks.workunit.client.0.smithi157.stdout:7/136: mknod d0/d11/d15/d17/c38 0 2024-04-03T08:39:03.640 INFO:tasks.workunit.client.0.smithi157.stdout:5/122: dread - dc/d16/f28 zero size 2024-04-03T08:39:03.640 INFO:tasks.workunit.client.0.smithi157.stdout:0/128: symlink d2/d9/dc/l28 0 2024-04-03T08:39:03.643 INFO:tasks.workunit.client.0.smithi157.stdout:8/115: dread d2/d11/d10/d12/f1c [0,4194304] 0 2024-04-03T08:39:03.648 INFO:tasks.workunit.client.0.smithi157.stdout:3/110: dwrite f4 [4194304,4194304] 0 2024-04-03T08:39:03.648 INFO:tasks.workunit.client.0.smithi157.stdout:7/137: creat d0/d11/d15/d1b/f39 x:0 0 0 2024-04-03T08:39:03.649 INFO:tasks.workunit.client.0.smithi157.stdout:0/129: chown d2/c10 4116345 1 2024-04-03T08:39:03.651 INFO:tasks.workunit.client.0.smithi157.stdout:4/132: dwrite da/df/d11/f27 [0,4194304] 0 2024-04-03T08:39:03.661 INFO:tasks.workunit.client.0.smithi157.stdout:8/116: rmdir d2/d11 39 2024-04-03T08:39:03.671 INFO:tasks.workunit.client.0.smithi157.stdout:8/117: write d2/d11/d10/d12/f17 [1512817,49903] 0 2024-04-03T08:39:03.680 INFO:tasks.workunit.client.0.smithi157.stdout:1/108: dwrite d2/d6/d7/f1d [0,4194304] 0 2024-04-03T08:39:03.683 INFO:tasks.workunit.client.0.smithi157.stdout:8/118: creat d2/d20/f29 x:0 0 0 2024-04-03T08:39:03.684 INFO:tasks.workunit.client.0.smithi157.stdout:5/123: dwrite dc/f12 [0,4194304] 0 2024-04-03T08:39:03.691 INFO:tasks.workunit.client.0.smithi157.stdout:1/109: creat d2/f21 x:0 0 0 2024-04-03T08:39:03.701 INFO:tasks.workunit.client.0.smithi157.stdout:7/138: dwrite d0/d11/d15/f1f [0,4194304] 0 2024-04-03T08:39:03.702 INFO:tasks.workunit.client.0.smithi157.stdout:4/133: dwrite f4 [0,4194304] 0 2024-04-03T08:39:03.703 INFO:tasks.workunit.client.0.smithi157.stdout:0/130: dwrite d2/d9/dc/f17 [0,4194304] 0 2024-04-03T08:39:03.704 INFO:tasks.workunit.client.0.smithi157.stdout:4/134: readlink da/l13 0 2024-04-03T08:39:03.705 INFO:tasks.workunit.client.0.smithi157.stdout:1/110: fsync d2/d6/d7/f1d 0 2024-04-03T08:39:03.715 INFO:tasks.workunit.client.0.smithi157.stdout:7/139: creat d0/d5/f3a x:0 0 0 2024-04-03T08:39:03.716 INFO:tasks.workunit.client.0.smithi157.stdout:8/119: creat d2/d11/d10/d24/f2a x:0 0 0 2024-04-03T08:39:03.718 INFO:tasks.workunit.client.0.smithi157.stdout:1/111: fdatasync d2/f5 0 2024-04-03T08:39:03.724 INFO:tasks.workunit.client.0.smithi157.stdout:7/140: creat d0/d11/d15/d35/f3b x:0 0 0 2024-04-03T08:39:03.726 INFO:tasks.workunit.client.0.smithi157.stdout:5/124: dread dc/f15 [0,4194304] 0 2024-04-03T08:39:03.727 INFO:tasks.workunit.client.0.smithi157.stdout:1/112: fsync d2/d6/d7/f9 0 2024-04-03T08:39:03.728 INFO:tasks.workunit.client.0.smithi157.stdout:8/120: rename d2/l7 to d2/d11/l2b 0 2024-04-03T08:39:03.737 INFO:tasks.workunit.client.0.smithi157.stdout:8/121: dread d2/f9 [4194304,4194304] 0 2024-04-03T08:39:03.740 INFO:tasks.workunit.client.0.smithi157.stdout:4/135: dwrite da/df/f10 [4194304,4194304] 0 2024-04-03T08:39:03.741 INFO:tasks.workunit.client.0.smithi157.stdout:0/131: dwrite d2/f22 [0,4194304] 0 2024-04-03T08:39:03.745 INFO:tasks.workunit.client.0.smithi157.stdout:5/125: rename l2 to dc/l2a 0 2024-04-03T08:39:03.751 INFO:tasks.workunit.client.0.smithi157.stdout:0/132: write d2/f1d [976950,15327] 0 2024-04-03T08:39:03.754 INFO:tasks.workunit.client.0.smithi157.stdout:5/126: mkdir dc/d16/d18/d2b 0 2024-04-03T08:39:03.756 INFO:tasks.workunit.client.0.smithi157.stdout:5/127: dread - dc/ff zero size 2024-04-03T08:39:03.760 INFO:tasks.workunit.client.0.smithi157.stdout:0/133: chown d2/d9/dc/df/c16 7500 1 2024-04-03T08:39:03.761 INFO:tasks.workunit.client.0.smithi157.stdout:5/128: chown dc/f1d 94246 1 2024-04-03T08:39:03.761 INFO:tasks.workunit.client.0.smithi157.stdout:4/136: dread da/f1e [0,4194304] 0 2024-04-03T08:39:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:7/141: dwrite d0/d11/d15/d35/f3b [0,4194304] 0 2024-04-03T08:39:03.762 INFO:tasks.workunit.client.0.smithi157.stdout:5/129: fsync fa 0 2024-04-03T08:39:03.764 INFO:tasks.workunit.client.0.smithi157.stdout:9/93: sync 2024-04-03T08:39:03.765 INFO:tasks.workunit.client.0.smithi157.stdout:1/113: dread d2/d6/f13 [0,4194304] 0 2024-04-03T08:39:03.768 INFO:tasks.workunit.client.0.smithi157.stdout:8/122: dwrite d2/d11/d10/d12/f28 [0,4194304] 0 2024-04-03T08:39:03.770 INFO:tasks.workunit.client.0.smithi157.stdout:0/134: write d2/fa [8349516,83554] 0 2024-04-03T08:39:03.772 INFO:tasks.workunit.client.0.smithi157.stdout:1/114: truncate d2/f21 414066 0 2024-04-03T08:39:03.777 INFO:tasks.workunit.client.0.smithi157.stdout:7/142: write d0/d11/d15/d17/d1c/f28 [233547,127248] 0 2024-04-03T08:39:03.782 INFO:tasks.workunit.client.0.smithi157.stdout:4/137: fdatasync da/fc 0 2024-04-03T08:39:03.785 INFO:tasks.workunit.client.0.smithi157.stdout:7/143: symlink d0/d5/l3c 0 2024-04-03T08:39:03.788 INFO:tasks.workunit.client.0.smithi157.stdout:9/94: dread d1/f1b [0,4194304] 0 2024-04-03T08:39:03.790 INFO:tasks.workunit.client.0.smithi157.stdout:0/135: mkdir d2/d9/dc/d13/d29 0 2024-04-03T08:39:03.792 INFO:tasks.workunit.client.0.smithi157.stdout:4/138: creat da/d26/f2e x:0 0 0 2024-04-03T08:39:03.796 INFO:tasks.workunit.client.0.smithi157.stdout:4/139: write da/f1e [288557,128601] 0 2024-04-03T08:39:03.797 INFO:tasks.workunit.client.0.smithi157.stdout:7/144: creat d0/d4/d36/f3d x:0 0 0 2024-04-03T08:39:03.798 INFO:tasks.workunit.client.0.smithi157.stdout:0/136: creat d2/d9/dc/df/f2a x:0 0 0 2024-04-03T08:39:03.798 INFO:tasks.workunit.client.0.smithi157.stdout:8/123: link d2/d20/l26 d2/d11/l2c 0 2024-04-03T08:39:03.800 INFO:tasks.workunit.client.0.smithi157.stdout:4/140: mkdir da/df/d2f 0 2024-04-03T08:39:03.802 INFO:tasks.workunit.client.0.smithi157.stdout:1/115: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:03.807 INFO:tasks.workunit.client.0.smithi157.stdout:5/130: dwrite dc/f11 [0,4194304] 0 2024-04-03T08:39:03.807 INFO:tasks.workunit.client.0.smithi157.stdout:0/137: rename d2/d9/dc/d13/d29 to d2/d9/dc/d13/d29/d2b 22 2024-04-03T08:39:03.808 INFO:tasks.workunit.client.0.smithi157.stdout:7/145: creat d0/d5/f3e x:0 0 0 2024-04-03T08:39:03.809 INFO:tasks.workunit.client.0.smithi157.stdout:8/124: mknod d2/d20/d23/c2d 0 2024-04-03T08:39:03.818 INFO:tasks.workunit.client.0.smithi157.stdout:9/95: dwrite d1/fb [0,4194304] 0 2024-04-03T08:39:03.820 INFO:tasks.workunit.client.0.smithi157.stdout:5/131: mknod dc/c2c 0 2024-04-03T08:39:03.821 INFO:tasks.workunit.client.0.smithi157.stdout:8/125: mkdir d2/d11/d10/d12/d2e 0 2024-04-03T08:39:03.823 INFO:tasks.workunit.client.0.smithi157.stdout:4/141: truncate da/df/f18 4129679 0 2024-04-03T08:39:03.825 INFO:tasks.workunit.client.0.smithi157.stdout:8/126: write d2/d11/f1d [3892126,31237] 0 2024-04-03T08:39:03.830 INFO:tasks.workunit.client.0.smithi157.stdout:0/138: rename d2/d9/dc/df/d1b/f1f to d2/f2c 0 2024-04-03T08:39:03.831 INFO:tasks.workunit.client.0.smithi157.stdout:1/116: dread f0 [0,4194304] 0 2024-04-03T08:39:03.833 INFO:tasks.workunit.client.0.smithi157.stdout:9/96: mkdir d1/d1d 0 2024-04-03T08:39:03.836 INFO:tasks.workunit.client.0.smithi157.stdout:8/127: mknod d2/d20/c2f 0 2024-04-03T08:39:03.836 INFO:tasks.workunit.client.0.smithi157.stdout:7/146: creat d0/d11/d15/d1b/f3f x:0 0 0 2024-04-03T08:39:03.841 INFO:tasks.workunit.client.0.smithi157.stdout:6/143: sync 2024-04-03T08:39:03.841 INFO:tasks.workunit.client.0.smithi157.stdout:2/159: sync 2024-04-03T08:39:03.841 INFO:tasks.workunit.client.0.smithi157.stdout:0/139: mknod d2/d9/dc/df/d1b/c2d 0 2024-04-03T08:39:03.841 INFO:tasks.workunit.client.0.smithi157.stdout:7/147: truncate d0/d11/d15/f2e 619307 0 2024-04-03T08:39:03.844 INFO:tasks.workunit.client.0.smithi157.stdout:9/97: rename d1/f18 to d1/d15/d16/f1e 0 2024-04-03T08:39:03.846 INFO:tasks.workunit.client.0.smithi157.stdout:5/132: dwrite fa [4194304,4194304] 0 2024-04-03T08:39:03.846 INFO:tasks.workunit.client.0.smithi157.stdout:4/142: link l3 da/df/l30 0 2024-04-03T08:39:03.847 INFO:tasks.workunit.client.0.smithi157.stdout:0/140: truncate d2/d9/dc/d13/f20 3074 0 2024-04-03T08:39:03.847 INFO:tasks.workunit.client.0.smithi157.stdout:4/143: fdatasync da/df/f10 0 2024-04-03T08:39:03.849 INFO:tasks.workunit.client.0.smithi157.stdout:7/148: rmdir d0/d5 39 2024-04-03T08:39:03.850 INFO:tasks.workunit.client.0.smithi157.stdout:7/149: chown d0/d11/d15/d1b/f3f 97893 1 2024-04-03T08:39:03.852 INFO:tasks.workunit.client.0.smithi157.stdout:7/150: fsync d0/d11/d15/f1f 0 2024-04-03T08:39:03.852 INFO:tasks.workunit.client.0.smithi157.stdout:6/144: mknod d1/d5/d10/c33 0 2024-04-03T08:39:03.853 INFO:tasks.workunit.client.0.smithi157.stdout:6/145: chown d1/l9 1039184 1 2024-04-03T08:39:03.855 INFO:tasks.workunit.client.0.smithi157.stdout:7/151: write d0/d11/f34 [374567,96495] 0 2024-04-03T08:39:03.857 INFO:tasks.workunit.client.0.smithi157.stdout:8/128: rename d2/d11/d10/d12/f17 to d2/d20/d23/f30 0 2024-04-03T08:39:03.860 INFO:tasks.workunit.client.0.smithi157.stdout:5/133: rmdir dc/d16 39 2024-04-03T08:39:03.863 INFO:tasks.workunit.client.0.smithi157.stdout:0/141: symlink d2/d9/l2e 0 2024-04-03T08:39:03.865 INFO:tasks.workunit.client.0.smithi157.stdout:0/142: chown d2/d9/dc/d13/l23 7 1 2024-04-03T08:39:03.867 INFO:tasks.workunit.client.0.smithi157.stdout:2/160: creat d3/f34 x:0 0 0 2024-04-03T08:39:03.867 INFO:tasks.workunit.client.0.smithi157.stdout:6/146: mkdir d1/d5/d17/d2a/d34 0 2024-04-03T08:39:03.869 INFO:tasks.workunit.client.0.smithi157.stdout:4/144: rename da/df/f10 to da/f31 0 2024-04-03T08:39:03.871 INFO:tasks.workunit.client.0.smithi157.stdout:0/143: unlink d2/d9/dc/df/f2a 0 2024-04-03T08:39:03.873 INFO:tasks.workunit.client.0.smithi157.stdout:7/152: rename d0/d11 to d0/d11/d40 22 2024-04-03T08:39:03.873 INFO:tasks.workunit.client.0.smithi157.stdout:8/129: creat d2/d11/d10/d12/d2e/f31 x:0 0 0 2024-04-03T08:39:03.875 INFO:tasks.workunit.client.0.smithi157.stdout:4/145: symlink da/df/d24/l32 0 2024-04-03T08:39:03.877 INFO:tasks.workunit.client.0.smithi157.stdout:9/98: dwrite d1/f1b [0,4194304] 0 2024-04-03T08:39:03.878 INFO:tasks.workunit.client.0.smithi157.stdout:0/144: creat d2/d9/dc/d13/f2f x:0 0 0 2024-04-03T08:39:03.879 INFO:tasks.workunit.client.0.smithi157.stdout:6/147: creat d1/d5/f35 x:0 0 0 2024-04-03T08:39:03.881 INFO:tasks.workunit.client.0.smithi157.stdout:6/148: fsync d1/d5/d10/f25 0 2024-04-03T08:39:03.882 INFO:tasks.workunit.client.0.smithi157.stdout:7/153: mknod d0/d4/d36/c41 0 2024-04-03T08:39:03.885 INFO:tasks.workunit.client.0.smithi157.stdout:8/130: symlink d2/l32 0 2024-04-03T08:39:03.886 INFO:tasks.workunit.client.0.smithi157.stdout:4/146: stat da/df/f18 0 2024-04-03T08:39:03.889 INFO:tasks.workunit.client.0.smithi157.stdout:0/145: creat d2/d9/dc/df/f30 x:0 0 0 2024-04-03T08:39:03.890 INFO:tasks.workunit.client.0.smithi157.stdout:7/154: chown d0/d5 0 1 2024-04-03T08:39:03.891 INFO:tasks.workunit.client.0.smithi157.stdout:6/149: readlink d1/d5/d1b/d2c/l2f 0 2024-04-03T08:39:03.891 INFO:tasks.workunit.client.0.smithi157.stdout:7/155: chown d0/l26 23 1 2024-04-03T08:39:03.892 INFO:tasks.workunit.client.0.smithi157.stdout:2/161: rename d3/db/l27 to d3/l35 0 2024-04-03T08:39:03.895 INFO:tasks.workunit.client.0.smithi157.stdout:4/147: mknod da/df/d11/c33 0 2024-04-03T08:39:03.899 INFO:tasks.workunit.client.0.smithi157.stdout:8/131: dread d2/d11/f1d [0,4194304] 0 2024-04-03T08:39:03.904 INFO:tasks.workunit.client.0.smithi157.stdout:6/150: rename d1/c23 to d1/c36 0 2024-04-03T08:39:03.906 INFO:tasks.workunit.client.0.smithi157.stdout:4/148: symlink da/df/d2f/l34 0 2024-04-03T08:39:03.908 INFO:tasks.workunit.client.0.smithi157.stdout:8/132: symlink d2/d11/d10/d24/l33 0 2024-04-03T08:39:03.909 INFO:tasks.workunit.client.0.smithi157.stdout:9/99: truncate d1/f1b 841491 0 2024-04-03T08:39:03.910 INFO:tasks.workunit.client.0.smithi157.stdout:4/149: unlink da/df/d11/c19 0 2024-04-03T08:39:03.912 INFO:tasks.workunit.client.0.smithi157.stdout:7/156: truncate d0/d11/f21 3720422 0 2024-04-03T08:39:03.912 INFO:tasks.workunit.client.0.smithi157.stdout:2/162: dwrite d3/db/f2a [0,4194304] 0 2024-04-03T08:39:03.915 INFO:tasks.workunit.client.0.smithi157.stdout:6/151: rename d1/d5/d10 to d1/d5/d17/d2a/d37 0 2024-04-03T08:39:03.917 INFO:tasks.workunit.client.0.smithi157.stdout:6/152: chown d1/d5/f1a 954498973 1 2024-04-03T08:39:03.917 INFO:tasks.workunit.client.0.smithi157.stdout:7/157: write d0/d11/d15/d1b/f39 [714851,84017] 0 2024-04-03T08:39:03.917 INFO:tasks.workunit.client.0.smithi157.stdout:9/100: rmdir d1/d15 39 2024-04-03T08:39:03.921 INFO:tasks.workunit.client.0.smithi157.stdout:8/133: symlink d2/l34 0 2024-04-03T08:39:03.924 INFO:tasks.workunit.client.0.smithi157.stdout:7/158: rmdir d0/d11/d15/d35 39 2024-04-03T08:39:03.927 INFO:tasks.workunit.client.0.smithi157.stdout:9/101: unlink d1/l8 0 2024-04-03T08:39:03.928 INFO:tasks.workunit.client.0.smithi157.stdout:2/163: dread d3/f6 [0,4194304] 0 2024-04-03T08:39:03.930 INFO:tasks.workunit.client.0.smithi157.stdout:8/134: chown d2/d11/l2c 62 1 2024-04-03T08:39:03.930 INFO:tasks.workunit.client.0.smithi157.stdout:7/159: symlink d0/d4/l42 0 2024-04-03T08:39:03.932 INFO:tasks.workunit.client.0.smithi157.stdout:8/135: chown d2/l32 64417989 1 2024-04-03T08:39:03.933 INFO:tasks.workunit.client.0.smithi157.stdout:7/160: fdatasync d0/d11/d15/d17/d1c/f37 0 2024-04-03T08:39:03.933 INFO:tasks.workunit.client.0.smithi157.stdout:6/153: mkdir d1/d5/d17/d2a/d34/d38 0 2024-04-03T08:39:03.934 INFO:tasks.workunit.client.0.smithi157.stdout:2/164: write d3/f6 [1951522,41803] 0 2024-04-03T08:39:03.935 INFO:tasks.workunit.client.0.smithi157.stdout:4/150: getdents da/df/d24 0 2024-04-03T08:39:03.935 INFO:tasks.workunit.client.0.smithi157.stdout:6/154: fdatasync d1/d5/d17/f1d 0 2024-04-03T08:39:03.937 INFO:tasks.workunit.client.0.smithi157.stdout:4/151: dread - da/df/f2a zero size 2024-04-03T08:39:03.941 INFO:tasks.workunit.client.0.smithi157.stdout:2/165: getdents d3 0 2024-04-03T08:39:03.941 INFO:tasks.workunit.client.0.smithi157.stdout:4/152: mkdir da/df/d24/d35 0 2024-04-03T08:39:03.945 INFO:tasks.workunit.client.0.smithi157.stdout:2/166: symlink d3/d2e/d32/l36 0 2024-04-03T08:39:03.947 INFO:tasks.workunit.client.0.smithi157.stdout:2/167: write d3/db/f1a [323202,55928] 0 2024-04-03T08:39:03.948 INFO:tasks.workunit.client.0.smithi157.stdout:2/168: chown d3/d12 32964 1 2024-04-03T08:39:03.951 INFO:tasks.workunit.client.0.smithi157.stdout:2/169: symlink d3/l37 0 2024-04-03T08:39:03.954 INFO:tasks.workunit.client.0.smithi157.stdout:8/136: dwrite d2/d11/d10/d12/f1c [0,4194304] 0 2024-04-03T08:39:03.960 INFO:tasks.workunit.client.0.smithi157.stdout:4/153: dwrite da/df/d11/f27 [0,4194304] 0 2024-04-03T08:39:03.963 INFO:tasks.workunit.client.0.smithi157.stdout:4/154: write da/df/d11/f27 [3373281,51974] 0 2024-04-03T08:39:03.964 INFO:tasks.workunit.client.0.smithi157.stdout:4/155: stat da/d26 0 2024-04-03T08:39:03.970 INFO:tasks.workunit.client.0.smithi157.stdout:4/156: link da/l1a da/d26/l36 0 2024-04-03T08:39:03.971 INFO:tasks.workunit.client.0.smithi157.stdout:4/157: chown da/f31 139 1 2024-04-03T08:39:03.972 INFO:tasks.workunit.client.0.smithi157.stdout:2/170: dread d3/d12/fa [0,4194304] 0 2024-04-03T08:39:03.977 INFO:tasks.workunit.client.0.smithi157.stdout:2/171: creat d3/db/f38 x:0 0 0 2024-04-03T08:39:03.999 INFO:tasks.workunit.client.0.smithi157.stdout:3/111: sync 2024-04-03T08:39:04.015 INFO:tasks.workunit.client.0.smithi157.stdout:2/172: mkdir d3/d12/d39 0 2024-04-03T08:39:04.015 INFO:tasks.workunit.client.0.smithi157.stdout:3/112: creat d8/d1e/f21 x:0 0 0 2024-04-03T08:39:04.018 INFO:tasks.workunit.client.0.smithi157.stdout:4/158: dread da/df/d11/f27 [0,4194304] 0 2024-04-03T08:39:04.018 INFO:tasks.workunit.client.0.smithi157.stdout:3/113: write d8/d13/f15 [32250,56091] 0 2024-04-03T08:39:04.024 INFO:tasks.workunit.client.0.smithi157.stdout:3/114: rmdir d8/d1e 39 2024-04-03T08:39:04.037 INFO:tasks.workunit.client.0.smithi157.stdout:3/115: dwrite d8/fe [0,4194304] 0 2024-04-03T08:39:04.038 INFO:tasks.workunit.client.0.smithi157.stdout:3/116: fdatasync f4 0 2024-04-03T08:39:04.041 INFO:tasks.workunit.client.0.smithi157.stdout:2/173: dread d3/f21 [0,4194304] 0 2024-04-03T08:39:04.044 INFO:tasks.workunit.client.0.smithi157.stdout:2/174: chown d3/f6 61 1 2024-04-03T08:39:04.045 INFO:tasks.workunit.client.0.smithi157.stdout:3/117: dread d8/f11 [0,4194304] 0 2024-04-03T08:39:04.047 INFO:tasks.workunit.client.0.smithi157.stdout:2/175: symlink d3/db/l3a 0 2024-04-03T08:39:04.048 INFO:tasks.workunit.client.0.smithi157.stdout:3/118: write d8/d1e/f20 [224393,108945] 0 2024-04-03T08:39:04.050 INFO:tasks.workunit.client.0.smithi157.stdout:3/119: dread - d8/d13/f1f zero size 2024-04-03T08:39:04.054 INFO:tasks.workunit.client.0.smithi157.stdout:2/176: creat d3/d2e/f3b x:0 0 0 2024-04-03T08:39:04.055 INFO:tasks.workunit.client.0.smithi157.stdout:3/120: rmdir d8 39 2024-04-03T08:39:04.065 INFO:tasks.workunit.client.0.smithi157.stdout:2/177: dread d3/f7 [4194304,4194304] 0 2024-04-03T08:39:04.069 INFO:tasks.workunit.client.0.smithi157.stdout:2/178: mkdir d3/d2e/d32/d3c 0 2024-04-03T08:39:04.072 INFO:tasks.workunit.client.0.smithi157.stdout:3/121: dwrite d8/f11 [0,4194304] 0 2024-04-03T08:39:04.077 INFO:tasks.workunit.client.0.smithi157.stdout:2/179: link d3/l17 d3/db/l3d 0 2024-04-03T08:39:04.081 INFO:tasks.workunit.client.0.smithi157.stdout:2/180: symlink d3/d2e/d32/l3e 0 2024-04-03T08:39:04.084 INFO:tasks.workunit.client.0.smithi157.stdout:2/181: readlink d3/d12/l1c 0 2024-04-03T08:39:04.087 INFO:tasks.workunit.client.0.smithi157.stdout:2/182: creat d3/d2e/d32/d3c/f3f x:0 0 0 2024-04-03T08:39:04.089 INFO:tasks.workunit.client.0.smithi157.stdout:3/122: dwrite d8/d13/f1a [0,4194304] 0 2024-04-03T08:39:04.091 INFO:tasks.workunit.client.0.smithi157.stdout:3/123: write f4 [3122726,29279] 0 2024-04-03T08:39:04.092 INFO:tasks.workunit.client.0.smithi157.stdout:2/183: link d3/d12/l30 d3/d12/l40 0 2024-04-03T08:39:04.098 INFO:tasks.workunit.client.0.smithi157.stdout:2/184: link d3/db/l3a d3/db/l41 0 2024-04-03T08:39:04.100 INFO:tasks.workunit.client.0.smithi157.stdout:2/185: rmdir d3/d2e/d32 39 2024-04-03T08:39:04.104 INFO:tasks.workunit.client.0.smithi157.stdout:2/186: mknod d3/d2e/c42 0 2024-04-03T08:39:04.107 INFO:tasks.workunit.client.0.smithi157.stdout:2/187: mkdir d3/d12/d43 0 2024-04-03T08:39:04.109 INFO:tasks.workunit.client.0.smithi157.stdout:3/124: dwrite d8/d13/d1b/f1d [0,4194304] 0 2024-04-03T08:39:04.111 INFO:tasks.workunit.client.0.smithi157.stdout:3/125: chown d8/d13/f15 1 1 2024-04-03T08:39:04.112 INFO:tasks.workunit.client.0.smithi157.stdout:2/188: mkdir d3/db/d44 0 2024-04-03T08:39:04.115 INFO:tasks.workunit.client.0.smithi157.stdout:2/189: write d3/d12/f15 [1725419,5525] 0 2024-04-03T08:39:04.115 INFO:tasks.workunit.client.0.smithi157.stdout:3/126: chown c7 63090 1 2024-04-03T08:39:04.115 INFO:tasks.workunit.client.0.smithi157.stdout:3/127: chown d8/d1e 2266 1 2024-04-03T08:39:04.116 INFO:tasks.workunit.client.0.smithi157.stdout:3/128: write d8/f11 [1981751,34389] 0 2024-04-03T08:39:04.119 INFO:tasks.workunit.client.0.smithi157.stdout:3/129: truncate d8/f17 819255 0 2024-04-03T08:39:04.120 INFO:tasks.workunit.client.0.smithi157.stdout:1/117: sync 2024-04-03T08:39:04.122 INFO:tasks.workunit.client.0.smithi157.stdout:1/118: readlink d2/d6/d7/l17 0 2024-04-03T08:39:04.125 INFO:tasks.workunit.client.0.smithi157.stdout:2/190: getdents d3/d12 0 2024-04-03T08:39:04.127 INFO:tasks.workunit.client.0.smithi157.stdout:2/191: write d3/d2e/f3b [418006,10720] 0 2024-04-03T08:39:04.128 INFO:tasks.workunit.client.0.smithi157.stdout:1/119: link d2/c4 d2/d11/c22 0 2024-04-03T08:39:04.131 INFO:tasks.workunit.client.0.smithi157.stdout:1/120: mkdir d2/d11/d23 0 2024-04-03T08:39:04.135 INFO:tasks.workunit.client.0.smithi157.stdout:3/130: dwrite f4 [4194304,4194304] 0 2024-04-03T08:39:04.137 INFO:tasks.workunit.client.0.smithi157.stdout:1/121: rename d2/d6 to d2/d11/d24 0 2024-04-03T08:39:04.139 INFO:tasks.workunit.client.0.smithi157.stdout:1/122: read d2/f5 [106935,92424] 0 2024-04-03T08:39:04.144 INFO:tasks.workunit.client.0.smithi157.stdout:1/123: readlink d2/d11/d24/ld 0 2024-04-03T08:39:04.146 INFO:tasks.workunit.client.0.smithi157.stdout:2/192: dwrite d3/db/f33 [0,4194304] 0 2024-04-03T08:39:04.152 INFO:tasks.workunit.client.0.smithi157.stdout:3/131: dread d8/fc [0,4194304] 0 2024-04-03T08:39:04.154 INFO:tasks.workunit.client.0.smithi157.stdout:2/193: dread d3/db/f1b [0,4194304] 0 2024-04-03T08:39:04.159 INFO:tasks.workunit.client.0.smithi157.stdout:2/194: mknod d3/d12/c45 0 2024-04-03T08:39:04.163 INFO:tasks.workunit.client.0.smithi157.stdout:2/195: write d3/d12/f20 [384791,127560] 0 2024-04-03T08:39:04.164 INFO:tasks.workunit.client.0.smithi157.stdout:1/124: dwrite d2/d11/d24/d7/f9 [4194304,4194304] 0 2024-04-03T08:39:04.178 INFO:tasks.workunit.client.0.smithi157.stdout:3/132: dwrite d8/d13/f1c [0,4194304] 0 2024-04-03T08:39:04.180 INFO:tasks.workunit.client.0.smithi157.stdout:3/133: chown d8/f12 76297603 1 2024-04-03T08:39:04.187 INFO:tasks.workunit.client.0.smithi157.stdout:2/196: mknod d3/d2e/d32/c46 0 2024-04-03T08:39:04.188 INFO:tasks.workunit.client.0.smithi157.stdout:3/134: rmdir d8/d13 39 2024-04-03T08:39:04.190 INFO:tasks.workunit.client.0.smithi157.stdout:1/125: fdatasync d2/d11/d24/d7/fe 0 2024-04-03T08:39:04.196 INFO:tasks.workunit.client.0.smithi157.stdout:3/135: dread d8/d13/f15 [0,4194304] 0 2024-04-03T08:39:04.198 INFO:tasks.workunit.client.0.smithi157.stdout:3/136: fsync d8/fe 0 2024-04-03T08:39:04.206 INFO:tasks.workunit.client.0.smithi157.stdout:2/197: getdents d3/db 0 2024-04-03T08:39:04.208 INFO:tasks.workunit.client.0.smithi157.stdout:1/126: link d2/c4 d2/c25 0 2024-04-03T08:39:04.210 INFO:tasks.workunit.client.0.smithi157.stdout:3/137: link l5 d8/d13/l22 0 2024-04-03T08:39:04.211 INFO:tasks.workunit.client.0.smithi157.stdout:2/198: mknod d3/d12/d39/c47 0 2024-04-03T08:39:04.211 INFO:tasks.workunit.client.0.smithi157.stdout:2/199: fdatasync d3/db/f38 0 2024-04-03T08:39:04.213 INFO:tasks.workunit.client.0.smithi157.stdout:2/200: write d3/d12/f15 [2920138,1009] 0 2024-04-03T08:39:04.214 INFO:tasks.workunit.client.0.smithi157.stdout:3/138: mkdir d8/d13/d23 0 2024-04-03T08:39:04.218 INFO:tasks.workunit.client.0.smithi157.stdout:3/139: rename d8/f12 to d8/d13/d1b/f24 0 2024-04-03T08:39:04.221 INFO:tasks.workunit.client.0.smithi157.stdout:2/201: creat d3/f48 x:0 0 0 2024-04-03T08:39:04.222 INFO:tasks.workunit.client.0.smithi157.stdout:3/140: mknod d8/d13/d1b/c25 0 2024-04-03T08:39:04.223 INFO:tasks.workunit.client.0.smithi157.stdout:3/141: chown f4 377846 1 2024-04-03T08:39:04.224 INFO:tasks.workunit.client.0.smithi157.stdout:2/202: fsync d3/d12/f11 0 2024-04-03T08:39:04.226 INFO:tasks.workunit.client.0.smithi157.stdout:2/203: write d3/d12/f23 [371976,21805] 0 2024-04-03T08:39:04.227 INFO:tasks.workunit.client.0.smithi157.stdout:2/204: chown c2 108 1 2024-04-03T08:39:04.228 INFO:tasks.workunit.client.0.smithi157.stdout:3/142: getdents d8/d13/d23 0 2024-04-03T08:39:04.230 INFO:tasks.workunit.client.0.smithi157.stdout:2/205: chown d3/d2e/d32/l3e 3866476 1 2024-04-03T08:39:04.239 INFO:tasks.workunit.client.0.smithi157.stdout:1/127: dwrite d2/d11/d24/d7/fe [0,4194304] 0 2024-04-03T08:39:04.248 INFO:tasks.workunit.client.0.smithi157.stdout:1/128: dread d2/d11/d24/f13 [0,4194304] 0 2024-04-03T08:39:04.251 INFO:tasks.workunit.client.0.smithi157.stdout:1/129: creat d2/d11/f26 x:0 0 0 2024-04-03T08:39:04.253 INFO:tasks.workunit.client.0.smithi157.stdout:1/130: mknod d2/d11/c27 0 2024-04-03T08:39:04.256 INFO:tasks.workunit.client.0.smithi157.stdout:1/131: creat d2/d11/d24/d7/d1b/f28 x:0 0 0 2024-04-03T08:39:04.305 INFO:tasks.workunit.client.0.smithi157.stdout:2/206: fdatasync d3/d12/f23 0 2024-04-03T08:39:04.308 INFO:tasks.workunit.client.0.smithi157.stdout:2/207: mknod d3/d12/d39/c49 0 2024-04-03T08:39:04.312 INFO:tasks.workunit.client.0.smithi157.stdout:2/208: dread d3/d2e/f3b [0,4194304] 0 2024-04-03T08:39:04.314 INFO:tasks.workunit.client.0.smithi157.stdout:2/209: symlink d3/d12/d43/l4a 0 2024-04-03T08:39:04.317 INFO:tasks.workunit.client.0.smithi157.stdout:2/210: getdents d3/db 0 2024-04-03T08:39:04.319 INFO:tasks.workunit.client.0.smithi157.stdout:2/211: readlink d3/l26 0 2024-04-03T08:39:04.327 INFO:tasks.workunit.client.0.smithi157.stdout:2/212: dread d3/f21 [0,4194304] 0 2024-04-03T08:39:04.329 INFO:tasks.workunit.client.0.smithi157.stdout:2/213: mkdir d3/d12/d43/d4b 0 2024-04-03T08:39:04.333 INFO:tasks.workunit.client.0.smithi157.stdout:5/134: sync 2024-04-03T08:39:04.334 INFO:tasks.workunit.client.0.smithi157.stdout:5/135: chown dc/c2c 112709366 1 2024-04-03T08:39:04.338 INFO:tasks.workunit.client.0.smithi157.stdout:2/214: truncate d3/db/f33 3176611 0 2024-04-03T08:39:04.352 INFO:tasks.workunit.client.0.smithi157.stdout:5/136: dwrite dc/d16/f28 [0,4194304] 0 2024-04-03T08:39:04.355 INFO:tasks.workunit.client.0.smithi157.stdout:2/215: dwrite d3/f48 [0,4194304] 0 2024-04-03T08:39:04.358 INFO:tasks.workunit.client.0.smithi157.stdout:2/216: mkdir d3/db/d44/d4c 0 2024-04-03T08:39:04.359 INFO:tasks.workunit.client.0.smithi157.stdout:2/217: chown d3/d12/d43 32515057 1 2024-04-03T08:39:04.360 INFO:tasks.workunit.client.0.smithi157.stdout:5/137: truncate f7 2385398 0 2024-04-03T08:39:04.364 INFO:tasks.workunit.client.0.smithi157.stdout:2/218: creat d3/f4d x:0 0 0 2024-04-03T08:39:04.367 INFO:tasks.workunit.client.0.smithi157.stdout:2/219: read d3/f5 [649274,39495] 0 2024-04-03T08:39:04.369 INFO:tasks.workunit.client.0.smithi157.stdout:2/220: unlink c2 0 2024-04-03T08:39:04.372 INFO:tasks.workunit.client.0.smithi157.stdout:5/138: dread dc/fd [0,4194304] 0 2024-04-03T08:39:04.374 INFO:tasks.workunit.client.0.smithi157.stdout:2/221: creat d3/f4e x:0 0 0 2024-04-03T08:39:04.375 INFO:tasks.workunit.client.0.smithi157.stdout:5/139: creat dc/d16/d18/f2d x:0 0 0 2024-04-03T08:39:04.376 INFO:tasks.workunit.client.0.smithi157.stdout:5/140: dread - dc/d16/f27 zero size 2024-04-03T08:39:04.378 INFO:tasks.workunit.client.0.smithi157.stdout:2/222: creat d3/d2e/d32/d3c/f4f x:0 0 0 2024-04-03T08:39:04.378 INFO:tasks.workunit.client.0.smithi157.stdout:5/141: chown dc/d16/f28 50456948 1 2024-04-03T08:39:04.379 INFO:tasks.workunit.client.0.smithi157.stdout:2/223: rmdir d3/db 39 2024-04-03T08:39:04.380 INFO:tasks.workunit.client.0.smithi157.stdout:5/142: mkdir dc/d16/d2e 0 2024-04-03T08:39:04.382 INFO:tasks.workunit.client.0.smithi157.stdout:2/224: chown d3/db/f31 177 1 2024-04-03T08:39:04.383 INFO:tasks.workunit.client.0.smithi157.stdout:2/225: dread - d3/d12/f11 zero size 2024-04-03T08:39:04.394 INFO:tasks.workunit.client.0.smithi157.stdout:2/226: dwrite d3/f4d [0,4194304] 0 2024-04-03T08:39:04.399 INFO:tasks.workunit.client.0.smithi157.stdout:6/155: sync 2024-04-03T08:39:04.399 INFO:tasks.workunit.client.0.smithi157.stdout:7/161: sync 2024-04-03T08:39:04.399 INFO:tasks.workunit.client.0.smithi157.stdout:0/146: sync 2024-04-03T08:39:04.399 INFO:tasks.workunit.client.0.smithi157.stdout:4/159: sync 2024-04-03T08:39:04.400 INFO:tasks.workunit.client.0.smithi157.stdout:8/137: sync 2024-04-03T08:39:04.400 INFO:tasks.workunit.client.0.smithi157.stdout:9/102: sync 2024-04-03T08:39:04.401 INFO:tasks.workunit.client.0.smithi157.stdout:2/227: truncate d3/d12/fd 883688 0 2024-04-03T08:39:04.404 INFO:tasks.workunit.client.0.smithi157.stdout:2/228: fdatasync d3/d12/f11 0 2024-04-03T08:39:04.406 INFO:tasks.workunit.client.0.smithi157.stdout:8/138: unlink d2/d20/l26 0 2024-04-03T08:39:04.408 INFO:tasks.workunit.client.0.smithi157.stdout:4/160: rename da/l13 to da/df/d24/d35/l37 0 2024-04-03T08:39:04.411 INFO:tasks.workunit.client.0.smithi157.stdout:7/162: mkdir d0/d11/d15/d17/d43 0 2024-04-03T08:39:04.415 INFO:tasks.workunit.client.0.smithi157.stdout:4/161: creat da/df/d2f/f38 x:0 0 0 2024-04-03T08:39:04.416 INFO:tasks.workunit.client.0.smithi157.stdout:8/139: creat d2/d20/f35 x:0 0 0 2024-04-03T08:39:04.418 INFO:tasks.workunit.client.0.smithi157.stdout:7/163: symlink d0/d16/l44 0 2024-04-03T08:39:04.431 INFO:tasks.workunit.client.0.smithi157.stdout:9/103: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:04.431 INFO:tasks.workunit.client.0.smithi157.stdout:7/164: truncate d0/d5/f3a 478669 0 2024-04-03T08:39:04.435 INFO:tasks.workunit.client.0.smithi157.stdout:6/156: dwrite d1/d5/d17/d2a/d37/f25 [0,4194304] 0 2024-04-03T08:39:04.440 INFO:tasks.workunit.client.0.smithi157.stdout:2/229: dwrite d3/d12/f23 [0,4194304] 0 2024-04-03T08:39:04.441 INFO:tasks.workunit.client.0.smithi157.stdout:0/147: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:04.444 INFO:tasks.workunit.client.0.smithi157.stdout:9/104: rmdir d1/d1d 0 2024-04-03T08:39:04.447 INFO:tasks.workunit.client.0.smithi157.stdout:8/140: truncate d2/d11/d10/d24/f2a 764307 0 2024-04-03T08:39:04.447 INFO:tasks.workunit.client.0.smithi157.stdout:0/148: unlink d2/c1e 0 2024-04-03T08:39:04.448 INFO:tasks.workunit.client.0.smithi157.stdout:6/157: truncate d1/d22/f26 988137 0 2024-04-03T08:39:04.450 INFO:tasks.workunit.client.0.smithi157.stdout:7/165: creat d0/d11/d15/d17/d43/f45 x:0 0 0 2024-04-03T08:39:04.451 INFO:tasks.workunit.client.0.smithi157.stdout:6/158: fsync d1/fc 0 2024-04-03T08:39:04.453 INFO:tasks.workunit.client.0.smithi157.stdout:4/162: dwrite da/d26/f2e [0,4194304] 0 2024-04-03T08:39:04.455 INFO:tasks.workunit.client.0.smithi157.stdout:8/141: mknod d2/d20/d23/c36 0 2024-04-03T08:39:04.455 INFO:tasks.workunit.client.0.smithi157.stdout:9/105: write d1/f5 [1164302,75359] 0 2024-04-03T08:39:04.457 INFO:tasks.workunit.client.0.smithi157.stdout:0/149: mkdir d2/d9/dc/d13/d31 0 2024-04-03T08:39:04.458 INFO:tasks.workunit.client.0.smithi157.stdout:7/166: write d0/d4/f2d [1135500,70254] 0 2024-04-03T08:39:04.459 INFO:tasks.workunit.client.0.smithi157.stdout:4/163: fdatasync da/df/f18 0 2024-04-03T08:39:04.461 INFO:tasks.workunit.client.0.smithi157.stdout:6/159: rmdir d1/d22 39 2024-04-03T08:39:04.461 INFO:tasks.workunit.client.0.smithi157.stdout:4/164: write f4 [5505095,51901] 0 2024-04-03T08:39:04.463 INFO:tasks.workunit.client.0.smithi157.stdout:6/160: fdatasync d1/d5/f18 0 2024-04-03T08:39:04.464 INFO:tasks.workunit.client.0.smithi157.stdout:8/142: rename d2/d20/c2f to d2/d11/d10/d12/c37 0 2024-04-03T08:39:04.465 INFO:tasks.workunit.client.0.smithi157.stdout:6/161: dread - d1/d5/d17/f1d zero size 2024-04-03T08:39:04.467 INFO:tasks.workunit.client.0.smithi157.stdout:7/167: symlink d0/d11/d15/d17/d1c/l46 0 2024-04-03T08:39:04.469 INFO:tasks.workunit.client.0.smithi157.stdout:4/165: chown da/df/l30 46 1 2024-04-03T08:39:04.469 INFO:tasks.workunit.client.0.smithi157.stdout:0/150: mknod d2/d9/dc/d13/d29/c32 0 2024-04-03T08:39:04.471 INFO:tasks.workunit.client.0.smithi157.stdout:7/168: write d0/d11/d15/f1f [1458875,117020] 0 2024-04-03T08:39:04.475 INFO:tasks.workunit.client.0.smithi157.stdout:4/166: write da/df/d11/f27 [913463,23252] 0 2024-04-03T08:39:04.477 INFO:tasks.workunit.client.0.smithi157.stdout:6/162: link d1/d5/d17/d29/c2d d1/c39 0 2024-04-03T08:39:04.479 INFO:tasks.workunit.client.0.smithi157.stdout:0/151: rename d2/d9/dc/d13/l26 to d2/d9/dc/df/d1b/l33 0 2024-04-03T08:39:04.481 INFO:tasks.workunit.client.0.smithi157.stdout:7/169: dread d0/f20 [0,4194304] 0 2024-04-03T08:39:04.482 INFO:tasks.workunit.client.0.smithi157.stdout:1/132: sync 2024-04-03T08:39:04.482 INFO:tasks.workunit.client.0.smithi157.stdout:3/143: sync 2024-04-03T08:39:04.483 INFO:tasks.workunit.client.0.smithi157.stdout:0/152: creat d2/d9/dc/df/d1b/f34 x:0 0 0 2024-04-03T08:39:04.485 INFO:tasks.workunit.client.0.smithi157.stdout:7/170: rmdir d0/d4 39 2024-04-03T08:39:04.486 INFO:tasks.workunit.client.0.smithi157.stdout:3/144: mknod d8/d13/c26 0 2024-04-03T08:39:04.487 INFO:tasks.workunit.client.0.smithi157.stdout:1/133: fdatasync d2/d11/d24/f13 0 2024-04-03T08:39:04.487 INFO:tasks.workunit.client.0.smithi157.stdout:0/153: mkdir d2/d9/dc/df/d1b/d35 0 2024-04-03T08:39:04.490 INFO:tasks.workunit.client.0.smithi157.stdout:7/171: creat d0/d11/d15/d17/d1c/f47 x:0 0 0 2024-04-03T08:39:04.493 INFO:tasks.workunit.client.0.smithi157.stdout:1/134: symlink d2/d11/l29 0 2024-04-03T08:39:04.493 INFO:tasks.workunit.client.0.smithi157.stdout:0/154: mkdir d2/d9/d36 0 2024-04-03T08:39:04.497 INFO:tasks.workunit.client.0.smithi157.stdout:1/135: readlink d2/d11/d24/d7/l17 0 2024-04-03T08:39:04.498 INFO:tasks.workunit.client.0.smithi157.stdout:0/155: creat d2/f37 x:0 0 0 2024-04-03T08:39:04.500 INFO:tasks.workunit.client.0.smithi157.stdout:7/172: rename d0/d4/l8 to d0/d5/l48 0 2024-04-03T08:39:04.502 INFO:tasks.workunit.client.0.smithi157.stdout:0/156: chown d2/fa 461130696 1 2024-04-03T08:39:04.503 INFO:tasks.workunit.client.0.smithi157.stdout:6/163: dwrite d1/d5/d17/d2a/d37/f25 [4194304,4194304] 0 2024-04-03T08:39:04.503 INFO:tasks.workunit.client.0.smithi157.stdout:4/167: dwrite da/d26/f2e [0,4194304] 0 2024-04-03T08:39:04.504 INFO:tasks.workunit.client.0.smithi157.stdout:1/136: write d2/d11/d24/f1c [571685,69951] 0 2024-04-03T08:39:04.506 INFO:tasks.workunit.client.0.smithi157.stdout:6/164: write d1/d5/d17/f1d [421111,27669] 0 2024-04-03T08:39:04.506 INFO:tasks.workunit.client.0.smithi157.stdout:0/157: mkdir d2/d9/d36/d38 0 2024-04-03T08:39:04.512 INFO:tasks.workunit.client.0.smithi157.stdout:1/137: chown d2/d11/d24/l1a 1 1 2024-04-03T08:39:04.513 INFO:tasks.workunit.client.0.smithi157.stdout:7/173: dread d0/d11/f1d [0,4194304] 0 2024-04-03T08:39:04.515 INFO:tasks.workunit.client.0.smithi157.stdout:6/165: truncate d1/d22/f2e 302709 0 2024-04-03T08:39:04.515 INFO:tasks.workunit.client.0.smithi157.stdout:4/168: getdents da/d26 0 2024-04-03T08:39:04.515 INFO:tasks.workunit.client.0.smithi157.stdout:0/158: rename d2/d9/dc/df to d2/d9/dc/df/d1b/d39 22 2024-04-03T08:39:04.517 INFO:tasks.workunit.client.0.smithi157.stdout:0/159: chown d2/f15 27495164 1 2024-04-03T08:39:04.517 INFO:tasks.workunit.client.0.smithi157.stdout:7/174: chown d0/d11/f21 490980472 1 2024-04-03T08:39:04.518 INFO:tasks.workunit.client.0.smithi157.stdout:6/166: chown d1/c36 15 1 2024-04-03T08:39:04.518 INFO:tasks.workunit.client.0.smithi157.stdout:1/138: creat d2/d11/d24/d7/d1b/f2a x:0 0 0 2024-04-03T08:39:04.519 INFO:tasks.workunit.client.0.smithi157.stdout:5/143: sync 2024-04-03T08:39:04.520 INFO:tasks.workunit.client.0.smithi157.stdout:4/169: creat da/df/f39 x:0 0 0 2024-04-03T08:39:04.520 INFO:tasks.workunit.client.0.smithi157.stdout:7/175: dread d0/d11/f1d [0,4194304] 0 2024-04-03T08:39:04.521 INFO:tasks.workunit.client.0.smithi157.stdout:6/167: truncate d1/f1f 282489 0 2024-04-03T08:39:04.522 INFO:tasks.workunit.client.0.smithi157.stdout:6/168: fdatasync d1/f1f 0 2024-04-03T08:39:04.525 INFO:tasks.workunit.client.0.smithi157.stdout:7/176: creat d0/d4/d36/f49 x:0 0 0 2024-04-03T08:39:04.526 INFO:tasks.workunit.client.0.smithi157.stdout:1/139: rename d2/c4 to d2/c2b 0 2024-04-03T08:39:04.527 INFO:tasks.workunit.client.0.smithi157.stdout:6/169: rmdir d1/d5/d17/d2a/d34 39 2024-04-03T08:39:04.529 INFO:tasks.workunit.client.0.smithi157.stdout:4/170: rename da/df/d24/d35/l37 to da/l3a 0 2024-04-03T08:39:04.531 INFO:tasks.workunit.client.0.smithi157.stdout:1/140: creat d2/d11/d24/d7/d1b/f2c x:0 0 0 2024-04-03T08:39:04.532 INFO:tasks.workunit.client.0.smithi157.stdout:7/177: mknod d0/c4a 0 2024-04-03T08:39:04.534 INFO:tasks.workunit.client.0.smithi157.stdout:4/171: creat da/df/d11/f3b x:0 0 0 2024-04-03T08:39:04.536 INFO:tasks.workunit.client.0.smithi157.stdout:4/172: dread - da/df/f2a zero size 2024-04-03T08:39:04.537 INFO:tasks.workunit.client.0.smithi157.stdout:1/141: dread d2/f21 [0,4194304] 0 2024-04-03T08:39:04.540 INFO:tasks.workunit.client.0.smithi157.stdout:4/173: getdents da/d26 0 2024-04-03T08:39:04.540 INFO:tasks.workunit.client.0.smithi157.stdout:5/144: dwrite dc/f15 [0,4194304] 0 2024-04-03T08:39:04.559 INFO:tasks.workunit.client.0.smithi157.stdout:1/142: dwrite d2/d11/d24/f13 [0,4194304] 0 2024-04-03T08:39:04.564 INFO:tasks.workunit.client.0.smithi157.stdout:4/174: dwrite da/df/d11/f1f [0,4194304] 0 2024-04-03T08:39:04.564 INFO:tasks.workunit.client.0.smithi157.stdout:1/143: write f0 [2369596,98730] 0 2024-04-03T08:39:04.573 INFO:tasks.workunit.client.0.smithi157.stdout:4/175: mkdir da/df/d24/d35/d3c 0 2024-04-03T08:39:04.575 INFO:tasks.workunit.client.0.smithi157.stdout:1/144: rename d2/d11/c14 to d2/d11/c2d 0 2024-04-03T08:39:04.599 INFO:tasks.workunit.client.0.smithi157.stdout:7/178: getdents d0/d11/d15/d17/d43 0 2024-04-03T08:39:04.599 INFO:tasks.workunit.client.0.smithi157.stdout:2/230: truncate d3/d12/f20 323522 0 2024-04-03T08:39:04.601 INFO:tasks.workunit.client.0.smithi157.stdout:2/231: chown d3/f4d 173799988 1 2024-04-03T08:39:04.605 INFO:tasks.workunit.client.0.smithi157.stdout:7/179: creat d0/d11/d15/d17/d1c/f4b x:0 0 0 2024-04-03T08:39:04.607 INFO:tasks.workunit.client.0.smithi157.stdout:8/143: getdents d2/d20 0 2024-04-03T08:39:04.609 INFO:tasks.workunit.client.0.smithi157.stdout:2/232: creat d3/d12/d43/f50 x:0 0 0 2024-04-03T08:39:04.610 INFO:tasks.workunit.client.0.smithi157.stdout:9/106: dwrite d1/f19 [0,4194304] 0 2024-04-03T08:39:04.614 INFO:tasks.workunit.client.0.smithi157.stdout:7/180: unlink d0/d11/d15/c1a 0 2024-04-03T08:39:04.615 INFO:tasks.workunit.client.0.smithi157.stdout:8/144: rmdir d2/d11/d10/d24 39 2024-04-03T08:39:04.620 INFO:tasks.workunit.client.0.smithi157.stdout:9/107: fsync d1/f3 0 2024-04-03T08:39:04.622 INFO:tasks.workunit.client.0.smithi157.stdout:6/170: getdents d1 0 2024-04-03T08:39:04.623 INFO:tasks.workunit.client.0.smithi157.stdout:6/171: fdatasync d1/f1f 0 2024-04-03T08:39:04.624 INFO:tasks.workunit.client.0.smithi157.stdout:6/172: stat d1/d5/d17/d2a/d37/c21 0 2024-04-03T08:39:04.628 INFO:tasks.workunit.client.0.smithi157.stdout:9/108: symlink d1/l1f 0 2024-04-03T08:39:04.628 INFO:tasks.workunit.client.0.smithi157.stdout:0/160: rmdir d2/d9/dc 39 2024-04-03T08:39:04.632 INFO:tasks.workunit.client.0.smithi157.stdout:3/145: write d8/d13/f15 [229585,71246] 0 2024-04-03T08:39:04.635 INFO:tasks.workunit.client.0.smithi157.stdout:7/181: link d0/d5/l3c d0/d11/l4c 0 2024-04-03T08:39:04.635 INFO:tasks.workunit.client.0.smithi157.stdout:8/145: dread d2/d11/f1d [0,4194304] 0 2024-04-03T08:39:04.638 INFO:tasks.workunit.client.0.smithi157.stdout:3/146: fdatasync d8/fa 0 2024-04-03T08:39:04.645 INFO:tasks.workunit.client.0.smithi157.stdout:9/109: dread d1/fc [0,4194304] 0 2024-04-03T08:39:04.646 INFO:tasks.workunit.client.0.smithi157.stdout:8/146: creat d2/d11/d10/d12/d2e/f38 x:0 0 0 2024-04-03T08:39:04.647 INFO:tasks.workunit.client.0.smithi157.stdout:6/173: dwrite d1/d22/f2e [0,4194304] 0 2024-04-03T08:39:04.650 INFO:tasks.workunit.client.0.smithi157.stdout:5/145: write dc/d16/d18/f1c [1635403,63050] 0 2024-04-03T08:39:04.650 INFO:tasks.workunit.client.0.smithi157.stdout:0/161: link d2/d9/dc/l24 d2/d9/dc/d13/l3a 0 2024-04-03T08:39:04.653 INFO:tasks.workunit.client.0.smithi157.stdout:7/182: link d0/d5/f3a d0/d11/d15/f4d 0 2024-04-03T08:39:04.654 INFO:tasks.workunit.client.0.smithi157.stdout:0/162: chown d2/fa 64520 1 2024-04-03T08:39:04.657 INFO:tasks.workunit.client.0.smithi157.stdout:7/183: write d0/d11/d15/d17/d1c/f37 [887534,53426] 0 2024-04-03T08:39:04.661 INFO:tasks.workunit.client.0.smithi157.stdout:3/147: creat d8/f27 x:0 0 0 2024-04-03T08:39:04.663 INFO:tasks.workunit.client.0.smithi157.stdout:2/233: write d3/f5 [1286121,28763] 0 2024-04-03T08:39:04.666 INFO:tasks.workunit.client.0.smithi157.stdout:9/110: mknod d1/d15/c20 0 2024-04-03T08:39:04.668 INFO:tasks.workunit.client.0.smithi157.stdout:0/163: mkdir d2/d9/dc/d13/d3b 0 2024-04-03T08:39:04.670 INFO:tasks.workunit.client.0.smithi157.stdout:9/111: chown d1/d15 936 1 2024-04-03T08:39:04.673 INFO:tasks.workunit.client.0.smithi157.stdout:8/147: dwrite d2/d11/d10/d12/f1c [0,4194304] 0 2024-04-03T08:39:04.674 INFO:tasks.workunit.client.0.smithi157.stdout:0/164: write d2/d9/dc/df/f30 [554291,45445] 0 2024-04-03T08:39:04.680 INFO:tasks.workunit.client.0.smithi157.stdout:9/112: unlink d1/f3 0 2024-04-03T08:39:04.680 INFO:tasks.workunit.client.0.smithi157.stdout:7/184: dread d0/d4/f10 [0,4194304] 0 2024-04-03T08:39:04.684 INFO:tasks.workunit.client.0.smithi157.stdout:2/234: mknod d3/d12/d43/d4b/c51 0 2024-04-03T08:39:04.684 INFO:tasks.workunit.client.0.smithi157.stdout:7/185: stat d0/d11/d15/d17/d1c/f37 0 2024-04-03T08:39:04.685 INFO:tasks.workunit.client.0.smithi157.stdout:3/148: dread d8/d13/f1a [0,4194304] 0 2024-04-03T08:39:04.692 INFO:tasks.workunit.client.0.smithi157.stdout:6/174: truncate d1/f3 7754314 0 2024-04-03T08:39:04.693 INFO:tasks.workunit.client.0.smithi157.stdout:5/146: truncate dc/f11 2226433 0 2024-04-03T08:39:04.695 INFO:tasks.workunit.client.0.smithi157.stdout:3/149: write d8/fc [2986492,4150] 0 2024-04-03T08:39:04.699 INFO:tasks.workunit.client.0.smithi157.stdout:7/186: symlink d0/d11/d15/d35/l4e 0 2024-04-03T08:39:04.700 INFO:tasks.workunit.client.0.smithi157.stdout:8/148: dwrite d2/d20/f29 [0,4194304] 0 2024-04-03T08:39:04.701 INFO:tasks.workunit.client.0.smithi157.stdout:3/150: write d8/f17 [191417,73556] 0 2024-04-03T08:39:04.703 INFO:tasks.workunit.client.0.smithi157.stdout:8/149: dread - d2/f25 zero size 2024-04-03T08:39:04.705 INFO:tasks.workunit.client.0.smithi157.stdout:2/235: dread d3/f6 [0,4194304] 0 2024-04-03T08:39:04.709 INFO:tasks.workunit.client.0.smithi157.stdout:0/165: getdents d2 0 2024-04-03T08:39:04.711 INFO:tasks.workunit.client.0.smithi157.stdout:0/166: chown d2/d9 3104 1 2024-04-03T08:39:04.711 INFO:tasks.workunit.client.0.smithi157.stdout:5/147: symlink dc/l2f 0 2024-04-03T08:39:04.719 INFO:tasks.workunit.client.0.smithi157.stdout:6/175: dwrite d1/d5/d1b/f1c [4194304,4194304] 0 2024-04-03T08:39:04.720 INFO:tasks.workunit.client.0.smithi157.stdout:8/150: write d2/d11/d10/d24/f2a [343611,65473] 0 2024-04-03T08:39:04.721 INFO:tasks.workunit.client.0.smithi157.stdout:2/236: chown d3/d12/l40 62200 1 2024-04-03T08:39:04.721 INFO:tasks.workunit.client.0.smithi157.stdout:3/151: dread d8/fc [0,4194304] 0 2024-04-03T08:39:04.725 INFO:tasks.workunit.client.0.smithi157.stdout:8/151: stat d2/d11/d10/d12/c1e 0 2024-04-03T08:39:04.729 INFO:tasks.workunit.client.0.smithi157.stdout:0/167: rename d2/f6 to d2/d9/dc/f3c 0 2024-04-03T08:39:04.734 INFO:tasks.workunit.client.0.smithi157.stdout:2/237: creat d3/d2e/d32/d3c/f52 x:0 0 0 2024-04-03T08:39:04.737 INFO:tasks.workunit.client.0.smithi157.stdout:0/168: rename d2/d9/dc/d13/d29 to d2/d9/dc/df/d1b/d35/d3d 0 2024-04-03T08:39:04.738 INFO:tasks.workunit.client.0.smithi157.stdout:5/148: link dc/d16/l17 dc/d16/l30 0 2024-04-03T08:39:04.741 INFO:tasks.workunit.client.0.smithi157.stdout:7/187: truncate d0/d4/f2d 982675 0 2024-04-03T08:39:04.743 INFO:tasks.workunit.client.0.smithi157.stdout:8/152: creat d2/f39 x:0 0 0 2024-04-03T08:39:04.745 INFO:tasks.workunit.client.0.smithi157.stdout:3/152: dwrite d8/f9 [0,4194304] 0 2024-04-03T08:39:04.745 INFO:tasks.workunit.client.0.smithi157.stdout:0/169: mknod d2/d9/dc/d13/d3b/c3e 0 2024-04-03T08:39:04.749 INFO:tasks.workunit.client.0.smithi157.stdout:0/170: fdatasync d2/f3 0 2024-04-03T08:39:04.749 INFO:tasks.workunit.client.0.smithi157.stdout:3/153: readlink d8/lf 0 2024-04-03T08:39:04.751 INFO:tasks.workunit.client.0.smithi157.stdout:6/176: dwrite d1/d5/d1b/f1c [4194304,4194304] 0 2024-04-03T08:39:04.752 INFO:tasks.workunit.client.0.smithi157.stdout:5/149: getdents dc/d16/d18/d21 0 2024-04-03T08:39:04.752 INFO:tasks.workunit.client.0.smithi157.stdout:7/188: read d0/d11/d15/d17/f25 [3477769,102599] 0 2024-04-03T08:39:04.757 INFO:tasks.workunit.client.0.smithi157.stdout:8/153: mknod d2/d11/d10/d24/c3a 0 2024-04-03T08:39:04.760 INFO:tasks.workunit.client.0.smithi157.stdout:0/171: creat d2/d9/d36/f3f x:0 0 0 2024-04-03T08:39:04.763 INFO:tasks.workunit.client.0.smithi157.stdout:6/177: stat d1/f3 0 2024-04-03T08:39:04.763 INFO:tasks.workunit.client.0.smithi157.stdout:0/172: dread - d2/f2c zero size 2024-04-03T08:39:04.766 INFO:tasks.workunit.client.0.smithi157.stdout:5/150: mknod dc/d16/d18/d21/c31 0 2024-04-03T08:39:04.768 INFO:tasks.workunit.client.0.smithi157.stdout:2/238: dwrite d3/db/f10 [0,4194304] 0 2024-04-03T08:39:04.770 INFO:tasks.workunit.client.0.smithi157.stdout:7/189: mkdir d0/d11/d15/d17/d1c/d4f 0 2024-04-03T08:39:04.775 INFO:tasks.workunit.client.0.smithi157.stdout:3/154: creat d8/f28 x:0 0 0 2024-04-03T08:39:04.775 INFO:tasks.workunit.client.0.smithi157.stdout:8/154: creat d2/d20/f3b x:0 0 0 2024-04-03T08:39:04.775 INFO:tasks.workunit.client.0.smithi157.stdout:0/173: readlink d2/d9/dc/df/d1b/l33 0 2024-04-03T08:39:04.780 INFO:tasks.workunit.client.0.smithi157.stdout:7/190: unlink d0/d11/f34 0 2024-04-03T08:39:04.784 INFO:tasks.workunit.client.0.smithi157.stdout:6/178: dread d1/d22/f2e [0,4194304] 0 2024-04-03T08:39:04.785 INFO:tasks.workunit.client.0.smithi157.stdout:0/174: symlink d2/l40 0 2024-04-03T08:39:04.787 INFO:tasks.workunit.client.0.smithi157.stdout:7/191: read d0/d11/d15/d17/f19 [2476792,17973] 0 2024-04-03T08:39:04.788 INFO:tasks.workunit.client.0.smithi157.stdout:5/151: rename dc/d16/l30 to dc/d16/d2e/l32 0 2024-04-03T08:39:04.793 INFO:tasks.workunit.client.0.smithi157.stdout:8/155: dread d2/d11/f1d [0,4194304] 0 2024-04-03T08:39:04.793 INFO:tasks.workunit.client.0.smithi157.stdout:3/155: creat d8/d13/d23/f29 x:0 0 0 2024-04-03T08:39:04.793 INFO:tasks.workunit.client.0.smithi157.stdout:2/239: creat d3/f53 x:0 0 0 2024-04-03T08:39:04.795 INFO:tasks.workunit.client.0.smithi157.stdout:8/156: write d2/d11/d10/d12/d2e/f38 [925925,54300] 0 2024-04-03T08:39:04.795 INFO:tasks.workunit.client.0.smithi157.stdout:7/192: unlink d0/l26 0 2024-04-03T08:39:04.796 INFO:tasks.workunit.client.0.smithi157.stdout:2/240: readlink d3/db/l2c 0 2024-04-03T08:39:04.798 INFO:tasks.workunit.client.0.smithi157.stdout:5/152: unlink dc/f15 0 2024-04-03T08:39:04.798 INFO:tasks.workunit.client.0.smithi157.stdout:8/157: write d2/d20/f35 [1018417,107271] 0 2024-04-03T08:39:04.802 INFO:tasks.workunit.client.0.smithi157.stdout:0/175: creat d2/d9/dc/d13/d3b/f41 x:0 0 0 2024-04-03T08:39:04.803 INFO:tasks.workunit.client.0.smithi157.stdout:8/158: read d2/d11/f1d [4121840,17602] 0 2024-04-03T08:39:04.806 INFO:tasks.workunit.client.0.smithi157.stdout:3/156: rmdir d8/d13/d23 39 2024-04-03T08:39:04.807 INFO:tasks.workunit.client.0.smithi157.stdout:8/159: stat d2/d11/d10/d12/f28 0 2024-04-03T08:39:04.809 INFO:tasks.workunit.client.0.smithi157.stdout:8/160: truncate d2/f39 700653 0 2024-04-03T08:39:04.813 INFO:tasks.workunit.client.0.smithi157.stdout:8/161: chown d2/d11/d10/d12/d2e/f38 411928659 1 2024-04-03T08:39:04.813 INFO:tasks.workunit.client.0.smithi157.stdout:0/176: mknod d2/d9/dc/df/d1b/d35/d3d/c42 0 2024-04-03T08:39:04.814 INFO:tasks.workunit.client.0.smithi157.stdout:3/157: stat l5 0 2024-04-03T08:39:04.817 INFO:tasks.workunit.client.0.smithi157.stdout:6/179: dread d1/fc [0,4194304] 0 2024-04-03T08:39:04.817 INFO:tasks.workunit.client.0.smithi157.stdout:7/193: write d0/d5/f3a [810450,56328] 0 2024-04-03T08:39:04.818 INFO:tasks.workunit.client.0.smithi157.stdout:2/241: link d3/d12/l2b d3/d12/d39/l54 0 2024-04-03T08:39:04.821 INFO:tasks.workunit.client.0.smithi157.stdout:0/177: readlink d2/d9/dc/d13/l3a 0 2024-04-03T08:39:04.821 INFO:tasks.workunit.client.0.smithi157.stdout:6/180: creat d1/f3a x:0 0 0 2024-04-03T08:39:04.822 INFO:tasks.workunit.client.0.smithi157.stdout:5/153: dwrite dc/d16/d18/f2d [0,4194304] 0 2024-04-03T08:39:04.824 INFO:tasks.workunit.client.0.smithi157.stdout:7/194: write d0/d11/d15/d1b/f3f [656192,100079] 0 2024-04-03T08:39:04.825 INFO:tasks.workunit.client.0.smithi157.stdout:0/178: write d2/d9/dc/d13/f2f [713338,48055] 0 2024-04-03T08:39:04.829 INFO:tasks.workunit.client.0.smithi157.stdout:6/181: creat d1/d5/d17/d2a/d37/f3b x:0 0 0 2024-04-03T08:39:04.832 INFO:tasks.workunit.client.0.smithi157.stdout:7/195: chown d0/d11/d15/d1b/l22 1773517 1 2024-04-03T08:39:04.833 INFO:tasks.workunit.client.0.smithi157.stdout:2/242: getdents d3/d2e 0 2024-04-03T08:39:04.833 INFO:tasks.workunit.client.0.smithi157.stdout:4/176: sync 2024-04-03T08:39:04.833 INFO:tasks.workunit.client.0.smithi157.stdout:1/145: sync 2024-04-03T08:39:04.834 INFO:tasks.workunit.client.0.smithi157.stdout:0/179: mknod d2/d9/c43 0 2024-04-03T08:39:04.838 INFO:tasks.workunit.client.0.smithi157.stdout:5/154: truncate dc/f12 805281 0 2024-04-03T08:39:04.839 INFO:tasks.workunit.client.0.smithi157.stdout:0/180: readlink d2/d9/dc/df/l11 0 2024-04-03T08:39:04.840 INFO:tasks.workunit.client.0.smithi157.stdout:4/177: chown da/df/d11/l23 35987264 1 2024-04-03T08:39:04.840 INFO:tasks.workunit.client.0.smithi157.stdout:2/243: write d3/db/f2a [1497621,35522] 0 2024-04-03T08:39:04.841 INFO:tasks.workunit.client.0.smithi157.stdout:1/146: mkdir d2/d11/d24/d7/d2e 0 2024-04-03T08:39:04.844 INFO:tasks.workunit.client.0.smithi157.stdout:3/158: dwrite d8/f27 [0,4194304] 0 2024-04-03T08:39:04.848 INFO:tasks.workunit.client.0.smithi157.stdout:4/178: dread - da/df/f39 zero size 2024-04-03T08:39:04.849 INFO:tasks.workunit.client.0.smithi157.stdout:7/196: getdents d0/d11/d15/d17/d1c/d4f 0 2024-04-03T08:39:04.849 INFO:tasks.workunit.client.0.smithi157.stdout:6/182: truncate d1/d5/d17/f1d 223116 0 2024-04-03T08:39:04.854 INFO:tasks.workunit.client.0.smithi157.stdout:3/159: mknod d8/d13/d23/c2a 0 2024-04-03T08:39:04.857 INFO:tasks.workunit.client.0.smithi157.stdout:1/147: creat d2/d11/d24/f2f x:0 0 0 2024-04-03T08:39:04.859 INFO:tasks.workunit.client.0.smithi157.stdout:4/179: read da/df/f18 [491113,7445] 0 2024-04-03T08:39:04.862 INFO:tasks.workunit.client.0.smithi157.stdout:6/183: symlink d1/d5/d17/d2a/d34/d38/l3c 0 2024-04-03T08:39:04.866 INFO:tasks.workunit.client.0.smithi157.stdout:1/148: creat d2/d11/d24/d7/d1b/f30 x:0 0 0 2024-04-03T08:39:04.866 INFO:tasks.workunit.client.0.smithi157.stdout:4/180: read da/df/f18 [2350075,44388] 0 2024-04-03T08:39:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:1/149: read d2/d11/d24/f13 [1194353,119131] 0 2024-04-03T08:39:04.872 INFO:tasks.workunit.client.0.smithi157.stdout:2/244: dwrite d3/d12/f23 [0,4194304] 0 2024-04-03T08:39:04.875 INFO:tasks.workunit.client.0.smithi157.stdout:5/155: dread dc/d16/d18/f2d [0,4194304] 0 2024-04-03T08:39:04.878 INFO:tasks.workunit.client.0.smithi157.stdout:1/150: chown d2/d11/d24/ld 68452 1 2024-04-03T08:39:04.881 INFO:tasks.workunit.client.0.smithi157.stdout:5/156: truncate dc/f1d 879753 0 2024-04-03T08:39:04.884 INFO:tasks.workunit.client.0.smithi157.stdout:7/197: dwrite d0/d5/f3e [0,4194304] 0 2024-04-03T08:39:04.886 INFO:tasks.workunit.client.0.smithi157.stdout:3/160: dwrite d8/d13/f14 [0,4194304] 0 2024-04-03T08:39:04.891 INFO:tasks.workunit.client.0.smithi157.stdout:5/157: dread dc/fd [0,4194304] 0 2024-04-03T08:39:04.895 INFO:tasks.workunit.client.0.smithi157.stdout:4/181: dwrite da/f1e [0,4194304] 0 2024-04-03T08:39:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:2/245: write d3/d12/f20 [1119906,84530] 0 2024-04-03T08:39:04.896 INFO:tasks.workunit.client.0.smithi157.stdout:6/184: link d1/d5/d17/d2a/d34/d38/l3c d1/d5/d17/d2a/l3d 0 2024-04-03T08:39:04.900 INFO:tasks.workunit.client.0.smithi157.stdout:5/158: read dc/d16/d18/f2d [3249057,9077] 0 2024-04-03T08:39:04.901 INFO:tasks.workunit.client.0.smithi157.stdout:4/182: dread - da/df/f39 zero size 2024-04-03T08:39:04.902 INFO:tasks.workunit.client.0.smithi157.stdout:5/159: dread - dc/d16/f20 zero size 2024-04-03T08:39:04.903 INFO:tasks.workunit.client.0.smithi157.stdout:1/151: rename d2/c15 to d2/d11/d24/c31 0 2024-04-03T08:39:04.904 INFO:tasks.workunit.client.0.smithi157.stdout:4/183: read da/d26/f2e [1577002,93440] 0 2024-04-03T08:39:04.908 INFO:tasks.workunit.client.0.smithi157.stdout:2/246: unlink d3/f4d 0 2024-04-03T08:39:04.916 INFO:tasks.workunit.client.0.smithi157.stdout:7/198: dread d0/d11/d15/d17/d1c/f37 [0,4194304] 0 2024-04-03T08:39:04.916 INFO:tasks.workunit.client.0.smithi157.stdout:1/152: write d2/d11/d24/f13 [5218357,94210] 0 2024-04-03T08:39:04.916 INFO:tasks.workunit.client.0.smithi157.stdout:5/160: link dc/d16/f27 dc/d16/f33 0 2024-04-03T08:39:04.916 INFO:tasks.workunit.client.0.smithi157.stdout:1/153: write d2/f5 [5000760,49542] 0 2024-04-03T08:39:04.916 INFO:tasks.workunit.client.0.smithi157.stdout:6/185: symlink d1/l3e 0 2024-04-03T08:39:04.917 INFO:tasks.workunit.client.0.smithi157.stdout:3/161: getdents d8/d13/d1b 0 2024-04-03T08:39:04.920 INFO:tasks.workunit.client.0.smithi157.stdout:1/154: chown d2/d11/d24/f2f 9096151 1 2024-04-03T08:39:04.922 INFO:tasks.workunit.client.0.smithi157.stdout:1/155: fdatasync d2/d11/d24/d7/d1b/f28 0 2024-04-03T08:39:04.923 INFO:tasks.workunit.client.0.smithi157.stdout:6/186: unlink d1/d5/d17/d2a/d37/f2b 0 2024-04-03T08:39:04.925 INFO:tasks.workunit.client.0.smithi157.stdout:3/162: mknod d8/d13/d1b/c2b 0 2024-04-03T08:39:04.927 INFO:tasks.workunit.client.0.smithi157.stdout:1/156: mkdir d2/d32 0 2024-04-03T08:39:04.928 INFO:tasks.workunit.client.0.smithi157.stdout:6/187: readlink d1/d5/d17/d2a/l3d 0 2024-04-03T08:39:04.930 INFO:tasks.workunit.client.0.smithi157.stdout:2/247: dwrite d3/f53 [0,4194304] 0 2024-04-03T08:39:04.931 INFO:tasks.workunit.client.0.smithi157.stdout:1/157: write d2/d11/d24/d7/f1d [1845286,107480] 0 2024-04-03T08:39:04.931 INFO:tasks.workunit.client.0.smithi157.stdout:5/161: rmdir dc 39 2024-04-03T08:39:04.932 INFO:tasks.workunit.client.0.smithi157.stdout:7/199: write d0/d11/f1d [727309,12402] 0 2024-04-03T08:39:04.938 INFO:tasks.workunit.client.0.smithi157.stdout:3/163: creat d8/f2c x:0 0 0 2024-04-03T08:39:04.942 INFO:tasks.workunit.client.0.smithi157.stdout:2/248: unlink d3/d12/f15 0 2024-04-03T08:39:04.942 INFO:tasks.workunit.client.0.smithi157.stdout:6/188: mknod d1/d5/d17/d2a/d30/c3f 0 2024-04-03T08:39:04.944 INFO:tasks.workunit.client.0.smithi157.stdout:2/249: dread - d3/d12/f11 zero size 2024-04-03T08:39:04.947 INFO:tasks.workunit.client.0.smithi157.stdout:3/164: mkdir d8/d1e/d2d 0 2024-04-03T08:39:04.947 INFO:tasks.workunit.client.0.smithi157.stdout:2/250: write d3/db/f1a [1694949,125550] 0 2024-04-03T08:39:04.950 INFO:tasks.workunit.client.0.smithi157.stdout:2/251: fdatasync d3/db/f2a 0 2024-04-03T08:39:04.951 INFO:tasks.workunit.client.0.smithi157.stdout:5/162: rename dc/d16 to dc/d34 0 2024-04-03T08:39:04.951 INFO:tasks.workunit.client.0.smithi157.stdout:7/200: dread d0/d4/f10 [0,4194304] 0 2024-04-03T08:39:04.953 INFO:tasks.workunit.client.0.smithi157.stdout:6/189: mkdir d1/d5/d17/d2a/d40 0 2024-04-03T08:39:04.955 INFO:tasks.workunit.client.0.smithi157.stdout:5/163: mkdir dc/d35 0 2024-04-03T08:39:04.956 INFO:tasks.workunit.client.0.smithi157.stdout:5/164: chown dc/d34/f26 420 1 2024-04-03T08:39:04.957 INFO:tasks.workunit.client.0.smithi157.stdout:7/201: creat d0/d11/d15/d35/f50 x:0 0 0 2024-04-03T08:39:04.959 INFO:tasks.workunit.client.0.smithi157.stdout:2/252: rename d3/d12/d39 to d3/d12/d43/d4b/d55 0 2024-04-03T08:39:04.961 INFO:tasks.workunit.client.0.smithi157.stdout:6/190: creat d1/d5/d1b/f41 x:0 0 0 2024-04-03T08:39:04.961 INFO:tasks.workunit.client.0.smithi157.stdout:5/165: symlink dc/d34/d18/d21/l36 0 2024-04-03T08:39:04.962 INFO:tasks.workunit.client.0.smithi157.stdout:2/253: write d3/d12/fd [81075,21074] 0 2024-04-03T08:39:04.963 INFO:tasks.workunit.client.0.smithi157.stdout:7/202: mkdir d0/d16/d51 0 2024-04-03T08:39:04.963 INFO:tasks.workunit.client.0.smithi157.stdout:6/191: write d1/d5/f18 [1022146,123368] 0 2024-04-03T08:39:04.965 INFO:tasks.workunit.client.0.smithi157.stdout:1/158: truncate d2/d11/d24/d7/fe 3794597 0 2024-04-03T08:39:04.967 INFO:tasks.workunit.client.0.smithi157.stdout:5/166: rmdir dc 39 2024-04-03T08:39:04.969 INFO:tasks.workunit.client.0.smithi157.stdout:1/159: symlink d2/d11/l33 0 2024-04-03T08:39:04.970 INFO:tasks.workunit.client.0.smithi157.stdout:1/160: truncate f0 4742550 0 2024-04-03T08:39:04.971 INFO:tasks.workunit.client.0.smithi157.stdout:2/254: unlink d3/c16 0 2024-04-03T08:39:04.974 INFO:tasks.workunit.client.0.smithi157.stdout:7/203: mkdir d0/d11/d15/d17/d52 0 2024-04-03T08:39:04.975 INFO:tasks.workunit.client.0.smithi157.stdout:7/204: chown d0/c3 247637837 1 2024-04-03T08:39:04.979 INFO:tasks.workunit.client.0.smithi157.stdout:5/167: creat dc/d34/d18/f37 x:0 0 0 2024-04-03T08:39:04.985 INFO:tasks.workunit.client.0.smithi157.stdout:5/168: creat dc/d29/f38 x:0 0 0 2024-04-03T08:39:04.986 INFO:tasks.workunit.client.0.smithi157.stdout:3/165: dread d8/d13/d1b/f24 [0,4194304] 0 2024-04-03T08:39:04.987 INFO:tasks.workunit.client.0.smithi157.stdout:6/192: write d1/d5/f1a [980121,72584] 0 2024-04-03T08:39:04.988 INFO:tasks.workunit.client.0.smithi157.stdout:5/169: fsync dc/f1f 0 2024-04-03T08:39:04.989 INFO:tasks.workunit.client.0.smithi157.stdout:1/161: dread f0 [0,4194304] 0 2024-04-03T08:39:04.992 INFO:tasks.workunit.client.0.smithi157.stdout:6/193: dread - d1/d5/d1b/f41 zero size 2024-04-03T08:39:04.993 INFO:tasks.workunit.client.0.smithi157.stdout:3/166: write d8/f28 [88761,38397] 0 2024-04-03T08:39:04.995 INFO:tasks.workunit.client.0.smithi157.stdout:5/170: symlink dc/d34/d2e/l39 0 2024-04-03T08:39:04.997 INFO:tasks.workunit.client.0.smithi157.stdout:6/194: chown d1/d5/c1e 523473365 1 2024-04-03T08:39:04.998 INFO:tasks.workunit.client.0.smithi157.stdout:3/167: truncate d8/f28 737196 0 2024-04-03T08:39:05.000 INFO:tasks.workunit.client.0.smithi157.stdout:5/171: chown dc/f12 177963190 1 2024-04-03T08:39:05.000 INFO:tasks.workunit.client.0.smithi157.stdout:7/205: dwrite d0/d11/f1d [0,4194304] 0 2024-04-03T08:39:05.001 INFO:tasks.workunit.client.0.smithi157.stdout:2/255: dwrite d3/d2e/f3b [0,4194304] 0 2024-04-03T08:39:05.001 INFO:tasks.workunit.client.0.smithi157.stdout:3/168: rmdir d8 39 2024-04-03T08:39:05.003 INFO:tasks.workunit.client.0.smithi157.stdout:7/206: fsync d0/d5/f3a 0 2024-04-03T08:39:05.005 INFO:tasks.workunit.client.0.smithi157.stdout:7/207: chown d0/d4/d36/f3d 0 1 2024-04-03T08:39:05.006 INFO:tasks.workunit.client.0.smithi157.stdout:6/195: creat d1/f42 x:0 0 0 2024-04-03T08:39:05.013 INFO:tasks.workunit.client.0.smithi157.stdout:3/169: rename d8/c10 to d8/d1e/c2e 0 2024-04-03T08:39:05.014 INFO:tasks.workunit.client.0.smithi157.stdout:3/170: chown d8/ld 51 1 2024-04-03T08:39:05.022 INFO:tasks.workunit.client.0.smithi157.stdout:3/171: rename d8/f27 to d8/f2f 0 2024-04-03T08:39:05.027 INFO:tasks.workunit.client.0.smithi157.stdout:6/196: dread d1/d5/d1b/f1c [4194304,4194304] 0 2024-04-03T08:39:05.031 INFO:tasks.workunit.client.0.smithi157.stdout:3/172: mkdir d8/d1e/d2d/d30 0 2024-04-03T08:39:05.031 INFO:tasks.workunit.client.0.smithi157.stdout:9/113: sync 2024-04-03T08:39:05.031 INFO:tasks.workunit.client.0.smithi157.stdout:5/172: dwrite dc/f1f [0,4194304] 0 2024-04-03T08:39:05.031 INFO:tasks.workunit.client.0.smithi157.stdout:7/208: dwrite d0/d11/d15/f1f [0,4194304] 0 2024-04-03T08:39:05.034 INFO:tasks.workunit.client.0.smithi157.stdout:2/256: dwrite d3/d12/f20 [0,4194304] 0 2024-04-03T08:39:05.035 INFO:tasks.workunit.client.0.smithi157.stdout:6/197: write d1/f42 [289482,130853] 0 2024-04-03T08:39:05.041 INFO:tasks.workunit.client.0.smithi157.stdout:3/173: creat d8/d13/f31 x:0 0 0 2024-04-03T08:39:05.041 INFO:tasks.workunit.client.0.smithi157.stdout:5/173: write dc/d34/d18/f1c [3778592,97953] 0 2024-04-03T08:39:05.043 INFO:tasks.workunit.client.0.smithi157.stdout:9/114: write d1/f19 [4977299,18885] 0 2024-04-03T08:39:05.046 INFO:tasks.workunit.client.0.smithi157.stdout:5/174: fsync dc/d34/f28 0 2024-04-03T08:39:05.048 INFO:tasks.workunit.client.0.smithi157.stdout:2/257: rename d3/db/f10 to d3/d12/f56 0 2024-04-03T08:39:05.048 INFO:tasks.workunit.client.0.smithi157.stdout:6/198: mknod d1/d5/d1b/c43 0 2024-04-03T08:39:05.050 INFO:tasks.workunit.client.0.smithi157.stdout:2/258: chown d3/d2e/f3b 10 1 2024-04-03T08:39:05.050 INFO:tasks.workunit.client.0.smithi157.stdout:7/209: rmdir d0/d16/d51 0 2024-04-03T08:39:05.052 INFO:tasks.workunit.client.0.smithi157.stdout:2/259: read - d3/d2e/d32/d3c/f52 zero size 2024-04-03T08:39:05.053 INFO:tasks.workunit.client.0.smithi157.stdout:3/174: rmdir d8/d1e/d2d 39 2024-04-03T08:39:05.054 INFO:tasks.workunit.client.0.smithi157.stdout:2/260: read d3/d12/f20 [3339903,86073] 0 2024-04-03T08:39:05.055 INFO:tasks.workunit.client.0.smithi157.stdout:5/175: creat dc/d34/d18/f3a x:0 0 0 2024-04-03T08:39:05.056 INFO:tasks.workunit.client.0.smithi157.stdout:6/199: mknod d1/d5/d1b/d2c/c44 0 2024-04-03T08:39:05.060 INFO:tasks.workunit.client.0.smithi157.stdout:5/176: mknod dc/d34/d18/c3b 0 2024-04-03T08:39:05.062 INFO:tasks.workunit.client.0.smithi157.stdout:6/200: creat d1/d5/d17/d2a/d34/f45 x:0 0 0 2024-04-03T08:39:05.064 INFO:tasks.workunit.client.0.smithi157.stdout:9/115: getdents d1 0 2024-04-03T08:39:05.067 INFO:tasks.workunit.client.0.smithi157.stdout:9/116: dread - d1/d15/d16/f1e zero size 2024-04-03T08:39:05.070 INFO:tasks.workunit.client.0.smithi157.stdout:6/201: dread d1/f1f [0,4194304] 0 2024-04-03T08:39:05.075 INFO:tasks.workunit.client.0.smithi157.stdout:2/261: dwrite d3/f53 [0,4194304] 0 2024-04-03T08:39:05.075 INFO:tasks.workunit.client.0.smithi157.stdout:6/202: creat d1/d5/f46 x:0 0 0 2024-04-03T08:39:05.078 INFO:tasks.workunit.client.0.smithi157.stdout:2/262: read d3/d12/fa [412166,43111] 0 2024-04-03T08:39:05.084 INFO:tasks.workunit.client.0.smithi157.stdout:2/263: mknod d3/db/d44/d4c/c57 0 2024-04-03T08:39:05.084 INFO:tasks.workunit.client.0.smithi157.stdout:5/177: dwrite dc/d34/f20 [0,4194304] 0 2024-04-03T08:39:05.090 INFO:tasks.workunit.client.0.smithi157.stdout:9/117: dwrite d1/f1b [0,4194304] 0 2024-04-03T08:39:05.167 INFO:tasks.workunit.client.0.smithi157.stdout:9/118: truncate d1/d15/d16/f1e 558741 0 2024-04-03T08:39:05.169 INFO:tasks.workunit.client.0.smithi157.stdout:9/119: chown d1/f17 23 1 2024-04-03T08:39:05.170 INFO:tasks.workunit.client.0.smithi157.stdout:6/203: truncate d1/d22/f2e 3039570 0 2024-04-03T08:39:05.171 INFO:tasks.workunit.client.0.smithi157.stdout:6/204: readlink d1/d5/la 0 2024-04-03T08:39:05.172 INFO:tasks.workunit.client.0.smithi157.stdout:2/264: link d3/db/l19 d3/db/d44/d4c/l58 0 2024-04-03T08:39:05.174 INFO:tasks.workunit.client.0.smithi157.stdout:6/205: write d1/d5/f35 [74060,12614] 0 2024-04-03T08:39:05.175 INFO:tasks.workunit.client.0.smithi157.stdout:5/178: truncate dc/f13 220935 0 2024-04-03T08:39:05.181 INFO:tasks.workunit.client.0.smithi157.stdout:5/179: symlink dc/d34/d2e/l3c 0 2024-04-03T08:39:05.184 INFO:tasks.workunit.client.0.smithi157.stdout:6/206: creat d1/d5/d17/d2a/f47 x:0 0 0 2024-04-03T08:39:05.185 INFO:tasks.workunit.client.0.smithi157.stdout:5/180: mknod dc/c3d 0 2024-04-03T08:39:05.186 INFO:tasks.workunit.client.0.smithi157.stdout:5/181: read f8 [58615,4114] 0 2024-04-03T08:39:05.187 INFO:tasks.workunit.client.0.smithi157.stdout:9/120: dwrite d1/f1b [0,4194304] 0 2024-04-03T08:39:05.192 INFO:tasks.workunit.client.0.smithi157.stdout:9/121: creat d1/d15/f21 x:0 0 0 2024-04-03T08:39:05.196 INFO:tasks.workunit.client.0.smithi157.stdout:9/122: rename l0 to d1/l22 0 2024-04-03T08:39:05.199 INFO:tasks.workunit.client.0.smithi157.stdout:5/182: dread f7 [0,4194304] 0 2024-04-03T08:39:05.202 INFO:tasks.workunit.client.0.smithi157.stdout:5/183: dread dc/fd [0,4194304] 0 2024-04-03T08:39:05.203 INFO:tasks.workunit.client.0.smithi157.stdout:5/184: write dc/d34/f28 [944639,74305] 0 2024-04-03T08:39:05.210 INFO:tasks.workunit.client.0.smithi157.stdout:5/185: creat dc/d34/d18/f3e x:0 0 0 2024-04-03T08:39:05.212 INFO:tasks.workunit.client.0.smithi157.stdout:6/207: dread d1/fb [0,4194304] 0 2024-04-03T08:39:05.213 INFO:tasks.workunit.client.0.smithi157.stdout:8/162: sync 2024-04-03T08:39:05.217 INFO:tasks.workunit.client.0.smithi157.stdout:6/208: write d1/d5/d1b/f1c [7439875,129739] 0 2024-04-03T08:39:05.217 INFO:tasks.workunit.client.0.smithi157.stdout:8/163: creat d2/d20/f3c x:0 0 0 2024-04-03T08:39:05.220 INFO:tasks.workunit.client.0.smithi157.stdout:9/123: creat d1/d15/d16/f23 x:0 0 0 2024-04-03T08:39:05.221 INFO:tasks.workunit.client.0.smithi157.stdout:8/164: read d2/d11/d10/f16 [1502440,118275] 0 2024-04-03T08:39:05.223 INFO:tasks.workunit.client.0.smithi157.stdout:9/124: mknod d1/d15/d16/c24 0 2024-04-03T08:39:05.228 INFO:tasks.workunit.client.0.smithi157.stdout:5/186: dread dc/f13 [0,4194304] 0 2024-04-03T08:39:05.229 INFO:tasks.workunit.client.0.smithi157.stdout:9/125: read d1/f13 [123996,74838] 0 2024-04-03T08:39:05.229 INFO:tasks.workunit.client.0.smithi157.stdout:6/209: link d1/d5/f12 d1/f48 0 2024-04-03T08:39:05.233 INFO:tasks.workunit.client.0.smithi157.stdout:5/187: mkdir dc/d34/d2e/d3f 0 2024-04-03T08:39:05.233 INFO:tasks.workunit.client.0.smithi157.stdout:5/188: stat dc/ce 0 2024-04-03T08:39:05.234 INFO:tasks.workunit.client.0.smithi157.stdout:9/126: mknod d1/c25 0 2024-04-03T08:39:05.235 INFO:tasks.workunit.client.0.smithi157.stdout:5/189: read - dc/d29/f38 zero size 2024-04-03T08:39:05.241 INFO:tasks.workunit.client.0.smithi157.stdout:6/210: truncate d1/d22/f26 976165 0 2024-04-03T08:39:05.244 INFO:tasks.workunit.client.0.smithi157.stdout:6/211: write d1/d5/f18 [12359,107187] 0 2024-04-03T08:39:05.248 INFO:tasks.workunit.client.0.smithi157.stdout:8/165: dread d2/d11/d10/f16 [0,4194304] 0 2024-04-03T08:39:05.253 INFO:tasks.workunit.client.0.smithi157.stdout:5/190: dwrite dc/d34/d18/f3a [0,4194304] 0 2024-04-03T08:39:05.254 INFO:tasks.workunit.client.0.smithi157.stdout:9/127: dwrite d1/d15/f21 [0,4194304] 0 2024-04-03T08:39:05.258 INFO:tasks.workunit.client.0.smithi157.stdout:8/166: creat d2/f3d x:0 0 0 2024-04-03T08:39:05.260 INFO:tasks.workunit.client.0.smithi157.stdout:9/128: rmdir d1/d15/d16 39 2024-04-03T08:39:05.261 INFO:tasks.workunit.client.0.smithi157.stdout:6/212: link d1/c39 d1/d5/d17/d2a/d34/c49 0 2024-04-03T08:39:05.268 INFO:tasks.workunit.client.0.smithi157.stdout:5/191: rmdir dc/d34/d2e/d3f 0 2024-04-03T08:39:05.269 INFO:tasks.workunit.client.0.smithi157.stdout:9/129: dread d1/d15/f1a [0,4194304] 0 2024-04-03T08:39:05.272 INFO:tasks.workunit.client.0.smithi157.stdout:6/213: dread d1/f42 [0,4194304] 0 2024-04-03T08:39:05.272 INFO:tasks.workunit.client.0.smithi157.stdout:9/130: rmdir d1/d15 39 2024-04-03T08:39:05.275 INFO:tasks.workunit.client.0.smithi157.stdout:6/214: truncate d1/d5/f46 318546 0 2024-04-03T08:39:05.280 INFO:tasks.workunit.client.0.smithi157.stdout:9/131: creat d1/f26 x:0 0 0 2024-04-03T08:39:05.281 INFO:tasks.workunit.client.0.smithi157.stdout:6/215: rmdir d1/d5/d17/d29 39 2024-04-03T08:39:05.285 INFO:tasks.workunit.client.0.smithi157.stdout:6/216: truncate d1/d5/d17/d2a/d34/f45 334294 0 2024-04-03T08:39:05.285 INFO:tasks.workunit.client.0.smithi157.stdout:9/132: mkdir d1/d15/d27 0 2024-04-03T08:39:05.286 INFO:tasks.workunit.client.0.smithi157.stdout:9/133: chown d1/c25 1494244005 1 2024-04-03T08:39:05.287 INFO:tasks.workunit.client.0.smithi157.stdout:6/217: mknod d1/d5/d1b/c4a 0 2024-04-03T08:39:05.290 INFO:tasks.workunit.client.0.smithi157.stdout:9/134: symlink d1/d15/d27/l28 0 2024-04-03T08:39:05.294 INFO:tasks.workunit.client.0.smithi157.stdout:9/135: dread d1/d15/d16/f1e [0,4194304] 0 2024-04-03T08:39:05.297 INFO:tasks.workunit.client.0.smithi157.stdout:9/136: mknod d1/d15/d27/c29 0 2024-04-03T08:39:05.299 INFO:tasks.workunit.client.0.smithi157.stdout:9/137: chown d1/f13 70981031 1 2024-04-03T08:39:05.304 INFO:tasks.workunit.client.0.smithi157.stdout:8/167: dread d2/d11/ff [0,4194304] 0 2024-04-03T08:39:05.304 INFO:tasks.workunit.client.0.smithi157.stdout:6/218: dwrite d1/d5/f12 [4194304,4194304] 0 2024-04-03T08:39:05.305 INFO:tasks.workunit.client.0.smithi157.stdout:9/138: rename d1/d15/f21 to d1/d15/d16/f2a 0 2024-04-03T08:39:05.306 INFO:tasks.workunit.client.0.smithi157.stdout:9/139: read d1/d15/f1a [64374,102612] 0 2024-04-03T08:39:05.308 INFO:tasks.workunit.client.0.smithi157.stdout:9/140: read d1/d15/f1a [287608,118218] 0 2024-04-03T08:39:05.309 INFO:tasks.workunit.client.0.smithi157.stdout:6/219: chown d1/ld 1 1 2024-04-03T08:39:05.311 INFO:tasks.workunit.client.0.smithi157.stdout:6/220: write d1/d5/f46 [1157256,115264] 0 2024-04-03T08:39:05.315 INFO:tasks.workunit.client.0.smithi157.stdout:6/221: dread d1/d5/d17/d2a/d34/f45 [0,4194304] 0 2024-04-03T08:39:05.316 INFO:tasks.workunit.client.0.smithi157.stdout:8/168: write d2/d11/d10/f16 [95215,111147] 0 2024-04-03T08:39:05.317 INFO:tasks.workunit.client.0.smithi157.stdout:9/141: write d1/d15/d16/f1e [1272728,58487] 0 2024-04-03T08:39:05.321 INFO:tasks.workunit.client.0.smithi157.stdout:9/142: truncate d1/f17 808367 0 2024-04-03T08:39:05.327 INFO:tasks.workunit.client.0.smithi157.stdout:6/222: write d1/fb [2239623,67496] 0 2024-04-03T08:39:05.333 INFO:tasks.workunit.client.0.smithi157.stdout:8/169: dread d2/d11/d10/f16 [0,4194304] 0 2024-04-03T08:39:05.335 INFO:tasks.workunit.client.0.smithi157.stdout:6/223: rename d1/d5/d17/d2a/d34 to d1/d4b 0 2024-04-03T08:39:05.337 INFO:tasks.workunit.client.0.smithi157.stdout:9/143: dwrite d1/f5 [0,4194304] 0 2024-04-03T08:39:05.337 INFO:tasks.workunit.client.0.smithi157.stdout:6/224: read d1/f3 [3670217,84098] 0 2024-04-03T08:39:05.339 INFO:tasks.workunit.client.0.smithi157.stdout:9/144: read - d1/f26 zero size 2024-04-03T08:39:05.349 INFO:tasks.workunit.client.0.smithi157.stdout:8/170: truncate d2/d11/d10/d12/f1c 1781447 0 2024-04-03T08:39:05.349 INFO:tasks.workunit.client.0.smithi157.stdout:6/225: dread d1/f48 [4194304,4194304] 0 2024-04-03T08:39:05.349 INFO:tasks.workunit.client.0.smithi157.stdout:9/145: dread d1/d15/d16/f2a [0,4194304] 0 2024-04-03T08:39:05.353 INFO:tasks.workunit.client.0.smithi157.stdout:9/146: mkdir d1/d15/d27/d2b 0 2024-04-03T08:39:05.354 INFO:tasks.workunit.client.0.smithi157.stdout:0/181: sync 2024-04-03T08:39:05.358 INFO:tasks.workunit.client.0.smithi157.stdout:9/147: link d1/d15/d16/l1c d1/d15/d16/l2c 0 2024-04-03T08:39:05.360 INFO:tasks.workunit.client.0.smithi157.stdout:9/148: chown d1/d15/f1a 125412790 1 2024-04-03T08:39:05.361 INFO:tasks.workunit.client.0.smithi157.stdout:6/226: write d1/d5/d17/f1d [1240795,60968] 0 2024-04-03T08:39:05.362 INFO:tasks.workunit.client.0.smithi157.stdout:0/182: link d2/d9/dc/l28 d2/d9/dc/df/l44 0 2024-04-03T08:39:05.362 INFO:tasks.workunit.client.0.smithi157.stdout:6/227: chown d1/d22 2928742 1 2024-04-03T08:39:05.363 INFO:tasks.workunit.client.0.smithi157.stdout:6/228: dread - d1/f3a zero size 2024-04-03T08:39:05.365 INFO:tasks.workunit.client.0.smithi157.stdout:0/183: truncate d2/d9/dc/d13/f20 514956 0 2024-04-03T08:39:05.368 INFO:tasks.workunit.client.0.smithi157.stdout:9/149: getdents d1 0 2024-04-03T08:39:05.370 INFO:tasks.workunit.client.0.smithi157.stdout:6/229: rename d1/d5/f12 to d1/d4b/d38/f4c 0 2024-04-03T08:39:05.371 INFO:tasks.workunit.client.0.smithi157.stdout:0/184: mknod d2/d9/dc/df/d1b/d35/c45 0 2024-04-03T08:39:05.373 INFO:tasks.workunit.client.0.smithi157.stdout:0/185: chown d2/f22 0 1 2024-04-03T08:39:05.373 INFO:tasks.workunit.client.0.smithi157.stdout:9/150: unlink d1/l22 0 2024-04-03T08:39:05.376 INFO:tasks.workunit.client.0.smithi157.stdout:6/230: creat d1/d5/d17/d2a/f4d x:0 0 0 2024-04-03T08:39:05.378 INFO:tasks.workunit.client.0.smithi157.stdout:6/231: write d1/d5/f1a [862442,88508] 0 2024-04-03T08:39:05.378 INFO:tasks.workunit.client.0.smithi157.stdout:0/186: getdents d2/d9/d36/d38 0 2024-04-03T08:39:05.383 INFO:tasks.workunit.client.0.smithi157.stdout:6/232: truncate d1/d5/d17/d2a/f4d 223574 0 2024-04-03T08:39:05.384 INFO:tasks.workunit.client.0.smithi157.stdout:8/171: dread d2/fb [0,4194304] 0 2024-04-03T08:39:05.386 INFO:tasks.workunit.client.0.smithi157.stdout:8/172: fdatasync d2/d20/f3c 0 2024-04-03T08:39:05.387 INFO:tasks.workunit.client.0.smithi157.stdout:6/233: creat d1/d5/d17/f4e x:0 0 0 2024-04-03T08:39:05.388 INFO:tasks.workunit.client.0.smithi157.stdout:8/173: rmdir d2/d11/d10 39 2024-04-03T08:39:05.388 INFO:tasks.workunit.client.0.smithi157.stdout:6/234: rmdir d1/d22 39 2024-04-03T08:39:05.394 INFO:tasks.workunit.client.0.smithi157.stdout:6/235: fdatasync d1/d22/f26 0 2024-04-03T08:39:05.398 INFO:tasks.workunit.client.0.smithi157.stdout:6/236: fdatasync d1/d5/d17/d2a/d37/f25 0 2024-04-03T08:39:05.399 INFO:tasks.workunit.client.0.smithi157.stdout:8/174: write d2/d11/d10/d12/f1c [1624474,37308] 0 2024-04-03T08:39:05.400 INFO:tasks.workunit.client.0.smithi157.stdout:9/151: dwrite d1/f26 [0,4194304] 0 2024-04-03T08:39:05.407 INFO:tasks.workunit.client.0.smithi157.stdout:8/175: creat d2/d11/f3e x:0 0 0 2024-04-03T08:39:05.412 INFO:tasks.workunit.client.0.smithi157.stdout:9/152: creat d1/d15/f2d x:0 0 0 2024-04-03T08:39:05.415 INFO:tasks.workunit.client.0.smithi157.stdout:9/153: read d1/fe [181354,60926] 0 2024-04-03T08:39:05.420 INFO:tasks.workunit.client.0.smithi157.stdout:9/154: rename d1/f13 to d1/f2e 0 2024-04-03T08:39:05.424 INFO:tasks.workunit.client.0.smithi157.stdout:8/176: dwrite d2/d20/d23/f30 [0,4194304] 0 2024-04-03T08:39:05.430 INFO:tasks.workunit.client.0.smithi157.stdout:9/155: mknod d1/c2f 0 2024-04-03T08:39:05.437 INFO:tasks.workunit.client.0.smithi157.stdout:9/156: dread d1/f17 [0,4194304] 0 2024-04-03T08:39:05.440 INFO:tasks.workunit.client.0.smithi157.stdout:8/177: dwrite d2/f25 [0,4194304] 0 2024-04-03T08:39:05.444 INFO:tasks.workunit.client.0.smithi157.stdout:8/178: dread d2/f39 [0,4194304] 0 2024-04-03T08:39:05.448 INFO:tasks.workunit.client.0.smithi157.stdout:8/179: rename d2/f3d to d2/d11/d10/d12/d2e/f3f 0 2024-04-03T08:39:05.449 INFO:tasks.workunit.client.0.smithi157.stdout:8/180: stat d2/d11/d10/f16 0 2024-04-03T08:39:05.462 INFO:tasks.workunit.client.0.smithi157.stdout:8/181: dwrite d2/d11/d10/d24/f2a [0,4194304] 0 2024-04-03T08:39:05.467 INFO:tasks.workunit.client.0.smithi157.stdout:8/182: getdents d2/d11/d10 0 2024-04-03T08:39:05.470 INFO:tasks.workunit.client.0.smithi157.stdout:8/183: mknod d2/d11/d10/d24/c40 0 2024-04-03T08:39:05.473 INFO:tasks.workunit.client.0.smithi157.stdout:8/184: creat d2/d20/d23/f41 x:0 0 0 2024-04-03T08:39:05.476 INFO:tasks.workunit.client.0.smithi157.stdout:8/185: creat d2/d11/d10/d12/d2e/f42 x:0 0 0 2024-04-03T08:39:05.479 INFO:tasks.workunit.client.0.smithi157.stdout:8/186: symlink d2/d11/d10/d12/d2e/l43 0 2024-04-03T08:39:05.481 INFO:tasks.workunit.client.0.smithi157.stdout:8/187: symlink d2/d20/l44 0 2024-04-03T08:39:05.484 INFO:tasks.workunit.client.0.smithi157.stdout:8/188: truncate d2/d11/d10/d12/f28 4290180 0 2024-04-03T08:39:05.496 INFO:tasks.workunit.client.0.smithi157.stdout:8/189: dwrite d2/f25 [0,4194304] 0 2024-04-03T08:39:05.503 INFO:tasks.workunit.client.0.smithi157.stdout:8/190: dread d2/d20/f35 [0,4194304] 0 2024-04-03T08:39:05.504 INFO:tasks.workunit.client.0.smithi157.stdout:8/191: chown d2/d20 5841550 1 2024-04-03T08:39:05.513 INFO:tasks.workunit.client.0.smithi157.stdout:8/192: dread d2/d11/d10/f16 [0,4194304] 0 2024-04-03T08:39:05.552 INFO:tasks.workunit.client.0.smithi157.stdout:4/184: sync 2024-04-03T08:39:05.553 INFO:tasks.workunit.client.0.smithi157.stdout:1/162: sync 2024-04-03T08:39:05.553 INFO:tasks.workunit.client.0.smithi157.stdout:1/163: fdatasync d2/d11/d24/d7/f9 0 2024-04-03T08:39:05.555 INFO:tasks.workunit.client.0.smithi157.stdout:4/185: creat da/d26/f3d x:0 0 0 2024-04-03T08:39:05.556 INFO:tasks.workunit.client.0.smithi157.stdout:1/164: symlink d2/d11/l34 0 2024-04-03T08:39:05.556 INFO:tasks.workunit.client.0.smithi157.stdout:4/186: chown da/f31 25060385 1 2024-04-03T08:39:05.558 INFO:tasks.workunit.client.0.smithi157.stdout:4/187: creat da/f3e x:0 0 0 2024-04-03T08:39:05.561 INFO:tasks.workunit.client.0.smithi157.stdout:4/188: fsync da/d26/f2e 0 2024-04-03T08:39:05.563 INFO:tasks.workunit.client.0.smithi157.stdout:4/189: write da/df/d11/f3b [771782,42915] 0 2024-04-03T08:39:05.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:05 smithi157 ceph-mon[35083]: pgmap v292: 65 pgs: 65 active+clean; 377 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 28 MiB/s wr, 194 op/s 2024-04-03T08:39:05.564 INFO:tasks.workunit.client.0.smithi157.stdout:4/190: write da/d26/f3d [331763,114716] 0 2024-04-03T08:39:05.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:05 smithi181 ceph-mon[44183]: pgmap v292: 65 pgs: 65 active+clean; 377 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 28 MiB/s wr, 194 op/s 2024-04-03T08:39:05.715 INFO:tasks.workunit.client.0.smithi157.stdout:7/210: sync 2024-04-03T08:39:05.716 INFO:tasks.workunit.client.0.smithi157.stdout:7/211: chown d0/d16/l44 56 1 2024-04-03T08:39:05.719 INFO:tasks.workunit.client.0.smithi157.stdout:7/212: getdents d0/d5 0 2024-04-03T08:39:05.743 INFO:tasks.workunit.client.0.smithi157.stdout:7/213: dread d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:05.814 INFO:tasks.workunit.client.0.smithi157.stdout:3/175: sync 2024-04-03T08:39:05.814 INFO:tasks.workunit.client.0.smithi157.stdout:9/157: sync 2024-04-03T08:39:05.814 INFO:tasks.workunit.client.0.smithi157.stdout:2/265: sync 2024-04-03T08:39:05.817 INFO:tasks.workunit.client.0.smithi157.stdout:2/266: creat d3/d12/d43/d4b/d55/f59 x:0 0 0 2024-04-03T08:39:05.818 INFO:tasks.workunit.client.0.smithi157.stdout:9/158: creat d1/d15/d27/f30 x:0 0 0 2024-04-03T08:39:05.820 INFO:tasks.workunit.client.0.smithi157.stdout:9/159: chown d1/fb 474 1 2024-04-03T08:39:05.820 INFO:tasks.workunit.client.0.smithi157.stdout:2/267: unlink d3/d2e/d32/d3c/f4f 0 2024-04-03T08:39:05.822 INFO:tasks.workunit.client.0.smithi157.stdout:9/160: fsync d1/f1b 0 2024-04-03T08:39:05.823 INFO:tasks.workunit.client.0.smithi157.stdout:2/268: fdatasync d3/f9 0 2024-04-03T08:39:05.829 INFO:tasks.workunit.client.0.smithi157.stdout:3/176: dwrite d8/d13/d23/f29 [0,4194304] 0 2024-04-03T08:39:05.833 INFO:tasks.workunit.client.0.smithi157.stdout:3/177: mkdir d8/d13/d23/d32 0 2024-04-03T08:39:05.833 INFO:tasks.workunit.client.0.smithi157.stdout:3/178: readlink d8/lf 0 2024-04-03T08:39:05.836 INFO:tasks.workunit.client.0.smithi157.stdout:9/161: dread d1/f26 [0,4194304] 0 2024-04-03T08:39:05.837 INFO:tasks.workunit.client.0.smithi157.stdout:3/179: symlink d8/d13/l33 0 2024-04-03T08:39:05.840 INFO:tasks.workunit.client.0.smithi157.stdout:9/162: creat d1/d15/f31 x:0 0 0 2024-04-03T08:39:05.840 INFO:tasks.workunit.client.0.smithi157.stdout:3/180: creat d8/d1e/d2d/f34 x:0 0 0 2024-04-03T08:39:05.843 INFO:tasks.workunit.client.0.smithi157.stdout:3/181: write d8/d13/f31 [228165,118460] 0 2024-04-03T08:39:05.844 INFO:tasks.workunit.client.0.smithi157.stdout:1/165: truncate d2/d11/d24/f1c 286458 0 2024-04-03T08:39:05.845 INFO:tasks.workunit.client.0.smithi157.stdout:3/182: write d8/f11 [1286400,103775] 0 2024-04-03T08:39:05.850 INFO:tasks.workunit.client.0.smithi157.stdout:9/163: link d1/f19 d1/d15/d27/f32 0 2024-04-03T08:39:05.851 INFO:tasks.workunit.client.0.smithi157.stdout:7/214: truncate d0/d11/d15/d1b/f3f 657005 0 2024-04-03T08:39:05.855 INFO:tasks.workunit.client.0.smithi157.stdout:6/237: sync 2024-04-03T08:39:05.855 INFO:tasks.workunit.client.0.smithi157.stdout:8/193: sync 2024-04-03T08:39:05.855 INFO:tasks.workunit.client.0.smithi157.stdout:0/187: sync 2024-04-03T08:39:05.855 INFO:tasks.workunit.client.0.smithi157.stdout:5/192: sync 2024-04-03T08:39:05.855 INFO:tasks.workunit.client.0.smithi157.stdout:3/183: read d8/d13/d1b/f1d [2684507,7679] 0 2024-04-03T08:39:05.864 INFO:tasks.workunit.client.0.smithi157.stdout:4/191: dwrite da/df/f18 [0,4194304] 0 2024-04-03T08:39:05.865 INFO:tasks.workunit.client.0.smithi157.stdout:3/184: mkdir d8/d13/d1b/d35 0 2024-04-03T08:39:05.867 INFO:tasks.workunit.client.0.smithi157.stdout:5/193: fsync dc/d34/f27 0 2024-04-03T08:39:05.867 INFO:tasks.workunit.client.0.smithi157.stdout:8/194: fsync d2/d11/ff 0 2024-04-03T08:39:05.867 INFO:tasks.workunit.client.0.smithi157.stdout:6/238: chown d1/l9 52103 1 2024-04-03T08:39:05.869 INFO:tasks.workunit.client.0.smithi157.stdout:0/188: unlink d2/d9/dc/d13/d3b/f41 0 2024-04-03T08:39:05.870 INFO:tasks.workunit.client.0.smithi157.stdout:6/239: stat d1/ld 0 2024-04-03T08:39:05.877 INFO:tasks.workunit.client.0.smithi157.stdout:9/164: creat d1/f33 x:0 0 0 2024-04-03T08:39:05.878 INFO:tasks.workunit.client.0.smithi157.stdout:1/166: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:05.878 INFO:tasks.workunit.client.0.smithi157.stdout:3/185: dread d8/f28 [0,4194304] 0 2024-04-03T08:39:05.880 INFO:tasks.workunit.client.0.smithi157.stdout:8/195: chown d2/d20/d23/f30 4058533 1 2024-04-03T08:39:05.881 INFO:tasks.workunit.client.0.smithi157.stdout:4/192: mknod da/df/d11/c3f 0 2024-04-03T08:39:05.885 INFO:tasks.workunit.client.0.smithi157.stdout:2/269: dwrite d3/db/f33 [0,4194304] 0 2024-04-03T08:39:05.887 INFO:tasks.workunit.client.0.smithi157.stdout:3/186: write d8/d13/f15 [1070411,97117] 0 2024-04-03T08:39:05.893 INFO:tasks.workunit.client.0.smithi157.stdout:5/194: write dc/d34/d18/f1c [61084,120125] 0 2024-04-03T08:39:05.894 INFO:tasks.workunit.client.0.smithi157.stdout:9/165: mkdir d1/d15/d27/d34 0 2024-04-03T08:39:05.894 INFO:tasks.workunit.client.0.smithi157.stdout:8/196: stat d2/ca 0 2024-04-03T08:39:05.898 INFO:tasks.workunit.client.0.smithi157.stdout:7/215: rename d0/d11/d15/d1b/c2a to d0/c53 0 2024-04-03T08:39:05.898 INFO:tasks.workunit.client.0.smithi157.stdout:5/195: fdatasync dc/d34/f28 0 2024-04-03T08:39:05.899 INFO:tasks.workunit.client.0.smithi157.stdout:8/197: fdatasync d2/d11/ff 0 2024-04-03T08:39:05.901 INFO:tasks.workunit.client.0.smithi157.stdout:1/167: rmdir d2/d11 39 2024-04-03T08:39:05.904 INFO:tasks.workunit.client.0.smithi157.stdout:2/270: mkdir d3/db/d44/d4c/d5a 0 2024-04-03T08:39:05.906 INFO:tasks.workunit.client.0.smithi157.stdout:5/196: write dc/f1d [1897747,4120] 0 2024-04-03T08:39:05.906 INFO:tasks.workunit.client.0.smithi157.stdout:4/193: creat da/df/d2f/f40 x:0 0 0 2024-04-03T08:39:05.906 INFO:tasks.workunit.client.0.smithi157.stdout:0/189: dwrite d2/fa [4194304,4194304] 0 2024-04-03T08:39:05.907 INFO:tasks.workunit.client.0.smithi157.stdout:6/240: mkdir d1/d5/d17/d2a/d40/d4f 0 2024-04-03T08:39:05.912 INFO:tasks.workunit.client.0.smithi157.stdout:5/197: write dc/d34/f20 [1046227,59989] 0 2024-04-03T08:39:05.913 INFO:tasks.workunit.client.0.smithi157.stdout:9/166: creat d1/d15/d27/f35 x:0 0 0 2024-04-03T08:39:05.917 INFO:tasks.workunit.client.0.smithi157.stdout:0/190: write d2/f3 [828079,93189] 0 2024-04-03T08:39:05.921 INFO:tasks.workunit.client.0.smithi157.stdout:9/167: write d1/d15/f2d [754115,111260] 0 2024-04-03T08:39:05.922 INFO:tasks.workunit.client.0.smithi157.stdout:7/216: rename d0/d11/d15/d17/d1c/f24 to d0/d11/d15/d17/d52/f54 0 2024-04-03T08:39:05.924 INFO:tasks.workunit.client.0.smithi157.stdout:9/168: truncate d1/f26 5235710 0 2024-04-03T08:39:05.927 INFO:tasks.workunit.client.0.smithi157.stdout:4/194: creat da/df/d24/d35/f41 x:0 0 0 2024-04-03T08:39:05.930 INFO:tasks.workunit.client.0.smithi157.stdout:0/191: symlink d2/d9/dc/l46 0 2024-04-03T08:39:05.932 INFO:tasks.workunit.client.0.smithi157.stdout:7/217: unlink d0/d11/d15/d17/c38 0 2024-04-03T08:39:05.935 INFO:tasks.workunit.client.0.smithi157.stdout:2/271: truncate d3/f6 2892013 0 2024-04-03T08:39:05.936 INFO:tasks.workunit.client.0.smithi157.stdout:0/192: truncate d2/d9/dc/df/f30 1609568 0 2024-04-03T08:39:05.938 INFO:tasks.workunit.client.0.smithi157.stdout:3/187: rename d8/d13/f14 to d8/d13/f36 0 2024-04-03T08:39:05.938 INFO:tasks.workunit.client.0.smithi157.stdout:8/198: dwrite d2/d11/d10/d12/d2e/f38 [0,4194304] 0 2024-04-03T08:39:05.939 INFO:tasks.workunit.client.0.smithi157.stdout:6/241: rename d1/d22/l32 to d1/d5/d1b/d2c/l50 0 2024-04-03T08:39:05.940 INFO:tasks.workunit.client.0.smithi157.stdout:8/199: readlink d2/l32 0 2024-04-03T08:39:05.940 INFO:tasks.workunit.client.0.smithi157.stdout:0/193: dread - d2/d9/d36/f3f zero size 2024-04-03T08:39:05.941 INFO:tasks.workunit.client.0.smithi157.stdout:3/188: chown c3 180 1 2024-04-03T08:39:05.942 INFO:tasks.workunit.client.0.smithi157.stdout:5/198: dwrite dc/f1d [0,4194304] 0 2024-04-03T08:39:05.945 INFO:tasks.workunit.client.0.smithi157.stdout:5/199: stat dc/ff 0 2024-04-03T08:39:05.947 INFO:tasks.workunit.client.0.smithi157.stdout:9/169: mkdir d1/d36 0 2024-04-03T08:39:05.953 INFO:tasks.workunit.client.0.smithi157.stdout:3/189: mkdir d8/d13/d1b/d37 0 2024-04-03T08:39:05.959 INFO:tasks.workunit.client.0.smithi157.stdout:1/168: rename d2/d11/c2d to d2/d11/d24/d7/d2e/c35 0 2024-04-03T08:39:05.961 INFO:tasks.workunit.client.0.smithi157.stdout:6/242: dread d1/d5/d17/d2a/d37/f25 [0,4194304] 0 2024-04-03T08:39:05.961 INFO:tasks.workunit.client.0.smithi157.stdout:0/194: symlink d2/d9/dc/df/d1b/l47 0 2024-04-03T08:39:05.963 INFO:tasks.workunit.client.0.smithi157.stdout:7/218: write d0/d4/f2d [662303,18574] 0 2024-04-03T08:39:05.965 INFO:tasks.workunit.client.0.smithi157.stdout:4/195: getdents da 0 2024-04-03T08:39:05.970 INFO:tasks.workunit.client.0.smithi157.stdout:1/169: fdatasync f0 0 2024-04-03T08:39:05.970 INFO:tasks.workunit.client.0.smithi157.stdout:8/200: rename d2/d20/d23/c2d to d2/d11/d10/d12/d2e/c45 0 2024-04-03T08:39:05.972 INFO:tasks.workunit.client.0.smithi157.stdout:9/170: symlink d1/d36/l37 0 2024-04-03T08:39:05.974 INFO:tasks.workunit.client.0.smithi157.stdout:2/272: getdents d3/db/d44/d4c 0 2024-04-03T08:39:05.977 INFO:tasks.workunit.client.0.smithi157.stdout:4/196: symlink da/df/d2f/l42 0 2024-04-03T08:39:05.979 INFO:tasks.workunit.client.0.smithi157.stdout:5/200: getdents dc/d34 0 2024-04-03T08:39:05.979 INFO:tasks.workunit.client.0.smithi157.stdout:9/171: rmdir d1/d15/d16 39 2024-04-03T08:39:05.983 INFO:tasks.workunit.client.0.smithi157.stdout:5/201: readlink dc/l10 0 2024-04-03T08:39:05.984 INFO:tasks.workunit.client.0.smithi157.stdout:2/273: creat d3/db/d44/f5b x:0 0 0 2024-04-03T08:39:05.984 INFO:tasks.workunit.client.0.smithi157.stdout:8/201: link d2/l34 d2/d20/d23/l46 0 2024-04-03T08:39:05.986 INFO:tasks.workunit.client.0.smithi157.stdout:1/170: rename d2/d11/d24/d7/c12 to d2/d11/d24/d7/d2e/c36 0 2024-04-03T08:39:05.989 INFO:tasks.workunit.client.0.smithi157.stdout:8/202: fsync d2/f25 0 2024-04-03T08:39:05.991 INFO:tasks.workunit.client.0.smithi157.stdout:9/172: fdatasync d1/fe 0 2024-04-03T08:39:05.993 INFO:tasks.workunit.client.0.smithi157.stdout:6/243: dwrite d1/d5/d17/f4e [0,4194304] 0 2024-04-03T08:39:05.999 INFO:tasks.workunit.client.0.smithi157.stdout:8/203: dread - d2/d11/d10/d12/d2e/f3f zero size 2024-04-03T08:39:06.001 INFO:tasks.workunit.client.0.smithi157.stdout:3/190: dwrite d8/f2f [4194304,4194304] 0 2024-04-03T08:39:06.001 INFO:tasks.workunit.client.0.smithi157.stdout:7/219: link d0/c53 d0/d11/d15/d35/c55 0 2024-04-03T08:39:06.004 INFO:tasks.workunit.client.0.smithi157.stdout:1/171: mknod d2/c37 0 2024-04-03T08:39:06.009 INFO:tasks.workunit.client.0.smithi157.stdout:4/197: getdents da/df/d11 0 2024-04-03T08:39:06.009 INFO:tasks.workunit.client.0.smithi157.stdout:8/204: chown d2/d11/d10/d24/c3a 352 1 2024-04-03T08:39:06.010 INFO:tasks.workunit.client.0.smithi157.stdout:0/195: dwrite d2/d9/dc/df/d1b/f34 [0,4194304] 0 2024-04-03T08:39:06.010 INFO:tasks.workunit.client.0.smithi157.stdout:6/244: read d1/d4b/f45 [155531,90922] 0 2024-04-03T08:39:06.012 INFO:tasks.workunit.client.0.smithi157.stdout:8/205: chown d2/c21 3096932 1 2024-04-03T08:39:06.013 INFO:tasks.workunit.client.0.smithi157.stdout:4/198: dread - da/df/d24/d35/f41 zero size 2024-04-03T08:39:06.014 INFO:tasks.workunit.client.0.smithi157.stdout:8/206: read d2/f25 [3384776,60317] 0 2024-04-03T08:39:06.016 INFO:tasks.workunit.client.0.smithi157.stdout:9/173: rmdir d1/d15/d27/d2b 0 2024-04-03T08:39:06.018 INFO:tasks.workunit.client.0.smithi157.stdout:3/191: mkdir d8/d13/d38 0 2024-04-03T08:39:06.020 INFO:tasks.workunit.client.0.smithi157.stdout:6/245: creat d1/d5/d17/d2a/d37/f51 x:0 0 0 2024-04-03T08:39:06.021 INFO:tasks.workunit.client.0.smithi157.stdout:0/196: creat d2/d9/dc/d13/d3b/f48 x:0 0 0 2024-04-03T08:39:06.022 INFO:tasks.workunit.client.0.smithi157.stdout:2/274: dread d3/d12/fa [0,4194304] 0 2024-04-03T08:39:06.031 INFO:tasks.workunit.client.0.smithi157.stdout:2/275: truncate d3/f4e 133354 0 2024-04-03T08:39:06.031 INFO:tasks.workunit.client.0.smithi157.stdout:1/172: creat d2/d11/d24/f38 x:0 0 0 2024-04-03T08:39:06.031 INFO:tasks.workunit.client.0.smithi157.stdout:9/174: symlink d1/d15/l38 0 2024-04-03T08:39:06.033 INFO:tasks.workunit.client.0.smithi157.stdout:7/220: link d0/d5/l29 d0/d11/d15/l56 0 2024-04-03T08:39:06.037 INFO:tasks.workunit.client.0.smithi157.stdout:0/197: creat d2/d9/dc/df/d1b/f49 x:0 0 0 2024-04-03T08:39:06.037 INFO:tasks.workunit.client.0.smithi157.stdout:9/175: stat d1/l11 0 2024-04-03T08:39:06.039 INFO:tasks.workunit.client.0.smithi157.stdout:4/199: truncate f4 4322429 0 2024-04-03T08:39:06.039 INFO:tasks.workunit.client.0.smithi157.stdout:7/221: fsync d0/d11/d15/d1b/f32 0 2024-04-03T08:39:06.040 INFO:tasks.workunit.client.0.smithi157.stdout:8/207: dread d2/d11/d10/d24/f2a [0,4194304] 0 2024-04-03T08:39:06.042 INFO:tasks.workunit.client.0.smithi157.stdout:0/198: truncate d2/f37 381518 0 2024-04-03T08:39:06.045 INFO:tasks.workunit.client.0.smithi157.stdout:2/276: link d3/db/l2c d3/db/l5c 0 2024-04-03T08:39:06.047 INFO:tasks.workunit.client.0.smithi157.stdout:1/173: getdents d2 0 2024-04-03T08:39:06.048 INFO:tasks.workunit.client.0.smithi157.stdout:8/208: write d2/d20/d23/f41 [612621,64493] 0 2024-04-03T08:39:06.050 INFO:tasks.workunit.client.0.smithi157.stdout:0/199: dread d2/f37 [0,4194304] 0 2024-04-03T08:39:06.050 INFO:tasks.workunit.client.0.smithi157.stdout:6/246: truncate d1/d5/f1a 857495 0 2024-04-03T08:39:06.053 INFO:tasks.workunit.client.0.smithi157.stdout:3/192: dwrite f4 [4194304,4194304] 0 2024-04-03T08:39:06.053 INFO:tasks.workunit.client.0.smithi157.stdout:4/200: rename da/df/f39 to da/df/d24/d35/f43 0 2024-04-03T08:39:06.055 INFO:tasks.workunit.client.0.smithi157.stdout:2/277: chown d3/d2e/d32/d3c/f3f 9361 1 2024-04-03T08:39:06.056 INFO:tasks.workunit.client.0.smithi157.stdout:3/193: fdatasync d8/d13/f1a 0 2024-04-03T08:39:06.058 INFO:tasks.workunit.client.0.smithi157.stdout:8/209: unlink d2/f25 0 2024-04-03T08:39:06.059 INFO:tasks.workunit.client.0.smithi157.stdout:0/200: rmdir d2/d9/dc/df/d1b 39 2024-04-03T08:39:06.061 INFO:tasks.workunit.client.0.smithi157.stdout:6/247: rmdir d1/d5/d1b 39 2024-04-03T08:39:06.062 INFO:tasks.workunit.client.0.smithi157.stdout:8/210: truncate d2/d20/f29 4939459 0 2024-04-03T08:39:06.066 INFO:tasks.workunit.client.0.smithi157.stdout:4/201: mknod da/c44 0 2024-04-03T08:39:06.066 INFO:tasks.workunit.client.0.smithi157.stdout:1/174: mkdir d2/d11/d24/d39 0 2024-04-03T08:39:06.072 INFO:tasks.workunit.client.0.smithi157.stdout:3/194: mkdir d8/d1e/d2d/d39 0 2024-04-03T08:39:06.073 INFO:tasks.workunit.client.0.smithi157.stdout:7/222: dread d0/d11/f21 [0,4194304] 0 2024-04-03T08:39:06.074 INFO:tasks.workunit.client.0.smithi157.stdout:3/195: write d8/f19 [618705,120762] 0 2024-04-03T08:39:06.075 INFO:tasks.workunit.client.0.smithi157.stdout:7/223: dread - d0/d11/d15/d17/d1c/f4b zero size 2024-04-03T08:39:06.078 INFO:tasks.workunit.client.0.smithi157.stdout:6/248: creat d1/d5/d17/d2a/d40/f52 x:0 0 0 2024-04-03T08:39:06.081 INFO:tasks.workunit.client.0.smithi157.stdout:2/278: truncate d3/db/f2a 2626023 0 2024-04-03T08:39:06.082 INFO:tasks.workunit.client.0.smithi157.stdout:7/224: dread d0/f20 [0,4194304] 0 2024-04-03T08:39:06.084 INFO:tasks.workunit.client.0.smithi157.stdout:4/202: rename da/df/c28 to da/df/d24/c45 0 2024-04-03T08:39:06.085 INFO:tasks.workunit.client.0.smithi157.stdout:8/211: link d2/d11/d10/d12/d2e/f31 d2/d11/d10/d12/f47 0 2024-04-03T08:39:06.088 INFO:tasks.workunit.client.0.smithi157.stdout:3/196: dread d8/f2f [0,4194304] 0 2024-04-03T08:39:06.088 INFO:tasks.workunit.client.0.smithi157.stdout:2/279: unlink d3/f53 0 2024-04-03T08:39:06.089 INFO:tasks.workunit.client.0.smithi157.stdout:7/225: creat d0/d11/d15/d1b/f57 x:0 0 0 2024-04-03T08:39:06.091 INFO:tasks.workunit.client.0.smithi157.stdout:0/201: rename d2/d9/dc/d13 to d2/d9/dc/df/d1b/d4a 0 2024-04-03T08:39:06.093 INFO:tasks.workunit.client.0.smithi157.stdout:4/203: creat da/df/d11/f46 x:0 0 0 2024-04-03T08:39:06.093 INFO:tasks.workunit.client.0.smithi157.stdout:0/202: stat d2/d9/dc/f17 0 2024-04-03T08:39:06.096 INFO:tasks.workunit.client.0.smithi157.stdout:4/204: dread - da/df/d24/d35/f41 zero size 2024-04-03T08:39:06.097 INFO:tasks.workunit.client.0.smithi157.stdout:3/197: mkdir d8/d13/d1b/d3a 0 2024-04-03T08:39:06.097 INFO:tasks.workunit.client.0.smithi157.stdout:8/212: creat d2/d11/d10/f48 x:0 0 0 2024-04-03T08:39:06.098 INFO:tasks.workunit.client.0.smithi157.stdout:2/280: symlink d3/db/d44/d4c/l5d 0 2024-04-03T08:39:06.100 INFO:tasks.workunit.client.0.smithi157.stdout:0/203: rename d2/d9/dc/f17 to d2/d9/dc/df/d1b/f4b 0 2024-04-03T08:39:06.107 INFO:tasks.workunit.client.0.smithi157.stdout:0/204: creat d2/d9/dc/df/d1b/d4a/d31/f4c x:0 0 0 2024-04-03T08:39:06.108 INFO:tasks.workunit.client.0.smithi157.stdout:3/198: dread d8/d13/f15 [0,4194304] 0 2024-04-03T08:39:06.109 INFO:tasks.workunit.client.0.smithi157.stdout:0/205: stat d2/d9/d36/d38 0 2024-04-03T08:39:06.110 INFO:tasks.workunit.client.0.smithi157.stdout:7/226: dwrite d0/d11/d15/d17/d1c/f4b [0,4194304] 0 2024-04-03T08:39:06.112 INFO:tasks.workunit.client.0.smithi157.stdout:3/199: mkdir d8/d1e/d2d/d3b 0 2024-04-03T08:39:06.118 INFO:tasks.workunit.client.0.smithi157.stdout:7/227: dread - d0/d11/d15/d35/f50 zero size 2024-04-03T08:39:06.120 INFO:tasks.workunit.client.0.smithi157.stdout:7/228: rmdir d0/d11/d15/d17/d52 39 2024-04-03T08:39:06.127 INFO:tasks.workunit.client.0.smithi157.stdout:7/229: rename d0/d5/l29 to d0/d11/d15/d17/d1c/l58 0 2024-04-03T08:39:06.128 INFO:tasks.workunit.client.0.smithi157.stdout:0/206: dwrite d2/d9/dc/df/d1b/d4a/f20 [0,4194304] 0 2024-04-03T08:39:06.133 INFO:tasks.workunit.client.0.smithi157.stdout:3/200: dwrite d8/d13/d1b/f1d [0,4194304] 0 2024-04-03T08:39:06.134 INFO:tasks.workunit.client.0.smithi157.stdout:3/201: chown d8/d13/d1b 75234 1 2024-04-03T08:39:06.134 INFO:tasks.workunit.client.0.smithi157.stdout:2/281: dread d3/d12/f56 [0,4194304] 0 2024-04-03T08:39:06.136 INFO:tasks.workunit.client.0.smithi157.stdout:3/202: write d8/fe [389149,6958] 0 2024-04-03T08:39:06.136 INFO:tasks.workunit.client.0.smithi157.stdout:2/282: readlink d3/d12/l30 0 2024-04-03T08:39:06.136 INFO:tasks.workunit.client.0.smithi157.stdout:7/230: creat d0/d11/d15/d1b/f59 x:0 0 0 2024-04-03T08:39:06.139 INFO:tasks.workunit.client.0.smithi157.stdout:2/283: readlink d3/d12/l2b 0 2024-04-03T08:39:06.139 INFO:tasks.workunit.client.0.smithi157.stdout:3/203: mknod d8/d13/d23/c3c 0 2024-04-03T08:39:06.140 INFO:tasks.workunit.client.0.smithi157.stdout:0/207: read d2/f15 [622760,59679] 0 2024-04-03T08:39:06.144 INFO:tasks.workunit.client.0.smithi157.stdout:3/204: mkdir d8/d13/d3d 0 2024-04-03T08:39:06.146 INFO:tasks.workunit.client.0.smithi157.stdout:0/208: dread - d2/d9/dc/df/d1b/d4a/d31/f4c zero size 2024-04-03T08:39:06.148 INFO:tasks.workunit.client.0.smithi157.stdout:2/284: link d3/l17 d3/db/l5e 0 2024-04-03T08:39:06.149 INFO:tasks.workunit.client.0.smithi157.stdout:3/205: mknod d8/d13/c3e 0 2024-04-03T08:39:06.152 INFO:tasks.workunit.client.0.smithi157.stdout:0/209: symlink d2/d9/dc/df/d1b/d35/d3d/l4d 0 2024-04-03T08:39:06.155 INFO:tasks.workunit.client.0.smithi157.stdout:2/285: creat d3/db/d44/d4c/d5a/f5f x:0 0 0 2024-04-03T08:39:06.157 INFO:tasks.workunit.client.0.smithi157.stdout:2/286: dread - d3/d12/f11 zero size 2024-04-03T08:39:06.157 INFO:tasks.workunit.client.0.smithi157.stdout:7/231: dwrite d0/d5/f3e [0,4194304] 0 2024-04-03T08:39:06.159 INFO:tasks.workunit.client.0.smithi157.stdout:0/210: unlink d2/d9/dc/df/d1b/l33 0 2024-04-03T08:39:06.159 INFO:tasks.workunit.client.0.smithi157.stdout:2/287: chown d3/d12/c14 13 1 2024-04-03T08:39:06.162 INFO:tasks.workunit.client.0.smithi157.stdout:2/288: mknod d3/d12/d43/c60 0 2024-04-03T08:39:06.164 INFO:tasks.workunit.client.0.smithi157.stdout:0/211: symlink d2/d9/dc/df/l4e 0 2024-04-03T08:39:06.165 INFO:tasks.workunit.client.0.smithi157.stdout:3/206: dread d8/d13/d23/f29 [0,4194304] 0 2024-04-03T08:39:06.168 INFO:tasks.workunit.client.0.smithi157.stdout:7/232: getdents d0/d4 0 2024-04-03T08:39:06.170 INFO:tasks.workunit.client.0.smithi157.stdout:2/289: creat d3/db/d44/f61 x:0 0 0 2024-04-03T08:39:06.170 INFO:tasks.workunit.client.0.smithi157.stdout:3/207: unlink d8/d1e/f21 0 2024-04-03T08:39:06.171 INFO:tasks.workunit.client.0.smithi157.stdout:2/290: chown d3/d12/l30 58197 1 2024-04-03T08:39:06.172 INFO:tasks.workunit.client.0.smithi157.stdout:0/212: write d2/d9/dc/df/d1b/d4a/d3b/f48 [1018204,110631] 0 2024-04-03T08:39:06.173 INFO:tasks.workunit.client.0.smithi157.stdout:3/208: mkdir d8/d1e/d2d/d3f 0 2024-04-03T08:39:06.173 INFO:tasks.workunit.client.0.smithi157.stdout:0/213: readlink d2/ld 0 2024-04-03T08:39:06.175 INFO:tasks.workunit.client.0.smithi157.stdout:7/233: creat d0/d11/d15/d17/d52/f5a x:0 0 0 2024-04-03T08:39:06.177 INFO:tasks.workunit.client.0.smithi157.stdout:3/209: write d8/fe [1350405,20224] 0 2024-04-03T08:39:06.177 INFO:tasks.workunit.client.0.smithi157.stdout:2/291: creat d3/d12/d43/d4b/d55/f62 x:0 0 0 2024-04-03T08:39:06.178 INFO:tasks.workunit.client.0.smithi157.stdout:0/214: fsync d2/d9/dc/df/d1b/d4a/f2f 0 2024-04-03T08:39:06.179 INFO:tasks.workunit.client.0.smithi157.stdout:7/234: fsync d0/d4/d36/f49 0 2024-04-03T08:39:06.179 INFO:tasks.workunit.client.0.smithi157.stdout:2/292: dread - d3/d12/d43/f50 zero size 2024-04-03T08:39:06.181 INFO:tasks.workunit.client.0.smithi157.stdout:3/210: truncate d8/d13/d1b/f1d 4311123 0 2024-04-03T08:39:06.182 INFO:tasks.workunit.client.0.smithi157.stdout:7/235: mkdir d0/d4/d36/d5b 0 2024-04-03T08:39:06.184 INFO:tasks.workunit.client.0.smithi157.stdout:2/293: rename d3/db/f1a to d3/d12/f63 0 2024-04-03T08:39:06.185 INFO:tasks.workunit.client.0.smithi157.stdout:3/211: creat d8/d13/d23/f40 x:0 0 0 2024-04-03T08:39:06.186 INFO:tasks.workunit.client.0.smithi157.stdout:2/294: truncate d3/db/f38 80249 0 2024-04-03T08:39:06.188 INFO:tasks.workunit.client.0.smithi157.stdout:3/212: mknod d8/d13/d1b/d35/c41 0 2024-04-03T08:39:06.191 INFO:tasks.workunit.client.0.smithi157.stdout:2/295: rename d3/f5 to d3/db/d44/f64 0 2024-04-03T08:39:06.193 INFO:tasks.workunit.client.0.smithi157.stdout:2/296: write d3/d2e/d32/d3c/f3f [528483,125798] 0 2024-04-03T08:39:06.197 INFO:tasks.workunit.client.0.smithi157.stdout:2/297: mkdir d3/d2e/d65 0 2024-04-03T08:39:06.202 INFO:tasks.workunit.client.0.smithi157.stdout:0/215: dread d2/f15 [0,4194304] 0 2024-04-03T08:39:06.214 INFO:tasks.workunit.client.0.smithi157.stdout:0/216: dwrite d2/d9/dc/df/d1b/d4a/f2f [0,4194304] 0 2024-04-03T08:39:06.218 INFO:tasks.workunit.client.0.smithi157.stdout:0/217: creat d2/d9/f4f x:0 0 0 2024-04-03T08:39:06.218 INFO:tasks.workunit.client.0.smithi157.stdout:0/218: chown d2/d9 202 1 2024-04-03T08:39:06.227 INFO:tasks.workunit.client.0.smithi157.stdout:0/219: dread d2/d9/dc/df/d1b/d4a/f20 [0,4194304] 0 2024-04-03T08:39:06.240 INFO:tasks.workunit.client.0.smithi157.stdout:0/220: dwrite d2/d9/dc/df/d1b/f49 [0,4194304] 0 2024-04-03T08:39:06.250 INFO:tasks.workunit.client.0.smithi157.stdout:0/221: dread d2/fa [4194304,4194304] 0 2024-04-03T08:39:06.252 INFO:tasks.workunit.client.0.smithi157.stdout:0/222: dread - d2/f25 zero size 2024-04-03T08:39:06.255 INFO:tasks.workunit.client.0.smithi157.stdout:0/223: creat d2/f50 x:0 0 0 2024-04-03T08:39:06.256 INFO:tasks.workunit.client.0.smithi157.stdout:0/224: stat d2/d9/dc/df/d1b/d35/d3d/c32 0 2024-04-03T08:39:06.260 INFO:tasks.workunit.client.0.smithi157.stdout:0/225: mkdir d2/d9/d51 0 2024-04-03T08:39:06.262 INFO:tasks.workunit.client.0.smithi157.stdout:0/226: creat d2/d9/d51/f52 x:0 0 0 2024-04-03T08:39:06.265 INFO:tasks.workunit.client.0.smithi157.stdout:0/227: mknod d2/d9/d51/c53 0 2024-04-03T08:39:06.277 INFO:tasks.workunit.client.0.smithi157.stdout:0/228: dwrite d2/f1d [0,4194304] 0 2024-04-03T08:39:06.280 INFO:tasks.workunit.client.0.smithi157.stdout:0/229: fdatasync d2/d9/dc/f3c 0 2024-04-03T08:39:06.282 INFO:tasks.workunit.client.0.smithi157.stdout:0/230: mkdir d2/d9/dc/d54 0 2024-04-03T08:39:06.290 INFO:tasks.workunit.client.0.smithi157.stdout:5/202: sync 2024-04-03T08:39:06.290 INFO:tasks.workunit.client.0.smithi157.stdout:1/175: sync 2024-04-03T08:39:06.290 INFO:tasks.workunit.client.0.smithi157.stdout:9/176: sync 2024-04-03T08:39:06.296 INFO:tasks.workunit.client.0.smithi157.stdout:5/203: creat dc/d35/f40 x:0 0 0 2024-04-03T08:39:06.299 INFO:tasks.workunit.client.0.smithi157.stdout:0/231: dwrite d2/d9/dc/df/d1b/d4a/d3b/f48 [0,4194304] 0 2024-04-03T08:39:06.300 INFO:tasks.workunit.client.0.smithi157.stdout:5/204: truncate dc/fd 1173518 0 2024-04-03T08:39:06.300 INFO:tasks.workunit.client.0.smithi157.stdout:7/236: read d0/d5/f3a [744581,74760] 0 2024-04-03T08:39:06.303 INFO:tasks.workunit.client.0.smithi157.stdout:7/237: chown d0/d5/f3e 18205380 1 2024-04-03T08:39:06.304 INFO:tasks.workunit.client.0.smithi157.stdout:5/205: mknod dc/d35/c41 0 2024-04-03T08:39:06.306 INFO:tasks.workunit.client.0.smithi157.stdout:5/206: dread - dc/d34/f22 zero size 2024-04-03T08:39:06.311 INFO:tasks.workunit.client.0.smithi157.stdout:0/232: rename d2/d9/dc/df/d1b/d4a/l23 to d2/l55 0 2024-04-03T08:39:06.319 INFO:tasks.workunit.client.0.smithi157.stdout:0/233: creat d2/d9/dc/df/d1b/d35/f56 x:0 0 0 2024-04-03T08:39:06.324 INFO:tasks.workunit.client.0.smithi157.stdout:0/234: readlink d2/d9/dc/df/l44 0 2024-04-03T08:39:06.326 INFO:tasks.workunit.client.0.smithi157.stdout:5/207: dread f7 [0,4194304] 0 2024-04-03T08:39:06.328 INFO:tasks.workunit.client.0.smithi157.stdout:5/208: stat dc/d34/c1b 0 2024-04-03T08:39:06.333 INFO:tasks.workunit.client.0.smithi157.stdout:7/238: dwrite d0/d4/d36/f3d [0,4194304] 0 2024-04-03T08:39:06.336 INFO:tasks.workunit.client.0.smithi157.stdout:8/213: creat d2/d11/d10/d12/f49 x:0 0 0 2024-04-03T08:39:06.338 INFO:tasks.workunit.client.0.smithi157.stdout:8/214: stat d2/d11/d10/d12 0 2024-04-03T08:39:06.339 INFO:tasks.workunit.client.0.smithi157.stdout:6/249: dwrite d1/d22/f2e [0,4194304] 0 2024-04-03T08:39:06.340 INFO:tasks.workunit.client.0.smithi157.stdout:7/239: read d0/d11/d15/d17/d1c/f4b [1661038,54896] 0 2024-04-03T08:39:06.348 INFO:tasks.workunit.client.0.smithi157.stdout:5/209: creat dc/f42 x:0 0 0 2024-04-03T08:39:06.348 INFO:tasks.workunit.client.0.smithi157.stdout:0/235: rename d2/d9/dc/df/f30 to d2/d9/f57 0 2024-04-03T08:39:06.348 INFO:tasks.workunit.client.0.smithi157.stdout:4/205: sync 2024-04-03T08:39:06.351 INFO:tasks.workunit.client.0.smithi157.stdout:1/176: dread d2/d11/d24/d7/f9 [0,4194304] 0 2024-04-03T08:39:06.352 INFO:tasks.workunit.client.0.smithi157.stdout:0/236: read - d2/d9/d36/f3f zero size 2024-04-03T08:39:06.357 INFO:tasks.workunit.client.0.smithi157.stdout:0/237: chown d2/d9/dc/l28 55 1 2024-04-03T08:39:06.359 INFO:tasks.workunit.client.0.smithi157.stdout:6/250: mknod d1/d5/d17/d2a/d40/d4f/c53 0 2024-04-03T08:39:06.364 INFO:tasks.workunit.client.0.smithi157.stdout:0/238: stat d2/d9/dc/df/d1b/f34 0 2024-04-03T08:39:06.365 INFO:tasks.workunit.client.0.smithi157.stdout:7/240: link d0/d11/d15/d17/d43/f45 d0/d11/d15/d17/d1c/f5c 0 2024-04-03T08:39:06.366 INFO:tasks.workunit.client.0.smithi157.stdout:6/251: stat d1/d5/d17/l31 0 2024-04-03T08:39:06.366 INFO:tasks.workunit.client.0.smithi157.stdout:1/177: chown d2/c25 82676872 1 2024-04-03T08:39:06.367 INFO:tasks.workunit.client.0.smithi157.stdout:0/239: write d2/d9/f4f [566243,53042] 0 2024-04-03T08:39:06.370 INFO:tasks.workunit.client.0.smithi157.stdout:6/252: readlink d1/d5/d17/l31 0 2024-04-03T08:39:06.371 INFO:tasks.workunit.client.0.smithi157.stdout:8/215: link d2/d11/d10/d12/d2e/c45 d2/d11/d10/d12/c4a 0 2024-04-03T08:39:06.371 INFO:tasks.workunit.client.0.smithi157.stdout:7/241: chown d0/d11/d15/d17/d1c/l46 28 1 2024-04-03T08:39:06.372 INFO:tasks.workunit.client.0.smithi157.stdout:1/178: symlink d2/d11/l3a 0 2024-04-03T08:39:06.372 INFO:tasks.workunit.client.0.smithi157.stdout:4/206: link da/d26/c2b da/df/d24/c47 0 2024-04-03T08:39:06.373 INFO:tasks.workunit.client.0.smithi157.stdout:6/253: readlink d1/d5/la 0 2024-04-03T08:39:06.377 INFO:tasks.workunit.client.0.smithi157.stdout:8/216: dread - d2/d11/f3e zero size 2024-04-03T08:39:06.379 INFO:tasks.workunit.client.0.smithi157.stdout:4/207: mkdir da/df/d24/d48 0 2024-04-03T08:39:06.381 INFO:tasks.workunit.client.0.smithi157.stdout:5/210: dwrite dc/d34/d18/f1c [0,4194304] 0 2024-04-03T08:39:06.385 INFO:tasks.workunit.client.0.smithi157.stdout:0/240: creat d2/d9/dc/df/d1b/d35/d3d/f58 x:0 0 0 2024-04-03T08:39:06.385 INFO:tasks.workunit.client.0.smithi157.stdout:3/213: truncate d8/f17 674811 0 2024-04-03T08:39:06.385 INFO:tasks.workunit.client.0.smithi157.stdout:5/211: write fa [2180907,54406] 0 2024-04-03T08:39:06.385 INFO:tasks.workunit.client.0.smithi157.stdout:7/242: creat d0/d11/d15/d17/d1c/f5d x:0 0 0 2024-04-03T08:39:06.387 INFO:tasks.workunit.client.0.smithi157.stdout:8/217: creat d2/d11/d10/d12/f4b x:0 0 0 2024-04-03T08:39:06.389 INFO:tasks.workunit.client.0.smithi157.stdout:4/208: read da/fc [213196,97847] 0 2024-04-03T08:39:06.389 INFO:tasks.workunit.client.0.smithi157.stdout:5/212: mkdir dc/d29/d43 0 2024-04-03T08:39:06.393 INFO:tasks.workunit.client.0.smithi157.stdout:3/214: rename d8/d13/f1f to d8/d13/d23/d32/f42 0 2024-04-03T08:39:06.394 INFO:tasks.workunit.client.0.smithi157.stdout:8/218: symlink d2/d11/d10/d12/l4c 0 2024-04-03T08:39:06.397 INFO:tasks.workunit.client.0.smithi157.stdout:6/254: dread d1/fb [0,4194304] 0 2024-04-03T08:39:06.398 INFO:tasks.workunit.client.0.smithi157.stdout:2/298: symlink d3/d2e/d32/l66 0 2024-04-03T08:39:06.400 INFO:tasks.workunit.client.0.smithi157.stdout:4/209: symlink da/d26/l49 0 2024-04-03T08:39:06.401 INFO:tasks.workunit.client.0.smithi157.stdout:9/177: write d1/f17 [1487014,55155] 0 2024-04-03T08:39:06.402 INFO:tasks.workunit.client.0.smithi157.stdout:4/210: readlink da/le 0 2024-04-03T08:39:06.404 INFO:tasks.workunit.client.0.smithi157.stdout:1/179: dwrite d2/d11/d24/d7/d1b/f2a [0,4194304] 0 2024-04-03T08:39:06.407 INFO:tasks.workunit.client.0.smithi157.stdout:1/180: read d2/f21 [171796,21377] 0 2024-04-03T08:39:06.408 INFO:tasks.workunit.client.0.smithi157.stdout:3/215: write d8/d13/d23/d32/f42 [665497,30707] 0 2024-04-03T08:39:06.415 INFO:tasks.workunit.client.0.smithi157.stdout:1/181: dread - d2/d11/d24/f38 zero size 2024-04-03T08:39:06.415 INFO:tasks.workunit.client.0.smithi157.stdout:8/219: dread d2/d11/d10/d12/d2e/f38 [0,4194304] 0 2024-04-03T08:39:06.416 INFO:tasks.workunit.client.0.smithi157.stdout:1/182: chown f0 16 1 2024-04-03T08:39:06.420 INFO:tasks.workunit.client.0.smithi157.stdout:2/299: symlink d3/db/d44/l67 0 2024-04-03T08:39:06.424 INFO:tasks.workunit.client.0.smithi157.stdout:9/178: creat d1/d15/d27/f39 x:0 0 0 2024-04-03T08:39:06.426 INFO:tasks.workunit.client.0.smithi157.stdout:4/211: creat da/d26/f4a x:0 0 0 2024-04-03T08:39:06.428 INFO:tasks.workunit.client.0.smithi157.stdout:4/212: write da/df/d2f/f38 [516900,40335] 0 2024-04-03T08:39:06.429 INFO:tasks.workunit.client.0.smithi157.stdout:3/216: rename d8/fa to d8/d1e/d2d/d3b/f43 0 2024-04-03T08:39:06.433 INFO:tasks.workunit.client.0.smithi157.stdout:7/243: creat d0/d11/d15/d17/f5e x:0 0 0 2024-04-03T08:39:06.434 INFO:tasks.workunit.client.0.smithi157.stdout:5/213: creat dc/f44 x:0 0 0 2024-04-03T08:39:06.437 INFO:tasks.workunit.client.0.smithi157.stdout:6/255: creat d1/d5/d1b/f54 x:0 0 0 2024-04-03T08:39:06.438 INFO:tasks.workunit.client.0.smithi157.stdout:6/256: readlink d1/d5/d17/d2a/l3d 0 2024-04-03T08:39:06.452 INFO:tasks.workunit.client.0.smithi157.stdout:8/220: dwrite d2/d20/f35 [0,4194304] 0 2024-04-03T08:39:06.461 INFO:tasks.workunit.client.0.smithi157.stdout:9/179: creat d1/d15/d16/f3a x:0 0 0 2024-04-03T08:39:06.461 INFO:tasks.workunit.client.0.smithi157.stdout:4/213: creat da/df/d24/d48/f4b x:0 0 0 2024-04-03T08:39:06.463 INFO:tasks.workunit.client.0.smithi157.stdout:3/217: creat d8/d1e/d2d/d3f/f44 x:0 0 0 2024-04-03T08:39:06.467 INFO:tasks.workunit.client.0.smithi157.stdout:7/244: mkdir d0/d11/d15/d17/d1c/d4f/d5f 0 2024-04-03T08:39:06.470 INFO:tasks.workunit.client.0.smithi157.stdout:5/214: fdatasync f8 0 2024-04-03T08:39:06.474 INFO:tasks.workunit.client.0.smithi157.stdout:6/257: mknod d1/d5/d17/c55 0 2024-04-03T08:39:06.483 INFO:tasks.workunit.client.0.smithi157.stdout:1/183: write d2/d11/d24/f1c [461724,46927] 0 2024-04-03T08:39:06.483 INFO:tasks.workunit.client.0.smithi157.stdout:3/218: dwrite d8/d13/f31 [0,4194304] 0 2024-04-03T08:39:06.486 INFO:tasks.workunit.client.0.smithi157.stdout:5/215: dread dc/f1d [0,4194304] 0 2024-04-03T08:39:06.492 INFO:tasks.workunit.client.0.smithi157.stdout:4/214: dread da/df/d11/f27 [0,4194304] 0 2024-04-03T08:39:06.493 INFO:tasks.workunit.client.0.smithi157.stdout:1/184: write d2/d11/d24/d7/d1b/f30 [900992,3411] 0 2024-04-03T08:39:06.494 INFO:tasks.workunit.client.0.smithi157.stdout:8/221: symlink d2/d11/l4d 0 2024-04-03T08:39:06.496 INFO:tasks.workunit.client.0.smithi157.stdout:3/219: mknod d8/d13/d23/c45 0 2024-04-03T08:39:06.497 INFO:tasks.workunit.client.0.smithi157.stdout:1/185: write d2/d11/d24/d7/d1b/f30 [696356,102526] 0 2024-04-03T08:39:06.497 INFO:tasks.workunit.client.0.smithi157.stdout:4/215: rmdir da 39 2024-04-03T08:39:06.498 INFO:tasks.workunit.client.0.smithi157.stdout:1/186: fdatasync d2/f3 0 2024-04-03T08:39:06.504 INFO:tasks.workunit.client.0.smithi157.stdout:5/216: creat dc/d34/d18/d21/f45 x:0 0 0 2024-04-03T08:39:06.508 INFO:tasks.workunit.client.0.smithi157.stdout:8/222: creat d2/d20/d23/f4e x:0 0 0 2024-04-03T08:39:06.512 INFO:tasks.workunit.client.0.smithi157.stdout:9/180: getdents d1/d15/d16 0 2024-04-03T08:39:06.512 INFO:tasks.workunit.client.0.smithi157.stdout:5/217: creat dc/d29/f46 x:0 0 0 2024-04-03T08:39:06.513 INFO:tasks.workunit.client.0.smithi157.stdout:7/245: getdents d0/d11/d15/d17/d52 0 2024-04-03T08:39:06.513 INFO:tasks.workunit.client.0.smithi157.stdout:4/216: symlink da/l4c 0 2024-04-03T08:39:06.515 INFO:tasks.workunit.client.0.smithi157.stdout:8/223: chown d2/d11/l2c 2 1 2024-04-03T08:39:06.516 INFO:tasks.workunit.client.0.smithi157.stdout:5/218: dread - dc/d34/f27 zero size 2024-04-03T08:39:06.517 INFO:tasks.workunit.client.0.smithi157.stdout:9/181: write d1/f33 [45439,42610] 0 2024-04-03T08:39:06.518 INFO:tasks.workunit.client.0.smithi157.stdout:7/246: dread - d0/d11/d15/d17/d1c/f5c zero size 2024-04-03T08:39:06.522 INFO:tasks.workunit.client.0.smithi157.stdout:8/224: unlink d2/ca 0 2024-04-03T08:39:06.523 INFO:tasks.workunit.client.0.smithi157.stdout:4/217: write da/f1e [1928377,74856] 0 2024-04-03T08:39:06.524 INFO:tasks.workunit.client.0.smithi157.stdout:9/182: write d1/d15/d16/f1e [849633,110862] 0 2024-04-03T08:39:06.526 INFO:tasks.workunit.client.0.smithi157.stdout:3/220: dwrite d8/d13/d23/d32/f42 [0,4194304] 0 2024-04-03T08:39:06.528 INFO:tasks.workunit.client.0.smithi157.stdout:5/219: symlink dc/d34/l47 0 2024-04-03T08:39:06.529 INFO:tasks.workunit.client.0.smithi157.stdout:4/218: fsync da/df/d2f/f40 0 2024-04-03T08:39:06.531 INFO:tasks.workunit.client.0.smithi157.stdout:3/221: chown d8/d13/d1b 247 1 2024-04-03T08:39:06.531 INFO:tasks.workunit.client.0.smithi157.stdout:4/219: fdatasync da/fc 0 2024-04-03T08:39:06.532 INFO:tasks.workunit.client.0.smithi157.stdout:1/187: dwrite d2/d11/d24/d7/d1b/f28 [0,4194304] 0 2024-04-03T08:39:06.532 INFO:tasks.workunit.client.0.smithi157.stdout:9/183: fsync d1/d15/d27/f32 0 2024-04-03T08:39:06.534 INFO:tasks.workunit.client.0.smithi157.stdout:3/222: chown d8/d13/f1c 159205 1 2024-04-03T08:39:06.537 INFO:tasks.workunit.client.0.smithi157.stdout:8/225: symlink d2/d11/d10/d12/d2e/l4f 0 2024-04-03T08:39:06.537 INFO:tasks.workunit.client.0.smithi157.stdout:3/223: fsync d8/d13/d23/f40 0 2024-04-03T08:39:06.541 INFO:tasks.workunit.client.0.smithi157.stdout:9/184: creat d1/d36/f3b x:0 0 0 2024-04-03T08:39:06.543 INFO:tasks.workunit.client.0.smithi157.stdout:3/224: symlink d8/d13/d23/l46 0 2024-04-03T08:39:06.545 INFO:tasks.workunit.client.0.smithi157.stdout:9/185: truncate d1/d15/d16/f2a 4748956 0 2024-04-03T08:39:06.546 INFO:tasks.workunit.client.0.smithi157.stdout:4/220: creat da/df/d24/d35/d3c/f4d x:0 0 0 2024-04-03T08:39:06.551 INFO:tasks.workunit.client.0.smithi157.stdout:3/225: creat d8/d1e/d2d/d39/f47 x:0 0 0 2024-04-03T08:39:06.551 INFO:tasks.workunit.client.0.smithi157.stdout:9/186: chown d1/d15/d27/f30 29154 1 2024-04-03T08:39:06.551 INFO:tasks.workunit.client.0.smithi157.stdout:4/221: dread - da/df/d24/d48/f4b zero size 2024-04-03T08:39:06.556 INFO:tasks.workunit.client.0.smithi157.stdout:9/187: write d1/d15/f2d [353435,102435] 0 2024-04-03T08:39:06.556 INFO:tasks.workunit.client.0.smithi157.stdout:4/222: symlink da/df/d24/l4e 0 2024-04-03T08:39:06.556 INFO:tasks.workunit.client.0.smithi157.stdout:5/220: dwrite dc/d35/f40 [0,4194304] 0 2024-04-03T08:39:06.559 INFO:tasks.workunit.client.0.smithi157.stdout:5/221: chown f8 1674494 1 2024-04-03T08:39:06.559 INFO:tasks.workunit.client.0.smithi157.stdout:1/188: dwrite d2/d11/f26 [0,4194304] 0 2024-04-03T08:39:06.560 INFO:tasks.workunit.client.0.smithi157.stdout:4/223: write da/df/f18 [1662131,88153] 0 2024-04-03T08:39:06.564 INFO:tasks.workunit.client.0.smithi157.stdout:5/222: write dc/d29/f46 [443365,14429] 0 2024-04-03T08:39:06.566 INFO:tasks.workunit.client.0.smithi157.stdout:8/226: chown d2/d11/d10/d12/f1c 75789 1 2024-04-03T08:39:06.569 INFO:tasks.workunit.client.0.smithi157.stdout:5/223: fdatasync dc/f1d 0 2024-04-03T08:39:06.571 INFO:tasks.workunit.client.0.smithi157.stdout:1/189: rename d2/d11/d24/d7 to d2/d11/d24/d39/d3b 0 2024-04-03T08:39:06.576 INFO:tasks.workunit.client.0.smithi157.stdout:4/224: link f4 da/df/d2f/f4f 0 2024-04-03T08:39:06.577 INFO:tasks.workunit.client.0.smithi157.stdout:1/190: read d2/f21 [277172,560] 0 2024-04-03T08:39:06.578 INFO:tasks.workunit.client.0.smithi157.stdout:8/227: mkdir d2/d50 0 2024-04-03T08:39:06.580 INFO:tasks.workunit.client.0.smithi157.stdout:4/225: read - da/df/d11/f46 zero size 2024-04-03T08:39:06.582 INFO:tasks.workunit.client.0.smithi157.stdout:9/188: dread d1/d15/d16/f2a [0,4194304] 0 2024-04-03T08:39:06.585 INFO:tasks.workunit.client.0.smithi157.stdout:4/226: creat da/df/d24/f50 x:0 0 0 2024-04-03T08:39:06.588 INFO:tasks.workunit.client.0.smithi157.stdout:8/228: truncate d2/d11/ff 3022506 0 2024-04-03T08:39:06.590 INFO:tasks.workunit.client.0.smithi157.stdout:5/224: dwrite dc/d34/f26 [0,4194304] 0 2024-04-03T08:39:06.592 INFO:tasks.workunit.client.0.smithi157.stdout:9/189: rename d1/l14 to d1/d15/d16/l3c 0 2024-04-03T08:39:06.595 INFO:tasks.workunit.client.0.smithi157.stdout:4/227: mkdir da/df/d24/d35/d3c/d51 0 2024-04-03T08:39:06.598 INFO:tasks.workunit.client.0.smithi157.stdout:4/228: dread - da/df/d24/d35/f41 zero size 2024-04-03T08:39:06.599 INFO:tasks.workunit.client.0.smithi157.stdout:1/191: link d2/d11/d24/d39/d3b/l17 d2/d11/d23/l3c 0 2024-04-03T08:39:06.606 INFO:tasks.workunit.client.0.smithi157.stdout:5/225: rename dc/f42 to dc/d29/d43/f48 0 2024-04-03T08:39:06.606 INFO:tasks.workunit.client.0.smithi157.stdout:4/229: write da/f3e [888101,106717] 0 2024-04-03T08:39:06.607 INFO:tasks.workunit.client.0.smithi157.stdout:1/192: write d2/d11/d24/d39/d3b/f1d [1332373,3176] 0 2024-04-03T08:39:06.609 INFO:tasks.workunit.client.0.smithi157.stdout:9/190: symlink d1/l3d 0 2024-04-03T08:39:06.610 INFO:tasks.workunit.client.0.smithi157.stdout:5/226: mkdir dc/d34/d49 0 2024-04-03T08:39:06.611 INFO:tasks.workunit.client.0.smithi157.stdout:4/230: dread - da/df/d24/d35/f41 zero size 2024-04-03T08:39:06.611 INFO:tasks.workunit.client.0.smithi157.stdout:8/229: creat d2/d11/f51 x:0 0 0 2024-04-03T08:39:06.613 INFO:tasks.workunit.client.0.smithi157.stdout:5/227: creat dc/d29/f4a x:0 0 0 2024-04-03T08:39:06.613 INFO:tasks.workunit.client.0.smithi157.stdout:1/193: symlink d2/d32/l3d 0 2024-04-03T08:39:06.615 INFO:tasks.workunit.client.0.smithi157.stdout:4/231: creat da/df/d24/d35/f52 x:0 0 0 2024-04-03T08:39:06.616 INFO:tasks.workunit.client.0.smithi157.stdout:8/230: unlink d2/c4 0 2024-04-03T08:39:06.618 INFO:tasks.workunit.client.0.smithi157.stdout:8/231: fdatasync d2/d20/d23/f41 0 2024-04-03T08:39:06.618 INFO:tasks.workunit.client.0.smithi157.stdout:4/232: write da/df/d24/d48/f4b [596299,85829] 0 2024-04-03T08:39:06.619 INFO:tasks.workunit.client.0.smithi157.stdout:1/194: creat d2/d11/d24/d39/d3b/d2e/f3e x:0 0 0 2024-04-03T08:39:06.624 INFO:tasks.workunit.client.0.smithi157.stdout:4/233: write da/f31 [6302264,82485] 0 2024-04-03T08:39:06.627 INFO:tasks.workunit.client.1.smithi181.stdout:8/21: sync 2024-04-03T08:39:06.627 INFO:tasks.workunit.client.1.smithi181.stdout:2/64: sync 2024-04-03T08:39:06.627 INFO:tasks.workunit.client.1.smithi181.stdout:1/10: sync 2024-04-03T08:39:06.627 INFO:tasks.workunit.client.1.smithi181.stdout:0/61: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:4/66: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:9/140: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:7/6: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:7/7: dread - no filename 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:3/10: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:6/21: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.1.smithi181.stdout:5/77: sync 2024-04-03T08:39:06.628 INFO:tasks.workunit.client.0.smithi157.stdout:4/234: chown da/d26/f4a 95 1 2024-04-03T08:39:06.630 INFO:tasks.workunit.client.0.smithi157.stdout:8/232: link d2/l34 d2/d11/d10/l52 0 2024-04-03T08:39:06.631 INFO:tasks.workunit.client.1.smithi181.stdout:1/11: dread - f0 zero size 2024-04-03T08:39:06.632 INFO:tasks.workunit.client.1.smithi181.stdout:1/12: chown f4 34 1 2024-04-03T08:39:06.633 INFO:tasks.workunit.client.0.smithi157.stdout:9/191: dwrite d1/d15/f31 [0,4194304] 0 2024-04-03T08:39:06.635 INFO:tasks.workunit.client.0.smithi157.stdout:8/233: fsync d2/d20/d23/f4e 0 2024-04-03T08:39:06.638 INFO:tasks.workunit.client.0.smithi157.stdout:5/228: dwrite dc/d34/d18/f1c [0,4194304] 0 2024-04-03T08:39:06.639 INFO:tasks.workunit.client.0.smithi157.stdout:8/234: write d2/d11/d10/f48 [143250,8228] 0 2024-04-03T08:39:06.640 INFO:tasks.workunit.client.0.smithi157.stdout:4/235: rename da/df/d24/d48 to da/df/d24/d35/d53 0 2024-04-03T08:39:06.641 INFO:tasks.workunit.client.1.smithi181.stdout:0/62: dread - d5/d9/fd zero size 2024-04-03T08:39:06.643 INFO:tasks.workunit.client.0.smithi157.stdout:8/235: chown d2/l27 33056706 1 2024-04-03T08:39:06.645 INFO:tasks.workunit.client.1.smithi181.stdout:4/67: unlink d1/l4 0 2024-04-03T08:39:06.645 INFO:tasks.workunit.client.0.smithi157.stdout:1/195: dwrite d2/d11/d24/f13 [0,4194304] 0 2024-04-03T08:39:06.647 INFO:tasks.workunit.client.1.smithi181.stdout:3/11: mkdir d0 0 2024-04-03T08:39:06.648 INFO:tasks.workunit.client.1.smithi181.stdout:3/12: chown d0 146 1 2024-04-03T08:39:06.649 INFO:tasks.workunit.client.0.smithi157.stdout:9/192: symlink d1/d15/d27/d34/l3e 0 2024-04-03T08:39:06.655 INFO:tasks.workunit.client.1.smithi181.stdout:1/13: symlink l5 0 2024-04-03T08:39:06.658 INFO:tasks.workunit.client.0.smithi157.stdout:4/236: dwrite da/f31 [4194304,4194304] 0 2024-04-03T08:39:06.658 INFO:tasks.workunit.client.1.smithi181.stdout:7/8: mkdir d0/d1 0 2024-04-03T08:39:06.658 INFO:tasks.workunit.client.1.smithi181.stdout:7/9: dwrite - no filename 2024-04-03T08:39:06.661 INFO:tasks.workunit.client.0.smithi157.stdout:4/237: chown da/df/d11 93 1 2024-04-03T08:39:06.662 INFO:tasks.workunit.client.0.smithi157.stdout:1/196: chown d2/d11/d24/d39/d3b/l17 193619020 1 2024-04-03T08:39:06.663 INFO:tasks.workunit.client.1.smithi181.stdout:6/22: mkdir d6/d7 0 2024-04-03T08:39:06.663 INFO:tasks.workunit.client.1.smithi181.stdout:6/23: dwrite - no filename 2024-04-03T08:39:06.664 INFO:tasks.workunit.client.0.smithi157.stdout:4/238: dread - da/df/f2a zero size 2024-04-03T08:39:06.664 INFO:tasks.workunit.client.1.smithi181.stdout:5/78: creat d4/d17/f1c x:0 0 0 2024-04-03T08:39:06.665 INFO:tasks.workunit.client.1.smithi181.stdout:6/24: chown c3 5335518 1 2024-04-03T08:39:06.665 INFO:tasks.workunit.client.1.smithi181.stdout:6/25: write - no filename 2024-04-03T08:39:06.665 INFO:tasks.workunit.client.1.smithi181.stdout:6/26: write - no filename 2024-04-03T08:39:06.667 INFO:tasks.workunit.client.0.smithi157.stdout:8/236: mkdir d2/d11/d10/d12/d53 0 2024-04-03T08:39:06.667 INFO:tasks.workunit.client.0.smithi157.stdout:0/241: sync 2024-04-03T08:39:06.667 INFO:tasks.workunit.client.0.smithi157.stdout:5/229: getdents dc/d34/d18 0 2024-04-03T08:39:06.668 INFO:tasks.workunit.client.1.smithi181.stdout:9/141: mkdir d1/da/d13/d22/d23/d36 0 2024-04-03T08:39:06.669 INFO:tasks.workunit.client.1.smithi181.stdout:1/14: dread - f4 zero size 2024-04-03T08:39:06.670 INFO:tasks.workunit.client.0.smithi157.stdout:8/237: fsync d2/d20/d23/f30 0 2024-04-03T08:39:06.670 INFO:tasks.workunit.client.1.smithi181.stdout:7/10: mknod d0/c2 0 2024-04-03T08:39:06.670 INFO:tasks.workunit.client.1.smithi181.stdout:7/11: dread - no filename 2024-04-03T08:39:06.670 INFO:tasks.workunit.client.0.smithi157.stdout:1/197: rename d2/d11/d24/d39 to d2/d11/d24/d39/d3b/d3f 22 2024-04-03T08:39:06.673 INFO:tasks.workunit.client.0.smithi157.stdout:9/193: dwrite d1/d15/d27/f30 [0,4194304] 0 2024-04-03T08:39:06.673 INFO:tasks.workunit.client.0.smithi157.stdout:5/230: write dc/d34/d18/f1c [575235,23232] 0 2024-04-03T08:39:06.673 INFO:tasks.workunit.client.0.smithi157.stdout:0/242: rmdir d2/d9/d51 39 2024-04-03T08:39:06.677 INFO:tasks.workunit.client.1.smithi181.stdout:3/13: mknod d0/c1 0 2024-04-03T08:39:06.677 INFO:tasks.workunit.client.1.smithi181.stdout:3/14: read - no filename 2024-04-03T08:39:06.677 INFO:tasks.workunit.client.1.smithi181.stdout:3/15: truncate - no filename 2024-04-03T08:39:06.677 INFO:tasks.workunit.client.0.smithi157.stdout:4/239: write da/df/d24/d35/f43 [639686,97389] 0 2024-04-03T08:39:06.678 INFO:tasks.workunit.client.1.smithi181.stdout:2/65: dwrite f11 [0,4194304] 0 2024-04-03T08:39:06.681 INFO:tasks.workunit.client.1.smithi181.stdout:9/142: creat d1/d34/f37 x:0 0 0 2024-04-03T08:39:06.684 INFO:tasks.workunit.client.1.smithi181.stdout:9/143: chown d1/l15 61204 1 2024-04-03T08:39:06.685 INFO:tasks.workunit.client.1.smithi181.stdout:9/144: stat d1/da/d1a 0 2024-04-03T08:39:06.687 INFO:tasks.workunit.client.1.smithi181.stdout:1/15: mknod c6 0 2024-04-03T08:39:06.694 INFO:tasks.workunit.client.0.smithi157.stdout:0/243: fsync d2/f15 0 2024-04-03T08:39:06.697 INFO:tasks.workunit.client.0.smithi157.stdout:5/231: unlink dc/l10 0 2024-04-03T08:39:06.699 INFO:tasks.workunit.client.1.smithi181.stdout:6/27: mknod d6/d7/c8 0 2024-04-03T08:39:06.699 INFO:tasks.workunit.client.1.smithi181.stdout:6/28: dwrite - no filename 2024-04-03T08:39:06.700 INFO:tasks.workunit.client.0.smithi157.stdout:5/232: chown dc/d34/d18/c3b 99 1 2024-04-03T08:39:06.701 INFO:tasks.workunit.client.1.smithi181.stdout:5/79: write f1 [3846189,127150] 0 2024-04-03T08:39:06.703 INFO:tasks.workunit.client.0.smithi157.stdout:4/240: dwrite da/f31 [0,4194304] 0 2024-04-03T08:39:06.703 INFO:tasks.workunit.client.1.smithi181.stdout:5/80: chown d4/f12 56 1 2024-04-03T08:39:06.706 INFO:tasks.workunit.client.1.smithi181.stdout:9/145: rename d1/da/cd to d1/da/d16/c38 0 2024-04-03T08:39:06.707 INFO:tasks.workunit.client.1.smithi181.stdout:2/66: dread f0 [0,4194304] 0 2024-04-03T08:39:06.710 INFO:tasks.workunit.client.0.smithi157.stdout:4/241: fdatasync da/df/d24/d35/f41 0 2024-04-03T08:39:06.713 INFO:tasks.workunit.client.0.smithi157.stdout:0/244: creat d2/d9/dc/df/d1b/f59 x:0 0 0 2024-04-03T08:39:06.713 INFO:tasks.workunit.client.1.smithi181.stdout:7/12: creat d0/d1/f3 x:0 0 0 2024-04-03T08:39:06.714 INFO:tasks.workunit.client.1.smithi181.stdout:4/68: getdents d1 0 2024-04-03T08:39:06.717 INFO:tasks.workunit.client.0.smithi157.stdout:0/245: read d2/d9/dc/df/d1b/d4a/f2f [3235687,10048] 0 2024-04-03T08:39:06.717 INFO:tasks.workunit.client.1.smithi181.stdout:7/13: chown d0/d1/f3 189 1 2024-04-03T08:39:06.717 INFO:tasks.workunit.client.0.smithi157.stdout:9/194: dwrite d1/fd [0,4194304] 0 2024-04-03T08:39:06.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/29: mkdir d6/d7/d9 0 2024-04-03T08:39:06.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/30: dread - no filename 2024-04-03T08:39:06.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/31: chown c3 11 1 2024-04-03T08:39:06.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/32: write - no filename 2024-04-03T08:39:06.718 INFO:tasks.workunit.client.0.smithi157.stdout:1/198: link d2/d11/d24/ld d2/l40 0 2024-04-03T08:39:06.718 INFO:tasks.workunit.client.1.smithi181.stdout:7/14: write d0/d1/f3 [260922,27494] 0 2024-04-03T08:39:06.720 INFO:tasks.workunit.client.1.smithi181.stdout:5/81: symlink d4/l1d 0 2024-04-03T08:39:06.725 INFO:tasks.workunit.client.0.smithi157.stdout:1/199: write d2/d11/d24/f13 [4200050,80896] 0 2024-04-03T08:39:06.731 INFO:tasks.workunit.client.0.smithi157.stdout:8/238: dread d2/d11/d10/f1f [0,4194304] 0 2024-04-03T08:39:06.735 INFO:tasks.workunit.client.0.smithi157.stdout:1/200: fdatasync d2/f21 0 2024-04-03T08:39:06.736 INFO:tasks.workunit.client.0.smithi157.stdout:0/246: dread d2/fa [4194304,4194304] 0 2024-04-03T08:39:06.738 INFO:tasks.workunit.client.1.smithi181.stdout:1/16: dwrite f0 [0,4194304] 0 2024-04-03T08:39:06.740 INFO:tasks.workunit.client.0.smithi157.stdout:2/300: sync 2024-04-03T08:39:06.741 INFO:tasks.workunit.client.1.smithi181.stdout:2/67: write ff [247296,53667] 0 2024-04-03T08:39:06.742 INFO:tasks.workunit.client.1.smithi181.stdout:6/33: creat d6/d7/d9/fa x:0 0 0 2024-04-03T08:39:06.743 INFO:tasks.workunit.client.1.smithi181.stdout:9/146: write d1/f35 [477417,1328] 0 2024-04-03T08:39:06.746 INFO:tasks.workunit.client.1.smithi181.stdout:5/82: write d4/f5 [440950,109896] 0 2024-04-03T08:39:06.748 INFO:tasks.workunit.client.0.smithi157.stdout:4/242: getdents da/df/d24 0 2024-04-03T08:39:06.749 INFO:tasks.workunit.client.0.smithi157.stdout:1/201: symlink d2/d11/d24/d39/l41 0 2024-04-03T08:39:06.749 INFO:tasks.workunit.client.1.smithi181.stdout:7/15: dwrite d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:06.749 INFO:tasks.workunit.client.1.smithi181.stdout:2/68: write ff [944961,43768] 0 2024-04-03T08:39:06.749 INFO:tasks.workunit.client.0.smithi157.stdout:9/195: creat d1/f3f x:0 0 0 2024-04-03T08:39:06.750 INFO:tasks.workunit.client.1.smithi181.stdout:6/34: chown c2 13065 1 2024-04-03T08:39:06.752 INFO:tasks.workunit.client.0.smithi157.stdout:4/243: dread - da/df/d24/f50 zero size 2024-04-03T08:39:06.755 INFO:tasks.workunit.client.1.smithi181.stdout:2/69: mkdir d13/d1c 0 2024-04-03T08:39:06.757 INFO:tasks.workunit.client.1.smithi181.stdout:7/16: unlink d0/c2 0 2024-04-03T08:39:06.758 INFO:tasks.workunit.client.0.smithi157.stdout:8/239: rmdir d2/d11/d10/d12/d2e 39 2024-04-03T08:39:06.759 INFO:tasks.workunit.client.1.smithi181.stdout:7/17: read d0/d1/f3 [2397242,78738] 0 2024-04-03T08:39:06.760 INFO:tasks.workunit.client.0.smithi157.stdout:9/196: symlink d1/d15/d27/d34/l40 0 2024-04-03T08:39:06.761 INFO:tasks.workunit.client.0.smithi157.stdout:5/233: dread dc/d34/f20 [0,4194304] 0 2024-04-03T08:39:06.761 INFO:tasks.workunit.client.1.smithi181.stdout:5/83: rename d4/l14 to d4/l1e 0 2024-04-03T08:39:06.763 INFO:tasks.workunit.client.1.smithi181.stdout:4/69: dwrite d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:06.764 INFO:tasks.workunit.client.1.smithi181.stdout:9/147: truncate d1/da/f1e 576048 0 2024-04-03T08:39:06.767 INFO:tasks.workunit.client.1.smithi181.stdout:6/35: creat d6/d7/fb x:0 0 0 2024-04-03T08:39:06.768 INFO:tasks.workunit.client.1.smithi181.stdout:6/36: stat d6/d7 0 2024-04-03T08:39:06.771 INFO:tasks.workunit.client.1.smithi181.stdout:2/70: mkdir d13/d1d 0 2024-04-03T08:39:06.776 INFO:tasks.workunit.client.1.smithi181.stdout:5/84: symlink d4/l1f 0 2024-04-03T08:39:06.776 INFO:tasks.workunit.client.1.smithi181.stdout:1/17: dwrite f2 [0,4194304] 0 2024-04-03T08:39:06.778 INFO:tasks.workunit.client.1.smithi181.stdout:1/18: chown f2 522763438 1 2024-04-03T08:39:06.779 INFO:tasks.workunit.client.0.smithi157.stdout:5/234: dread f7 [0,4194304] 0 2024-04-03T08:39:06.779 INFO:tasks.workunit.client.0.smithi157.stdout:1/202: dwrite d2/d11/d24/f1f [0,4194304] 0 2024-04-03T08:39:06.781 INFO:tasks.workunit.client.0.smithi157.stdout:8/240: unlink d2/d20/d23/l46 0 2024-04-03T08:39:06.783 INFO:tasks.workunit.client.1.smithi181.stdout:7/18: fdatasync d0/d1/f3 0 2024-04-03T08:39:06.785 INFO:tasks.workunit.client.0.smithi157.stdout:1/203: chown d2/d11/d24/d39/d3b/f1d 395950 1 2024-04-03T08:39:06.787 INFO:tasks.workunit.client.0.smithi157.stdout:9/197: dwrite d1/f33 [0,4194304] 0 2024-04-03T08:39:06.787 INFO:tasks.workunit.client.0.smithi157.stdout:0/247: getdents d2/d9/d51 0 2024-04-03T08:39:06.790 INFO:tasks.workunit.client.1.smithi181.stdout:6/37: symlink d6/d7/lc 0 2024-04-03T08:39:06.790 INFO:tasks.workunit.client.1.smithi181.stdout:6/38: fsync d6/d7/fb 0 2024-04-03T08:39:06.792 INFO:tasks.workunit.client.1.smithi181.stdout:2/71: creat d13/f1e x:0 0 0 2024-04-03T08:39:06.794 INFO:tasks.workunit.client.1.smithi181.stdout:6/39: chown d6/d7/c8 1053404015 1 2024-04-03T08:39:06.794 INFO:tasks.workunit.client.1.smithi181.stdout:5/85: creat d4/d17/f20 x:0 0 0 2024-04-03T08:39:06.794 INFO:tasks.workunit.client.0.smithi157.stdout:4/244: write da/df/d2f/f4f [1566782,47786] 0 2024-04-03T08:39:06.796 INFO:tasks.workunit.client.1.smithi181.stdout:1/19: symlink l7 0 2024-04-03T08:39:06.799 INFO:tasks.workunit.client.1.smithi181.stdout:7/19: mknod d0/c4 0 2024-04-03T08:39:06.801 INFO:tasks.workunit.client.0.smithi157.stdout:4/245: readlink da/df/d24/l32 0 2024-04-03T08:39:06.802 INFO:tasks.workunit.client.0.smithi157.stdout:4/246: chown da/df/l30 56108155 1 2024-04-03T08:39:06.806 INFO:tasks.workunit.client.1.smithi181.stdout:4/70: dwrite d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:06.813 INFO:tasks.workunit.client.1.smithi181.stdout:5/86: fdatasync d4/ff 0 2024-04-03T08:39:06.814 INFO:tasks.workunit.client.0.smithi157.stdout:0/248: symlink d2/d9/dc/d54/l5a 0 2024-04-03T08:39:06.814 INFO:tasks.workunit.client.0.smithi157.stdout:8/241: creat d2/d11/d10/d24/f54 x:0 0 0 2024-04-03T08:39:06.816 INFO:tasks.workunit.client.1.smithi181.stdout:6/40: rename c4 to d6/d7/d9/cd 0 2024-04-03T08:39:06.817 INFO:tasks.workunit.client.0.smithi157.stdout:5/235: creat dc/f4b x:0 0 0 2024-04-03T08:39:06.818 INFO:tasks.workunit.client.0.smithi157.stdout:8/242: readlink d2/d11/l4d 0 2024-04-03T08:39:06.818 INFO:tasks.workunit.client.1.smithi181.stdout:7/20: symlink d0/l5 0 2024-04-03T08:39:06.819 INFO:tasks.workunit.client.1.smithi181.stdout:1/20: dwrite f0 [0,4194304] 0 2024-04-03T08:39:06.819 INFO:tasks.workunit.client.0.smithi157.stdout:8/243: stat d2/d20/d23 0 2024-04-03T08:39:06.820 INFO:tasks.workunit.client.1.smithi181.stdout:9/148: dwrite d1/da/f12 [0,4194304] 0 2024-04-03T08:39:06.820 INFO:tasks.workunit.client.1.smithi181.stdout:7/21: chown d0/l5 24350 1 2024-04-03T08:39:06.821 INFO:tasks.workunit.client.1.smithi181.stdout:5/87: symlink d4/d17/l21 0 2024-04-03T08:39:06.821 INFO:tasks.workunit.client.1.smithi181.stdout:6/41: rmdir d6 39 2024-04-03T08:39:06.824 INFO:tasks.workunit.client.1.smithi181.stdout:7/22: chown d0/c4 1916599 1 2024-04-03T08:39:06.824 INFO:tasks.workunit.client.0.smithi157.stdout:1/204: link d2/d11/d24/d39/d3b/l10 d2/d11/l42 0 2024-04-03T08:39:06.825 INFO:tasks.workunit.client.1.smithi181.stdout:1/21: creat f8 x:0 0 0 2024-04-03T08:39:06.830 INFO:tasks.workunit.client.1.smithi181.stdout:5/88: mkdir d4/d22 0 2024-04-03T08:39:06.830 INFO:tasks.workunit.client.1.smithi181.stdout:6/42: fdatasync d6/d7/d9/fa 0 2024-04-03T08:39:06.833 INFO:tasks.workunit.client.1.smithi181.stdout:7/23: mkdir d0/d1/d6 0 2024-04-03T08:39:06.833 INFO:tasks.workunit.client.1.smithi181.stdout:1/22: unlink f0 0 2024-04-03T08:39:06.836 INFO:tasks.workunit.client.1.smithi181.stdout:7/24: read d0/d1/f3 [3062096,865] 0 2024-04-03T08:39:06.840 INFO:tasks.workunit.client.1.smithi181.stdout:7/25: write d0/d1/f3 [3372240,125081] 0 2024-04-03T08:39:06.840 INFO:tasks.workunit.client.1.smithi181.stdout:7/26: stat d0/d1 0 2024-04-03T08:39:06.842 INFO:tasks.workunit.client.0.smithi157.stdout:0/249: link d2/f25 d2/f5b 0 2024-04-03T08:39:06.843 INFO:tasks.workunit.client.0.smithi157.stdout:9/198: dread d1/d15/d27/f32 [0,4194304] 0 2024-04-03T08:39:06.846 INFO:tasks.workunit.client.1.smithi181.stdout:5/89: getdents d4/d22 0 2024-04-03T08:39:06.848 INFO:tasks.workunit.client.1.smithi181.stdout:5/90: fsync f1 0 2024-04-03T08:39:06.849 INFO:tasks.workunit.client.1.smithi181.stdout:1/23: fdatasync f4 0 2024-04-03T08:39:06.851 INFO:tasks.workunit.client.1.smithi181.stdout:7/27: symlink d0/d1/l7 0 2024-04-03T08:39:06.852 INFO:tasks.workunit.client.1.smithi181.stdout:5/91: dread - d4/d17/f20 zero size 2024-04-03T08:39:06.853 INFO:tasks.workunit.client.0.smithi157.stdout:0/250: read d2/f37 [170595,36087] 0 2024-04-03T08:39:06.857 INFO:tasks.workunit.client.0.smithi157.stdout:1/205: dwrite d2/d11/d24/d39/d3b/d2e/f3e [0,4194304] 0 2024-04-03T08:39:06.857 INFO:tasks.workunit.client.0.smithi157.stdout:4/247: getdents da/df 0 2024-04-03T08:39:06.858 INFO:tasks.workunit.client.1.smithi181.stdout:7/28: write d0/d1/f3 [789464,106592] 0 2024-04-03T08:39:06.859 INFO:tasks.workunit.client.1.smithi181.stdout:1/24: rename f8 to f9 0 2024-04-03T08:39:06.860 INFO:tasks.workunit.client.0.smithi157.stdout:4/248: write da/df/d11/f46 [623137,20486] 0 2024-04-03T08:39:06.862 INFO:tasks.workunit.client.1.smithi181.stdout:7/29: chown d0 22003013 1 2024-04-03T08:39:06.864 INFO:tasks.workunit.client.0.smithi157.stdout:4/249: truncate da/df/f14 4309409 0 2024-04-03T08:39:06.865 INFO:tasks.workunit.client.0.smithi157.stdout:0/251: mknod d2/d9/dc/c5c 0 2024-04-03T08:39:06.865 INFO:tasks.workunit.client.0.smithi157.stdout:9/199: dread d1/f33 [0,4194304] 0 2024-04-03T08:39:06.866 INFO:tasks.workunit.client.1.smithi181.stdout:5/92: creat d4/d18/f23 x:0 0 0 2024-04-03T08:39:06.868 INFO:tasks.workunit.client.0.smithi157.stdout:9/200: read d1/f33 [3716692,8912] 0 2024-04-03T08:39:06.869 INFO:tasks.workunit.client.0.smithi157.stdout:1/206: rename d2/d11/c27 to d2/d11/d24/d39/c43 0 2024-04-03T08:39:06.872 INFO:tasks.workunit.client.1.smithi181.stdout:6/43: dwrite d6/d7/d9/fa [0,4194304] 0 2024-04-03T08:39:06.877 INFO:tasks.workunit.client.1.smithi181.stdout:5/93: chown d4/cc 789302 1 2024-04-03T08:39:06.877 INFO:tasks.workunit.client.0.smithi157.stdout:1/207: chown d2/d11/l42 3 1 2024-04-03T08:39:06.880 INFO:tasks.workunit.client.0.smithi157.stdout:5/236: dwrite dc/d34/f33 [0,4194304] 0 2024-04-03T08:39:06.880 INFO:tasks.workunit.client.1.smithi181.stdout:7/30: write d0/d1/f3 [2369006,15671] 0 2024-04-03T08:39:06.883 INFO:tasks.workunit.client.0.smithi157.stdout:0/252: link d2/d9/dc/df/d1b/f49 d2/d9/dc/f5d 0 2024-04-03T08:39:06.884 INFO:tasks.workunit.client.1.smithi181.stdout:2/72: dwrite f12 [0,4194304] 0 2024-04-03T08:39:06.887 INFO:tasks.workunit.client.1.smithi181.stdout:5/94: symlink d4/d18/l24 0 2024-04-03T08:39:06.889 INFO:tasks.workunit.client.0.smithi157.stdout:4/250: dwrite da/f31 [0,4194304] 0 2024-04-03T08:39:06.890 INFO:tasks.workunit.client.1.smithi181.stdout:4/71: dwrite d1/d16/f18 [0,4194304] 0 2024-04-03T08:39:06.892 INFO:tasks.workunit.client.1.smithi181.stdout:1/25: write f4 [37208,49263] 0 2024-04-03T08:39:06.892 INFO:tasks.workunit.client.0.smithi157.stdout:0/253: fsync d2/fa 0 2024-04-03T08:39:06.895 INFO:tasks.workunit.client.0.smithi157.stdout:0/254: fsync d2/f1d 0 2024-04-03T08:39:06.895 INFO:tasks.workunit.client.0.smithi157.stdout:9/201: dread d1/d15/d16/f2a [0,4194304] 0 2024-04-03T08:39:06.896 INFO:tasks.workunit.client.1.smithi181.stdout:7/31: symlink d0/l8 0 2024-04-03T08:39:06.898 INFO:tasks.workunit.client.1.smithi181.stdout:2/73: unlink f9 0 2024-04-03T08:39:06.904 INFO:tasks.workunit.client.0.smithi157.stdout:9/202: chown d1/d15/d16/f3a 8 1 2024-04-03T08:39:06.905 INFO:tasks.workunit.client.1.smithi181.stdout:5/95: rmdir d4/d17 39 2024-04-03T08:39:06.905 INFO:tasks.workunit.client.1.smithi181.stdout:1/26: rename c3 to ca 0 2024-04-03T08:39:06.906 INFO:tasks.workunit.client.1.smithi181.stdout:4/72: rename d1/d16/ce to d1/c1b 0 2024-04-03T08:39:06.907 INFO:tasks.workunit.client.1.smithi181.stdout:4/73: stat d1/c9 0 2024-04-03T08:39:06.909 INFO:tasks.workunit.client.0.smithi157.stdout:4/251: mkdir da/df/d2f/d54 0 2024-04-03T08:39:06.911 INFO:tasks.workunit.client.1.smithi181.stdout:6/44: link d6/d7/d9/fa d6/d7/d9/fe 0 2024-04-03T08:39:06.913 INFO:tasks.workunit.client.1.smithi181.stdout:1/27: creat fb x:0 0 0 2024-04-03T08:39:06.914 INFO:tasks.workunit.client.1.smithi181.stdout:1/28: fdatasync fb 0 2024-04-03T08:39:06.915 INFO:tasks.workunit.client.1.smithi181.stdout:6/45: chown d6/d7/d9/fe 3126 1 2024-04-03T08:39:06.915 INFO:tasks.workunit.client.0.smithi157.stdout:7/247: sync 2024-04-03T08:39:06.915 INFO:tasks.workunit.client.0.smithi157.stdout:6/258: sync 2024-04-03T08:39:06.915 INFO:tasks.workunit.client.0.smithi157.stdout:3/226: sync 2024-04-03T08:39:06.916 INFO:tasks.workunit.client.0.smithi157.stdout:5/237: dwrite dc/f4b [0,4194304] 0 2024-04-03T08:39:06.916 INFO:tasks.workunit.client.1.smithi181.stdout:4/74: creat d1/d15/f1c x:0 0 0 2024-04-03T08:39:06.918 INFO:tasks.workunit.client.1.smithi181.stdout:0/63: sync 2024-04-03T08:39:06.918 INFO:tasks.workunit.client.1.smithi181.stdout:8/22: sync 2024-04-03T08:39:06.918 INFO:tasks.workunit.client.1.smithi181.stdout:7/32: creat d0/d1/d6/f9 x:0 0 0 2024-04-03T08:39:06.921 INFO:tasks.workunit.client.1.smithi181.stdout:2/74: mknod d13/d1c/c1f 0 2024-04-03T08:39:06.922 INFO:tasks.workunit.client.1.smithi181.stdout:5/96: rename d4/d17 to d4/d18/d25 0 2024-04-03T08:39:06.923 INFO:tasks.workunit.client.1.smithi181.stdout:7/33: readlink d0/l8 0 2024-04-03T08:39:06.925 INFO:tasks.workunit.client.1.smithi181.stdout:3/16: sync 2024-04-03T08:39:06.925 INFO:tasks.workunit.client.0.smithi157.stdout:7/248: readlink d0/d11/d15/d35/l4e 0 2024-04-03T08:39:06.926 INFO:tasks.workunit.client.1.smithi181.stdout:7/34: chown d0/d1/d6 1416688 1 2024-04-03T08:39:06.928 INFO:tasks.workunit.client.0.smithi157.stdout:5/238: fsync dc/d34/f20 0 2024-04-03T08:39:06.929 INFO:tasks.workunit.client.1.smithi181.stdout:0/64: chown d5/d9/fd 6507 1 2024-04-03T08:39:06.930 INFO:tasks.workunit.client.0.smithi157.stdout:7/249: readlink d0/d4/l42 0 2024-04-03T08:39:06.932 INFO:tasks.workunit.client.1.smithi181.stdout:8/23: truncate f3 1939045 0 2024-04-03T08:39:06.933 INFO:tasks.workunit.client.1.smithi181.stdout:7/35: dread - d0/d1/d6/f9 zero size 2024-04-03T08:39:06.933 INFO:tasks.workunit.client.1.smithi181.stdout:2/75: symlink d13/l20 0 2024-04-03T08:39:06.936 INFO:tasks.workunit.client.0.smithi157.stdout:0/255: dwrite d2/d9/dc/df/d1b/d4a/d31/f4c [0,4194304] 0 2024-04-03T08:39:06.936 INFO:tasks.workunit.client.1.smithi181.stdout:3/17: symlink d0/l2 0 2024-04-03T08:39:06.936 INFO:tasks.workunit.client.1.smithi181.stdout:3/18: dread - no filename 2024-04-03T08:39:06.937 INFO:tasks.workunit.client.1.smithi181.stdout:1/29: read f4 [33109,120486] 0 2024-04-03T08:39:06.937 INFO:tasks.workunit.client.0.smithi157.stdout:9/203: getdents d1/d15 0 2024-04-03T08:39:06.938 INFO:tasks.workunit.client.0.smithi157.stdout:4/252: dread da/f31 [4194304,4194304] 0 2024-04-03T08:39:06.939 INFO:tasks.workunit.client.0.smithi157.stdout:3/227: mkdir d8/d13/d3d/d48 0 2024-04-03T08:39:06.941 INFO:tasks.workunit.client.1.smithi181.stdout:2/76: mknod d13/c21 0 2024-04-03T08:39:06.941 INFO:tasks.workunit.client.0.smithi157.stdout:9/204: read d1/f19 [13062,52615] 0 2024-04-03T08:39:06.941 INFO:tasks.workunit.client.1.smithi181.stdout:2/77: fsync ff 0 2024-04-03T08:39:06.943 INFO:tasks.workunit.client.0.smithi157.stdout:0/256: chown d2/d9/dc/df/l11 0 1 2024-04-03T08:39:06.944 INFO:tasks.workunit.client.0.smithi157.stdout:4/253: write da/df/d2f/f4f [4145793,122286] 0 2024-04-03T08:39:06.944 INFO:tasks.workunit.client.0.smithi157.stdout:9/205: chown d1/l3d 204853 1 2024-04-03T08:39:06.944 INFO:tasks.workunit.client.1.smithi181.stdout:7/36: mknod d0/d1/d6/ca 0 2024-04-03T08:39:06.946 INFO:tasks.workunit.client.0.smithi157.stdout:7/250: mknod d0/d11/d15/d17/d1c/d4f/c60 0 2024-04-03T08:39:06.949 INFO:tasks.workunit.client.1.smithi181.stdout:4/75: dread d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:06.953 INFO:tasks.workunit.client.0.smithi157.stdout:4/254: read f4 [2428431,10934] 0 2024-04-03T08:39:06.953 INFO:tasks.workunit.client.0.smithi157.stdout:9/206: write d1/d15/d27/f39 [242667,114890] 0 2024-04-03T08:39:06.954 INFO:tasks.workunit.client.1.smithi181.stdout:3/19: creat d0/f3 x:0 0 0 2024-04-03T08:39:06.955 INFO:tasks.workunit.client.0.smithi157.stdout:1/208: dread f0 [0,4194304] 0 2024-04-03T08:39:06.955 INFO:tasks.workunit.client.1.smithi181.stdout:6/46: dwrite d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:06.955 INFO:tasks.workunit.client.0.smithi157.stdout:6/259: dwrite d1/f48 [0,4194304] 0 2024-04-03T08:39:06.956 INFO:tasks.workunit.client.0.smithi157.stdout:5/239: symlink dc/l4c 0 2024-04-03T08:39:06.957 INFO:tasks.workunit.client.1.smithi181.stdout:3/20: write d0/f3 [621369,123737] 0 2024-04-03T08:39:06.958 INFO:tasks.workunit.client.0.smithi157.stdout:4/255: fsync da/fc 0 2024-04-03T08:39:06.958 INFO:tasks.workunit.client.0.smithi157.stdout:9/207: fdatasync d1/f17 0 2024-04-03T08:39:06.960 INFO:tasks.workunit.client.0.smithi157.stdout:7/251: dread d0/f20 [0,4194304] 0 2024-04-03T08:39:06.962 INFO:tasks.workunit.client.0.smithi157.stdout:7/252: stat d0/cc 0 2024-04-03T08:39:06.962 INFO:tasks.workunit.client.0.smithi157.stdout:0/257: symlink d2/d9/d36/l5e 0 2024-04-03T08:39:06.966 INFO:tasks.workunit.client.1.smithi181.stdout:0/65: truncate d5/dc/f12 564145 0 2024-04-03T08:39:06.975 INFO:tasks.workunit.client.0.smithi157.stdout:1/209: creat d2/d11/f44 x:0 0 0 2024-04-03T08:39:06.976 INFO:tasks.workunit.client.0.smithi157.stdout:1/210: readlink d2/d11/l33 0 2024-04-03T08:39:06.976 INFO:tasks.workunit.client.0.smithi157.stdout:9/208: mknod d1/d15/d16/c41 0 2024-04-03T08:39:06.977 INFO:tasks.workunit.client.0.smithi157.stdout:9/209: chown d1/f26 402 1 2024-04-03T08:39:06.978 INFO:tasks.workunit.client.0.smithi157.stdout:4/256: mknod da/df/d24/d35/c55 0 2024-04-03T08:39:06.979 INFO:tasks.workunit.client.1.smithi181.stdout:0/66: mkdir d5/d9/d13 0 2024-04-03T08:39:06.980 INFO:tasks.workunit.client.1.smithi181.stdout:3/21: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:06.981 INFO:tasks.workunit.client.0.smithi157.stdout:4/257: chown da/f31 1068085 1 2024-04-03T08:39:06.985 INFO:tasks.workunit.client.0.smithi157.stdout:5/240: truncate dc/f11 2028845 0 2024-04-03T08:39:06.986 INFO:tasks.workunit.client.0.smithi157.stdout:5/241: chown c6 0 1 2024-04-03T08:39:06.987 INFO:tasks.workunit.client.1.smithi181.stdout:3/22: chown d0/c1 8569981 1 2024-04-03T08:39:06.987 INFO:tasks.workunit.client.1.smithi181.stdout:5/97: truncate d4/f5 1279107 0 2024-04-03T08:39:06.987 INFO:tasks.workunit.client.1.smithi181.stdout:4/76: dread d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:06.988 INFO:tasks.workunit.client.1.smithi181.stdout:9/149: sync 2024-04-03T08:39:06.988 INFO:tasks.workunit.client.0.smithi157.stdout:9/210: readlink d1/l9 0 2024-04-03T08:39:06.989 INFO:tasks.workunit.client.1.smithi181.stdout:1/30: dwrite f4 [0,4194304] 0 2024-04-03T08:39:06.990 INFO:tasks.workunit.client.1.smithi181.stdout:0/67: mkdir d5/dc/d14 0 2024-04-03T08:39:06.990 INFO:tasks.workunit.client.1.smithi181.stdout:7/37: dwrite d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:06.990 INFO:tasks.workunit.client.0.smithi157.stdout:0/258: mkdir d2/d9/d5f 0 2024-04-03T08:39:06.992 INFO:tasks.workunit.client.0.smithi157.stdout:7/253: mkdir d0/d11/d15/d17/d1c/d4f/d5f/d61 0 2024-04-03T08:39:06.994 INFO:tasks.workunit.client.0.smithi157.stdout:4/258: rename da/df/d24/l32 to da/df/d24/d35/d53/l56 0 2024-04-03T08:39:06.994 INFO:tasks.workunit.client.1.smithi181.stdout:9/150: readlink d1/da/d13/l1d 0 2024-04-03T08:39:06.994 INFO:tasks.workunit.client.1.smithi181.stdout:8/24: dread f3 [0,4194304] 0 2024-04-03T08:39:06.995 INFO:tasks.workunit.client.0.smithi157.stdout:4/259: chown da/df/d11/c3f 0 1 2024-04-03T08:39:06.997 INFO:tasks.workunit.client.0.smithi157.stdout:5/242: creat dc/d34/f4d x:0 0 0 2024-04-03T08:39:06.998 INFO:tasks.workunit.client.0.smithi157.stdout:4/260: write da/df/f18 [1553087,40928] 0 2024-04-03T08:39:07.000 INFO:tasks.workunit.client.1.smithi181.stdout:0/68: read f2 [922751,112436] 0 2024-04-03T08:39:07.000 INFO:tasks.workunit.client.1.smithi181.stdout:6/47: dwrite d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:07.001 INFO:tasks.workunit.client.0.smithi157.stdout:4/261: read - da/df/d24/d35/d3c/f4d zero size 2024-04-03T08:39:07.003 INFO:tasks.workunit.client.1.smithi181.stdout:7/38: write d0/d1/f3 [3045583,33764] 0 2024-04-03T08:39:07.005 INFO:tasks.workunit.client.1.smithi181.stdout:3/23: write d0/f3 [1395544,19970] 0 2024-04-03T08:39:07.006 INFO:tasks.workunit.client.0.smithi157.stdout:7/254: creat d0/d5/f62 x:0 0 0 2024-04-03T08:39:07.006 INFO:tasks.workunit.client.1.smithi181.stdout:2/78: truncate f0 4078345 0 2024-04-03T08:39:07.007 INFO:tasks.workunit.client.0.smithi157.stdout:7/255: chown d0/d11/d15/d17 3652236 1 2024-04-03T08:39:07.008 INFO:tasks.workunit.client.1.smithi181.stdout:1/31: creat fc x:0 0 0 2024-04-03T08:39:07.011 INFO:tasks.workunit.client.1.smithi181.stdout:1/32: write f4 [2391672,102328] 0 2024-04-03T08:39:07.012 INFO:tasks.workunit.client.1.smithi181.stdout:1/33: stat l7 0 2024-04-03T08:39:07.013 INFO:tasks.workunit.client.0.smithi157.stdout:5/243: symlink dc/d34/d18/d21/l4e 0 2024-04-03T08:39:07.018 INFO:tasks.workunit.client.1.smithi181.stdout:8/25: write f3 [2842901,1160] 0 2024-04-03T08:39:07.020 INFO:tasks.workunit.client.1.smithi181.stdout:8/26: chown f3 90 1 2024-04-03T08:39:07.024 INFO:tasks.workunit.client.1.smithi181.stdout:2/79: mkdir d13/d22 0 2024-04-03T08:39:07.024 INFO:tasks.workunit.client.0.smithi157.stdout:4/262: creat da/df/f57 x:0 0 0 2024-04-03T08:39:07.030 INFO:tasks.workunit.client.0.smithi157.stdout:1/211: dwrite d2/d11/d24/f1f [4194304,4194304] 0 2024-04-03T08:39:07.032 INFO:tasks.workunit.client.1.smithi181.stdout:7/39: mknod d0/d1/d6/cb 0 2024-04-03T08:39:07.032 INFO:tasks.workunit.client.1.smithi181.stdout:9/151: write d1/f5 [3928579,11204] 0 2024-04-03T08:39:07.034 INFO:tasks.workunit.client.1.smithi181.stdout:4/77: dwrite d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:07.034 INFO:tasks.workunit.client.1.smithi181.stdout:6/48: dread d6/d7/d9/fa [0,4194304] 0 2024-04-03T08:39:07.035 INFO:tasks.workunit.client.0.smithi157.stdout:4/263: fdatasync da/df/d11/f46 0 2024-04-03T08:39:07.039 INFO:tasks.workunit.client.0.smithi157.stdout:0/259: creat d2/d9/dc/df/f60 x:0 0 0 2024-04-03T08:39:07.039 INFO:tasks.workunit.client.1.smithi181.stdout:9/152: chown d1/f20 5494 1 2024-04-03T08:39:07.042 INFO:tasks.workunit.client.1.smithi181.stdout:0/69: creat d5/d9/d13/f15 x:0 0 0 2024-04-03T08:39:07.042 INFO:tasks.workunit.client.1.smithi181.stdout:5/98: dwrite d4/f16 [0,4194304] 0 2024-04-03T08:39:07.045 INFO:tasks.workunit.client.0.smithi157.stdout:7/256: dwrite d0/d11/d15/d1b/f39 [0,4194304] 0 2024-04-03T08:39:07.045 INFO:tasks.workunit.client.0.smithi157.stdout:5/244: dwrite dc/f4b [4194304,4194304] 0 2024-04-03T08:39:07.047 INFO:tasks.workunit.client.1.smithi181.stdout:5/99: chown f1 24 1 2024-04-03T08:39:07.053 INFO:tasks.workunit.client.0.smithi157.stdout:5/245: write dc/f4b [8059629,66477] 0 2024-04-03T08:39:07.054 INFO:tasks.workunit.client.1.smithi181.stdout:8/27: mkdir d4 0 2024-04-03T08:39:07.056 INFO:tasks.workunit.client.0.smithi157.stdout:4/264: mkdir da/df/d24/d58 0 2024-04-03T08:39:07.056 INFO:tasks.workunit.client.0.smithi157.stdout:1/212: creat d2/f45 x:0 0 0 2024-04-03T08:39:07.059 INFO:tasks.workunit.client.0.smithi157.stdout:9/211: rename d1/fc to d1/f42 0 2024-04-03T08:39:07.060 INFO:tasks.workunit.client.0.smithi157.stdout:4/265: dread - da/d26/f4a zero size 2024-04-03T08:39:07.061 INFO:tasks.workunit.client.0.smithi157.stdout:6/260: fdatasync d1/fc 0 2024-04-03T08:39:07.062 INFO:tasks.workunit.client.0.smithi157.stdout:0/260: creat d2/d9/d51/f61 x:0 0 0 2024-04-03T08:39:07.063 INFO:tasks.workunit.client.1.smithi181.stdout:3/24: link d0/f3 d0/f4 0 2024-04-03T08:39:07.065 INFO:tasks.workunit.client.1.smithi181.stdout:7/40: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:07.066 INFO:tasks.workunit.client.0.smithi157.stdout:1/213: rename d2/d11 to d2/d11/d46 22 2024-04-03T08:39:07.066 INFO:tasks.workunit.client.1.smithi181.stdout:7/41: stat d0/l5 0 2024-04-03T08:39:07.069 INFO:tasks.workunit.client.0.smithi157.stdout:7/257: unlink d0/d4/f13 0 2024-04-03T08:39:07.070 INFO:tasks.workunit.client.0.smithi157.stdout:6/261: read d1/d5/f46 [529972,114856] 0 2024-04-03T08:39:07.072 INFO:tasks.workunit.client.1.smithi181.stdout:4/78: dwrite d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:07.074 INFO:tasks.workunit.client.0.smithi157.stdout:9/212: creat d1/d15/f43 x:0 0 0 2024-04-03T08:39:07.076 INFO:tasks.workunit.client.0.smithi157.stdout:5/246: dread fa [0,4194304] 0 2024-04-03T08:39:07.076 INFO:tasks.workunit.client.1.smithi181.stdout:6/49: write d6/d7/d9/fa [4473965,129393] 0 2024-04-03T08:39:07.082 INFO:tasks.workunit.client.0.smithi157.stdout:4/266: rename da/df/d24/d35/f43 to da/df/d24/f59 0 2024-04-03T08:39:07.084 INFO:tasks.workunit.client.1.smithi181.stdout:5/100: rmdir d4/d18/d25 39 2024-04-03T08:39:07.084 INFO:tasks.workunit.client.0.smithi157.stdout:2/301: sync 2024-04-03T08:39:07.089 INFO:tasks.workunit.client.0.smithi157.stdout:2/302: chown d3/d12/c14 114133 1 2024-04-03T08:39:07.093 INFO:tasks.workunit.client.0.smithi157.stdout:2/303: truncate d3/f4e 727893 0 2024-04-03T08:39:07.093 INFO:tasks.workunit.client.0.smithi157.stdout:0/261: dread d2/f1d [0,4194304] 0 2024-04-03T08:39:07.099 INFO:tasks.workunit.client.0.smithi157.stdout:1/214: rename d2/d11/d24/d39/d3b/l10 to d2/d11/l47 0 2024-04-03T08:39:07.102 INFO:tasks.workunit.client.1.smithi181.stdout:6/50: dwrite d6/d7/d9/fa [0,4194304] 0 2024-04-03T08:39:07.104 INFO:tasks.workunit.client.0.smithi157.stdout:7/258: creat d0/d4/d36/d5b/f63 x:0 0 0 2024-04-03T08:39:07.104 INFO:tasks.workunit.client.1.smithi181.stdout:6/51: stat c3 0 2024-04-03T08:39:07.104 INFO:tasks.workunit.client.1.smithi181.stdout:3/25: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:07.105 INFO:tasks.workunit.client.1.smithi181.stdout:6/52: read - d6/d7/fb zero size 2024-04-03T08:39:07.106 INFO:tasks.workunit.client.0.smithi157.stdout:0/262: chown d2/l55 56508 1 2024-04-03T08:39:07.107 INFO:tasks.workunit.client.1.smithi181.stdout:4/79: read - d1/d15/f1a zero size 2024-04-03T08:39:07.116 INFO:tasks.workunit.client.0.smithi157.stdout:0/263: read d2/fa [355151,81686] 0 2024-04-03T08:39:07.116 INFO:tasks.workunit.client.0.smithi157.stdout:5/247: rmdir dc/d34/d18/d2b 0 2024-04-03T08:39:07.116 INFO:tasks.workunit.client.0.smithi157.stdout:4/267: dread da/d26/f2e [0,4194304] 0 2024-04-03T08:39:07.117 INFO:tasks.workunit.client.0.smithi157.stdout:7/259: dread d0/d5/f3a [0,4194304] 0 2024-04-03T08:39:07.117 INFO:tasks.workunit.client.1.smithi181.stdout:8/28: getdents d4 0 2024-04-03T08:39:07.117 INFO:tasks.workunit.client.1.smithi181.stdout:9/153: write d1/f20 [1932878,31252] 0 2024-04-03T08:39:07.118 INFO:tasks.workunit.client.1.smithi181.stdout:8/29: chown d4 245828 1 2024-04-03T08:39:07.120 INFO:tasks.workunit.client.0.smithi157.stdout:5/248: read dc/fd [1096356,46744] 0 2024-04-03T08:39:07.123 INFO:tasks.workunit.client.0.smithi157.stdout:5/249: read fa [2907213,129256] 0 2024-04-03T08:39:07.123 INFO:tasks.workunit.client.1.smithi181.stdout:1/34: truncate f2 3739075 0 2024-04-03T08:39:07.127 INFO:tasks.workunit.client.1.smithi181.stdout:5/101: dread d4/d18/d25/f19 [0,4194304] 0 2024-04-03T08:39:07.128 INFO:tasks.workunit.client.0.smithi157.stdout:9/213: readlink d1/d15/d27/d34/l3e 0 2024-04-03T08:39:07.129 INFO:tasks.workunit.client.1.smithi181.stdout:3/26: mkdir d0/d5 0 2024-04-03T08:39:07.131 INFO:tasks.workunit.client.0.smithi157.stdout:5/250: fsync fa 0 2024-04-03T08:39:07.131 INFO:tasks.workunit.client.1.smithi181.stdout:6/53: mkdir d6/df 0 2024-04-03T08:39:07.135 INFO:tasks.workunit.client.0.smithi157.stdout:0/264: dread d2/f1d [0,4194304] 0 2024-04-03T08:39:07.136 INFO:tasks.workunit.client.1.smithi181.stdout:6/54: dread d6/d7/d9/fe [4194304,4194304] 0 2024-04-03T08:39:07.143 INFO:tasks.workunit.client.0.smithi157.stdout:7/260: dwrite d0/d5/f3a [0,4194304] 0 2024-04-03T08:39:07.147 INFO:tasks.workunit.client.1.smithi181.stdout:1/35: unlink c6 0 2024-04-03T08:39:07.148 INFO:tasks.workunit.client.1.smithi181.stdout:1/36: readlink l5 0 2024-04-03T08:39:07.149 INFO:tasks.workunit.client.0.smithi157.stdout:7/261: fsync d0/d5/f3e 0 2024-04-03T08:39:07.151 INFO:tasks.workunit.client.1.smithi181.stdout:0/70: getdents d5/d9 0 2024-04-03T08:39:07.151 INFO:tasks.workunit.client.1.smithi181.stdout:1/37: dread - f9 zero size 2024-04-03T08:39:07.155 INFO:tasks.workunit.client.1.smithi181.stdout:5/102: fsync d4/f13 0 2024-04-03T08:39:07.157 INFO:tasks.workunit.client.0.smithi157.stdout:6/262: dwrite d1/ff [0,4194304] 0 2024-04-03T08:39:07.158 INFO:tasks.workunit.client.0.smithi157.stdout:4/268: dread da/df/d2f/f4f [0,4194304] 0 2024-04-03T08:39:07.160 INFO:tasks.workunit.client.0.smithi157.stdout:0/265: rename d2/f22 to d2/d9/dc/df/d1b/d35/d3d/f62 0 2024-04-03T08:39:07.163 INFO:tasks.workunit.client.0.smithi157.stdout:1/215: dwrite d2/d11/d24/d39/d3b/fe [0,4194304] 0 2024-04-03T08:39:07.166 INFO:tasks.workunit.client.0.smithi157.stdout:0/266: fdatasync d2/d9/d51/f61 0 2024-04-03T08:39:07.166 INFO:tasks.workunit.client.0.smithi157.stdout:5/251: dwrite dc/d34/f27 [0,4194304] 0 2024-04-03T08:39:07.167 INFO:tasks.workunit.client.1.smithi181.stdout:7/42: getdents d0 0 2024-04-03T08:39:07.169 INFO:tasks.workunit.client.0.smithi157.stdout:9/214: link d1/d36/l37 d1/l44 0 2024-04-03T08:39:07.170 INFO:tasks.workunit.client.0.smithi157.stdout:4/269: chown da/df/d11/c1c 353621695 1 2024-04-03T08:39:07.171 INFO:tasks.workunit.client.1.smithi181.stdout:8/30: creat d4/f5 x:0 0 0 2024-04-03T08:39:07.173 INFO:tasks.workunit.client.0.smithi157.stdout:0/267: mkdir d2/d9/d51/d63 0 2024-04-03T08:39:07.174 INFO:tasks.workunit.client.0.smithi157.stdout:1/216: mkdir d2/d11/d24/d39/d3b/d2e/d48 0 2024-04-03T08:39:07.177 INFO:tasks.workunit.client.1.smithi181.stdout:2/80: dwrite f12 [0,4194304] 0 2024-04-03T08:39:07.177 INFO:tasks.workunit.client.1.smithi181.stdout:9/154: dwrite d1/da/d1a/f1f [0,4194304] 0 2024-04-03T08:39:07.181 INFO:tasks.workunit.client.0.smithi157.stdout:9/215: chown d1/c25 1571 1 2024-04-03T08:39:07.182 INFO:tasks.workunit.client.1.smithi181.stdout:1/38: unlink l5 0 2024-04-03T08:39:07.186 INFO:tasks.workunit.client.0.smithi157.stdout:5/252: mknod dc/d35/c4f 0 2024-04-03T08:39:07.190 INFO:tasks.workunit.client.1.smithi181.stdout:4/80: truncate d1/d16/f17 1702642 0 2024-04-03T08:39:07.190 INFO:tasks.workunit.client.0.smithi157.stdout:4/270: dread da/df/d2f/f38 [0,4194304] 0 2024-04-03T08:39:07.192 INFO:tasks.workunit.client.0.smithi157.stdout:0/268: write d2/d9/dc/df/d1b/f34 [3675220,102274] 0 2024-04-03T08:39:07.195 INFO:tasks.workunit.client.0.smithi157.stdout:1/217: creat d2/f49 x:0 0 0 2024-04-03T08:39:07.196 INFO:tasks.workunit.client.0.smithi157.stdout:7/262: dwrite d0/d4/f2d [0,4194304] 0 2024-04-03T08:39:07.196 INFO:tasks.workunit.client.1.smithi181.stdout:7/43: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:07.198 INFO:tasks.workunit.client.1.smithi181.stdout:3/27: dwrite d0/f4 [0,4194304] 0 2024-04-03T08:39:07.199 INFO:tasks.workunit.client.0.smithi157.stdout:7/263: chown d0/d11/l12 369 1 2024-04-03T08:39:07.201 INFO:tasks.workunit.client.1.smithi181.stdout:8/31: mkdir d4/d6 0 2024-04-03T08:39:07.210 INFO:tasks.workunit.client.0.smithi157.stdout:5/253: mkdir dc/d34/d18/d50 0 2024-04-03T08:39:07.210 INFO:tasks.workunit.client.0.smithi157.stdout:9/216: write d1/f5 [1833899,13730] 0 2024-04-03T08:39:07.212 INFO:tasks.workunit.client.1.smithi181.stdout:9/155: unlink d1/da/c14 0 2024-04-03T08:39:07.214 INFO:tasks.workunit.client.1.smithi181.stdout:2/81: write f10 [366375,4862] 0 2024-04-03T08:39:07.218 INFO:tasks.workunit.client.0.smithi157.stdout:0/269: symlink d2/d9/dc/l64 0 2024-04-03T08:39:07.218 INFO:tasks.workunit.client.1.smithi181.stdout:9/156: stat d1/da/d1a/f1f 0 2024-04-03T08:39:07.219 INFO:tasks.workunit.client.1.smithi181.stdout:1/39: mknod cd 0 2024-04-03T08:39:07.225 INFO:tasks.workunit.client.1.smithi181.stdout:7/44: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:07.225 INFO:tasks.workunit.client.0.smithi157.stdout:4/271: rename da/df/d24/f50 to da/df/d2f/d54/f5a 0 2024-04-03T08:39:07.228 INFO:tasks.workunit.client.0.smithi157.stdout:4/272: chown da/f31 27023 1 2024-04-03T08:39:07.228 INFO:tasks.workunit.client.1.smithi181.stdout:5/103: creat d4/d22/f26 x:0 0 0 2024-04-03T08:39:07.230 INFO:tasks.workunit.client.0.smithi157.stdout:6/263: getdents d1/d5/d17 0 2024-04-03T08:39:07.232 INFO:tasks.workunit.client.0.smithi157.stdout:8/244: sync 2024-04-03T08:39:07.232 INFO:tasks.workunit.client.0.smithi157.stdout:6/264: write d1/d4b/d38/f4c [7955133,102969] 0 2024-04-03T08:39:07.233 INFO:tasks.workunit.client.0.smithi157.stdout:6/265: fsync d1/ff 0 2024-04-03T08:39:07.234 INFO:tasks.workunit.client.1.smithi181.stdout:8/32: dwrite f3 [0,4194304] 0 2024-04-03T08:39:07.235 INFO:tasks.workunit.client.0.smithi157.stdout:6/266: write d1/f48 [8713821,93268] 0 2024-04-03T08:39:07.237 INFO:tasks.workunit.client.0.smithi157.stdout:0/270: symlink d2/d9/dc/df/d1b/l65 0 2024-04-03T08:39:07.237 INFO:tasks.workunit.client.1.smithi181.stdout:2/82: dread f10 [0,4194304] 0 2024-04-03T08:39:07.242 INFO:tasks.workunit.client.1.smithi181.stdout:8/33: write d4/f5 [62615,72940] 0 2024-04-03T08:39:07.243 INFO:tasks.workunit.client.1.smithi181.stdout:1/40: symlink le 0 2024-04-03T08:39:07.243 INFO:tasks.workunit.client.0.smithi157.stdout:1/218: dread d2/f3 [0,4194304] 0 2024-04-03T08:39:07.246 INFO:tasks.workunit.client.0.smithi157.stdout:9/217: dread d1/d15/f1a [0,4194304] 0 2024-04-03T08:39:07.246 INFO:tasks.workunit.client.1.smithi181.stdout:0/71: link d5/l6 d5/dc/d14/l16 0 2024-04-03T08:39:07.247 INFO:tasks.workunit.client.1.smithi181.stdout:9/157: mkdir d1/d34/d39 0 2024-04-03T08:39:07.251 INFO:tasks.workunit.client.1.smithi181.stdout:9/158: stat d1/da/d13/d22/f2e 0 2024-04-03T08:39:07.253 INFO:tasks.workunit.client.1.smithi181.stdout:7/45: symlink d0/d1/lc 0 2024-04-03T08:39:07.254 INFO:tasks.workunit.client.1.smithi181.stdout:7/46: stat d0/d1/d6 0 2024-04-03T08:39:07.256 INFO:tasks.workunit.client.1.smithi181.stdout:3/28: mkdir d0/d5/d6 0 2024-04-03T08:39:07.256 INFO:tasks.workunit.client.1.smithi181.stdout:9/159: write d1/f5 [5565799,34392] 0 2024-04-03T08:39:07.257 INFO:tasks.workunit.client.1.smithi181.stdout:5/104: dread d4/f8 [0,4194304] 0 2024-04-03T08:39:07.258 INFO:tasks.workunit.client.1.smithi181.stdout:7/47: write d0/d1/d6/f9 [1047602,48072] 0 2024-04-03T08:39:07.259 INFO:tasks.workunit.client.1.smithi181.stdout:5/105: chown d4/d18/c1b 1593006 1 2024-04-03T08:39:07.261 INFO:tasks.workunit.client.1.smithi181.stdout:7/48: chown d0/d1/lc 204587 1 2024-04-03T08:39:07.262 INFO:tasks.workunit.client.1.smithi181.stdout:7/49: stat d0/l5 0 2024-04-03T08:39:07.262 INFO:tasks.workunit.client.0.smithi157.stdout:6/267: creat d1/d5/d17/f56 x:0 0 0 2024-04-03T08:39:07.262 INFO:tasks.workunit.client.0.smithi157.stdout:7/264: dread d0/d5/f3e [0,4194304] 0 2024-04-03T08:39:07.263 INFO:tasks.workunit.client.0.smithi157.stdout:4/273: dwrite da/df/d2f/f38 [0,4194304] 0 2024-04-03T08:39:07.264 INFO:tasks.workunit.client.0.smithi157.stdout:0/271: rename d2/d9/dc/df/d1b/f4b to d2/d9/dc/df/d1b/d35/f66 0 2024-04-03T08:39:07.265 INFO:tasks.workunit.client.1.smithi181.stdout:0/72: symlink d5/dc/l17 0 2024-04-03T08:39:07.265 INFO:tasks.workunit.client.0.smithi157.stdout:4/274: chown da/f1e 75 1 2024-04-03T08:39:07.266 INFO:tasks.workunit.client.0.smithi157.stdout:0/272: dread - d2/d9/d51/f52 zero size 2024-04-03T08:39:07.268 INFO:tasks.workunit.client.1.smithi181.stdout:4/81: link d1/c9 d1/d15/c1d 0 2024-04-03T08:39:07.270 INFO:tasks.workunit.client.1.smithi181.stdout:3/29: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:07.270 INFO:tasks.workunit.client.0.smithi157.stdout:9/218: rename d1/d15/d27/f35 to d1/d15/d27/f45 0 2024-04-03T08:39:07.271 INFO:tasks.workunit.client.1.smithi181.stdout:3/30: write d0/f3 [185305,28194] 0 2024-04-03T08:39:07.276 INFO:tasks.workunit.client.0.smithi157.stdout:8/245: mknod d2/d11/d10/c55 0 2024-04-03T08:39:07.281 INFO:tasks.workunit.client.0.smithi157.stdout:7/265: dwrite d0/d11/d15/d17/d52/f5a [0,4194304] 0 2024-04-03T08:39:07.282 INFO:tasks.workunit.client.1.smithi181.stdout:2/83: link f12 d13/f23 0 2024-04-03T08:39:07.285 INFO:tasks.workunit.client.0.smithi157.stdout:7/266: chown d0/d11/d15/d1b/f59 1 1 2024-04-03T08:39:07.286 INFO:tasks.workunit.client.0.smithi157.stdout:3/228: sync 2024-04-03T08:39:07.286 INFO:tasks.workunit.client.0.smithi157.stdout:6/268: readlink d1/l15 0 2024-04-03T08:39:07.287 INFO:tasks.workunit.client.1.smithi181.stdout:8/34: creat d4/d6/f7 x:0 0 0 2024-04-03T08:39:07.288 INFO:tasks.workunit.client.0.smithi157.stdout:6/269: stat d1/d5/d1b/d2c/c44 0 2024-04-03T08:39:07.288 INFO:tasks.workunit.client.0.smithi157.stdout:7/267: write d0/d4/d36/f3d [3978965,50715] 0 2024-04-03T08:39:07.292 INFO:tasks.workunit.client.1.smithi181.stdout:7/50: creat d0/d1/d6/fd x:0 0 0 2024-04-03T08:39:07.292 INFO:tasks.workunit.client.0.smithi157.stdout:7/268: fsync d0/d11/d15/f4d 0 2024-04-03T08:39:07.293 INFO:tasks.workunit.client.0.smithi157.stdout:4/275: write da/df/d24/f59 [516872,4244] 0 2024-04-03T08:39:07.295 INFO:tasks.workunit.client.1.smithi181.stdout:0/73: rename d5/f8 to d5/dc/f18 0 2024-04-03T08:39:07.297 INFO:tasks.workunit.client.0.smithi157.stdout:1/219: unlink d2/d11/l47 0 2024-04-03T08:39:07.302 INFO:tasks.workunit.client.1.smithi181.stdout:3/31: creat d0/f7 x:0 0 0 2024-04-03T08:39:07.303 INFO:tasks.workunit.client.0.smithi157.stdout:5/254: getdents dc/d29 0 2024-04-03T08:39:07.305 INFO:tasks.workunit.client.0.smithi157.stdout:9/219: mkdir d1/d36/d46 0 2024-04-03T08:39:07.305 INFO:tasks.workunit.client.0.smithi157.stdout:6/270: dwrite d1/d22/f2e [0,4194304] 0 2024-04-03T08:39:07.308 INFO:tasks.workunit.client.1.smithi181.stdout:9/160: fsync d1/f6 0 2024-04-03T08:39:07.311 INFO:tasks.workunit.client.0.smithi157.stdout:8/246: chown d2/d11/d10/d12/c13 65405 1 2024-04-03T08:39:07.318 INFO:tasks.workunit.client.1.smithi181.stdout:7/51: dwrite d0/d1/d6/f9 [0,4194304] 0 2024-04-03T08:39:07.324 INFO:tasks.workunit.client.1.smithi181.stdout:3/32: mknod d0/c8 0 2024-04-03T08:39:07.327 INFO:tasks.workunit.client.0.smithi157.stdout:1/220: creat d2/d11/d24/d39/f4a x:0 0 0 2024-04-03T08:39:07.329 INFO:tasks.workunit.client.0.smithi157.stdout:1/221: fsync d2/d11/d24/d39/d3b/f9 0 2024-04-03T08:39:07.330 INFO:tasks.workunit.client.0.smithi157.stdout:0/273: mkdir d2/d9/d36/d38/d67 0 2024-04-03T08:39:07.332 INFO:tasks.workunit.client.1.smithi181.stdout:2/84: write f3 [294184,123428] 0 2024-04-03T08:39:07.333 INFO:tasks.workunit.client.0.smithi157.stdout:5/255: mkdir dc/d29/d51 0 2024-04-03T08:39:07.335 INFO:tasks.workunit.client.1.smithi181.stdout:8/35: link d4/d6/f7 d4/d6/f8 0 2024-04-03T08:39:07.335 INFO:tasks.workunit.client.1.smithi181.stdout:6/55: sync 2024-04-03T08:39:07.337 INFO:tasks.workunit.client.1.smithi181.stdout:2/85: chown f3 2954 1 2024-04-03T08:39:07.338 INFO:tasks.workunit.client.0.smithi157.stdout:9/220: creat d1/d15/d27/f47 x:0 0 0 2024-04-03T08:39:07.339 INFO:tasks.workunit.client.1.smithi181.stdout:0/74: creat d5/dc/d14/f19 x:0 0 0 2024-04-03T08:39:07.340 INFO:tasks.workunit.client.1.smithi181.stdout:2/86: read d13/f23 [3472308,68647] 0 2024-04-03T08:39:07.341 INFO:tasks.workunit.client.1.smithi181.stdout:7/52: dwrite d0/d1/d6/fd [0,4194304] 0 2024-04-03T08:39:07.341 INFO:tasks.workunit.client.0.smithi157.stdout:2/304: sync 2024-04-03T08:39:07.342 INFO:tasks.workunit.client.1.smithi181.stdout:2/87: chown d13/d22 19497068 1 2024-04-03T08:39:07.344 INFO:tasks.workunit.client.1.smithi181.stdout:3/33: write d0/f3 [691726,79392] 0 2024-04-03T08:39:07.345 INFO:tasks.workunit.client.1.smithi181.stdout:0/75: readlink d5/dc/l17 0 2024-04-03T08:39:07.345 INFO:tasks.workunit.client.0.smithi157.stdout:9/221: write d1/d15/d27/f39 [1160369,72532] 0 2024-04-03T08:39:07.346 INFO:tasks.workunit.client.1.smithi181.stdout:5/106: getdents d4/d22 0 2024-04-03T08:39:07.348 INFO:tasks.workunit.client.0.smithi157.stdout:4/276: creat da/df/d24/d58/f5b x:0 0 0 2024-04-03T08:39:07.351 INFO:tasks.workunit.client.0.smithi157.stdout:4/277: chown da/d26 196756719 1 2024-04-03T08:39:07.352 INFO:tasks.workunit.client.0.smithi157.stdout:3/229: truncate d8/d13/f36 2116711 0 2024-04-03T08:39:07.354 INFO:tasks.workunit.client.0.smithi157.stdout:9/222: rename d1/d15/d27 to d1/d15/d27/d34/d48 22 2024-04-03T08:39:07.355 INFO:tasks.workunit.client.0.smithi157.stdout:3/230: chown d8/d13/d3d 21395 1 2024-04-03T08:39:07.357 INFO:tasks.workunit.client.0.smithi157.stdout:7/269: truncate d0/d4/d36/f3d 2155761 0 2024-04-03T08:39:07.358 INFO:tasks.workunit.client.0.smithi157.stdout:0/274: dwrite d2/d9/d36/f3f [0,4194304] 0 2024-04-03T08:39:07.359 INFO:tasks.workunit.client.1.smithi181.stdout:8/36: mkdir d4/d6/d9 0 2024-04-03T08:39:07.359 INFO:tasks.workunit.client.0.smithi157.stdout:4/278: chown da/df/d24/d58/f5b 630 1 2024-04-03T08:39:07.360 INFO:tasks.workunit.client.0.smithi157.stdout:1/222: dwrite d2/f3 [4194304,4194304] 0 2024-04-03T08:39:07.361 INFO:tasks.workunit.client.1.smithi181.stdout:4/82: dwrite d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:07.367 INFO:tasks.workunit.client.0.smithi157.stdout:5/256: mkdir dc/d34/d52 0 2024-04-03T08:39:07.374 INFO:tasks.workunit.client.1.smithi181.stdout:6/56: rename c3 to d6/d7/c10 0 2024-04-03T08:39:07.377 INFO:tasks.workunit.client.0.smithi157.stdout:8/247: mkdir d2/d11/d10/d12/d2e/d56 0 2024-04-03T08:39:07.381 INFO:tasks.workunit.client.1.smithi181.stdout:7/53: mkdir d0/d1/d6/de 0 2024-04-03T08:39:07.383 INFO:tasks.workunit.client.1.smithi181.stdout:3/34: creat d0/f9 x:0 0 0 2024-04-03T08:39:07.384 INFO:tasks.workunit.client.1.smithi181.stdout:3/35: fdatasync d0/f3 0 2024-04-03T08:39:07.385 INFO:tasks.workunit.client.0.smithi157.stdout:9/223: unlink d1/fd 0 2024-04-03T08:39:07.386 INFO:tasks.workunit.client.1.smithi181.stdout:3/36: write d0/f3 [3591629,70806] 0 2024-04-03T08:39:07.386 INFO:tasks.workunit.client.0.smithi157.stdout:3/231: rmdir d8/d1e/d2d/d3b 39 2024-04-03T08:39:07.386 INFO:tasks.workunit.client.1.smithi181.stdout:3/37: read - d0/f9 zero size 2024-04-03T08:39:07.389 INFO:tasks.workunit.client.0.smithi157.stdout:3/232: write d8/f11 [5235667,31917] 0 2024-04-03T08:39:07.390 INFO:tasks.workunit.client.0.smithi157.stdout:5/257: dwrite dc/d29/f38 [0,4194304] 0 2024-04-03T08:39:07.395 INFO:tasks.workunit.client.1.smithi181.stdout:4/83: rename d1/d15 to d1/d1e 0 2024-04-03T08:39:07.396 INFO:tasks.workunit.client.0.smithi157.stdout:4/279: rename da/df/d24/d35/f41 to da/df/d24/f5c 0 2024-04-03T08:39:07.396 INFO:tasks.workunit.client.1.smithi181.stdout:6/57: truncate d6/d7/d9/fe 1049314 0 2024-04-03T08:39:07.397 INFO:tasks.workunit.client.1.smithi181.stdout:2/88: symlink d13/d1d/l24 0 2024-04-03T08:39:07.406 INFO:tasks.workunit.client.0.smithi157.stdout:3/233: dread d8/d13/d23/d32/f42 [0,4194304] 0 2024-04-03T08:39:07.410 INFO:tasks.workunit.client.1.smithi181.stdout:4/84: rmdir d1/d16 39 2024-04-03T08:39:07.410 INFO:tasks.workunit.client.0.smithi157.stdout:9/224: read d1/d15/f2d [585181,31731] 0 2024-04-03T08:39:07.411 INFO:tasks.workunit.client.1.smithi181.stdout:8/37: write d4/d6/f7 [765049,90455] 0 2024-04-03T08:39:07.412 INFO:tasks.workunit.client.0.smithi157.stdout:9/225: read - d1/d15/d27/f45 zero size 2024-04-03T08:39:07.415 INFO:tasks.workunit.client.1.smithi181.stdout:6/58: symlink d6/d7/d9/l11 0 2024-04-03T08:39:07.418 INFO:tasks.workunit.client.1.smithi181.stdout:7/54: symlink d0/d1/d6/de/lf 0 2024-04-03T08:39:07.419 INFO:tasks.workunit.client.0.smithi157.stdout:7/270: dwrite d0/d11/f21 [0,4194304] 0 2024-04-03T08:39:07.419 INFO:tasks.workunit.client.1.smithi181.stdout:6/59: chown d6/df 60 1 2024-04-03T08:39:07.420 INFO:tasks.workunit.client.0.smithi157.stdout:2/305: truncate d3/f21 2361548 0 2024-04-03T08:39:07.421 INFO:tasks.workunit.client.0.smithi157.stdout:7/271: dread - d0/d11/d15/d1b/f57 zero size 2024-04-03T08:39:07.423 INFO:tasks.workunit.client.1.smithi181.stdout:2/89: dwrite d13/f1e [0,4194304] 0 2024-04-03T08:39:07.424 INFO:tasks.workunit.client.1.smithi181.stdout:3/38: rename d0/f9 to d0/d5/fa 0 2024-04-03T08:39:07.424 INFO:tasks.workunit.client.1.smithi181.stdout:5/107: dwrite d4/ff [0,4194304] 0 2024-04-03T08:39:07.426 INFO:tasks.workunit.client.1.smithi181.stdout:0/76: truncate f2 5369942 0 2024-04-03T08:39:07.431 INFO:tasks.workunit.client.1.smithi181.stdout:3/39: read - d0/d5/fa zero size 2024-04-03T08:39:07.435 INFO:tasks.workunit.client.1.smithi181.stdout:7/55: symlink d0/l10 0 2024-04-03T08:39:07.439 INFO:tasks.workunit.client.1.smithi181.stdout:7/56: rename d0 to d0/d11 22 2024-04-03T08:39:07.440 INFO:tasks.workunit.client.1.smithi181.stdout:8/38: dwrite f3 [4194304,4194304] 0 2024-04-03T08:39:07.442 INFO:tasks.workunit.client.1.smithi181.stdout:2/90: creat d13/f25 x:0 0 0 2024-04-03T08:39:07.442 INFO:tasks.workunit.client.1.smithi181.stdout:7/57: fdatasync d0/d1/d6/f9 0 2024-04-03T08:39:07.444 INFO:tasks.workunit.client.0.smithi157.stdout:5/258: mkdir dc/d34/d49/d53 0 2024-04-03T08:39:07.448 INFO:tasks.workunit.client.1.smithi181.stdout:2/91: read ff [162236,101112] 0 2024-04-03T08:39:07.449 INFO:tasks.workunit.client.1.smithi181.stdout:4/85: write d1/fb [1452832,75103] 0 2024-04-03T08:39:07.449 INFO:tasks.workunit.client.0.smithi157.stdout:2/306: creat d3/d12/f68 x:0 0 0 2024-04-03T08:39:07.449 INFO:tasks.workunit.client.0.smithi157.stdout:5/259: write dc/d29/f46 [888095,29749] 0 2024-04-03T08:39:07.452 INFO:tasks.workunit.client.1.smithi181.stdout:5/108: rename d4/d18/d25/l21 to d4/d18/d25/l27 0 2024-04-03T08:39:07.452 INFO:tasks.workunit.client.0.smithi157.stdout:2/307: chown d3/d12/d43 8994 1 2024-04-03T08:39:07.457 INFO:tasks.workunit.client.0.smithi157.stdout:5/260: read dc/f1f [4192936,45120] 0 2024-04-03T08:39:07.457 INFO:tasks.workunit.client.0.smithi157.stdout:7/272: dwrite d0/d11/d15/d17/f5e [0,4194304] 0 2024-04-03T08:39:07.457 INFO:tasks.workunit.client.0.smithi157.stdout:8/248: link d2/c18 d2/d20/c57 0 2024-04-03T08:39:07.458 INFO:tasks.workunit.client.1.smithi181.stdout:8/39: symlink d4/la 0 2024-04-03T08:39:07.459 INFO:tasks.workunit.client.0.smithi157.stdout:3/234: symlink d8/d1e/l49 0 2024-04-03T08:39:07.459 INFO:tasks.workunit.client.1.smithi181.stdout:7/58: mknod d0/c12 0 2024-04-03T08:39:07.462 INFO:tasks.workunit.client.1.smithi181.stdout:8/40: fdatasync d4/d6/f8 0 2024-04-03T08:39:07.464 INFO:tasks.workunit.client.0.smithi157.stdout:2/308: write d3/d12/f68 [857232,110466] 0 2024-04-03T08:39:07.468 INFO:tasks.workunit.client.0.smithi157.stdout:2/309: readlink d3/d12/l30 0 2024-04-03T08:39:07.469 INFO:tasks.workunit.client.1.smithi181.stdout:7/59: fsync d0/d1/d6/f9 0 2024-04-03T08:39:07.470 INFO:tasks.workunit.client.0.smithi157.stdout:0/275: rename d2/d9/dc/df/d1b/c2d to d2/d9/c68 0 2024-04-03T08:39:07.470 INFO:tasks.workunit.client.1.smithi181.stdout:2/92: mknod d13/c26 0 2024-04-03T08:39:07.474 INFO:tasks.workunit.client.0.smithi157.stdout:2/310: write d3/d12/d43/f50 [724682,34849] 0 2024-04-03T08:39:07.474 INFO:tasks.workunit.client.0.smithi157.stdout:4/280: rmdir da/df/d24/d35/d3c/d51 0 2024-04-03T08:39:07.474 INFO:tasks.workunit.client.0.smithi157.stdout:2/311: fdatasync d3/db/f33 0 2024-04-03T08:39:07.475 INFO:tasks.workunit.client.1.smithi181.stdout:3/40: dwrite d0/f7 [0,4194304] 0 2024-04-03T08:39:07.475 INFO:tasks.workunit.client.1.smithi181.stdout:5/109: read d4/f13 [3600056,82977] 0 2024-04-03T08:39:07.475 INFO:tasks.workunit.client.0.smithi157.stdout:7/273: symlink d0/d4/l64 0 2024-04-03T08:39:07.475 INFO:tasks.workunit.client.0.smithi157.stdout:4/281: dread - da/df/d24/d35/d3c/f4d zero size 2024-04-03T08:39:07.478 INFO:tasks.workunit.client.1.smithi181.stdout:5/110: chown d4/f12 113899 1 2024-04-03T08:39:07.479 INFO:tasks.workunit.client.0.smithi157.stdout:7/274: truncate d0/d11/d15/d17/d1c/f37 951543 0 2024-04-03T08:39:07.479 INFO:tasks.workunit.client.1.smithi181.stdout:4/86: mkdir d1/d16/d1f 0 2024-04-03T08:39:07.479 INFO:tasks.workunit.client.0.smithi157.stdout:6/271: rename d1/d5/d17/d2a/d40/f52 to d1/d4b/f57 0 2024-04-03T08:39:07.483 INFO:tasks.workunit.client.0.smithi157.stdout:0/276: mknod d2/d9/dc/df/d1b/d4a/d3b/c69 0 2024-04-03T08:39:07.484 INFO:tasks.workunit.client.1.smithi181.stdout:3/41: fdatasync d0/d5/fa 0 2024-04-03T08:39:07.485 INFO:tasks.workunit.client.1.smithi181.stdout:2/93: truncate d13/f1b 964772 0 2024-04-03T08:39:07.485 INFO:tasks.workunit.client.0.smithi157.stdout:0/277: readlink d2/d9/d36/l5e 0 2024-04-03T08:39:07.486 INFO:tasks.workunit.client.0.smithi157.stdout:5/261: mknod dc/d34/d52/c54 0 2024-04-03T08:39:07.487 INFO:tasks.workunit.client.1.smithi181.stdout:4/87: chown d1/c1b 3 1 2024-04-03T08:39:07.488 INFO:tasks.workunit.client.1.smithi181.stdout:5/111: fdatasync d4/f13 0 2024-04-03T08:39:07.490 INFO:tasks.workunit.client.0.smithi157.stdout:4/282: mkdir da/df/d11/d5d 0 2024-04-03T08:39:07.493 INFO:tasks.workunit.client.1.smithi181.stdout:8/41: rmdir d4 39 2024-04-03T08:39:07.495 INFO:tasks.workunit.client.1.smithi181.stdout:7/60: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:07.496 INFO:tasks.workunit.client.0.smithi157.stdout:1/223: rename d2/d11/d24/d39/d3b/f9 to d2/d32/f4b 0 2024-04-03T08:39:07.500 INFO:tasks.workunit.client.1.smithi181.stdout:3/42: fdatasync d0/f7 0 2024-04-03T08:39:07.502 INFO:tasks.workunit.client.1.smithi181.stdout:8/42: unlink f3 0 2024-04-03T08:39:07.503 INFO:tasks.workunit.client.1.smithi181.stdout:3/43: dread - d0/d5/fa zero size 2024-04-03T08:39:07.503 INFO:tasks.workunit.client.0.smithi157.stdout:0/278: mkdir d2/d9/dc/df/d1b/d4a/d3b/d6a 0 2024-04-03T08:39:07.504 INFO:tasks.workunit.client.0.smithi157.stdout:0/279: chown d2/d9/d36 7209033 1 2024-04-03T08:39:07.505 INFO:tasks.workunit.client.0.smithi157.stdout:5/262: unlink dc/d34/d18/d21/c31 0 2024-04-03T08:39:07.507 INFO:tasks.workunit.client.0.smithi157.stdout:4/283: rmdir da/d26 39 2024-04-03T08:39:07.512 INFO:tasks.workunit.client.1.smithi181.stdout:5/112: dwrite d4/d18/d25/f1c [0,4194304] 0 2024-04-03T08:39:07.513 INFO:tasks.workunit.client.1.smithi181.stdout:8/43: truncate d4/f5 440180 0 2024-04-03T08:39:07.514 INFO:tasks.workunit.client.0.smithi157.stdout:9/226: rename d1/fb to d1/d15/d27/f49 0 2024-04-03T08:39:07.516 INFO:tasks.workunit.client.1.smithi181.stdout:7/61: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:07.517 INFO:tasks.workunit.client.1.smithi181.stdout:8/44: write d4/d6/f8 [1311543,64863] 0 2024-04-03T08:39:07.522 INFO:tasks.workunit.client.0.smithi157.stdout:8/249: getdents d2/d11 0 2024-04-03T08:39:07.522 INFO:tasks.workunit.client.0.smithi157.stdout:6/272: write d1/d5/f46 [1366803,49000] 0 2024-04-03T08:39:07.524 INFO:tasks.workunit.client.1.smithi181.stdout:5/113: unlink d4/d18/c1b 0 2024-04-03T08:39:07.525 INFO:tasks.workunit.client.0.smithi157.stdout:6/273: truncate d1/f3a 78314 0 2024-04-03T08:39:07.527 INFO:tasks.workunit.client.0.smithi157.stdout:0/280: mknod d2/d9/dc/df/d1b/c6b 0 2024-04-03T08:39:07.530 INFO:tasks.workunit.client.0.smithi157.stdout:7/275: write d0/d11/d15/d1b/f3f [1527503,75555] 0 2024-04-03T08:39:07.532 INFO:tasks.workunit.client.1.smithi181.stdout:4/88: link d1/l5 d1/l20 0 2024-04-03T08:39:07.532 INFO:tasks.workunit.client.1.smithi181.stdout:2/94: write d13/f1b [910545,78000] 0 2024-04-03T08:39:07.533 INFO:tasks.workunit.client.0.smithi157.stdout:1/224: dwrite d2/d11/f26 [0,4194304] 0 2024-04-03T08:39:07.534 INFO:tasks.workunit.client.1.smithi181.stdout:8/45: mkdir d4/d6/db 0 2024-04-03T08:39:07.540 INFO:tasks.workunit.client.1.smithi181.stdout:6/60: dwrite d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:07.542 INFO:tasks.workunit.client.0.smithi157.stdout:3/235: rename d8/fe to d8/d13/d3d/f4a 0 2024-04-03T08:39:07.543 INFO:tasks.workunit.client.1.smithi181.stdout:3/44: truncate d0/f7 194058 0 2024-04-03T08:39:07.546 INFO:tasks.workunit.client.0.smithi157.stdout:8/250: dwrite d2/d20/d23/f4e [0,4194304] 0 2024-04-03T08:39:07.547 INFO:tasks.workunit.client.0.smithi157.stdout:6/274: creat d1/d22/f58 x:0 0 0 2024-04-03T08:39:07.548 INFO:tasks.workunit.client.1.smithi181.stdout:3/45: write d0/f4 [4086780,117479] 0 2024-04-03T08:39:07.548 INFO:tasks.workunit.client.0.smithi157.stdout:8/251: fsync d2/d11/f51 0 2024-04-03T08:39:07.551 INFO:tasks.workunit.client.1.smithi181.stdout:1/41: sync 2024-04-03T08:39:07.551 INFO:tasks.workunit.client.0.smithi157.stdout:6/275: fdatasync d1/d5/d17/d2a/f4d 0 2024-04-03T08:39:07.553 INFO:tasks.workunit.client.0.smithi157.stdout:5/263: mknod dc/d29/d51/c55 0 2024-04-03T08:39:07.554 INFO:tasks.workunit.client.0.smithi157.stdout:4/284: rename da/d26/f4a to da/d26/f5e 0 2024-04-03T08:39:07.557 INFO:tasks.workunit.client.0.smithi157.stdout:7/276: dread d0/d11/d15/d17/d52/f5a [0,4194304] 0 2024-04-03T08:39:07.559 INFO:tasks.workunit.client.1.smithi181.stdout:6/61: creat d6/d7/d9/f12 x:0 0 0 2024-04-03T08:39:07.559 INFO:tasks.workunit.client.0.smithi157.stdout:1/225: symlink d2/d11/d24/d39/d3b/d2e/l4c 0 2024-04-03T08:39:07.560 INFO:tasks.workunit.client.1.smithi181.stdout:8/46: creat d4/fc x:0 0 0 2024-04-03T08:39:07.563 INFO:tasks.workunit.client.0.smithi157.stdout:1/226: chown d2/d11/d24/f1f 204185110 1 2024-04-03T08:39:07.563 INFO:tasks.workunit.client.0.smithi157.stdout:1/227: dread - d2/f45 zero size 2024-04-03T08:39:07.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:07 smithi157 ceph-mon[35083]: pgmap v293: 65 pgs: 65 active+clean; 607 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.4 MiB/s rd, 60 MiB/s wr, 215 op/s 2024-04-03T08:39:07.564 INFO:tasks.workunit.client.0.smithi157.stdout:9/227: mkdir d1/d4a 0 2024-04-03T08:39:07.565 INFO:tasks.workunit.client.1.smithi181.stdout:5/114: dwrite d4/d18/d25/f1c [4194304,4194304] 0 2024-04-03T08:39:07.565 INFO:tasks.workunit.client.1.smithi181.stdout:6/62: chown d6/d7/lc 25 1 2024-04-03T08:39:07.566 INFO:tasks.workunit.client.1.smithi181.stdout:7/62: link d0/d1/d6/cb d0/d1/c13 0 2024-04-03T08:39:07.570 INFO:tasks.workunit.client.1.smithi181.stdout:5/115: stat d4/ff 0 2024-04-03T08:39:07.571 INFO:tasks.workunit.client.0.smithi157.stdout:2/312: rename d3/db/l25 to d3/d2e/d65/l69 0 2024-04-03T08:39:07.574 INFO:tasks.workunit.client.1.smithi181.stdout:8/47: write d4/d6/f8 [1140803,22140] 0 2024-04-03T08:39:07.574 INFO:tasks.workunit.client.1.smithi181.stdout:7/63: write d0/d1/d6/fd [986335,94102] 0 2024-04-03T08:39:07.578 INFO:tasks.workunit.client.1.smithi181.stdout:4/89: dwrite d1/d16/f12 [0,4194304] 0 2024-04-03T08:39:07.581 INFO:tasks.workunit.client.0.smithi157.stdout:6/276: write d1/d4b/f57 [491414,42682] 0 2024-04-03T08:39:07.583 INFO:tasks.workunit.client.1.smithi181.stdout:6/63: truncate d6/d7/d9/f12 181076 0 2024-04-03T08:39:07.583 INFO:tasks.workunit.client.0.smithi157.stdout:4/285: mkdir da/df/d2f/d54/d5f 0 2024-04-03T08:39:07.585 INFO:tasks.workunit.client.0.smithi157.stdout:7/277: creat d0/d4/f65 x:0 0 0 2024-04-03T08:39:07.586 INFO:tasks.workunit.client.1.smithi181.stdout:4/90: write d1/fb [1892551,65990] 0 2024-04-03T08:39:07.589 INFO:tasks.workunit.client.1.smithi181.stdout:7/64: truncate d0/d1/d6/fd 4655463 0 2024-04-03T08:39:07.589 INFO:tasks.workunit.client.0.smithi157.stdout:0/281: dwrite d2/f5b [0,4194304] 0 2024-04-03T08:39:07.594 INFO:tasks.workunit.client.0.smithi157.stdout:3/236: creat d8/d1e/d2d/d30/f4b x:0 0 0 2024-04-03T08:39:07.595 INFO:tasks.workunit.client.1.smithi181.stdout:6/64: write d6/d7/d9/fa [330540,56386] 0 2024-04-03T08:39:07.596 INFO:tasks.workunit.client.0.smithi157.stdout:7/278: write d0/d4/d36/d5b/f63 [168498,108007] 0 2024-04-03T08:39:07.597 INFO:tasks.workunit.client.0.smithi157.stdout:8/252: rename d2/d20/f35 to d2/d11/d10/d12/d2e/f58 0 2024-04-03T08:39:07.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:07 smithi181 ceph-mon[44183]: pgmap v293: 65 pgs: 65 active+clean; 607 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.4 MiB/s rd, 60 MiB/s wr, 215 op/s 2024-04-03T08:39:07.599 INFO:tasks.workunit.client.0.smithi157.stdout:2/313: mknod d3/db/c6a 0 2024-04-03T08:39:07.601 INFO:tasks.workunit.client.0.smithi157.stdout:7/279: truncate d0/d11/d15/d1b/f32 976733 0 2024-04-03T08:39:07.602 INFO:tasks.workunit.client.0.smithi157.stdout:9/228: mknod d1/d15/d16/c4b 0 2024-04-03T08:39:07.604 INFO:tasks.workunit.client.0.smithi157.stdout:0/282: mkdir d2/d9/d36/d38/d6c 0 2024-04-03T08:39:07.609 INFO:tasks.workunit.client.0.smithi157.stdout:5/264: rename dc/d34 to dc/d29/d56 0 2024-04-03T08:39:07.610 INFO:tasks.workunit.client.0.smithi157.stdout:7/280: symlink d0/d4/d36/l66 0 2024-04-03T08:39:07.611 INFO:tasks.workunit.client.1.smithi181.stdout:8/48: dread d4/d6/f8 [0,4194304] 0 2024-04-03T08:39:07.612 INFO:tasks.workunit.client.0.smithi157.stdout:5/265: write dc/d29/d56/f26 [999649,73482] 0 2024-04-03T08:39:07.613 INFO:tasks.workunit.client.0.smithi157.stdout:6/277: truncate d1/ff 933521 0 2024-04-03T08:39:07.613 INFO:tasks.workunit.client.0.smithi157.stdout:7/281: dread - d0/d11/d15/d1b/f57 zero size 2024-04-03T08:39:07.615 INFO:tasks.workunit.client.0.smithi157.stdout:7/282: fdatasync d0/d5/f3e 0 2024-04-03T08:39:07.615 INFO:tasks.workunit.client.0.smithi157.stdout:1/228: link d2/d11/d24/d39/d3b/d1b/f2c d2/d11/d23/f4d 0 2024-04-03T08:39:07.618 INFO:tasks.workunit.client.1.smithi181.stdout:7/65: write d0/d1/d6/f9 [4899238,77130] 0 2024-04-03T08:39:07.619 INFO:tasks.workunit.client.1.smithi181.stdout:2/95: dwrite fe [0,4194304] 0 2024-04-03T08:39:07.620 INFO:tasks.workunit.client.0.smithi157.stdout:8/253: mkdir d2/d11/d10/d12/d2e/d56/d59 0 2024-04-03T08:39:07.620 INFO:tasks.workunit.client.1.smithi181.stdout:6/65: creat d6/f13 x:0 0 0 2024-04-03T08:39:07.622 INFO:tasks.workunit.client.0.smithi157.stdout:3/237: rename d8/d13/d23 to d8/d13/d3d/d4c 0 2024-04-03T08:39:07.627 INFO:tasks.workunit.client.1.smithi181.stdout:8/49: fdatasync d4/d6/f7 0 2024-04-03T08:39:07.629 INFO:tasks.workunit.client.0.smithi157.stdout:9/229: creat d1/d4a/f4c x:0 0 0 2024-04-03T08:39:07.629 INFO:tasks.workunit.client.1.smithi181.stdout:7/66: mknod d0/d1/d6/de/c14 0 2024-04-03T08:39:07.630 INFO:tasks.workunit.client.1.smithi181.stdout:1/42: dwrite fb [0,4194304] 0 2024-04-03T08:39:07.633 INFO:tasks.workunit.client.0.smithi157.stdout:1/229: creat d2/d11/d24/d39/d3b/d1b/f4e x:0 0 0 2024-04-03T08:39:07.634 INFO:tasks.workunit.client.1.smithi181.stdout:6/66: symlink d6/d7/l14 0 2024-04-03T08:39:07.634 INFO:tasks.workunit.client.1.smithi181.stdout:3/46: dwrite d0/f7 [0,4194304] 0 2024-04-03T08:39:07.640 INFO:tasks.workunit.client.0.smithi157.stdout:0/283: rename d2/d9/dc/df/d1b/d4a/d31/f4c to d2/d9/dc/df/d1b/f6d 0 2024-04-03T08:39:07.641 INFO:tasks.workunit.client.1.smithi181.stdout:5/116: dread d4/d18/d25/f19 [0,4194304] 0 2024-04-03T08:39:07.642 INFO:tasks.workunit.client.0.smithi157.stdout:3/238: mkdir d8/d1e/d2d/d3f/d4d 0 2024-04-03T08:39:07.643 INFO:tasks.workunit.client.0.smithi157.stdout:0/284: write d2/d9/dc/df/d1b/d35/f56 [472749,39840] 0 2024-04-03T08:39:07.643 INFO:tasks.workunit.client.0.smithi157.stdout:4/286: getdents da/df/d2f/d54 0 2024-04-03T08:39:07.644 INFO:tasks.workunit.client.0.smithi157.stdout:3/239: fdatasync d8/d13/d1b/f1d 0 2024-04-03T08:39:07.646 INFO:tasks.workunit.client.0.smithi157.stdout:5/266: link dc/d29/d56/d18/f1c dc/d29/f57 0 2024-04-03T08:39:07.649 INFO:tasks.workunit.client.1.smithi181.stdout:1/43: mknod cf 0 2024-04-03T08:39:07.650 INFO:tasks.workunit.client.1.smithi181.stdout:3/47: write d0/d5/fa [330722,107217] 0 2024-04-03T08:39:07.652 INFO:tasks.workunit.client.1.smithi181.stdout:7/67: creat d0/d1/f15 x:0 0 0 2024-04-03T08:39:07.653 INFO:tasks.workunit.client.0.smithi157.stdout:2/314: truncate d3/d12/fe 392867 0 2024-04-03T08:39:07.656 INFO:tasks.workunit.client.0.smithi157.stdout:7/283: creat d0/d11/d15/d17/d1c/d4f/d5f/d61/f67 x:0 0 0 2024-04-03T08:39:07.657 INFO:tasks.workunit.client.0.smithi157.stdout:9/230: dread d1/d15/f1a [0,4194304] 0 2024-04-03T08:39:07.657 INFO:tasks.workunit.client.1.smithi181.stdout:2/96: mkdir d13/d22/d27 0 2024-04-03T08:39:07.660 INFO:tasks.workunit.client.1.smithi181.stdout:3/48: chown d0/c1 304970 1 2024-04-03T08:39:07.664 INFO:tasks.workunit.client.0.smithi157.stdout:3/240: rename d8/d13/d38 to d8/d13/d1b/d4e 0 2024-04-03T08:39:07.665 INFO:tasks.workunit.client.0.smithi157.stdout:5/267: creat dc/d29/d56/d52/f58 x:0 0 0 2024-04-03T08:39:07.665 INFO:tasks.workunit.client.0.smithi157.stdout:2/315: dread d3/d12/f68 [0,4194304] 0 2024-04-03T08:39:07.667 INFO:tasks.workunit.client.0.smithi157.stdout:5/268: write dc/d35/f40 [5041137,22240] 0 2024-04-03T08:39:07.670 INFO:tasks.workunit.client.1.smithi181.stdout:1/44: mkdir d10 0 2024-04-03T08:39:07.672 INFO:tasks.workunit.client.1.smithi181.stdout:1/45: readlink l7 0 2024-04-03T08:39:07.673 INFO:tasks.workunit.client.1.smithi181.stdout:7/68: truncate d0/d1/d6/fd 5590871 0 2024-04-03T08:39:07.674 INFO:tasks.workunit.client.0.smithi157.stdout:7/284: creat d0/d11/d15/d17/d52/f68 x:0 0 0 2024-04-03T08:39:07.677 INFO:tasks.workunit.client.1.smithi181.stdout:2/97: link d13/f1b d13/d22/d27/f28 0 2024-04-03T08:39:07.678 INFO:tasks.workunit.client.1.smithi181.stdout:6/67: dwrite d6/d7/d9/fa [0,4194304] 0 2024-04-03T08:39:07.678 INFO:tasks.workunit.client.0.smithi157.stdout:9/231: mkdir d1/d4a/d4d 0 2024-04-03T08:39:07.679 INFO:tasks.workunit.client.1.smithi181.stdout:8/50: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:07.681 INFO:tasks.workunit.client.0.smithi157.stdout:9/232: write d1/d15/d16/f23 [980515,23162] 0 2024-04-03T08:39:07.682 INFO:tasks.workunit.client.0.smithi157.stdout:0/285: rename d2/d9/dc/df/d1b/d35/d3d/f62 to d2/d9/d36/d38/d6c/f6e 0 2024-04-03T08:39:07.683 INFO:tasks.workunit.client.0.smithi157.stdout:4/287: dread da/fc [0,4194304] 0 2024-04-03T08:39:07.683 INFO:tasks.workunit.client.0.smithi157.stdout:9/233: chown d1/d4a 99 1 2024-04-03T08:39:07.686 INFO:tasks.workunit.client.0.smithi157.stdout:0/286: stat d2/d9/dc/d54/l5a 0 2024-04-03T08:39:07.695 INFO:tasks.workunit.client.0.smithi157.stdout:8/254: link d2/d11/d10/d12/f49 d2/f5a 0 2024-04-03T08:39:07.696 INFO:tasks.workunit.client.1.smithi181.stdout:1/46: fdatasync f2 0 2024-04-03T08:39:07.698 INFO:tasks.workunit.client.1.smithi181.stdout:6/68: chown d6/d7/d9/cd 0 1 2024-04-03T08:39:07.698 INFO:tasks.workunit.client.0.smithi157.stdout:3/241: mknod d8/d1e/d2d/d3f/d4d/c4f 0 2024-04-03T08:39:07.698 INFO:tasks.workunit.client.0.smithi157.stdout:4/288: write da/df/d11/f27 [4346092,476] 0 2024-04-03T08:39:07.700 INFO:tasks.workunit.client.0.smithi157.stdout:4/289: fsync da/df/f57 0 2024-04-03T08:39:07.701 INFO:tasks.workunit.client.0.smithi157.stdout:1/230: getdents d2/d11/d24/d39/d3b/d2e 0 2024-04-03T08:39:07.703 INFO:tasks.workunit.client.1.smithi181.stdout:2/98: dread d13/d22/d27/f28 [0,4194304] 0 2024-04-03T08:39:07.703 INFO:tasks.workunit.client.1.smithi181.stdout:9/161: sync 2024-04-03T08:39:07.705 INFO:tasks.workunit.client.1.smithi181.stdout:3/49: getdents d0/d5 0 2024-04-03T08:39:07.708 INFO:tasks.workunit.client.1.smithi181.stdout:7/69: getdents d0/d1/d6 0 2024-04-03T08:39:07.710 INFO:tasks.workunit.client.0.smithi157.stdout:9/234: rmdir d1/d4a 39 2024-04-03T08:39:07.711 INFO:tasks.workunit.client.1.smithi181.stdout:3/50: chown d0/f3 1 1 2024-04-03T08:39:07.711 INFO:tasks.workunit.client.1.smithi181.stdout:7/70: chown d0/d1/d6 255991008 1 2024-04-03T08:39:07.712 INFO:tasks.workunit.client.0.smithi157.stdout:0/287: mkdir d2/d9/dc/df/d6f 0 2024-04-03T08:39:07.713 INFO:tasks.workunit.client.1.smithi181.stdout:7/71: readlink d0/l5 0 2024-04-03T08:39:07.714 INFO:tasks.workunit.client.1.smithi181.stdout:6/69: creat d6/d7/d9/f15 x:0 0 0 2024-04-03T08:39:07.714 INFO:tasks.workunit.client.0.smithi157.stdout:0/288: write d2/d9/dc/df/f60 [764611,44000] 0 2024-04-03T08:39:07.715 INFO:tasks.workunit.client.1.smithi181.stdout:5/117: dwrite d4/f12 [0,4194304] 0 2024-04-03T08:39:07.717 INFO:tasks.workunit.client.0.smithi157.stdout:2/316: link d3/d12/d43/f50 d3/d2e/f6b 0 2024-04-03T08:39:07.720 INFO:tasks.workunit.client.0.smithi157.stdout:4/290: dwrite da/fc [0,4194304] 0 2024-04-03T08:39:07.723 INFO:tasks.workunit.client.0.smithi157.stdout:7/285: rename d0/d16/c27 to d0/d11/d15/d17/c69 0 2024-04-03T08:39:07.724 INFO:tasks.workunit.client.0.smithi157.stdout:5/269: dread dc/f11 [0,4194304] 0 2024-04-03T08:39:07.730 INFO:tasks.workunit.client.0.smithi157.stdout:8/255: write d2/d11/ff [2728641,7069] 0 2024-04-03T08:39:07.730 INFO:tasks.workunit.client.1.smithi181.stdout:3/51: mknod d0/cb 0 2024-04-03T08:39:07.733 INFO:tasks.workunit.client.0.smithi157.stdout:1/231: link d2/f3 d2/d11/d23/f4f 0 2024-04-03T08:39:07.737 INFO:tasks.workunit.client.1.smithi181.stdout:6/70: symlink d6/d7/d9/l16 0 2024-04-03T08:39:07.738 INFO:tasks.workunit.client.0.smithi157.stdout:0/289: symlink d2/d9/dc/df/d1b/d4a/l70 0 2024-04-03T08:39:07.740 INFO:tasks.workunit.client.1.smithi181.stdout:7/72: symlink d0/d1/d6/de/l16 0 2024-04-03T08:39:07.741 INFO:tasks.workunit.client.0.smithi157.stdout:0/290: write d2/fa [8484203,50893] 0 2024-04-03T08:39:07.742 INFO:tasks.workunit.client.1.smithi181.stdout:9/162: write d1/da/fb [1008783,76195] 0 2024-04-03T08:39:07.742 INFO:tasks.workunit.client.1.smithi181.stdout:7/73: readlink d0/l10 0 2024-04-03T08:39:07.743 INFO:tasks.workunit.client.0.smithi157.stdout:4/291: dwrite da/f3e [0,4194304] 0 2024-04-03T08:39:07.743 INFO:tasks.workunit.client.0.smithi157.stdout:2/317: fsync d3/d2e/f3b 0 2024-04-03T08:39:07.745 INFO:tasks.workunit.client.1.smithi181.stdout:1/47: truncate f4 3143684 0 2024-04-03T08:39:07.745 INFO:tasks.workunit.client.1.smithi181.stdout:7/74: truncate d0/d1/f15 617970 0 2024-04-03T08:39:07.746 INFO:tasks.workunit.client.1.smithi181.stdout:1/48: dread - fc zero size 2024-04-03T08:39:07.748 INFO:tasks.workunit.client.0.smithi157.stdout:3/242: rename d8/d13/d1b/d35 to d8/d13/d1b/d4e/d50 0 2024-04-03T08:39:07.748 INFO:tasks.workunit.client.1.smithi181.stdout:3/52: dread d0/f7 [0,4194304] 0 2024-04-03T08:39:07.748 INFO:tasks.workunit.client.1.smithi181.stdout:7/75: write d0/d1/d6/fd [2494740,76265] 0 2024-04-03T08:39:07.749 INFO:tasks.workunit.client.0.smithi157.stdout:7/286: symlink d0/d4/d36/l6a 0 2024-04-03T08:39:07.749 INFO:tasks.workunit.client.0.smithi157.stdout:3/243: chown d8/d1e 225 1 2024-04-03T08:39:07.750 INFO:tasks.workunit.client.0.smithi157.stdout:9/235: symlink d1/l4e 0 2024-04-03T08:39:07.752 INFO:tasks.workunit.client.1.smithi181.stdout:6/71: creat d6/f17 x:0 0 0 2024-04-03T08:39:07.752 INFO:tasks.workunit.client.0.smithi157.stdout:1/232: readlink d2/d11/d23/l3c 0 2024-04-03T08:39:07.753 INFO:tasks.workunit.client.1.smithi181.stdout:9/163: dread - d1/da/d13/f2d zero size 2024-04-03T08:39:07.754 INFO:tasks.workunit.client.0.smithi157.stdout:7/287: truncate d0/d11/d15/d35/f50 644753 0 2024-04-03T08:39:07.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/118: unlink d4/c9 0 2024-04-03T08:39:07.756 INFO:tasks.workunit.client.0.smithi157.stdout:0/291: unlink d2/d9/dc/df/d1b/f49 0 2024-04-03T08:39:07.758 INFO:tasks.workunit.client.0.smithi157.stdout:4/292: symlink da/d26/l60 0 2024-04-03T08:39:07.760 INFO:tasks.workunit.client.1.smithi181.stdout:1/49: write f9 [364034,105381] 0 2024-04-03T08:39:07.761 INFO:tasks.workunit.client.0.smithi157.stdout:4/293: dread - da/df/d24/d58/f5b zero size 2024-04-03T08:39:07.761 INFO:tasks.workunit.client.0.smithi157.stdout:3/244: fdatasync d8/d13/d1b/f24 0 2024-04-03T08:39:07.764 INFO:tasks.workunit.client.0.smithi157.stdout:3/245: dread - d8/d1e/d2d/d30/f4b zero size 2024-04-03T08:39:07.768 INFO:tasks.workunit.client.0.smithi157.stdout:7/288: creat d0/d16/f6b x:0 0 0 2024-04-03T08:39:07.772 INFO:tasks.workunit.client.1.smithi181.stdout:9/164: creat d1/d34/f3a x:0 0 0 2024-04-03T08:39:07.774 INFO:tasks.workunit.client.0.smithi157.stdout:0/292: dwrite d2/f5b [0,4194304] 0 2024-04-03T08:39:07.774 INFO:tasks.workunit.client.1.smithi181.stdout:2/99: getdents d13/d22 0 2024-04-03T08:39:07.776 INFO:tasks.workunit.client.0.smithi157.stdout:0/293: fdatasync d2/d9/d36/f3f 0 2024-04-03T08:39:07.778 INFO:tasks.workunit.client.1.smithi181.stdout:3/53: dwrite d0/d5/fa [0,4194304] 0 2024-04-03T08:39:07.778 INFO:tasks.workunit.client.1.smithi181.stdout:6/72: dread d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:07.781 INFO:tasks.workunit.client.1.smithi181.stdout:2/100: chown fe 1 1 2024-04-03T08:39:07.781 INFO:tasks.workunit.client.1.smithi181.stdout:7/76: dwrite d0/d1/d6/fd [4194304,4194304] 0 2024-04-03T08:39:07.782 INFO:tasks.workunit.client.0.smithi157.stdout:9/236: symlink d1/l4f 0 2024-04-03T08:39:07.783 INFO:tasks.workunit.client.0.smithi157.stdout:9/237: chown d1/d15 0 1 2024-04-03T08:39:07.788 INFO:tasks.workunit.client.0.smithi157.stdout:1/233: mknod d2/d11/c50 0 2024-04-03T08:39:07.788 INFO:tasks.workunit.client.1.smithi181.stdout:1/50: getdents d10 0 2024-04-03T08:39:07.789 INFO:tasks.workunit.client.0.smithi157.stdout:2/318: creat d3/f6c x:0 0 0 2024-04-03T08:39:07.789 INFO:tasks.workunit.client.1.smithi181.stdout:7/77: readlink d0/d1/d6/de/lf 0 2024-04-03T08:39:07.791 INFO:tasks.workunit.client.1.smithi181.stdout:1/51: fsync fb 0 2024-04-03T08:39:07.791 INFO:tasks.workunit.client.1.smithi181.stdout:0/77: sync 2024-04-03T08:39:07.792 INFO:tasks.workunit.client.0.smithi157.stdout:1/234: write d2/d11/d24/d39/d3b/fe [1159246,43269] 0 2024-04-03T08:39:07.795 INFO:tasks.workunit.client.1.smithi181.stdout:1/52: truncate f9 1237628 0 2024-04-03T08:39:07.795 INFO:tasks.workunit.client.0.smithi157.stdout:7/289: mknod d0/d4/d36/d5b/c6c 0 2024-04-03T08:39:07.799 INFO:tasks.workunit.client.0.smithi157.stdout:7/290: dread - d0/d11/d15/d17/d52/f54 zero size 2024-04-03T08:39:07.799 INFO:tasks.workunit.client.0.smithi157.stdout:5/270: rename dc/d29/d56/d18/f2d to dc/f59 0 2024-04-03T08:39:07.799 INFO:tasks.workunit.client.1.smithi181.stdout:5/119: creat d4/d18/f28 x:0 0 0 2024-04-03T08:39:07.800 INFO:tasks.workunit.client.1.smithi181.stdout:6/73: symlink d6/d7/d9/l18 0 2024-04-03T08:39:07.803 INFO:tasks.workunit.client.1.smithi181.stdout:6/74: chown d6/d7/fb 23055993 1 2024-04-03T08:39:07.804 INFO:tasks.workunit.client.1.smithi181.stdout:3/54: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:07.810 INFO:tasks.workunit.client.1.smithi181.stdout:2/101: dread d13/f1e [0,4194304] 0 2024-04-03T08:39:07.815 INFO:tasks.workunit.client.1.smithi181.stdout:0/78: unlink d5/dc/d14/f19 0 2024-04-03T08:39:07.817 INFO:tasks.workunit.client.0.smithi157.stdout:1/235: rmdir d2/d11/d24 39 2024-04-03T08:39:07.819 INFO:tasks.workunit.client.1.smithi181.stdout:7/78: mkdir d0/d1/d6/de/d17 0 2024-04-03T08:39:07.823 INFO:tasks.workunit.client.0.smithi157.stdout:8/256: rename d2/d11/d10/d12 to d2/d11/d10/d24/d5b 0 2024-04-03T08:39:07.825 INFO:tasks.workunit.client.0.smithi157.stdout:0/294: truncate d2/f3 4155458 0 2024-04-03T08:39:07.826 INFO:tasks.workunit.client.1.smithi181.stdout:6/75: creat d6/d7/d9/f19 x:0 0 0 2024-04-03T08:39:07.826 INFO:tasks.workunit.client.0.smithi157.stdout:2/319: dwrite d3/d12/f63 [0,4194304] 0 2024-04-03T08:39:07.827 INFO:tasks.workunit.client.0.smithi157.stdout:7/291: mknod d0/d11/d15/d17/d1c/d4f/d5f/c6d 0 2024-04-03T08:39:07.828 INFO:tasks.workunit.client.0.smithi157.stdout:2/320: stat d3/db 0 2024-04-03T08:39:07.829 INFO:tasks.workunit.client.0.smithi157.stdout:2/321: write d3/d12/f11 [912888,5759] 0 2024-04-03T08:39:07.831 INFO:tasks.workunit.client.0.smithi157.stdout:4/294: link l3 da/df/d11/l61 0 2024-04-03T08:39:07.836 INFO:tasks.workunit.client.0.smithi157.stdout:3/246: write d8/f17 [1317009,31023] 0 2024-04-03T08:39:07.838 INFO:tasks.workunit.client.1.smithi181.stdout:9/165: truncate d1/f20 1018926 0 2024-04-03T08:39:07.839 INFO:tasks.workunit.client.0.smithi157.stdout:3/247: write d8/d1e/d2d/d39/f47 [119255,113983] 0 2024-04-03T08:39:07.840 INFO:tasks.workunit.client.0.smithi157.stdout:3/248: stat d8/f9 0 2024-04-03T08:39:07.841 INFO:tasks.workunit.client.1.smithi181.stdout:4/91: sync 2024-04-03T08:39:07.841 INFO:tasks.workunit.client.1.smithi181.stdout:8/51: sync 2024-04-03T08:39:07.843 INFO:tasks.workunit.client.0.smithi157.stdout:1/236: write d2/d11/d24/f2f [516637,97740] 0 2024-04-03T08:39:07.845 INFO:tasks.workunit.client.1.smithi181.stdout:3/55: symlink d0/d5/d6/lc 0 2024-04-03T08:39:07.847 INFO:tasks.workunit.client.0.smithi157.stdout:1/237: write d2/d11/d24/d39/d3b/d1b/f2a [593868,72275] 0 2024-04-03T08:39:07.852 INFO:tasks.workunit.client.0.smithi157.stdout:5/271: rename dc/d29/d56/f20 to dc/d29/d56/d49/d53/f5a 0 2024-04-03T08:39:07.855 INFO:tasks.workunit.client.0.smithi157.stdout:2/322: chown d3/l17 6586245 1 2024-04-03T08:39:07.855 INFO:tasks.workunit.client.0.smithi157.stdout:1/238: truncate d2/d11/d24/d39/d3b/d1b/f2c 493617 0 2024-04-03T08:39:07.855 INFO:tasks.workunit.client.0.smithi157.stdout:9/238: creat d1/d15/f50 x:0 0 0 2024-04-03T08:39:07.860 INFO:tasks.workunit.client.1.smithi181.stdout:6/76: dwrite d6/d7/d9/f15 [0,4194304] 0 2024-04-03T08:39:07.860 INFO:tasks.workunit.client.1.smithi181.stdout:0/79: truncate d5/fb 1426925 0 2024-04-03T08:39:07.861 INFO:tasks.workunit.client.0.smithi157.stdout:8/257: write d2/f5a [434820,37676] 0 2024-04-03T08:39:07.862 INFO:tasks.workunit.client.1.smithi181.stdout:8/52: dread d4/f5 [0,4194304] 0 2024-04-03T08:39:07.863 INFO:tasks.workunit.client.1.smithi181.stdout:8/53: fdatasync d4/f5 0 2024-04-03T08:39:07.865 INFO:tasks.workunit.client.1.smithi181.stdout:2/102: truncate f3 511716 0 2024-04-03T08:39:07.865 INFO:tasks.workunit.client.1.smithi181.stdout:8/54: chown d4/la 14732255 1 2024-04-03T08:39:07.866 INFO:tasks.workunit.client.1.smithi181.stdout:4/92: mknod d1/d16/c21 0 2024-04-03T08:39:07.867 INFO:tasks.workunit.client.1.smithi181.stdout:4/93: read - d1/d1e/f1a zero size 2024-04-03T08:39:07.868 INFO:tasks.workunit.client.0.smithi157.stdout:5/272: dread dc/d29/d56/f27 [0,4194304] 0 2024-04-03T08:39:07.868 INFO:tasks.workunit.client.1.smithi181.stdout:4/94: write d1/fb [4321956,3867] 0 2024-04-03T08:39:07.872 INFO:tasks.workunit.client.1.smithi181.stdout:4/95: write d1/fb [2943308,21091] 0 2024-04-03T08:39:07.875 INFO:tasks.workunit.client.0.smithi157.stdout:7/292: rename d0/d5/l2b to d0/d4/d36/l6e 0 2024-04-03T08:39:07.878 INFO:tasks.workunit.client.1.smithi181.stdout:9/166: getdents d1/da/d16/d32 0 2024-04-03T08:39:07.879 INFO:tasks.workunit.client.0.smithi157.stdout:1/239: creat d2/d32/f51 x:0 0 0 2024-04-03T08:39:07.881 INFO:tasks.workunit.client.1.smithi181.stdout:6/77: creat d6/d7/d9/f1a x:0 0 0 2024-04-03T08:39:07.885 INFO:tasks.workunit.client.1.smithi181.stdout:2/103: symlink d13/l29 0 2024-04-03T08:39:07.886 INFO:tasks.workunit.client.0.smithi157.stdout:5/273: creat dc/d29/d56/d49/d53/f5b x:0 0 0 2024-04-03T08:39:07.887 INFO:tasks.workunit.client.1.smithi181.stdout:3/56: dwrite d0/f7 [0,4194304] 0 2024-04-03T08:39:07.888 INFO:tasks.workunit.client.0.smithi157.stdout:5/274: fsync dc/f44 0 2024-04-03T08:39:07.888 INFO:tasks.workunit.client.0.smithi157.stdout:5/275: chown dc/f44 687583 1 2024-04-03T08:39:07.889 INFO:tasks.workunit.client.1.smithi181.stdout:4/96: dread d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:07.889 INFO:tasks.workunit.client.0.smithi157.stdout:3/249: rename d8/d13/d3d to d8/d1e/d2d/d39/d51 0 2024-04-03T08:39:07.893 INFO:tasks.workunit.client.0.smithi157.stdout:2/323: mkdir d3/d2e/d32/d3c/d6d 0 2024-04-03T08:39:07.894 INFO:tasks.workunit.client.0.smithi157.stdout:9/239: creat d1/d15/d27/f51 x:0 0 0 2024-04-03T08:39:07.897 INFO:tasks.workunit.client.0.smithi157.stdout:2/324: read d3/f9 [1438814,94468] 0 2024-04-03T08:39:07.902 INFO:tasks.workunit.client.0.smithi157.stdout:7/293: mkdir d0/d11/d6f 0 2024-04-03T08:39:07.904 INFO:tasks.workunit.client.0.smithi157.stdout:7/294: fsync d0/d5/f62 0 2024-04-03T08:39:07.904 INFO:tasks.workunit.client.0.smithi157.stdout:3/250: dwrite d8/d13/d1b/f24 [4194304,4194304] 0 2024-04-03T08:39:07.907 INFO:tasks.workunit.client.0.smithi157.stdout:5/276: symlink dc/d29/d56/d18/d21/l5c 0 2024-04-03T08:39:07.907 INFO:tasks.workunit.client.1.smithi181.stdout:6/78: rename d6/d7/d9/f12 to d6/d7/d9/f1b 0 2024-04-03T08:39:07.911 INFO:tasks.workunit.client.1.smithi181.stdout:5/120: truncate d4/f16 861503 0 2024-04-03T08:39:07.915 INFO:tasks.workunit.client.0.smithi157.stdout:9/240: chown d1/d15/d16/c41 4 1 2024-04-03T08:39:07.915 INFO:tasks.workunit.client.0.smithi157.stdout:2/325: rmdir d3/d2e/d32 39 2024-04-03T08:39:07.915 INFO:tasks.workunit.client.0.smithi157.stdout:8/258: truncate d2/d11/ff 970670 0 2024-04-03T08:39:07.915 INFO:tasks.workunit.client.0.smithi157.stdout:9/241: dread - d1/d15/d27/f51 zero size 2024-04-03T08:39:07.916 INFO:tasks.workunit.client.1.smithi181.stdout:9/167: write d1/da/d13/d22/f2e [2849447,70902] 0 2024-04-03T08:39:07.922 INFO:tasks.workunit.client.0.smithi157.stdout:5/277: creat dc/d29/d56/d18/d21/f5d x:0 0 0 2024-04-03T08:39:07.925 INFO:tasks.workunit.client.0.smithi157.stdout:3/251: dread d8/f28 [0,4194304] 0 2024-04-03T08:39:07.926 INFO:tasks.workunit.client.1.smithi181.stdout:2/104: dwrite f0 [0,4194304] 0 2024-04-03T08:39:07.926 INFO:tasks.workunit.client.1.smithi181.stdout:6/79: symlink d6/d7/d9/l1c 0 2024-04-03T08:39:07.930 INFO:tasks.workunit.client.0.smithi157.stdout:9/242: dread - d1/d4a/f4c zero size 2024-04-03T08:39:07.936 INFO:tasks.workunit.client.0.smithi157.stdout:2/326: mknod d3/d12/d43/c6e 0 2024-04-03T08:39:07.938 INFO:tasks.workunit.client.0.smithi157.stdout:8/259: creat d2/d20/d23/f5c x:0 0 0 2024-04-03T08:39:07.938 INFO:tasks.workunit.client.0.smithi157.stdout:2/327: chown d3/db/d44/d4c 7708324 1 2024-04-03T08:39:07.942 INFO:tasks.workunit.client.0.smithi157.stdout:1/240: link d2/d11/l3a d2/d11/d24/d39/l52 0 2024-04-03T08:39:07.944 INFO:tasks.workunit.client.1.smithi181.stdout:2/105: creat d13/d1d/f2a x:0 0 0 2024-04-03T08:39:07.944 INFO:tasks.workunit.client.0.smithi157.stdout:5/278: truncate dc/f12 1817734 0 2024-04-03T08:39:07.945 INFO:tasks.workunit.client.1.smithi181.stdout:6/80: symlink d6/d7/d9/l1d 0 2024-04-03T08:39:07.946 INFO:tasks.workunit.client.0.smithi157.stdout:5/279: read - dc/d29/d43/f48 zero size 2024-04-03T08:39:07.946 INFO:tasks.workunit.client.1.smithi181.stdout:3/57: truncate d0/d5/fa 1519867 0 2024-04-03T08:39:07.947 INFO:tasks.workunit.client.1.smithi181.stdout:0/80: write d5/fb [188125,42443] 0 2024-04-03T08:39:07.947 INFO:tasks.workunit.client.1.smithi181.stdout:3/58: stat d0/l2 0 2024-04-03T08:39:07.949 INFO:tasks.workunit.client.0.smithi157.stdout:7/295: rename d0/d11/d15/d1b/f32 to d0/d11/f70 0 2024-04-03T08:39:07.951 INFO:tasks.workunit.client.0.smithi157.stdout:2/328: mknod d3/d12/d43/d4b/d55/c6f 0 2024-04-03T08:39:07.952 INFO:tasks.workunit.client.1.smithi181.stdout:9/168: write d1/da/d13/f29 [10930,75829] 0 2024-04-03T08:39:07.952 INFO:tasks.workunit.client.1.smithi181.stdout:2/106: mknod d13/d1c/c2b 0 2024-04-03T08:39:07.953 INFO:tasks.workunit.client.0.smithi157.stdout:5/280: read dc/d29/d56/f27 [2653204,19173] 0 2024-04-03T08:39:07.956 INFO:tasks.workunit.client.0.smithi157.stdout:3/252: rename d8/l16 to d8/d1e/d2d/d39/d51/d4c/l52 0 2024-04-03T08:39:07.957 INFO:tasks.workunit.client.1.smithi181.stdout:3/59: mkdir d0/d5/d6/dd 0 2024-04-03T08:39:07.961 INFO:tasks.workunit.client.1.smithi181.stdout:9/169: rmdir d1 39 2024-04-03T08:39:07.963 INFO:tasks.workunit.client.1.smithi181.stdout:0/81: dwrite d5/fb [0,4194304] 0 2024-04-03T08:39:07.964 INFO:tasks.workunit.client.0.smithi157.stdout:5/281: unlink dc/d29/d56/l1e 0 2024-04-03T08:39:07.969 INFO:tasks.workunit.client.1.smithi181.stdout:2/107: fdatasync f3 0 2024-04-03T08:39:07.972 INFO:tasks.workunit.client.0.smithi157.stdout:7/296: dwrite d0/f20 [0,4194304] 0 2024-04-03T08:39:07.974 INFO:tasks.workunit.client.1.smithi181.stdout:0/82: fdatasync d5/d9/fd 0 2024-04-03T08:39:07.979 INFO:tasks.workunit.client.0.smithi157.stdout:8/260: rename d2/d11/d10/d24/d5b/f28 to d2/d11/d10/d24/d5b/d2e/d56/f5d 0 2024-04-03T08:39:07.980 INFO:tasks.workunit.client.0.smithi157.stdout:3/253: symlink d8/d13/l53 0 2024-04-03T08:39:07.980 INFO:tasks.workunit.client.0.smithi157.stdout:8/261: dread - d2/d20/f3b zero size 2024-04-03T08:39:07.982 INFO:tasks.workunit.client.1.smithi181.stdout:3/60: dwrite d0/f4 [0,4194304] 0 2024-04-03T08:39:07.985 INFO:tasks.workunit.client.1.smithi181.stdout:2/108: unlink d13/l16 0 2024-04-03T08:39:07.985 INFO:tasks.workunit.client.0.smithi157.stdout:8/262: read - d2/d11/d10/d24/d5b/d2e/f42 zero size 2024-04-03T08:39:07.987 INFO:tasks.workunit.client.1.smithi181.stdout:1/53: sync 2024-04-03T08:39:07.987 INFO:tasks.workunit.client.1.smithi181.stdout:6/81: getdents d6/d7 0 2024-04-03T08:39:07.988 INFO:tasks.workunit.client.0.smithi157.stdout:5/282: write dc/f1d [759317,30442] 0 2024-04-03T08:39:07.998 INFO:tasks.workunit.client.0.smithi157.stdout:1/241: rename d2/d11/d24/d39/d3b/f1d to d2/f53 0 2024-04-03T08:39:08.000 INFO:tasks.workunit.client.0.smithi157.stdout:2/329: link d3/d12/d43/d4b/d55/c49 d3/d2e/c70 0 2024-04-03T08:39:08.002 INFO:tasks.workunit.client.0.smithi157.stdout:2/330: write d3/f48 [1856921,73833] 0 2024-04-03T08:39:08.005 INFO:tasks.workunit.client.0.smithi157.stdout:8/263: creat d2/d11/d10/d24/d5b/d2e/d56/f5e x:0 0 0 2024-04-03T08:39:08.007 INFO:tasks.workunit.client.0.smithi157.stdout:1/242: dread d2/d11/d24/f13 [4194304,4194304] 0 2024-04-03T08:39:08.008 INFO:tasks.workunit.client.0.smithi157.stdout:5/283: creat dc/d29/d56/d49/f5e x:0 0 0 2024-04-03T08:39:08.009 INFO:tasks.workunit.client.0.smithi157.stdout:1/243: chown d2/d11/d24/ld 15 1 2024-04-03T08:39:08.014 INFO:tasks.workunit.client.1.smithi181.stdout:3/61: symlink d0/d5/d6/dd/le 0 2024-04-03T08:39:08.015 INFO:tasks.workunit.client.0.smithi157.stdout:7/297: creat d0/d11/f71 x:0 0 0 2024-04-03T08:39:08.017 INFO:tasks.workunit.client.1.smithi181.stdout:1/54: creat d10/f11 x:0 0 0 2024-04-03T08:39:08.019 INFO:tasks.workunit.client.0.smithi157.stdout:8/264: mknod d2/d11/d10/d24/d5b/d2e/d56/c5f 0 2024-04-03T08:39:08.019 INFO:tasks.workunit.client.1.smithi181.stdout:9/170: dwrite d1/da/f1e [0,4194304] 0 2024-04-03T08:39:08.019 INFO:tasks.workunit.client.1.smithi181.stdout:6/82: mknod d6/df/c1e 0 2024-04-03T08:39:08.021 INFO:tasks.workunit.client.0.smithi157.stdout:5/284: dread dc/ff [0,4194304] 0 2024-04-03T08:39:08.021 INFO:tasks.workunit.client.1.smithi181.stdout:0/83: link d5/dc/l17 d5/d9/d13/l1a 0 2024-04-03T08:39:08.022 INFO:tasks.workunit.client.0.smithi157.stdout:8/265: read d2/f5a [297999,113223] 0 2024-04-03T08:39:08.026 INFO:tasks.workunit.client.0.smithi157.stdout:7/298: chown d0/d11/l4c 2210420 1 2024-04-03T08:39:08.028 INFO:tasks.workunit.client.0.smithi157.stdout:2/331: dread d3/f48 [0,4194304] 0 2024-04-03T08:39:08.029 INFO:tasks.workunit.client.1.smithi181.stdout:9/171: dread d1/da/d13/f29 [0,4194304] 0 2024-04-03T08:39:08.029 INFO:tasks.workunit.client.1.smithi181.stdout:2/109: dwrite d13/f19 [0,4194304] 0 2024-04-03T08:39:08.032 INFO:tasks.workunit.client.0.smithi157.stdout:7/299: dread d0/d11/f70 [0,4194304] 0 2024-04-03T08:39:08.032 INFO:tasks.workunit.client.1.smithi181.stdout:2/110: chown f12 5261 1 2024-04-03T08:39:08.035 INFO:tasks.workunit.client.1.smithi181.stdout:0/84: mknod d5/dc/c1b 0 2024-04-03T08:39:08.035 INFO:tasks.workunit.client.0.smithi157.stdout:8/266: creat d2/d20/f60 x:0 0 0 2024-04-03T08:39:08.041 INFO:tasks.workunit.client.0.smithi157.stdout:3/254: rename d8/d13/f36 to d8/d1e/d2d/f54 0 2024-04-03T08:39:08.043 INFO:tasks.workunit.client.0.smithi157.stdout:7/300: symlink d0/d4/d36/l72 0 2024-04-03T08:39:08.045 INFO:tasks.workunit.client.1.smithi181.stdout:0/85: fdatasync d5/dc/ff 0 2024-04-03T08:39:08.046 INFO:tasks.workunit.client.1.smithi181.stdout:1/55: dwrite fc [0,4194304] 0 2024-04-03T08:39:08.047 INFO:tasks.workunit.client.0.smithi157.stdout:5/285: rmdir dc/d29/d56/d18/d50 0 2024-04-03T08:39:08.048 INFO:tasks.workunit.client.0.smithi157.stdout:5/286: chown dc/c3d 733854434 1 2024-04-03T08:39:08.049 INFO:tasks.workunit.client.1.smithi181.stdout:2/111: creat d13/d22/d27/f2c x:0 0 0 2024-04-03T08:39:08.049 INFO:tasks.workunit.client.1.smithi181.stdout:6/83: getdents d6 0 2024-04-03T08:39:08.052 INFO:tasks.workunit.client.0.smithi157.stdout:5/287: creat dc/d29/f5f x:0 0 0 2024-04-03T08:39:08.055 INFO:tasks.workunit.client.1.smithi181.stdout:6/84: chown d6/d7/fb 6 1 2024-04-03T08:39:08.056 INFO:tasks.workunit.client.1.smithi181.stdout:6/85: stat d6/d7 0 2024-04-03T08:39:08.058 INFO:tasks.workunit.client.1.smithi181.stdout:2/112: mknod d13/d1d/c2d 0 2024-04-03T08:39:08.058 INFO:tasks.workunit.client.1.smithi181.stdout:9/172: dread d1/da/d13/d22/f2e [0,4194304] 0 2024-04-03T08:39:08.059 INFO:tasks.workunit.client.0.smithi157.stdout:5/288: truncate dc/d29/d56/d49/f5e 126249 0 2024-04-03T08:39:08.060 INFO:tasks.workunit.client.1.smithi181.stdout:2/113: write d13/f23 [845401,12863] 0 2024-04-03T08:39:08.061 INFO:tasks.workunit.client.0.smithi157.stdout:3/255: dread d8/d1e/d2d/d39/d51/d4c/d32/f42 [0,4194304] 0 2024-04-03T08:39:08.061 INFO:tasks.workunit.client.1.smithi181.stdout:6/86: chown d6/d7/fb 14981 1 2024-04-03T08:39:08.063 INFO:tasks.workunit.client.1.smithi181.stdout:6/87: write d6/f13 [227762,7290] 0 2024-04-03T08:39:08.065 INFO:tasks.workunit.client.0.smithi157.stdout:8/267: dread d2/d11/d10/d24/d5b/f1c [0,4194304] 0 2024-04-03T08:39:08.066 INFO:tasks.workunit.client.0.smithi157.stdout:7/301: dwrite d0/d4/f65 [0,4194304] 0 2024-04-03T08:39:08.071 INFO:tasks.workunit.client.1.smithi181.stdout:1/56: link ca d10/c12 0 2024-04-03T08:39:08.074 INFO:tasks.workunit.client.1.smithi181.stdout:6/88: mknod d6/df/c1f 0 2024-04-03T08:39:08.079 INFO:tasks.workunit.client.1.smithi181.stdout:2/114: link lc d13/l2e 0 2024-04-03T08:39:08.080 INFO:tasks.workunit.client.0.smithi157.stdout:3/256: symlink d8/d13/l55 0 2024-04-03T08:39:08.080 INFO:tasks.workunit.client.0.smithi157.stdout:5/289: dread dc/f4b [0,4194304] 0 2024-04-03T08:39:08.082 INFO:tasks.workunit.client.1.smithi181.stdout:6/89: creat d6/d7/f20 x:0 0 0 2024-04-03T08:39:08.085 INFO:tasks.workunit.client.1.smithi181.stdout:2/115: stat f11 0 2024-04-03T08:39:08.088 INFO:tasks.workunit.client.0.smithi157.stdout:8/268: dwrite d2/d11/d10/f48 [0,4194304] 0 2024-04-03T08:39:08.088 INFO:tasks.workunit.client.0.smithi157.stdout:5/290: rename dc/d29/d56/d18/c3b to dc/d29/d56/d49/d53/c60 0 2024-04-03T08:39:08.093 INFO:tasks.workunit.client.0.smithi157.stdout:7/302: dwrite d0/d11/f1d [0,4194304] 0 2024-04-03T08:39:08.093 INFO:tasks.workunit.client.1.smithi181.stdout:0/86: dwrite d5/dc/f12 [0,4194304] 0 2024-04-03T08:39:08.094 INFO:tasks.workunit.client.1.smithi181.stdout:2/116: unlink d13/l29 0 2024-04-03T08:39:08.096 INFO:tasks.workunit.client.1.smithi181.stdout:6/90: fdatasync d6/d7/d9/fe 0 2024-04-03T08:39:08.097 INFO:tasks.workunit.client.1.smithi181.stdout:7/79: sync 2024-04-03T08:39:08.098 INFO:tasks.workunit.client.0.smithi157.stdout:8/269: rmdir d2/d11/d10/d24/d5b/d2e 39 2024-04-03T08:39:08.098 INFO:tasks.workunit.client.1.smithi181.stdout:0/87: stat d5/c7 0 2024-04-03T08:39:08.099 INFO:tasks.workunit.client.1.smithi181.stdout:2/117: chown d13/l17 205 1 2024-04-03T08:39:08.100 INFO:tasks.workunit.client.1.smithi181.stdout:9/173: dwrite d1/da/d13/f2d [0,4194304] 0 2024-04-03T08:39:08.102 INFO:tasks.workunit.client.0.smithi157.stdout:8/270: readlink d2/l34 0 2024-04-03T08:39:08.103 INFO:tasks.workunit.client.1.smithi181.stdout:0/88: fdatasync d5/dc/f18 0 2024-04-03T08:39:08.105 INFO:tasks.workunit.client.0.smithi157.stdout:6/278: sync 2024-04-03T08:39:08.105 INFO:tasks.workunit.client.1.smithi181.stdout:1/57: dwrite fc [4194304,4194304] 0 2024-04-03T08:39:08.106 INFO:tasks.workunit.client.1.smithi181.stdout:0/89: read d5/dc/f12 [4083579,42403] 0 2024-04-03T08:39:08.108 INFO:tasks.workunit.client.1.smithi181.stdout:1/58: fsync f9 0 2024-04-03T08:39:08.109 INFO:tasks.workunit.client.1.smithi181.stdout:2/118: mkdir d13/d22/d27/d2f 0 2024-04-03T08:39:08.109 INFO:tasks.workunit.client.1.smithi181.stdout:1/59: fdatasync fb 0 2024-04-03T08:39:08.110 INFO:tasks.workunit.client.0.smithi157.stdout:3/257: dwrite d8/f17 [0,4194304] 0 2024-04-03T08:39:08.115 INFO:tasks.workunit.client.0.smithi157.stdout:7/303: rename d0/d11/d15/f4d to d0/d11/d15/d1b/f73 0 2024-04-03T08:39:08.115 INFO:tasks.workunit.client.0.smithi157.stdout:3/258: write d8/f9 [5083227,67075] 0 2024-04-03T08:39:08.115 INFO:tasks.workunit.client.1.smithi181.stdout:7/80: rename d0/c4 to d0/d1/d6/c18 0 2024-04-03T08:39:08.117 INFO:tasks.workunit.client.0.smithi157.stdout:5/291: link dc/d29/d56/d18/f37 dc/d29/d56/d18/d21/f61 0 2024-04-03T08:39:08.122 INFO:tasks.workunit.client.1.smithi181.stdout:0/90: dread - d5/d9/fd zero size 2024-04-03T08:39:08.125 INFO:tasks.workunit.client.0.smithi157.stdout:6/279: unlink d1/f3a 0 2024-04-03T08:39:08.126 INFO:tasks.workunit.client.1.smithi181.stdout:3/62: sync 2024-04-03T08:39:08.126 INFO:tasks.workunit.client.1.smithi181.stdout:5/121: sync 2024-04-03T08:39:08.126 INFO:tasks.workunit.client.1.smithi181.stdout:8/55: sync 2024-04-03T08:39:08.127 INFO:tasks.workunit.client.1.smithi181.stdout:4/97: sync 2024-04-03T08:39:08.127 INFO:tasks.workunit.client.1.smithi181.stdout:6/91: dwrite d6/d7/d9/f19 [0,4194304] 0 2024-04-03T08:39:08.129 INFO:tasks.workunit.client.0.smithi157.stdout:8/271: dread d2/f39 [0,4194304] 0 2024-04-03T08:39:08.134 INFO:tasks.workunit.client.1.smithi181.stdout:6/92: write d6/f17 [170871,22103] 0 2024-04-03T08:39:08.139 INFO:tasks.workunit.client.1.smithi181.stdout:9/174: rename d1/d34/f3a to d1/da/d13/d22/f3b 0 2024-04-03T08:39:08.140 INFO:tasks.workunit.client.1.smithi181.stdout:6/93: read d6/f13 [53961,37217] 0 2024-04-03T08:39:08.141 INFO:tasks.workunit.client.0.smithi157.stdout:7/304: write d0/d4/f10 [234868,25769] 0 2024-04-03T08:39:08.149 INFO:tasks.workunit.client.1.smithi181.stdout:9/175: write d1/da/f12 [2384117,128476] 0 2024-04-03T08:39:08.149 INFO:tasks.workunit.client.1.smithi181.stdout:7/81: creat d0/d1/f19 x:0 0 0 2024-04-03T08:39:08.149 INFO:tasks.workunit.client.0.smithi157.stdout:8/272: fdatasync d2/f39 0 2024-04-03T08:39:08.152 INFO:tasks.workunit.client.0.smithi157.stdout:6/280: dread d1/ff [0,4194304] 0 2024-04-03T08:39:08.153 INFO:tasks.workunit.client.1.smithi181.stdout:5/122: truncate d4/d18/d25/f19 4967142 0 2024-04-03T08:39:08.153 INFO:tasks.workunit.client.0.smithi157.stdout:6/281: readlink d1/l15 0 2024-04-03T08:39:08.159 INFO:tasks.workunit.client.1.smithi181.stdout:4/98: write d1/d16/f17 [1152502,29916] 0 2024-04-03T08:39:08.160 INFO:tasks.workunit.client.0.smithi157.stdout:6/282: truncate d1/d5/d1b/f41 687203 0 2024-04-03T08:39:08.161 INFO:tasks.workunit.client.0.smithi157.stdout:8/273: fdatasync d2/f39 0 2024-04-03T08:39:08.162 INFO:tasks.workunit.client.0.smithi157.stdout:3/259: rename d8/f19 to d8/d13/f56 0 2024-04-03T08:39:08.165 INFO:tasks.workunit.client.0.smithi157.stdout:7/305: creat d0/d11/f74 x:0 0 0 2024-04-03T08:39:08.166 INFO:tasks.workunit.client.1.smithi181.stdout:3/63: rename d0/f4 to d0/d5/d6/dd/ff 0 2024-04-03T08:39:08.166 INFO:tasks.workunit.client.0.smithi157.stdout:6/283: chown d1/d5/d17/d2a/d30/c3f 78 1 2024-04-03T08:39:08.166 INFO:tasks.workunit.client.0.smithi157.stdout:3/260: truncate d8/f2c 23042 0 2024-04-03T08:39:08.168 INFO:tasks.workunit.client.1.smithi181.stdout:1/60: truncate f9 796218 0 2024-04-03T08:39:08.168 INFO:tasks.workunit.client.0.smithi157.stdout:3/261: write d8/f2c [580705,108790] 0 2024-04-03T08:39:08.170 INFO:tasks.workunit.client.0.smithi157.stdout:5/292: dread dc/d35/f40 [0,4194304] 0 2024-04-03T08:39:08.176 INFO:tasks.workunit.client.1.smithi181.stdout:0/91: truncate d5/dc/f18 2276214 0 2024-04-03T08:39:08.177 INFO:tasks.workunit.client.1.smithi181.stdout:7/82: symlink d0/d1/d6/de/l1a 0 2024-04-03T08:39:08.178 INFO:tasks.workunit.client.0.smithi157.stdout:6/284: mkdir d1/d4b/d38/d59 0 2024-04-03T08:39:08.179 INFO:tasks.workunit.client.1.smithi181.stdout:1/61: dread f2 [0,4194304] 0 2024-04-03T08:39:08.185 INFO:tasks.workunit.client.1.smithi181.stdout:8/56: creat d4/d6/db/fd x:0 0 0 2024-04-03T08:39:08.186 INFO:tasks.workunit.client.0.smithi157.stdout:7/306: mkdir d0/d75 0 2024-04-03T08:39:08.186 INFO:tasks.workunit.client.1.smithi181.stdout:8/57: write d4/fc [935055,128179] 0 2024-04-03T08:39:08.188 INFO:tasks.workunit.client.1.smithi181.stdout:8/58: stat d4/d6/d9 0 2024-04-03T08:39:08.188 INFO:tasks.workunit.client.0.smithi157.stdout:8/274: mknod d2/d11/d10/d24/d5b/c61 0 2024-04-03T08:39:08.189 INFO:tasks.workunit.client.0.smithi157.stdout:7/307: write d0/d11/d15/d17/d1c/f28 [1026309,9723] 0 2024-04-03T08:39:08.191 INFO:tasks.workunit.client.0.smithi157.stdout:6/285: unlink d1/d5/c1e 0 2024-04-03T08:39:08.193 INFO:tasks.workunit.client.1.smithi181.stdout:8/59: write d4/fc [16474,60225] 0 2024-04-03T08:39:08.193 INFO:tasks.workunit.client.1.smithi181.stdout:4/99: rename d1/c14 to d1/d16/c22 0 2024-04-03T08:39:08.194 INFO:tasks.workunit.client.0.smithi157.stdout:6/286: chown d1/d5/d17/d2a/d37/c33 238658613 1 2024-04-03T08:39:08.196 INFO:tasks.workunit.client.1.smithi181.stdout:3/64: unlink d0/c8 0 2024-04-03T08:39:08.199 INFO:tasks.workunit.client.1.smithi181.stdout:8/60: write d4/d6/f7 [794349,70832] 0 2024-04-03T08:39:08.199 INFO:tasks.workunit.client.1.smithi181.stdout:0/92: rmdir d5/dc/d14 39 2024-04-03T08:39:08.201 INFO:tasks.workunit.client.1.smithi181.stdout:2/119: getdents d13/d22/d27 0 2024-04-03T08:39:08.202 INFO:tasks.workunit.client.0.smithi157.stdout:5/293: creat dc/f62 x:0 0 0 2024-04-03T08:39:08.203 INFO:tasks.workunit.client.1.smithi181.stdout:5/123: mknod d4/c29 0 2024-04-03T08:39:08.204 INFO:tasks.workunit.client.0.smithi157.stdout:8/275: dread d2/f5a [0,4194304] 0 2024-04-03T08:39:08.205 INFO:tasks.workunit.client.1.smithi181.stdout:1/62: dwrite fb [0,4194304] 0 2024-04-03T08:39:08.205 INFO:tasks.workunit.client.0.smithi157.stdout:6/287: write d1/f42 [700990,64298] 0 2024-04-03T08:39:08.205 INFO:tasks.workunit.client.0.smithi157.stdout:3/262: rename d8/d1e/d2d/d30/f4b to d8/f57 0 2024-04-03T08:39:08.212 INFO:tasks.workunit.client.1.smithi181.stdout:4/100: creat d1/d16/f23 x:0 0 0 2024-04-03T08:39:08.216 INFO:tasks.workunit.client.0.smithi157.stdout:8/276: symlink d2/d20/d23/l62 0 2024-04-03T08:39:08.218 INFO:tasks.workunit.client.1.smithi181.stdout:3/65: write d0/d5/d6/dd/ff [853024,75002] 0 2024-04-03T08:39:08.222 INFO:tasks.workunit.client.1.smithi181.stdout:8/61: symlink d4/d6/le 0 2024-04-03T08:39:08.222 INFO:tasks.workunit.client.1.smithi181.stdout:8/62: chown d4 13313 1 2024-04-03T08:39:08.224 INFO:tasks.workunit.client.1.smithi181.stdout:0/93: write d5/dc/f12 [1813051,87601] 0 2024-04-03T08:39:08.226 INFO:tasks.workunit.client.1.smithi181.stdout:8/63: truncate d4/d6/db/fd 926104 0 2024-04-03T08:39:08.227 INFO:tasks.workunit.client.1.smithi181.stdout:2/120: mknod d13/d1c/c30 0 2024-04-03T08:39:08.229 INFO:tasks.workunit.client.0.smithi157.stdout:5/294: dwrite dc/d29/d43/f48 [0,4194304] 0 2024-04-03T08:39:08.230 INFO:tasks.workunit.client.1.smithi181.stdout:9/176: getdents d1/da/d13 0 2024-04-03T08:39:08.231 INFO:tasks.workunit.client.1.smithi181.stdout:2/121: write ff [1870217,79048] 0 2024-04-03T08:39:08.232 INFO:tasks.workunit.client.1.smithi181.stdout:2/122: stat c6 0 2024-04-03T08:39:08.232 INFO:tasks.workunit.client.0.smithi157.stdout:6/288: creat d1/d5/d17/d29/f5a x:0 0 0 2024-04-03T08:39:08.232 INFO:tasks.workunit.client.0.smithi157.stdout:7/308: dread d0/d11/d15/d17/f25 [0,4194304] 0 2024-04-03T08:39:08.233 INFO:tasks.workunit.client.1.smithi181.stdout:4/101: chown d1/c9 14 1 2024-04-03T08:39:08.234 INFO:tasks.workunit.client.0.smithi157.stdout:5/295: dread - dc/d29/d56/d18/d21/f61 zero size 2024-04-03T08:39:08.235 INFO:tasks.workunit.client.1.smithi181.stdout:4/102: chown d1/c9 204 1 2024-04-03T08:39:08.236 INFO:tasks.workunit.client.1.smithi181.stdout:4/103: chown d1/c19 0 1 2024-04-03T08:39:08.237 INFO:tasks.workunit.client.0.smithi157.stdout:3/263: creat d8/d1e/f58 x:0 0 0 2024-04-03T08:39:08.243 INFO:tasks.workunit.client.0.smithi157.stdout:7/309: chown d0/d11/d15/d17/d1c/f37 192 1 2024-04-03T08:39:08.243 INFO:tasks.workunit.client.0.smithi157.stdout:3/264: read d8/d1e/d2d/d39/d51/d4c/f29 [157784,77336] 0 2024-04-03T08:39:08.243 INFO:tasks.workunit.client.1.smithi181.stdout:5/124: dread d4/ff [0,4194304] 0 2024-04-03T08:39:08.245 INFO:tasks.workunit.client.1.smithi181.stdout:8/64: dread d4/d6/db/fd [0,4194304] 0 2024-04-03T08:39:08.250 INFO:tasks.workunit.client.0.smithi157.stdout:5/296: creat dc/d29/d56/d18/f63 x:0 0 0 2024-04-03T08:39:08.250 INFO:tasks.workunit.client.1.smithi181.stdout:9/177: rmdir d1/da/d28 39 2024-04-03T08:39:08.252 INFO:tasks.workunit.client.0.smithi157.stdout:6/289: mkdir d1/d5/d17/d2a/d5b 0 2024-04-03T08:39:08.253 INFO:tasks.workunit.client.1.smithi181.stdout:2/123: mknod d13/d22/d27/c31 0 2024-04-03T08:39:08.255 INFO:tasks.workunit.client.0.smithi157.stdout:3/265: creat d8/d13/d1b/d4e/d50/f59 x:0 0 0 2024-04-03T08:39:08.256 INFO:tasks.workunit.client.1.smithi181.stdout:4/104: mkdir d1/d16/d24 0 2024-04-03T08:39:08.256 INFO:tasks.workunit.client.0.smithi157.stdout:6/290: truncate d1/d5/d17/d2a/d37/f3b 664698 0 2024-04-03T08:39:08.257 INFO:tasks.workunit.client.1.smithi181.stdout:4/105: fsync d1/d16/f12 0 2024-04-03T08:39:08.258 INFO:tasks.workunit.client.0.smithi157.stdout:8/277: rename d2/d11/d10/d24/d5b/d2e/d56/f5d to d2/f63 0 2024-04-03T08:39:08.259 INFO:tasks.workunit.client.0.smithi157.stdout:6/291: truncate d1/d5/d1b/f54 410970 0 2024-04-03T08:39:08.260 INFO:tasks.workunit.client.0.smithi157.stdout:7/310: mkdir d0/d11/d6f/d76 0 2024-04-03T08:39:08.261 INFO:tasks.workunit.client.0.smithi157.stdout:8/278: write d2/d11/f3e [218735,123850] 0 2024-04-03T08:39:08.261 INFO:tasks.workunit.client.1.smithi181.stdout:3/66: truncate d0/f3 2079975 0 2024-04-03T08:39:08.264 INFO:tasks.workunit.client.0.smithi157.stdout:8/279: stat d2/d11/l4d 0 2024-04-03T08:39:08.266 INFO:tasks.workunit.client.1.smithi181.stdout:8/65: mkdir d4/d6/db/df 0 2024-04-03T08:39:08.266 INFO:tasks.workunit.client.0.smithi157.stdout:6/292: dread d1/d4b/f57 [0,4194304] 0 2024-04-03T08:39:08.267 INFO:tasks.workunit.client.0.smithi157.stdout:7/311: write d0/d11/d15/d35/f50 [294712,85211] 0 2024-04-03T08:39:08.268 INFO:tasks.workunit.client.1.smithi181.stdout:8/66: write d4/d6/f7 [1494814,53369] 0 2024-04-03T08:39:08.268 INFO:tasks.workunit.client.1.smithi181.stdout:2/124: symlink d13/l32 0 2024-04-03T08:39:08.272 INFO:tasks.workunit.client.0.smithi157.stdout:8/280: fdatasync d2/d11/d10/d24/d5b/d2e/f3f 0 2024-04-03T08:39:08.272 INFO:tasks.workunit.client.0.smithi157.stdout:5/297: dwrite dc/d29/d56/f4d [0,4194304] 0 2024-04-03T08:39:08.273 INFO:tasks.workunit.client.1.smithi181.stdout:0/94: link d5/c7 d5/d9/c1c 0 2024-04-03T08:39:08.273 INFO:tasks.workunit.client.1.smithi181.stdout:0/95: chown d5/d9 423558 1 2024-04-03T08:39:08.275 INFO:tasks.workunit.client.0.smithi157.stdout:3/266: link d8/f9 d8/d1e/d2d/d3b/f5a 0 2024-04-03T08:39:08.276 INFO:tasks.workunit.client.1.smithi181.stdout:3/67: chown d0/d5/fa 1808894554 1 2024-04-03T08:39:08.278 INFO:tasks.workunit.client.0.smithi157.stdout:6/293: creat d1/d5/d1b/d2c/f5c x:0 0 0 2024-04-03T08:39:08.279 INFO:tasks.workunit.client.1.smithi181.stdout:1/63: link d10/c12 d10/c13 0 2024-04-03T08:39:08.282 INFO:tasks.workunit.client.1.smithi181.stdout:5/125: symlink d4/d22/l2a 0 2024-04-03T08:39:08.284 INFO:tasks.workunit.client.0.smithi157.stdout:5/298: creat dc/d29/d51/f64 x:0 0 0 2024-04-03T08:39:08.286 INFO:tasks.workunit.client.0.smithi157.stdout:4/295: sync 2024-04-03T08:39:08.286 INFO:tasks.workunit.client.0.smithi157.stdout:0/295: sync 2024-04-03T08:39:08.287 INFO:tasks.workunit.client.0.smithi157.stdout:3/267: mkdir d8/d13/d1b/d5b 0 2024-04-03T08:39:08.291 INFO:tasks.workunit.client.0.smithi157.stdout:8/281: rename d2/d11/d10/d24/f2a to d2/d11/d10/d24/d5b/d2e/f64 0 2024-04-03T08:39:08.293 INFO:tasks.workunit.client.1.smithi181.stdout:4/106: symlink d1/d16/d24/l25 0 2024-04-03T08:39:08.294 INFO:tasks.workunit.client.0.smithi157.stdout:6/294: fsync d1/d5/d17/d2a/d37/f25 0 2024-04-03T08:39:08.294 INFO:tasks.workunit.client.1.smithi181.stdout:8/67: rename d4/la to d4/d6/db/l10 0 2024-04-03T08:39:08.295 INFO:tasks.workunit.client.0.smithi157.stdout:7/312: creat d0/d11/d15/d17/f77 x:0 0 0 2024-04-03T08:39:08.296 INFO:tasks.workunit.client.1.smithi181.stdout:8/68: read d4/d6/f8 [247722,88002] 0 2024-04-03T08:39:08.297 INFO:tasks.workunit.client.0.smithi157.stdout:5/299: creat dc/d29/d56/d18/d21/f65 x:0 0 0 2024-04-03T08:39:08.300 INFO:tasks.workunit.client.1.smithi181.stdout:1/64: mknod d10/c14 0 2024-04-03T08:39:08.300 INFO:tasks.workunit.client.1.smithi181.stdout:1/65: readlink le 0 2024-04-03T08:39:08.302 INFO:tasks.workunit.client.0.smithi157.stdout:4/296: symlink da/df/d2f/d54/l62 0 2024-04-03T08:39:08.303 INFO:tasks.workunit.client.0.smithi157.stdout:9/243: sync 2024-04-03T08:39:08.303 INFO:tasks.workunit.client.0.smithi157.stdout:2/332: sync 2024-04-03T08:39:08.303 INFO:tasks.workunit.client.0.smithi157.stdout:1/244: sync 2024-04-03T08:39:08.305 INFO:tasks.workunit.client.0.smithi157.stdout:8/282: creat d2/d20/f65 x:0 0 0 2024-04-03T08:39:08.306 INFO:tasks.workunit.client.1.smithi181.stdout:6/94: sync 2024-04-03T08:39:08.306 INFO:tasks.workunit.client.1.smithi181.stdout:9/178: symlink d1/da/d28/d30/l3c 0 2024-04-03T08:39:08.306 INFO:tasks.workunit.client.0.smithi157.stdout:3/268: dwrite d8/d1e/d2d/d39/d51/d4c/f40 [0,4194304] 0 2024-04-03T08:39:08.307 INFO:tasks.workunit.client.0.smithi157.stdout:9/244: write d1/f5 [2516777,61378] 0 2024-04-03T08:39:08.309 INFO:tasks.workunit.client.1.smithi181.stdout:4/107: mknod d1/d16/d24/c26 0 2024-04-03T08:39:08.309 INFO:tasks.workunit.client.0.smithi157.stdout:2/333: write d3/d12/f11 [1000857,27858] 0 2024-04-03T08:39:08.310 INFO:tasks.workunit.client.1.smithi181.stdout:4/108: chown d1/c1b 54819077 1 2024-04-03T08:39:08.316 INFO:tasks.workunit.client.0.smithi157.stdout:6/295: write d1/fb [3676845,121500] 0 2024-04-03T08:39:08.318 INFO:tasks.workunit.client.0.smithi157.stdout:8/283: dread d2/d20/d23/f41 [0,4194304] 0 2024-04-03T08:39:08.319 INFO:tasks.workunit.client.1.smithi181.stdout:6/95: dread d6/d7/d9/f15 [0,4194304] 0 2024-04-03T08:39:08.319 INFO:tasks.workunit.client.1.smithi181.stdout:2/125: symlink d13/d22/d27/d2f/l33 0 2024-04-03T08:39:08.320 INFO:tasks.workunit.client.1.smithi181.stdout:2/126: fdatasync f0 0 2024-04-03T08:39:08.323 INFO:tasks.workunit.client.1.smithi181.stdout:3/68: unlink d0/d5/d6/dd/ff 0 2024-04-03T08:39:08.326 INFO:tasks.workunit.client.0.smithi157.stdout:4/297: mkdir da/df/d24/d35/d3c/d63 0 2024-04-03T08:39:08.329 INFO:tasks.workunit.client.1.smithi181.stdout:9/179: creat d1/da/d13/f3d x:0 0 0 2024-04-03T08:39:08.330 INFO:tasks.workunit.client.1.smithi181.stdout:9/180: fdatasync d1/d34/f37 0 2024-04-03T08:39:08.332 INFO:tasks.workunit.client.1.smithi181.stdout:4/109: creat d1/d16/f27 x:0 0 0 2024-04-03T08:39:08.332 INFO:tasks.workunit.client.1.smithi181.stdout:4/110: stat d1/d1e 0 2024-04-03T08:39:08.334 INFO:tasks.workunit.client.1.smithi181.stdout:0/96: rename d5/dc/f18 to d5/d9/f1d 0 2024-04-03T08:39:08.335 INFO:tasks.workunit.client.1.smithi181.stdout:6/96: dread d6/d7/d9/f19 [0,4194304] 0 2024-04-03T08:39:08.336 INFO:tasks.workunit.client.0.smithi157.stdout:2/334: rename d3/d2e/f6b to d3/db/d44/f71 0 2024-04-03T08:39:08.340 INFO:tasks.workunit.client.0.smithi157.stdout:7/313: link d0/d5/f3a d0/d4/d36/f78 0 2024-04-03T08:39:08.340 INFO:tasks.workunit.client.0.smithi157.stdout:2/335: write d3/d12/d43/d4b/d55/f59 [1031621,121960] 0 2024-04-03T08:39:08.341 INFO:tasks.workunit.client.1.smithi181.stdout:8/69: creat d4/d6/d9/f11 x:0 0 0 2024-04-03T08:39:08.343 INFO:tasks.workunit.client.0.smithi157.stdout:0/296: rmdir d2/d9/dc/d54 39 2024-04-03T08:39:08.345 INFO:tasks.workunit.client.0.smithi157.stdout:6/296: rmdir d1/d5/d17/d2a/d30 39 2024-04-03T08:39:08.346 INFO:tasks.workunit.client.0.smithi157.stdout:5/300: dwrite f7 [0,4194304] 0 2024-04-03T08:39:08.346 INFO:tasks.workunit.client.0.smithi157.stdout:9/245: dwrite d1/d15/d16/f2a [0,4194304] 0 2024-04-03T08:39:08.348 INFO:tasks.workunit.client.0.smithi157.stdout:6/297: dread - d1/d5/d17/d29/f5a zero size 2024-04-03T08:39:08.349 INFO:tasks.workunit.client.0.smithi157.stdout:0/297: read d2/d9/fe [76906,93399] 0 2024-04-03T08:39:08.349 INFO:tasks.workunit.client.0.smithi157.stdout:2/336: write d3/db/d44/f5b [661493,89977] 0 2024-04-03T08:39:08.353 INFO:tasks.workunit.client.0.smithi157.stdout:1/245: link d2/d11/f26 d2/d11/d24/d39/f54 0 2024-04-03T08:39:08.355 INFO:tasks.workunit.client.0.smithi157.stdout:3/269: creat d8/d1e/d2d/d39/d51/d48/f5c x:0 0 0 2024-04-03T08:39:08.356 INFO:tasks.workunit.client.0.smithi157.stdout:7/314: fdatasync d0/d11/d15/d17/d52/f54 0 2024-04-03T08:39:08.357 INFO:tasks.workunit.client.1.smithi181.stdout:4/111: fdatasync d1/f7 0 2024-04-03T08:39:08.360 INFO:tasks.workunit.client.0.smithi157.stdout:7/315: dread d0/d11/f70 [0,4194304] 0 2024-04-03T08:39:08.360 INFO:tasks.workunit.client.1.smithi181.stdout:5/126: dwrite d4/f13 [0,4194304] 0 2024-04-03T08:39:08.361 INFO:tasks.workunit.client.0.smithi157.stdout:9/246: creat d1/d4a/f52 x:0 0 0 2024-04-03T08:39:08.362 INFO:tasks.workunit.client.0.smithi157.stdout:5/301: dread dc/d29/d56/f27 [0,4194304] 0 2024-04-03T08:39:08.363 INFO:tasks.workunit.client.1.smithi181.stdout:6/97: creat d6/d7/d9/f21 x:0 0 0 2024-04-03T08:39:08.364 INFO:tasks.workunit.client.0.smithi157.stdout:2/337: mknod d3/db/c72 0 2024-04-03T08:39:08.366 INFO:tasks.workunit.client.0.smithi157.stdout:6/298: creat d1/d5/d17/d2a/d40/f5d x:0 0 0 2024-04-03T08:39:08.368 INFO:tasks.workunit.client.0.smithi157.stdout:3/270: symlink d8/d1e/d2d/d3f/l5d 0 2024-04-03T08:39:08.370 INFO:tasks.workunit.client.1.smithi181.stdout:8/70: mknod d4/d6/db/c12 0 2024-04-03T08:39:08.370 INFO:tasks.workunit.client.1.smithi181.stdout:0/97: fdatasync d5/fb 0 2024-04-03T08:39:08.371 INFO:tasks.workunit.client.0.smithi157.stdout:8/284: link d2/d20/l44 d2/d11/d10/d24/d5b/d2e/d56/d59/l66 0 2024-04-03T08:39:08.373 INFO:tasks.workunit.client.1.smithi181.stdout:6/98: mkdir d6/d7/d9/d22 0 2024-04-03T08:39:08.376 INFO:tasks.workunit.client.0.smithi157.stdout:7/316: rename d0/d4/d36/f49 to d0/d4/d36/f79 0 2024-04-03T08:39:08.379 INFO:tasks.workunit.client.0.smithi157.stdout:0/298: mkdir d2/d9/d51/d63/d71 0 2024-04-03T08:39:08.380 INFO:tasks.workunit.client.1.smithi181.stdout:8/71: creat d4/d6/db/f13 x:0 0 0 2024-04-03T08:39:08.380 INFO:tasks.workunit.client.0.smithi157.stdout:5/302: creat dc/d29/d43/f66 x:0 0 0 2024-04-03T08:39:08.382 INFO:tasks.workunit.client.0.smithi157.stdout:2/338: rename d3/db/f1b to d3/d12/d43/d4b/f73 0 2024-04-03T08:39:08.385 INFO:tasks.workunit.client.0.smithi157.stdout:6/299: write d1/d5/d17/f4e [1208985,63543] 0 2024-04-03T08:39:08.385 INFO:tasks.workunit.client.0.smithi157.stdout:8/285: fdatasync d2/d11/f1d 0 2024-04-03T08:39:08.388 INFO:tasks.workunit.client.0.smithi157.stdout:4/298: getdents da/df/d2f/d54 0 2024-04-03T08:39:08.390 INFO:tasks.workunit.client.1.smithi181.stdout:0/98: rmdir d5/dc 39 2024-04-03T08:39:08.392 INFO:tasks.workunit.client.1.smithi181.stdout:0/99: dread - d5/d9/fd zero size 2024-04-03T08:39:08.393 INFO:tasks.workunit.client.1.smithi181.stdout:6/99: getdents d6/d7/d9/d22 0 2024-04-03T08:39:08.393 INFO:tasks.workunit.client.0.smithi157.stdout:0/299: fsync d2/f2c 0 2024-04-03T08:39:08.398 INFO:tasks.workunit.client.0.smithi157.stdout:5/303: dwrite dc/d29/d56/f4d [0,4194304] 0 2024-04-03T08:39:08.398 INFO:tasks.workunit.client.1.smithi181.stdout:0/100: dread - d5/d9/fd zero size 2024-04-03T08:39:08.399 INFO:tasks.workunit.client.0.smithi157.stdout:7/317: rename d0/c3 to d0/d4/d36/c7a 0 2024-04-03T08:39:08.399 INFO:tasks.workunit.client.1.smithi181.stdout:1/66: write f9 [1065747,78931] 0 2024-04-03T08:39:08.400 INFO:tasks.workunit.client.0.smithi157.stdout:7/318: chown d0/d11/d15/d35 1613 1 2024-04-03T08:39:08.401 INFO:tasks.workunit.client.1.smithi181.stdout:5/127: dwrite d4/f8 [0,4194304] 0 2024-04-03T08:39:08.409 INFO:tasks.workunit.client.0.smithi157.stdout:4/299: mkdir da/df/d2f/d64 0 2024-04-03T08:39:08.412 INFO:tasks.workunit.client.1.smithi181.stdout:5/128: readlink d4/l1f 0 2024-04-03T08:39:08.412 INFO:tasks.workunit.client.1.smithi181.stdout:1/67: mkdir d10/d15 0 2024-04-03T08:39:08.414 INFO:tasks.workunit.client.0.smithi157.stdout:7/319: dread d0/d4/d36/f78 [0,4194304] 0 2024-04-03T08:39:08.415 INFO:tasks.workunit.client.1.smithi181.stdout:1/68: readlink le 0 2024-04-03T08:39:08.417 INFO:tasks.workunit.client.0.smithi157.stdout:1/246: getdents d2/d11/d24 0 2024-04-03T08:39:08.418 INFO:tasks.workunit.client.0.smithi157.stdout:2/339: mknod d3/d2e/d32/d3c/c74 0 2024-04-03T08:39:08.427 INFO:tasks.workunit.client.0.smithi157.stdout:0/300: write d2/d9/dc/df/d1b/d4a/f20 [5014428,20462] 0 2024-04-03T08:39:08.428 INFO:tasks.workunit.client.1.smithi181.stdout:3/69: dwrite d0/d5/fa [0,4194304] 0 2024-04-03T08:39:08.432 INFO:tasks.workunit.client.1.smithi181.stdout:8/72: rmdir d4/d6/db 39 2024-04-03T08:39:08.432 INFO:tasks.workunit.client.0.smithi157.stdout:3/271: dread d8/d13/f1c [0,4194304] 0 2024-04-03T08:39:08.432 INFO:tasks.workunit.client.0.smithi157.stdout:9/247: write d1/d15/d27/f32 [2964997,113403] 0 2024-04-03T08:39:08.434 INFO:tasks.workunit.client.1.smithi181.stdout:9/181: dwrite d1/f6 [0,4194304] 0 2024-04-03T08:39:08.435 INFO:tasks.workunit.client.0.smithi157.stdout:3/272: truncate f4 9178638 0 2024-04-03T08:39:08.438 INFO:tasks.workunit.client.0.smithi157.stdout:1/247: dwrite d2/d11/d24/d39/d3b/d1b/f2a [0,4194304] 0 2024-04-03T08:39:08.438 INFO:tasks.workunit.client.0.smithi157.stdout:5/304: creat dc/f67 x:0 0 0 2024-04-03T08:39:08.439 INFO:tasks.workunit.client.0.smithi157.stdout:3/273: stat d8/fc 0 2024-04-03T08:39:08.440 INFO:tasks.workunit.client.1.smithi181.stdout:3/70: mknod d0/d5/c10 0 2024-04-03T08:39:08.440 INFO:tasks.workunit.client.1.smithi181.stdout:6/100: write d6/f13 [404009,62395] 0 2024-04-03T08:39:08.444 INFO:tasks.workunit.client.0.smithi157.stdout:9/248: creat d1/d15/d27/d34/f53 x:0 0 0 2024-04-03T08:39:08.447 INFO:tasks.workunit.client.0.smithi157.stdout:5/305: write dc/d29/f5f [982411,106124] 0 2024-04-03T08:39:08.450 INFO:tasks.workunit.client.0.smithi157.stdout:2/340: link d3/d12/f63 d3/d2e/f75 0 2024-04-03T08:39:08.452 INFO:tasks.workunit.client.1.smithi181.stdout:9/182: chown d1/da/d16/c24 141687872 1 2024-04-03T08:39:08.454 INFO:tasks.workunit.client.1.smithi181.stdout:4/112: dwrite d1/d1e/f1a [0,4194304] 0 2024-04-03T08:39:08.459 INFO:tasks.workunit.client.0.smithi157.stdout:2/341: readlink d3/d2e/d32/l36 0 2024-04-03T08:39:08.459 INFO:tasks.workunit.client.0.smithi157.stdout:5/306: dread - dc/d29/d56/d18/d21/f45 zero size 2024-04-03T08:39:08.459 INFO:tasks.workunit.client.0.smithi157.stdout:0/301: dwrite d2/f1d [0,4194304] 0 2024-04-03T08:39:08.461 INFO:tasks.workunit.client.0.smithi157.stdout:6/300: dwrite d1/d4b/f45 [0,4194304] 0 2024-04-03T08:39:08.463 INFO:tasks.workunit.client.0.smithi157.stdout:3/274: symlink d8/d13/l5e 0 2024-04-03T08:39:08.463 INFO:tasks.workunit.client.0.smithi157.stdout:8/286: truncate d2/d20/f29 1922000 0 2024-04-03T08:39:08.465 INFO:tasks.workunit.client.0.smithi157.stdout:3/275: read d8/d13/f15 [1106124,60926] 0 2024-04-03T08:39:08.467 INFO:tasks.workunit.client.0.smithi157.stdout:0/302: write d2/f21 [498905,80051] 0 2024-04-03T08:39:08.468 INFO:tasks.workunit.client.1.smithi181.stdout:8/73: mkdir d4/d6/db/d14 0 2024-04-03T08:39:08.468 INFO:tasks.workunit.client.0.smithi157.stdout:5/307: fdatasync dc/d29/d43/f48 0 2024-04-03T08:39:08.472 INFO:tasks.workunit.client.1.smithi181.stdout:7/83: sync 2024-04-03T08:39:08.473 INFO:tasks.workunit.client.0.smithi157.stdout:8/287: mknod d2/d20/c67 0 2024-04-03T08:39:08.476 INFO:tasks.workunit.client.0.smithi157.stdout:7/320: write d0/d11/d15/d17/f19 [2315991,19685] 0 2024-04-03T08:39:08.478 INFO:tasks.workunit.client.1.smithi181.stdout:8/74: dread - d4/d6/d9/f11 zero size 2024-04-03T08:39:08.478 INFO:tasks.workunit.client.1.smithi181.stdout:4/113: fdatasync d1/d16/f13 0 2024-04-03T08:39:08.480 INFO:tasks.workunit.client.0.smithi157.stdout:1/248: link d2/d11/d24/d39/d3b/d1b/f4e d2/d11/d23/f55 0 2024-04-03T08:39:08.482 INFO:tasks.workunit.client.1.smithi181.stdout:5/129: dwrite d4/d22/f26 [0,4194304] 0 2024-04-03T08:39:08.482 INFO:tasks.workunit.client.1.smithi181.stdout:7/84: rmdir d0/d1/d6/de 39 2024-04-03T08:39:08.485 INFO:tasks.workunit.client.0.smithi157.stdout:9/249: dwrite d1/f19 [4194304,4194304] 0 2024-04-03T08:39:08.490 INFO:tasks.workunit.client.0.smithi157.stdout:0/303: symlink d2/d9/d36/l72 0 2024-04-03T08:39:08.491 INFO:tasks.workunit.client.1.smithi181.stdout:1/69: truncate fb 3975930 0 2024-04-03T08:39:08.493 INFO:tasks.workunit.client.1.smithi181.stdout:0/101: dwrite d5/dc/ff [0,4194304] 0 2024-04-03T08:39:08.494 INFO:tasks.workunit.client.1.smithi181.stdout:1/70: stat cf 0 2024-04-03T08:39:08.494 INFO:tasks.workunit.client.0.smithi157.stdout:5/308: creat dc/d29/d56/f68 x:0 0 0 2024-04-03T08:39:08.498 INFO:tasks.workunit.client.1.smithi181.stdout:4/114: mknod d1/d16/d24/c28 0 2024-04-03T08:39:08.498 INFO:tasks.workunit.client.0.smithi157.stdout:2/342: link d3/d12/d43/d4b/d55/l54 d3/d2e/d65/l76 0 2024-04-03T08:39:08.500 INFO:tasks.workunit.client.1.smithi181.stdout:0/102: chown d5/dc/c1b 0 1 2024-04-03T08:39:08.503 INFO:tasks.workunit.client.1.smithi181.stdout:8/75: unlink d4/d6/db/c12 0 2024-04-03T08:39:08.504 INFO:tasks.workunit.client.1.smithi181.stdout:4/115: write d1/d16/f12 [3788845,37339] 0 2024-04-03T08:39:08.506 INFO:tasks.workunit.client.1.smithi181.stdout:4/116: fsync d1/d16/f23 0 2024-04-03T08:39:08.511 INFO:tasks.workunit.client.1.smithi181.stdout:5/130: chown d4/cd 0 1 2024-04-03T08:39:08.513 INFO:tasks.workunit.client.0.smithi157.stdout:6/301: dwrite d1/d5/d17/d2a/f47 [0,4194304] 0 2024-04-03T08:39:08.519 INFO:tasks.workunit.client.1.smithi181.stdout:3/71: write d0/f3 [15142,46202] 0 2024-04-03T08:39:08.521 INFO:tasks.workunit.client.1.smithi181.stdout:8/76: mkdir d4/d6/d9/d15 0 2024-04-03T08:39:08.521 INFO:tasks.workunit.client.0.smithi157.stdout:3/276: dwrite d8/d1e/d2d/d39/d51/d48/f5c [0,4194304] 0 2024-04-03T08:39:08.524 INFO:tasks.workunit.client.0.smithi157.stdout:5/309: rename dc/f4b to dc/d29/d43/f69 0 2024-04-03T08:39:08.524 INFO:tasks.workunit.client.1.smithi181.stdout:4/117: mkdir d1/d1e/d29 0 2024-04-03T08:39:08.525 INFO:tasks.workunit.client.1.smithi181.stdout:8/77: write d4/f5 [1887970,61636] 0 2024-04-03T08:39:08.526 INFO:tasks.workunit.client.1.smithi181.stdout:5/131: readlink d4/l1d 0 2024-04-03T08:39:08.528 INFO:tasks.workunit.client.1.smithi181.stdout:1/71: link d10/f11 d10/f16 0 2024-04-03T08:39:08.528 INFO:tasks.workunit.client.1.smithi181.stdout:6/101: dwrite d6/d7/d9/f19 [0,4194304] 0 2024-04-03T08:39:08.528 INFO:tasks.workunit.client.0.smithi157.stdout:6/302: chown d1/d5/d17/d29/f5a 23841 1 2024-04-03T08:39:08.529 INFO:tasks.workunit.client.0.smithi157.stdout:3/277: write d8/d1e/f20 [259594,31302] 0 2024-04-03T08:39:08.530 INFO:tasks.workunit.client.1.smithi181.stdout:6/102: fdatasync d6/d7/d9/fe 0 2024-04-03T08:39:08.531 INFO:tasks.workunit.client.1.smithi181.stdout:6/103: readlink l5 0 2024-04-03T08:39:08.533 INFO:tasks.workunit.client.0.smithi157.stdout:2/343: symlink d3/l77 0 2024-04-03T08:39:08.535 INFO:tasks.workunit.client.0.smithi157.stdout:8/288: dwrite d2/d20/d23/f41 [0,4194304] 0 2024-04-03T08:39:08.536 INFO:tasks.workunit.client.0.smithi157.stdout:0/304: dwrite d2/f1d [0,4194304] 0 2024-04-03T08:39:08.540 INFO:tasks.workunit.client.1.smithi181.stdout:3/72: creat d0/d5/d6/f11 x:0 0 0 2024-04-03T08:39:08.545 INFO:tasks.workunit.client.0.smithi157.stdout:2/344: fdatasync d3/d12/f24 0 2024-04-03T08:39:08.549 INFO:tasks.workunit.client.0.smithi157.stdout:5/310: mknod dc/d29/d56/d49/c6a 0 2024-04-03T08:39:08.549 INFO:tasks.workunit.client.0.smithi157.stdout:6/303: write d1/d5/d1b/d2c/f5c [779802,34949] 0 2024-04-03T08:39:08.558 INFO:tasks.workunit.client.1.smithi181.stdout:0/103: creat d5/dc/f1e x:0 0 0 2024-04-03T08:39:08.561 INFO:tasks.workunit.client.0.smithi157.stdout:3/278: creat d8/d1e/d2d/d39/f5f x:0 0 0 2024-04-03T08:39:08.562 INFO:tasks.workunit.client.1.smithi181.stdout:8/78: dread d4/d6/f7 [0,4194304] 0 2024-04-03T08:39:08.565 INFO:tasks.workunit.client.1.smithi181.stdout:6/104: dwrite d6/d7/d9/f1a [0,4194304] 0 2024-04-03T08:39:08.566 INFO:tasks.workunit.client.1.smithi181.stdout:1/72: mkdir d10/d15/d17 0 2024-04-03T08:39:08.567 INFO:tasks.workunit.client.1.smithi181.stdout:3/73: dread d0/f7 [0,4194304] 0 2024-04-03T08:39:08.571 INFO:tasks.workunit.client.1.smithi181.stdout:1/73: chown le 15101 1 2024-04-03T08:39:08.571 INFO:tasks.workunit.client.0.smithi157.stdout:2/345: creat d3/d12/d43/f78 x:0 0 0 2024-04-03T08:39:08.571 INFO:tasks.workunit.client.1.smithi181.stdout:7/85: getdents d0/d1/d6/de 0 2024-04-03T08:39:08.572 INFO:tasks.workunit.client.1.smithi181.stdout:8/79: fdatasync d4/d6/d9/f11 0 2024-04-03T08:39:08.572 INFO:tasks.workunit.client.1.smithi181.stdout:6/105: readlink d6/d7/d9/l11 0 2024-04-03T08:39:08.574 INFO:tasks.workunit.client.0.smithi157.stdout:9/250: dwrite d1/d15/d16/f1e [0,4194304] 0 2024-04-03T08:39:08.574 INFO:tasks.workunit.client.0.smithi157.stdout:7/321: dwrite d0/d5/f3a [0,4194304] 0 2024-04-03T08:39:08.577 INFO:tasks.workunit.client.1.smithi181.stdout:8/80: read - d4/d6/d9/f11 zero size 2024-04-03T08:39:08.582 INFO:tasks.workunit.client.1.smithi181.stdout:5/132: link d4/c11 d4/d18/c2b 0 2024-04-03T08:39:08.582 INFO:tasks.workunit.client.1.smithi181.stdout:1/74: creat d10/d15/f18 x:0 0 0 2024-04-03T08:39:08.582 INFO:tasks.workunit.client.0.smithi157.stdout:6/304: creat d1/f5e x:0 0 0 2024-04-03T08:39:08.585 INFO:tasks.workunit.client.0.smithi157.stdout:1/249: dread d2/d11/d24/d39/d3b/d1b/f28 [0,4194304] 0 2024-04-03T08:39:08.586 INFO:tasks.workunit.client.0.smithi157.stdout:3/279: fsync d8/d1e/d2d/f54 0 2024-04-03T08:39:08.587 INFO:tasks.workunit.client.1.smithi181.stdout:2/127: sync 2024-04-03T08:39:08.587 INFO:tasks.workunit.client.0.smithi157.stdout:8/289: dwrite d2/fb [4194304,4194304] 0 2024-04-03T08:39:08.589 INFO:tasks.workunit.client.0.smithi157.stdout:1/250: chown d2 31639 1 2024-04-03T08:39:08.589 INFO:tasks.workunit.client.0.smithi157.stdout:5/311: rename dc/d29/d56/l17 to dc/d29/d56/d49/l6b 0 2024-04-03T08:39:08.597 INFO:tasks.workunit.client.0.smithi157.stdout:5/312: chown dc/d29/d43/f69 955443 1 2024-04-03T08:39:08.598 INFO:tasks.workunit.client.1.smithi181.stdout:8/81: mkdir d4/d6/db/d16 0 2024-04-03T08:39:08.600 INFO:tasks.workunit.client.0.smithi157.stdout:6/305: symlink d1/d4b/d38/l5f 0 2024-04-03T08:39:08.603 INFO:tasks.workunit.client.0.smithi157.stdout:6/306: readlink d1/d5/d1b/d2c/l2f 0 2024-04-03T08:39:08.604 INFO:tasks.workunit.client.1.smithi181.stdout:1/75: truncate f2 791909 0 2024-04-03T08:39:08.608 INFO:tasks.workunit.client.1.smithi181.stdout:6/106: dwrite d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:08.608 INFO:tasks.workunit.client.0.smithi157.stdout:0/305: dwrite d2/d9/d36/d38/d6c/f6e [4194304,4194304] 0 2024-04-03T08:39:08.609 INFO:tasks.workunit.client.0.smithi157.stdout:2/346: dread d3/d12/f63 [0,4194304] 0 2024-04-03T08:39:08.609 INFO:tasks.workunit.client.0.smithi157.stdout:1/251: truncate d2/f21 117828 0 2024-04-03T08:39:08.613 INFO:tasks.workunit.client.1.smithi181.stdout:4/118: truncate d1/d16/f18 3277556 0 2024-04-03T08:39:08.613 INFO:tasks.workunit.client.1.smithi181.stdout:1/76: chown fc 596 1 2024-04-03T08:39:08.613 INFO:tasks.workunit.client.1.smithi181.stdout:7/86: dwrite d0/d1/f15 [0,4194304] 0 2024-04-03T08:39:08.613 INFO:tasks.workunit.client.1.smithi181.stdout:2/128: truncate f10 1280023 0 2024-04-03T08:39:08.616 INFO:tasks.workunit.client.1.smithi181.stdout:1/77: dread - d10/f16 zero size 2024-04-03T08:39:08.618 INFO:tasks.workunit.client.1.smithi181.stdout:3/74: link d0/cb d0/d5/d6/c12 0 2024-04-03T08:39:08.618 INFO:tasks.workunit.client.1.smithi181.stdout:8/82: mknod d4/c17 0 2024-04-03T08:39:08.620 INFO:tasks.workunit.client.0.smithi157.stdout:7/322: symlink d0/d4/d36/d5b/l7b 0 2024-04-03T08:39:08.620 INFO:tasks.workunit.client.0.smithi157.stdout:5/313: chown dc/f12 6507004 1 2024-04-03T08:39:08.620 INFO:tasks.workunit.client.0.smithi157.stdout:3/280: fdatasync d8/d1e/d2d/d39/d51/f4a 0 2024-04-03T08:39:08.621 INFO:tasks.workunit.client.0.smithi157.stdout:9/251: link d1/d15/d27/f45 d1/d36/d46/f54 0 2024-04-03T08:39:08.622 INFO:tasks.workunit.client.1.smithi181.stdout:0/104: write f2 [3428888,131011] 0 2024-04-03T08:39:08.622 INFO:tasks.workunit.client.0.smithi157.stdout:8/290: creat d2/d11/d10/d24/d5b/d2e/d56/f68 x:0 0 0 2024-04-03T08:39:08.624 INFO:tasks.workunit.client.0.smithi157.stdout:6/307: rename d1/d5/d17/d2a/f47 to d1/d5/d17/d2a/d37/f60 0 2024-04-03T08:39:08.627 INFO:tasks.workunit.client.1.smithi181.stdout:8/83: readlink d4/d6/le 0 2024-04-03T08:39:08.627 INFO:tasks.workunit.client.1.smithi181.stdout:9/183: sync 2024-04-03T08:39:08.628 INFO:tasks.workunit.client.0.smithi157.stdout:6/308: dread - d1/d5/d17/d2a/d37/f51 zero size 2024-04-03T08:39:08.629 INFO:tasks.workunit.client.1.smithi181.stdout:6/107: mknod d6/df/c23 0 2024-04-03T08:39:08.630 INFO:tasks.workunit.client.1.smithi181.stdout:2/129: rename d13/f1b to d13/d1d/f34 0 2024-04-03T08:39:08.630 INFO:tasks.workunit.client.1.smithi181.stdout:5/133: dwrite f1 [0,4194304] 0 2024-04-03T08:39:08.631 INFO:tasks.workunit.client.0.smithi157.stdout:2/347: creat d3/d12/d43/d4b/f79 x:0 0 0 2024-04-03T08:39:08.632 INFO:tasks.workunit.client.0.smithi157.stdout:8/291: truncate d2/d11/d10/d24/d5b/d2e/f42 990698 0 2024-04-03T08:39:08.632 INFO:tasks.workunit.client.1.smithi181.stdout:2/130: stat d13/l32 0 2024-04-03T08:39:08.634 INFO:tasks.workunit.client.1.smithi181.stdout:3/75: unlink d0/f7 0 2024-04-03T08:39:08.637 INFO:tasks.workunit.client.1.smithi181.stdout:0/105: fdatasync d5/fb 0 2024-04-03T08:39:08.637 INFO:tasks.workunit.client.0.smithi157.stdout:1/252: creat d2/d11/d24/d39/d3b/f56 x:0 0 0 2024-04-03T08:39:08.638 INFO:tasks.workunit.client.0.smithi157.stdout:7/323: fdatasync d0/d11/d15/d17/d1c/f37 0 2024-04-03T08:39:08.638 INFO:tasks.workunit.client.0.smithi157.stdout:5/314: mkdir dc/d29/d56/d49/d53/d6c 0 2024-04-03T08:39:08.639 INFO:tasks.workunit.client.1.smithi181.stdout:1/78: mkdir d10/d15/d17/d19 0 2024-04-03T08:39:08.640 INFO:tasks.workunit.client.1.smithi181.stdout:8/84: creat d4/d6/d9/f18 x:0 0 0 2024-04-03T08:39:08.641 INFO:tasks.workunit.client.0.smithi157.stdout:3/281: readlink d8/d1e/d2d/d39/d51/d4c/l52 0 2024-04-03T08:39:08.642 INFO:tasks.workunit.client.1.smithi181.stdout:1/79: stat d10/d15/f18 0 2024-04-03T08:39:08.642 INFO:tasks.workunit.client.1.smithi181.stdout:7/87: creat d0/d1/d6/de/d17/f1b x:0 0 0 2024-04-03T08:39:08.643 INFO:tasks.workunit.client.0.smithi157.stdout:6/309: mkdir d1/d4b/d61 0 2024-04-03T08:39:08.643 INFO:tasks.workunit.client.0.smithi157.stdout:2/348: read d3/db/f33 [304602,112420] 0 2024-04-03T08:39:08.644 INFO:tasks.workunit.client.1.smithi181.stdout:8/85: chown d4/d6/db 6 1 2024-04-03T08:39:08.645 INFO:tasks.workunit.client.0.smithi157.stdout:8/292: rmdir d2/d11/d10/d24/d5b/d2e 39 2024-04-03T08:39:08.648 INFO:tasks.workunit.client.1.smithi181.stdout:2/131: creat d13/f35 x:0 0 0 2024-04-03T08:39:08.649 INFO:tasks.workunit.client.0.smithi157.stdout:1/253: rmdir d2/d11/d24/d39/d3b/d1b 39 2024-04-03T08:39:08.649 INFO:tasks.workunit.client.0.smithi157.stdout:6/310: fdatasync d1/d5/d1b/f54 0 2024-04-03T08:39:08.650 INFO:tasks.workunit.client.0.smithi157.stdout:8/293: truncate d2/f39 747099 0 2024-04-03T08:39:08.651 INFO:tasks.workunit.client.0.smithi157.stdout:9/252: dwrite d1/d4a/f4c [0,4194304] 0 2024-04-03T08:39:08.654 INFO:tasks.workunit.client.1.smithi181.stdout:3/76: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:08.654 INFO:tasks.workunit.client.1.smithi181.stdout:6/108: write d6/d7/d9/f15 [4992807,101708] 0 2024-04-03T08:39:08.664 INFO:tasks.workunit.client.0.smithi157.stdout:2/349: creat d3/d12/d43/d4b/f7a x:0 0 0 2024-04-03T08:39:08.664 INFO:tasks.workunit.client.1.smithi181.stdout:7/88: write d0/d1/f3 [3634478,55789] 0 2024-04-03T08:39:08.669 INFO:tasks.workunit.client.0.smithi157.stdout:6/311: mkdir d1/d5/d17/d29/d62 0 2024-04-03T08:39:08.672 INFO:tasks.workunit.client.0.smithi157.stdout:6/312: write d1/d5/d17/d2a/f4d [601969,104175] 0 2024-04-03T08:39:08.673 INFO:tasks.workunit.client.1.smithi181.stdout:2/132: creat d13/d1c/f36 x:0 0 0 2024-04-03T08:39:08.674 INFO:tasks.workunit.client.0.smithi157.stdout:8/294: truncate d2/d11/d10/d24/d5b/d2e/f3f 426375 0 2024-04-03T08:39:08.675 INFO:tasks.workunit.client.0.smithi157.stdout:9/253: creat d1/d15/d27/f55 x:0 0 0 2024-04-03T08:39:08.677 INFO:tasks.workunit.client.1.smithi181.stdout:2/133: fdatasync d13/d1d/f2a 0 2024-04-03T08:39:08.678 INFO:tasks.workunit.client.1.smithi181.stdout:6/109: symlink d6/l24 0 2024-04-03T08:39:08.684 INFO:tasks.workunit.client.0.smithi157.stdout:2/350: creat d3/db/f7b x:0 0 0 2024-04-03T08:39:08.685 INFO:tasks.workunit.client.1.smithi181.stdout:3/77: dwrite d0/d5/fa [0,4194304] 0 2024-04-03T08:39:08.686 INFO:tasks.workunit.client.1.smithi181.stdout:4/119: dwrite d1/f7 [0,4194304] 0 2024-04-03T08:39:08.687 INFO:tasks.workunit.client.1.smithi181.stdout:3/78: chown d0/d5/d6/lc 0 1 2024-04-03T08:39:08.687 INFO:tasks.workunit.client.0.smithi157.stdout:6/313: symlink d1/d5/d17/d29/l63 0 2024-04-03T08:39:08.689 INFO:tasks.workunit.client.0.smithi157.stdout:6/314: fdatasync d1/f1f 0 2024-04-03T08:39:08.690 INFO:tasks.workunit.client.0.smithi157.stdout:8/295: mkdir d2/d20/d69 0 2024-04-03T08:39:08.691 INFO:tasks.workunit.client.1.smithi181.stdout:1/80: creat d10/d15/d17/d19/f1a x:0 0 0 2024-04-03T08:39:08.692 INFO:tasks.workunit.client.1.smithi181.stdout:2/134: truncate fa 363755 0 2024-04-03T08:39:08.692 INFO:tasks.workunit.client.1.smithi181.stdout:7/89: fsync d0/d1/d6/de/d17/f1b 0 2024-04-03T08:39:08.693 INFO:tasks.workunit.client.0.smithi157.stdout:1/254: dwrite d2/d11/d24/d39/d3b/d1b/f30 [0,4194304] 0 2024-04-03T08:39:08.693 INFO:tasks.workunit.client.1.smithi181.stdout:2/135: stat d13/d22 0 2024-04-03T08:39:08.698 INFO:tasks.workunit.client.1.smithi181.stdout:6/110: symlink d6/d7/d9/l25 0 2024-04-03T08:39:08.702 INFO:tasks.workunit.client.1.smithi181.stdout:3/79: creat d0/f13 x:0 0 0 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.1.smithi181.stdout:3/80: write d0/f13 [566448,120495] 0 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.1.smithi181.stdout:3/81: write d0/f13 [595406,88174] 0 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.0.smithi157.stdout:7/324: creat d0/d11/d15/d17/f7c x:0 0 0 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.0.smithi157.stdout:5/315: link dc/d29/d56/d52/c54 dc/d29/d56/d2e/c6d 0 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.0.smithi157.stdout:2/351: dread - d3/f34 zero size 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.0.smithi157.stdout:9/254: creat d1/d36/d46/f56 x:0 0 0 2024-04-03T08:39:08.707 INFO:tasks.workunit.client.0.smithi157.stdout:9/255: readlink d1/l11 0 2024-04-03T08:39:08.715 INFO:tasks.workunit.client.0.smithi157.stdout:6/315: chown d1/d5/d1b/d2c/l50 22957 1 2024-04-03T08:39:08.716 INFO:tasks.workunit.client.1.smithi181.stdout:0/106: rename d5/dc/l17 to d5/l1f 0 2024-04-03T08:39:08.716 INFO:tasks.workunit.client.1.smithi181.stdout:1/81: dread f9 [0,4194304] 0 2024-04-03T08:39:08.717 INFO:tasks.workunit.client.0.smithi157.stdout:9/256: dread d1/f17 [0,4194304] 0 2024-04-03T08:39:08.718 INFO:tasks.workunit.client.1.smithi181.stdout:2/136: creat d13/d22/d27/f37 x:0 0 0 2024-04-03T08:39:08.718 INFO:tasks.workunit.client.1.smithi181.stdout:8/86: write d4/d6/f8 [1214736,127416] 0 2024-04-03T08:39:08.720 INFO:tasks.workunit.client.0.smithi157.stdout:7/325: fdatasync d0/d11/f70 0 2024-04-03T08:39:08.723 INFO:tasks.workunit.client.1.smithi181.stdout:8/87: fdatasync d4/f5 0 2024-04-03T08:39:08.725 INFO:tasks.workunit.client.0.smithi157.stdout:3/282: dwrite d8/d1e/d2d/d3b/f43 [0,4194304] 0 2024-04-03T08:39:08.725 INFO:tasks.workunit.client.0.smithi157.stdout:3/283: dread - d8/f57 zero size 2024-04-03T08:39:08.726 INFO:tasks.workunit.client.1.smithi181.stdout:9/184: dwrite d1/f20 [0,4194304] 0 2024-04-03T08:39:08.726 INFO:tasks.workunit.client.0.smithi157.stdout:5/316: fdatasync dc/d29/d56/f27 0 2024-04-03T08:39:08.727 INFO:tasks.workunit.client.0.smithi157.stdout:9/257: rmdir d1/d4a 39 2024-04-03T08:39:08.730 INFO:tasks.workunit.client.0.smithi157.stdout:5/317: chown dc/d29/d56/d18/d21/l36 0 1 2024-04-03T08:39:08.731 INFO:tasks.workunit.client.1.smithi181.stdout:9/185: chown d1/l1c 4106896 1 2024-04-03T08:39:08.736 INFO:tasks.workunit.client.1.smithi181.stdout:3/82: dwrite d0/f13 [0,4194304] 0 2024-04-03T08:39:08.747 INFO:tasks.workunit.client.0.smithi157.stdout:8/296: dread d2/f9 [0,4194304] 0 2024-04-03T08:39:08.748 INFO:tasks.workunit.client.1.smithi181.stdout:6/111: rename d6/d7/fb to d6/df/f26 0 2024-04-03T08:39:08.750 INFO:tasks.workunit.client.1.smithi181.stdout:6/112: readlink d6/d7/d9/l1c 0 2024-04-03T08:39:08.751 INFO:tasks.workunit.client.0.smithi157.stdout:3/284: dwrite d8/d1e/d2d/d3f/f44 [0,4194304] 0 2024-04-03T08:39:08.753 INFO:tasks.workunit.client.0.smithi157.stdout:5/318: creat dc/d29/d56/d49/f6e x:0 0 0 2024-04-03T08:39:08.754 INFO:tasks.workunit.client.1.smithi181.stdout:5/134: sync 2024-04-03T08:39:08.755 INFO:tasks.workunit.client.0.smithi157.stdout:5/319: chown dc/l2f 51487 1 2024-04-03T08:39:08.756 INFO:tasks.workunit.client.1.smithi181.stdout:2/137: creat d13/d1c/f38 x:0 0 0 2024-04-03T08:39:08.757 INFO:tasks.workunit.client.1.smithi181.stdout:6/113: dread d6/f17 [0,4194304] 0 2024-04-03T08:39:08.764 INFO:tasks.workunit.client.1.smithi181.stdout:4/120: truncate d1/d1e/f1a 2056566 0 2024-04-03T08:39:08.764 INFO:tasks.workunit.client.1.smithi181.stdout:8/88: creat d4/f19 x:0 0 0 2024-04-03T08:39:08.765 INFO:tasks.workunit.client.1.smithi181.stdout:9/186: mkdir d1/da/d28/d30/d3e 0 2024-04-03T08:39:08.767 INFO:tasks.workunit.client.0.smithi157.stdout:1/255: dwrite d2/d11/d23/f55 [0,4194304] 0 2024-04-03T08:39:08.768 INFO:tasks.workunit.client.1.smithi181.stdout:3/83: rmdir d0/d5/d6 39 2024-04-03T08:39:08.770 INFO:tasks.workunit.client.1.smithi181.stdout:3/84: chown d0/d5 633 1 2024-04-03T08:39:08.771 INFO:tasks.workunit.client.0.smithi157.stdout:6/316: rename d1/f1f to d1/d5/d17/f64 0 2024-04-03T08:39:08.772 INFO:tasks.workunit.client.1.smithi181.stdout:0/107: write d5/d9/f1d [791375,126422] 0 2024-04-03T08:39:08.776 INFO:tasks.workunit.client.0.smithi157.stdout:1/256: dread d2/d11/d23/f4d [0,4194304] 0 2024-04-03T08:39:08.777 INFO:tasks.workunit.client.0.smithi157.stdout:7/326: creat d0/d11/d15/d17/f7d x:0 0 0 2024-04-03T08:39:08.781 INFO:tasks.workunit.client.1.smithi181.stdout:7/90: truncate d0/d1/d6/fd 7105379 0 2024-04-03T08:39:08.781 INFO:tasks.workunit.client.0.smithi157.stdout:2/352: dwrite d3/f21 [0,4194304] 0 2024-04-03T08:39:08.785 INFO:tasks.workunit.client.1.smithi181.stdout:7/91: write d0/d1/f15 [4623921,50849] 0 2024-04-03T08:39:08.788 INFO:tasks.workunit.client.1.smithi181.stdout:7/92: chown d0/d1/f19 6 1 2024-04-03T08:39:08.788 INFO:tasks.workunit.client.0.smithi157.stdout:4/300: sync 2024-04-03T08:39:08.790 INFO:tasks.workunit.client.0.smithi157.stdout:5/320: creat dc/d29/d56/d49/d53/d6c/f6f x:0 0 0 2024-04-03T08:39:08.792 INFO:tasks.workunit.client.1.smithi181.stdout:2/138: creat d13/f39 x:0 0 0 2024-04-03T08:39:08.793 INFO:tasks.workunit.client.0.smithi157.stdout:9/258: dread d1/d15/f31 [0,4194304] 0 2024-04-03T08:39:08.794 INFO:tasks.workunit.client.1.smithi181.stdout:2/139: chown d13/d22/d27 59 1 2024-04-03T08:39:08.795 INFO:tasks.workunit.client.1.smithi181.stdout:2/140: write f0 [1531976,15063] 0 2024-04-03T08:39:08.796 INFO:tasks.workunit.client.1.smithi181.stdout:6/114: rename c2 to d6/df/c27 0 2024-04-03T08:39:08.798 INFO:tasks.workunit.client.1.smithi181.stdout:6/115: stat d6/d7/d9/d22 0 2024-04-03T08:39:08.799 INFO:tasks.workunit.client.1.smithi181.stdout:8/89: rmdir d4/d6/d9 39 2024-04-03T08:39:08.801 INFO:tasks.workunit.client.1.smithi181.stdout:6/116: write d6/f13 [770508,88611] 0 2024-04-03T08:39:08.806 INFO:tasks.workunit.client.1.smithi181.stdout:3/85: mknod d0/c14 0 2024-04-03T08:39:08.807 INFO:tasks.workunit.client.0.smithi157.stdout:7/327: mknod d0/d4/d36/c7e 0 2024-04-03T08:39:08.811 INFO:tasks.workunit.client.0.smithi157.stdout:4/301: creat da/df/d2f/d54/f65 x:0 0 0 2024-04-03T08:39:08.815 INFO:tasks.workunit.client.1.smithi181.stdout:5/135: mkdir d4/d18/d2c 0 2024-04-03T08:39:08.815 INFO:tasks.workunit.client.0.smithi157.stdout:4/302: truncate da/df/f57 427216 0 2024-04-03T08:39:08.816 INFO:tasks.workunit.client.0.smithi157.stdout:8/297: dread d2/d11/d10/d24/d5b/d2e/f64 [0,4194304] 0 2024-04-03T08:39:08.817 INFO:tasks.workunit.client.1.smithi181.stdout:1/82: link l7 d10/d15/d17/d19/l1b 0 2024-04-03T08:39:08.817 INFO:tasks.workunit.client.0.smithi157.stdout:1/257: creat d2/d11/d23/f57 x:0 0 0 2024-04-03T08:39:08.819 INFO:tasks.workunit.client.1.smithi181.stdout:1/83: readlink d10/d15/d17/d19/l1b 0 2024-04-03T08:39:08.820 INFO:tasks.workunit.client.1.smithi181.stdout:1/84: stat d10/c14 0 2024-04-03T08:39:08.820 INFO:tasks.workunit.client.1.smithi181.stdout:7/93: mknod d0/d1/d6/de/c1c 0 2024-04-03T08:39:08.821 INFO:tasks.workunit.client.0.smithi157.stdout:2/353: dread d3/d2e/f3b [0,4194304] 0 2024-04-03T08:39:08.822 INFO:tasks.workunit.client.0.smithi157.stdout:3/285: rename d8/d1e/f20 to d8/d13/f60 0 2024-04-03T08:39:08.824 INFO:tasks.workunit.client.1.smithi181.stdout:4/121: rename d1/cc to d1/d1e/d29/c2a 0 2024-04-03T08:39:08.825 INFO:tasks.workunit.client.1.smithi181.stdout:4/122: stat d1/d16/d1f 0 2024-04-03T08:39:08.828 INFO:tasks.workunit.client.0.smithi157.stdout:4/303: rename da/df/d11/f46 to da/df/d11/f66 0 2024-04-03T08:39:08.829 INFO:tasks.workunit.client.1.smithi181.stdout:2/141: creat d13/d22/d27/f3a x:0 0 0 2024-04-03T08:39:08.830 INFO:tasks.workunit.client.1.smithi181.stdout:5/136: dwrite d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:08.831 INFO:tasks.workunit.client.0.smithi157.stdout:7/328: dwrite d0/d11/d15/d17/d52/f54 [0,4194304] 0 2024-04-03T08:39:08.833 INFO:tasks.workunit.client.0.smithi157.stdout:4/304: dread - da/df/d24/d35/f52 zero size 2024-04-03T08:39:08.833 INFO:tasks.workunit.client.1.smithi181.stdout:6/117: creat d6/d7/d9/f28 x:0 0 0 2024-04-03T08:39:08.834 INFO:tasks.workunit.client.0.smithi157.stdout:6/317: dwrite d1/d22/f26 [0,4194304] 0 2024-04-03T08:39:08.834 INFO:tasks.workunit.client.0.smithi157.stdout:7/329: chown d0/d5/f62 1 1 2024-04-03T08:39:08.835 INFO:tasks.workunit.client.0.smithi157.stdout:6/318: readlink d1/d5/la 0 2024-04-03T08:39:08.837 INFO:tasks.workunit.client.1.smithi181.stdout:9/187: creat d1/da/d16/d32/f3f x:0 0 0 2024-04-03T08:39:08.838 INFO:tasks.workunit.client.0.smithi157.stdout:0/306: sync 2024-04-03T08:39:08.840 INFO:tasks.workunit.client.0.smithi157.stdout:5/321: rename dc/d29/d56/f27 to dc/d29/f70 0 2024-04-03T08:39:08.841 INFO:tasks.workunit.client.0.smithi157.stdout:2/354: unlink d3/d12/d43/d4b/d55/c6f 0 2024-04-03T08:39:08.842 INFO:tasks.workunit.client.1.smithi181.stdout:0/108: creat d5/dc/d10/f20 x:0 0 0 2024-04-03T08:39:08.843 INFO:tasks.workunit.client.0.smithi157.stdout:2/355: fsync d3/f34 0 2024-04-03T08:39:08.846 INFO:tasks.workunit.client.1.smithi181.stdout:6/118: dread d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:08.847 INFO:tasks.workunit.client.1.smithi181.stdout:3/86: readlink d0/d5/d6/dd/le 0 2024-04-03T08:39:08.849 INFO:tasks.workunit.client.0.smithi157.stdout:0/307: truncate d2/d9/dc/df/f60 1539280 0 2024-04-03T08:39:08.849 INFO:tasks.workunit.client.1.smithi181.stdout:6/119: chown d6/df/c1e 1089502947 1 2024-04-03T08:39:08.850 INFO:tasks.workunit.client.0.smithi157.stdout:3/286: mknod d8/d1e/d2d/d39/d51/d4c/c61 0 2024-04-03T08:39:08.852 INFO:tasks.workunit.client.1.smithi181.stdout:3/87: truncate d0/d5/fa 4257302 0 2024-04-03T08:39:08.853 INFO:tasks.workunit.client.0.smithi157.stdout:4/305: creat da/df/d2f/d54/f67 x:0 0 0 2024-04-03T08:39:08.856 INFO:tasks.workunit.client.0.smithi157.stdout:6/319: rmdir d1/d22 39 2024-04-03T08:39:08.859 INFO:tasks.workunit.client.0.smithi157.stdout:6/320: write d1/f48 [2271464,39689] 0 2024-04-03T08:39:08.862 INFO:tasks.workunit.client.1.smithi181.stdout:3/88: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:08.863 INFO:tasks.workunit.client.1.smithi181.stdout:2/142: creat d13/d1c/f3b x:0 0 0 2024-04-03T08:39:08.864 INFO:tasks.workunit.client.0.smithi157.stdout:1/258: rename d2/d32 to d2/d11/d24/d39/d3b/d2e/d48/d58 0 2024-04-03T08:39:08.865 INFO:tasks.workunit.client.1.smithi181.stdout:2/143: chown d13/d22/d27/f3a 0 1 2024-04-03T08:39:08.866 INFO:tasks.workunit.client.0.smithi157.stdout:2/356: dwrite d3/db/f33 [0,4194304] 0 2024-04-03T08:39:08.869 INFO:tasks.workunit.client.0.smithi157.stdout:4/306: mkdir da/df/d24/d58/d68 0 2024-04-03T08:39:08.870 INFO:tasks.workunit.client.0.smithi157.stdout:8/298: link d2/d11/d10/d24/c40 d2/d11/d10/d24/d5b/d2e/d56/c6a 0 2024-04-03T08:39:08.872 INFO:tasks.workunit.client.0.smithi157.stdout:3/287: dread d8/d13/f1c [0,4194304] 0 2024-04-03T08:39:08.873 INFO:tasks.workunit.client.0.smithi157.stdout:3/288: readlink d8/d1e/l49 0 2024-04-03T08:39:08.874 INFO:tasks.workunit.client.1.smithi181.stdout:5/137: fdatasync d4/d18/f23 0 2024-04-03T08:39:08.875 INFO:tasks.workunit.client.1.smithi181.stdout:0/109: rmdir d5/d9 39 2024-04-03T08:39:08.878 INFO:tasks.workunit.client.1.smithi181.stdout:6/120: symlink d6/d7/d9/l29 0 2024-04-03T08:39:08.879 INFO:tasks.workunit.client.0.smithi157.stdout:6/321: creat d1/d5/d1b/f65 x:0 0 0 2024-04-03T08:39:08.880 INFO:tasks.workunit.client.0.smithi157.stdout:5/322: rename dc/ce to dc/d29/d56/d52/c71 0 2024-04-03T08:39:08.881 INFO:tasks.workunit.client.1.smithi181.stdout:4/123: mkdir d1/d16/d1f/d2b 0 2024-04-03T08:39:08.881 INFO:tasks.workunit.client.1.smithi181.stdout:3/89: rmdir d0/d5/d6/dd 39 2024-04-03T08:39:08.882 INFO:tasks.workunit.client.0.smithi157.stdout:5/323: chown dc/f12 514005 1 2024-04-03T08:39:08.883 INFO:tasks.workunit.client.1.smithi181.stdout:2/144: mknod d13/d22/d27/c3c 0 2024-04-03T08:39:08.884 INFO:tasks.workunit.client.1.smithi181.stdout:3/90: dread - d0/d5/d6/f11 zero size 2024-04-03T08:39:08.886 INFO:tasks.workunit.client.0.smithi157.stdout:8/299: dread - d2/d11/d10/d24/d5b/f4b zero size 2024-04-03T08:39:08.887 INFO:tasks.workunit.client.1.smithi181.stdout:3/91: chown d0/d5/fa 39463 1 2024-04-03T08:39:08.888 INFO:tasks.workunit.client.1.smithi181.stdout:1/85: dwrite d10/f11 [0,4194304] 0 2024-04-03T08:39:08.888 INFO:tasks.workunit.client.1.smithi181.stdout:5/138: fdatasync d4/f12 0 2024-04-03T08:39:08.892 INFO:tasks.workunit.client.1.smithi181.stdout:3/92: truncate d0/f13 4272110 0 2024-04-03T08:39:08.892 INFO:tasks.workunit.client.1.smithi181.stdout:5/139: write d4/d18/f23 [1534351,554] 0 2024-04-03T08:39:08.893 INFO:tasks.workunit.client.1.smithi181.stdout:5/140: stat d4/d22/l2a 0 2024-04-03T08:39:08.894 INFO:tasks.workunit.client.0.smithi157.stdout:4/307: dwrite da/df/d2f/d54/f65 [0,4194304] 0 2024-04-03T08:39:08.898 INFO:tasks.workunit.client.1.smithi181.stdout:7/94: link d0/d1/l7 d0/d1/l1d 0 2024-04-03T08:39:08.899 INFO:tasks.workunit.client.0.smithi157.stdout:0/308: rename d2/d9/c43 to d2/d9/dc/df/d1b/d4a/c73 0 2024-04-03T08:39:08.901 INFO:tasks.workunit.client.1.smithi181.stdout:6/121: creat d6/d7/f2a x:0 0 0 2024-04-03T08:39:08.903 INFO:tasks.workunit.client.0.smithi157.stdout:5/324: symlink dc/d29/d56/d49/l72 0 2024-04-03T08:39:08.905 INFO:tasks.workunit.client.0.smithi157.stdout:7/330: dwrite d0/d11/d15/d17/d1c/f4b [0,4194304] 0 2024-04-03T08:39:08.910 INFO:tasks.workunit.client.0.smithi157.stdout:6/322: mknod d1/d5/d17/d2a/d40/c66 0 2024-04-03T08:39:08.914 INFO:tasks.workunit.client.0.smithi157.stdout:8/300: fsync d2/d11/d10/d24/d5b/f1c 0 2024-04-03T08:39:08.915 INFO:tasks.workunit.client.0.smithi157.stdout:5/325: read dc/d29/d56/d18/f1c [4117408,82249] 0 2024-04-03T08:39:08.916 INFO:tasks.workunit.client.0.smithi157.stdout:6/323: chown d1/d5/d1b/f1c 7531667 1 2024-04-03T08:39:08.916 INFO:tasks.workunit.client.1.smithi181.stdout:9/188: dwrite d1/da/d1a/f27 [0,4194304] 0 2024-04-03T08:39:08.917 INFO:tasks.workunit.client.0.smithi157.stdout:7/331: write d0/d11/f71 [182476,17901] 0 2024-04-03T08:39:08.920 INFO:tasks.workunit.client.1.smithi181.stdout:1/86: symlink d10/d15/d17/d19/l1c 0 2024-04-03T08:39:08.921 INFO:tasks.workunit.client.0.smithi157.stdout:6/324: stat d1/d5/d17/d2a/d40/f5d 0 2024-04-03T08:39:08.921 INFO:tasks.workunit.client.0.smithi157.stdout:1/259: link d2/d11/d24/d39/f54 d2/d11/d24/d39/d3b/f59 0 2024-04-03T08:39:08.921 INFO:tasks.workunit.client.0.smithi157.stdout:3/289: dwrite d8/d1e/d2d/d39/d51/d4c/d32/f42 [0,4194304] 0 2024-04-03T08:39:08.924 INFO:tasks.workunit.client.0.smithi157.stdout:2/357: dwrite d3/db/d44/f64 [0,4194304] 0 2024-04-03T08:39:08.925 INFO:tasks.workunit.client.0.smithi157.stdout:4/308: fdatasync da/df/d2f/d54/f65 0 2024-04-03T08:39:08.927 INFO:tasks.workunit.client.1.smithi181.stdout:1/87: readlink d10/d15/d17/d19/l1c 0 2024-04-03T08:39:08.929 INFO:tasks.workunit.client.0.smithi157.stdout:1/260: chown d2/d11/l3a 249685 1 2024-04-03T08:39:08.930 INFO:tasks.workunit.client.1.smithi181.stdout:7/95: unlink d0/l10 0 2024-04-03T08:39:08.932 INFO:tasks.workunit.client.0.smithi157.stdout:2/358: stat d3/d2e/d32/d3c/f52 0 2024-04-03T08:39:08.932 INFO:tasks.workunit.client.1.smithi181.stdout:6/122: mknod d6/df/c2b 0 2024-04-03T08:39:08.933 INFO:tasks.workunit.client.0.smithi157.stdout:0/309: rename d2/d9/dc/df/d1b/d35/c45 to d2/d9/dc/df/d1b/c74 0 2024-04-03T08:39:08.933 INFO:tasks.workunit.client.1.smithi181.stdout:1/88: readlink le 0 2024-04-03T08:39:08.934 INFO:tasks.workunit.client.1.smithi181.stdout:7/96: fsync d0/d1/f15 0 2024-04-03T08:39:08.936 INFO:tasks.workunit.client.1.smithi181.stdout:0/110: creat d5/dc/f21 x:0 0 0 2024-04-03T08:39:08.937 INFO:tasks.workunit.client.1.smithi181.stdout:1/89: chown cd 1283615663 1 2024-04-03T08:39:08.938 INFO:tasks.workunit.client.1.smithi181.stdout:5/141: rename d4/c10 to d4/d22/c2d 0 2024-04-03T08:39:08.942 INFO:tasks.workunit.client.1.smithi181.stdout:6/123: dread d6/f17 [0,4194304] 0 2024-04-03T08:39:08.945 INFO:tasks.workunit.client.1.smithi181.stdout:0/111: readlink d5/l1f 0 2024-04-03T08:39:08.946 INFO:tasks.workunit.client.0.smithi157.stdout:4/309: write da/df/d24/f5c [278155,6974] 0 2024-04-03T08:39:08.947 INFO:tasks.workunit.client.1.smithi181.stdout:8/90: sync 2024-04-03T08:39:08.948 INFO:tasks.workunit.client.0.smithi157.stdout:2/359: rename d3/d12/d43/f50 to d3/d12/f7c 0 2024-04-03T08:39:08.949 INFO:tasks.workunit.client.1.smithi181.stdout:9/189: dwrite d1/da/d16/d32/f3f [0,4194304] 0 2024-04-03T08:39:08.951 INFO:tasks.workunit.client.1.smithi181.stdout:2/145: getdents d13/d22/d27 0 2024-04-03T08:39:08.953 INFO:tasks.workunit.client.0.smithi157.stdout:0/310: creat d2/d9/dc/d54/f75 x:0 0 0 2024-04-03T08:39:08.954 INFO:tasks.workunit.client.1.smithi181.stdout:7/97: rename d0/d1/d6/de/c1c to d0/c1e 0 2024-04-03T08:39:08.957 INFO:tasks.workunit.client.1.smithi181.stdout:3/93: link d0/cb d0/c15 0 2024-04-03T08:39:08.957 INFO:tasks.workunit.client.1.smithi181.stdout:2/146: dread d13/d1d/f34 [0,4194304] 0 2024-04-03T08:39:08.957 INFO:tasks.workunit.client.0.smithi157.stdout:6/325: link d1/d5/d17/f4e d1/d5/d17/f67 0 2024-04-03T08:39:08.958 INFO:tasks.workunit.client.0.smithi157.stdout:4/310: write da/df/f57 [768854,61918] 0 2024-04-03T08:39:08.960 INFO:tasks.workunit.client.1.smithi181.stdout:6/124: symlink d6/d7/l2c 0 2024-04-03T08:39:08.961 INFO:tasks.workunit.client.0.smithi157.stdout:5/326: dread dc/d29/d43/f48 [0,4194304] 0 2024-04-03T08:39:08.963 INFO:tasks.workunit.client.1.smithi181.stdout:0/112: rmdir d5 39 2024-04-03T08:39:08.965 INFO:tasks.workunit.client.0.smithi157.stdout:4/311: fsync da/df/f18 0 2024-04-03T08:39:08.967 INFO:tasks.workunit.client.0.smithi157.stdout:3/290: dwrite d8/fc [0,4194304] 0 2024-04-03T08:39:08.968 INFO:tasks.workunit.client.0.smithi157.stdout:8/301: dwrite d2/d11/d10/d24/d5b/d2e/d56/f68 [0,4194304] 0 2024-04-03T08:39:08.968 INFO:tasks.workunit.client.0.smithi157.stdout:0/311: fsync d2/f37 0 2024-04-03T08:39:08.975 INFO:tasks.workunit.client.1.smithi181.stdout:7/98: dwrite d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:08.975 INFO:tasks.workunit.client.1.smithi181.stdout:9/190: rmdir d1/da/d13/d22/d23 39 2024-04-03T08:39:08.976 INFO:tasks.workunit.client.0.smithi157.stdout:5/327: write dc/f67 [928349,29917] 0 2024-04-03T08:39:08.978 INFO:tasks.workunit.client.0.smithi157.stdout:7/332: dwrite d0/d11/d15/d1b/f39 [0,4194304] 0 2024-04-03T08:39:08.979 INFO:tasks.workunit.client.1.smithi181.stdout:7/99: truncate d0/d1/d6/f9 5883879 0 2024-04-03T08:39:08.992 INFO:tasks.workunit.client.1.smithi181.stdout:5/142: creat d4/d18/d2c/f2e x:0 0 0 2024-04-03T08:39:08.995 INFO:tasks.workunit.client.1.smithi181.stdout:4/124: sync 2024-04-03T08:39:08.996 INFO:tasks.workunit.client.1.smithi181.stdout:8/91: dwrite d4/d6/d9/f11 [0,4194304] 0 2024-04-03T08:39:08.996 INFO:tasks.workunit.client.0.smithi157.stdout:2/360: write d3/d12/f63 [4430354,24026] 0 2024-04-03T08:39:08.997 INFO:tasks.workunit.client.0.smithi157.stdout:6/326: dwrite d1/d5/d17/d2a/d40/f5d [0,4194304] 0 2024-04-03T08:39:08.999 INFO:tasks.workunit.client.1.smithi181.stdout:1/90: write f4 [1457815,129285] 0 2024-04-03T08:39:09.004 INFO:tasks.workunit.client.0.smithi157.stdout:1/261: dread d2/d11/d24/f1f [4194304,4194304] 0 2024-04-03T08:39:09.006 INFO:tasks.workunit.client.0.smithi157.stdout:3/291: creat d8/f62 x:0 0 0 2024-04-03T08:39:09.010 INFO:tasks.workunit.client.0.smithi157.stdout:7/333: symlink d0/d11/d15/d17/d1c/d4f/d5f/l7f 0 2024-04-03T08:39:09.013 INFO:tasks.workunit.client.1.smithi181.stdout:2/147: creat d13/d1d/f3d x:0 0 0 2024-04-03T08:39:09.013 INFO:tasks.workunit.client.1.smithi181.stdout:6/125: rename d6/df/c2b to d6/df/c2d 0 2024-04-03T08:39:09.015 INFO:tasks.workunit.client.1.smithi181.stdout:9/191: rename d1/da/d16/c24 to d1/da/d13/c40 0 2024-04-03T08:39:09.015 INFO:tasks.workunit.client.1.smithi181.stdout:2/148: readlink l1 0 2024-04-03T08:39:09.016 INFO:tasks.workunit.client.0.smithi157.stdout:3/292: fsync d8/f11 0 2024-04-03T08:39:09.016 INFO:tasks.workunit.client.1.smithi181.stdout:4/125: mkdir d1/d1e/d2c 0 2024-04-03T08:39:09.017 INFO:tasks.workunit.client.0.smithi157.stdout:7/334: readlink d0/d11/l1e 0 2024-04-03T08:39:09.020 INFO:tasks.workunit.client.0.smithi157.stdout:1/262: read d2/d11/d23/f4d [243676,57930] 0 2024-04-03T08:39:09.020 INFO:tasks.workunit.client.1.smithi181.stdout:3/94: mkdir d0/d5/d16 0 2024-04-03T08:39:09.021 INFO:tasks.workunit.client.0.smithi157.stdout:9/259: sync 2024-04-03T08:39:09.021 INFO:tasks.workunit.client.0.smithi157.stdout:7/335: fdatasync d0/d16/f6b 0 2024-04-03T08:39:09.021 INFO:tasks.workunit.client.1.smithi181.stdout:1/91: chown d10/d15/d17/d19/f1a 189765 1 2024-04-03T08:39:09.023 INFO:tasks.workunit.client.0.smithi157.stdout:8/302: dwrite d2/d11/f51 [0,4194304] 0 2024-04-03T08:39:09.024 INFO:tasks.workunit.client.0.smithi157.stdout:0/312: dwrite d2/d9/dc/df/f60 [0,4194304] 0 2024-04-03T08:39:09.024 INFO:tasks.workunit.client.0.smithi157.stdout:9/260: chown d1/d15/d27 859671 1 2024-04-03T08:39:09.025 INFO:tasks.workunit.client.1.smithi181.stdout:6/126: read d6/d7/d9/f19 [1616525,101421] 0 2024-04-03T08:39:09.031 INFO:tasks.workunit.client.1.smithi181.stdout:1/92: chown d10/d15/f18 10 1 2024-04-03T08:39:09.032 INFO:tasks.workunit.client.1.smithi181.stdout:7/100: dwrite d0/d1/f19 [0,4194304] 0 2024-04-03T08:39:09.033 INFO:tasks.workunit.client.1.smithi181.stdout:0/113: readlink d5/d9/d13/l1a 0 2024-04-03T08:39:09.038 INFO:tasks.workunit.client.1.smithi181.stdout:6/127: readlink d6/d7/d9/l16 0 2024-04-03T08:39:09.038 INFO:tasks.workunit.client.0.smithi157.stdout:6/327: link d1/d4b/d38/f4c d1/d4b/d61/f68 0 2024-04-03T08:39:09.038 INFO:tasks.workunit.client.0.smithi157.stdout:5/328: dread dc/d29/d56/f33 [0,4194304] 0 2024-04-03T08:39:09.040 INFO:tasks.workunit.client.0.smithi157.stdout:4/312: dread da/df/d2f/f4f [0,4194304] 0 2024-04-03T08:39:09.042 INFO:tasks.workunit.client.1.smithi181.stdout:7/101: chown d0/d1/f3 6 1 2024-04-03T08:39:09.045 INFO:tasks.workunit.client.0.smithi157.stdout:6/328: write d1/fb [745378,113147] 0 2024-04-03T08:39:09.045 INFO:tasks.workunit.client.0.smithi157.stdout:2/361: write d3/f6 [1149374,57419] 0 2024-04-03T08:39:09.049 INFO:tasks.workunit.client.1.smithi181.stdout:5/143: dwrite d4/d18/f28 [0,4194304] 0 2024-04-03T08:39:09.049 INFO:tasks.workunit.client.1.smithi181.stdout:3/95: mkdir d0/d17 0 2024-04-03T08:39:09.051 INFO:tasks.workunit.client.1.smithi181.stdout:5/144: fsync d4/d22/f26 0 2024-04-03T08:39:09.053 INFO:tasks.workunit.client.0.smithi157.stdout:4/313: fsync da/df/f2a 0 2024-04-03T08:39:09.054 INFO:tasks.workunit.client.1.smithi181.stdout:5/145: chown d4/d18/f28 691725206 1 2024-04-03T08:39:09.055 INFO:tasks.workunit.client.0.smithi157.stdout:2/362: dread - d3/d2e/d32/d3c/f52 zero size 2024-04-03T08:39:09.056 INFO:tasks.workunit.client.0.smithi157.stdout:9/261: rmdir d1/d15/d27/d34 39 2024-04-03T08:39:09.064 INFO:tasks.workunit.client.0.smithi157.stdout:1/263: dread d2/d11/d24/f1c [0,4194304] 0 2024-04-03T08:39:09.066 INFO:tasks.workunit.client.0.smithi157.stdout:3/293: dread d8/f17 [0,4194304] 0 2024-04-03T08:39:09.069 INFO:tasks.workunit.client.1.smithi181.stdout:2/149: truncate fa 446295 0 2024-04-03T08:39:09.070 INFO:tasks.workunit.client.0.smithi157.stdout:8/303: dwrite d2/d20/d23/f41 [4194304,4194304] 0 2024-04-03T08:39:09.070 INFO:tasks.workunit.client.0.smithi157.stdout:3/294: dread - d8/f57 zero size 2024-04-03T08:39:09.070 INFO:tasks.workunit.client.0.smithi157.stdout:4/314: chown da/d26/f2e 9690 1 2024-04-03T08:39:09.071 INFO:tasks.workunit.client.0.smithi157.stdout:4/315: stat da/d26/l49 0 2024-04-03T08:39:09.077 INFO:tasks.workunit.client.1.smithi181.stdout:8/92: dwrite d4/d6/db/fd [0,4194304] 0 2024-04-03T08:39:09.077 INFO:tasks.workunit.client.0.smithi157.stdout:5/329: chown dc/d29/d56/d52/c54 3144522 1 2024-04-03T08:39:09.078 INFO:tasks.workunit.client.0.smithi157.stdout:8/304: read - d2/d11/d10/d24/d5b/d2e/d56/f5e zero size 2024-04-03T08:39:09.079 INFO:tasks.workunit.client.1.smithi181.stdout:8/93: stat d4/d6/db/df 0 2024-04-03T08:39:09.080 INFO:tasks.workunit.client.1.smithi181.stdout:5/146: dread d4/f13 [0,4194304] 0 2024-04-03T08:39:09.080 INFO:tasks.workunit.client.1.smithi181.stdout:0/114: unlink d5/l1f 0 2024-04-03T08:39:09.083 INFO:tasks.workunit.client.0.smithi157.stdout:5/330: chown dc/d29/d56/d18/d21/l4e 4380109 1 2024-04-03T08:39:09.084 INFO:tasks.workunit.client.0.smithi157.stdout:7/336: dread d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:09.085 INFO:tasks.workunit.client.1.smithi181.stdout:6/128: fdatasync d6/d7/d9/fa 0 2024-04-03T08:39:09.087 INFO:tasks.workunit.client.1.smithi181.stdout:7/102: symlink d0/d1/l1f 0 2024-04-03T08:39:09.087 INFO:tasks.workunit.client.1.smithi181.stdout:6/129: stat d6 0 2024-04-03T08:39:09.088 INFO:tasks.workunit.client.0.smithi157.stdout:2/363: dread d3/f9 [0,4194304] 0 2024-04-03T08:39:09.090 INFO:tasks.workunit.client.1.smithi181.stdout:7/103: write d0/d1/f15 [1275424,36790] 0 2024-04-03T08:39:09.090 INFO:tasks.workunit.client.0.smithi157.stdout:4/316: mkdir da/df/d24/d35/d53/d69 0 2024-04-03T08:39:09.091 INFO:tasks.workunit.client.1.smithi181.stdout:6/130: chown d6/df/c23 983989 1 2024-04-03T08:39:09.092 INFO:tasks.workunit.client.0.smithi157.stdout:3/295: creat d8/d1e/d2d/d39/d51/d48/f63 x:0 0 0 2024-04-03T08:39:09.092 INFO:tasks.workunit.client.1.smithi181.stdout:3/96: rename d0/c1 to d0/c18 0 2024-04-03T08:39:09.097 INFO:tasks.workunit.client.0.smithi157.stdout:9/262: mknod d1/d15/d27/d34/c57 0 2024-04-03T08:39:09.097 INFO:tasks.workunit.client.0.smithi157.stdout:5/331: mknod dc/d29/d56/d52/c73 0 2024-04-03T08:39:09.101 INFO:tasks.workunit.client.0.smithi157.stdout:9/263: dread - d1/d36/d46/f56 zero size 2024-04-03T08:39:09.101 INFO:tasks.workunit.client.1.smithi181.stdout:9/192: dread d1/f5 [0,4194304] 0 2024-04-03T08:39:09.102 INFO:tasks.workunit.client.0.smithi157.stdout:6/329: creat d1/d5/d17/d29/d62/f69 x:0 0 0 2024-04-03T08:39:09.104 INFO:tasks.workunit.client.1.smithi181.stdout:2/150: mknod d13/d22/d27/c3e 0 2024-04-03T08:39:09.105 INFO:tasks.workunit.client.1.smithi181.stdout:3/97: dread d0/f13 [0,4194304] 0 2024-04-03T08:39:09.105 INFO:tasks.workunit.client.0.smithi157.stdout:4/317: rmdir da/df/d24/d35/d53 39 2024-04-03T08:39:09.106 INFO:tasks.workunit.client.1.smithi181.stdout:2/151: fsync d13/d22/d27/f3a 0 2024-04-03T08:39:09.108 INFO:tasks.workunit.client.0.smithi157.stdout:4/318: chown da/df/d24/d58 0 1 2024-04-03T08:39:09.109 INFO:tasks.workunit.client.0.smithi157.stdout:0/313: dread d2/d9/dc/df/d1b/f6d [0,4194304] 0 2024-04-03T08:39:09.114 INFO:tasks.workunit.client.1.smithi181.stdout:6/131: symlink d6/d7/d9/l2e 0 2024-04-03T08:39:09.114 INFO:tasks.workunit.client.0.smithi157.stdout:3/296: dread d8/d13/f1c [0,4194304] 0 2024-04-03T08:39:09.115 INFO:tasks.workunit.client.0.smithi157.stdout:4/319: write da/df/f57 [596601,60869] 0 2024-04-03T08:39:09.118 INFO:tasks.workunit.client.0.smithi157.stdout:6/330: mknod d1/d5/d1b/c6a 0 2024-04-03T08:39:09.119 INFO:tasks.workunit.client.1.smithi181.stdout:4/126: rename d1/d16/d24/l25 to d1/l2d 0 2024-04-03T08:39:09.121 INFO:tasks.workunit.client.1.smithi181.stdout:4/127: chown d1/d16 1464253 1 2024-04-03T08:39:09.122 INFO:tasks.workunit.client.0.smithi157.stdout:2/364: dwrite d3/db/d44/f64 [0,4194304] 0 2024-04-03T08:39:09.125 INFO:tasks.workunit.client.0.smithi157.stdout:1/264: dread d2/d11/d24/f13 [0,4194304] 0 2024-04-03T08:39:09.126 INFO:tasks.workunit.client.0.smithi157.stdout:5/332: write f8 [1547826,99772] 0 2024-04-03T08:39:09.128 INFO:tasks.workunit.client.0.smithi157.stdout:5/333: readlink dc/d29/d56/l25 0 2024-04-03T08:39:09.129 INFO:tasks.workunit.client.1.smithi181.stdout:5/147: dwrite d4/ff [0,4194304] 0 2024-04-03T08:39:09.132 INFO:tasks.workunit.client.1.smithi181.stdout:3/98: dread d0/d5/fa [0,4194304] 0 2024-04-03T08:39:09.136 INFO:tasks.workunit.client.0.smithi157.stdout:7/337: truncate d0/d11/d15/d1b/f73 3847140 0 2024-04-03T08:39:09.137 INFO:tasks.workunit.client.0.smithi157.stdout:7/338: stat d0/d4/l64 0 2024-04-03T08:39:09.138 INFO:tasks.workunit.client.1.smithi181.stdout:2/152: dwrite fe [0,4194304] 0 2024-04-03T08:39:09.138 INFO:tasks.workunit.client.1.smithi181.stdout:1/93: dwrite f2 [0,4194304] 0 2024-04-03T08:39:09.140 INFO:tasks.workunit.client.0.smithi157.stdout:9/264: creat d1/d4a/f58 x:0 0 0 2024-04-03T08:39:09.144 INFO:tasks.workunit.client.0.smithi157.stdout:9/265: dread - d1/d15/d27/f51 zero size 2024-04-03T08:39:09.146 INFO:tasks.workunit.client.0.smithi157.stdout:9/266: fdatasync d1/f17 0 2024-04-03T08:39:09.147 INFO:tasks.workunit.client.0.smithi157.stdout:9/267: read - d1/d36/f3b zero size 2024-04-03T08:39:09.148 INFO:tasks.workunit.client.0.smithi157.stdout:6/331: creat d1/d5/d17/d29/d62/f6b x:0 0 0 2024-04-03T08:39:09.150 INFO:tasks.workunit.client.0.smithi157.stdout:8/305: link d2/d11/d10/d24/d5b/d2e/d56/c6a d2/d11/c6b 0 2024-04-03T08:39:09.155 INFO:tasks.workunit.client.0.smithi157.stdout:1/265: mknod d2/d11/d24/d39/d3b/d1b/c5a 0 2024-04-03T08:39:09.157 INFO:tasks.workunit.client.0.smithi157.stdout:5/334: truncate dc/d29/d56/f33 4050936 0 2024-04-03T08:39:09.157 INFO:tasks.workunit.client.0.smithi157.stdout:4/320: mkdir da/df/d24/d35/d6a 0 2024-04-03T08:39:09.159 INFO:tasks.workunit.client.1.smithi181.stdout:9/193: rename d1/da/d16 to d1/da/d13/d41 0 2024-04-03T08:39:09.162 INFO:tasks.workunit.client.0.smithi157.stdout:4/321: write da/df/d2f/f40 [398476,37821] 0 2024-04-03T08:39:09.162 INFO:tasks.workunit.client.0.smithi157.stdout:0/314: creat d2/d9/dc/df/d1b/d4a/d3b/d6a/f76 x:0 0 0 2024-04-03T08:39:09.164 INFO:tasks.workunit.client.0.smithi157.stdout:7/339: rename d0/d11/d15/d17/d1c/d4f/d5f/d61/f67 to d0/d4/f80 0 2024-04-03T08:39:09.164 INFO:tasks.workunit.client.1.smithi181.stdout:4/128: creat d1/d1e/f2e x:0 0 0 2024-04-03T08:39:09.165 INFO:tasks.workunit.client.0.smithi157.stdout:3/297: mknod d8/d13/d1b/d5b/c64 0 2024-04-03T08:39:09.166 INFO:tasks.workunit.client.0.smithi157.stdout:0/315: dread - d2/d9/d51/f52 zero size 2024-04-03T08:39:09.168 INFO:tasks.workunit.client.0.smithi157.stdout:3/298: fdatasync d8/d1e/d2d/d39/f47 0 2024-04-03T08:39:09.169 INFO:tasks.workunit.client.0.smithi157.stdout:9/268: dwrite d1/d15/d16/f23 [0,4194304] 0 2024-04-03T08:39:09.170 INFO:tasks.workunit.client.0.smithi157.stdout:3/299: stat d8/d13/d1b/d4e/d50/f59 0 2024-04-03T08:39:09.172 INFO:tasks.workunit.client.0.smithi157.stdout:3/300: readlink d8/d1e/l49 0 2024-04-03T08:39:09.185 INFO:tasks.workunit.client.0.smithi157.stdout:6/332: truncate d1/f3 3176643 0 2024-04-03T08:39:09.186 INFO:tasks.workunit.client.1.smithi181.stdout:3/99: dwrite d0/f13 [4194304,4194304] 0 2024-04-03T08:39:09.203 INFO:tasks.workunit.client.0.smithi157.stdout:1/266: dread d2/f5 [0,4194304] 0 2024-04-03T08:39:09.212 INFO:tasks.workunit.client.1.smithi181.stdout:0/115: truncate d5/dc/ff 800319 0 2024-04-03T08:39:09.212 INFO:tasks.workunit.client.1.smithi181.stdout:5/148: sync 2024-04-03T08:39:09.213 INFO:tasks.workunit.client.1.smithi181.stdout:8/94: rmdir d4/d6/db/df 0 2024-04-03T08:39:09.215 INFO:tasks.workunit.client.0.smithi157.stdout:5/335: creat dc/d29/d56/d18/d21/f74 x:0 0 0 2024-04-03T08:39:09.216 INFO:tasks.workunit.client.1.smithi181.stdout:8/95: write d4/d6/f7 [1937925,18100] 0 2024-04-03T08:39:09.217 INFO:tasks.workunit.client.1.smithi181.stdout:8/96: chown d4/d6/f7 238696 1 2024-04-03T08:39:09.220 INFO:tasks.workunit.client.1.smithi181.stdout:7/104: creat d0/d1/d6/f20 x:0 0 0 2024-04-03T08:39:09.221 INFO:tasks.workunit.client.0.smithi157.stdout:1/267: dwrite d2/d11/d24/d39/d3b/d1b/f2a [0,4194304] 0 2024-04-03T08:39:09.223 INFO:tasks.workunit.client.0.smithi157.stdout:2/365: dwrite d3/d12/f7c [0,4194304] 0 2024-04-03T08:39:09.228 INFO:tasks.workunit.client.1.smithi181.stdout:1/94: rename f9 to d10/d15/d17/f1d 0 2024-04-03T08:39:09.232 INFO:tasks.workunit.client.0.smithi157.stdout:7/340: mknod d0/d11/d15/d17/d1c/d4f/d5f/c81 0 2024-04-03T08:39:09.234 INFO:tasks.workunit.client.1.smithi181.stdout:6/132: dwrite d6/f17 [0,4194304] 0 2024-04-03T08:39:09.237 INFO:tasks.workunit.client.0.smithi157.stdout:9/269: symlink d1/d15/d16/l59 0 2024-04-03T08:39:09.237 INFO:tasks.workunit.client.1.smithi181.stdout:4/129: readlink d1/l5 0 2024-04-03T08:39:09.241 INFO:tasks.workunit.client.0.smithi157.stdout:3/301: fdatasync d8/d13/f1c 0 2024-04-03T08:39:09.262 INFO:tasks.workunit.client.1.smithi181.stdout:8/97: symlink d4/d6/d9/l1a 0 2024-04-03T08:39:09.264 INFO:tasks.workunit.client.1.smithi181.stdout:7/105: creat d0/d1/f21 x:0 0 0 2024-04-03T08:39:09.272 INFO:tasks.workunit.client.1.smithi181.stdout:1/95: symlink d10/d15/d17/d19/l1e 0 2024-04-03T08:39:09.272 INFO:tasks.workunit.client.1.smithi181.stdout:6/133: mknod d6/c2f 0 2024-04-03T08:39:09.273 INFO:tasks.workunit.client.0.smithi157.stdout:7/341: creat d0/d11/d15/d17/d52/f82 x:0 0 0 2024-04-03T08:39:09.275 INFO:tasks.workunit.client.0.smithi157.stdout:7/342: fdatasync d0/d11/d15/f2e 0 2024-04-03T08:39:09.275 INFO:tasks.workunit.client.1.smithi181.stdout:3/100: mknod d0/d5/d6/c19 0 2024-04-03T08:39:09.277 INFO:tasks.workunit.client.0.smithi157.stdout:7/343: dread - d0/d11/d15/d1b/f57 zero size 2024-04-03T08:39:09.277 INFO:tasks.workunit.client.1.smithi181.stdout:6/134: dread - d6/d7/d9/f21 zero size 2024-04-03T08:39:09.277 INFO:tasks.workunit.client.1.smithi181.stdout:2/153: link d13/d22/d27/c31 d13/d22/d27/d2f/c3f 0 2024-04-03T08:39:09.278 INFO:tasks.workunit.client.0.smithi157.stdout:7/344: stat d0/d4/d36/f79 0 2024-04-03T08:39:09.279 INFO:tasks.workunit.client.0.smithi157.stdout:3/302: fsync d8/f2f 0 2024-04-03T08:39:09.279 INFO:tasks.workunit.client.1.smithi181.stdout:7/106: dread d0/d1/d6/f9 [4194304,4194304] 0 2024-04-03T08:39:09.281 INFO:tasks.workunit.client.1.smithi181.stdout:3/101: write d0/d5/d6/f11 [1008499,59899] 0 2024-04-03T08:39:09.281 INFO:tasks.workunit.client.1.smithi181.stdout:5/149: fdatasync d4/f5 0 2024-04-03T08:39:09.281 INFO:tasks.workunit.client.1.smithi181.stdout:6/135: read - d6/d7/f20 zero size 2024-04-03T08:39:09.287 INFO:tasks.workunit.client.1.smithi181.stdout:4/130: dread d1/d16/f13 [0,4194304] 0 2024-04-03T08:39:09.288 INFO:tasks.workunit.client.0.smithi157.stdout:9/270: dread d1/d15/f1a [0,4194304] 0 2024-04-03T08:39:09.288 INFO:tasks.workunit.client.1.smithi181.stdout:8/98: creat d4/d6/d9/f1b x:0 0 0 2024-04-03T08:39:09.293 INFO:tasks.workunit.client.0.smithi157.stdout:4/322: mkdir da/df/d6b 0 2024-04-03T08:39:09.293 INFO:tasks.workunit.client.1.smithi181.stdout:4/131: write d1/d1e/f1c [173614,56806] 0 2024-04-03T08:39:09.295 INFO:tasks.workunit.client.1.smithi181.stdout:1/96: rename le to d10/d15/d17/l1f 0 2024-04-03T08:39:09.298 INFO:tasks.workunit.client.0.smithi157.stdout:6/333: symlink d1/d5/d1b/l6c 0 2024-04-03T08:39:09.298 INFO:tasks.workunit.client.1.smithi181.stdout:4/132: write d1/d16/f27 [677528,68609] 0 2024-04-03T08:39:09.301 INFO:tasks.workunit.client.1.smithi181.stdout:0/116: link d5/fb d5/dc/d14/f22 0 2024-04-03T08:39:09.302 INFO:tasks.workunit.client.0.smithi157.stdout:1/268: link d2/d11/d24/d39/d3b/l17 d2/d11/d24/d39/d3b/d2e/l5b 0 2024-04-03T08:39:09.302 INFO:tasks.workunit.client.0.smithi157.stdout:9/271: dwrite d1/d15/d16/f2a [0,4194304] 0 2024-04-03T08:39:09.304 INFO:tasks.workunit.client.1.smithi181.stdout:6/136: dwrite d6/d7/f2a [0,4194304] 0 2024-04-03T08:39:09.308 INFO:tasks.workunit.client.1.smithi181.stdout:7/107: chown d0/d1/d6/fd 955197012 1 2024-04-03T08:39:09.309 INFO:tasks.workunit.client.0.smithi157.stdout:4/323: mknod da/df/c6c 0 2024-04-03T08:39:09.312 INFO:tasks.workunit.client.0.smithi157.stdout:4/324: truncate da/df/d24/f5c 1011163 0 2024-04-03T08:39:09.315 INFO:tasks.workunit.client.0.smithi157.stdout:1/269: dread d2/d11/d24/d39/d3b/d1b/f30 [0,4194304] 0 2024-04-03T08:39:09.315 INFO:tasks.workunit.client.1.smithi181.stdout:2/154: dwrite f11 [0,4194304] 0 2024-04-03T08:39:09.321 INFO:tasks.workunit.client.1.smithi181.stdout:1/97: rename cf to d10/d15/d17/c20 0 2024-04-03T08:39:09.323 INFO:tasks.workunit.client.0.smithi157.stdout:3/303: creat d8/d1e/f65 x:0 0 0 2024-04-03T08:39:09.326 INFO:tasks.workunit.client.1.smithi181.stdout:5/150: unlink d4/d18/d25/l27 0 2024-04-03T08:39:09.333 INFO:tasks.workunit.client.1.smithi181.stdout:8/99: mkdir d4/d6/db/d16/d1c 0 2024-04-03T08:39:09.336 INFO:tasks.workunit.client.1.smithi181.stdout:8/100: chown d4/d6/d9/f11 764235656 1 2024-04-03T08:39:09.338 INFO:tasks.workunit.client.1.smithi181.stdout:2/155: mkdir d13/d22/d40 0 2024-04-03T08:39:09.339 INFO:tasks.workunit.client.0.smithi157.stdout:7/345: mknod d0/d4/c83 0 2024-04-03T08:39:09.339 INFO:tasks.workunit.client.0.smithi157.stdout:4/325: symlink da/df/d11/d5d/l6d 0 2024-04-03T08:39:09.340 INFO:tasks.workunit.client.1.smithi181.stdout:6/137: rename d6/d7/d9/l18 to d6/l30 0 2024-04-03T08:39:09.341 INFO:tasks.workunit.client.0.smithi157.stdout:4/326: chown da/df/l17 510389 1 2024-04-03T08:39:09.343 INFO:tasks.workunit.client.0.smithi157.stdout:6/334: link d1/d5/d1b/f54 d1/f6d 0 2024-04-03T08:39:09.346 INFO:tasks.workunit.client.1.smithi181.stdout:1/98: creat d10/d15/d17/f21 x:0 0 0 2024-04-03T08:39:09.350 INFO:tasks.workunit.client.0.smithi157.stdout:7/346: mknod d0/d4/c84 0 2024-04-03T08:39:09.350 INFO:tasks.workunit.client.0.smithi157.stdout:8/306: sync 2024-04-03T08:39:09.353 INFO:tasks.workunit.client.1.smithi181.stdout:5/151: mknod d4/d18/d2c/c2f 0 2024-04-03T08:39:09.354 INFO:tasks.workunit.client.1.smithi181.stdout:8/101: dread d4/fc [0,4194304] 0 2024-04-03T08:39:09.355 INFO:tasks.workunit.client.0.smithi157.stdout:6/335: stat d1/d4b/c49 0 2024-04-03T08:39:09.357 INFO:tasks.workunit.client.0.smithi157.stdout:1/270: creat d2/d11/d24/d39/d3b/f5c x:0 0 0 2024-04-03T08:39:09.358 INFO:tasks.workunit.client.1.smithi181.stdout:8/102: chown d4/f5 1973628029 1 2024-04-03T08:39:09.361 INFO:tasks.workunit.client.0.smithi157.stdout:0/316: symlink d2/d9/dc/l77 0 2024-04-03T08:39:09.366 INFO:tasks.workunit.client.1.smithi181.stdout:2/156: creat d13/f41 x:0 0 0 2024-04-03T08:39:09.366 INFO:tasks.workunit.client.1.smithi181.stdout:4/133: creat d1/f2f x:0 0 0 2024-04-03T08:39:09.366 INFO:tasks.workunit.client.0.smithi157.stdout:7/347: dwrite d0/d11/d15/d1b/f39 [0,4194304] 0 2024-04-03T08:39:09.372 INFO:tasks.workunit.client.0.smithi157.stdout:2/366: symlink d3/d2e/l7d 0 2024-04-03T08:39:09.373 INFO:tasks.workunit.client.0.smithi157.stdout:1/271: mkdir d2/d11/d24/d39/d3b/d2e/d48/d5d 0 2024-04-03T08:39:09.374 INFO:tasks.workunit.client.1.smithi181.stdout:1/99: creat d10/f22 x:0 0 0 2024-04-03T08:39:09.375 INFO:tasks.workunit.client.0.smithi157.stdout:6/336: dwrite d1/d5/d1b/f41 [0,4194304] 0 2024-04-03T08:39:09.378 INFO:tasks.workunit.client.0.smithi157.stdout:1/272: write d2/d11/d24/d39/d3b/d1b/f2a [2040080,30842] 0 2024-04-03T08:39:09.379 INFO:tasks.workunit.client.1.smithi181.stdout:6/138: dwrite d6/d7/d9/f15 [4194304,4194304] 0 2024-04-03T08:39:09.383 INFO:tasks.workunit.client.0.smithi157.stdout:6/337: dread d1/d5/d1b/f54 [0,4194304] 0 2024-04-03T08:39:09.383 INFO:tasks.workunit.client.0.smithi157.stdout:0/317: dwrite d2/f25 [0,4194304] 0 2024-04-03T08:39:09.388 INFO:tasks.workunit.client.0.smithi157.stdout:7/348: dread d0/d11/d15/d1b/f3f [0,4194304] 0 2024-04-03T08:39:09.390 INFO:tasks.workunit.client.1.smithi181.stdout:3/102: getdents d0/d5/d6/dd 0 2024-04-03T08:39:09.390 INFO:tasks.workunit.client.1.smithi181.stdout:4/134: mknod d1/d16/d1f/c30 0 2024-04-03T08:39:09.392 INFO:tasks.workunit.client.0.smithi157.stdout:2/367: readlink d3/d12/l2b 0 2024-04-03T08:39:09.392 INFO:tasks.workunit.client.0.smithi157.stdout:7/349: chown d0/d4/f10 7838 1 2024-04-03T08:39:09.392 INFO:tasks.workunit.client.1.smithi181.stdout:4/135: readlink d1/l20 0 2024-04-03T08:39:09.393 INFO:tasks.workunit.client.0.smithi157.stdout:7/350: chown d0/f20 0 1 2024-04-03T08:39:09.393 INFO:tasks.workunit.client.1.smithi181.stdout:8/103: dwrite d4/d6/d9/f18 [0,4194304] 0 2024-04-03T08:39:09.395 INFO:tasks.workunit.client.1.smithi181.stdout:6/139: write d6/d7/f20 [1041488,103647] 0 2024-04-03T08:39:09.396 INFO:tasks.workunit.client.1.smithi181.stdout:5/152: unlink d4/cc 0 2024-04-03T08:39:09.397 INFO:tasks.workunit.client.1.smithi181.stdout:8/104: rename d4 to d4/d1d 22 2024-04-03T08:39:09.400 INFO:tasks.workunit.client.1.smithi181.stdout:7/108: link d0/d1/c13 d0/d1/d6/de/d17/c22 0 2024-04-03T08:39:09.402 INFO:tasks.workunit.client.1.smithi181.stdout:1/100: mkdir d10/d15/d17/d23 0 2024-04-03T08:39:09.405 INFO:tasks.workunit.client.1.smithi181.stdout:7/109: write d0/d1/f15 [1501752,31939] 0 2024-04-03T08:39:09.409 INFO:tasks.workunit.client.0.smithi157.stdout:6/338: symlink d1/d5/d1b/l6e 0 2024-04-03T08:39:09.410 INFO:tasks.workunit.client.1.smithi181.stdout:2/157: link f0 d13/d22/d40/f42 0 2024-04-03T08:39:09.411 INFO:tasks.workunit.client.1.smithi181.stdout:3/103: symlink d0/l1a 0 2024-04-03T08:39:09.413 INFO:tasks.workunit.client.1.smithi181.stdout:2/158: chown d13/l1a 56931 1 2024-04-03T08:39:09.417 INFO:tasks.workunit.client.0.smithi157.stdout:7/351: dwrite d0/d5/f3e [0,4194304] 0 2024-04-03T08:39:09.418 INFO:tasks.workunit.client.0.smithi157.stdout:0/318: dread d2/d9/d36/f3f [0,4194304] 0 2024-04-03T08:39:09.425 INFO:tasks.workunit.client.1.smithi181.stdout:4/136: dread d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:09.425 INFO:tasks.workunit.client.1.smithi181.stdout:4/137: readlink d1/l20 0 2024-04-03T08:39:09.431 INFO:tasks.workunit.client.1.smithi181.stdout:0/117: truncate d5/dc/d14/f22 1543170 0 2024-04-03T08:39:09.432 INFO:tasks.workunit.client.1.smithi181.stdout:7/110: creat d0/d1/d6/de/f23 x:0 0 0 2024-04-03T08:39:09.432 INFO:tasks.workunit.client.1.smithi181.stdout:1/101: dread fc [4194304,4194304] 0 2024-04-03T08:39:09.434 INFO:tasks.workunit.client.0.smithi157.stdout:7/352: rename d0/d11/c2f to d0/d11/d15/d17/d52/c85 0 2024-04-03T08:39:09.436 INFO:tasks.workunit.client.0.smithi157.stdout:6/339: read d1/fb [2895694,128155] 0 2024-04-03T08:39:09.439 INFO:tasks.workunit.client.0.smithi157.stdout:6/340: readlink d1/d5/d1b/d2c/l50 0 2024-04-03T08:39:09.440 INFO:tasks.workunit.client.1.smithi181.stdout:2/159: mknod d13/d1d/c43 0 2024-04-03T08:39:09.441 INFO:tasks.workunit.client.1.smithi181.stdout:8/105: symlink d4/d6/d9/d15/l1e 0 2024-04-03T08:39:09.442 INFO:tasks.workunit.client.0.smithi157.stdout:0/319: dwrite d2/f5b [4194304,4194304] 0 2024-04-03T08:39:09.443 INFO:tasks.workunit.client.1.smithi181.stdout:2/160: dread - d13/d1c/f36 zero size 2024-04-03T08:39:09.445 INFO:tasks.workunit.client.1.smithi181.stdout:2/161: fsync d13/f25 0 2024-04-03T08:39:09.445 INFO:tasks.workunit.client.1.smithi181.stdout:4/138: mkdir d1/d16/d1f/d31 0 2024-04-03T08:39:09.448 INFO:tasks.workunit.client.1.smithi181.stdout:7/111: creat d0/d1/d6/de/d17/f24 x:0 0 0 2024-04-03T08:39:09.451 INFO:tasks.workunit.client.1.smithi181.stdout:3/104: dread d0/d5/fa [0,4194304] 0 2024-04-03T08:39:09.452 INFO:tasks.workunit.client.0.smithi157.stdout:6/341: rename d1/d5/d1b/d2c/l2f to d1/d4b/d38/d59/l6f 0 2024-04-03T08:39:09.454 INFO:tasks.workunit.client.1.smithi181.stdout:9/194: rmdir d1/d34 39 2024-04-03T08:39:09.456 INFO:tasks.workunit.client.1.smithi181.stdout:8/106: mknod d4/c1f 0 2024-04-03T08:39:09.460 INFO:tasks.workunit.client.0.smithi157.stdout:6/342: fdatasync d1/d22/f58 0 2024-04-03T08:39:09.461 INFO:tasks.workunit.client.1.smithi181.stdout:5/153: dread d4/f12 [0,4194304] 0 2024-04-03T08:39:09.462 INFO:tasks.workunit.client.1.smithi181.stdout:6/140: rmdir d6/d7/d9 39 2024-04-03T08:39:09.463 INFO:tasks.workunit.client.0.smithi157.stdout:5/336: link dc/d29/d56/d2e/l39 dc/l75 0 2024-04-03T08:39:09.463 INFO:tasks.workunit.client.1.smithi181.stdout:5/154: chown d4/d18 1 1 2024-04-03T08:39:09.463 INFO:tasks.workunit.client.1.smithi181.stdout:6/141: chown d6/f13 14824 1 2024-04-03T08:39:09.465 INFO:tasks.workunit.client.0.smithi157.stdout:7/353: dwrite d0/d4/d36/f79 [0,4194304] 0 2024-04-03T08:39:09.466 INFO:tasks.workunit.client.0.smithi157.stdout:5/337: stat dc/d29/d56/d49/d53 0 2024-04-03T08:39:09.471 INFO:tasks.workunit.client.1.smithi181.stdout:3/105: stat d0/d5/d6/c12 0 2024-04-03T08:39:09.471 INFO:tasks.workunit.client.0.smithi157.stdout:0/320: dwrite d2/d9/dc/f3c [0,4194304] 0 2024-04-03T08:39:09.474 INFO:tasks.workunit.client.0.smithi157.stdout:9/272: mknod d1/d15/c5a 0 2024-04-03T08:39:09.478 INFO:tasks.workunit.client.0.smithi157.stdout:7/354: unlink d0/d4/d36/f79 0 2024-04-03T08:39:09.485 INFO:tasks.workunit.client.0.smithi157.stdout:9/273: creat d1/d15/d16/f5b x:0 0 0 2024-04-03T08:39:09.486 INFO:tasks.workunit.client.0.smithi157.stdout:5/338: dwrite dc/d29/d56/d49/f5e [0,4194304] 0 2024-04-03T08:39:09.489 INFO:tasks.workunit.client.1.smithi181.stdout:4/139: getdents d1/d16/d1f/d2b 0 2024-04-03T08:39:09.496 INFO:tasks.workunit.client.0.smithi157.stdout:4/327: dwrite f4 [0,4194304] 0 2024-04-03T08:39:09.498 INFO:tasks.workunit.client.0.smithi157.stdout:7/355: creat d0/d75/f86 x:0 0 0 2024-04-03T08:39:09.500 INFO:tasks.workunit.client.0.smithi157.stdout:5/339: rename dc/d29/d56/d18/d21/f65 to dc/d29/d56/d49/d53/f76 0 2024-04-03T08:39:09.504 INFO:tasks.workunit.client.0.smithi157.stdout:9/274: mkdir d1/d15/d27/d5c 0 2024-04-03T08:39:09.506 INFO:tasks.workunit.client.1.smithi181.stdout:6/142: dwrite d6/d7/d9/f15 [4194304,4194304] 0 2024-04-03T08:39:09.509 INFO:tasks.workunit.client.1.smithi181.stdout:4/140: unlink d1/d1e/c1d 0 2024-04-03T08:39:09.510 INFO:tasks.workunit.client.1.smithi181.stdout:4/141: stat d1/d16/f17 0 2024-04-03T08:39:09.511 INFO:tasks.workunit.client.1.smithi181.stdout:4/142: dread - d1/f2f zero size 2024-04-03T08:39:09.514 INFO:tasks.workunit.client.1.smithi181.stdout:3/106: symlink d0/d17/l1b 0 2024-04-03T08:39:09.517 INFO:tasks.workunit.client.0.smithi157.stdout:5/340: fsync dc/d35/f40 0 2024-04-03T08:39:09.520 INFO:tasks.workunit.client.1.smithi181.stdout:9/195: creat d1/da/d13/d22/f42 x:0 0 0 2024-04-03T08:39:09.522 INFO:tasks.workunit.client.1.smithi181.stdout:9/196: write d1/da/d13/d22/f42 [683218,117433] 0 2024-04-03T08:39:09.525 INFO:tasks.workunit.client.1.smithi181.stdout:3/107: dread d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:09.526 INFO:tasks.workunit.client.1.smithi181.stdout:2/162: getdents d13/d22 0 2024-04-03T08:39:09.526 INFO:tasks.workunit.client.1.smithi181.stdout:3/108: chown d0/d17/l1b 1810 1 2024-04-03T08:39:09.526 INFO:tasks.workunit.client.1.smithi181.stdout:3/109: readlink d0/l1a 0 2024-04-03T08:39:09.527 INFO:tasks.workunit.client.1.smithi181.stdout:6/143: mkdir d6/d31 0 2024-04-03T08:39:09.528 INFO:tasks.workunit.client.0.smithi157.stdout:0/321: dread d2/d9/dc/f5d [0,4194304] 0 2024-04-03T08:39:09.529 INFO:tasks.workunit.client.0.smithi157.stdout:8/307: dwrite d2/d11/d10/d24/d5b/d2e/f38 [0,4194304] 0 2024-04-03T08:39:09.530 INFO:tasks.workunit.client.0.smithi157.stdout:4/328: getdents da/df/d2f/d54/d5f 0 2024-04-03T08:39:09.534 INFO:tasks.workunit.client.0.smithi157.stdout:5/341: dread f8 [0,4194304] 0 2024-04-03T08:39:09.535 INFO:tasks.workunit.client.0.smithi157.stdout:5/342: dread - dc/d29/d43/f66 zero size 2024-04-03T08:39:09.537 INFO:tasks.workunit.client.0.smithi157.stdout:9/275: rename d1/l1f to d1/d4a/l5d 0 2024-04-03T08:39:09.539 INFO:tasks.workunit.client.1.smithi181.stdout:6/144: dread d6/f17 [0,4194304] 0 2024-04-03T08:39:09.540 INFO:tasks.workunit.client.0.smithi157.stdout:9/276: chown d1/d15/f31 105237824 1 2024-04-03T08:39:09.540 INFO:tasks.workunit.client.0.smithi157.stdout:5/343: dread - dc/d29/d56/d18/d21/f61 zero size 2024-04-03T08:39:09.540 INFO:tasks.workunit.client.0.smithi157.stdout:6/343: dread d1/f3 [0,4194304] 0 2024-04-03T08:39:09.540 INFO:tasks.workunit.client.0.smithi157.stdout:9/277: dread - d1/d4a/f58 zero size 2024-04-03T08:39:09.541 INFO:tasks.workunit.client.1.smithi181.stdout:6/145: read d6/d7/f2a [3600429,18629] 0 2024-04-03T08:39:09.541 INFO:tasks.workunit.client.0.smithi157.stdout:2/368: truncate d3/d2e/f75 140191 0 2024-04-03T08:39:09.542 INFO:tasks.workunit.client.1.smithi181.stdout:6/146: readlink d6/d7/d9/l16 0 2024-04-03T08:39:09.543 INFO:tasks.workunit.client.1.smithi181.stdout:2/163: mkdir d13/d1c/d44 0 2024-04-03T08:39:09.543 INFO:tasks.workunit.client.0.smithi157.stdout:7/356: creat d0/d11/d15/f87 x:0 0 0 2024-04-03T08:39:09.544 INFO:tasks.workunit.client.0.smithi157.stdout:2/369: chown d3/f48 69653501 1 2024-04-03T08:39:09.546 INFO:tasks.workunit.client.1.smithi181.stdout:3/110: creat d0/d5/d6/dd/f1c x:0 0 0 2024-04-03T08:39:09.546 INFO:tasks.workunit.client.1.smithi181.stdout:3/111: readlink d0/l1a 0 2024-04-03T08:39:09.547 INFO:tasks.workunit.client.0.smithi157.stdout:4/329: rmdir da/df/d24 39 2024-04-03T08:39:09.548 INFO:tasks.workunit.client.1.smithi181.stdout:3/112: readlink d0/d5/d6/dd/le 0 2024-04-03T08:39:09.553 INFO:tasks.workunit.client.1.smithi181.stdout:9/197: mknod d1/da/d28/d30/d3e/c43 0 2024-04-03T08:39:09.553 INFO:tasks.workunit.client.0.smithi157.stdout:8/308: dwrite d2/d11/d10/d24/d5b/d2e/d56/f5e [0,4194304] 0 2024-04-03T08:39:09.555 INFO:tasks.workunit.client.1.smithi181.stdout:7/112: rmdir d0/d1 39 2024-04-03T08:39:09.558 INFO:tasks.workunit.client.0.smithi157.stdout:3/304: sync 2024-04-03T08:39:09.560 INFO:tasks.workunit.client.1.smithi181.stdout:4/143: dread d1/d16/f18 [0,4194304] 0 2024-04-03T08:39:09.561 INFO:tasks.workunit.client.0.smithi157.stdout:2/370: creat d3/db/f7e x:0 0 0 2024-04-03T08:39:09.563 INFO:tasks.workunit.client.0.smithi157.stdout:9/278: dwrite d1/d15/f50 [0,4194304] 0 2024-04-03T08:39:09.564 INFO:tasks.workunit.client.1.smithi181.stdout:1/102: write fb [3105101,88440] 0 2024-04-03T08:39:09.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:09 smithi157 ceph-mon[35083]: pgmap v294: 65 pgs: 65 active+clean; 730 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 4.9 MiB/s rd, 77 MiB/s wr, 154 op/s 2024-04-03T08:39:09.564 INFO:tasks.workunit.client.1.smithi181.stdout:2/164: symlink d13/d1c/l45 0 2024-04-03T08:39:09.569 INFO:tasks.workunit.client.1.smithi181.stdout:3/113: dwrite d0/d5/d6/dd/f1c [0,4194304] 0 2024-04-03T08:39:09.570 INFO:tasks.workunit.client.0.smithi157.stdout:4/330: truncate da/df/d24/f59 1271097 0 2024-04-03T08:39:09.572 INFO:tasks.workunit.client.1.smithi181.stdout:0/118: truncate d5/dc/f12 3318602 0 2024-04-03T08:39:09.574 INFO:tasks.workunit.client.1.smithi181.stdout:4/144: dread d1/d16/f18 [0,4194304] 0 2024-04-03T08:39:09.575 INFO:tasks.workunit.client.1.smithi181.stdout:4/145: fdatasync d1/f7 0 2024-04-03T08:39:09.577 INFO:tasks.workunit.client.1.smithi181.stdout:3/114: dread d0/f3 [0,4194304] 0 2024-04-03T08:39:09.578 INFO:tasks.workunit.client.1.smithi181.stdout:4/146: chown d1/d16/c21 47898136 1 2024-04-03T08:39:09.579 INFO:tasks.workunit.client.1.smithi181.stdout:3/115: stat d0/l1a 0 2024-04-03T08:39:09.582 INFO:tasks.workunit.client.1.smithi181.stdout:8/107: truncate d4/d6/db/fd 2597994 0 2024-04-03T08:39:09.582 INFO:tasks.workunit.client.1.smithi181.stdout:8/108: chown d4 19450061 1 2024-04-03T08:39:09.583 INFO:tasks.workunit.client.0.smithi157.stdout:2/371: creat d3/d2e/d65/f7f x:0 0 0 2024-04-03T08:39:09.585 INFO:tasks.workunit.client.0.smithi157.stdout:3/305: mknod d8/d1e/d2d/d3f/c66 0 2024-04-03T08:39:09.587 INFO:tasks.workunit.client.1.smithi181.stdout:6/147: unlink d6/df/c2d 0 2024-04-03T08:39:09.588 INFO:tasks.workunit.client.1.smithi181.stdout:8/109: dread d4/d6/f8 [0,4194304] 0 2024-04-03T08:39:09.589 INFO:tasks.workunit.client.1.smithi181.stdout:6/148: chown d6/d7/d9/l2e 26236352 1 2024-04-03T08:39:09.589 INFO:tasks.workunit.client.0.smithi157.stdout:9/279: write d1/d15/d27/f49 [3583009,108736] 0 2024-04-03T08:39:09.591 INFO:tasks.workunit.client.1.smithi181.stdout:1/103: chown ca 504 1 2024-04-03T08:39:09.591 INFO:tasks.workunit.client.1.smithi181.stdout:6/149: write d6/d7/d9/f21 [938373,80069] 0 2024-04-03T08:39:09.592 INFO:tasks.workunit.client.0.smithi157.stdout:4/331: symlink da/df/d11/l6e 0 2024-04-03T08:39:09.593 INFO:tasks.workunit.client.1.smithi181.stdout:2/165: mkdir d13/d22/d27/d46 0 2024-04-03T08:39:09.596 INFO:tasks.workunit.client.0.smithi157.stdout:0/322: rename d2/d9/dc/df/d1b/d4a/d3b to d2/d9/dc/df/d78 0 2024-04-03T08:39:09.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:09 smithi181 ceph-mon[44183]: pgmap v294: 65 pgs: 65 active+clean; 730 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 4.9 MiB/s rd, 77 MiB/s wr, 154 op/s 2024-04-03T08:39:09.602 INFO:tasks.workunit.client.0.smithi157.stdout:2/372: dwrite d3/d12/d43/d4b/d55/f62 [0,4194304] 0 2024-04-03T08:39:09.604 INFO:tasks.workunit.client.0.smithi157.stdout:3/306: mknod d8/d1e/d2d/d39/c67 0 2024-04-03T08:39:09.605 INFO:tasks.workunit.client.1.smithi181.stdout:9/198: mknod d1/da/d13/d22/d23/c44 0 2024-04-03T08:39:09.606 INFO:tasks.workunit.client.0.smithi157.stdout:9/280: creat d1/d36/d46/f5e x:0 0 0 2024-04-03T08:39:09.609 INFO:tasks.workunit.client.0.smithi157.stdout:9/281: write d1/d36/f3b [337634,114917] 0 2024-04-03T08:39:09.609 INFO:tasks.workunit.client.1.smithi181.stdout:1/104: dwrite d10/d15/d17/d19/f1a [0,4194304] 0 2024-04-03T08:39:09.609 INFO:tasks.workunit.client.0.smithi157.stdout:5/344: write dc/f13 [29449,109825] 0 2024-04-03T08:39:09.617 INFO:tasks.workunit.client.1.smithi181.stdout:1/105: truncate d10/d15/d17/f1d 1570799 0 2024-04-03T08:39:09.618 INFO:tasks.workunit.client.1.smithi181.stdout:1/106: fdatasync f4 0 2024-04-03T08:39:09.619 INFO:tasks.workunit.client.1.smithi181.stdout:1/107: chown f4 14 1 2024-04-03T08:39:09.622 INFO:tasks.workunit.client.1.smithi181.stdout:2/166: creat d13/d22/d27/d2f/f47 x:0 0 0 2024-04-03T08:39:09.627 INFO:tasks.workunit.client.0.smithi157.stdout:3/307: unlink d8/d13/d1b/c2b 0 2024-04-03T08:39:09.631 INFO:tasks.workunit.client.0.smithi157.stdout:3/308: chown d8/d1e/d2d/d39/d51/d4c/f40 2460060 1 2024-04-03T08:39:09.632 INFO:tasks.workunit.client.1.smithi181.stdout:1/108: dread f2 [0,4194304] 0 2024-04-03T08:39:09.633 INFO:tasks.workunit.client.1.smithi181.stdout:9/199: rmdir d1/da/d13/d22/d23 39 2024-04-03T08:39:09.638 INFO:tasks.workunit.client.0.smithi157.stdout:4/332: dread da/fc [0,4194304] 0 2024-04-03T08:39:09.638 INFO:tasks.workunit.client.0.smithi157.stdout:3/309: dread d8/d13/f60 [0,4194304] 0 2024-04-03T08:39:09.639 INFO:tasks.workunit.client.0.smithi157.stdout:8/309: write d2/d11/ff [1276449,26458] 0 2024-04-03T08:39:09.644 INFO:tasks.workunit.client.1.smithi181.stdout:8/110: creat d4/d6/db/d14/f20 x:0 0 0 2024-04-03T08:39:09.645 INFO:tasks.workunit.client.1.smithi181.stdout:8/111: stat d4/d6/db/f13 0 2024-04-03T08:39:09.647 INFO:tasks.workunit.client.0.smithi157.stdout:8/310: dread d2/d11/d10/d24/d5b/f49 [0,4194304] 0 2024-04-03T08:39:09.649 INFO:tasks.workunit.client.0.smithi157.stdout:9/282: dread d1/f19 [4194304,4194304] 0 2024-04-03T08:39:09.649 INFO:tasks.workunit.client.1.smithi181.stdout:6/150: symlink d6/d7/d9/d22/l32 0 2024-04-03T08:39:09.650 INFO:tasks.workunit.client.0.smithi157.stdout:8/311: write d2/d11/ff [1810909,71979] 0 2024-04-03T08:39:09.650 INFO:tasks.workunit.client.1.smithi181.stdout:2/167: dread d13/d22/d40/f42 [0,4194304] 0 2024-04-03T08:39:09.651 INFO:tasks.workunit.client.0.smithi157.stdout:8/312: dread - d2/d20/f3b zero size 2024-04-03T08:39:09.656 INFO:tasks.workunit.client.1.smithi181.stdout:0/119: creat d5/dc/f23 x:0 0 0 2024-04-03T08:39:09.657 INFO:tasks.workunit.client.1.smithi181.stdout:0/120: stat d5/dc 0 2024-04-03T08:39:09.657 INFO:tasks.workunit.client.0.smithi157.stdout:5/345: dread dc/f59 [0,4194304] 0 2024-04-03T08:39:09.658 INFO:tasks.workunit.client.0.smithi157.stdout:6/344: rename d1/d5/d1b/c6a to d1/d5/d17/d2a/c70 0 2024-04-03T08:39:09.658 INFO:tasks.workunit.client.1.smithi181.stdout:0/121: dread - d5/d9/fd zero size 2024-04-03T08:39:09.659 INFO:tasks.workunit.client.1.smithi181.stdout:3/116: creat d0/d5/d6/f1d x:0 0 0 2024-04-03T08:39:09.663 INFO:tasks.workunit.client.1.smithi181.stdout:1/109: write d10/d15/d17/f1d [1817349,122083] 0 2024-04-03T08:39:09.663 INFO:tasks.workunit.client.1.smithi181.stdout:8/112: dwrite d4/d6/d9/f1b [0,4194304] 0 2024-04-03T08:39:09.666 INFO:tasks.workunit.client.1.smithi181.stdout:4/147: rename d1/d16/f27 to d1/f32 0 2024-04-03T08:39:09.670 INFO:tasks.workunit.client.0.smithi157.stdout:3/310: creat d8/d1e/d2d/d39/f68 x:0 0 0 2024-04-03T08:39:09.670 INFO:tasks.workunit.client.1.smithi181.stdout:2/168: dwrite d13/d22/d27/d2f/f47 [0,4194304] 0 2024-04-03T08:39:09.670 INFO:tasks.workunit.client.0.smithi157.stdout:8/313: dwrite d2/d11/d10/d24/d5b/d2e/f42 [0,4194304] 0 2024-04-03T08:39:09.675 INFO:tasks.workunit.client.0.smithi157.stdout:8/314: dread - d2/d20/f60 zero size 2024-04-03T08:39:09.682 INFO:tasks.workunit.client.1.smithi181.stdout:0/122: mknod d5/dc/d14/c24 0 2024-04-03T08:39:09.683 INFO:tasks.workunit.client.0.smithi157.stdout:0/323: getdents d2/d9/d36 0 2024-04-03T08:39:09.684 INFO:tasks.workunit.client.1.smithi181.stdout:4/148: dwrite d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:09.685 INFO:tasks.workunit.client.1.smithi181.stdout:0/123: fdatasync d5/dc/f1e 0 2024-04-03T08:39:09.685 INFO:tasks.workunit.client.0.smithi157.stdout:6/345: creat d1/d5/d1b/d2c/f71 x:0 0 0 2024-04-03T08:39:09.689 INFO:tasks.workunit.client.0.smithi157.stdout:5/346: rename dc/d29/d56/d18/d21/f74 to dc/d29/d56/d49/f77 0 2024-04-03T08:39:09.692 INFO:tasks.workunit.client.0.smithi157.stdout:2/373: dwrite d3/d12/fe [0,4194304] 0 2024-04-03T08:39:09.693 INFO:tasks.workunit.client.1.smithi181.stdout:1/110: mkdir d10/d15/d24 0 2024-04-03T08:39:09.695 INFO:tasks.workunit.client.1.smithi181.stdout:8/113: mknod d4/d6/db/d14/c21 0 2024-04-03T08:39:09.696 INFO:tasks.workunit.client.1.smithi181.stdout:8/114: fdatasync d4/d6/d9/f11 0 2024-04-03T08:39:09.699 INFO:tasks.workunit.client.1.smithi181.stdout:6/151: rename d6/d7/f2a to d6/df/f33 0 2024-04-03T08:39:09.701 INFO:tasks.workunit.client.1.smithi181.stdout:7/113: getdents d0/d1/d6 0 2024-04-03T08:39:09.702 INFO:tasks.workunit.client.0.smithi157.stdout:9/283: creat d1/d15/d27/d5c/f5f x:0 0 0 2024-04-03T08:39:09.706 INFO:tasks.workunit.client.1.smithi181.stdout:3/117: mkdir d0/d5/d16/d1e 0 2024-04-03T08:39:09.707 INFO:tasks.workunit.client.0.smithi157.stdout:4/333: creat da/f6f x:0 0 0 2024-04-03T08:39:09.707 INFO:tasks.workunit.client.0.smithi157.stdout:6/346: dread d1/f48 [8388608,4194304] 0 2024-04-03T08:39:09.710 INFO:tasks.workunit.client.0.smithi157.stdout:0/324: rename d2/d9/dc/d54/l5a to d2/d9/dc/df/d6f/l79 0 2024-04-03T08:39:09.711 INFO:tasks.workunit.client.0.smithi157.stdout:6/347: dread d1/f6d [0,4194304] 0 2024-04-03T08:39:09.713 INFO:tasks.workunit.client.0.smithi157.stdout:5/347: symlink dc/d29/d51/l78 0 2024-04-03T08:39:09.714 INFO:tasks.workunit.client.0.smithi157.stdout:6/348: write d1/d5/d1b/f65 [743156,89217] 0 2024-04-03T08:39:09.715 INFO:tasks.workunit.client.1.smithi181.stdout:9/200: creat d1/da/d13/d22/f45 x:0 0 0 2024-04-03T08:39:09.720 INFO:tasks.workunit.client.0.smithi157.stdout:1/273: sync 2024-04-03T08:39:09.720 INFO:tasks.workunit.client.1.smithi181.stdout:8/115: creat d4/d6/db/d16/f22 x:0 0 0 2024-04-03T08:39:09.722 INFO:tasks.workunit.client.1.smithi181.stdout:7/114: readlink d0/d1/l7 0 2024-04-03T08:39:09.727 INFO:tasks.workunit.client.1.smithi181.stdout:3/118: mknod d0/d5/d6/dd/c1f 0 2024-04-03T08:39:09.729 INFO:tasks.workunit.client.0.smithi157.stdout:0/325: symlink d2/d9/dc/df/d78/d6a/l7a 0 2024-04-03T08:39:09.729 INFO:tasks.workunit.client.0.smithi157.stdout:0/326: chown d2/d9/f57 4094382 1 2024-04-03T08:39:09.730 INFO:tasks.workunit.client.1.smithi181.stdout:0/124: write d5/dc/d14/f22 [1752738,83898] 0 2024-04-03T08:39:09.733 INFO:tasks.workunit.client.1.smithi181.stdout:6/152: dread d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:09.733 INFO:tasks.workunit.client.0.smithi157.stdout:3/311: creat d8/d13/f69 x:0 0 0 2024-04-03T08:39:09.735 INFO:tasks.workunit.client.1.smithi181.stdout:8/116: creat d4/d6/db/d16/f23 x:0 0 0 2024-04-03T08:39:09.735 INFO:tasks.workunit.client.1.smithi181.stdout:5/155: sync 2024-04-03T08:39:09.735 INFO:tasks.workunit.client.0.smithi157.stdout:8/315: rmdir d2/d50 0 2024-04-03T08:39:09.738 INFO:tasks.workunit.client.0.smithi157.stdout:4/334: mknod da/df/d24/d35/c70 0 2024-04-03T08:39:09.740 INFO:tasks.workunit.client.0.smithi157.stdout:7/357: sync 2024-04-03T08:39:09.741 INFO:tasks.workunit.client.0.smithi157.stdout:9/284: rename d1/l44 to d1/d15/d16/l60 0 2024-04-03T08:39:09.741 INFO:tasks.workunit.client.1.smithi181.stdout:3/119: dread d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:09.741 INFO:tasks.workunit.client.1.smithi181.stdout:4/149: link d1/d16/d1f/c30 d1/d1e/d2c/c33 0 2024-04-03T08:39:09.742 INFO:tasks.workunit.client.0.smithi157.stdout:9/285: chown d1/d36/d46 189 1 2024-04-03T08:39:09.743 INFO:tasks.workunit.client.0.smithi157.stdout:5/348: unlink dc/d29/f70 0 2024-04-03T08:39:09.745 INFO:tasks.workunit.client.0.smithi157.stdout:2/374: rmdir d3/d2e/d32/d3c/d6d 0 2024-04-03T08:39:09.747 INFO:tasks.workunit.client.0.smithi157.stdout:2/375: stat d3/d12/d43/d4b/f79 0 2024-04-03T08:39:09.748 INFO:tasks.workunit.client.1.smithi181.stdout:7/115: dread d0/d1/d6/f9 [0,4194304] 0 2024-04-03T08:39:09.748 INFO:tasks.workunit.client.1.smithi181.stdout:1/111: rmdir d10/d15/d24 0 2024-04-03T08:39:09.749 INFO:tasks.workunit.client.1.smithi181.stdout:1/112: stat fc 0 2024-04-03T08:39:09.749 INFO:tasks.workunit.client.0.smithi157.stdout:1/274: fsync d2/d11/d24/d39/f54 0 2024-04-03T08:39:09.750 INFO:tasks.workunit.client.0.smithi157.stdout:2/376: chown d3/d12/d43/d4b/d55/l54 2598602 1 2024-04-03T08:39:09.754 INFO:tasks.workunit.client.1.smithi181.stdout:2/169: getdents d13/d22/d27 0 2024-04-03T08:39:09.755 INFO:tasks.workunit.client.0.smithi157.stdout:7/358: mkdir d0/d11/d15/d17/d1c/d88 0 2024-04-03T08:39:09.755 INFO:tasks.workunit.client.1.smithi181.stdout:2/170: chown d13/l32 179688230 1 2024-04-03T08:39:09.757 INFO:tasks.workunit.client.1.smithi181.stdout:8/117: rename d4/d6/d9/f11 to d4/d6/d9/d15/f24 0 2024-04-03T08:39:09.758 INFO:tasks.workunit.client.0.smithi157.stdout:9/286: dread d1/f26 [0,4194304] 0 2024-04-03T08:39:09.760 INFO:tasks.workunit.client.1.smithi181.stdout:6/153: dread d6/f17 [0,4194304] 0 2024-04-03T08:39:09.761 INFO:tasks.workunit.client.1.smithi181.stdout:6/154: write d6/d7/d9/f21 [398825,113717] 0 2024-04-03T08:39:09.794 INFO:tasks.workunit.client.0.smithi157.stdout:6/349: rename d1/l15 to d1/d4b/d38/d59/l72 0 2024-04-03T08:39:09.796 INFO:tasks.workunit.client.0.smithi157.stdout:6/350: truncate d1/d5/f35 911386 0 2024-04-03T08:39:09.797 INFO:tasks.workunit.client.1.smithi181.stdout:4/150: write d1/f32 [213995,119078] 0 2024-04-03T08:39:09.797 INFO:tasks.workunit.client.1.smithi181.stdout:4/151: fdatasync d1/d1e/f2e 0 2024-04-03T08:39:09.798 INFO:tasks.workunit.client.0.smithi157.stdout:3/312: symlink d8/d1e/d2d/l6a 0 2024-04-03T08:39:09.799 INFO:tasks.workunit.client.1.smithi181.stdout:4/152: read - d1/d16/f23 zero size 2024-04-03T08:39:09.802 INFO:tasks.workunit.client.1.smithi181.stdout:0/125: mknod d5/dc/c25 0 2024-04-03T08:39:09.804 INFO:tasks.workunit.client.1.smithi181.stdout:0/126: write d5/dc/d10/f20 [825515,53983] 0 2024-04-03T08:39:09.804 INFO:tasks.workunit.client.1.smithi181.stdout:9/201: creat d1/da/d13/d22/f46 x:0 0 0 2024-04-03T08:39:09.805 INFO:tasks.workunit.client.1.smithi181.stdout:5/156: write d4/f5 [1718825,33749] 0 2024-04-03T08:39:09.806 INFO:tasks.workunit.client.1.smithi181.stdout:9/202: chown d1/da 108 1 2024-04-03T08:39:09.808 INFO:tasks.workunit.client.1.smithi181.stdout:9/203: stat d1/f20 0 2024-04-03T08:39:09.808 INFO:tasks.workunit.client.1.smithi181.stdout:5/157: fsync d4/f8 0 2024-04-03T08:39:09.808 INFO:tasks.workunit.client.0.smithi157.stdout:7/359: mkdir d0/d11/d6f/d89 0 2024-04-03T08:39:09.809 INFO:tasks.workunit.client.0.smithi157.stdout:9/287: fdatasync d1/d15/d27/f45 0 2024-04-03T08:39:09.812 INFO:tasks.workunit.client.0.smithi157.stdout:0/327: rename d2/d9/dc/df/d78/c69 to d2/d9/dc/df/d78/d6a/c7b 0 2024-04-03T08:39:09.814 INFO:tasks.workunit.client.1.smithi181.stdout:1/113: rename cd to d10/d15/c25 0 2024-04-03T08:39:09.815 INFO:tasks.workunit.client.0.smithi157.stdout:3/313: creat d8/d13/d1b/f6b x:0 0 0 2024-04-03T08:39:09.816 INFO:tasks.workunit.client.1.smithi181.stdout:9/204: chown d1/f2f 4392 1 2024-04-03T08:39:09.816 INFO:tasks.workunit.client.1.smithi181.stdout:3/120: dwrite d0/f3 [0,4194304] 0 2024-04-03T08:39:09.821 INFO:tasks.workunit.client.0.smithi157.stdout:8/316: truncate d2/d11/d10/d24/d5b/d2e/f58 2701870 0 2024-04-03T08:39:09.828 INFO:tasks.workunit.client.0.smithi157.stdout:7/360: mkdir d0/d11/d15/d17/d43/d8a 0 2024-04-03T08:39:09.831 INFO:tasks.workunit.client.0.smithi157.stdout:1/275: dwrite d2/d11/d24/d39/d3b/d1b/f2c [0,4194304] 0 2024-04-03T08:39:09.831 INFO:tasks.workunit.client.1.smithi181.stdout:5/158: dwrite d4/f12 [4194304,4194304] 0 2024-04-03T08:39:09.834 INFO:tasks.workunit.client.0.smithi157.stdout:4/335: rename da/df/d24/d35/d53/f4b to da/df/d24/d35/d3c/f71 0 2024-04-03T08:39:09.834 INFO:tasks.workunit.client.1.smithi181.stdout:7/116: symlink d0/l25 0 2024-04-03T08:39:09.834 INFO:tasks.workunit.client.1.smithi181.stdout:1/114: dwrite d10/f22 [0,4194304] 0 2024-04-03T08:39:09.835 INFO:tasks.workunit.client.0.smithi157.stdout:1/276: fdatasync d2/d11/d24/f38 0 2024-04-03T08:39:09.836 INFO:tasks.workunit.client.0.smithi157.stdout:0/328: mknod d2/d9/d51/c7c 0 2024-04-03T08:39:09.836 INFO:tasks.workunit.client.1.smithi181.stdout:2/171: dwrite d13/d1d/f34 [0,4194304] 0 2024-04-03T08:39:09.837 INFO:tasks.workunit.client.1.smithi181.stdout:5/159: chown d4/f12 0 1 2024-04-03T08:39:09.839 INFO:tasks.workunit.client.1.smithi181.stdout:2/172: fdatasync d13/f39 0 2024-04-03T08:39:09.842 INFO:tasks.workunit.client.1.smithi181.stdout:5/160: read d4/ff [2143827,21586] 0 2024-04-03T08:39:09.843 INFO:tasks.workunit.client.1.smithi181.stdout:4/153: write d1/d1e/f1c [4659282,100569] 0 2024-04-03T08:39:09.845 INFO:tasks.workunit.client.1.smithi181.stdout:9/205: creat d1/da/d28/d30/f47 x:0 0 0 2024-04-03T08:39:09.846 INFO:tasks.workunit.client.0.smithi157.stdout:3/314: creat d8/d1e/d2d/d39/f6c x:0 0 0 2024-04-03T08:39:09.846 INFO:tasks.workunit.client.0.smithi157.stdout:2/377: creat d3/d2e/f80 x:0 0 0 2024-04-03T08:39:09.847 INFO:tasks.workunit.client.1.smithi181.stdout:3/121: rename d0/l2 to d0/d5/d16/d1e/l20 0 2024-04-03T08:39:09.848 INFO:tasks.workunit.client.0.smithi157.stdout:2/378: stat d3/db/f38 0 2024-04-03T08:39:09.848 INFO:tasks.workunit.client.0.smithi157.stdout:8/317: creat d2/d20/d23/f6c x:0 0 0 2024-04-03T08:39:09.850 INFO:tasks.workunit.client.0.smithi157.stdout:9/288: fsync d1/f2e 0 2024-04-03T08:39:09.851 INFO:tasks.workunit.client.1.smithi181.stdout:8/118: dwrite d4/d6/f8 [0,4194304] 0 2024-04-03T08:39:09.852 INFO:tasks.workunit.client.1.smithi181.stdout:3/122: chown d0/d5/d6/dd 98262984 1 2024-04-03T08:39:09.852 INFO:tasks.workunit.client.0.smithi157.stdout:3/315: write d8/d1e/d2d/d39/d51/d48/f5c [3731192,45007] 0 2024-04-03T08:39:09.853 INFO:tasks.workunit.client.1.smithi181.stdout:0/127: chown d5/d9/d13/l1a 7389 1 2024-04-03T08:39:09.853 INFO:tasks.workunit.client.0.smithi157.stdout:9/289: chown d1/d15/d16/c41 31 1 2024-04-03T08:39:09.858 INFO:tasks.workunit.client.1.smithi181.stdout:7/117: creat d0/d1/d6/f26 x:0 0 0 2024-04-03T08:39:09.860 INFO:tasks.workunit.client.0.smithi157.stdout:4/336: dread da/df/d24/f59 [0,4194304] 0 2024-04-03T08:39:09.860 INFO:tasks.workunit.client.0.smithi157.stdout:1/277: symlink d2/d11/d24/d39/d3b/d2e/l5e 0 2024-04-03T08:39:09.865 INFO:tasks.workunit.client.0.smithi157.stdout:8/318: symlink d2/d20/l6d 0 2024-04-03T08:39:09.868 INFO:tasks.workunit.client.0.smithi157.stdout:3/316: symlink d8/d1e/d2d/d3f/l6d 0 2024-04-03T08:39:09.875 INFO:tasks.workunit.client.0.smithi157.stdout:1/278: write d2/d11/d23/f55 [3353036,76794] 0 2024-04-03T08:39:09.875 INFO:tasks.workunit.client.1.smithi181.stdout:1/115: symlink d10/d15/d17/d23/l26 0 2024-04-03T08:39:09.876 INFO:tasks.workunit.client.0.smithi157.stdout:3/317: read d8/d13/d1b/f1d [2398975,22925] 0 2024-04-03T08:39:09.879 INFO:tasks.workunit.client.0.smithi157.stdout:9/290: unlink d1/d15/d27/f30 0 2024-04-03T08:39:09.880 INFO:tasks.workunit.client.0.smithi157.stdout:3/318: readlink d8/ld 0 2024-04-03T08:39:09.880 INFO:tasks.workunit.client.1.smithi181.stdout:3/123: creat d0/d5/d6/dd/f21 x:0 0 0 2024-04-03T08:39:09.886 INFO:tasks.workunit.client.0.smithi157.stdout:4/337: dread f4 [0,4194304] 0 2024-04-03T08:39:09.887 INFO:tasks.workunit.client.0.smithi157.stdout:2/379: dwrite d3/f48 [0,4194304] 0 2024-04-03T08:39:09.887 INFO:tasks.workunit.client.1.smithi181.stdout:8/119: rmdir d4/d6/db 39 2024-04-03T08:39:09.891 INFO:tasks.workunit.client.0.smithi157.stdout:0/329: dwrite d2/d9/f57 [0,4194304] 0 2024-04-03T08:39:09.894 INFO:tasks.workunit.client.0.smithi157.stdout:8/319: symlink d2/d11/d10/d24/l6e 0 2024-04-03T08:39:09.897 INFO:tasks.workunit.client.0.smithi157.stdout:6/351: rename d1/d5/d1b/d2c to d1/d5/d17/d2a/d73 0 2024-04-03T08:39:09.900 INFO:tasks.workunit.client.1.smithi181.stdout:0/128: dwrite d5/d9/d13/f15 [0,4194304] 0 2024-04-03T08:39:09.901 INFO:tasks.workunit.client.0.smithi157.stdout:6/352: fsync d1/d5/d17/d2a/f4d 0 2024-04-03T08:39:09.902 INFO:tasks.workunit.client.0.smithi157.stdout:1/279: mknod d2/c5f 0 2024-04-03T08:39:09.902 INFO:tasks.workunit.client.1.smithi181.stdout:2/173: creat d13/d22/d40/f48 x:0 0 0 2024-04-03T08:39:09.905 INFO:tasks.workunit.client.0.smithi157.stdout:1/280: dread - d2/d11/d24/d39/d3b/f56 zero size 2024-04-03T08:39:09.907 INFO:tasks.workunit.client.1.smithi181.stdout:4/154: truncate d1/d1e/f1a 1210429 0 2024-04-03T08:39:09.909 INFO:tasks.workunit.client.0.smithi157.stdout:9/291: creat d1/d36/f61 x:0 0 0 2024-04-03T08:39:09.912 INFO:tasks.workunit.client.0.smithi157.stdout:9/292: chown d1/d15/d16/c4b 37 1 2024-04-03T08:39:09.919 INFO:tasks.workunit.client.1.smithi181.stdout:1/116: mkdir d10/d15/d17/d23/d27 0 2024-04-03T08:39:09.922 INFO:tasks.workunit.client.1.smithi181.stdout:3/124: mkdir d0/d5/d16/d22 0 2024-04-03T08:39:09.922 INFO:tasks.workunit.client.0.smithi157.stdout:4/338: rmdir da/df/d11/d5d 39 2024-04-03T08:39:09.922 INFO:tasks.workunit.client.0.smithi157.stdout:8/320: dwrite d2/d11/d10/d24/d5b/d2e/d56/f68 [0,4194304] 0 2024-04-03T08:39:09.923 INFO:tasks.workunit.client.1.smithi181.stdout:3/125: readlink d0/l1a 0 2024-04-03T08:39:09.923 INFO:tasks.workunit.client.0.smithi157.stdout:4/339: chown da/fc 1813 1 2024-04-03T08:39:09.926 INFO:tasks.workunit.client.1.smithi181.stdout:1/117: dread d10/d15/d17/f1d [0,4194304] 0 2024-04-03T08:39:09.928 INFO:tasks.workunit.client.0.smithi157.stdout:2/380: mknod d3/d12/d43/d4b/c81 0 2024-04-03T08:39:09.929 INFO:tasks.workunit.client.1.smithi181.stdout:8/120: creat d4/d6/d9/f25 x:0 0 0 2024-04-03T08:39:09.929 INFO:tasks.workunit.client.0.smithi157.stdout:9/293: dread d1/fe [0,4194304] 0 2024-04-03T08:39:09.931 INFO:tasks.workunit.client.0.smithi157.stdout:3/319: dread d8/d13/f31 [0,4194304] 0 2024-04-03T08:39:09.934 INFO:tasks.workunit.client.0.smithi157.stdout:9/294: dread - d1/d15/d27/f47 zero size 2024-04-03T08:39:09.937 INFO:tasks.workunit.client.1.smithi181.stdout:0/129: fdatasync d5/fe 0 2024-04-03T08:39:09.945 INFO:tasks.workunit.client.0.smithi157.stdout:6/353: dread d1/d4b/d38/f4c [4194304,4194304] 0 2024-04-03T08:39:09.949 INFO:tasks.workunit.client.1.smithi181.stdout:9/206: truncate d1/da/f12 2935736 0 2024-04-03T08:39:09.950 INFO:tasks.workunit.client.1.smithi181.stdout:4/155: readlink d1/l2d 0 2024-04-03T08:39:09.951 INFO:tasks.workunit.client.0.smithi157.stdout:8/321: dread d2/d11/d10/d24/d5b/f1c [0,4194304] 0 2024-04-03T08:39:09.955 INFO:tasks.workunit.client.0.smithi157.stdout:2/381: dread d3/d12/fa [0,4194304] 0 2024-04-03T08:39:09.958 INFO:tasks.workunit.client.1.smithi181.stdout:6/155: sync 2024-04-03T08:39:09.959 INFO:tasks.workunit.client.1.smithi181.stdout:8/121: dread - d4/d6/db/d14/f20 zero size 2024-04-03T08:39:09.960 INFO:tasks.workunit.client.0.smithi157.stdout:1/281: write d2/d11/d23/f4f [6425585,62437] 0 2024-04-03T08:39:09.961 INFO:tasks.workunit.client.1.smithi181.stdout:2/174: creat d13/d22/d27/d46/f49 x:0 0 0 2024-04-03T08:39:09.962 INFO:tasks.workunit.client.1.smithi181.stdout:7/118: mkdir d0/d1/d6/de/d17/d27 0 2024-04-03T08:39:09.963 INFO:tasks.workunit.client.1.smithi181.stdout:5/161: getdents d4/d18/d25 0 2024-04-03T08:39:09.965 INFO:tasks.workunit.client.1.smithi181.stdout:9/207: unlink d1/da/d13/d22/f46 0 2024-04-03T08:39:09.966 INFO:tasks.workunit.client.0.smithi157.stdout:4/340: symlink da/df/l72 0 2024-04-03T08:39:09.967 INFO:tasks.workunit.client.1.smithi181.stdout:4/156: mkdir d1/d1e/d29/d34 0 2024-04-03T08:39:09.968 INFO:tasks.workunit.client.1.smithi181.stdout:4/157: write d1/fb [3438659,78256] 0 2024-04-03T08:39:09.969 INFO:tasks.workunit.client.1.smithi181.stdout:3/126: symlink d0/d5/l23 0 2024-04-03T08:39:09.970 INFO:tasks.workunit.client.1.smithi181.stdout:4/158: chown d1/d16/d24 1356273 1 2024-04-03T08:39:09.970 INFO:tasks.workunit.client.0.smithi157.stdout:7/361: rename d0/d11/l31 to d0/d11/d15/d17/l8b 0 2024-04-03T08:39:09.973 INFO:tasks.workunit.client.1.smithi181.stdout:1/118: rename d10/d15/d17/l1f to d10/d15/d17/d23/d27/l28 0 2024-04-03T08:39:09.973 INFO:tasks.workunit.client.0.smithi157.stdout:9/295: symlink d1/l62 0 2024-04-03T08:39:09.973 INFO:tasks.workunit.client.0.smithi157.stdout:7/362: write d0/d11/d15/d17/f7c [815136,99107] 0 2024-04-03T08:39:09.975 INFO:tasks.workunit.client.0.smithi157.stdout:6/354: mknod d1/d5/d17/d2a/c74 0 2024-04-03T08:39:09.976 INFO:tasks.workunit.client.0.smithi157.stdout:9/296: write d1/d15/d16/f5b [621745,36368] 0 2024-04-03T08:39:09.977 INFO:tasks.workunit.client.1.smithi181.stdout:6/156: creat d6/df/f34 x:0 0 0 2024-04-03T08:39:09.978 INFO:tasks.workunit.client.1.smithi181.stdout:2/175: dwrite d13/d1d/f34 [0,4194304] 0 2024-04-03T08:39:09.978 INFO:tasks.workunit.client.1.smithi181.stdout:5/162: dwrite d4/d18/d2c/f2e [0,4194304] 0 2024-04-03T08:39:09.979 INFO:tasks.workunit.client.0.smithi157.stdout:8/322: mkdir d2/d6f 0 2024-04-03T08:39:09.979 INFO:tasks.workunit.client.0.smithi157.stdout:4/341: rmdir da/df 39 2024-04-03T08:39:09.980 INFO:tasks.workunit.client.1.smithi181.stdout:8/122: symlink d4/d6/d9/l26 0 2024-04-03T08:39:09.981 INFO:tasks.workunit.client.1.smithi181.stdout:5/163: chown d4/d18/d2c/f2e 137395165 1 2024-04-03T08:39:09.982 INFO:tasks.workunit.client.1.smithi181.stdout:5/164: readlink d4/l1f 0 2024-04-03T08:39:09.982 INFO:tasks.workunit.client.0.smithi157.stdout:3/320: rename d8/d13/d1b/f24 to d8/d1e/d2d/d3b/f6e 0 2024-04-03T08:39:09.982 INFO:tasks.workunit.client.0.smithi157.stdout:8/323: chown d2/f9 14305 1 2024-04-03T08:39:09.984 INFO:tasks.workunit.client.0.smithi157.stdout:1/282: creat d2/d11/d24/d39/d3b/d2e/d48/d5d/f60 x:0 0 0 2024-04-03T08:39:09.985 INFO:tasks.workunit.client.1.smithi181.stdout:5/165: truncate d4/d18/d2c/f2e 4409500 0 2024-04-03T08:39:09.985 INFO:tasks.workunit.client.1.smithi181.stdout:9/208: read - d1/da/d13/d22/f31 zero size 2024-04-03T08:39:09.986 INFO:tasks.workunit.client.0.smithi157.stdout:3/321: fdatasync d8/d1e/d2d/f34 0 2024-04-03T08:39:09.991 INFO:tasks.workunit.client.0.smithi157.stdout:8/324: write d2/d11/d10/d24/d5b/d2e/f38 [2048927,71690] 0 2024-04-03T08:39:09.993 INFO:tasks.workunit.client.1.smithi181.stdout:3/127: rename d0/d5/d6/dd/f1c to d0/d5/d6/dd/f24 0 2024-04-03T08:39:09.994 INFO:tasks.workunit.client.0.smithi157.stdout:4/342: fdatasync da/d26/f5e 0 2024-04-03T08:39:09.994 INFO:tasks.workunit.client.1.smithi181.stdout:3/128: write d0/f3 [2403167,11943] 0 2024-04-03T08:39:09.995 INFO:tasks.workunit.client.0.smithi157.stdout:3/322: write d8/d1e/d2d/d39/d51/d48/f5c [4724429,89768] 0 2024-04-03T08:39:09.996 INFO:tasks.workunit.client.0.smithi157.stdout:2/382: getdents d3/db/d44/d4c/d5a 0 2024-04-03T08:39:09.998 INFO:tasks.workunit.client.1.smithi181.stdout:0/130: creat d5/d9/d13/f26 x:0 0 0 2024-04-03T08:39:09.999 INFO:tasks.workunit.client.0.smithi157.stdout:7/363: dwrite d0/d11/f70 [0,4194304] 0 2024-04-03T08:39:10.000 INFO:tasks.workunit.client.1.smithi181.stdout:2/176: unlink d13/l1a 0 2024-04-03T08:39:10.001 INFO:tasks.workunit.client.0.smithi157.stdout:2/383: chown d3/db/d44/d4c/l5d 107452 1 2024-04-03T08:39:10.004 INFO:tasks.workunit.client.1.smithi181.stdout:6/157: rename d6/df/c1f to d6/d31/c35 0 2024-04-03T08:39:10.006 INFO:tasks.workunit.client.0.smithi157.stdout:1/283: creat d2/d11/d24/d39/f61 x:0 0 0 2024-04-03T08:39:10.009 INFO:tasks.workunit.client.1.smithi181.stdout:7/119: creat d0/d1/d6/de/d17/d27/f28 x:0 0 0 2024-04-03T08:39:10.011 INFO:tasks.workunit.client.1.smithi181.stdout:5/166: symlink d4/d22/l30 0 2024-04-03T08:39:10.012 INFO:tasks.workunit.client.1.smithi181.stdout:0/131: dwrite d5/dc/f21 [0,4194304] 0 2024-04-03T08:39:10.016 INFO:tasks.workunit.client.0.smithi157.stdout:2/384: dwrite d3/d2e/f3b [0,4194304] 0 2024-04-03T08:39:10.022 INFO:tasks.workunit.client.0.smithi157.stdout:9/297: creat d1/d15/f63 x:0 0 0 2024-04-03T08:39:10.025 INFO:tasks.workunit.client.0.smithi157.stdout:5/349: sync 2024-04-03T08:39:10.025 INFO:tasks.workunit.client.1.smithi181.stdout:2/177: mkdir d13/d1c/d4a 0 2024-04-03T08:39:10.027 INFO:tasks.workunit.client.1.smithi181.stdout:2/178: truncate d13/d1d/f3d 30738 0 2024-04-03T08:39:10.030 INFO:tasks.workunit.client.0.smithi157.stdout:8/325: mkdir d2/d6f/d70 0 2024-04-03T08:39:10.030 INFO:tasks.workunit.client.1.smithi181.stdout:8/123: link d4/d6/d9/f18 d4/f27 0 2024-04-03T08:39:10.032 INFO:tasks.workunit.client.1.smithi181.stdout:6/158: truncate d6/d7/d9/fa 967413 0 2024-04-03T08:39:10.033 INFO:tasks.workunit.client.1.smithi181.stdout:8/124: truncate d4/d6/db/d16/f22 783224 0 2024-04-03T08:39:10.034 INFO:tasks.workunit.client.0.smithi157.stdout:2/385: dread d3/d12/fd [0,4194304] 0 2024-04-03T08:39:10.034 INFO:tasks.workunit.client.1.smithi181.stdout:8/125: fdatasync d4/d6/d9/f1b 0 2024-04-03T08:39:10.036 INFO:tasks.workunit.client.0.smithi157.stdout:6/355: rename d1/d5/d17/d2a/d73/l50 to d1/d5/d17/l75 0 2024-04-03T08:39:10.036 INFO:tasks.workunit.client.0.smithi157.stdout:2/386: chown d3/db/d44/d4c/d5a 1570 1 2024-04-03T08:39:10.037 INFO:tasks.workunit.client.0.smithi157.stdout:7/364: mkdir d0/d11/d6f/d89/d8c 0 2024-04-03T08:39:10.040 INFO:tasks.workunit.client.0.smithi157.stdout:7/365: write d0/d11/d15/d17/d52/f54 [1602930,69454] 0 2024-04-03T08:39:10.041 INFO:tasks.workunit.client.0.smithi157.stdout:7/366: chown d0/d4 56005 1 2024-04-03T08:39:10.042 INFO:tasks.workunit.client.0.smithi157.stdout:4/343: getdents da/df/d2f/d64 0 2024-04-03T08:39:10.043 INFO:tasks.workunit.client.1.smithi181.stdout:2/179: creat d13/d22/d27/f4b x:0 0 0 2024-04-03T08:39:10.044 INFO:tasks.workunit.client.0.smithi157.stdout:4/344: chown da/df/d11/f66 57409 1 2024-04-03T08:39:10.045 INFO:tasks.workunit.client.0.smithi157.stdout:9/298: symlink d1/d4a/d4d/l64 0 2024-04-03T08:39:10.046 INFO:tasks.workunit.client.1.smithi181.stdout:5/167: mknod d4/c31 0 2024-04-03T08:39:10.047 INFO:tasks.workunit.client.1.smithi181.stdout:6/159: dwrite d6/d7/d9/f28 [0,4194304] 0 2024-04-03T08:39:10.048 INFO:tasks.workunit.client.0.smithi157.stdout:9/299: chown d1/f5 74138 1 2024-04-03T08:39:10.048 INFO:tasks.workunit.client.0.smithi157.stdout:2/387: symlink d3/d12/d43/l82 0 2024-04-03T08:39:10.048 INFO:tasks.workunit.client.0.smithi157.stdout:8/326: dwrite d2/d11/d10/d24/d5b/f1c [0,4194304] 0 2024-04-03T08:39:10.049 INFO:tasks.workunit.client.0.smithi157.stdout:9/300: chown d1/l4f 2651412 1 2024-04-03T08:39:10.052 INFO:tasks.workunit.client.0.smithi157.stdout:6/356: read d1/d5/d17/f1d [590495,75126] 0 2024-04-03T08:39:10.056 INFO:tasks.workunit.client.0.smithi157.stdout:9/301: chown d1/d15/d16/l2c 62 1 2024-04-03T08:39:10.057 INFO:tasks.workunit.client.0.smithi157.stdout:8/327: write d2/d11/f1d [3676155,116358] 0 2024-04-03T08:39:10.059 INFO:tasks.workunit.client.0.smithi157.stdout:4/345: symlink da/df/d24/d35/l73 0 2024-04-03T08:39:10.060 INFO:tasks.workunit.client.1.smithi181.stdout:7/120: dwrite d0/d1/d6/f20 [0,4194304] 0 2024-04-03T08:39:10.062 INFO:tasks.workunit.client.0.smithi157.stdout:8/328: chown d2/d11/d10/d24/d5b/d2e/d56/d59 5292319 1 2024-04-03T08:39:10.064 INFO:tasks.workunit.client.0.smithi157.stdout:6/357: creat d1/d5/d17/d2a/d37/f76 x:0 0 0 2024-04-03T08:39:10.065 INFO:tasks.workunit.client.1.smithi181.stdout:2/180: getdents d13/d22/d27/d2f 0 2024-04-03T08:39:10.066 INFO:tasks.workunit.client.0.smithi157.stdout:9/302: creat d1/d15/d16/f65 x:0 0 0 2024-04-03T08:39:10.068 INFO:tasks.workunit.client.1.smithi181.stdout:2/181: fdatasync d13/d1c/f3b 0 2024-04-03T08:39:10.069 INFO:tasks.workunit.client.0.smithi157.stdout:2/388: creat d3/d2e/f83 x:0 0 0 2024-04-03T08:39:10.071 INFO:tasks.workunit.client.1.smithi181.stdout:5/168: dwrite d4/d22/f26 [4194304,4194304] 0 2024-04-03T08:39:10.071 INFO:tasks.workunit.client.0.smithi157.stdout:8/329: creat d2/d6f/f71 x:0 0 0 2024-04-03T08:39:10.073 INFO:tasks.workunit.client.0.smithi157.stdout:9/303: mkdir d1/d36/d66 0 2024-04-03T08:39:10.078 INFO:tasks.workunit.client.0.smithi157.stdout:5/350: dwrite dc/d29/d56/d18/d21/f5d [0,4194304] 0 2024-04-03T08:39:10.084 INFO:tasks.workunit.client.1.smithi181.stdout:7/121: dwrite d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:10.087 INFO:tasks.workunit.client.1.smithi181.stdout:7/122: read - d0/d1/d6/de/d17/f1b zero size 2024-04-03T08:39:10.089 INFO:tasks.workunit.client.0.smithi157.stdout:9/304: dwrite d1/d15/d16/f3a [0,4194304] 0 2024-04-03T08:39:10.091 INFO:tasks.workunit.client.0.smithi157.stdout:9/305: dread - d1/d4a/f52 zero size 2024-04-03T08:39:10.094 INFO:tasks.workunit.client.0.smithi157.stdout:9/306: write d1/d15/d27/f55 [588693,102149] 0 2024-04-03T08:39:10.095 INFO:tasks.workunit.client.1.smithi181.stdout:7/123: write d0/d1/f21 [736426,11146] 0 2024-04-03T08:39:10.098 INFO:tasks.workunit.client.0.smithi157.stdout:9/307: truncate d1/d15/d27/f39 1311149 0 2024-04-03T08:39:10.137 INFO:tasks.workunit.client.1.smithi181.stdout:2/182: rename l1 to d13/d22/d27/l4c 0 2024-04-03T08:39:10.138 INFO:tasks.workunit.client.1.smithi181.stdout:2/183: dread - d13/d1c/f3b zero size 2024-04-03T08:39:10.142 INFO:tasks.workunit.client.0.smithi157.stdout:6/358: mkdir d1/d5/d17/d2a/d30/d77 0 2024-04-03T08:39:10.143 INFO:tasks.workunit.client.0.smithi157.stdout:4/346: creat da/df/f74 x:0 0 0 2024-04-03T08:39:10.145 INFO:tasks.workunit.client.1.smithi181.stdout:2/184: rename d13/d22/d27/f37 to d13/d1c/d4a/f4d 0 2024-04-03T08:39:10.148 INFO:tasks.workunit.client.1.smithi181.stdout:9/209: write d1/da/d13/d41/f1b [804281,63589] 0 2024-04-03T08:39:10.149 INFO:tasks.workunit.client.1.smithi181.stdout:5/169: creat d4/f32 x:0 0 0 2024-04-03T08:39:10.151 INFO:tasks.workunit.client.0.smithi157.stdout:6/359: symlink d1/d4b/d38/l78 0 2024-04-03T08:39:10.151 INFO:tasks.workunit.client.1.smithi181.stdout:3/129: write d0/d5/d6/f11 [607207,16117] 0 2024-04-03T08:39:10.152 INFO:tasks.workunit.client.1.smithi181.stdout:3/130: chown d0/d5/fa 77 1 2024-04-03T08:39:10.153 INFO:tasks.workunit.client.0.smithi157.stdout:4/347: creat da/df/d24/f75 x:0 0 0 2024-04-03T08:39:10.154 INFO:tasks.workunit.client.1.smithi181.stdout:3/131: write d0/d5/d6/f11 [1949154,27687] 0 2024-04-03T08:39:10.156 INFO:tasks.workunit.client.0.smithi157.stdout:2/389: creat d3/f84 x:0 0 0 2024-04-03T08:39:10.157 INFO:tasks.workunit.client.0.smithi157.stdout:2/390: chown d3/d12/f11 1358645 1 2024-04-03T08:39:10.158 INFO:tasks.workunit.client.1.smithi181.stdout:2/185: mknod d13/d22/d27/d2f/c4e 0 2024-04-03T08:39:10.159 INFO:tasks.workunit.client.0.smithi157.stdout:5/351: creat dc/d29/d56/d49/d53/f79 x:0 0 0 2024-04-03T08:39:10.160 INFO:tasks.workunit.client.1.smithi181.stdout:5/170: dread d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:10.166 INFO:tasks.workunit.client.1.smithi181.stdout:0/132: write d5/d9/fd [938024,93257] 0 2024-04-03T08:39:10.167 INFO:tasks.workunit.client.0.smithi157.stdout:3/323: truncate d8/d1e/d2d/d3b/f6e 262799 0 2024-04-03T08:39:10.170 INFO:tasks.workunit.client.0.smithi157.stdout:6/360: dwrite d1/f5e [0,4194304] 0 2024-04-03T08:39:10.170 INFO:tasks.workunit.client.0.smithi157.stdout:5/352: creat dc/d29/d56/d49/f7a x:0 0 0 2024-04-03T08:39:10.172 INFO:tasks.workunit.client.0.smithi157.stdout:6/361: dread - d1/d5/d17/d2a/d37/f76 zero size 2024-04-03T08:39:10.173 INFO:tasks.workunit.client.0.smithi157.stdout:5/353: truncate dc/d29/d56/d18/f3e 410346 0 2024-04-03T08:39:10.179 INFO:tasks.workunit.client.0.smithi157.stdout:9/308: getdents d1/d15/d27/d34 0 2024-04-03T08:39:10.181 INFO:tasks.workunit.client.1.smithi181.stdout:9/210: dread d1/f2f [0,4194304] 0 2024-04-03T08:39:10.181 INFO:tasks.workunit.client.0.smithi157.stdout:3/324: mknod d8/d1e/d2d/d39/d51/d4c/d32/c6f 0 2024-04-03T08:39:10.182 INFO:tasks.workunit.client.1.smithi181.stdout:9/211: write d1/da/fb [1150562,40807] 0 2024-04-03T08:39:10.183 INFO:tasks.workunit.client.1.smithi181.stdout:0/133: creat d5/dc/d10/f27 x:0 0 0 2024-04-03T08:39:10.184 INFO:tasks.workunit.client.0.smithi157.stdout:2/391: link d3/l26 d3/d12/d43/d4b/l85 0 2024-04-03T08:39:10.185 INFO:tasks.workunit.client.1.smithi181.stdout:6/160: write d6/d7/d9/f19 [3625783,125094] 0 2024-04-03T08:39:10.185 INFO:tasks.workunit.client.0.smithi157.stdout:3/325: read d8/d13/f15 [807739,13652] 0 2024-04-03T08:39:10.187 INFO:tasks.workunit.client.1.smithi181.stdout:6/161: write d6/d7/d9/f1a [232634,77078] 0 2024-04-03T08:39:10.187 INFO:tasks.workunit.client.0.smithi157.stdout:5/354: mknod dc/d29/d56/d18/c7b 0 2024-04-03T08:39:10.188 INFO:tasks.workunit.client.0.smithi157.stdout:2/392: chown d3/d12/fd 7 1 2024-04-03T08:39:10.190 INFO:tasks.workunit.client.0.smithi157.stdout:5/355: fdatasync dc/d29/d43/f66 0 2024-04-03T08:39:10.190 INFO:tasks.workunit.client.0.smithi157.stdout:9/309: creat d1/d15/d16/f67 x:0 0 0 2024-04-03T08:39:10.194 INFO:tasks.workunit.client.0.smithi157.stdout:8/330: fsync d2/d6f/f71 0 2024-04-03T08:39:10.195 INFO:tasks.workunit.client.1.smithi181.stdout:9/212: chown d1/d34/f37 4100 1 2024-04-03T08:39:10.196 INFO:tasks.workunit.client.0.smithi157.stdout:6/362: dwrite d1/d5/d17/d29/d62/f69 [0,4194304] 0 2024-04-03T08:39:10.198 INFO:tasks.workunit.client.1.smithi181.stdout:3/132: rmdir d0/d5/d16/d22 0 2024-04-03T08:39:10.198 INFO:tasks.workunit.client.1.smithi181.stdout:3/133: readlink d0/l1a 0 2024-04-03T08:39:10.206 INFO:tasks.workunit.client.1.smithi181.stdout:6/162: rename d6/df to d6/d31/d36 0 2024-04-03T08:39:10.207 INFO:tasks.workunit.client.0.smithi157.stdout:3/326: dwrite d8/d13/d1b/f6b [0,4194304] 0 2024-04-03T08:39:10.209 INFO:tasks.workunit.client.0.smithi157.stdout:2/393: rename d3/f7 to d3/d12/d43/f86 0 2024-04-03T08:39:10.210 INFO:tasks.workunit.client.1.smithi181.stdout:9/213: dwrite d1/f6 [0,4194304] 0 2024-04-03T08:39:10.213 INFO:tasks.workunit.client.1.smithi181.stdout:9/214: truncate d1/d34/f37 137167 0 2024-04-03T08:39:10.217 INFO:tasks.workunit.client.0.smithi157.stdout:8/331: unlink d2/d11/d10/d24/d5b/d2e/d56/f68 0 2024-04-03T08:39:10.219 INFO:tasks.workunit.client.1.smithi181.stdout:7/124: truncate d0/d1/f19 3745588 0 2024-04-03T08:39:10.220 INFO:tasks.workunit.client.1.smithi181.stdout:3/134: fdatasync d0/d5/fa 0 2024-04-03T08:39:10.221 INFO:tasks.workunit.client.0.smithi157.stdout:6/363: rmdir d1/d5/d17/d2a 39 2024-04-03T08:39:10.222 INFO:tasks.workunit.client.1.smithi181.stdout:6/163: mknod d6/d31/d36/c37 0 2024-04-03T08:39:10.227 INFO:tasks.workunit.client.0.smithi157.stdout:5/356: mkdir dc/d29/d56/d52/d7c 0 2024-04-03T08:39:10.228 INFO:tasks.workunit.client.1.smithi181.stdout:9/215: rename d1/c4 to d1/da/d13/c48 0 2024-04-03T08:39:10.231 INFO:tasks.workunit.client.1.smithi181.stdout:3/135: mkdir d0/d5/d6/dd/d25 0 2024-04-03T08:39:10.232 INFO:tasks.workunit.client.0.smithi157.stdout:2/394: mknod d3/d2e/d65/c87 0 2024-04-03T08:39:10.233 INFO:tasks.workunit.client.0.smithi157.stdout:2/395: readlink d3/db/l2d 0 2024-04-03T08:39:10.236 INFO:tasks.workunit.client.0.smithi157.stdout:0/330: sync 2024-04-03T08:39:10.237 INFO:tasks.workunit.client.1.smithi181.stdout:6/164: rmdir d6/d7/d9 39 2024-04-03T08:39:10.239 INFO:tasks.workunit.client.0.smithi157.stdout:8/332: chown d2/d11/d10/f16 129542010 1 2024-04-03T08:39:10.239 INFO:tasks.workunit.client.0.smithi157.stdout:0/331: write d2/d9/dc/df/d1b/d4a/f20 [2936636,13526] 0 2024-04-03T08:39:10.240 INFO:tasks.workunit.client.1.smithi181.stdout:5/171: write d4/f13 [1494957,115323] 0 2024-04-03T08:39:10.243 INFO:tasks.workunit.client.1.smithi181.stdout:9/216: rename d1/da/d13/f2d to d1/da/d28/f49 0 2024-04-03T08:39:10.245 INFO:tasks.workunit.client.1.smithi181.stdout:3/136: dread d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:10.246 INFO:tasks.workunit.client.1.smithi181.stdout:9/217: write d1/da/d13/d41/d32/f3f [4832894,45423] 0 2024-04-03T08:39:10.248 INFO:tasks.workunit.client.0.smithi157.stdout:5/357: mknod dc/d29/d56/d18/d21/c7d 0 2024-04-03T08:39:10.250 INFO:tasks.workunit.client.1.smithi181.stdout:7/125: link d0/d1/f21 d0/d1/d6/de/d17/f29 0 2024-04-03T08:39:10.251 INFO:tasks.workunit.client.1.smithi181.stdout:7/126: dread - d0/d1/d6/f26 zero size 2024-04-03T08:39:10.252 INFO:tasks.workunit.client.1.smithi181.stdout:2/186: truncate d13/f1e 3493047 0 2024-04-03T08:39:10.253 INFO:tasks.workunit.client.0.smithi157.stdout:2/396: mkdir d3/db/d44/d4c/d5a/d88 0 2024-04-03T08:39:10.254 INFO:tasks.workunit.client.0.smithi157.stdout:9/310: rmdir d1/d15/d16 39 2024-04-03T08:39:10.256 INFO:tasks.workunit.client.0.smithi157.stdout:9/311: write d1/d15/d27/f39 [94511,89067] 0 2024-04-03T08:39:10.258 INFO:tasks.workunit.client.0.smithi157.stdout:8/333: stat d2/d20/l44 0 2024-04-03T08:39:10.260 INFO:tasks.workunit.client.0.smithi157.stdout:0/332: mknod d2/d9/d51/c7d 0 2024-04-03T08:39:10.263 INFO:tasks.workunit.client.0.smithi157.stdout:6/364: unlink d1/d5/d17/d2a/d40/f5d 0 2024-04-03T08:39:10.264 INFO:tasks.workunit.client.1.smithi181.stdout:1/119: sync 2024-04-03T08:39:10.265 INFO:tasks.workunit.client.1.smithi181.stdout:4/159: sync 2024-04-03T08:39:10.265 INFO:tasks.workunit.client.1.smithi181.stdout:8/126: sync 2024-04-03T08:39:10.265 INFO:tasks.workunit.client.1.smithi181.stdout:3/137: creat d0/d17/f26 x:0 0 0 2024-04-03T08:39:10.266 INFO:tasks.workunit.client.0.smithi157.stdout:3/327: link d8/d1e/l49 d8/d13/d1b/l70 0 2024-04-03T08:39:10.269 INFO:tasks.workunit.client.1.smithi181.stdout:3/138: truncate d0/d5/d6/dd/f21 416132 0 2024-04-03T08:39:10.272 INFO:tasks.workunit.client.0.smithi157.stdout:9/312: dread - d1/d15/d16/f67 zero size 2024-04-03T08:39:10.272 INFO:tasks.workunit.client.1.smithi181.stdout:2/187: creat d13/d22/d27/f4f x:0 0 0 2024-04-03T08:39:10.274 INFO:tasks.workunit.client.0.smithi157.stdout:9/313: write d1/d15/d27/f39 [517219,88462] 0 2024-04-03T08:39:10.276 INFO:tasks.workunit.client.1.smithi181.stdout:1/120: dread d10/f11 [0,4194304] 0 2024-04-03T08:39:10.278 INFO:tasks.workunit.client.0.smithi157.stdout:3/328: creat d8/d1e/d2d/d3f/f71 x:0 0 0 2024-04-03T08:39:10.281 INFO:tasks.workunit.client.0.smithi157.stdout:8/334: mkdir d2/d6f/d70/d72 0 2024-04-03T08:39:10.282 INFO:tasks.workunit.client.1.smithi181.stdout:8/127: mknod d4/d6/db/d14/c28 0 2024-04-03T08:39:10.283 INFO:tasks.workunit.client.1.smithi181.stdout:2/188: dread f11 [0,4194304] 0 2024-04-03T08:39:10.284 INFO:tasks.workunit.client.0.smithi157.stdout:0/333: symlink d2/d9/d36/d38/d67/l7e 0 2024-04-03T08:39:10.286 INFO:tasks.workunit.client.1.smithi181.stdout:3/139: write d0/d5/d6/f11 [751484,10687] 0 2024-04-03T08:39:10.288 INFO:tasks.workunit.client.1.smithi181.stdout:7/127: truncate d0/d1/d6/fd 8020567 0 2024-04-03T08:39:10.289 INFO:tasks.workunit.client.1.smithi181.stdout:3/140: write d0/d5/d6/dd/f21 [1150672,54702] 0 2024-04-03T08:39:10.290 INFO:tasks.workunit.client.1.smithi181.stdout:3/141: chown d0/d5/c10 13022282 1 2024-04-03T08:39:10.291 INFO:tasks.workunit.client.0.smithi157.stdout:3/329: mknod d8/d1e/d2d/d3f/c72 0 2024-04-03T08:39:10.294 INFO:tasks.workunit.client.1.smithi181.stdout:6/165: creat d6/d7/f38 x:0 0 0 2024-04-03T08:39:10.297 INFO:tasks.workunit.client.1.smithi181.stdout:1/121: mknod d10/d15/c29 0 2024-04-03T08:39:10.298 INFO:tasks.workunit.client.0.smithi157.stdout:0/334: dread d2/d9/dc/df/d1b/f6d [0,4194304] 0 2024-04-03T08:39:10.300 INFO:tasks.workunit.client.0.smithi157.stdout:9/314: truncate d1/d15/f2d 334200 0 2024-04-03T08:39:10.301 INFO:tasks.workunit.client.0.smithi157.stdout:9/315: chown d1/d15/d16/l1c 0 1 2024-04-03T08:39:10.302 INFO:tasks.workunit.client.0.smithi157.stdout:5/358: rename dc/d29/d56/f33 to dc/f7e 0 2024-04-03T08:39:10.304 INFO:tasks.workunit.client.1.smithi181.stdout:8/128: rmdir d4/d6/d9/d15 39 2024-04-03T08:39:10.304 INFO:tasks.workunit.client.0.smithi157.stdout:5/359: fdatasync dc/d29/d56/d18/f3e 0 2024-04-03T08:39:10.304 INFO:tasks.workunit.client.0.smithi157.stdout:3/330: symlink d8/d1e/d2d/d39/d51/d4c/l73 0 2024-04-03T08:39:10.306 INFO:tasks.workunit.client.0.smithi157.stdout:5/360: fdatasync dc/d35/f40 0 2024-04-03T08:39:10.306 INFO:tasks.workunit.client.0.smithi157.stdout:3/331: stat d8/d13/d1b/d5b/c64 0 2024-04-03T08:39:10.306 INFO:tasks.workunit.client.1.smithi181.stdout:9/218: mknod d1/da/d13/d22/d23/d36/c4a 0 2024-04-03T08:39:10.307 INFO:tasks.workunit.client.1.smithi181.stdout:9/219: readlink d1/da/lf 0 2024-04-03T08:39:10.307 INFO:tasks.workunit.client.1.smithi181.stdout:0/134: sync 2024-04-03T08:39:10.308 INFO:tasks.workunit.client.1.smithi181.stdout:2/189: creat d13/d1d/f50 x:0 0 0 2024-04-03T08:39:10.309 INFO:tasks.workunit.client.0.smithi157.stdout:0/335: creat d2/d9/d51/f7f x:0 0 0 2024-04-03T08:39:10.309 INFO:tasks.workunit.client.1.smithi181.stdout:5/172: truncate d4/d18/d25/f1c 4977748 0 2024-04-03T08:39:10.310 INFO:tasks.workunit.client.0.smithi157.stdout:0/336: write d2/f21 [1290608,21332] 0 2024-04-03T08:39:10.312 INFO:tasks.workunit.client.0.smithi157.stdout:9/316: unlink d1/d15/d16/f5b 0 2024-04-03T08:39:10.312 INFO:tasks.workunit.client.0.smithi157.stdout:0/337: write d2/f21 [593226,25848] 0 2024-04-03T08:39:10.313 INFO:tasks.workunit.client.0.smithi157.stdout:9/317: chown d1/d15/d16 0 1 2024-04-03T08:39:10.313 INFO:tasks.workunit.client.1.smithi181.stdout:7/128: creat d0/d1/d6/de/f2a x:0 0 0 2024-04-03T08:39:10.314 INFO:tasks.workunit.client.0.smithi157.stdout:0/338: write d2/f21 [1002352,36481] 0 2024-04-03T08:39:10.316 INFO:tasks.workunit.client.0.smithi157.stdout:6/365: rename l0 to d1/d5/d17/d2a/d40/l79 0 2024-04-03T08:39:10.317 INFO:tasks.workunit.client.1.smithi181.stdout:3/142: rmdir d0/d5/d16/d1e 39 2024-04-03T08:39:10.320 INFO:tasks.workunit.client.1.smithi181.stdout:0/135: dwrite d5/fb [0,4194304] 0 2024-04-03T08:39:10.322 INFO:tasks.workunit.client.1.smithi181.stdout:1/122: rmdir d10/d15/d17/d23/d27 39 2024-04-03T08:39:10.327 INFO:tasks.workunit.client.0.smithi157.stdout:6/366: dread d1/fc [4194304,4194304] 0 2024-04-03T08:39:10.331 INFO:tasks.workunit.client.0.smithi157.stdout:0/339: creat d2/d9/d36/f80 x:0 0 0 2024-04-03T08:39:10.332 INFO:tasks.workunit.client.0.smithi157.stdout:0/340: dread - d2/f2c zero size 2024-04-03T08:39:10.333 INFO:tasks.workunit.client.1.smithi181.stdout:4/160: write d1/d1e/f1a [2140740,128209] 0 2024-04-03T08:39:10.335 INFO:tasks.workunit.client.1.smithi181.stdout:4/161: chown d1/c1b 2453 1 2024-04-03T08:39:10.336 INFO:tasks.workunit.client.0.smithi157.stdout:3/332: rename c3 to d8/d1e/d2d/d39/d51/c74 0 2024-04-03T08:39:10.339 INFO:tasks.workunit.client.1.smithi181.stdout:0/136: dwrite d5/dc/f21 [4194304,4194304] 0 2024-04-03T08:39:10.341 INFO:tasks.workunit.client.1.smithi181.stdout:0/137: write d5/dc/f23 [159073,5002] 0 2024-04-03T08:39:10.345 INFO:tasks.workunit.client.1.smithi181.stdout:0/138: truncate d5/dc/d10/f20 1718401 0 2024-04-03T08:39:10.346 INFO:tasks.workunit.client.1.smithi181.stdout:3/143: unlink d0/c15 0 2024-04-03T08:39:10.355 INFO:tasks.workunit.client.0.smithi157.stdout:5/361: rename dc/d29/d56/d52/d7c to dc/d29/d56/d49/d7f 0 2024-04-03T08:39:10.357 INFO:tasks.workunit.client.1.smithi181.stdout:1/123: write fc [3097871,88127] 0 2024-04-03T08:39:10.359 INFO:tasks.workunit.client.0.smithi157.stdout:8/335: link d2/d11/c22 d2/d11/c73 0 2024-04-03T08:39:10.361 INFO:tasks.workunit.client.1.smithi181.stdout:8/129: write d4/d6/d9/f18 [4505625,28332] 0 2024-04-03T08:39:10.364 INFO:tasks.workunit.client.0.smithi157.stdout:0/341: creat d2/d9/d51/d63/d71/f81 x:0 0 0 2024-04-03T08:39:10.366 INFO:tasks.workunit.client.0.smithi157.stdout:0/342: dread - d2/d9/dc/df/d78/d6a/f76 zero size 2024-04-03T08:39:10.366 INFO:tasks.workunit.client.0.smithi157.stdout:3/333: dread d8/d1e/d2d/d3f/f44 [0,4194304] 0 2024-04-03T08:39:10.367 INFO:tasks.workunit.client.0.smithi157.stdout:5/362: symlink dc/d35/l80 0 2024-04-03T08:39:10.368 INFO:tasks.workunit.client.1.smithi181.stdout:5/173: mknod d4/c33 0 2024-04-03T08:39:10.371 INFO:tasks.workunit.client.0.smithi157.stdout:8/336: symlink d2/d11/d10/d24/d5b/d2e/d56/l74 0 2024-04-03T08:39:10.372 INFO:tasks.workunit.client.1.smithi181.stdout:9/220: dwrite d1/f2f [4194304,4194304] 0 2024-04-03T08:39:10.372 INFO:tasks.workunit.client.0.smithi157.stdout:9/318: truncate d1/d36/f3b 129941 0 2024-04-03T08:39:10.374 INFO:tasks.workunit.client.1.smithi181.stdout:0/139: creat d5/d9/f28 x:0 0 0 2024-04-03T08:39:10.375 INFO:tasks.workunit.client.0.smithi157.stdout:6/367: rmdir d1/d5/d17/d2a/d5b 0 2024-04-03T08:39:10.376 INFO:tasks.workunit.client.1.smithi181.stdout:0/140: truncate d5/d9/f28 192446 0 2024-04-03T08:39:10.376 INFO:tasks.workunit.client.0.smithi157.stdout:6/368: dread - d1/d5/d17/d29/f5a zero size 2024-04-03T08:39:10.377 INFO:tasks.workunit.client.1.smithi181.stdout:3/144: write d0/d5/d6/dd/f24 [46663,116514] 0 2024-04-03T08:39:10.378 INFO:tasks.workunit.client.0.smithi157.stdout:3/334: unlink d8/d13/f31 0 2024-04-03T08:39:10.378 INFO:tasks.workunit.client.0.smithi157.stdout:6/369: fsync d1/d22/f2e 0 2024-04-03T08:39:10.379 INFO:tasks.workunit.client.1.smithi181.stdout:6/166: creat d6/d7/f39 x:0 0 0 2024-04-03T08:39:10.380 INFO:tasks.workunit.client.0.smithi157.stdout:3/335: readlink d8/d1e/d2d/d3f/l5d 0 2024-04-03T08:39:10.381 INFO:tasks.workunit.client.0.smithi157.stdout:0/343: mkdir d2/d9/d36/d82 0 2024-04-03T08:39:10.382 INFO:tasks.workunit.client.1.smithi181.stdout:1/124: creat d10/d15/d17/f2a x:0 0 0 2024-04-03T08:39:10.383 INFO:tasks.workunit.client.1.smithi181.stdout:1/125: dread - d10/d15/f18 zero size 2024-04-03T08:39:10.383 INFO:tasks.workunit.client.0.smithi157.stdout:5/363: symlink dc/d29/d56/d49/d53/l81 0 2024-04-03T08:39:10.384 INFO:tasks.workunit.client.1.smithi181.stdout:4/162: creat d1/d1e/d29/d34/f35 x:0 0 0 2024-04-03T08:39:10.385 INFO:tasks.workunit.client.1.smithi181.stdout:1/126: chown d10/d15/d17/d19/f1a 15620 1 2024-04-03T08:39:10.386 INFO:tasks.workunit.client.0.smithi157.stdout:6/370: dread d1/d4b/f57 [0,4194304] 0 2024-04-03T08:39:10.387 INFO:tasks.workunit.client.1.smithi181.stdout:7/129: link d0/l25 d0/d1/l2b 0 2024-04-03T08:39:10.390 INFO:tasks.workunit.client.1.smithi181.stdout:5/174: rename d4/d18/d25/f19 to d4/d18/d2c/f34 0 2024-04-03T08:39:10.392 INFO:tasks.workunit.client.0.smithi157.stdout:3/336: mknod d8/d1e/d2d/d39/d51/d4c/c75 0 2024-04-03T08:39:10.395 INFO:tasks.workunit.client.1.smithi181.stdout:9/221: rmdir d1/da/d1a 39 2024-04-03T08:39:10.395 INFO:tasks.workunit.client.1.smithi181.stdout:1/127: dread f2 [0,4194304] 0 2024-04-03T08:39:10.395 INFO:tasks.workunit.client.0.smithi157.stdout:3/337: chown d8/d13/d1b/f6b 44 1 2024-04-03T08:39:10.397 INFO:tasks.workunit.client.0.smithi157.stdout:0/344: rename d2/fa to d2/d9/d36/d38/f83 0 2024-04-03T08:39:10.400 INFO:tasks.workunit.client.0.smithi157.stdout:9/319: mknod d1/d36/d66/c68 0 2024-04-03T08:39:10.401 INFO:tasks.workunit.client.0.smithi157.stdout:5/364: dwrite dc/f67 [0,4194304] 0 2024-04-03T08:39:10.402 INFO:tasks.workunit.client.0.smithi157.stdout:9/320: stat d1/d15/d27/f32 0 2024-04-03T08:39:10.403 INFO:tasks.workunit.client.0.smithi157.stdout:8/337: dwrite d2/d11/d10/d24/d5b/d2e/f64 [0,4194304] 0 2024-04-03T08:39:10.403 INFO:tasks.workunit.client.0.smithi157.stdout:6/371: symlink d1/d5/d17/d2a/d30/l7a 0 2024-04-03T08:39:10.407 INFO:tasks.workunit.client.0.smithi157.stdout:8/338: write d2/d11/d10/d24/d5b/d2e/f64 [293335,38219] 0 2024-04-03T08:39:10.407 INFO:tasks.workunit.client.1.smithi181.stdout:1/128: dwrite d10/f22 [0,4194304] 0 2024-04-03T08:39:10.410 INFO:tasks.workunit.client.0.smithi157.stdout:3/338: write d8/f57 [725311,267] 0 2024-04-03T08:39:10.411 INFO:tasks.workunit.client.0.smithi157.stdout:3/339: dread d8/d13/f60 [0,4194304] 0 2024-04-03T08:39:10.412 INFO:tasks.workunit.client.1.smithi181.stdout:1/129: write fb [3491539,43469] 0 2024-04-03T08:39:10.415 INFO:tasks.workunit.client.1.smithi181.stdout:8/130: creat d4/d6/d9/d15/f29 x:0 0 0 2024-04-03T08:39:10.415 INFO:tasks.workunit.client.1.smithi181.stdout:1/130: fdatasync d10/d15/d17/d19/f1a 0 2024-04-03T08:39:10.419 INFO:tasks.workunit.client.0.smithi157.stdout:5/365: creat dc/d29/d56/d49/d7f/f82 x:0 0 0 2024-04-03T08:39:10.420 INFO:tasks.workunit.client.1.smithi181.stdout:4/163: mknod d1/d1e/d29/d34/c36 0 2024-04-03T08:39:10.422 INFO:tasks.workunit.client.1.smithi181.stdout:2/190: getdents d13/d22/d27 0 2024-04-03T08:39:10.430 INFO:tasks.workunit.client.0.smithi157.stdout:6/372: creat d1/d5/d17/d2a/d37/f7b x:0 0 0 2024-04-03T08:39:10.433 INFO:tasks.workunit.client.1.smithi181.stdout:5/175: fdatasync d4/d18/d2c/f34 0 2024-04-03T08:39:10.435 INFO:tasks.workunit.client.1.smithi181.stdout:0/141: write d5/d9/f1d [4877191,115684] 0 2024-04-03T08:39:10.435 INFO:tasks.workunit.client.0.smithi157.stdout:6/373: chown d1/d5/d1b/f41 971 1 2024-04-03T08:39:10.440 INFO:tasks.workunit.client.0.smithi157.stdout:3/340: dwrite d8/d1e/d2d/d3f/f71 [0,4194304] 0 2024-04-03T08:39:10.441 INFO:tasks.workunit.client.0.smithi157.stdout:0/345: write d2/f37 [617388,8309] 0 2024-04-03T08:39:10.443 INFO:tasks.workunit.client.0.smithi157.stdout:1/284: sync 2024-04-03T08:39:10.445 INFO:tasks.workunit.client.1.smithi181.stdout:3/145: symlink d0/d5/d16/l27 0 2024-04-03T08:39:10.447 INFO:tasks.workunit.client.0.smithi157.stdout:5/366: dread dc/d29/d56/d49/f5e [0,4194304] 0 2024-04-03T08:39:10.448 INFO:tasks.workunit.client.0.smithi157.stdout:1/285: readlink d2/d11/d24/l1a 0 2024-04-03T08:39:10.448 INFO:tasks.workunit.client.0.smithi157.stdout:8/339: truncate d2/d20/f29 2162416 0 2024-04-03T08:39:10.449 INFO:tasks.workunit.client.0.smithi157.stdout:0/346: fdatasync d2/d9/d51/d63/d71/f81 0 2024-04-03T08:39:10.453 INFO:tasks.workunit.client.1.smithi181.stdout:9/222: dwrite d1/da/d28/f49 [0,4194304] 0 2024-04-03T08:39:10.455 INFO:tasks.workunit.client.0.smithi157.stdout:3/341: creat d8/d1e/d2d/d39/f76 x:0 0 0 2024-04-03T08:39:10.456 INFO:tasks.workunit.client.0.smithi157.stdout:1/286: dread d2/d11/d24/f2f [0,4194304] 0 2024-04-03T08:39:10.456 INFO:tasks.workunit.client.1.smithi181.stdout:9/223: chown d1/da/d13/d41 5347653 1 2024-04-03T08:39:10.457 INFO:tasks.workunit.client.1.smithi181.stdout:8/131: rename d4/d6/d9/d15 to d4/d2a 0 2024-04-03T08:39:10.460 INFO:tasks.workunit.client.1.smithi181.stdout:2/191: creat d13/d1c/f51 x:0 0 0 2024-04-03T08:39:10.463 INFO:tasks.workunit.client.0.smithi157.stdout:6/374: link d1/d4b/f45 d1/d5/d17/d2a/d40/f7c 0 2024-04-03T08:39:10.464 INFO:tasks.workunit.client.0.smithi157.stdout:9/321: dwrite d1/d15/f2d [0,4194304] 0 2024-04-03T08:39:10.465 INFO:tasks.workunit.client.1.smithi181.stdout:7/130: fdatasync d0/d1/f19 0 2024-04-03T08:39:10.469 INFO:tasks.workunit.client.0.smithi157.stdout:8/340: chown d2/d11/d10/d24/d5b/f47 139033 1 2024-04-03T08:39:10.470 INFO:tasks.workunit.client.1.smithi181.stdout:0/142: mkdir d5/dc/d14/d29 0 2024-04-03T08:39:10.471 INFO:tasks.workunit.client.1.smithi181.stdout:3/146: unlink d0/d5/c10 0 2024-04-03T08:39:10.472 INFO:tasks.workunit.client.0.smithi157.stdout:3/342: symlink d8/d1e/d2d/d39/l77 0 2024-04-03T08:39:10.479 INFO:tasks.workunit.client.1.smithi181.stdout:6/167: truncate d6/d7/d9/fe 591595 0 2024-04-03T08:39:10.481 INFO:tasks.workunit.client.1.smithi181.stdout:4/164: rename d1/d1e/d29 to d1/d16/d37 0 2024-04-03T08:39:10.481 INFO:tasks.workunit.client.0.smithi157.stdout:1/287: mkdir d2/d11/d24/d39/d3b/d2e/d48/d58/d62 0 2024-04-03T08:39:10.483 INFO:tasks.workunit.client.0.smithi157.stdout:6/375: creat d1/d5/d17/d29/f7d x:0 0 0 2024-04-03T08:39:10.485 INFO:tasks.workunit.client.0.smithi157.stdout:6/376: stat d1/d5/d1b/f65 0 2024-04-03T08:39:10.485 INFO:tasks.workunit.client.1.smithi181.stdout:2/192: rmdir d13/d1c/d4a 39 2024-04-03T08:39:10.486 INFO:tasks.workunit.client.1.smithi181.stdout:4/165: dread - d1/d1e/f2e zero size 2024-04-03T08:39:10.486 INFO:tasks.workunit.client.1.smithi181.stdout:1/131: chown d10/d15/d17/d23/d27/l28 1159466 1 2024-04-03T08:39:10.488 INFO:tasks.workunit.client.0.smithi157.stdout:8/341: rmdir d2/d11/d10/d24/d5b 39 2024-04-03T08:39:10.489 INFO:tasks.workunit.client.0.smithi157.stdout:1/288: symlink d2/d11/d24/d39/d3b/d2e/l63 0 2024-04-03T08:39:10.491 INFO:tasks.workunit.client.1.smithi181.stdout:1/132: fdatasync fc 0 2024-04-03T08:39:10.493 INFO:tasks.workunit.client.1.smithi181.stdout:7/131: rename d0/d1/d6/de/d17/f29 to d0/d1/d6/de/d17/f2c 0 2024-04-03T08:39:10.494 INFO:tasks.workunit.client.0.smithi157.stdout:1/289: read d2/d11/d24/d39/d3b/fe [304254,115055] 0 2024-04-03T08:39:10.494 INFO:tasks.workunit.client.0.smithi157.stdout:5/367: rename dc/d29/d56/d18/d21/f45 to dc/f83 0 2024-04-03T08:39:10.496 INFO:tasks.workunit.client.1.smithi181.stdout:6/168: write d6/d31/d36/f34 [581666,13266] 0 2024-04-03T08:39:10.497 INFO:tasks.workunit.client.0.smithi157.stdout:8/342: stat d2/d11/d10/d24/d5b/d2e/l43 0 2024-04-03T08:39:10.501 INFO:tasks.workunit.client.1.smithi181.stdout:3/147: creat d0/d5/d16/d1e/f28 x:0 0 0 2024-04-03T08:39:10.502 INFO:tasks.workunit.client.1.smithi181.stdout:1/133: dread - d10/d15/f18 zero size 2024-04-03T08:39:10.502 INFO:tasks.workunit.client.1.smithi181.stdout:4/166: fsync d1/d16/f17 0 2024-04-03T08:39:10.503 INFO:tasks.workunit.client.1.smithi181.stdout:9/224: write d1/da/d13/d41/f26 [1957930,8535] 0 2024-04-03T08:39:10.504 INFO:tasks.workunit.client.1.smithi181.stdout:2/193: creat d13/d22/d27/d46/f52 x:0 0 0 2024-04-03T08:39:10.504 INFO:tasks.workunit.client.0.smithi157.stdout:0/347: rename d2/d9/dc/df/l44 to d2/d9/dc/df/d78/l84 0 2024-04-03T08:39:10.505 INFO:tasks.workunit.client.1.smithi181.stdout:5/176: dread d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:10.506 INFO:tasks.workunit.client.1.smithi181.stdout:8/132: dwrite d4/d2a/f29 [0,4194304] 0 2024-04-03T08:39:10.506 INFO:tasks.workunit.client.0.smithi157.stdout:1/290: mkdir d2/d11/d24/d39/d3b/d2e/d48/d64 0 2024-04-03T08:39:10.509 INFO:tasks.workunit.client.0.smithi157.stdout:9/322: getdents d1/d36 0 2024-04-03T08:39:10.511 INFO:tasks.workunit.client.1.smithi181.stdout:0/143: dwrite d5/dc/f1e [0,4194304] 0 2024-04-03T08:39:10.512 INFO:tasks.workunit.client.0.smithi157.stdout:8/343: mkdir d2/d11/d10/d24/d5b/d2e/d75 0 2024-04-03T08:39:10.516 INFO:tasks.workunit.client.0.smithi157.stdout:1/291: read d2/d11/d24/d39/d3b/d1b/f2a [1039432,84901] 0 2024-04-03T08:39:10.516 INFO:tasks.workunit.client.0.smithi157.stdout:0/348: read d2/d9/dc/df/d1b/d35/f66 [2947025,587] 0 2024-04-03T08:39:10.516 INFO:tasks.workunit.client.1.smithi181.stdout:0/144: stat d5/fb 0 2024-04-03T08:39:10.516 INFO:tasks.workunit.client.0.smithi157.stdout:3/343: rename d8/d13/f1c to d8/d1e/d2d/d39/d51/d4c/f78 0 2024-04-03T08:39:10.517 INFO:tasks.workunit.client.0.smithi157.stdout:5/368: dwrite dc/f62 [0,4194304] 0 2024-04-03T08:39:10.518 INFO:tasks.workunit.client.1.smithi181.stdout:5/177: truncate d4/f13 4299901 0 2024-04-03T08:39:10.519 INFO:tasks.workunit.client.1.smithi181.stdout:9/225: write d1/da/f1e [2197675,69364] 0 2024-04-03T08:39:10.520 INFO:tasks.workunit.client.0.smithi157.stdout:9/323: chown d1/d15/d27/d5c/f5f 166 1 2024-04-03T08:39:10.522 INFO:tasks.workunit.client.0.smithi157.stdout:5/369: write dc/d29/d56/d18/d21/f5d [347488,98153] 0 2024-04-03T08:39:10.523 INFO:tasks.workunit.client.1.smithi181.stdout:5/178: write f1 [5444545,64255] 0 2024-04-03T08:39:10.527 INFO:tasks.workunit.client.1.smithi181.stdout:8/133: write d4/d6/d9/f18 [2278686,83063] 0 2024-04-03T08:39:10.527 INFO:tasks.workunit.client.0.smithi157.stdout:9/324: truncate d1/d15/d16/f67 935317 0 2024-04-03T08:39:10.528 INFO:tasks.workunit.client.1.smithi181.stdout:4/167: mknod d1/d16/d24/c38 0 2024-04-03T08:39:10.530 INFO:tasks.workunit.client.0.smithi157.stdout:0/349: fdatasync d2/d9/d36/d38/f83 0 2024-04-03T08:39:10.532 INFO:tasks.workunit.client.0.smithi157.stdout:6/377: dread d1/d22/f2e [0,4194304] 0 2024-04-03T08:39:10.536 INFO:tasks.workunit.client.0.smithi157.stdout:1/292: dread d2/d11/d24/f1c [0,4194304] 0 2024-04-03T08:39:10.536 INFO:tasks.workunit.client.0.smithi157.stdout:5/370: creat dc/d29/d56/d49/f84 x:0 0 0 2024-04-03T08:39:10.536 INFO:tasks.workunit.client.0.smithi157.stdout:8/344: creat d2/d11/d10/d24/d5b/d2e/d75/f76 x:0 0 0 2024-04-03T08:39:10.540 INFO:tasks.workunit.client.1.smithi181.stdout:5/179: stat d4/d18/c2b 0 2024-04-03T08:39:10.545 INFO:tasks.workunit.client.0.smithi157.stdout:3/344: dwrite d8/d13/f1a [4194304,4194304] 0 2024-04-03T08:39:10.546 INFO:tasks.workunit.client.1.smithi181.stdout:7/132: link d0/d1/f15 d0/d1/d6/de/f2d 0 2024-04-03T08:39:10.548 INFO:tasks.workunit.client.1.smithi181.stdout:9/226: unlink d1/da/d13/c40 0 2024-04-03T08:39:10.548 INFO:tasks.workunit.client.0.smithi157.stdout:0/350: mkdir d2/d9/d5f/d85 0 2024-04-03T08:39:10.549 INFO:tasks.workunit.client.0.smithi157.stdout:8/345: rename d2/d6f/d70/d72 to d2/d20/d77 0 2024-04-03T08:39:10.550 INFO:tasks.workunit.client.0.smithi157.stdout:3/345: rmdir d8/d13/d1b/d5b 39 2024-04-03T08:39:10.553 INFO:tasks.workunit.client.0.smithi157.stdout:0/351: fdatasync d2/d9/dc/df/d1b/d35/f56 0 2024-04-03T08:39:10.553 INFO:tasks.workunit.client.0.smithi157.stdout:1/293: read d2/f21 [26219,49144] 0 2024-04-03T08:39:10.554 INFO:tasks.workunit.client.1.smithi181.stdout:3/148: dwrite d0/d5/d6/dd/f24 [0,4194304] 0 2024-04-03T08:39:10.556 INFO:tasks.workunit.client.1.smithi181.stdout:3/149: chown d0/d5/d16/d1e 19 1 2024-04-03T08:39:10.557 INFO:tasks.workunit.client.1.smithi181.stdout:2/194: rmdir d13/d1c/d44 0 2024-04-03T08:39:10.558 INFO:tasks.workunit.client.0.smithi157.stdout:1/294: write d2/d11/d24/d39/d3b/d1b/f4e [2291868,126385] 0 2024-04-03T08:39:10.561 INFO:tasks.workunit.client.1.smithi181.stdout:2/195: dread - d13/d1c/f38 zero size 2024-04-03T08:39:10.564 INFO:tasks.workunit.client.1.smithi181.stdout:7/133: creat d0/d1/d6/de/d17/d27/f2e x:0 0 0 2024-04-03T08:39:10.565 INFO:tasks.workunit.client.0.smithi157.stdout:4/348: sync 2024-04-03T08:39:10.565 INFO:tasks.workunit.client.0.smithi157.stdout:7/367: sync 2024-04-03T08:39:10.567 INFO:tasks.workunit.client.1.smithi181.stdout:7/134: stat d0/d1/d6/de/f2d 0 2024-04-03T08:39:10.568 INFO:tasks.workunit.client.0.smithi157.stdout:5/371: creat dc/f85 x:0 0 0 2024-04-03T08:39:10.570 INFO:tasks.workunit.client.0.smithi157.stdout:4/349: write da/df/d24/d35/d3c/f4d [820263,119301] 0 2024-04-03T08:39:10.571 INFO:tasks.workunit.client.0.smithi157.stdout:0/352: dwrite d2/f1d [0,4194304] 0 2024-04-03T08:39:10.572 INFO:tasks.workunit.client.1.smithi181.stdout:9/227: symlink d1/da/d13/d41/l4b 0 2024-04-03T08:39:10.572 INFO:tasks.workunit.client.1.smithi181.stdout:1/134: dwrite d10/d15/d17/f1d [0,4194304] 0 2024-04-03T08:39:10.575 INFO:tasks.workunit.client.1.smithi181.stdout:0/145: write d5/fe [1845849,38211] 0 2024-04-03T08:39:10.577 INFO:tasks.workunit.client.0.smithi157.stdout:1/295: readlink d2/l40 0 2024-04-03T08:39:10.578 INFO:tasks.workunit.client.0.smithi157.stdout:9/325: write d1/f2e [1243572,20111] 0 2024-04-03T08:39:10.579 INFO:tasks.workunit.client.1.smithi181.stdout:1/135: read fc [3255969,28510] 0 2024-04-03T08:39:10.580 INFO:tasks.workunit.client.1.smithi181.stdout:2/196: creat d13/d22/d27/d46/f53 x:0 0 0 2024-04-03T08:39:10.583 INFO:tasks.workunit.client.0.smithi157.stdout:7/368: creat d0/d75/f8d x:0 0 0 2024-04-03T08:39:10.585 INFO:tasks.workunit.client.0.smithi157.stdout:5/372: read - dc/d29/d56/f22 zero size 2024-04-03T08:39:10.587 INFO:tasks.workunit.client.1.smithi181.stdout:5/180: creat d4/d18/f35 x:0 0 0 2024-04-03T08:39:10.588 INFO:tasks.workunit.client.0.smithi157.stdout:6/378: dwrite d1/d5/d17/f4e [0,4194304] 0 2024-04-03T08:39:10.589 INFO:tasks.workunit.client.1.smithi181.stdout:0/146: mkdir d5/d9/d2a 0 2024-04-03T08:39:10.591 INFO:tasks.workunit.client.0.smithi157.stdout:5/373: dread dc/d29/d56/d18/f3e [0,4194304] 0 2024-04-03T08:39:10.591 INFO:tasks.workunit.client.1.smithi181.stdout:7/135: dread d0/d1/d6/f9 [4194304,4194304] 0 2024-04-03T08:39:10.594 INFO:tasks.workunit.client.0.smithi157.stdout:5/374: write dc/d35/f40 [3603877,62195] 0 2024-04-03T08:39:10.595 INFO:tasks.workunit.client.1.smithi181.stdout:1/136: mknod d10/c2b 0 2024-04-03T08:39:10.595 INFO:tasks.workunit.client.0.smithi157.stdout:7/369: mkdir d0/d4/d8e 0 2024-04-03T08:39:10.596 INFO:tasks.workunit.client.1.smithi181.stdout:9/228: creat d1/da/d1a/f4c x:0 0 0 2024-04-03T08:39:10.599 INFO:tasks.workunit.client.0.smithi157.stdout:3/346: rename d8/d1e/d2d/d3f/f71 to d8/d1e/d2d/f79 0 2024-04-03T08:39:10.600 INFO:tasks.workunit.client.0.smithi157.stdout:5/375: write dc/d29/d56/f22 [466385,16504] 0 2024-04-03T08:39:10.601 INFO:tasks.workunit.client.1.smithi181.stdout:0/147: symlink d5/d9/l2b 0 2024-04-03T08:39:10.603 INFO:tasks.workunit.client.0.smithi157.stdout:4/350: mkdir da/df/d24/d35/d6a/d76 0 2024-04-03T08:39:10.603 INFO:tasks.workunit.client.1.smithi181.stdout:2/197: dwrite d13/d1d/f2a [0,4194304] 0 2024-04-03T08:39:10.605 INFO:tasks.workunit.client.1.smithi181.stdout:0/148: write d5/dc/f1e [1896779,23352] 0 2024-04-03T08:39:10.607 INFO:tasks.workunit.client.0.smithi157.stdout:0/353: creat d2/d9/d5f/d85/f86 x:0 0 0 2024-04-03T08:39:10.608 INFO:tasks.workunit.client.1.smithi181.stdout:0/149: fsync d5/dc/d10/f20 0 2024-04-03T08:39:10.608 INFO:tasks.workunit.client.0.smithi157.stdout:2/397: sync 2024-04-03T08:39:10.610 INFO:tasks.workunit.client.1.smithi181.stdout:0/150: write d5/d9/fd [1737377,33416] 0 2024-04-03T08:39:10.611 INFO:tasks.workunit.client.1.smithi181.stdout:1/137: unlink fb 0 2024-04-03T08:39:10.612 INFO:tasks.workunit.client.1.smithi181.stdout:1/138: stat d10/c14 0 2024-04-03T08:39:10.616 INFO:tasks.workunit.client.1.smithi181.stdout:8/134: truncate d4/d6/f8 2736741 0 2024-04-03T08:39:10.617 INFO:tasks.workunit.client.0.smithi157.stdout:8/346: link d2/d11/l2c d2/d6f/d70/l78 0 2024-04-03T08:39:10.618 INFO:tasks.workunit.client.1.smithi181.stdout:8/135: dread - d4/f19 zero size 2024-04-03T08:39:10.619 INFO:tasks.workunit.client.0.smithi157.stdout:0/354: write d2/d9/dc/df/d1b/d35/f56 [1404972,94149] 0 2024-04-03T08:39:10.624 INFO:tasks.workunit.client.1.smithi181.stdout:6/169: write d6/d7/d9/fa [317828,61929] 0 2024-04-03T08:39:10.627 INFO:tasks.workunit.client.0.smithi157.stdout:8/347: fsync d2/d11/d10/d24/d5b/d2e/d75/f76 0 2024-04-03T08:39:10.629 INFO:tasks.workunit.client.0.smithi157.stdout:7/370: rename d0/d4/d36 to d0/d11/d15/d17/d43/d8a/d8f 0 2024-04-03T08:39:10.630 INFO:tasks.workunit.client.0.smithi157.stdout:3/347: dwrite d8/d13/f1a [4194304,4194304] 0 2024-04-03T08:39:10.633 INFO:tasks.workunit.client.1.smithi181.stdout:3/150: truncate d0/d5/d6/dd/f21 868533 0 2024-04-03T08:39:10.634 INFO:tasks.workunit.client.1.smithi181.stdout:3/151: stat d0/l1a 0 2024-04-03T08:39:10.634 INFO:tasks.workunit.client.0.smithi157.stdout:1/296: write d2/d11/d24/f2f [1152892,42454] 0 2024-04-03T08:39:10.635 INFO:tasks.workunit.client.1.smithi181.stdout:8/136: dread d4/d6/d9/f18 [0,4194304] 0 2024-04-03T08:39:10.635 INFO:tasks.workunit.client.0.smithi157.stdout:5/376: fdatasync fa 0 2024-04-03T08:39:10.635 INFO:tasks.workunit.client.0.smithi157.stdout:9/326: dread d1/f1b [0,4194304] 0 2024-04-03T08:39:10.636 INFO:tasks.workunit.client.0.smithi157.stdout:4/351: creat da/df/d24/d35/d6a/f77 x:0 0 0 2024-04-03T08:39:10.643 INFO:tasks.workunit.client.0.smithi157.stdout:1/297: chown d2/d11/d24/d39/d3b/d2e/d48/d58/l3d 8 1 2024-04-03T08:39:10.645 INFO:tasks.workunit.client.0.smithi157.stdout:6/379: write d1/f6d [1002295,14310] 0 2024-04-03T08:39:10.646 INFO:tasks.workunit.client.0.smithi157.stdout:8/348: dread d2/d11/ff [0,4194304] 0 2024-04-03T08:39:10.648 INFO:tasks.workunit.client.1.smithi181.stdout:8/137: dread d4/f27 [0,4194304] 0 2024-04-03T08:39:10.650 INFO:tasks.workunit.client.1.smithi181.stdout:0/151: mkdir d5/d9/d2c 0 2024-04-03T08:39:10.651 INFO:tasks.workunit.client.1.smithi181.stdout:1/139: creat d10/d15/d17/d23/d27/f2c x:0 0 0 2024-04-03T08:39:10.652 INFO:tasks.workunit.client.1.smithi181.stdout:9/229: write d1/da/d13/d22/f31 [1046271,66362] 0 2024-04-03T08:39:10.654 INFO:tasks.workunit.client.1.smithi181.stdout:3/152: dwrite d0/d5/d16/d1e/f28 [0,4194304] 0 2024-04-03T08:39:10.654 INFO:tasks.workunit.client.1.smithi181.stdout:6/170: creat d6/f3a x:0 0 0 2024-04-03T08:39:10.654 INFO:tasks.workunit.client.0.smithi157.stdout:6/380: dread d1/d5/d17/d2a/d37/f3b [0,4194304] 0 2024-04-03T08:39:10.655 INFO:tasks.workunit.client.1.smithi181.stdout:9/230: chown d1/da/d13/d41/f26 11 1 2024-04-03T08:39:10.664 INFO:tasks.workunit.client.0.smithi157.stdout:5/377: dwrite dc/d35/f40 [0,4194304] 0 2024-04-03T08:39:10.665 INFO:tasks.workunit.client.1.smithi181.stdout:7/136: rename d0/d1/d6/fd to d0/f2f 0 2024-04-03T08:39:10.667 INFO:tasks.workunit.client.1.smithi181.stdout:2/198: creat d13/d1c/f54 x:0 0 0 2024-04-03T08:39:10.669 INFO:tasks.workunit.client.1.smithi181.stdout:2/199: stat d13/d1d/c2d 0 2024-04-03T08:39:10.671 INFO:tasks.workunit.client.1.smithi181.stdout:0/152: dwrite d5/dc/d10/f27 [0,4194304] 0 2024-04-03T08:39:10.671 INFO:tasks.workunit.client.1.smithi181.stdout:2/200: truncate fe 4529152 0 2024-04-03T08:39:10.672 INFO:tasks.workunit.client.0.smithi157.stdout:0/355: rename d2/d9/dc/df/d1b/d35/d3d/c32 to d2/d9/d51/d63/c87 0 2024-04-03T08:39:10.673 INFO:tasks.workunit.client.1.smithi181.stdout:1/140: symlink d10/d15/d17/d23/d27/l2d 0 2024-04-03T08:39:10.676 INFO:tasks.workunit.client.0.smithi157.stdout:0/356: chown d2/d9/dc/df/d78/d6a/l7a 8127488 1 2024-04-03T08:39:10.676 INFO:tasks.workunit.client.1.smithi181.stdout:0/153: dread - d5/d9/d13/f26 zero size 2024-04-03T08:39:10.676 INFO:tasks.workunit.client.1.smithi181.stdout:6/171: unlink d6/d7/l14 0 2024-04-03T08:39:10.676 INFO:tasks.workunit.client.1.smithi181.stdout:2/201: chown d13/d22/d27/d2f/f47 992276 1 2024-04-03T08:39:10.677 INFO:tasks.workunit.client.1.smithi181.stdout:6/172: stat d6/d7/d9/l25 0 2024-04-03T08:39:10.679 INFO:tasks.workunit.client.1.smithi181.stdout:9/231: symlink d1/da/d28/d30/l4d 0 2024-04-03T08:39:10.679 INFO:tasks.workunit.client.1.smithi181.stdout:2/202: fsync d13/d22/d27/d2f/f47 0 2024-04-03T08:39:10.681 INFO:tasks.workunit.client.1.smithi181.stdout:8/138: unlink d4/d6/d9/f18 0 2024-04-03T08:39:10.681 INFO:tasks.workunit.client.1.smithi181.stdout:0/154: dread d5/d9/f28 [0,4194304] 0 2024-04-03T08:39:10.684 INFO:tasks.workunit.client.1.smithi181.stdout:2/203: read - d13/d1c/f3b zero size 2024-04-03T08:39:10.684 INFO:tasks.workunit.client.1.smithi181.stdout:8/139: dread - d4/d6/db/d14/f20 zero size 2024-04-03T08:39:10.684 INFO:tasks.workunit.client.1.smithi181.stdout:2/204: readlink ld 0 2024-04-03T08:39:10.688 INFO:tasks.workunit.client.1.smithi181.stdout:1/141: unlink d10/d15/d17/f1d 0 2024-04-03T08:39:10.689 INFO:tasks.workunit.client.1.smithi181.stdout:3/153: write d0/d5/fa [1116389,114919] 0 2024-04-03T08:39:10.692 INFO:tasks.workunit.client.1.smithi181.stdout:3/154: fsync d0/d5/d6/dd/f24 0 2024-04-03T08:39:10.693 INFO:tasks.workunit.client.0.smithi157.stdout:6/381: creat d1/d5/d17/d2a/d40/f7e x:0 0 0 2024-04-03T08:39:10.694 INFO:tasks.workunit.client.1.smithi181.stdout:6/173: unlink d6/d31/d36/c1e 0 2024-04-03T08:39:10.695 INFO:tasks.workunit.client.0.smithi157.stdout:6/382: fdatasync d1/d5/d17/f4e 0 2024-04-03T08:39:10.695 INFO:tasks.workunit.client.0.smithi157.stdout:5/378: symlink dc/d29/d56/d18/d21/l86 0 2024-04-03T08:39:10.697 INFO:tasks.workunit.client.0.smithi157.stdout:6/383: write d1/f42 [268813,77886] 0 2024-04-03T08:39:10.699 INFO:tasks.workunit.client.1.smithi181.stdout:9/232: mkdir d1/da/d28/d30/d3e/d4e 0 2024-04-03T08:39:10.700 INFO:tasks.workunit.client.1.smithi181.stdout:8/140: dread d4/d6/d9/f1b [0,4194304] 0 2024-04-03T08:39:10.700 INFO:tasks.workunit.client.0.smithi157.stdout:9/327: write d1/d15/d27/f45 [969060,35273] 0 2024-04-03T08:39:10.703 INFO:tasks.workunit.client.0.smithi157.stdout:0/357: rmdir d2/d9/d51 39 2024-04-03T08:39:10.703 INFO:tasks.workunit.client.0.smithi157.stdout:9/328: dread d1/d36/f3b [0,4194304] 0 2024-04-03T08:39:10.704 INFO:tasks.workunit.client.1.smithi181.stdout:2/205: dwrite d13/f39 [0,4194304] 0 2024-04-03T08:39:10.706 INFO:tasks.workunit.client.1.smithi181.stdout:0/155: rename d5/dc/f23 to d5/d9/d2c/f2d 0 2024-04-03T08:39:10.708 INFO:tasks.workunit.client.1.smithi181.stdout:0/156: write d5/d9/fd [489445,77251] 0 2024-04-03T08:39:10.721 INFO:tasks.workunit.client.0.smithi157.stdout:4/352: truncate da/df/d2f/d54/f65 2272554 0 2024-04-03T08:39:10.722 INFO:tasks.workunit.client.1.smithi181.stdout:1/142: dread d10/f16 [0,4194304] 0 2024-04-03T08:39:10.723 INFO:tasks.workunit.client.0.smithi157.stdout:0/358: dwrite d2/f37 [0,4194304] 0 2024-04-03T08:39:10.725 INFO:tasks.workunit.client.0.smithi157.stdout:8/349: creat d2/d11/d10/d24/d5b/d53/f79 x:0 0 0 2024-04-03T08:39:10.727 INFO:tasks.workunit.client.1.smithi181.stdout:0/157: dwrite d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:10.729 INFO:tasks.workunit.client.1.smithi181.stdout:6/174: dread d6/d7/d9/f1a [0,4194304] 0 2024-04-03T08:39:10.729 INFO:tasks.workunit.client.0.smithi157.stdout:8/350: write d2/d11/f1d [1118409,61926] 0 2024-04-03T08:39:10.732 INFO:tasks.workunit.client.0.smithi157.stdout:8/351: write d2/d20/d23/f6c [804457,128631] 0 2024-04-03T08:39:10.734 INFO:tasks.workunit.client.1.smithi181.stdout:6/175: truncate d6/f3a 483259 0 2024-04-03T08:39:10.734 INFO:tasks.workunit.client.1.smithi181.stdout:7/137: mknod d0/d1/d6/c30 0 2024-04-03T08:39:10.737 INFO:tasks.workunit.client.0.smithi157.stdout:0/359: dread d2/d9/d36/f3f [0,4194304] 0 2024-04-03T08:39:10.737 INFO:tasks.workunit.client.0.smithi157.stdout:5/379: unlink dc/d29/d56/d18/d21/l5c 0 2024-04-03T08:39:10.739 INFO:tasks.workunit.client.1.smithi181.stdout:9/233: symlink d1/da/d13/d22/d23/d36/l4f 0 2024-04-03T08:39:10.743 INFO:tasks.workunit.client.0.smithi157.stdout:6/384: mkdir d1/d5/d17/d29/d62/d7f 0 2024-04-03T08:39:10.745 INFO:tasks.workunit.client.1.smithi181.stdout:2/206: symlink d13/d22/d40/l55 0 2024-04-03T08:39:10.749 INFO:tasks.workunit.client.0.smithi157.stdout:9/329: mkdir d1/d36/d69 0 2024-04-03T08:39:10.753 INFO:tasks.workunit.client.0.smithi157.stdout:3/348: creat d8/d1e/f7a x:0 0 0 2024-04-03T08:39:10.754 INFO:tasks.workunit.client.1.smithi181.stdout:3/155: mkdir d0/d5/d6/d29 0 2024-04-03T08:39:10.757 INFO:tasks.workunit.client.0.smithi157.stdout:2/398: getdents d3/db/d44 0 2024-04-03T08:39:10.757 INFO:tasks.workunit.client.0.smithi157.stdout:0/360: dwrite d2/d9/d36/d38/d6c/f6e [4194304,4194304] 0 2024-04-03T08:39:10.758 INFO:tasks.workunit.client.1.smithi181.stdout:1/143: symlink d10/d15/l2e 0 2024-04-03T08:39:10.758 INFO:tasks.workunit.client.1.smithi181.stdout:0/158: mkdir d5/d9/d2e 0 2024-04-03T08:39:10.762 INFO:tasks.workunit.client.0.smithi157.stdout:4/353: unlink da/df/d24/d35/f52 0 2024-04-03T08:39:10.769 INFO:tasks.workunit.client.1.smithi181.stdout:3/156: dwrite d0/f3 [0,4194304] 0 2024-04-03T08:39:10.770 INFO:tasks.workunit.client.0.smithi157.stdout:3/349: dwrite d8/d1e/d2d/d39/f68 [0,4194304] 0 2024-04-03T08:39:10.771 INFO:tasks.workunit.client.1.smithi181.stdout:2/207: creat d13/d22/d40/f56 x:0 0 0 2024-04-03T08:39:10.772 INFO:tasks.workunit.client.1.smithi181.stdout:2/208: chown d13/d22/d40 929 1 2024-04-03T08:39:10.775 INFO:tasks.workunit.client.0.smithi157.stdout:6/385: mkdir d1/d5/d17/d29/d80 0 2024-04-03T08:39:10.778 INFO:tasks.workunit.client.1.smithi181.stdout:1/144: creat d10/d15/d17/d19/f2f x:0 0 0 2024-04-03T08:39:10.781 INFO:tasks.workunit.client.0.smithi157.stdout:2/399: mknod d3/d12/d43/d4b/d55/c89 0 2024-04-03T08:39:10.784 INFO:tasks.workunit.client.0.smithi157.stdout:2/400: chown d3/d12/f56 1 1 2024-04-03T08:39:10.790 INFO:tasks.workunit.client.1.smithi181.stdout:7/138: creat d0/d1/d6/de/d17/f31 x:0 0 0 2024-04-03T08:39:10.791 INFO:tasks.workunit.client.0.smithi157.stdout:0/361: rename d2/d9/d36/d38/d67/l7e to d2/d9/d36/d38/d67/l88 0 2024-04-03T08:39:10.792 INFO:tasks.workunit.client.1.smithi181.stdout:7/139: dread - d0/d1/d6/de/d17/d27/f28 zero size 2024-04-03T08:39:10.793 INFO:tasks.workunit.client.1.smithi181.stdout:4/168: sync 2024-04-03T08:39:10.799 INFO:tasks.workunit.client.0.smithi157.stdout:4/354: mkdir da/df/d24/d35/d6a/d78 0 2024-04-03T08:39:10.800 INFO:tasks.workunit.client.0.smithi157.stdout:6/386: dwrite d1/d5/d17/f4e [0,4194304] 0 2024-04-03T08:39:10.801 INFO:tasks.workunit.client.0.smithi157.stdout:0/362: chown d2/d9/dc/df/d1b/d4a/c27 7004093 1 2024-04-03T08:39:10.801 INFO:tasks.workunit.client.1.smithi181.stdout:9/234: creat d1/d34/d39/f50 x:0 0 0 2024-04-03T08:39:10.802 INFO:tasks.workunit.client.1.smithi181.stdout:6/176: truncate d6/d7/d9/f21 744375 0 2024-04-03T08:39:10.803 INFO:tasks.workunit.client.1.smithi181.stdout:9/235: write d1/da/d1a/f1f [34202,93862] 0 2024-04-03T08:39:10.803 INFO:tasks.workunit.client.1.smithi181.stdout:6/177: chown d6/d7/d9/fe 39 1 2024-04-03T08:39:10.806 INFO:tasks.workunit.client.0.smithi157.stdout:5/380: mkdir dc/d29/d56/d87 0 2024-04-03T08:39:10.807 INFO:tasks.workunit.client.1.smithi181.stdout:1/145: write f2 [2834819,4618] 0 2024-04-03T08:39:10.807 INFO:tasks.workunit.client.0.smithi157.stdout:4/355: readlink da/df/d24/l4e 0 2024-04-03T08:39:10.808 INFO:tasks.workunit.client.1.smithi181.stdout:1/146: write f4 [3538972,16531] 0 2024-04-03T08:39:10.809 INFO:tasks.workunit.client.0.smithi157.stdout:7/371: rename d0/d11/d15/d17/c69 to d0/c90 0 2024-04-03T08:39:10.810 INFO:tasks.workunit.client.0.smithi157.stdout:3/350: write d8/d13/f56 [352461,22194] 0 2024-04-03T08:39:10.811 INFO:tasks.workunit.client.1.smithi181.stdout:1/147: write d10/d15/d17/d23/d27/f2c [563420,60473] 0 2024-04-03T08:39:10.811 INFO:tasks.workunit.client.1.smithi181.stdout:0/159: mknod d5/d9/d2e/c2f 0 2024-04-03T08:39:10.813 INFO:tasks.workunit.client.1.smithi181.stdout:1/148: write f2 [1805690,13725] 0 2024-04-03T08:39:10.814 INFO:tasks.workunit.client.1.smithi181.stdout:0/160: truncate d5/d9/d13/f26 544159 0 2024-04-03T08:39:10.815 INFO:tasks.workunit.client.0.smithi157.stdout:4/356: chown da/df/d2f/d54/d5f 3518537 1 2024-04-03T08:39:10.815 INFO:tasks.workunit.client.0.smithi157.stdout:2/401: dwrite d3/db/f7b [0,4194304] 0 2024-04-03T08:39:10.815 INFO:tasks.workunit.client.1.smithi181.stdout:7/140: symlink d0/d1/l32 0 2024-04-03T08:39:10.818 INFO:tasks.workunit.client.1.smithi181.stdout:4/169: unlink d1/d16/f12 0 2024-04-03T08:39:10.822 INFO:tasks.workunit.client.0.smithi157.stdout:8/352: dwrite d2/d11/d10/d24/d5b/f49 [0,4194304] 0 2024-04-03T08:39:10.825 INFO:tasks.workunit.client.0.smithi157.stdout:1/298: sync 2024-04-03T08:39:10.826 INFO:tasks.workunit.client.1.smithi181.stdout:9/236: fsync d1/da/d1a/f1f 0 2024-04-03T08:39:10.831 INFO:tasks.workunit.client.0.smithi157.stdout:0/363: write d2/d9/d51/f7f [798774,125455] 0 2024-04-03T08:39:10.832 INFO:tasks.workunit.client.1.smithi181.stdout:9/237: read d1/f35 [458779,90085] 0 2024-04-03T08:39:10.833 INFO:tasks.workunit.client.1.smithi181.stdout:3/157: creat d0/d5/d6/d29/f2a x:0 0 0 2024-04-03T08:39:10.833 INFO:tasks.workunit.client.0.smithi157.stdout:3/351: truncate d8/d1e/d2d/d39/d51/d4c/f40 5145292 0 2024-04-03T08:39:10.835 INFO:tasks.workunit.client.1.smithi181.stdout:9/238: read - d1/d34/d39/f50 zero size 2024-04-03T08:39:10.837 INFO:tasks.workunit.client.0.smithi157.stdout:6/387: mkdir d1/d5/d17/d2a/d40/d81 0 2024-04-03T08:39:10.837 INFO:tasks.workunit.client.0.smithi157.stdout:1/299: write d2/d11/d23/f4d [3835056,130634] 0 2024-04-03T08:39:10.838 INFO:tasks.workunit.client.1.smithi181.stdout:3/158: fsync d0/d17/f26 0 2024-04-03T08:39:10.839 INFO:tasks.workunit.client.0.smithi157.stdout:0/364: chown d2/d9/f4f 46798 1 2024-04-03T08:39:10.839 INFO:tasks.workunit.client.0.smithi157.stdout:3/352: fsync d8/d1e/d2d/d39/f47 0 2024-04-03T08:39:10.841 INFO:tasks.workunit.client.1.smithi181.stdout:4/170: dread d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:10.841 INFO:tasks.workunit.client.1.smithi181.stdout:8/141: write d4/d6/db/fd [1061816,104317] 0 2024-04-03T08:39:10.841 INFO:tasks.workunit.client.0.smithi157.stdout:9/330: dread d1/d15/f1a [0,4194304] 0 2024-04-03T08:39:10.842 INFO:tasks.workunit.client.1.smithi181.stdout:2/209: creat d13/d1c/d4a/f57 x:0 0 0 2024-04-03T08:39:10.846 INFO:tasks.workunit.client.0.smithi157.stdout:5/381: symlink dc/d29/d56/d2e/l88 0 2024-04-03T08:39:10.847 INFO:tasks.workunit.client.1.smithi181.stdout:7/141: unlink d0/d1/lc 0 2024-04-03T08:39:10.847 INFO:tasks.workunit.client.0.smithi157.stdout:8/353: write d2/d11/d10/d24/d5b/d2e/f42 [3647054,76963] 0 2024-04-03T08:39:10.847 INFO:tasks.workunit.client.0.smithi157.stdout:6/388: read d1/d5/d17/d29/d62/f69 [1460042,89005] 0 2024-04-03T08:39:10.848 INFO:tasks.workunit.client.0.smithi157.stdout:7/372: mknod d0/d11/c91 0 2024-04-03T08:39:10.850 INFO:tasks.workunit.client.1.smithi181.stdout:0/161: mkdir d5/dc/d10/d30 0 2024-04-03T08:39:10.852 INFO:tasks.workunit.client.1.smithi181.stdout:6/178: dread d6/d7/d9/f19 [0,4194304] 0 2024-04-03T08:39:10.852 INFO:tasks.workunit.client.0.smithi157.stdout:1/300: rmdir d2/d11/d24/d39/d3b 39 2024-04-03T08:39:10.854 INFO:tasks.workunit.client.0.smithi157.stdout:4/357: dwrite da/df/d2f/f38 [4194304,4194304] 0 2024-04-03T08:39:10.854 INFO:tasks.workunit.client.0.smithi157.stdout:6/389: fsync d1/d5/d17/f56 0 2024-04-03T08:39:10.859 INFO:tasks.workunit.client.0.smithi157.stdout:4/358: read - da/df/f2a zero size 2024-04-03T08:39:10.861 INFO:tasks.workunit.client.0.smithi157.stdout:2/402: rename d3/d2e/d65/l69 to d3/db/d44/d4c/l8a 0 2024-04-03T08:39:10.862 INFO:tasks.workunit.client.0.smithi157.stdout:5/382: dread dc/d29/f46 [0,4194304] 0 2024-04-03T08:39:10.864 INFO:tasks.workunit.client.0.smithi157.stdout:4/359: write da/df/f2a [983323,99721] 0 2024-04-03T08:39:10.867 INFO:tasks.workunit.client.1.smithi181.stdout:9/239: creat d1/da/d13/d41/d32/f51 x:0 0 0 2024-04-03T08:39:10.868 INFO:tasks.workunit.client.0.smithi157.stdout:9/331: symlink d1/l6a 0 2024-04-03T08:39:10.869 INFO:tasks.workunit.client.1.smithi181.stdout:8/142: dread - d4/d6/db/f13 zero size 2024-04-03T08:39:10.870 INFO:tasks.workunit.client.1.smithi181.stdout:3/159: rename d0/c14 to d0/d5/d6/dd/d25/c2b 0 2024-04-03T08:39:10.871 INFO:tasks.workunit.client.1.smithi181.stdout:9/240: write d1/da/d13/d41/f26 [2342474,18261] 0 2024-04-03T08:39:10.872 INFO:tasks.workunit.client.1.smithi181.stdout:3/160: readlink d0/d5/d6/lc 0 2024-04-03T08:39:10.872 INFO:tasks.workunit.client.1.smithi181.stdout:9/241: stat d1/da/d13/d41/d32/f51 0 2024-04-03T08:39:10.873 INFO:tasks.workunit.client.1.smithi181.stdout:3/161: write d0/f3 [2764320,50410] 0 2024-04-03T08:39:10.874 INFO:tasks.workunit.client.1.smithi181.stdout:3/162: chown d0/d5/d16 0 1 2024-04-03T08:39:10.875 INFO:tasks.workunit.client.1.smithi181.stdout:4/171: truncate d1/d16/f13 3169030 0 2024-04-03T08:39:10.877 INFO:tasks.workunit.client.0.smithi157.stdout:1/301: dread - d2/d11/d24/d39/d3b/f56 zero size 2024-04-03T08:39:10.879 INFO:tasks.workunit.client.0.smithi157.stdout:1/302: write d2/d11/d23/f55 [3618028,78702] 0 2024-04-03T08:39:10.880 INFO:tasks.workunit.client.1.smithi181.stdout:6/179: mknod d6/c3b 0 2024-04-03T08:39:10.882 INFO:tasks.workunit.client.0.smithi157.stdout:1/303: chown d2/d11/d24/d39/d3b/d2e/d48/d58 2132683785 1 2024-04-03T08:39:10.922 INFO:tasks.workunit.client.1.smithi181.stdout:5/181: sync 2024-04-03T08:39:10.922 INFO:tasks.workunit.client.1.smithi181.stdout:5/182: dread - d4/d18/d25/f20 zero size 2024-04-03T08:39:10.922 INFO:tasks.workunit.client.1.smithi181.stdout:6/180: dread d6/f13 [0,4194304] 0 2024-04-03T08:39:10.922 INFO:tasks.workunit.client.1.smithi181.stdout:8/143: rmdir d4 39 2024-04-03T08:39:10.922 INFO:tasks.workunit.client.1.smithi181.stdout:9/242: mkdir d1/da/d28/d30/d3e/d52 0 2024-04-03T08:39:10.922 INFO:tasks.workunit.client.1.smithi181.stdout:2/210: truncate fe 1484447 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:3/163: chown d0/d5/d6/dd/d25/c2b 2932 1 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:5/183: rename d4/c11 to d4/d18/d2c/c36 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:0/162: truncate d5/fe 3849304 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:6/181: unlink d6/d7/c8 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:7/142: dwrite d0/d1/d6/f9 [0,4194304] 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:9/243: dread d1/da/f1e [0,4194304] 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.1.smithi181.stdout:8/144: chown d4/d6/d9 1 1 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.0.smithi157.stdout:7/373: rename d0/d11/d15/d17/f5e to d0/d5/f92 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.0.smithi157.stdout:6/390: write d1/d5/d17/f1d [462712,119820] 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.0.smithi157.stdout:5/383: mknod dc/d29/d56/d49/c89 0 2024-04-03T08:39:10.923 INFO:tasks.workunit.client.0.smithi157.stdout:5/384: write dc/d29/d56/d49/f6e [924174,82128] 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:4/360: creat da/df/d24/d35/d6a/f79 x:0 0 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:9/332: symlink d1/d4a/d4d/l6b 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:8/354: symlink d2/d11/d10/d24/d5b/l7a 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:3/353: creat d8/d1e/f7b x:0 0 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:3/354: truncate d8/fc 5233580 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:1/304: mknod d2/d11/d24/d39/d3b/d2e/d48/d58/c65 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:1/305: fdatasync d2/d11/d23/f55 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:8/355: dwrite d2/d11/d10/d24/d5b/d2e/f3f [0,4194304] 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:6/391: fsync d1/fb 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.0.smithi157.stdout:5/385: symlink dc/d29/d56/d49/d7f/l8a 0 2024-04-03T08:39:10.924 INFO:tasks.workunit.client.1.smithi181.stdout:1/149: getdents d10 0 2024-04-03T08:39:10.925 INFO:tasks.workunit.client.1.smithi181.stdout:1/150: read - d10/d15/d17/d19/f2f zero size 2024-04-03T08:39:10.926 INFO:tasks.workunit.client.0.smithi157.stdout:3/355: unlink d8/d13/f69 0 2024-04-03T08:39:10.927 INFO:tasks.workunit.client.1.smithi181.stdout:4/172: mkdir d1/d16/d1f/d31/d39 0 2024-04-03T08:39:10.931 INFO:tasks.workunit.client.0.smithi157.stdout:0/365: getdents d2/d9/d51/d63/d71 0 2024-04-03T08:39:10.932 INFO:tasks.workunit.client.1.smithi181.stdout:0/163: symlink d5/d9/d2c/l31 0 2024-04-03T08:39:10.932 INFO:tasks.workunit.client.0.smithi157.stdout:5/386: dread dc/f13 [0,4194304] 0 2024-04-03T08:39:10.935 INFO:tasks.workunit.client.1.smithi181.stdout:6/182: dwrite d6/d7/d9/fe [0,4194304] 0 2024-04-03T08:39:10.937 INFO:tasks.workunit.client.0.smithi157.stdout:8/356: rmdir d2/d11/d10/d24/d5b/d2e/d56 39 2024-04-03T08:39:10.937 INFO:tasks.workunit.client.1.smithi181.stdout:6/183: chown d6/d7/c10 52 1 2024-04-03T08:39:10.938 INFO:tasks.workunit.client.0.smithi157.stdout:6/392: dwrite d1/d5/d17/d2a/d37/f51 [0,4194304] 0 2024-04-03T08:39:10.938 INFO:tasks.workunit.client.0.smithi157.stdout:8/357: fdatasync d2/d20/f3b 0 2024-04-03T08:39:10.943 INFO:tasks.workunit.client.0.smithi157.stdout:8/358: stat d2/d11/d10/d24/l33 0 2024-04-03T08:39:10.947 INFO:tasks.workunit.client.0.smithi157.stdout:4/361: dwrite da/f31 [0,4194304] 0 2024-04-03T08:39:10.947 INFO:tasks.workunit.client.1.smithi181.stdout:1/151: mkdir d10/d15/d17/d30 0 2024-04-03T08:39:10.950 INFO:tasks.workunit.client.0.smithi157.stdout:7/374: creat d0/f93 x:0 0 0 2024-04-03T08:39:10.956 INFO:tasks.workunit.client.0.smithi157.stdout:3/356: mkdir d8/d13/d1b/d4e/d50/d7c 0 2024-04-03T08:39:10.956 INFO:tasks.workunit.client.1.smithi181.stdout:4/173: mkdir d1/d16/d1f/d31/d3a 0 2024-04-03T08:39:10.957 INFO:tasks.workunit.client.1.smithi181.stdout:4/174: dread - d1/f2f zero size 2024-04-03T08:39:10.959 INFO:tasks.workunit.client.0.smithi157.stdout:2/403: getdents d3/d12/d43/d4b 0 2024-04-03T08:39:10.960 INFO:tasks.workunit.client.1.smithi181.stdout:0/164: rmdir d5/dc 39 2024-04-03T08:39:10.962 INFO:tasks.workunit.client.0.smithi157.stdout:0/366: symlink d2/d9/d36/l89 0 2024-04-03T08:39:10.965 INFO:tasks.workunit.client.0.smithi157.stdout:5/387: symlink dc/d29/d56/d49/d53/l8b 0 2024-04-03T08:39:10.966 INFO:tasks.workunit.client.1.smithi181.stdout:9/244: dread d1/da/d13/d41/d32/f3f [0,4194304] 0 2024-04-03T08:39:10.967 INFO:tasks.workunit.client.1.smithi181.stdout:8/145: creat d4/d6/db/d16/d1c/f2b x:0 0 0 2024-04-03T08:39:10.970 INFO:tasks.workunit.client.1.smithi181.stdout:3/164: creat d0/d5/f2c x:0 0 0 2024-04-03T08:39:10.973 INFO:tasks.workunit.client.1.smithi181.stdout:4/175: symlink d1/d16/d37/d34/l3b 0 2024-04-03T08:39:10.973 INFO:tasks.workunit.client.1.smithi181.stdout:7/143: write d0/d1/f21 [132088,75794] 0 2024-04-03T08:39:10.974 INFO:tasks.workunit.client.0.smithi157.stdout:8/359: fdatasync d2/d20/f3c 0 2024-04-03T08:39:10.975 INFO:tasks.workunit.client.1.smithi181.stdout:7/144: stat d0/d1/d6/f9 0 2024-04-03T08:39:10.978 INFO:tasks.workunit.client.1.smithi181.stdout:9/245: mkdir d1/da/d28/d30/d3e/d53 0 2024-04-03T08:39:10.979 INFO:tasks.workunit.client.1.smithi181.stdout:9/246: read d1/d34/f37 [86787,41148] 0 2024-04-03T08:39:10.980 INFO:tasks.workunit.client.0.smithi157.stdout:7/375: creat d0/d11/d15/d17/d43/d8a/f94 x:0 0 0 2024-04-03T08:39:10.981 INFO:tasks.workunit.client.0.smithi157.stdout:7/376: chown d0/d11/d15/d1b/f39 1 1 2024-04-03T08:39:10.982 INFO:tasks.workunit.client.1.smithi181.stdout:9/247: write d1/da/d13/d41/d32/f51 [216426,83398] 0 2024-04-03T08:39:10.984 INFO:tasks.workunit.client.1.smithi181.stdout:8/146: rename d4/d6/db/d16/f23 to d4/d6/db/d16/d1c/f2c 0 2024-04-03T08:39:10.986 INFO:tasks.workunit.client.0.smithi157.stdout:3/357: rmdir d8/d1e 39 2024-04-03T08:39:10.987 INFO:tasks.workunit.client.1.smithi181.stdout:0/165: dread d5/dc/f1e [0,4194304] 0 2024-04-03T08:39:10.988 INFO:tasks.workunit.client.0.smithi157.stdout:2/404: dread d3/db/d44/f71 [0,4194304] 0 2024-04-03T08:39:10.988 INFO:tasks.workunit.client.1.smithi181.stdout:9/248: dread d1/da/d13/d22/f42 [0,4194304] 0 2024-04-03T08:39:10.991 INFO:tasks.workunit.client.0.smithi157.stdout:0/367: rmdir d2/d9/dc/df/d1b/d35/d3d 39 2024-04-03T08:39:10.996 INFO:tasks.workunit.client.0.smithi157.stdout:9/333: rename d1/c12 to d1/c6c 0 2024-04-03T08:39:11.002 INFO:tasks.workunit.client.0.smithi157.stdout:8/360: write d2/d20/f3c [457224,22854] 0 2024-04-03T08:39:11.004 INFO:tasks.workunit.client.0.smithi157.stdout:4/362: creat da/df/d24/d35/d6a/d78/f7a x:0 0 0 2024-04-03T08:39:11.005 INFO:tasks.workunit.client.0.smithi157.stdout:7/377: creat d0/d11/d15/d35/f95 x:0 0 0 2024-04-03T08:39:11.006 INFO:tasks.workunit.client.1.smithi181.stdout:3/165: unlink d0/cb 0 2024-04-03T08:39:11.009 INFO:tasks.workunit.client.0.smithi157.stdout:2/405: creat d3/db/d44/d4c/d5a/f8b x:0 0 0 2024-04-03T08:39:11.011 INFO:tasks.workunit.client.1.smithi181.stdout:9/249: dread d1/da/f21 [0,4194304] 0 2024-04-03T08:39:11.012 INFO:tasks.workunit.client.1.smithi181.stdout:7/145: symlink d0/d1/d6/l33 0 2024-04-03T08:39:11.013 INFO:tasks.workunit.client.1.smithi181.stdout:7/146: stat d0/d1/d6/de/d17/f31 0 2024-04-03T08:39:11.015 INFO:tasks.workunit.client.1.smithi181.stdout:8/147: dread d4/d2a/f29 [0,4194304] 0 2024-04-03T08:39:11.016 INFO:tasks.workunit.client.0.smithi157.stdout:9/334: readlink d1/d15/d16/l3c 0 2024-04-03T08:39:11.018 INFO:tasks.workunit.client.0.smithi157.stdout:6/393: rename d1/ff to d1/d5/d17/d2a/f82 0 2024-04-03T08:39:11.023 INFO:tasks.workunit.client.1.smithi181.stdout:3/166: rmdir d0/d5/d6/dd/d25 39 2024-04-03T08:39:11.024 INFO:tasks.workunit.client.1.smithi181.stdout:3/167: read d0/f3 [2161194,114634] 0 2024-04-03T08:39:11.025 INFO:tasks.workunit.client.0.smithi157.stdout:7/378: dwrite d0/d5/f62 [0,4194304] 0 2024-04-03T08:39:11.025 INFO:tasks.workunit.client.1.smithi181.stdout:3/168: write d0/d5/f2c [891837,10846] 0 2024-04-03T08:39:11.027 INFO:tasks.workunit.client.0.smithi157.stdout:3/358: dwrite d8/d1e/d2d/d39/d51/d48/f63 [0,4194304] 0 2024-04-03T08:39:11.031 INFO:tasks.workunit.client.0.smithi157.stdout:5/388: creat dc/f8c x:0 0 0 2024-04-03T08:39:11.032 INFO:tasks.workunit.client.1.smithi181.stdout:7/147: mknod d0/d1/d6/de/c34 0 2024-04-03T08:39:11.034 INFO:tasks.workunit.client.0.smithi157.stdout:6/394: creat d1/d4b/d38/d59/f83 x:0 0 0 2024-04-03T08:39:11.036 INFO:tasks.workunit.client.0.smithi157.stdout:8/361: mkdir d2/d7b 0 2024-04-03T08:39:11.037 INFO:tasks.workunit.client.1.smithi181.stdout:0/166: truncate d5/dc/f1e 3693663 0 2024-04-03T08:39:11.043 INFO:tasks.workunit.client.0.smithi157.stdout:0/368: creat d2/d9/dc/df/f8a x:0 0 0 2024-04-03T08:39:11.046 INFO:tasks.workunit.client.0.smithi157.stdout:2/406: creat d3/db/d44/d4c/d5a/d88/f8c x:0 0 0 2024-04-03T08:39:11.046 INFO:tasks.workunit.client.1.smithi181.stdout:4/176: getdents d1/d16/d37/d34 0 2024-04-03T08:39:11.048 INFO:tasks.workunit.client.1.smithi181.stdout:8/148: link d4/d6/db/d16/f22 d4/d6/db/d14/f2d 0 2024-04-03T08:39:11.049 INFO:tasks.workunit.client.1.smithi181.stdout:4/177: truncate d1/d1e/f1a 2334642 0 2024-04-03T08:39:11.049 INFO:tasks.workunit.client.0.smithi157.stdout:9/335: link d1/d15/d16/f23 d1/d15/d27/d34/f6d 0 2024-04-03T08:39:11.051 INFO:tasks.workunit.client.0.smithi157.stdout:5/389: mknod dc/d29/d56/d49/d53/d6c/c8d 0 2024-04-03T08:39:11.054 INFO:tasks.workunit.client.0.smithi157.stdout:8/362: unlink d2/d11/d10/c55 0 2024-04-03T08:39:11.055 INFO:tasks.workunit.client.0.smithi157.stdout:0/369: creat d2/d9/dc/df/d1b/f8b x:0 0 0 2024-04-03T08:39:11.055 INFO:tasks.workunit.client.1.smithi181.stdout:9/250: dread d1/da/f12 [0,4194304] 0 2024-04-03T08:39:11.056 INFO:tasks.workunit.client.1.smithi181.stdout:0/167: dwrite d5/d9/d13/f15 [0,4194304] 0 2024-04-03T08:39:11.057 INFO:tasks.workunit.client.0.smithi157.stdout:0/370: dread - d2/d9/dc/df/d1b/f8b zero size 2024-04-03T08:39:11.058 INFO:tasks.workunit.client.1.smithi181.stdout:4/178: getdents d1/d16/d37/d34 0 2024-04-03T08:39:11.059 INFO:tasks.workunit.client.1.smithi181.stdout:9/251: write d1/da/d13/d41/f1b [848021,115100] 0 2024-04-03T08:39:11.059 INFO:tasks.workunit.client.0.smithi157.stdout:2/407: mknod d3/db/d44/d4c/d5a/d88/c8d 0 2024-04-03T08:39:11.065 INFO:tasks.workunit.client.0.smithi157.stdout:6/395: symlink d1/l84 0 2024-04-03T08:39:11.067 INFO:tasks.workunit.client.0.smithi157.stdout:8/363: rename d2/d11/d10/d24/d5b/d2e/f42 to d2/d6f/f7c 0 2024-04-03T08:39:11.067 INFO:tasks.workunit.client.0.smithi157.stdout:5/390: write dc/d29/d56/f68 [608134,2255] 0 2024-04-03T08:39:11.071 INFO:tasks.workunit.client.0.smithi157.stdout:9/336: creat d1/d36/d69/f6e x:0 0 0 2024-04-03T08:39:11.075 INFO:tasks.workunit.client.0.smithi157.stdout:9/337: symlink d1/d15/d27/d5c/l6f 0 2024-04-03T08:39:11.077 INFO:tasks.workunit.client.0.smithi157.stdout:6/396: getdents d1/d5/d17/d29/d62/d7f 0 2024-04-03T08:39:11.080 INFO:tasks.workunit.client.0.smithi157.stdout:0/371: getdents d2 0 2024-04-03T08:39:11.080 INFO:tasks.workunit.client.0.smithi157.stdout:9/338: write d1/d15/f2d [568803,23075] 0 2024-04-03T08:39:11.082 INFO:tasks.workunit.client.0.smithi157.stdout:2/408: getdents d3/d2e 0 2024-04-03T08:39:11.084 INFO:tasks.workunit.client.0.smithi157.stdout:6/397: mkdir d1/d5/d17/d2a/d85 0 2024-04-03T08:39:11.085 INFO:tasks.workunit.client.1.smithi181.stdout:0/168: dread d5/dc/f12 [0,4194304] 0 2024-04-03T08:39:11.086 INFO:tasks.workunit.client.0.smithi157.stdout:2/409: dread - d3/d2e/d65/f7f zero size 2024-04-03T08:39:11.089 INFO:tasks.workunit.client.0.smithi157.stdout:6/398: chown d1/d5/d17/f64 230510 1 2024-04-03T08:39:11.089 INFO:tasks.workunit.client.1.smithi181.stdout:0/169: creat d5/d9/f32 x:0 0 0 2024-04-03T08:39:11.092 INFO:tasks.workunit.client.0.smithi157.stdout:5/391: dwrite dc/f8c [0,4194304] 0 2024-04-03T08:39:11.094 INFO:tasks.workunit.client.0.smithi157.stdout:8/364: dwrite d2/d11/d10/d24/d5b/f4b [0,4194304] 0 2024-04-03T08:39:11.095 INFO:tasks.workunit.client.1.smithi181.stdout:0/170: symlink d5/dc/d10/d30/l33 0 2024-04-03T08:39:11.095 INFO:tasks.workunit.client.0.smithi157.stdout:9/339: rename d1/d15/l38 to d1/l70 0 2024-04-03T08:39:11.101 INFO:tasks.workunit.client.0.smithi157.stdout:9/340: write d1/d15/f43 [902686,20659] 0 2024-04-03T08:39:11.101 INFO:tasks.workunit.client.0.smithi157.stdout:8/365: truncate d2/d11/d10/d24/d5b/d2e/f31 499162 0 2024-04-03T08:39:11.102 INFO:tasks.workunit.client.0.smithi157.stdout:2/410: rename d3/d12/l40 to d3/d2e/d32/l8e 0 2024-04-03T08:39:11.104 INFO:tasks.workunit.client.0.smithi157.stdout:6/399: creat d1/d5/d17/d2a/f86 x:0 0 0 2024-04-03T08:39:11.105 INFO:tasks.workunit.client.0.smithi157.stdout:2/411: symlink d3/db/l8f 0 2024-04-03T08:39:11.107 INFO:tasks.workunit.client.1.smithi181.stdout:0/171: dread d5/dc/f21 [4194304,4194304] 0 2024-04-03T08:39:11.109 INFO:tasks.workunit.client.0.smithi157.stdout:6/400: unlink d1/d4b/f57 0 2024-04-03T08:39:11.111 INFO:tasks.workunit.client.0.smithi157.stdout:2/412: creat d3/d2e/f90 x:0 0 0 2024-04-03T08:39:11.113 INFO:tasks.workunit.client.0.smithi157.stdout:6/401: truncate d1/d22/f26 4684165 0 2024-04-03T08:39:11.115 INFO:tasks.workunit.client.0.smithi157.stdout:8/366: rename d2/d11/d10/d24/d5b/d2e/f31 to d2/d11/d10/d24/d5b/d2e/f7d 0 2024-04-03T08:39:11.117 INFO:tasks.workunit.client.0.smithi157.stdout:5/392: dwrite dc/d29/d56/d49/d53/d6c/f6f [0,4194304] 0 2024-04-03T08:39:11.120 INFO:tasks.workunit.client.0.smithi157.stdout:8/367: write d2/d11/d10/d24/d5b/d2e/d75/f76 [502136,110031] 0 2024-04-03T08:39:11.122 INFO:tasks.workunit.client.0.smithi157.stdout:6/402: unlink d1/d4b/d38/d59/l6f 0 2024-04-03T08:39:11.127 INFO:tasks.workunit.client.0.smithi157.stdout:8/368: unlink d2/d11/l4d 0 2024-04-03T08:39:11.132 INFO:tasks.workunit.client.0.smithi157.stdout:2/413: dwrite d3/db/d44/d4c/d5a/f5f [0,4194304] 0 2024-04-03T08:39:11.133 INFO:tasks.workunit.client.0.smithi157.stdout:6/403: rename d1/d5/d17/d2a/d40/d4f to d1/d5/d17/d29/d87 0 2024-04-03T08:39:11.138 INFO:tasks.workunit.client.0.smithi157.stdout:4/363: truncate da/df/d2f/f38 1779591 0 2024-04-03T08:39:11.139 INFO:tasks.workunit.client.0.smithi157.stdout:2/414: rmdir d3/db/d44 39 2024-04-03T08:39:11.141 INFO:tasks.workunit.client.0.smithi157.stdout:8/369: dread d2/f39 [0,4194304] 0 2024-04-03T08:39:11.145 INFO:tasks.workunit.client.1.smithi181.stdout:8/149: getdents d4/d6/db/d14 0 2024-04-03T08:39:11.146 INFO:tasks.workunit.client.0.smithi157.stdout:6/404: symlink d1/d5/d17/d29/d80/l88 0 2024-04-03T08:39:11.148 INFO:tasks.workunit.client.0.smithi157.stdout:4/364: creat da/df/d2f/d64/f7b x:0 0 0 2024-04-03T08:39:11.150 INFO:tasks.workunit.client.0.smithi157.stdout:8/370: creat d2/d6f/d70/f7e x:0 0 0 2024-04-03T08:39:11.152 INFO:tasks.workunit.client.0.smithi157.stdout:8/371: chown d2/d6f/f7c 7 1 2024-04-03T08:39:11.152 INFO:tasks.workunit.client.0.smithi157.stdout:6/405: fdatasync d1/f3 0 2024-04-03T08:39:11.153 INFO:tasks.workunit.client.0.smithi157.stdout:7/379: truncate d0/d4/f65 3752599 0 2024-04-03T08:39:11.156 INFO:tasks.workunit.client.0.smithi157.stdout:4/365: creat da/df/d24/d58/f7c x:0 0 0 2024-04-03T08:39:11.160 INFO:tasks.workunit.client.1.smithi181.stdout:4/179: write d1/d16/f13 [998276,65353] 0 2024-04-03T08:39:11.161 INFO:tasks.workunit.client.1.smithi181.stdout:4/180: chown d1/d16/f18 171714 1 2024-04-03T08:39:11.162 INFO:tasks.workunit.client.1.smithi181.stdout:8/150: creat d4/d6/f2e x:0 0 0 2024-04-03T08:39:11.165 INFO:tasks.workunit.client.1.smithi181.stdout:3/169: link d0/d5/d16/d1e/l20 d0/d5/d6/l2d 0 2024-04-03T08:39:11.166 INFO:tasks.workunit.client.0.smithi157.stdout:1/306: sync 2024-04-03T08:39:11.167 INFO:tasks.workunit.client.1.smithi181.stdout:4/181: creat d1/d16/d1f/f3c x:0 0 0 2024-04-03T08:39:11.169 INFO:tasks.workunit.client.1.smithi181.stdout:4/182: write d1/f32 [1250861,5696] 0 2024-04-03T08:39:11.170 INFO:tasks.workunit.client.1.smithi181.stdout:8/151: creat d4/d6/db/d16/d1c/f2f x:0 0 0 2024-04-03T08:39:11.170 INFO:tasks.workunit.client.1.smithi181.stdout:4/183: stat d1/d16/d24/c26 0 2024-04-03T08:39:11.174 INFO:tasks.workunit.client.0.smithi157.stdout:1/307: mkdir d2/d11/d24/d39/d3b/d2e/d66 0 2024-04-03T08:39:11.176 INFO:tasks.workunit.client.0.smithi157.stdout:7/380: dread d0/f20 [0,4194304] 0 2024-04-03T08:39:11.176 INFO:tasks.workunit.client.0.smithi157.stdout:8/372: dwrite d2/d11/f51 [0,4194304] 0 2024-04-03T08:39:11.176 INFO:tasks.workunit.client.0.smithi157.stdout:4/366: getdents da/df/d24/d58/d68 0 2024-04-03T08:39:11.179 INFO:tasks.workunit.client.1.smithi181.stdout:8/152: creat d4/d6/db/d16/f30 x:0 0 0 2024-04-03T08:39:11.181 INFO:tasks.workunit.client.1.smithi181.stdout:2/211: sync 2024-04-03T08:39:11.181 INFO:tasks.workunit.client.1.smithi181.stdout:5/184: sync 2024-04-03T08:39:11.181 INFO:tasks.workunit.client.0.smithi157.stdout:0/372: dwrite d2/f15 [0,4194304] 0 2024-04-03T08:39:11.182 INFO:tasks.workunit.client.0.smithi157.stdout:8/373: write d2/d11/d10/d24/d5b/d2e/f64 [4297693,68526] 0 2024-04-03T08:39:11.184 INFO:tasks.workunit.client.0.smithi157.stdout:1/308: unlink d2/d11/d23/f55 0 2024-04-03T08:39:11.185 INFO:tasks.workunit.client.1.smithi181.stdout:2/212: dread - d13/d22/d27/d46/f49 zero size 2024-04-03T08:39:11.186 INFO:tasks.workunit.client.1.smithi181.stdout:4/184: dwrite d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:11.190 INFO:tasks.workunit.client.1.smithi181.stdout:3/170: truncate d0/d5/d6/dd/f21 274659 0 2024-04-03T08:39:11.191 INFO:tasks.workunit.client.1.smithi181.stdout:0/172: write d5/dc/f12 [469042,10969] 0 2024-04-03T08:39:11.194 INFO:tasks.workunit.client.1.smithi181.stdout:5/185: mknod d4/d18/d25/c37 0 2024-04-03T08:39:11.195 INFO:tasks.workunit.client.1.smithi181.stdout:0/173: write f2 [874976,62198] 0 2024-04-03T08:39:11.196 INFO:tasks.workunit.client.0.smithi157.stdout:5/393: write dc/f11 [311504,86847] 0 2024-04-03T08:39:11.201 INFO:tasks.workunit.client.1.smithi181.stdout:2/213: symlink d13/d22/d27/d2f/l58 0 2024-04-03T08:39:11.203 INFO:tasks.workunit.client.0.smithi157.stdout:7/381: mkdir d0/d4/d8e/d96 0 2024-04-03T08:39:11.204 INFO:tasks.workunit.client.0.smithi157.stdout:8/374: dread d2/d11/d10/d24/d5b/f4b [0,4194304] 0 2024-04-03T08:39:11.205 INFO:tasks.workunit.client.0.smithi157.stdout:5/394: write dc/d29/f4a [797364,112650] 0 2024-04-03T08:39:11.210 INFO:tasks.workunit.client.0.smithi157.stdout:5/395: fdatasync dc/d29/d43/f66 0 2024-04-03T08:39:11.211 INFO:tasks.workunit.client.1.smithi181.stdout:4/185: symlink d1/d16/d1f/d31/d39/l3d 0 2024-04-03T08:39:11.212 INFO:tasks.workunit.client.0.smithi157.stdout:0/373: dwrite d2/d9/dc/df/d1b/f8b [0,4194304] 0 2024-04-03T08:39:11.217 INFO:tasks.workunit.client.0.smithi157.stdout:7/382: write d0/d11/d15/d1b/f57 [51545,48287] 0 2024-04-03T08:39:11.218 INFO:tasks.workunit.client.0.smithi157.stdout:8/375: fsync d2/d11/d10/d24/d5b/d2e/d75/f76 0 2024-04-03T08:39:11.220 INFO:tasks.workunit.client.0.smithi157.stdout:8/376: stat d2/d20/c67 0 2024-04-03T08:39:11.225 INFO:tasks.workunit.client.0.smithi157.stdout:7/383: chown d0/d5/l3c 0 1 2024-04-03T08:39:11.225 INFO:tasks.workunit.client.1.smithi181.stdout:3/171: dwrite d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:11.228 INFO:tasks.workunit.client.1.smithi181.stdout:2/214: creat d13/f59 x:0 0 0 2024-04-03T08:39:11.229 INFO:tasks.workunit.client.1.smithi181.stdout:4/186: dread d1/d16/f17 [0,4194304] 0 2024-04-03T08:39:11.231 INFO:tasks.workunit.client.1.smithi181.stdout:1/152: sync 2024-04-03T08:39:11.231 INFO:tasks.workunit.client.1.smithi181.stdout:9/252: sync 2024-04-03T08:39:11.231 INFO:tasks.workunit.client.1.smithi181.stdout:6/184: sync 2024-04-03T08:39:11.232 INFO:tasks.workunit.client.1.smithi181.stdout:7/148: sync 2024-04-03T08:39:11.232 INFO:tasks.workunit.client.0.smithi157.stdout:7/384: chown d0/d11/d15/d35/f95 1695 1 2024-04-03T08:39:11.234 INFO:tasks.workunit.client.1.smithi181.stdout:9/253: chown d1/da/d1a 1350920 1 2024-04-03T08:39:11.235 INFO:tasks.workunit.client.0.smithi157.stdout:7/385: chown d0/d11/d15/f1f 1 1 2024-04-03T08:39:11.238 INFO:tasks.workunit.client.1.smithi181.stdout:6/185: chown d6/l24 3786635 1 2024-04-03T08:39:11.238 INFO:tasks.workunit.client.1.smithi181.stdout:1/153: write d10/d15/f18 [123292,55705] 0 2024-04-03T08:39:11.238 INFO:tasks.workunit.client.1.smithi181.stdout:6/186: fdatasync d6/d7/d9/fa 0 2024-04-03T08:39:11.238 INFO:tasks.workunit.client.1.smithi181.stdout:7/149: dread - d0/d1/d6/de/d17/f1b zero size 2024-04-03T08:39:11.239 INFO:tasks.workunit.client.0.smithi157.stdout:8/377: fdatasync d2/d20/f29 0 2024-04-03T08:39:11.240 INFO:tasks.workunit.client.1.smithi181.stdout:3/172: creat d0/d17/f2e x:0 0 0 2024-04-03T08:39:11.241 INFO:tasks.workunit.client.1.smithi181.stdout:6/187: dread - d6/d7/f38 zero size 2024-04-03T08:39:11.243 INFO:tasks.workunit.client.1.smithi181.stdout:8/153: rename d4/d6/db/d16 to d4/d6/db/d14/d31 0 2024-04-03T08:39:11.244 INFO:tasks.workunit.client.1.smithi181.stdout:5/186: dread d4/d18/f28 [0,4194304] 0 2024-04-03T08:39:11.244 INFO:tasks.workunit.client.1.smithi181.stdout:3/173: write d0/d5/d16/d1e/f28 [904000,58600] 0 2024-04-03T08:39:11.245 INFO:tasks.workunit.client.0.smithi157.stdout:8/378: truncate d2/d20/d23/f6c 1938122 0 2024-04-03T08:39:11.248 INFO:tasks.workunit.client.0.smithi157.stdout:0/374: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:11.248 INFO:tasks.workunit.client.1.smithi181.stdout:5/187: write d4/d22/f26 [3459054,43136] 0 2024-04-03T08:39:11.251 INFO:tasks.workunit.client.0.smithi157.stdout:7/386: symlink d0/d11/d15/d17/d1c/d4f/l97 0 2024-04-03T08:39:11.251 INFO:tasks.workunit.client.0.smithi157.stdout:0/375: fsync d2/d9/d36/f80 0 2024-04-03T08:39:11.251 INFO:tasks.workunit.client.0.smithi157.stdout:1/309: read d2/d11/d24/d39/d3b/d1b/f4e [3515007,4703] 0 2024-04-03T08:39:11.253 INFO:tasks.workunit.client.0.smithi157.stdout:8/379: creat d2/d20/d77/f7f x:0 0 0 2024-04-03T08:39:11.254 INFO:tasks.workunit.client.1.smithi181.stdout:4/187: creat d1/d16/d1f/f3e x:0 0 0 2024-04-03T08:39:11.256 INFO:tasks.workunit.client.0.smithi157.stdout:1/310: mkdir d2/d11/d24/d67 0 2024-04-03T08:39:11.257 INFO:tasks.workunit.client.1.smithi181.stdout:4/188: chown d1/d16/d24/c38 111887 1 2024-04-03T08:39:11.258 INFO:tasks.workunit.client.0.smithi157.stdout:4/367: truncate da/df/d2f/f4f 916986 0 2024-04-03T08:39:11.261 INFO:tasks.workunit.client.1.smithi181.stdout:4/189: stat d1/d16/d37/d34/f35 0 2024-04-03T08:39:11.262 INFO:tasks.workunit.client.1.smithi181.stdout:9/254: dread d1/f35 [0,4194304] 0 2024-04-03T08:39:11.263 INFO:tasks.workunit.client.1.smithi181.stdout:4/190: dread - d1/d16/f23 zero size 2024-04-03T08:39:11.263 INFO:tasks.workunit.client.1.smithi181.stdout:1/154: symlink d10/d15/l31 0 2024-04-03T08:39:11.264 INFO:tasks.workunit.client.1.smithi181.stdout:3/174: dread d0/d5/d6/dd/f24 [0,4194304] 0 2024-04-03T08:39:11.265 INFO:tasks.workunit.client.1.smithi181.stdout:1/155: fdatasync f4 0 2024-04-03T08:39:11.265 INFO:tasks.workunit.client.0.smithi157.stdout:0/376: creat d2/d9/dc/d54/f8c x:0 0 0 2024-04-03T08:39:11.269 INFO:tasks.workunit.client.1.smithi181.stdout:6/188: creat d6/d7/d9/d22/f3c x:0 0 0 2024-04-03T08:39:11.270 INFO:tasks.workunit.client.1.smithi181.stdout:8/154: symlink d4/d6/db/d14/l32 0 2024-04-03T08:39:11.271 INFO:tasks.workunit.client.1.smithi181.stdout:1/156: write d10/d15/d17/d19/f2f [959953,107152] 0 2024-04-03T08:39:11.272 INFO:tasks.workunit.client.1.smithi181.stdout:2/215: dwrite d13/d1c/d4a/f4d [0,4194304] 0 2024-04-03T08:39:11.276 INFO:tasks.workunit.client.1.smithi181.stdout:6/189: write d6/d7/d9/f15 [3371370,78089] 0 2024-04-03T08:39:11.276 INFO:tasks.workunit.client.1.smithi181.stdout:5/188: creat d4/d22/f38 x:0 0 0 2024-04-03T08:39:11.282 INFO:tasks.workunit.client.0.smithi157.stdout:5/396: dwrite dc/f13 [0,4194304] 0 2024-04-03T08:39:11.287 INFO:tasks.workunit.client.0.smithi157.stdout:5/397: fsync dc/d29/f5f 0 2024-04-03T08:39:11.287 INFO:tasks.workunit.client.1.smithi181.stdout:0/174: dwrite d5/d9/f28 [0,4194304] 0 2024-04-03T08:39:11.288 INFO:tasks.workunit.client.0.smithi157.stdout:4/368: dwrite da/d26/f5e [0,4194304] 0 2024-04-03T08:39:11.289 INFO:tasks.workunit.client.1.smithi181.stdout:7/150: symlink d0/d1/d6/l35 0 2024-04-03T08:39:11.291 INFO:tasks.workunit.client.1.smithi181.stdout:7/151: dread - d0/d1/d6/de/f2a zero size 2024-04-03T08:39:11.293 INFO:tasks.workunit.client.1.smithi181.stdout:9/255: mkdir d1/da/d13/d22/d23/d54 0 2024-04-03T08:39:11.294 INFO:tasks.workunit.client.0.smithi157.stdout:8/380: creat d2/d11/d10/d24/d5b/d2e/f80 x:0 0 0 2024-04-03T08:39:11.294 INFO:tasks.workunit.client.0.smithi157.stdout:5/398: read dc/d29/d43/f69 [1529589,79195] 0 2024-04-03T08:39:11.294 INFO:tasks.workunit.client.1.smithi181.stdout:1/157: dread d10/f16 [0,4194304] 0 2024-04-03T08:39:11.295 INFO:tasks.workunit.client.1.smithi181.stdout:3/175: creat d0/d17/f2f x:0 0 0 2024-04-03T08:39:11.299 INFO:tasks.workunit.client.1.smithi181.stdout:2/216: dread f12 [0,4194304] 0 2024-04-03T08:39:11.300 INFO:tasks.workunit.client.1.smithi181.stdout:7/152: fsync d0/d1/d6/de/d17/d27/f28 0 2024-04-03T08:39:11.305 INFO:tasks.workunit.client.0.smithi157.stdout:5/399: fsync dc/d29/f46 0 2024-04-03T08:39:11.306 INFO:tasks.workunit.client.1.smithi181.stdout:0/175: readlink d5/dc/d14/l16 0 2024-04-03T08:39:11.307 INFO:tasks.workunit.client.0.smithi157.stdout:5/400: dread - dc/d29/d56/d18/f37 zero size 2024-04-03T08:39:11.310 INFO:tasks.workunit.client.0.smithi157.stdout:8/381: unlink d2/d11/d10/d24/d5b/d2e/f7d 0 2024-04-03T08:39:11.316 INFO:tasks.workunit.client.0.smithi157.stdout:5/401: unlink dc/l24 0 2024-04-03T08:39:11.317 INFO:tasks.workunit.client.1.smithi181.stdout:4/191: dread d1/fb [0,4194304] 0 2024-04-03T08:39:11.319 INFO:tasks.workunit.client.0.smithi157.stdout:8/382: mkdir d2/d11/d10/d24/d5b/d2e/d75/d81 0 2024-04-03T08:39:11.319 INFO:tasks.workunit.client.1.smithi181.stdout:3/176: dread d0/d5/f2c [0,4194304] 0 2024-04-03T08:39:11.320 INFO:tasks.workunit.client.0.smithi157.stdout:0/377: write d2/d9/dc/df/d1b/d4a/f2f [367034,123021] 0 2024-04-03T08:39:11.320 INFO:tasks.workunit.client.1.smithi181.stdout:4/192: chown d1/d1e/f1c 251706 1 2024-04-03T08:39:11.321 INFO:tasks.workunit.client.0.smithi157.stdout:1/311: truncate d2/d11/d23/f4f 1478050 0 2024-04-03T08:39:11.323 INFO:tasks.workunit.client.0.smithi157.stdout:7/387: dwrite d0/d11/d15/d17/d43/d8a/d8f/f78 [0,4194304] 0 2024-04-03T08:39:11.324 INFO:tasks.workunit.client.1.smithi181.stdout:7/153: unlink d0/d1/f19 0 2024-04-03T08:39:11.326 INFO:tasks.workunit.client.0.smithi157.stdout:5/402: creat dc/d29/d56/d49/d53/d6c/f8e x:0 0 0 2024-04-03T08:39:11.327 INFO:tasks.workunit.client.0.smithi157.stdout:5/403: stat dc/d29/d56 0 2024-04-03T08:39:11.329 INFO:tasks.workunit.client.0.smithi157.stdout:5/404: chown dc/d29/d56/f68 370917321 1 2024-04-03T08:39:11.330 INFO:tasks.workunit.client.1.smithi181.stdout:6/190: rename d6/d7/d9/fe to d6/d31/d36/f3d 0 2024-04-03T08:39:11.331 INFO:tasks.workunit.client.0.smithi157.stdout:8/383: rmdir d2/d20/d23 39 2024-04-03T08:39:11.334 INFO:tasks.workunit.client.0.smithi157.stdout:8/384: chown d2/d11/d10/f48 106 1 2024-04-03T08:39:11.336 INFO:tasks.workunit.client.0.smithi157.stdout:1/312: rename d2/d11/d23/l3c to d2/l68 0 2024-04-03T08:39:11.338 INFO:tasks.workunit.client.0.smithi157.stdout:8/385: write d2/d11/f1d [4824886,57465] 0 2024-04-03T08:39:11.339 INFO:tasks.workunit.client.0.smithi157.stdout:0/378: dwrite d2/f50 [0,4194304] 0 2024-04-03T08:39:11.340 INFO:tasks.workunit.client.1.smithi181.stdout:1/158: symlink d10/d15/d17/d23/l32 0 2024-04-03T08:39:11.342 INFO:tasks.workunit.client.1.smithi181.stdout:1/159: dread - d10/d15/d17/f21 zero size 2024-04-03T08:39:11.343 INFO:tasks.workunit.client.1.smithi181.stdout:1/160: chown d10/f11 1013476013 1 2024-04-03T08:39:11.344 INFO:tasks.workunit.client.1.smithi181.stdout:5/189: creat d4/f39 x:0 0 0 2024-04-03T08:39:11.347 INFO:tasks.workunit.client.0.smithi157.stdout:7/388: rename d0/d11/d15/d35/f50 to d0/d4/d8e/d96/f98 0 2024-04-03T08:39:11.347 INFO:tasks.workunit.client.1.smithi181.stdout:3/177: write d0/d5/d6/f1d [515209,3290] 0 2024-04-03T08:39:11.349 INFO:tasks.workunit.client.0.smithi157.stdout:7/389: fsync d0/d11/d15/d1b/f59 0 2024-04-03T08:39:11.352 INFO:tasks.workunit.client.0.smithi157.stdout:0/379: mkdir d2/d9/d5f/d8d 0 2024-04-03T08:39:11.356 INFO:tasks.workunit.client.0.smithi157.stdout:3/359: sync 2024-04-03T08:39:11.358 INFO:tasks.workunit.client.1.smithi181.stdout:6/191: mkdir d6/d3e 0 2024-04-03T08:39:11.359 INFO:tasks.workunit.client.0.smithi157.stdout:3/360: truncate d8/d1e/f65 130922 0 2024-04-03T08:39:11.360 INFO:tasks.workunit.client.0.smithi157.stdout:3/361: fsync d8/f2f 0 2024-04-03T08:39:11.361 INFO:tasks.workunit.client.1.smithi181.stdout:0/176: mknod d5/d9/d13/c34 0 2024-04-03T08:39:11.362 INFO:tasks.workunit.client.0.smithi157.stdout:5/405: rmdir dc/d29/d56/d49 39 2024-04-03T08:39:11.363 INFO:tasks.workunit.client.1.smithi181.stdout:5/190: dwrite d4/d22/f38 [0,4194304] 0 2024-04-03T08:39:11.366 INFO:tasks.workunit.client.1.smithi181.stdout:1/161: mkdir d10/d15/d17/d19/d33 0 2024-04-03T08:39:11.366 INFO:tasks.workunit.client.1.smithi181.stdout:3/178: dwrite d0/d17/f2e [0,4194304] 0 2024-04-03T08:39:11.370 INFO:tasks.workunit.client.1.smithi181.stdout:2/217: creat d13/d1c/f5a x:0 0 0 2024-04-03T08:39:11.371 INFO:tasks.workunit.client.1.smithi181.stdout:1/162: dread d10/d15/f18 [0,4194304] 0 2024-04-03T08:39:11.372 INFO:tasks.workunit.client.1.smithi181.stdout:7/154: link d0/d1/d6/de/d17/f2c d0/d1/d6/de/d17/d27/f36 0 2024-04-03T08:39:11.376 INFO:tasks.workunit.client.1.smithi181.stdout:4/193: write d1/d16/f18 [793408,56751] 0 2024-04-03T08:39:11.379 INFO:tasks.workunit.client.1.smithi181.stdout:4/194: write d1/d1e/f2e [211644,94536] 0 2024-04-03T08:39:11.379 INFO:tasks.workunit.client.0.smithi157.stdout:7/390: unlink d0/d11/d15/d17/d43/d8a/d8f/d5b/f63 0 2024-04-03T08:39:11.381 INFO:tasks.workunit.client.1.smithi181.stdout:4/195: write d1/d1e/f2e [303796,18356] 0 2024-04-03T08:39:11.385 INFO:tasks.workunit.client.0.smithi157.stdout:5/406: dread - dc/d29/d56/d49/d53/f76 zero size 2024-04-03T08:39:11.387 INFO:tasks.workunit.client.1.smithi181.stdout:3/179: rename d0/d5 to d0/d5/d6/dd/d30 22 2024-04-03T08:39:11.388 INFO:tasks.workunit.client.0.smithi157.stdout:5/407: read dc/d29/d56/d49/d53/d6c/f6f [1665615,11054] 0 2024-04-03T08:39:11.389 INFO:tasks.workunit.client.1.smithi181.stdout:2/218: creat d13/d1d/f5b x:0 0 0 2024-04-03T08:39:11.389 INFO:tasks.workunit.client.0.smithi157.stdout:7/391: mknod d0/d11/d6f/c99 0 2024-04-03T08:39:11.390 INFO:tasks.workunit.client.1.smithi181.stdout:2/219: fdatasync d13/d1d/f50 0 2024-04-03T08:39:11.391 INFO:tasks.workunit.client.1.smithi181.stdout:1/163: dwrite d10/d15/d17/d19/f2f [0,4194304] 0 2024-04-03T08:39:11.391 INFO:tasks.workunit.client.0.smithi157.stdout:4/369: truncate da/df/d2f/f4f 438494 0 2024-04-03T08:39:11.392 INFO:tasks.workunit.client.0.smithi157.stdout:7/392: write d0/d11/d15/d1b/f73 [4121079,33081] 0 2024-04-03T08:39:11.392 INFO:tasks.workunit.client.0.smithi157.stdout:4/370: chown da/df/d24/d35/d6a 29113 1 2024-04-03T08:39:11.393 INFO:tasks.workunit.client.1.smithi181.stdout:7/155: fdatasync d0/d1/f15 0 2024-04-03T08:39:11.395 INFO:tasks.workunit.client.0.smithi157.stdout:4/371: write da/df/d24/d35/d6a/d78/f7a [822856,50279] 0 2024-04-03T08:39:11.396 INFO:tasks.workunit.client.0.smithi157.stdout:8/386: rename d2/d11/d10/d24/d5b/c4a to d2/d11/d10/d24/d5b/d2e/d75/d81/c82 0 2024-04-03T08:39:11.396 INFO:tasks.workunit.client.0.smithi157.stdout:8/387: chown d2 174 1 2024-04-03T08:39:11.399 INFO:tasks.workunit.client.0.smithi157.stdout:0/380: mknod d2/d9/dc/df/d1b/d35/d3d/c8e 0 2024-04-03T08:39:11.399 INFO:tasks.workunit.client.0.smithi157.stdout:8/388: chown d2/d11/d10/d24/f54 1 1 2024-04-03T08:39:11.401 INFO:tasks.workunit.client.0.smithi157.stdout:8/389: fsync d2/d20/d77/f7f 0 2024-04-03T08:39:11.402 INFO:tasks.workunit.client.0.smithi157.stdout:3/362: mkdir d8/d13/d1b/d7d 0 2024-04-03T08:39:11.406 INFO:tasks.workunit.client.1.smithi181.stdout:4/196: mkdir d1/d16/d1f/d3f 0 2024-04-03T08:39:11.408 INFO:tasks.workunit.client.1.smithi181.stdout:0/177: fdatasync d5/fe 0 2024-04-03T08:39:11.409 INFO:tasks.workunit.client.1.smithi181.stdout:4/197: fsync d1/d16/d1f/f3e 0 2024-04-03T08:39:11.409 INFO:tasks.workunit.client.0.smithi157.stdout:1/313: mkdir d2/d11/d24/d39/d3b/d69 0 2024-04-03T08:39:11.409 INFO:tasks.workunit.client.1.smithi181.stdout:2/220: dwrite d13/d1d/f50 [0,4194304] 0 2024-04-03T08:39:11.410 INFO:tasks.workunit.client.1.smithi181.stdout:5/191: symlink d4/d18/l3a 0 2024-04-03T08:39:11.411 INFO:tasks.workunit.client.0.smithi157.stdout:1/314: write d2/d11/d24/d39/f61 [966942,72941] 0 2024-04-03T08:39:11.414 INFO:tasks.workunit.client.1.smithi181.stdout:5/192: stat d4/f39 0 2024-04-03T08:39:11.415 INFO:tasks.workunit.client.0.smithi157.stdout:5/408: creat dc/d29/d56/d49/d53/f8f x:0 0 0 2024-04-03T08:39:11.419 INFO:tasks.workunit.client.1.smithi181.stdout:3/180: unlink d0/f3 0 2024-04-03T08:39:11.419 INFO:tasks.workunit.client.1.smithi181.stdout:2/221: chown d13/d1d/f2a 109281 1 2024-04-03T08:39:11.423 INFO:tasks.workunit.client.1.smithi181.stdout:2/222: dread - d13/d22/d27/d46/f53 zero size 2024-04-03T08:39:11.424 INFO:tasks.workunit.client.1.smithi181.stdout:1/164: dwrite d10/d15/d17/d23/d27/f2c [0,4194304] 0 2024-04-03T08:39:11.426 INFO:tasks.workunit.client.0.smithi157.stdout:3/363: write d8/d13/f60 [718544,120475] 0 2024-04-03T08:39:11.428 INFO:tasks.workunit.client.0.smithi157.stdout:3/364: dread - d8/d1e/d2d/d39/f5f zero size 2024-04-03T08:39:11.429 INFO:tasks.workunit.client.0.smithi157.stdout:1/315: write d2/d11/d24/d39/d3b/d2e/d48/d58/f4b [759129,115848] 0 2024-04-03T08:39:11.430 INFO:tasks.workunit.client.0.smithi157.stdout:3/365: stat d8/d1e/d2d/d3f/f44 0 2024-04-03T08:39:11.431 INFO:tasks.workunit.client.0.smithi157.stdout:5/409: creat dc/d35/f90 x:0 0 0 2024-04-03T08:39:11.433 INFO:tasks.workunit.client.1.smithi181.stdout:6/192: dwrite d6/d31/d36/f33 [0,4194304] 0 2024-04-03T08:39:11.435 INFO:tasks.workunit.client.1.smithi181.stdout:0/178: dread d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:11.436 INFO:tasks.workunit.client.0.smithi157.stdout:7/393: unlink d0/d11/d15/d17/d43/d8a/d8f/l6e 0 2024-04-03T08:39:11.438 INFO:tasks.workunit.client.0.smithi157.stdout:4/372: creat da/df/d11/d5d/f7d x:0 0 0 2024-04-03T08:39:11.440 INFO:tasks.workunit.client.1.smithi181.stdout:5/193: rename d4/d18/l24 to d4/d22/l3b 0 2024-04-03T08:39:11.444 INFO:tasks.workunit.client.1.smithi181.stdout:1/165: rmdir d10/d15/d17/d23 39 2024-04-03T08:39:11.449 INFO:tasks.workunit.client.0.smithi157.stdout:7/394: symlink d0/d11/d15/d35/l9a 0 2024-04-03T08:39:11.452 INFO:tasks.workunit.client.1.smithi181.stdout:6/193: unlink d6/d7/d9/l25 0 2024-04-03T08:39:11.457 INFO:tasks.workunit.client.1.smithi181.stdout:1/166: dread d10/d15/d17/d19/f2f [0,4194304] 0 2024-04-03T08:39:11.457 INFO:tasks.workunit.client.0.smithi157.stdout:4/373: dwrite da/df/d24/f5c [0,4194304] 0 2024-04-03T08:39:11.463 INFO:tasks.workunit.client.1.smithi181.stdout:8/155: sync 2024-04-03T08:39:11.463 INFO:tasks.workunit.client.1.smithi181.stdout:9/256: sync 2024-04-03T08:39:11.463 INFO:tasks.workunit.client.1.smithi181.stdout:7/156: creat d0/f37 x:0 0 0 2024-04-03T08:39:11.464 INFO:tasks.workunit.client.0.smithi157.stdout:0/381: truncate d2/f5b 2625897 0 2024-04-03T08:39:11.465 INFO:tasks.workunit.client.1.smithi181.stdout:3/181: link d0/d5/d16/d1e/f28 d0/d5/d16/d1e/f31 0 2024-04-03T08:39:11.465 INFO:tasks.workunit.client.1.smithi181.stdout:9/257: chown d1/da/d28/d30/d3e 733933367 1 2024-04-03T08:39:11.466 INFO:tasks.workunit.client.1.smithi181.stdout:8/156: stat d4/d6/db/d14/d31/d1c 0 2024-04-03T08:39:11.467 INFO:tasks.workunit.client.1.smithi181.stdout:4/198: rmdir d1/d16/d1f/d31/d3a 0 2024-04-03T08:39:11.468 INFO:tasks.workunit.client.1.smithi181.stdout:8/157: dread - d4/d6/f2e zero size 2024-04-03T08:39:11.469 INFO:tasks.workunit.client.1.smithi181.stdout:5/194: dread d4/f13 [0,4194304] 0 2024-04-03T08:39:11.470 INFO:tasks.workunit.client.0.smithi157.stdout:0/382: write d2/d9/dc/df/d1b/f8b [4997355,707] 0 2024-04-03T08:39:11.470 INFO:tasks.workunit.client.0.smithi157.stdout:7/395: symlink d0/d11/l9b 0 2024-04-03T08:39:11.473 INFO:tasks.workunit.client.1.smithi181.stdout:0/179: mknod d5/d9/d13/c35 0 2024-04-03T08:39:11.474 INFO:tasks.workunit.client.0.smithi157.stdout:1/316: getdents d2/d11/d24/d39/d3b/d2e/d48 0 2024-04-03T08:39:11.476 INFO:tasks.workunit.client.0.smithi157.stdout:0/383: fsync d2/d9/dc/df/d1b/d35/f56 0 2024-04-03T08:39:11.476 INFO:tasks.workunit.client.1.smithi181.stdout:2/223: rename f10 to d13/d22/d27/d2f/f5c 0 2024-04-03T08:39:11.479 INFO:tasks.workunit.client.0.smithi157.stdout:4/374: dread da/f3e [0,4194304] 0 2024-04-03T08:39:11.481 INFO:tasks.workunit.client.1.smithi181.stdout:7/157: rmdir d0/d1 39 2024-04-03T08:39:11.481 INFO:tasks.workunit.client.0.smithi157.stdout:5/410: dread dc/d29/d56/f26 [0,4194304] 0 2024-04-03T08:39:11.488 INFO:tasks.workunit.client.0.smithi157.stdout:1/317: dread - d2/d11/f44 zero size 2024-04-03T08:39:11.488 INFO:tasks.workunit.client.1.smithi181.stdout:9/258: mknod d1/da/d1a/c55 0 2024-04-03T08:39:11.489 INFO:tasks.workunit.client.0.smithi157.stdout:8/390: link d2/d11/d10/d24/d5b/c13 d2/d11/d10/d24/c83 0 2024-04-03T08:39:11.493 INFO:tasks.workunit.client.1.smithi181.stdout:5/195: chown d4/l1e 1957972 1 2024-04-03T08:39:11.494 INFO:tasks.workunit.client.1.smithi181.stdout:5/196: chown d4/d18/d2c/f34 48217220 1 2024-04-03T08:39:11.495 INFO:tasks.workunit.client.0.smithi157.stdout:7/396: dwrite d0/d5/f92 [4194304,4194304] 0 2024-04-03T08:39:11.499 INFO:tasks.workunit.client.0.smithi157.stdout:5/411: creat dc/d29/f91 x:0 0 0 2024-04-03T08:39:11.499 INFO:tasks.workunit.client.0.smithi157.stdout:1/318: fsync d2/d11/f26 0 2024-04-03T08:39:11.500 INFO:tasks.workunit.client.1.smithi181.stdout:1/167: rmdir d10/d15/d17/d23 39 2024-04-03T08:39:11.502 INFO:tasks.workunit.client.0.smithi157.stdout:5/412: chown dc/d29/d56/d2e/l3c 23511 1 2024-04-03T08:39:11.504 INFO:tasks.workunit.client.1.smithi181.stdout:2/224: mkdir d13/d22/d27/d2f/d5d 0 2024-04-03T08:39:11.504 INFO:tasks.workunit.client.0.smithi157.stdout:8/391: chown d2/d20/d23/l62 59 1 2024-04-03T08:39:11.504 INFO:tasks.workunit.client.1.smithi181.stdout:4/199: dread d1/f7 [0,4194304] 0 2024-04-03T08:39:11.506 INFO:tasks.workunit.client.0.smithi157.stdout:8/392: chown d2/d11/d10/l52 459768 1 2024-04-03T08:39:11.508 INFO:tasks.workunit.client.1.smithi181.stdout:4/200: fdatasync d1/d1e/f1a 0 2024-04-03T08:39:11.508 INFO:tasks.workunit.client.0.smithi157.stdout:0/384: dwrite d2/d9/dc/df/d1b/d35/f66 [0,4194304] 0 2024-04-03T08:39:11.508 INFO:tasks.workunit.client.0.smithi157.stdout:4/375: mkdir da/d7e 0 2024-04-03T08:39:11.508 INFO:tasks.workunit.client.1.smithi181.stdout:3/182: mkdir d0/d5/d6/d32 0 2024-04-03T08:39:11.510 INFO:tasks.workunit.client.0.smithi157.stdout:0/385: readlink d2/d9/dc/df/l4e 0 2024-04-03T08:39:11.510 INFO:tasks.workunit.client.0.smithi157.stdout:4/376: dread - da/df/d2f/d64/f7b zero size 2024-04-03T08:39:11.510 INFO:tasks.workunit.client.1.smithi181.stdout:3/183: readlink d0/d5/d16/l27 0 2024-04-03T08:39:11.511 INFO:tasks.workunit.client.0.smithi157.stdout:0/386: read - d2/d9/dc/df/d1b/f59 zero size 2024-04-03T08:39:11.512 INFO:tasks.workunit.client.1.smithi181.stdout:6/194: creat d6/d7/f3f x:0 0 0 2024-04-03T08:39:11.513 INFO:tasks.workunit.client.0.smithi157.stdout:1/319: rmdir d2 39 2024-04-03T08:39:11.519 INFO:tasks.workunit.client.1.smithi181.stdout:8/158: link d4/d6/d9/f1b d4/d6/db/f33 0 2024-04-03T08:39:11.521 INFO:tasks.workunit.client.1.smithi181.stdout:5/197: write d4/f13 [3949120,69291] 0 2024-04-03T08:39:11.521 INFO:tasks.workunit.client.0.smithi157.stdout:8/393: unlink d2/d6f/f7c 0 2024-04-03T08:39:11.523 INFO:tasks.workunit.client.0.smithi157.stdout:4/377: fdatasync da/d26/f3d 0 2024-04-03T08:39:11.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/394: chown d2/d20/f65 102 1 2024-04-03T08:39:11.525 INFO:tasks.workunit.client.1.smithi181.stdout:1/168: creat d10/d15/f34 x:0 0 0 2024-04-03T08:39:11.526 INFO:tasks.workunit.client.1.smithi181.stdout:1/169: readlink l7 0 2024-04-03T08:39:11.529 INFO:tasks.workunit.client.0.smithi157.stdout:5/413: mknod dc/d29/d56/c92 0 2024-04-03T08:39:11.529 INFO:tasks.workunit.client.0.smithi157.stdout:0/387: dwrite d2/f3 [0,4194304] 0 2024-04-03T08:39:11.531 INFO:tasks.workunit.client.1.smithi181.stdout:4/201: chown d1/d16/d37/c2a 2797954 1 2024-04-03T08:39:11.533 INFO:tasks.workunit.client.1.smithi181.stdout:7/158: truncate d0/d1/d6/de/f2d 5439957 0 2024-04-03T08:39:11.534 INFO:tasks.workunit.client.0.smithi157.stdout:7/397: link d0/d4/l42 d0/d11/d15/d17/d43/d8a/d8f/l9c 0 2024-04-03T08:39:11.535 INFO:tasks.workunit.client.0.smithi157.stdout:0/388: write d2/d9/dc/df/d1b/d35/d3d/f58 [489699,30972] 0 2024-04-03T08:39:11.541 INFO:tasks.workunit.client.1.smithi181.stdout:0/180: truncate d5/d9/f28 1827080 0 2024-04-03T08:39:11.545 INFO:tasks.workunit.client.0.smithi157.stdout:5/414: creat dc/d29/d56/d18/d21/f93 x:0 0 0 2024-04-03T08:39:11.547 INFO:tasks.workunit.client.1.smithi181.stdout:5/198: creat d4/d18/d25/f3c x:0 0 0 2024-04-03T08:39:11.547 INFO:tasks.workunit.client.0.smithi157.stdout:7/398: mkdir d0/d4/d8e/d9d 0 2024-04-03T08:39:11.549 INFO:tasks.workunit.client.1.smithi181.stdout:1/170: symlink d10/d15/l35 0 2024-04-03T08:39:11.549 INFO:tasks.workunit.client.0.smithi157.stdout:7/399: chown d0/d11/d15/d17/f7c 224879 1 2024-04-03T08:39:11.550 INFO:tasks.workunit.client.1.smithi181.stdout:7/159: dwrite d0/d1/d6/de/d17/f31 [0,4194304] 0 2024-04-03T08:39:11.550 INFO:tasks.workunit.client.1.smithi181.stdout:1/171: chown fc 100717496 1 2024-04-03T08:39:11.550 INFO:tasks.workunit.client.0.smithi157.stdout:0/389: mknod d2/d9/dc/df/d1b/d35/d3d/c8f 0 2024-04-03T08:39:11.552 INFO:tasks.workunit.client.0.smithi157.stdout:0/390: write d2/f2c [344646,126852] 0 2024-04-03T08:39:11.553 INFO:tasks.workunit.client.1.smithi181.stdout:4/202: rename d1/d16/f18 to d1/d16/d1f/d3f/f40 0 2024-04-03T08:39:11.554 INFO:tasks.workunit.client.1.smithi181.stdout:6/195: mkdir d6/d3e/d40 0 2024-04-03T08:39:11.556 INFO:tasks.workunit.client.1.smithi181.stdout:4/203: chown d1/d1e/f2e 7 1 2024-04-03T08:39:11.557 INFO:tasks.workunit.client.1.smithi181.stdout:6/196: fdatasync d6/d31/d36/f33 0 2024-04-03T08:39:11.557 INFO:tasks.workunit.client.1.smithi181.stdout:9/259: link d1/da/d13/f29 d1/da/d1a/f56 0 2024-04-03T08:39:11.557 INFO:tasks.workunit.client.0.smithi157.stdout:7/400: symlink d0/d11/d15/d17/d1c/d4f/d5f/d61/l9e 0 2024-04-03T08:39:11.559 INFO:tasks.workunit.client.1.smithi181.stdout:4/204: write d1/d1e/f2e [401959,129099] 0 2024-04-03T08:39:11.559 INFO:tasks.workunit.client.1.smithi181.stdout:0/181: creat d5/dc/d10/f36 x:0 0 0 2024-04-03T08:39:11.562 INFO:tasks.workunit.client.1.smithi181.stdout:9/260: dread d1/f35 [0,4194304] 0 2024-04-03T08:39:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:11 smithi157 ceph-mon[35083]: pgmap v295: 65 pgs: 65 active+clean; 937 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 111 MiB/s wr, 211 op/s 2024-04-03T08:39:11.564 INFO:tasks.workunit.client.1.smithi181.stdout:5/199: chown d4/d22/c2d 48 1 2024-04-03T08:39:11.564 INFO:tasks.workunit.client.1.smithi181.stdout:9/261: readlink d1/l15 0 2024-04-03T08:39:11.566 INFO:tasks.workunit.client.1.smithi181.stdout:7/160: creat d0/d1/d6/de/d17/f38 x:0 0 0 2024-04-03T08:39:11.567 INFO:tasks.workunit.client.0.smithi157.stdout:4/378: dread da/f1e [0,4194304] 0 2024-04-03T08:39:11.567 INFO:tasks.workunit.client.0.smithi157.stdout:1/320: getdents d2/d11 0 2024-04-03T08:39:11.568 INFO:tasks.workunit.client.0.smithi157.stdout:0/391: mknod d2/d9/dc/c90 0 2024-04-03T08:39:11.568 INFO:tasks.workunit.client.0.smithi157.stdout:9/341: sync 2024-04-03T08:39:11.569 INFO:tasks.workunit.client.1.smithi181.stdout:7/161: chown d0/d1/d6/de/c34 3427081 1 2024-04-03T08:39:11.570 INFO:tasks.workunit.client.0.smithi157.stdout:0/392: fdatasync d2/d9/d5f/d85/f86 0 2024-04-03T08:39:11.571 INFO:tasks.workunit.client.0.smithi157.stdout:7/401: mkdir d0/d11/d15/d17/d9f 0 2024-04-03T08:39:11.572 INFO:tasks.workunit.client.1.smithi181.stdout:3/184: creat d0/d5/f33 x:0 0 0 2024-04-03T08:39:11.573 INFO:tasks.workunit.client.1.smithi181.stdout:1/172: dwrite f4 [0,4194304] 0 2024-04-03T08:39:11.577 INFO:tasks.workunit.client.1.smithi181.stdout:1/173: chown d10/d15/d17/d19/l1c 42399662 1 2024-04-03T08:39:11.578 INFO:tasks.workunit.client.0.smithi157.stdout:9/342: rmdir d1/d15/d27/d34 39 2024-04-03T08:39:11.582 INFO:tasks.workunit.client.1.smithi181.stdout:1/174: read d10/f22 [1288170,68350] 0 2024-04-03T08:39:11.582 INFO:tasks.workunit.client.1.smithi181.stdout:3/185: dread d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:11.583 INFO:tasks.workunit.client.1.smithi181.stdout:6/197: chown d6/l30 1468569924 1 2024-04-03T08:39:11.583 INFO:tasks.workunit.client.0.smithi157.stdout:4/379: dwrite da/df/d24/d35/d3c/f4d [0,4194304] 0 2024-04-03T08:39:11.585 INFO:tasks.workunit.client.1.smithi181.stdout:3/186: write d0/d17/f2f [749266,104605] 0 2024-04-03T08:39:11.585 INFO:tasks.workunit.client.0.smithi157.stdout:1/321: mknod d2/d11/d24/d67/c6a 0 2024-04-03T08:39:11.589 INFO:tasks.workunit.client.0.smithi157.stdout:8/395: truncate d2/d11/d10/d24/d5b/f47 453308 0 2024-04-03T08:39:11.589 INFO:tasks.workunit.client.1.smithi181.stdout:4/205: unlink d1/d16/d1f/f3e 0 2024-04-03T08:39:11.591 INFO:tasks.workunit.client.0.smithi157.stdout:7/402: mknod d0/d11/d15/ca0 0 2024-04-03T08:39:11.591 INFO:tasks.workunit.client.0.smithi157.stdout:5/415: truncate dc/fd 413663 0 2024-04-03T08:39:11.595 INFO:tasks.workunit.client.0.smithi157.stdout:0/393: unlink d2/d9/dc/df/d78/d6a/c7b 0 2024-04-03T08:39:11.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:11 smithi181 ceph-mon[44183]: pgmap v295: 65 pgs: 65 active+clean; 937 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 111 MiB/s wr, 211 op/s 2024-04-03T08:39:11.600 INFO:tasks.workunit.client.1.smithi181.stdout:2/225: getdents d13 0 2024-04-03T08:39:11.604 INFO:tasks.workunit.client.0.smithi157.stdout:8/396: read d2/d11/d10/d24/d5b/d2e/f3f [3129584,29169] 0 2024-04-03T08:39:11.604 INFO:tasks.workunit.client.1.smithi181.stdout:7/162: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:11.605 INFO:tasks.workunit.client.0.smithi157.stdout:8/397: chown d2/d11/d10/l52 184725 1 2024-04-03T08:39:11.607 INFO:tasks.workunit.client.1.smithi181.stdout:9/262: dread d1/da/d13/d22/f42 [0,4194304] 0 2024-04-03T08:39:11.607 INFO:tasks.workunit.client.0.smithi157.stdout:4/380: creat da/d7e/f7f x:0 0 0 2024-04-03T08:39:11.608 INFO:tasks.workunit.client.0.smithi157.stdout:4/381: chown da/df/d2f 183893 1 2024-04-03T08:39:11.609 INFO:tasks.workunit.client.0.smithi157.stdout:0/394: mkdir d2/d9/dc/df/d78/d6a/d91 0 2024-04-03T08:39:11.611 INFO:tasks.workunit.client.1.smithi181.stdout:1/175: creat d10/d15/f36 x:0 0 0 2024-04-03T08:39:11.614 INFO:tasks.workunit.client.1.smithi181.stdout:8/159: getdents d4 0 2024-04-03T08:39:11.617 INFO:tasks.workunit.client.1.smithi181.stdout:4/206: mkdir d1/d16/d1f/d3f/d41 0 2024-04-03T08:39:11.618 INFO:tasks.workunit.client.0.smithi157.stdout:4/382: write da/df/d24/d35/d3c/f71 [1065647,2270] 0 2024-04-03T08:39:11.620 INFO:tasks.workunit.client.1.smithi181.stdout:7/163: dread d0/d1/d6/de/d17/f31 [0,4194304] 0 2024-04-03T08:39:11.621 INFO:tasks.workunit.client.1.smithi181.stdout:4/207: write d1/d16/d37/d34/f35 [867729,107427] 0 2024-04-03T08:39:11.621 INFO:tasks.workunit.client.0.smithi157.stdout:0/395: rename d2/d9/dc/df/f60 to d2/d9/d51/d63/d71/f92 0 2024-04-03T08:39:11.623 INFO:tasks.workunit.client.1.smithi181.stdout:4/208: chown d1/d1e/f2e 2242552 1 2024-04-03T08:39:11.624 INFO:tasks.workunit.client.1.smithi181.stdout:4/209: dread - d1/f2f zero size 2024-04-03T08:39:11.627 INFO:tasks.workunit.client.0.smithi157.stdout:7/403: rmdir d0/d4/d8e/d9d 0 2024-04-03T08:39:11.627 INFO:tasks.workunit.client.0.smithi157.stdout:1/322: dread d2/d11/d24/d39/d3b/d1b/f2c [0,4194304] 0 2024-04-03T08:39:11.627 INFO:tasks.workunit.client.1.smithi181.stdout:2/226: rename d13/d1d/f2a to d13/d22/d27/d2f/f5e 0 2024-04-03T08:39:11.631 INFO:tasks.workunit.client.0.smithi157.stdout:8/398: mknod d2/d7b/c84 0 2024-04-03T08:39:11.632 INFO:tasks.workunit.client.0.smithi157.stdout:7/404: write d0/d11/d15/d1b/f59 [432132,109840] 0 2024-04-03T08:39:11.634 INFO:tasks.workunit.client.0.smithi157.stdout:7/405: read - d0/d11/d15/d17/f77 zero size 2024-04-03T08:39:11.638 INFO:tasks.workunit.client.0.smithi157.stdout:0/396: mkdir d2/d9/dc/df/d1b/d4a/d31/d93 0 2024-04-03T08:39:11.642 INFO:tasks.workunit.client.1.smithi181.stdout:1/176: dread d10/d15/d17/d19/f1a [0,4194304] 0 2024-04-03T08:39:11.643 INFO:tasks.workunit.client.1.smithi181.stdout:1/177: write f4 [4575961,14650] 0 2024-04-03T08:39:11.645 INFO:tasks.workunit.client.1.smithi181.stdout:1/178: dread - d10/d15/f36 zero size 2024-04-03T08:39:11.645 INFO:tasks.workunit.client.1.smithi181.stdout:6/198: write d6/f13 [678540,50096] 0 2024-04-03T08:39:11.647 INFO:tasks.workunit.client.0.smithi157.stdout:5/416: truncate dc/d29/d56/f26 3681985 0 2024-04-03T08:39:11.652 INFO:tasks.workunit.client.1.smithi181.stdout:5/200: creat d4/f3d x:0 0 0 2024-04-03T08:39:11.660 INFO:tasks.workunit.client.1.smithi181.stdout:2/227: unlink d13/f39 0 2024-04-03T08:39:11.661 INFO:tasks.workunit.client.0.smithi157.stdout:8/399: creat d2/d11/d10/d24/d5b/d2e/d75/f85 x:0 0 0 2024-04-03T08:39:11.663 INFO:tasks.workunit.client.0.smithi157.stdout:5/417: dwrite dc/d29/d43/f48 [0,4194304] 0 2024-04-03T08:39:11.664 INFO:tasks.workunit.client.1.smithi181.stdout:7/164: rename d0/f37 to d0/d1/f39 0 2024-04-03T08:39:11.665 INFO:tasks.workunit.client.1.smithi181.stdout:7/165: chown d0/d1/d6/de/d17/d27/f2e 106900 1 2024-04-03T08:39:11.667 INFO:tasks.workunit.client.0.smithi157.stdout:5/418: write dc/d29/d56/d18/f63 [324027,5836] 0 2024-04-03T08:39:11.668 INFO:tasks.workunit.client.0.smithi157.stdout:7/406: fdatasync d0/d11/d15/d17/d1c/f5c 0 2024-04-03T08:39:11.671 INFO:tasks.workunit.client.0.smithi157.stdout:0/397: creat d2/d9/dc/df/d1b/f94 x:0 0 0 2024-04-03T08:39:11.678 INFO:tasks.workunit.client.1.smithi181.stdout:6/199: symlink d6/d31/d36/l41 0 2024-04-03T08:39:11.680 INFO:tasks.workunit.client.1.smithi181.stdout:0/182: link d5/dc/c1b d5/d9/d13/c37 0 2024-04-03T08:39:11.680 INFO:tasks.workunit.client.1.smithi181.stdout:8/160: write d4/d6/db/d14/f2d [402505,121157] 0 2024-04-03T08:39:11.680 INFO:tasks.workunit.client.1.smithi181.stdout:6/200: read - d6/d31/d36/f26 zero size 2024-04-03T08:39:11.681 INFO:tasks.workunit.client.0.smithi157.stdout:4/383: creat da/df/d24/d35/f80 x:0 0 0 2024-04-03T08:39:11.684 INFO:tasks.workunit.client.0.smithi157.stdout:1/323: write d2/f21 [1080798,13931] 0 2024-04-03T08:39:11.685 INFO:tasks.workunit.client.1.smithi181.stdout:4/210: creat d1/d16/d1f/d3f/d41/f42 x:0 0 0 2024-04-03T08:39:11.686 INFO:tasks.workunit.client.0.smithi157.stdout:7/407: mkdir d0/d11/d15/d17/d1c/da1 0 2024-04-03T08:39:11.687 INFO:tasks.workunit.client.1.smithi181.stdout:4/211: write d1/d16/f13 [1374583,100588] 0 2024-04-03T08:39:11.695 INFO:tasks.workunit.client.1.smithi181.stdout:7/166: creat d0/d1/d6/de/d17/d27/f3a x:0 0 0 2024-04-03T08:39:11.697 INFO:tasks.workunit.client.1.smithi181.stdout:9/263: creat d1/f57 x:0 0 0 2024-04-03T08:39:11.698 INFO:tasks.workunit.client.1.smithi181.stdout:3/187: getdents d0/d5/d6/dd 0 2024-04-03T08:39:11.700 INFO:tasks.workunit.client.0.smithi157.stdout:7/408: rename d0/d5/f3e to d0/d11/d6f/d76/fa2 0 2024-04-03T08:39:11.701 INFO:tasks.workunit.client.1.smithi181.stdout:1/179: mkdir d10/d15/d17/d37 0 2024-04-03T08:39:11.702 INFO:tasks.workunit.client.1.smithi181.stdout:0/183: creat d5/dc/d10/f38 x:0 0 0 2024-04-03T08:39:11.703 INFO:tasks.workunit.client.0.smithi157.stdout:8/400: rmdir d2/d20/d69 0 2024-04-03T08:39:11.703 INFO:tasks.workunit.client.0.smithi157.stdout:5/419: dread dc/d29/d56/d18/f3a [0,4194304] 0 2024-04-03T08:39:11.704 INFO:tasks.workunit.client.0.smithi157.stdout:0/398: write d2/d9/dc/df/d78/f48 [2564130,97979] 0 2024-04-03T08:39:11.705 INFO:tasks.workunit.client.1.smithi181.stdout:6/201: creat d6/f42 x:0 0 0 2024-04-03T08:39:11.706 INFO:tasks.workunit.client.1.smithi181.stdout:8/161: creat d4/d6/db/d14/d31/f34 x:0 0 0 2024-04-03T08:39:11.707 INFO:tasks.workunit.client.1.smithi181.stdout:5/201: mkdir d4/d18/d3e 0 2024-04-03T08:39:11.715 INFO:tasks.workunit.client.0.smithi157.stdout:1/324: dwrite d2/d11/d23/f4d [0,4194304] 0 2024-04-03T08:39:11.715 INFO:tasks.workunit.client.1.smithi181.stdout:9/264: unlink d1/f8 0 2024-04-03T08:39:11.716 INFO:tasks.workunit.client.1.smithi181.stdout:9/265: read d1/f2f [4286187,5817] 0 2024-04-03T08:39:11.717 INFO:tasks.workunit.client.1.smithi181.stdout:3/188: mkdir d0/d5/d6/dd/d25/d34 0 2024-04-03T08:39:11.718 INFO:tasks.workunit.client.1.smithi181.stdout:8/162: dread d4/d6/d9/f1b [0,4194304] 0 2024-04-03T08:39:11.724 INFO:tasks.workunit.client.1.smithi181.stdout:1/180: dread d10/d15/f18 [0,4194304] 0 2024-04-03T08:39:11.726 INFO:tasks.workunit.client.0.smithi157.stdout:4/384: getdents da/df/d2f/d64 0 2024-04-03T08:39:11.727 INFO:tasks.workunit.client.1.smithi181.stdout:6/202: creat d6/d31/d36/f43 x:0 0 0 2024-04-03T08:39:11.730 INFO:tasks.workunit.client.0.smithi157.stdout:5/420: link dc/f44 dc/d29/d56/d18/d21/f94 0 2024-04-03T08:39:11.731 INFO:tasks.workunit.client.0.smithi157.stdout:5/421: fsync dc/d29/d56/d52/f58 0 2024-04-03T08:39:11.732 INFO:tasks.workunit.client.1.smithi181.stdout:4/212: symlink d1/l43 0 2024-04-03T08:39:11.733 INFO:tasks.workunit.client.0.smithi157.stdout:1/325: read d2/f5 [371977,42312] 0 2024-04-03T08:39:11.734 INFO:tasks.workunit.client.0.smithi157.stdout:5/422: readlink dc/d29/d56/d49/l72 0 2024-04-03T08:39:11.734 INFO:tasks.workunit.client.0.smithi157.stdout:8/401: dread d2/fb [8388608,4194304] 0 2024-04-03T08:39:11.736 INFO:tasks.workunit.client.0.smithi157.stdout:0/399: link d2/d9/dc/df/d1b/d35/d3d/l4d d2/d9/dc/df/d6f/l95 0 2024-04-03T08:39:11.737 INFO:tasks.workunit.client.1.smithi181.stdout:3/189: symlink d0/d17/l35 0 2024-04-03T08:39:11.741 INFO:tasks.workunit.client.1.smithi181.stdout:2/228: dwrite fe [0,4194304] 0 2024-04-03T08:39:11.744 INFO:tasks.workunit.client.1.smithi181.stdout:1/181: dwrite fc [0,4194304] 0 2024-04-03T08:39:11.745 INFO:tasks.workunit.client.1.smithi181.stdout:0/184: truncate d5/dc/f1e 94395 0 2024-04-03T08:39:11.748 INFO:tasks.workunit.client.1.smithi181.stdout:6/203: rename d6/d7/d9/f19 to d6/d31/d36/f44 0 2024-04-03T08:39:11.749 INFO:tasks.workunit.client.0.smithi157.stdout:7/409: dwrite d0/d4/f65 [0,4194304] 0 2024-04-03T08:39:11.749 INFO:tasks.workunit.client.0.smithi157.stdout:7/410: stat d0/la 0 2024-04-03T08:39:11.751 INFO:tasks.workunit.client.0.smithi157.stdout:7/411: stat d0/d11/d15/d17/d9f 0 2024-04-03T08:39:11.753 INFO:tasks.workunit.client.1.smithi181.stdout:7/167: creat d0/f3b x:0 0 0 2024-04-03T08:39:11.757 INFO:tasks.workunit.client.1.smithi181.stdout:7/168: readlink d0/l8 0 2024-04-03T08:39:11.757 INFO:tasks.workunit.client.1.smithi181.stdout:2/229: dread d13/d22/d40/f42 [0,4194304] 0 2024-04-03T08:39:11.757 INFO:tasks.workunit.client.1.smithi181.stdout:7/169: readlink d0/d1/l1d 0 2024-04-03T08:39:11.758 INFO:tasks.workunit.client.0.smithi157.stdout:8/402: rename d2/d11/c73 to d2/d11/c86 0 2024-04-03T08:39:11.758 INFO:tasks.workunit.client.1.smithi181.stdout:4/213: symlink d1/d16/d1f/d3f/d41/l44 0 2024-04-03T08:39:11.759 INFO:tasks.workunit.client.0.smithi157.stdout:1/326: link d2/d11/d24/d39/d3b/d2e/l63 d2/d11/d24/l6b 0 2024-04-03T08:39:11.761 INFO:tasks.workunit.client.0.smithi157.stdout:7/412: fsync d0/d11/d15/d1b/f3f 0 2024-04-03T08:39:11.762 INFO:tasks.workunit.client.0.smithi157.stdout:8/403: fdatasync d2/d11/d10/d24/d5b/d2e/d75/f76 0 2024-04-03T08:39:11.763 INFO:tasks.workunit.client.1.smithi181.stdout:9/266: symlink d1/da/d28/d30/d3e/d52/l58 0 2024-04-03T08:39:11.763 INFO:tasks.workunit.client.0.smithi157.stdout:1/327: write d2/d11/f44 [124655,63431] 0 2024-04-03T08:39:11.764 INFO:tasks.workunit.client.1.smithi181.stdout:8/163: truncate d4/d6/f7 712119 0 2024-04-03T08:39:11.764 INFO:tasks.workunit.client.0.smithi157.stdout:4/385: dwrite da/df/d2f/d54/f65 [0,4194304] 0 2024-04-03T08:39:11.765 INFO:tasks.workunit.client.1.smithi181.stdout:4/214: stat d1/d16/d37/c2a 0 2024-04-03T08:39:11.765 INFO:tasks.workunit.client.1.smithi181.stdout:1/182: unlink d10/d15/d17/d19/l1e 0 2024-04-03T08:39:11.766 INFO:tasks.workunit.client.0.smithi157.stdout:7/413: chown d0/d11/d15/d17/d43/d8a/d8f/d5b 21835364 1 2024-04-03T08:39:11.767 INFO:tasks.workunit.client.1.smithi181.stdout:0/185: creat d5/d9/d2e/f39 x:0 0 0 2024-04-03T08:39:11.768 INFO:tasks.workunit.client.1.smithi181.stdout:9/267: chown d1/da/d28/d30/d3e 3215230 1 2024-04-03T08:39:11.768 INFO:tasks.workunit.client.0.smithi157.stdout:4/386: read - da/df/d24/d35/d6a/f77 zero size 2024-04-03T08:39:11.769 INFO:tasks.workunit.client.1.smithi181.stdout:4/215: chown d1/f32 0 1 2024-04-03T08:39:11.770 INFO:tasks.workunit.client.1.smithi181.stdout:6/204: rename d6/l24 to d6/d3e/d40/l45 0 2024-04-03T08:39:11.771 INFO:tasks.workunit.client.0.smithi157.stdout:1/328: mknod d2/d11/d23/c6c 0 2024-04-03T08:39:11.772 INFO:tasks.workunit.client.1.smithi181.stdout:2/230: mknod d13/d22/d27/d46/c5f 0 2024-04-03T08:39:11.777 INFO:tasks.workunit.client.1.smithi181.stdout:5/202: getdents d4 0 2024-04-03T08:39:11.780 INFO:tasks.workunit.client.0.smithi157.stdout:7/414: read d0/d11/d15/d17/d43/d8a/d8f/f3d [1320267,33555] 0 2024-04-03T08:39:11.781 INFO:tasks.workunit.client.1.smithi181.stdout:0/186: creat d5/dc/d14/f3a x:0 0 0 2024-04-03T08:39:11.781 INFO:tasks.workunit.client.0.smithi157.stdout:4/387: link da/df/d24/d35/d6a/f79 da/df/d2f/d64/f81 0 2024-04-03T08:39:11.782 INFO:tasks.workunit.client.1.smithi181.stdout:6/205: creat d6/d3e/f46 x:0 0 0 2024-04-03T08:39:11.782 INFO:tasks.workunit.client.1.smithi181.stdout:7/170: dread d0/d1/d6/de/d17/f2c [0,4194304] 0 2024-04-03T08:39:11.782 INFO:tasks.workunit.client.1.smithi181.stdout:2/231: chown d13/d22/d27/d2f/f47 0 1 2024-04-03T08:39:11.786 INFO:tasks.workunit.client.1.smithi181.stdout:3/190: getdents d0/d5/d6/dd 0 2024-04-03T08:39:11.786 INFO:tasks.workunit.client.0.smithi157.stdout:8/404: dwrite d2/d11/d10/d24/f54 [0,4194304] 0 2024-04-03T08:39:11.787 INFO:tasks.workunit.client.1.smithi181.stdout:6/206: read - d6/d31/d36/f26 zero size 2024-04-03T08:39:11.792 INFO:tasks.workunit.client.1.smithi181.stdout:1/183: rename d10/d15/d17/d19/f1a to d10/d15/d17/d30/f38 0 2024-04-03T08:39:11.793 INFO:tasks.workunit.client.1.smithi181.stdout:3/191: dread - d0/d5/f33 zero size 2024-04-03T08:39:11.798 INFO:tasks.workunit.client.1.smithi181.stdout:6/207: write d6/d7/f20 [533658,72939] 0 2024-04-03T08:39:11.799 INFO:tasks.workunit.client.1.smithi181.stdout:9/268: fsync d1/da/d13/d22/f2e 0 2024-04-03T08:39:11.802 INFO:tasks.workunit.client.1.smithi181.stdout:5/203: creat d4/f3f x:0 0 0 2024-04-03T08:39:11.803 INFO:tasks.workunit.client.1.smithi181.stdout:8/164: dwrite d4/d6/db/d14/d31/d1c/f2b [0,4194304] 0 2024-04-03T08:39:11.803 INFO:tasks.workunit.client.0.smithi157.stdout:7/415: mknod d0/d11/d6f/d89/d8c/ca3 0 2024-04-03T08:39:11.804 INFO:tasks.workunit.client.0.smithi157.stdout:7/416: stat d0/d4/l64 0 2024-04-03T08:39:11.807 INFO:tasks.workunit.client.0.smithi157.stdout:8/405: truncate d2/d11/d10/d24/d5b/f47 492658 0 2024-04-03T08:39:11.807 INFO:tasks.workunit.client.1.smithi181.stdout:9/269: fsync d1/da/d28/d30/f47 0 2024-04-03T08:39:11.808 INFO:tasks.workunit.client.0.smithi157.stdout:8/406: stat d2/c21 0 2024-04-03T08:39:11.808 INFO:tasks.workunit.client.1.smithi181.stdout:8/165: rename d4 to d4/d6/db/d35 22 2024-04-03T08:39:11.809 INFO:tasks.workunit.client.0.smithi157.stdout:1/329: link d2/d11/d24/d39/d3b/d2e/d48/d58/c65 d2/d11/d24/d39/d3b/c6d 0 2024-04-03T08:39:11.810 INFO:tasks.workunit.client.1.smithi181.stdout:9/270: write d1/f6 [440259,16498] 0 2024-04-03T08:39:11.813 INFO:tasks.workunit.client.1.smithi181.stdout:0/187: dread d5/dc/d10/f27 [0,4194304] 0 2024-04-03T08:39:11.815 INFO:tasks.workunit.client.0.smithi157.stdout:8/407: unlink d2/f9 0 2024-04-03T08:39:11.817 INFO:tasks.workunit.client.1.smithi181.stdout:0/188: read - d5/dc/d14/f3a zero size 2024-04-03T08:39:11.818 INFO:tasks.workunit.client.1.smithi181.stdout:9/271: read d1/da/fb [865848,71113] 0 2024-04-03T08:39:11.818 INFO:tasks.workunit.client.1.smithi181.stdout:2/232: dwrite d13/d1c/d4a/f4d [0,4194304] 0 2024-04-03T08:39:11.819 INFO:tasks.workunit.client.0.smithi157.stdout:1/330: symlink d2/d11/d24/d39/d3b/d2e/l6e 0 2024-04-03T08:39:11.821 INFO:tasks.workunit.client.0.smithi157.stdout:1/331: fsync d2/d11/d24/d39/f4a 0 2024-04-03T08:39:11.821 INFO:tasks.workunit.client.1.smithi181.stdout:4/216: dwrite d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:11.822 INFO:tasks.workunit.client.1.smithi181.stdout:0/189: chown d5/d9/d13/l1a 166971 1 2024-04-03T08:39:11.823 INFO:tasks.workunit.client.1.smithi181.stdout:3/192: unlink d0/d17/f2f 0 2024-04-03T08:39:11.824 INFO:tasks.workunit.client.1.smithi181.stdout:9/272: truncate d1/d34/d39/f50 28960 0 2024-04-03T08:39:11.825 INFO:tasks.workunit.client.1.smithi181.stdout:3/193: dread - d0/d5/f33 zero size 2024-04-03T08:39:11.826 INFO:tasks.workunit.client.1.smithi181.stdout:6/208: symlink d6/d31/d36/l47 0 2024-04-03T08:39:11.827 INFO:tasks.workunit.client.0.smithi157.stdout:7/417: dwrite d0/d11/d15/d1b/f73 [4194304,4194304] 0 2024-04-03T08:39:11.827 INFO:tasks.workunit.client.1.smithi181.stdout:3/194: write d0/d5/f33 [667833,122828] 0 2024-04-03T08:39:11.829 INFO:tasks.workunit.client.0.smithi157.stdout:1/332: chown d2/d11/d24/f13 1 1 2024-04-03T08:39:11.835 INFO:tasks.workunit.client.0.smithi157.stdout:8/408: creat d2/d11/f87 x:0 0 0 2024-04-03T08:39:11.839 INFO:tasks.workunit.client.1.smithi181.stdout:7/171: creat d0/f3c x:0 0 0 2024-04-03T08:39:11.846 INFO:tasks.workunit.client.1.smithi181.stdout:9/273: dwrite d1/d34/d39/f50 [0,4194304] 0 2024-04-03T08:39:11.847 INFO:tasks.workunit.client.1.smithi181.stdout:2/233: symlink d13/l60 0 2024-04-03T08:39:11.847 INFO:tasks.workunit.client.0.smithi157.stdout:4/388: dread da/df/f14 [0,4194304] 0 2024-04-03T08:39:11.848 INFO:tasks.workunit.client.0.smithi157.stdout:8/409: mknod d2/c88 0 2024-04-03T08:39:11.848 INFO:tasks.workunit.client.0.smithi157.stdout:7/418: dwrite d0/d11/f21 [4194304,4194304] 0 2024-04-03T08:39:11.850 INFO:tasks.workunit.client.1.smithi181.stdout:2/234: dread - d13/d22/d27/f2c zero size 2024-04-03T08:39:11.850 INFO:tasks.workunit.client.0.smithi157.stdout:1/333: getdents d2/d11/d24/d67 0 2024-04-03T08:39:11.851 INFO:tasks.workunit.client.1.smithi181.stdout:9/274: truncate d1/da/d13/d22/f45 682962 0 2024-04-03T08:39:11.852 INFO:tasks.workunit.client.1.smithi181.stdout:4/217: creat d1/d16/d1f/f45 x:0 0 0 2024-04-03T08:39:11.856 INFO:tasks.workunit.client.1.smithi181.stdout:3/195: rename d0/d5/d16 to d0/d17/d36 0 2024-04-03T08:39:11.861 INFO:tasks.workunit.client.0.smithi157.stdout:8/410: truncate d2/d11/d10/f16 413046 0 2024-04-03T08:39:11.863 INFO:tasks.workunit.client.0.smithi157.stdout:2/415: sync 2024-04-03T08:39:11.863 INFO:tasks.workunit.client.0.smithi157.stdout:6/406: sync 2024-04-03T08:39:11.864 INFO:tasks.workunit.client.0.smithi157.stdout:3/366: sync 2024-04-03T08:39:11.864 INFO:tasks.workunit.client.1.smithi181.stdout:7/172: chown d0/d1/l2b 116301 1 2024-04-03T08:39:11.864 INFO:tasks.workunit.client.1.smithi181.stdout:4/218: creat d1/d1e/f46 x:0 0 0 2024-04-03T08:39:11.865 INFO:tasks.workunit.client.1.smithi181.stdout:4/219: readlink d1/l6 0 2024-04-03T08:39:11.866 INFO:tasks.workunit.client.0.smithi157.stdout:4/389: creat da/df/d11/f82 x:0 0 0 2024-04-03T08:39:11.866 INFO:tasks.workunit.client.1.smithi181.stdout:5/204: creat d4/d18/d2c/f40 x:0 0 0 2024-04-03T08:39:11.867 INFO:tasks.workunit.client.1.smithi181.stdout:4/220: readlink d1/l5 0 2024-04-03T08:39:11.870 INFO:tasks.workunit.client.1.smithi181.stdout:4/221: fdatasync d1/d1e/f1a 0 2024-04-03T08:39:11.874 INFO:tasks.workunit.client.0.smithi157.stdout:8/411: write d2/d11/f87 [660722,41743] 0 2024-04-03T08:39:11.875 INFO:tasks.workunit.client.1.smithi181.stdout:0/190: dwrite d5/dc/d14/f22 [4194304,4194304] 0 2024-04-03T08:39:11.880 INFO:tasks.workunit.client.1.smithi181.stdout:1/184: link d10/c13 d10/d15/d17/d23/c39 0 2024-04-03T08:39:11.881 INFO:tasks.workunit.client.0.smithi157.stdout:7/419: dwrite d0/d11/d15/f2e [0,4194304] 0 2024-04-03T08:39:11.882 INFO:tasks.workunit.client.0.smithi157.stdout:3/367: mkdir d8/d1e/d2d/d39/d51/d7e 0 2024-04-03T08:39:11.882 INFO:tasks.workunit.client.0.smithi157.stdout:6/407: mkdir d1/d5/d17/d29/d62/d7f/d89 0 2024-04-03T08:39:11.888 INFO:tasks.workunit.client.0.smithi157.stdout:2/416: symlink d3/d2e/d32/l91 0 2024-04-03T08:39:11.892 INFO:tasks.workunit.client.1.smithi181.stdout:2/235: getdents d13/d22/d27 0 2024-04-03T08:39:11.892 INFO:tasks.workunit.client.0.smithi157.stdout:1/334: dwrite d2/d11/d24/d39/f4a [0,4194304] 0 2024-04-03T08:39:11.893 INFO:tasks.workunit.client.1.smithi181.stdout:2/236: fsync d13/d22/d27/f4f 0 2024-04-03T08:39:11.894 INFO:tasks.workunit.client.1.smithi181.stdout:4/222: dwrite d1/f32 [0,4194304] 0 2024-04-03T08:39:11.894 INFO:tasks.workunit.client.1.smithi181.stdout:9/275: getdents d1/da/d13/d22 0 2024-04-03T08:39:11.897 INFO:tasks.workunit.client.0.smithi157.stdout:6/408: symlink d1/d5/d17/d29/d80/l8a 0 2024-04-03T08:39:11.897 INFO:tasks.workunit.client.0.smithi157.stdout:7/420: write d0/d11/d15/d17/f77 [160803,18141] 0 2024-04-03T08:39:11.903 INFO:tasks.workunit.client.0.smithi157.stdout:3/368: mkdir d8/d13/d1b/d5b/d7f 0 2024-04-03T08:39:11.905 INFO:tasks.workunit.client.1.smithi181.stdout:6/209: truncate d6/d31/d36/f34 223100 0 2024-04-03T08:39:11.910 INFO:tasks.workunit.client.1.smithi181.stdout:5/205: link d4/d22/f38 d4/d18/d25/f41 0 2024-04-03T08:39:11.912 INFO:tasks.workunit.client.1.smithi181.stdout:5/206: read - d4/d18/d25/f20 zero size 2024-04-03T08:39:11.913 INFO:tasks.workunit.client.0.smithi157.stdout:4/390: dwrite da/df/d24/d35/d6a/d78/f7a [0,4194304] 0 2024-04-03T08:39:11.917 INFO:tasks.workunit.client.1.smithi181.stdout:4/223: creat d1/d16/d24/f47 x:0 0 0 2024-04-03T08:39:11.919 INFO:tasks.workunit.client.1.smithi181.stdout:3/196: dwrite d0/d17/d36/d1e/f31 [0,4194304] 0 2024-04-03T08:39:11.922 INFO:tasks.workunit.client.1.smithi181.stdout:8/166: write d4/d6/f8 [1644751,11874] 0 2024-04-03T08:39:11.924 INFO:tasks.workunit.client.1.smithi181.stdout:9/276: dwrite d1/da/d1a/f27 [0,4194304] 0 2024-04-03T08:39:11.924 INFO:tasks.workunit.client.0.smithi157.stdout:4/391: truncate da/df/d2f/d54/f5a 513400 0 2024-04-03T08:39:11.925 INFO:tasks.workunit.client.0.smithi157.stdout:7/421: rmdir d0/d11/d15/d17/d52 39 2024-04-03T08:39:11.929 INFO:tasks.workunit.client.0.smithi157.stdout:3/369: symlink d8/d13/d1b/d4e/l80 0 2024-04-03T08:39:11.932 INFO:tasks.workunit.client.0.smithi157.stdout:3/370: truncate d8/f2c 1090978 0 2024-04-03T08:39:11.932 INFO:tasks.workunit.client.1.smithi181.stdout:4/224: creat d1/d16/d24/f48 x:0 0 0 2024-04-03T08:39:11.933 INFO:tasks.workunit.client.1.smithi181.stdout:5/207: dread - d4/f39 zero size 2024-04-03T08:39:11.938 INFO:tasks.workunit.client.1.smithi181.stdout:8/167: creat d4/f36 x:0 0 0 2024-04-03T08:39:11.938 INFO:tasks.workunit.client.0.smithi157.stdout:2/417: dread d3/d12/fe [0,4194304] 0 2024-04-03T08:39:11.938 INFO:tasks.workunit.client.1.smithi181.stdout:0/191: link d5/dc/c1b d5/dc/c3b 0 2024-04-03T08:39:11.939 INFO:tasks.workunit.client.1.smithi181.stdout:5/208: stat d4/d18/d25/f20 0 2024-04-03T08:39:11.940 INFO:tasks.workunit.client.1.smithi181.stdout:9/277: chown d1/da/d1a/f56 11134498 1 2024-04-03T08:39:11.944 INFO:tasks.workunit.client.0.smithi157.stdout:3/371: symlink d8/d1e/d2d/l81 0 2024-04-03T08:39:11.944 INFO:tasks.workunit.client.1.smithi181.stdout:6/210: truncate d6/d7/d9/f21 508758 0 2024-04-03T08:39:11.946 INFO:tasks.workunit.client.1.smithi181.stdout:3/197: dwrite d0/d17/d36/d1e/f28 [4194304,4194304] 0 2024-04-03T08:39:11.947 INFO:tasks.workunit.client.1.smithi181.stdout:1/185: getdents d10/d15/d17/d30 0 2024-04-03T08:39:11.948 INFO:tasks.workunit.client.0.smithi157.stdout:2/418: truncate d3/d12/fd 1396962 0 2024-04-03T08:39:11.949 INFO:tasks.workunit.client.1.smithi181.stdout:1/186: chown d10/c2b 0 1 2024-04-03T08:39:11.949 INFO:tasks.workunit.client.0.smithi157.stdout:6/409: dread d1/d5/f1a [0,4194304] 0 2024-04-03T08:39:11.950 INFO:tasks.workunit.client.1.smithi181.stdout:4/225: mknod d1/d16/d37/d34/c49 0 2024-04-03T08:39:11.951 INFO:tasks.workunit.client.1.smithi181.stdout:1/187: chown d10/d15/d17/d19/d33 1531419 1 2024-04-03T08:39:11.952 INFO:tasks.workunit.client.1.smithi181.stdout:5/209: symlink d4/d22/l42 0 2024-04-03T08:39:11.952 INFO:tasks.workunit.client.1.smithi181.stdout:1/188: fsync f2 0 2024-04-03T08:39:11.953 INFO:tasks.workunit.client.1.smithi181.stdout:0/192: creat d5/dc/d14/f3c x:0 0 0 2024-04-03T08:39:11.953 INFO:tasks.workunit.client.0.smithi157.stdout:1/335: dread d2/d11/d24/d39/d3b/d1b/f30 [0,4194304] 0 2024-04-03T08:39:11.954 INFO:tasks.workunit.client.1.smithi181.stdout:9/278: creat d1/d34/d39/f59 x:0 0 0 2024-04-03T08:39:11.956 INFO:tasks.workunit.client.1.smithi181.stdout:3/198: fsync d0/d5/d6/dd/f21 0 2024-04-03T08:39:11.956 INFO:tasks.workunit.client.1.smithi181.stdout:1/189: readlink d10/d15/d17/d19/l1c 0 2024-04-03T08:39:11.957 INFO:tasks.workunit.client.0.smithi157.stdout:7/422: dwrite d0/d5/f92 [0,4194304] 0 2024-04-03T08:39:11.957 INFO:tasks.workunit.client.0.smithi157.stdout:6/410: symlink d1/d4b/d38/d59/l8b 0 2024-04-03T08:39:11.960 INFO:tasks.workunit.client.0.smithi157.stdout:2/419: rename d3/d2e/d65/f7f to d3/db/d44/f92 0 2024-04-03T08:39:11.965 INFO:tasks.workunit.client.1.smithi181.stdout:5/210: mknod d4/c43 0 2024-04-03T08:39:11.965 INFO:tasks.workunit.client.1.smithi181.stdout:9/279: truncate d1/da/f11 827095 0 2024-04-03T08:39:11.967 INFO:tasks.workunit.client.1.smithi181.stdout:1/190: creat d10/d15/d17/d23/d27/f3a x:0 0 0 2024-04-03T08:39:11.967 INFO:tasks.workunit.client.0.smithi157.stdout:7/423: dread - d0/d11/d15/d17/d52/f82 zero size 2024-04-03T08:39:11.970 INFO:tasks.workunit.client.0.smithi157.stdout:3/372: link d8/d13/d1b/c25 d8/d1e/d2d/c82 0 2024-04-03T08:39:11.973 INFO:tasks.workunit.client.0.smithi157.stdout:1/336: unlink d2/d11/d24/f38 0 2024-04-03T08:39:11.978 INFO:tasks.workunit.client.0.smithi157.stdout:6/411: dwrite d1/d5/d17/f4e [0,4194304] 0 2024-04-03T08:39:11.980 INFO:tasks.workunit.client.1.smithi181.stdout:5/211: fdatasync d4/d18/f23 0 2024-04-03T08:39:11.981 INFO:tasks.workunit.client.1.smithi181.stdout:4/226: dwrite d1/f7 [0,4194304] 0 2024-04-03T08:39:11.981 INFO:tasks.workunit.client.1.smithi181.stdout:0/193: dwrite d5/dc/f21 [4194304,4194304] 0 2024-04-03T08:39:11.982 INFO:tasks.workunit.client.0.smithi157.stdout:8/412: truncate d2/d11/d10/d24/d5b/d2e/d56/f5e 1835813 0 2024-04-03T08:39:11.983 INFO:tasks.workunit.client.0.smithi157.stdout:3/373: truncate d8/f28 877026 0 2024-04-03T08:39:11.985 INFO:tasks.workunit.client.0.smithi157.stdout:3/374: read d8/d13/f15 [383427,78548] 0 2024-04-03T08:39:11.985 INFO:tasks.workunit.client.1.smithi181.stdout:3/199: link d0/d5/d6/c12 d0/d17/d36/d1e/c37 0 2024-04-03T08:39:11.988 INFO:tasks.workunit.client.1.smithi181.stdout:2/237: truncate d13/d1c/d4a/f4d 1903016 0 2024-04-03T08:39:11.989 INFO:tasks.workunit.client.1.smithi181.stdout:0/194: chown d5/d9/f32 209 1 2024-04-03T08:39:11.991 INFO:tasks.workunit.client.0.smithi157.stdout:7/424: creat d0/d11/d15/d17/d1c/da1/fa4 x:0 0 0 2024-04-03T08:39:11.994 INFO:tasks.workunit.client.1.smithi181.stdout:5/212: fdatasync d4/f13 0 2024-04-03T08:39:11.994 INFO:tasks.workunit.client.1.smithi181.stdout:1/191: dwrite d10/d15/f34 [0,4194304] 0 2024-04-03T08:39:11.995 INFO:tasks.workunit.client.0.smithi157.stdout:6/412: write d1/d5/d17/d2a/d37/f60 [5138933,58127] 0 2024-04-03T08:39:11.997 INFO:tasks.workunit.client.1.smithi181.stdout:1/192: chown d10/d15/d17/d19/l1c 0 1 2024-04-03T08:39:11.999 INFO:tasks.workunit.client.0.smithi157.stdout:6/413: stat d1/d5/d1b/c43 0 2024-04-03T08:39:11.999 INFO:tasks.workunit.client.1.smithi181.stdout:8/168: write d4/f36 [131909,12292] 0 2024-04-03T08:39:12.001 INFO:tasks.workunit.client.1.smithi181.stdout:1/193: dread - d10/d15/d17/f21 zero size 2024-04-03T08:39:12.002 INFO:tasks.workunit.client.1.smithi181.stdout:9/280: rename d1/da/d13/f29 to d1/da/f5a 0 2024-04-03T08:39:12.005 INFO:tasks.workunit.client.1.smithi181.stdout:8/169: write d4/d6/f8 [1824909,7437] 0 2024-04-03T08:39:12.005 INFO:tasks.workunit.client.1.smithi181.stdout:4/227: creat d1/d16/d1f/f4a x:0 0 0 2024-04-03T08:39:12.012 INFO:tasks.workunit.client.1.smithi181.stdout:0/195: symlink d5/dc/d10/d30/l3d 0 2024-04-03T08:39:12.014 INFO:tasks.workunit.client.1.smithi181.stdout:0/196: chown d5/d9/l2b 1173 1 2024-04-03T08:39:12.016 INFO:tasks.workunit.client.0.smithi157.stdout:1/337: rmdir d2/d11/d24/d39/d3b/d69 0 2024-04-03T08:39:12.017 INFO:tasks.workunit.client.1.smithi181.stdout:6/211: dwrite d6/d7/d9/fa [0,4194304] 0 2024-04-03T08:39:12.021 INFO:tasks.workunit.client.0.smithi157.stdout:3/375: mkdir d8/d13/d1b/d83 0 2024-04-03T08:39:12.024 INFO:tasks.workunit.client.0.smithi157.stdout:3/376: write d8/d1e/f7a [185438,95999] 0 2024-04-03T08:39:12.025 INFO:tasks.workunit.client.0.smithi157.stdout:2/420: write d3/d12/fa [3259004,109985] 0 2024-04-03T08:39:12.027 INFO:tasks.workunit.client.0.smithi157.stdout:7/425: dread d0/d4/f10 [0,4194304] 0 2024-04-03T08:39:12.029 INFO:tasks.workunit.client.0.smithi157.stdout:2/421: dread - d3/db/f7e zero size 2024-04-03T08:39:12.030 INFO:tasks.workunit.client.1.smithi181.stdout:9/281: creat d1/da/d13/f5b x:0 0 0 2024-04-03T08:39:12.033 INFO:tasks.workunit.client.0.smithi157.stdout:3/377: symlink d8/d1e/d2d/d39/d51/d48/l84 0 2024-04-03T08:39:12.033 INFO:tasks.workunit.client.0.smithi157.stdout:2/422: dread - d3/d12/d43/d4b/f79 zero size 2024-04-03T08:39:12.033 INFO:tasks.workunit.client.0.smithi157.stdout:7/426: write d0/d11/d15/d1b/f3f [104420,15366] 0 2024-04-03T08:39:12.035 INFO:tasks.workunit.client.0.smithi157.stdout:9/343: sync 2024-04-03T08:39:12.038 INFO:tasks.workunit.client.1.smithi181.stdout:4/228: unlink d1/f2f 0 2024-04-03T08:39:12.039 INFO:tasks.workunit.client.1.smithi181.stdout:6/212: dwrite d6/f42 [0,4194304] 0 2024-04-03T08:39:12.041 INFO:tasks.workunit.client.0.smithi157.stdout:6/414: dwrite d1/d5/d17/f64 [0,4194304] 0 2024-04-03T08:39:12.042 INFO:tasks.workunit.client.0.smithi157.stdout:8/413: rename d2/d11/d10/d24/d5b/d2e/d56 to d2/d6f/d70/d89 0 2024-04-03T08:39:12.045 INFO:tasks.workunit.client.1.smithi181.stdout:0/197: creat d5/d9/f3e x:0 0 0 2024-04-03T08:39:12.046 INFO:tasks.workunit.client.1.smithi181.stdout:5/213: dread d4/d18/d2c/f34 [0,4194304] 0 2024-04-03T08:39:12.049 INFO:tasks.workunit.client.0.smithi157.stdout:6/415: fsync d1/d5/d17/d29/d62/f6b 0 2024-04-03T08:39:12.050 INFO:tasks.workunit.client.0.smithi157.stdout:6/416: stat d1/d4b/d38/d59 0 2024-04-03T08:39:12.053 INFO:tasks.workunit.client.0.smithi157.stdout:7/427: mkdir d0/d4/da5 0 2024-04-03T08:39:12.059 INFO:tasks.workunit.client.0.smithi157.stdout:3/378: dwrite d8/d13/f1a [0,4194304] 0 2024-04-03T08:39:12.060 INFO:tasks.workunit.client.0.smithi157.stdout:9/344: creat d1/d36/f71 x:0 0 0 2024-04-03T08:39:12.062 INFO:tasks.workunit.client.0.smithi157.stdout:1/338: creat d2/d11/d24/d39/f6f x:0 0 0 2024-04-03T08:39:12.066 INFO:tasks.workunit.client.1.smithi181.stdout:9/282: dread d1/f6 [0,4194304] 0 2024-04-03T08:39:12.068 INFO:tasks.workunit.client.0.smithi157.stdout:2/423: rename d3/d12/d43/d4b/c81 to d3/d2e/d32/d3c/c93 0 2024-04-03T08:39:12.073 INFO:tasks.workunit.client.0.smithi157.stdout:8/414: creat d2/d11/d10/d24/d5b/d53/f8a x:0 0 0 2024-04-03T08:39:12.073 INFO:tasks.workunit.client.0.smithi157.stdout:5/423: sync 2024-04-03T08:39:12.073 INFO:tasks.workunit.client.0.smithi157.stdout:0/400: sync 2024-04-03T08:39:12.074 INFO:tasks.workunit.client.0.smithi157.stdout:7/428: creat d0/d11/d15/d17/d43/d8a/fa6 x:0 0 0 2024-04-03T08:39:12.081 INFO:tasks.workunit.client.1.smithi181.stdout:6/213: creat d6/d31/f48 x:0 0 0 2024-04-03T08:39:12.081 INFO:tasks.workunit.client.1.smithi181.stdout:1/194: dwrite d10/f11 [0,4194304] 0 2024-04-03T08:39:12.082 INFO:tasks.workunit.client.1.smithi181.stdout:6/214: fdatasync d6/d7/f38 0 2024-04-03T08:39:12.085 INFO:tasks.workunit.client.1.smithi181.stdout:2/238: write fa [698712,130699] 0 2024-04-03T08:39:12.087 INFO:tasks.workunit.client.0.smithi157.stdout:6/417: rename d1/d5/d17/d29/d62/f69 to d1/d5/d17/d2a/d85/f8c 0 2024-04-03T08:39:12.090 INFO:tasks.workunit.client.0.smithi157.stdout:8/415: fsync d2/fb 0 2024-04-03T08:39:12.091 INFO:tasks.workunit.client.0.smithi157.stdout:2/424: dwrite d3/f48 [0,4194304] 0 2024-04-03T08:39:12.092 INFO:tasks.workunit.client.1.smithi181.stdout:0/198: unlink d5/dc/d14/c24 0 2024-04-03T08:39:12.092 INFO:tasks.workunit.client.0.smithi157.stdout:8/416: write d2/d20/d23/f41 [7391981,26857] 0 2024-04-03T08:39:12.097 INFO:tasks.workunit.client.0.smithi157.stdout:0/401: creat d2/d9/dc/df/d78/d6a/f96 x:0 0 0 2024-04-03T08:39:12.098 INFO:tasks.workunit.client.1.smithi181.stdout:3/200: rename d0/f13 to d0/d5/f38 0 2024-04-03T08:39:12.099 INFO:tasks.workunit.client.0.smithi157.stdout:2/425: write d3/db/d44/d4c/d5a/d88/f8c [844565,68946] 0 2024-04-03T08:39:12.105 INFO:tasks.workunit.client.0.smithi157.stdout:7/429: dread d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:12.110 INFO:tasks.workunit.client.0.smithi157.stdout:1/339: link d2/f49 d2/d11/d24/d67/f70 0 2024-04-03T08:39:12.111 INFO:tasks.workunit.client.1.smithi181.stdout:4/229: symlink d1/l4b 0 2024-04-03T08:39:12.115 INFO:tasks.workunit.client.0.smithi157.stdout:9/345: rename d1/d15/f2d to d1/d36/d69/f72 0 2024-04-03T08:39:12.116 INFO:tasks.workunit.client.0.smithi157.stdout:5/424: mknod dc/c95 0 2024-04-03T08:39:12.116 INFO:tasks.workunit.client.1.smithi181.stdout:9/283: dwrite d1/da/f21 [0,4194304] 0 2024-04-03T08:39:12.118 INFO:tasks.workunit.client.0.smithi157.stdout:4/392: sync 2024-04-03T08:39:12.119 INFO:tasks.workunit.client.0.smithi157.stdout:2/426: dwrite d3/db/d44/f64 [0,4194304] 0 2024-04-03T08:39:12.119 INFO:tasks.workunit.client.0.smithi157.stdout:5/425: chown dc/f67 0 1 2024-04-03T08:39:12.121 INFO:tasks.workunit.client.1.smithi181.stdout:2/239: creat d13/d22/d27/d46/f61 x:0 0 0 2024-04-03T08:39:12.121 INFO:tasks.workunit.client.1.smithi181.stdout:0/199: symlink d5/d9/l3f 0 2024-04-03T08:39:12.123 INFO:tasks.workunit.client.0.smithi157.stdout:8/417: fsync d2/d11/d10/f1f 0 2024-04-03T08:39:12.125 INFO:tasks.workunit.client.1.smithi181.stdout:5/214: dread d4/f12 [4194304,4194304] 0 2024-04-03T08:39:12.126 INFO:tasks.workunit.client.0.smithi157.stdout:0/402: dwrite d2/d9/dc/df/d1b/f34 [0,4194304] 0 2024-04-03T08:39:12.126 INFO:tasks.workunit.client.0.smithi157.stdout:3/379: rmdir d8/d13/d1b/d3a 0 2024-04-03T08:39:12.126 INFO:tasks.workunit.client.0.smithi157.stdout:9/346: truncate d1/d4a/f58 262858 0 2024-04-03T08:39:12.127 INFO:tasks.workunit.client.0.smithi157.stdout:5/426: read - dc/d29/d56/d18/d21/f61 zero size 2024-04-03T08:39:12.146 INFO:tasks.workunit.client.1.smithi181.stdout:1/195: mknod d10/d15/d17/d23/c3b 0 2024-04-03T08:39:12.148 INFO:tasks.workunit.client.0.smithi157.stdout:2/427: dwrite d3/db/d44/f64 [0,4194304] 0 2024-04-03T08:39:12.149 INFO:tasks.workunit.client.0.smithi157.stdout:1/340: mknod d2/d11/d24/d39/d3b/d2e/d48/d5d/c71 0 2024-04-03T08:39:12.151 INFO:tasks.workunit.client.1.smithi181.stdout:4/230: unlink d1/l4b 0 2024-04-03T08:39:12.152 INFO:tasks.workunit.client.0.smithi157.stdout:1/341: read - d2/f45 zero size 2024-04-03T08:39:12.153 INFO:tasks.workunit.client.1.smithi181.stdout:4/231: write d1/d16/f13 [2999085,86231] 0 2024-04-03T08:39:12.155 INFO:tasks.workunit.client.0.smithi157.stdout:6/418: fsync d1/d5/d17/d2a/f82 0 2024-04-03T08:39:12.159 INFO:tasks.workunit.client.0.smithi157.stdout:7/430: rename d0/d5 to d0/d11/d6f/d76/da7 0 2024-04-03T08:39:12.160 INFO:tasks.workunit.client.1.smithi181.stdout:9/284: mkdir d1/da/d13/d41/d5c 0 2024-04-03T08:39:12.162 INFO:tasks.workunit.client.0.smithi157.stdout:0/403: dwrite d2/d9/dc/df/d1b/d35/f56 [0,4194304] 0 2024-04-03T08:39:12.165 INFO:tasks.workunit.client.0.smithi157.stdout:7/431: write d0/d11/d15/d35/f95 [821440,104475] 0 2024-04-03T08:39:12.170 INFO:tasks.workunit.client.0.smithi157.stdout:7/432: write d0/d11/d15/d17/f77 [348965,4566] 0 2024-04-03T08:39:12.170 INFO:tasks.workunit.client.0.smithi157.stdout:9/347: fsync d1/d15/f1a 0 2024-04-03T08:39:12.175 INFO:tasks.workunit.client.1.smithi181.stdout:8/170: getdents d4/d2a 0 2024-04-03T08:39:12.177 INFO:tasks.workunit.client.0.smithi157.stdout:2/428: creat d3/d2e/d32/f94 x:0 0 0 2024-04-03T08:39:12.178 INFO:tasks.workunit.client.1.smithi181.stdout:1/196: mknod d10/d15/d17/d30/c3c 0 2024-04-03T08:39:12.180 INFO:tasks.workunit.client.1.smithi181.stdout:1/197: readlink d10/d15/d17/d19/l1b 0 2024-04-03T08:39:12.182 INFO:tasks.workunit.client.0.smithi157.stdout:1/342: creat d2/d11/d24/d39/d3b/d2e/d48/d58/f72 x:0 0 0 2024-04-03T08:39:12.184 INFO:tasks.workunit.client.1.smithi181.stdout:6/215: creat d6/d7/f49 x:0 0 0 2024-04-03T08:39:12.187 INFO:tasks.workunit.client.1.smithi181.stdout:4/232: rename d1/l2d to d1/d1e/d2c/l4c 0 2024-04-03T08:39:12.188 INFO:tasks.workunit.client.0.smithi157.stdout:4/393: fdatasync f4 0 2024-04-03T08:39:12.189 INFO:tasks.workunit.client.0.smithi157.stdout:5/427: dwrite dc/ff [0,4194304] 0 2024-04-03T08:39:12.192 INFO:tasks.workunit.client.0.smithi157.stdout:4/394: write da/df/f2a [1425029,112944] 0 2024-04-03T08:39:12.192 INFO:tasks.workunit.client.0.smithi157.stdout:8/418: symlink d2/l8b 0 2024-04-03T08:39:12.198 INFO:tasks.workunit.client.1.smithi181.stdout:5/215: dwrite d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:12.198 INFO:tasks.workunit.client.1.smithi181.stdout:3/201: rmdir d0/d5/d6/dd/d25/d34 0 2024-04-03T08:39:12.198 INFO:tasks.workunit.client.0.smithi157.stdout:8/419: dread d2/d11/f1d [4194304,4194304] 0 2024-04-03T08:39:12.199 INFO:tasks.workunit.client.0.smithi157.stdout:6/419: mknod d1/d5/d17/d2a/d37/c8d 0 2024-04-03T08:39:12.202 INFO:tasks.workunit.client.1.smithi181.stdout:8/171: mkdir d4/d2a/d37 0 2024-04-03T08:39:12.203 INFO:tasks.workunit.client.1.smithi181.stdout:5/216: write d4/d18/d25/f20 [435424,126861] 0 2024-04-03T08:39:12.204 INFO:tasks.workunit.client.1.smithi181.stdout:0/200: truncate d5/dc/f12 2834738 0 2024-04-03T08:39:12.205 INFO:tasks.workunit.client.1.smithi181.stdout:8/172: chown d4/d2a/d37 206079 1 2024-04-03T08:39:12.207 INFO:tasks.workunit.client.0.smithi157.stdout:9/348: creat d1/d36/d66/f73 x:0 0 0 2024-04-03T08:39:12.210 INFO:tasks.workunit.client.1.smithi181.stdout:6/216: unlink d6/d31/d36/c37 0 2024-04-03T08:39:12.211 INFO:tasks.workunit.client.0.smithi157.stdout:3/380: creat d8/d13/d1b/d37/f85 x:0 0 0 2024-04-03T08:39:12.211 INFO:tasks.workunit.client.1.smithi181.stdout:6/217: chown d6/d31 5796 1 2024-04-03T08:39:12.214 INFO:tasks.workunit.client.1.smithi181.stdout:9/285: dwrite d1/da/d13/d41/f2a [0,4194304] 0 2024-04-03T08:39:12.216 INFO:tasks.workunit.client.0.smithi157.stdout:5/428: symlink dc/d29/d56/d52/l96 0 2024-04-03T08:39:12.216 INFO:tasks.workunit.client.1.smithi181.stdout:0/201: rmdir d5/d9/d2e 39 2024-04-03T08:39:12.217 INFO:tasks.workunit.client.1.smithi181.stdout:3/202: write d0/d5/f38 [9179536,31569] 0 2024-04-03T08:39:12.222 INFO:tasks.workunit.client.1.smithi181.stdout:9/286: write d1/da/d28/f49 [3288676,75562] 0 2024-04-03T08:39:12.223 INFO:tasks.workunit.client.1.smithi181.stdout:4/233: symlink d1/d16/d1f/d2b/l4d 0 2024-04-03T08:39:12.227 INFO:tasks.workunit.client.1.smithi181.stdout:8/173: fsync d4/fc 0 2024-04-03T08:39:12.227 INFO:tasks.workunit.client.1.smithi181.stdout:5/217: dread d4/d18/f28 [0,4194304] 0 2024-04-03T08:39:12.233 INFO:tasks.workunit.client.1.smithi181.stdout:6/218: dwrite d6/d3e/f46 [0,4194304] 0 2024-04-03T08:39:12.233 INFO:tasks.workunit.client.0.smithi157.stdout:6/420: creat d1/d5/d17/d2a/d37/f8e x:0 0 0 2024-04-03T08:39:12.234 INFO:tasks.workunit.client.0.smithi157.stdout:5/429: dwrite dc/d29/d56/d18/f63 [0,4194304] 0 2024-04-03T08:39:12.238 INFO:tasks.workunit.client.1.smithi181.stdout:6/219: read - d6/d31/f48 zero size 2024-04-03T08:39:12.241 INFO:tasks.workunit.client.1.smithi181.stdout:9/287: symlink d1/da/d13/l5d 0 2024-04-03T08:39:12.243 INFO:tasks.workunit.client.0.smithi157.stdout:9/349: creat d1/d15/d27/d5c/f74 x:0 0 0 2024-04-03T08:39:12.248 INFO:tasks.workunit.client.0.smithi157.stdout:1/343: dwrite d2/d11/d24/d39/f54 [0,4194304] 0 2024-04-03T08:39:12.251 INFO:tasks.workunit.client.1.smithi181.stdout:3/203: dwrite d0/d17/d36/d1e/f31 [0,4194304] 0 2024-04-03T08:39:12.254 INFO:tasks.workunit.client.1.smithi181.stdout:8/174: write d4/f19 [22426,46783] 0 2024-04-03T08:39:12.254 INFO:tasks.workunit.client.1.smithi181.stdout:4/234: unlink d1/d16/f17 0 2024-04-03T08:39:12.257 INFO:tasks.workunit.client.1.smithi181.stdout:7/173: sync 2024-04-03T08:39:12.257 INFO:tasks.workunit.client.0.smithi157.stdout:4/395: creat da/df/d6b/f83 x:0 0 0 2024-04-03T08:39:12.259 INFO:tasks.workunit.client.1.smithi181.stdout:1/198: link d10/c13 d10/d15/d17/d23/d27/c3d 0 2024-04-03T08:39:12.261 INFO:tasks.workunit.client.1.smithi181.stdout:7/174: fdatasync d0/d1/d6/de/d17/d27/f2e 0 2024-04-03T08:39:12.261 INFO:tasks.workunit.client.1.smithi181.stdout:6/220: unlink d6/d31/d36/f26 0 2024-04-03T08:39:12.262 INFO:tasks.workunit.client.0.smithi157.stdout:0/404: creat d2/d9/dc/df/d1b/d35/f97 x:0 0 0 2024-04-03T08:39:12.264 INFO:tasks.workunit.client.1.smithi181.stdout:6/221: write d6/f3a [1079489,125162] 0 2024-04-03T08:39:12.264 INFO:tasks.workunit.client.1.smithi181.stdout:0/202: creat d5/f40 x:0 0 0 2024-04-03T08:39:12.267 INFO:tasks.workunit.client.0.smithi157.stdout:8/420: mknod d2/d6f/d70/d89/d59/c8c 0 2024-04-03T08:39:12.269 INFO:tasks.workunit.client.1.smithi181.stdout:4/235: dread d1/d16/d37/d34/f35 [0,4194304] 0 2024-04-03T08:39:12.269 INFO:tasks.workunit.client.1.smithi181.stdout:0/203: read d5/d9/d2c/f2d [18901,55313] 0 2024-04-03T08:39:12.270 INFO:tasks.workunit.client.1.smithi181.stdout:5/218: mkdir d4/d44 0 2024-04-03T08:39:12.272 INFO:tasks.workunit.client.1.smithi181.stdout:4/236: write d1/d16/d37/d34/f35 [885315,93827] 0 2024-04-03T08:39:12.272 INFO:tasks.workunit.client.0.smithi157.stdout:1/344: fdatasync d2/d11/d24/f13 0 2024-04-03T08:39:12.275 INFO:tasks.workunit.client.1.smithi181.stdout:4/237: dread - d1/d16/d1f/d3f/d41/f42 zero size 2024-04-03T08:39:12.275 INFO:tasks.workunit.client.1.smithi181.stdout:8/175: rmdir d4/d6/db/d14 39 2024-04-03T08:39:12.276 INFO:tasks.workunit.client.0.smithi157.stdout:6/421: dwrite d1/d5/d17/d29/f7d [0,4194304] 0 2024-04-03T08:39:12.281 INFO:tasks.workunit.client.0.smithi157.stdout:9/350: dwrite d1/f3f [0,4194304] 0 2024-04-03T08:39:12.283 INFO:tasks.workunit.client.0.smithi157.stdout:4/396: truncate da/df/d24/f59 735835 0 2024-04-03T08:39:12.284 INFO:tasks.workunit.client.1.smithi181.stdout:1/199: unlink d10/d15/d17/d19/l1b 0 2024-04-03T08:39:12.285 INFO:tasks.workunit.client.1.smithi181.stdout:1/200: read fc [3001544,15304] 0 2024-04-03T08:39:12.286 INFO:tasks.workunit.client.0.smithi157.stdout:7/433: getdents d0/d4/d8e 0 2024-04-03T08:39:12.288 INFO:tasks.workunit.client.1.smithi181.stdout:1/201: write d10/d15/d17/f2a [249707,128737] 0 2024-04-03T08:39:12.289 INFO:tasks.workunit.client.0.smithi157.stdout:2/429: getdents d3 0 2024-04-03T08:39:12.289 INFO:tasks.workunit.client.1.smithi181.stdout:4/238: dread d1/f7 [0,4194304] 0 2024-04-03T08:39:12.290 INFO:tasks.workunit.client.1.smithi181.stdout:7/175: mknod d0/d1/d6/de/d17/c3d 0 2024-04-03T08:39:12.291 INFO:tasks.workunit.client.0.smithi157.stdout:9/351: readlink d1/d15/d16/l1c 0 2024-04-03T08:39:12.291 INFO:tasks.workunit.client.1.smithi181.stdout:7/176: fsync d0/f3b 0 2024-04-03T08:39:12.293 INFO:tasks.workunit.client.1.smithi181.stdout:4/239: truncate d1/d16/d37/d34/f35 1106826 0 2024-04-03T08:39:12.294 INFO:tasks.workunit.client.1.smithi181.stdout:4/240: dread - d1/d16/f23 zero size 2024-04-03T08:39:12.295 INFO:tasks.workunit.client.1.smithi181.stdout:4/241: dread - d1/d16/d24/f47 zero size 2024-04-03T08:39:12.295 INFO:tasks.workunit.client.1.smithi181.stdout:9/288: link d1/da/d28/f49 d1/da/d13/d22/d23/f5e 0 2024-04-03T08:39:12.302 INFO:tasks.workunit.client.0.smithi157.stdout:0/405: dwrite d2/d9/d5f/d85/f86 [0,4194304] 0 2024-04-03T08:39:12.309 INFO:tasks.workunit.client.1.smithi181.stdout:2/240: sync 2024-04-03T08:39:12.311 INFO:tasks.workunit.client.0.smithi157.stdout:6/422: chown d1/d5/d17/d2a/d37/c14 75 1 2024-04-03T08:39:12.314 INFO:tasks.workunit.client.1.smithi181.stdout:9/289: dwrite d1/da/d13/d22/f45 [0,4194304] 0 2024-04-03T08:39:12.315 INFO:tasks.workunit.client.0.smithi157.stdout:1/345: fdatasync d2/d11/d24/d39/d3b/fe 0 2024-04-03T08:39:12.316 INFO:tasks.workunit.client.0.smithi157.stdout:3/381: dwrite d8/d1e/d2d/f54 [0,4194304] 0 2024-04-03T08:39:12.316 INFO:tasks.workunit.client.0.smithi157.stdout:6/423: dread - d1/d5/d17/d2a/d37/f7b zero size 2024-04-03T08:39:12.318 INFO:tasks.workunit.client.1.smithi181.stdout:5/219: write d4/d18/f28 [4420732,56306] 0 2024-04-03T08:39:12.323 INFO:tasks.workunit.client.0.smithi157.stdout:2/430: creat d3/d12/d43/d4b/d55/f95 x:0 0 0 2024-04-03T08:39:12.323 INFO:tasks.workunit.client.0.smithi157.stdout:4/397: truncate da/d26/f2e 2822895 0 2024-04-03T08:39:12.323 INFO:tasks.workunit.client.0.smithi157.stdout:1/346: write d2/d11/d24/d39/d3b/d2e/d48/d58/f72 [723218,7164] 0 2024-04-03T08:39:12.325 INFO:tasks.workunit.client.0.smithi157.stdout:3/382: truncate d8/d1e/f7b 661906 0 2024-04-03T08:39:12.333 INFO:tasks.workunit.client.0.smithi157.stdout:5/430: dread f7 [0,4194304] 0 2024-04-03T08:39:12.336 INFO:tasks.workunit.client.0.smithi157.stdout:6/424: dread d1/f6d [0,4194304] 0 2024-04-03T08:39:12.338 INFO:tasks.workunit.client.1.smithi181.stdout:4/242: mknod d1/d16/d1f/c4e 0 2024-04-03T08:39:12.341 INFO:tasks.workunit.client.0.smithi157.stdout:5/431: truncate dc/d29/f5f 1535483 0 2024-04-03T08:39:12.342 INFO:tasks.workunit.client.1.smithi181.stdout:0/204: write d5/fe [1338578,120236] 0 2024-04-03T08:39:12.350 INFO:tasks.workunit.client.1.smithi181.stdout:2/241: creat d13/d22/d27/f62 x:0 0 0 2024-04-03T08:39:12.351 INFO:tasks.workunit.client.1.smithi181.stdout:5/220: dread - d4/f32 zero size 2024-04-03T08:39:12.352 INFO:tasks.workunit.client.0.smithi157.stdout:4/398: dread da/df/d2f/d54/f65 [0,4194304] 0 2024-04-03T08:39:12.352 INFO:tasks.workunit.client.0.smithi157.stdout:3/383: symlink d8/d1e/d2d/d3f/d4d/l86 0 2024-04-03T08:39:12.353 INFO:tasks.workunit.client.1.smithi181.stdout:2/242: read d13/f1e [2992414,71709] 0 2024-04-03T08:39:12.353 INFO:tasks.workunit.client.0.smithi157.stdout:2/431: dwrite d3/db/d44/f5b [0,4194304] 0 2024-04-03T08:39:12.356 INFO:tasks.workunit.client.1.smithi181.stdout:3/204: rename d0/d5/f2c to d0/d5/d6/f39 0 2024-04-03T08:39:12.356 INFO:tasks.workunit.client.1.smithi181.stdout:2/243: write d13/d22/d27/d46/f61 [999744,94373] 0 2024-04-03T08:39:12.359 INFO:tasks.workunit.client.0.smithi157.stdout:1/347: write d2/d11/d24/d39/d3b/d1b/f28 [1868251,53519] 0 2024-04-03T08:39:12.360 INFO:tasks.workunit.client.1.smithi181.stdout:1/202: write d10/d15/d17/d19/f2f [3929979,55428] 0 2024-04-03T08:39:12.361 INFO:tasks.workunit.client.1.smithi181.stdout:3/205: chown d0/d5/d6/dd/f24 3 1 2024-04-03T08:39:12.361 INFO:tasks.workunit.client.0.smithi157.stdout:2/432: truncate d3/f34 1008297 0 2024-04-03T08:39:12.363 INFO:tasks.workunit.client.0.smithi157.stdout:7/434: write d0/d11/d15/d35/f3b [4827915,127681] 0 2024-04-03T08:39:12.367 INFO:tasks.workunit.client.1.smithi181.stdout:6/222: truncate d6/d7/d9/fa 4044219 0 2024-04-03T08:39:12.367 INFO:tasks.workunit.client.1.smithi181.stdout:4/243: creat d1/d16/d1f/f4f x:0 0 0 2024-04-03T08:39:12.368 INFO:tasks.workunit.client.1.smithi181.stdout:4/244: readlink d1/l43 0 2024-04-03T08:39:12.376 INFO:tasks.workunit.client.1.smithi181.stdout:2/244: dwrite d13/d22/d27/f4b [0,4194304] 0 2024-04-03T08:39:12.376 INFO:tasks.workunit.client.1.smithi181.stdout:3/206: symlink d0/d17/l3a 0 2024-04-03T08:39:12.377 INFO:tasks.workunit.client.1.smithi181.stdout:2/245: stat d13/d22/d27/d2f 0 2024-04-03T08:39:12.378 INFO:tasks.workunit.client.1.smithi181.stdout:0/205: creat d5/dc/d14/d29/f41 x:0 0 0 2024-04-03T08:39:12.379 INFO:tasks.workunit.client.0.smithi157.stdout:3/384: dwrite d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:12.380 INFO:tasks.workunit.client.1.smithi181.stdout:0/206: write d5/fe [2832829,110841] 0 2024-04-03T08:39:12.382 INFO:tasks.workunit.client.0.smithi157.stdout:4/399: creat da/df/d24/d35/d53/f84 x:0 0 0 2024-04-03T08:39:12.383 INFO:tasks.workunit.client.1.smithi181.stdout:4/245: rename d1/d1e/f46 to d1/d16/d1f/f50 0 2024-04-03T08:39:12.384 INFO:tasks.workunit.client.0.smithi157.stdout:0/406: dwrite d2/d9/dc/f5d [0,4194304] 0 2024-04-03T08:39:12.385 INFO:tasks.workunit.client.1.smithi181.stdout:4/246: fdatasync d1/d1e/f2e 0 2024-04-03T08:39:12.387 INFO:tasks.workunit.client.0.smithi157.stdout:1/348: chown d2/f3 1085360 1 2024-04-03T08:39:12.387 INFO:tasks.workunit.client.1.smithi181.stdout:4/247: chown d1/f32 20495585 1 2024-04-03T08:39:12.389 INFO:tasks.workunit.client.0.smithi157.stdout:6/425: symlink d1/d5/d17/d2a/d40/d81/l8f 0 2024-04-03T08:39:12.390 INFO:tasks.workunit.client.1.smithi181.stdout:4/248: fdatasync d1/d16/d1f/f3c 0 2024-04-03T08:39:12.391 INFO:tasks.workunit.client.1.smithi181.stdout:1/203: dread d10/f22 [0,4194304] 0 2024-04-03T08:39:12.393 INFO:tasks.workunit.client.0.smithi157.stdout:7/435: dwrite d0/d11/d15/d17/d43/d8a/f94 [0,4194304] 0 2024-04-03T08:39:12.395 INFO:tasks.workunit.client.0.smithi157.stdout:2/433: creat d3/db/d44/d4c/d5a/d88/f96 x:0 0 0 2024-04-03T08:39:12.395 INFO:tasks.workunit.client.1.smithi181.stdout:3/207: dread d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:12.397 INFO:tasks.workunit.client.0.smithi157.stdout:7/436: fsync d0/d11/d15/d1b/f59 0 2024-04-03T08:39:12.402 INFO:tasks.workunit.client.0.smithi157.stdout:8/421: link d2/d11/d10/d24/d5b/c37 d2/c8d 0 2024-04-03T08:39:12.403 INFO:tasks.workunit.client.1.smithi181.stdout:9/290: getdents d1/da/d28/d30/d3e 0 2024-04-03T08:39:12.411 INFO:tasks.workunit.client.1.smithi181.stdout:4/249: dread d1/d1e/f2e [0,4194304] 0 2024-04-03T08:39:12.413 INFO:tasks.workunit.client.1.smithi181.stdout:4/250: chown d1/f7 2633 1 2024-04-03T08:39:12.414 INFO:tasks.workunit.client.1.smithi181.stdout:0/207: mknod d5/d9/c42 0 2024-04-03T08:39:12.420 INFO:tasks.workunit.client.1.smithi181.stdout:1/204: link d10/d15/d17/d30/f38 d10/d15/d17/d19/f3e 0 2024-04-03T08:39:12.421 INFO:tasks.workunit.client.0.smithi157.stdout:7/437: dwrite d0/d4/f2d [0,4194304] 0 2024-04-03T08:39:12.421 INFO:tasks.workunit.client.0.smithi157.stdout:9/352: getdents d1/d15/d27/d34 0 2024-04-03T08:39:12.422 INFO:tasks.workunit.client.1.smithi181.stdout:3/208: mkdir d0/d17/d36/d3b 0 2024-04-03T08:39:12.426 INFO:tasks.workunit.client.0.smithi157.stdout:7/438: write d0/d11/d15/d17/d52/f68 [1012589,114369] 0 2024-04-03T08:39:12.426 INFO:tasks.workunit.client.1.smithi181.stdout:9/291: rename d1/da/d13/c18 to d1/da/d28/d30/d3e/c5f 0 2024-04-03T08:39:12.427 INFO:tasks.workunit.client.1.smithi181.stdout:8/176: sync 2024-04-03T08:39:12.429 INFO:tasks.workunit.client.1.smithi181.stdout:2/246: creat d13/d1c/f63 x:0 0 0 2024-04-03T08:39:12.431 INFO:tasks.workunit.client.1.smithi181.stdout:4/251: mkdir d1/d16/d51 0 2024-04-03T08:39:12.432 INFO:tasks.workunit.client.0.smithi157.stdout:7/439: write d0/d11/d15/d1b/f3f [2420053,88722] 0 2024-04-03T08:39:12.434 INFO:tasks.workunit.client.0.smithi157.stdout:8/422: dwrite d2/d20/f65 [0,4194304] 0 2024-04-03T08:39:12.435 INFO:tasks.workunit.client.1.smithi181.stdout:5/221: write d4/d22/f38 [2674085,117489] 0 2024-04-03T08:39:12.435 INFO:tasks.workunit.client.0.smithi157.stdout:0/407: mkdir d2/d9/d5f/d8d/d98 0 2024-04-03T08:39:12.436 INFO:tasks.workunit.client.0.smithi157.stdout:7/440: fdatasync d0/d11/d15/d35/f95 0 2024-04-03T08:39:12.439 INFO:tasks.workunit.client.0.smithi157.stdout:6/426: link d1/fb d1/d5/d17/d29/d62/d7f/f90 0 2024-04-03T08:39:12.441 INFO:tasks.workunit.client.0.smithi157.stdout:8/423: chown d2/d11/d10/d24/d5b/d2e/d75/f76 109177596 1 2024-04-03T08:39:12.442 INFO:tasks.workunit.client.0.smithi157.stdout:5/432: getdents dc/d29/d56/d49/d53 0 2024-04-03T08:39:12.442 INFO:tasks.workunit.client.1.smithi181.stdout:1/205: write d10/d15/d17/d19/f3e [3393893,35706] 0 2024-04-03T08:39:12.446 INFO:tasks.workunit.client.0.smithi157.stdout:9/353: mkdir d1/d36/d66/d75 0 2024-04-03T08:39:12.452 INFO:tasks.workunit.client.1.smithi181.stdout:3/209: rmdir d0/d17 39 2024-04-03T08:39:12.452 INFO:tasks.workunit.client.1.smithi181.stdout:4/252: dwrite d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:12.454 INFO:tasks.workunit.client.1.smithi181.stdout:2/247: symlink d13/d1d/l64 0 2024-04-03T08:39:12.457 INFO:tasks.workunit.client.0.smithi157.stdout:1/349: dwrite d2/d11/d24/d39/d3b/fe [0,4194304] 0 2024-04-03T08:39:12.459 INFO:tasks.workunit.client.1.smithi181.stdout:4/253: dread d1/d16/d37/d34/f35 [0,4194304] 0 2024-04-03T08:39:12.462 INFO:tasks.workunit.client.1.smithi181.stdout:4/254: read d1/d1e/f1c [781904,46714] 0 2024-04-03T08:39:12.462 INFO:tasks.workunit.client.1.smithi181.stdout:0/208: creat d5/d9/d2e/f43 x:0 0 0 2024-04-03T08:39:12.462 INFO:tasks.workunit.client.1.smithi181.stdout:9/292: dread d1/da/fb [0,4194304] 0 2024-04-03T08:39:12.465 INFO:tasks.workunit.client.1.smithi181.stdout:5/222: write d4/d18/d2c/f34 [2569353,85958] 0 2024-04-03T08:39:12.467 INFO:tasks.workunit.client.1.smithi181.stdout:0/209: truncate d5/dc/d10/f36 79298 0 2024-04-03T08:39:12.468 INFO:tasks.workunit.client.0.smithi157.stdout:2/434: truncate d3/d12/f11 820768 0 2024-04-03T08:39:12.469 INFO:tasks.workunit.client.1.smithi181.stdout:5/223: read - d4/d18/d2c/f40 zero size 2024-04-03T08:39:12.474 INFO:tasks.workunit.client.1.smithi181.stdout:5/224: dread - d4/f32 zero size 2024-04-03T08:39:12.474 INFO:tasks.workunit.client.0.smithi157.stdout:0/408: creat d2/d9/dc/df/d1b/d35/d3d/f99 x:0 0 0 2024-04-03T08:39:12.475 INFO:tasks.workunit.client.1.smithi181.stdout:5/225: chown d4/d44 0 1 2024-04-03T08:39:12.478 INFO:tasks.workunit.client.0.smithi157.stdout:5/433: unlink dc/d35/f90 0 2024-04-03T08:39:12.478 INFO:tasks.workunit.client.1.smithi181.stdout:2/248: dwrite d13/d1c/f54 [0,4194304] 0 2024-04-03T08:39:12.480 INFO:tasks.workunit.client.1.smithi181.stdout:9/293: mknod d1/da/d28/d30/d3e/c60 0 2024-04-03T08:39:12.481 INFO:tasks.workunit.client.0.smithi157.stdout:1/350: dwrite d2/d11/f26 [0,4194304] 0 2024-04-03T08:39:12.482 INFO:tasks.workunit.client.0.smithi157.stdout:9/354: creat d1/d15/d27/d5c/f76 x:0 0 0 2024-04-03T08:39:12.483 INFO:tasks.workunit.client.1.smithi181.stdout:0/210: symlink d5/dc/d14/l44 0 2024-04-03T08:39:12.484 INFO:tasks.workunit.client.1.smithi181.stdout:0/211: chown d5/dc/d14 585929372 1 2024-04-03T08:39:12.485 INFO:tasks.workunit.client.0.smithi157.stdout:3/385: getdents d8/d1e/d2d 0 2024-04-03T08:39:12.485 INFO:tasks.workunit.client.1.smithi181.stdout:8/177: creat d4/d6/d9/f38 x:0 0 0 2024-04-03T08:39:12.488 INFO:tasks.workunit.client.0.smithi157.stdout:4/400: rename da/df/d24/d35/d53/l56 to da/df/l85 0 2024-04-03T08:39:12.491 INFO:tasks.workunit.client.0.smithi157.stdout:7/441: unlink d0/d11/d15/d17/d52/c85 0 2024-04-03T08:39:12.493 INFO:tasks.workunit.client.0.smithi157.stdout:2/435: mkdir d3/db/d44/d4c/d5a/d88/d97 0 2024-04-03T08:39:12.496 INFO:tasks.workunit.client.0.smithi157.stdout:6/427: creat d1/d4b/d61/f91 x:0 0 0 2024-04-03T08:39:12.497 INFO:tasks.workunit.client.1.smithi181.stdout:2/249: stat d13/d22/d27/d2f/f5c 0 2024-04-03T08:39:12.497 INFO:tasks.workunit.client.1.smithi181.stdout:4/255: fsync d1/d1e/f1c 0 2024-04-03T08:39:12.501 INFO:tasks.workunit.client.1.smithi181.stdout:7/177: sync 2024-04-03T08:39:12.501 INFO:tasks.workunit.client.1.smithi181.stdout:4/256: truncate d1/d16/d24/f47 160494 0 2024-04-03T08:39:12.501 INFO:tasks.workunit.client.1.smithi181.stdout:5/226: read d4/f5 [538930,23247] 0 2024-04-03T08:39:12.502 INFO:tasks.workunit.client.0.smithi157.stdout:6/428: chown d1/d4b/d38/d59/f83 3317995 1 2024-04-03T08:39:12.504 INFO:tasks.workunit.client.0.smithi157.stdout:8/424: symlink d2/d11/d10/d24/d5b/l8e 0 2024-04-03T08:39:12.505 INFO:tasks.workunit.client.1.smithi181.stdout:1/206: getdents d10 0 2024-04-03T08:39:12.505 INFO:tasks.workunit.client.1.smithi181.stdout:0/212: creat d5/dc/d14/d29/f45 x:0 0 0 2024-04-03T08:39:12.507 INFO:tasks.workunit.client.0.smithi157.stdout:9/355: mknod d1/d36/d69/c77 0 2024-04-03T08:39:12.509 INFO:tasks.workunit.client.0.smithi157.stdout:1/351: dread d2/d11/d24/d39/d3b/d1b/f30 [0,4194304] 0 2024-04-03T08:39:12.511 INFO:tasks.workunit.client.0.smithi157.stdout:9/356: write d1/d15/f63 [860898,59676] 0 2024-04-03T08:39:12.513 INFO:tasks.workunit.client.0.smithi157.stdout:3/386: symlink d8/d1e/d2d/d39/d51/d4c/l87 0 2024-04-03T08:39:12.518 INFO:tasks.workunit.client.1.smithi181.stdout:5/227: dwrite d4/f32 [0,4194304] 0 2024-04-03T08:39:12.519 INFO:tasks.workunit.client.0.smithi157.stdout:3/387: truncate d8/d1e/d2d/f34 353395 0 2024-04-03T08:39:12.520 INFO:tasks.workunit.client.1.smithi181.stdout:4/257: creat d1/d1e/f52 x:0 0 0 2024-04-03T08:39:12.521 INFO:tasks.workunit.client.0.smithi157.stdout:0/409: symlink d2/d9/d36/d82/l9a 0 2024-04-03T08:39:12.523 INFO:tasks.workunit.client.0.smithi157.stdout:7/442: rename d0/d11/d15/d17/d1c/c2c to d0/d16/ca8 0 2024-04-03T08:39:12.524 INFO:tasks.workunit.client.1.smithi181.stdout:8/178: dwrite d4/d6/db/d14/d31/f22 [0,4194304] 0 2024-04-03T08:39:12.525 INFO:tasks.workunit.client.1.smithi181.stdout:4/258: truncate d1/d16/d1f/d3f/d41/f42 633927 0 2024-04-03T08:39:12.526 INFO:tasks.workunit.client.1.smithi181.stdout:8/179: write d4/d6/db/f13 [115250,30675] 0 2024-04-03T08:39:12.529 INFO:tasks.workunit.client.0.smithi157.stdout:6/429: mkdir d1/d4b/d61/d92 0 2024-04-03T08:39:12.529 INFO:tasks.workunit.client.0.smithi157.stdout:7/443: readlink d0/d11/d15/d17/d1c/d4f/d5f/l7f 0 2024-04-03T08:39:12.532 INFO:tasks.workunit.client.1.smithi181.stdout:0/213: rmdir d5/d9/d2c 39 2024-04-03T08:39:12.534 INFO:tasks.workunit.client.0.smithi157.stdout:0/410: read d2/d9/dc/df/d1b/d4a/f2f [3537942,95589] 0 2024-04-03T08:39:12.535 INFO:tasks.workunit.client.1.smithi181.stdout:9/294: write d1/da/f12 [3786590,100820] 0 2024-04-03T08:39:12.536 INFO:tasks.workunit.client.1.smithi181.stdout:9/295: write d1/f20 [2939047,71316] 0 2024-04-03T08:39:12.537 INFO:tasks.workunit.client.1.smithi181.stdout:4/259: dread d1/f32 [0,4194304] 0 2024-04-03T08:39:12.537 INFO:tasks.workunit.client.0.smithi157.stdout:8/425: rmdir d2/d20/d77 39 2024-04-03T08:39:12.546 INFO:tasks.workunit.client.0.smithi157.stdout:5/434: write dc/d29/d56/d18/f3a [2473787,117424] 0 2024-04-03T08:39:12.546 INFO:tasks.workunit.client.0.smithi157.stdout:8/426: read d2/fb [12212,22037] 0 2024-04-03T08:39:12.546 INFO:tasks.workunit.client.1.smithi181.stdout:3/210: getdents d0 0 2024-04-03T08:39:12.547 INFO:tasks.workunit.client.1.smithi181.stdout:3/211: fsync d0/d17/d36/d1e/f31 0 2024-04-03T08:39:12.547 INFO:tasks.workunit.client.1.smithi181.stdout:9/296: dread d1/d34/d39/f50 [0,4194304] 0 2024-04-03T08:39:12.549 INFO:tasks.workunit.client.0.smithi157.stdout:1/352: dwrite d2/d11/d23/f57 [0,4194304] 0 2024-04-03T08:39:12.550 INFO:tasks.workunit.client.0.smithi157.stdout:9/357: unlink d1/d15/d16/f2a 0 2024-04-03T08:39:12.557 INFO:tasks.workunit.client.0.smithi157.stdout:9/358: write d1/f5 [2965683,125] 0 2024-04-03T08:39:12.559 INFO:tasks.workunit.client.1.smithi181.stdout:2/250: unlink d13/d22/d27/c31 0 2024-04-03T08:39:12.560 INFO:tasks.workunit.client.0.smithi157.stdout:1/353: write d2/f45 [611872,50177] 0 2024-04-03T08:39:12.563 INFO:tasks.workunit.client.1.smithi181.stdout:3/212: dwrite d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:12.563 INFO:tasks.workunit.client.0.smithi157.stdout:6/430: dwrite d1/f5e [0,4194304] 0 2024-04-03T08:39:12.563 INFO:tasks.workunit.client.0.smithi157.stdout:1/354: truncate d2/f45 1323634 0 2024-04-03T08:39:12.564 INFO:tasks.workunit.client.1.smithi181.stdout:3/213: stat d0/d17/l1b 0 2024-04-03T08:39:12.567 INFO:tasks.workunit.client.1.smithi181.stdout:3/214: chown d0/d5/d6/dd 4085510 1 2024-04-03T08:39:12.569 INFO:tasks.workunit.client.1.smithi181.stdout:0/214: mkdir d5/dc/d14/d29/d46 0 2024-04-03T08:39:12.571 INFO:tasks.workunit.client.0.smithi157.stdout:7/444: symlink d0/d11/d15/d17/d43/la9 0 2024-04-03T08:39:12.571 INFO:tasks.workunit.client.0.smithi157.stdout:4/401: dwrite da/df/d11/f1f [0,4194304] 0 2024-04-03T08:39:12.573 INFO:tasks.workunit.client.0.smithi157.stdout:7/445: chown d0/d11/d15/d17/d52 0 1 2024-04-03T08:39:12.579 INFO:tasks.workunit.client.1.smithi181.stdout:4/260: creat d1/d16/d1f/f53 x:0 0 0 2024-04-03T08:39:12.587 INFO:tasks.workunit.client.1.smithi181.stdout:9/297: fsync d1/da/fb 0 2024-04-03T08:39:12.587 INFO:tasks.workunit.client.0.smithi157.stdout:8/427: dread d2/d11/d10/d24/d5b/f47 [0,4194304] 0 2024-04-03T08:39:12.590 INFO:tasks.workunit.client.0.smithi157.stdout:2/436: link d3/d2e/f80 d3/d12/d43/d4b/f98 0 2024-04-03T08:39:12.590 INFO:tasks.workunit.client.1.smithi181.stdout:9/298: read d1/da/f12 [672707,31103] 0 2024-04-03T08:39:12.592 INFO:tasks.workunit.client.1.smithi181.stdout:7/178: creat d0/f3e x:0 0 0 2024-04-03T08:39:12.593 INFO:tasks.workunit.client.1.smithi181.stdout:2/251: creat d13/d1d/f65 x:0 0 0 2024-04-03T08:39:12.594 INFO:tasks.workunit.client.0.smithi157.stdout:9/359: creat d1/d36/d66/f78 x:0 0 0 2024-04-03T08:39:12.595 INFO:tasks.workunit.client.1.smithi181.stdout:2/252: dread - d13/d22/d27/f3a zero size 2024-04-03T08:39:12.598 INFO:tasks.workunit.client.1.smithi181.stdout:1/207: creat d10/d15/d17/f3f x:0 0 0 2024-04-03T08:39:12.600 INFO:tasks.workunit.client.0.smithi157.stdout:1/355: dread d2/d11/d23/f4f [0,4194304] 0 2024-04-03T08:39:12.600 INFO:tasks.workunit.client.1.smithi181.stdout:0/215: creat d5/dc/d14/d29/f47 x:0 0 0 2024-04-03T08:39:12.601 INFO:tasks.workunit.client.1.smithi181.stdout:3/215: truncate d0/d5/d6/f1d 558531 0 2024-04-03T08:39:12.604 INFO:tasks.workunit.client.0.smithi157.stdout:3/388: creat d8/f88 x:0 0 0 2024-04-03T08:39:12.604 INFO:tasks.workunit.client.0.smithi157.stdout:8/428: mknod d2/d6f/d70/c8f 0 2024-04-03T08:39:12.605 INFO:tasks.workunit.client.1.smithi181.stdout:3/216: dread d0/d5/d6/dd/f21 [0,4194304] 0 2024-04-03T08:39:12.605 INFO:tasks.workunit.client.1.smithi181.stdout:4/261: creat d1/d16/f54 x:0 0 0 2024-04-03T08:39:12.606 INFO:tasks.workunit.client.0.smithi157.stdout:4/402: dread da/df/d11/f3b [0,4194304] 0 2024-04-03T08:39:12.607 INFO:tasks.workunit.client.0.smithi157.stdout:2/437: symlink d3/d12/d43/d4b/l99 0 2024-04-03T08:39:12.610 INFO:tasks.workunit.client.0.smithi157.stdout:9/360: unlink d1/d36/d46/f5e 0 2024-04-03T08:39:12.610 INFO:tasks.workunit.client.0.smithi157.stdout:1/356: dread d2/d11/d24/d39/f61 [0,4194304] 0 2024-04-03T08:39:12.611 INFO:tasks.workunit.client.1.smithi181.stdout:9/299: creat d1/da/d28/d30/f61 x:0 0 0 2024-04-03T08:39:12.614 INFO:tasks.workunit.client.0.smithi157.stdout:3/389: dread d8/f11 [4194304,4194304] 0 2024-04-03T08:39:12.616 INFO:tasks.workunit.client.1.smithi181.stdout:1/208: dwrite d10/d15/d17/d23/d27/f3a [0,4194304] 0 2024-04-03T08:39:12.616 INFO:tasks.workunit.client.0.smithi157.stdout:0/411: rename d2/d9/d36/d38/d6c to d2/d9/dc/df/d9b 0 2024-04-03T08:39:12.618 INFO:tasks.workunit.client.1.smithi181.stdout:8/180: creat d4/d6/f39 x:0 0 0 2024-04-03T08:39:12.619 INFO:tasks.workunit.client.0.smithi157.stdout:1/357: truncate d2/d11/d24/d39/d3b/d2e/d48/d58/f51 468345 0 2024-04-03T08:39:12.623 INFO:tasks.workunit.client.0.smithi157.stdout:1/358: write d2/d11/d24/d39/d3b/d2e/d48/d58/f72 [20778,59984] 0 2024-04-03T08:39:12.625 INFO:tasks.workunit.client.1.smithi181.stdout:0/216: dread d5/d9/d2c/f2d [0,4194304] 0 2024-04-03T08:39:12.628 INFO:tasks.workunit.client.0.smithi157.stdout:2/438: dwrite d3/d12/d43/d4b/d55/f59 [0,4194304] 0 2024-04-03T08:39:12.630 INFO:tasks.workunit.client.1.smithi181.stdout:1/209: dwrite d10/f11 [0,4194304] 0 2024-04-03T08:39:12.631 INFO:tasks.workunit.client.0.smithi157.stdout:5/435: truncate dc/d29/d56/d49/f5e 318982 0 2024-04-03T08:39:12.638 INFO:tasks.workunit.client.1.smithi181.stdout:7/179: write d0/d1/d6/de/d17/f2c [164594,1743] 0 2024-04-03T08:39:12.641 INFO:tasks.workunit.client.0.smithi157.stdout:7/446: truncate d0/d11/d15/d17/f7c 29140 0 2024-04-03T08:39:12.643 INFO:tasks.workunit.client.0.smithi157.stdout:7/447: dread - d0/d11/d15/d17/f7d zero size 2024-04-03T08:39:12.651 INFO:tasks.workunit.client.0.smithi157.stdout:1/359: fdatasync d2/d11/d24/f2f 0 2024-04-03T08:39:12.656 INFO:tasks.workunit.client.0.smithi157.stdout:2/439: read d3/d12/f63 [135805,43004] 0 2024-04-03T08:39:12.657 INFO:tasks.workunit.client.1.smithi181.stdout:3/217: unlink d0/d5/d6/d29/f2a 0 2024-04-03T08:39:12.666 INFO:tasks.workunit.client.0.smithi157.stdout:1/360: dwrite d2/d11/d24/d39/f6f [0,4194304] 0 2024-04-03T08:39:12.668 INFO:tasks.workunit.client.1.smithi181.stdout:6/223: sync 2024-04-03T08:39:12.670 INFO:tasks.workunit.client.1.smithi181.stdout:6/224: fdatasync d6/d7/d9/f28 0 2024-04-03T08:39:12.672 INFO:tasks.workunit.client.0.smithi157.stdout:1/361: write d2/d11/d24/d39/d3b/f5c [740509,126919] 0 2024-04-03T08:39:12.673 INFO:tasks.workunit.client.1.smithi181.stdout:2/253: truncate d13/d22/d27/f28 4004470 0 2024-04-03T08:39:12.676 INFO:tasks.workunit.client.0.smithi157.stdout:9/361: dwrite d1/d36/f3b [0,4194304] 0 2024-04-03T08:39:12.676 INFO:tasks.workunit.client.1.smithi181.stdout:0/217: truncate d5/dc/f12 2887420 0 2024-04-03T08:39:12.676 INFO:tasks.workunit.client.1.smithi181.stdout:2/254: dread - d13/f35 zero size 2024-04-03T08:39:12.679 INFO:tasks.workunit.client.1.smithi181.stdout:2/255: fsync d13/d22/d27/d46/f61 0 2024-04-03T08:39:12.679 INFO:tasks.workunit.client.1.smithi181.stdout:3/218: readlink d0/d17/d36/d1e/l20 0 2024-04-03T08:39:12.680 INFO:tasks.workunit.client.1.smithi181.stdout:0/218: chown d5/d9/l2b 9 1 2024-04-03T08:39:12.683 INFO:tasks.workunit.client.1.smithi181.stdout:4/262: truncate d1/f32 620978 0 2024-04-03T08:39:12.687 INFO:tasks.workunit.client.0.smithi157.stdout:7/448: unlink d0/d11/d15/d1b/f3f 0 2024-04-03T08:39:12.688 INFO:tasks.workunit.client.1.smithi181.stdout:9/300: truncate d1/da/d13/d22/f31 286761 0 2024-04-03T08:39:12.689 INFO:tasks.workunit.client.0.smithi157.stdout:6/431: getdents d1/d4b/d61 0 2024-04-03T08:39:12.691 INFO:tasks.workunit.client.0.smithi157.stdout:3/390: creat d8/d13/d1b/d7d/f89 x:0 0 0 2024-04-03T08:39:12.693 INFO:tasks.workunit.client.1.smithi181.stdout:6/225: dwrite d6/f42 [4194304,4194304] 0 2024-04-03T08:39:12.693 INFO:tasks.workunit.client.0.smithi157.stdout:0/412: mknod d2/d9/dc/c9c 0 2024-04-03T08:39:12.696 INFO:tasks.workunit.client.1.smithi181.stdout:6/226: write d6/d7/f20 [1895196,50529] 0 2024-04-03T08:39:12.698 INFO:tasks.workunit.client.1.smithi181.stdout:8/181: write d4/f27 [5307222,115188] 0 2024-04-03T08:39:12.704 INFO:tasks.workunit.client.1.smithi181.stdout:4/263: mkdir d1/d16/d55 0 2024-04-03T08:39:12.704 INFO:tasks.workunit.client.1.smithi181.stdout:8/182: truncate d4/d6/db/d14/d31/f34 833785 0 2024-04-03T08:39:12.704 INFO:tasks.workunit.client.0.smithi157.stdout:1/362: unlink d2/d11/l33 0 2024-04-03T08:39:12.707 INFO:tasks.workunit.client.0.smithi157.stdout:8/429: creat d2/d11/f90 x:0 0 0 2024-04-03T08:39:12.708 INFO:tasks.workunit.client.1.smithi181.stdout:3/219: mknod d0/d17/d36/c3c 0 2024-04-03T08:39:12.709 INFO:tasks.workunit.client.0.smithi157.stdout:9/362: mkdir d1/d15/d27/d5c/d79 0 2024-04-03T08:39:12.713 INFO:tasks.workunit.client.0.smithi157.stdout:5/436: fsync dc/d29/d56/f26 0 2024-04-03T08:39:12.716 INFO:tasks.workunit.client.1.smithi181.stdout:2/256: mknod d13/d22/d27/d2f/c66 0 2024-04-03T08:39:12.719 INFO:tasks.workunit.client.1.smithi181.stdout:4/264: mkdir d1/d16/d1f/d2b/d56 0 2024-04-03T08:39:12.719 INFO:tasks.workunit.client.0.smithi157.stdout:4/403: dwrite da/df/d24/f59 [0,4194304] 0 2024-04-03T08:39:12.724 INFO:tasks.workunit.client.0.smithi157.stdout:6/432: creat d1/d4b/d38/d59/f93 x:0 0 0 2024-04-03T08:39:12.726 INFO:tasks.workunit.client.0.smithi157.stdout:3/391: rename d8/f17 to d8/d13/d1b/d5b/f8a 0 2024-04-03T08:39:12.728 INFO:tasks.workunit.client.0.smithi157.stdout:3/392: readlink d8/d13/l33 0 2024-04-03T08:39:12.735 INFO:tasks.workunit.client.1.smithi181.stdout:7/180: dwrite d0/d1/f15 [4194304,4194304] 0 2024-04-03T08:39:12.735 INFO:tasks.workunit.client.1.smithi181.stdout:6/227: dwrite d6/d31/d36/f43 [0,4194304] 0 2024-04-03T08:39:12.736 INFO:tasks.workunit.client.0.smithi157.stdout:8/430: fdatasync d2/f39 0 2024-04-03T08:39:12.738 INFO:tasks.workunit.client.0.smithi157.stdout:8/431: chown d2/d11/d10/d24/d5b 4 1 2024-04-03T08:39:12.740 INFO:tasks.workunit.client.0.smithi157.stdout:9/363: creat d1/d36/d46/f7a x:0 0 0 2024-04-03T08:39:12.741 INFO:tasks.workunit.client.1.smithi181.stdout:8/183: truncate d4/d6/d9/f1b 248616 0 2024-04-03T08:39:12.741 INFO:tasks.workunit.client.0.smithi157.stdout:8/432: chown d2/d11/d10/d24/d5b/d2e/l43 67 1 2024-04-03T08:39:12.742 INFO:tasks.workunit.client.1.smithi181.stdout:0/219: dwrite d5/dc/d10/f27 [0,4194304] 0 2024-04-03T08:39:12.742 INFO:tasks.workunit.client.1.smithi181.stdout:4/265: rmdir d1/d16/d1f/d3f 39 2024-04-03T08:39:12.743 INFO:tasks.workunit.client.1.smithi181.stdout:8/184: chown d4/d6/db/d14/f20 347871694 1 2024-04-03T08:39:12.747 INFO:tasks.workunit.client.1.smithi181.stdout:9/301: write d1/da/f11 [527111,124472] 0 2024-04-03T08:39:12.750 INFO:tasks.workunit.client.1.smithi181.stdout:2/257: dread d13/d22/d27/d46/f61 [0,4194304] 0 2024-04-03T08:39:12.750 INFO:tasks.workunit.client.1.smithi181.stdout:3/220: truncate d0/d5/d6/dd/f24 2592055 0 2024-04-03T08:39:12.750 INFO:tasks.workunit.client.1.smithi181.stdout:5/228: sync 2024-04-03T08:39:12.750 INFO:tasks.workunit.client.0.smithi157.stdout:5/437: fsync dc/f59 0 2024-04-03T08:39:12.755 INFO:tasks.workunit.client.1.smithi181.stdout:9/302: fsync d1/da/d13/d41/f1b 0 2024-04-03T08:39:12.755 INFO:tasks.workunit.client.1.smithi181.stdout:7/181: unlink d0/f3c 0 2024-04-03T08:39:12.755 INFO:tasks.workunit.client.0.smithi157.stdout:4/404: mknod da/df/d24/c86 0 2024-04-03T08:39:12.755 INFO:tasks.workunit.client.1.smithi181.stdout:5/229: write d4/d18/d25/f20 [237272,75780] 0 2024-04-03T08:39:12.757 INFO:tasks.workunit.client.0.smithi157.stdout:7/449: unlink d0/l7 0 2024-04-03T08:39:12.757 INFO:tasks.workunit.client.0.smithi157.stdout:8/433: dread d2/d20/d23/f6c [0,4194304] 0 2024-04-03T08:39:12.758 INFO:tasks.workunit.client.1.smithi181.stdout:9/303: write d1/da/d1a/f1f [3547398,18962] 0 2024-04-03T08:39:12.761 INFO:tasks.workunit.client.0.smithi157.stdout:7/450: write d0/d11/d15/d35/f3b [5143108,43126] 0 2024-04-03T08:39:12.763 INFO:tasks.workunit.client.1.smithi181.stdout:0/220: dread d5/fb [4194304,4194304] 0 2024-04-03T08:39:12.763 INFO:tasks.workunit.client.0.smithi157.stdout:6/433: symlink d1/d5/d17/d29/d62/d7f/l94 0 2024-04-03T08:39:12.767 INFO:tasks.workunit.client.0.smithi157.stdout:0/413: rename d2/d9/dc/df/d78 to d2/d9/dc/df/d6f/d9d 0 2024-04-03T08:39:12.771 INFO:tasks.workunit.client.0.smithi157.stdout:2/440: creat d3/d2e/f9a x:0 0 0 2024-04-03T08:39:12.773 INFO:tasks.workunit.client.0.smithi157.stdout:3/393: rmdir d8/d1e/d2d/d39/d51/d4c/d32 39 2024-04-03T08:39:12.773 INFO:tasks.workunit.client.0.smithi157.stdout:0/414: write d2/d9/dc/df/d1b/d35/f56 [2685876,90691] 0 2024-04-03T08:39:12.773 INFO:tasks.workunit.client.0.smithi157.stdout:2/441: dread - d3/db/f7e zero size 2024-04-03T08:39:12.779 INFO:tasks.workunit.client.0.smithi157.stdout:5/438: dwrite dc/d29/d56/f22 [0,4194304] 0 2024-04-03T08:39:12.780 INFO:tasks.workunit.client.0.smithi157.stdout:3/394: chown d8/d1e/d2d/d3f/d4d/c4f 7149 1 2024-04-03T08:39:12.781 INFO:tasks.workunit.client.1.smithi181.stdout:4/266: rename d1/c1b to d1/d16/d55/c57 0 2024-04-03T08:39:12.782 INFO:tasks.workunit.client.0.smithi157.stdout:5/439: readlink dc/d29/d56/d52/l96 0 2024-04-03T08:39:12.783 INFO:tasks.workunit.client.1.smithi181.stdout:6/228: dread d6/d31/d36/f3d [0,4194304] 0 2024-04-03T08:39:12.783 INFO:tasks.workunit.client.1.smithi181.stdout:4/267: dread - d1/d1e/f52 zero size 2024-04-03T08:39:12.786 INFO:tasks.workunit.client.0.smithi157.stdout:8/434: mknod d2/d6f/d70/d89/c91 0 2024-04-03T08:39:12.790 INFO:tasks.workunit.client.1.smithi181.stdout:4/268: truncate d1/d16/d1f/f45 291973 0 2024-04-03T08:39:12.793 INFO:tasks.workunit.client.1.smithi181.stdout:8/185: dread d4/f5 [0,4194304] 0 2024-04-03T08:39:12.800 INFO:tasks.workunit.client.1.smithi181.stdout:7/182: dread d0/d1/f3 [0,4194304] 0 2024-04-03T08:39:12.801 INFO:tasks.workunit.client.0.smithi157.stdout:6/434: rename d1/d22 to d1/d5/d17/d2a/d30/d95 0 2024-04-03T08:39:12.802 INFO:tasks.workunit.client.0.smithi157.stdout:3/395: dwrite d8/d1e/d2d/d39/f47 [0,4194304] 0 2024-04-03T08:39:12.802 INFO:tasks.workunit.client.0.smithi157.stdout:6/435: dread - d1/d5/d17/d2a/d73/f71 zero size 2024-04-03T08:39:12.805 INFO:tasks.workunit.client.0.smithi157.stdout:2/442: symlink d3/d12/l9b 0 2024-04-03T08:39:12.806 INFO:tasks.workunit.client.1.smithi181.stdout:2/258: write f0 [998522,96515] 0 2024-04-03T08:39:12.806 INFO:tasks.workunit.client.0.smithi157.stdout:1/363: mkdir d2/d11/d23/d73 0 2024-04-03T08:39:12.808 INFO:tasks.workunit.client.0.smithi157.stdout:9/364: symlink d1/d15/d27/l7b 0 2024-04-03T08:39:12.820 INFO:tasks.workunit.client.0.smithi157.stdout:5/440: creat dc/d35/f97 x:0 0 0 2024-04-03T08:39:12.820 INFO:tasks.workunit.client.1.smithi181.stdout:3/221: symlink d0/d5/d6/l3d 0 2024-04-03T08:39:12.824 INFO:tasks.workunit.client.1.smithi181.stdout:7/183: dwrite d0/d1/d6/de/f2d [4194304,4194304] 0 2024-04-03T08:39:12.826 INFO:tasks.workunit.client.1.smithi181.stdout:4/269: mkdir d1/d16/d1f/d31/d39/d58 0 2024-04-03T08:39:12.829 INFO:tasks.workunit.client.0.smithi157.stdout:3/396: dwrite d8/f62 [0,4194304] 0 2024-04-03T08:39:12.838 INFO:tasks.workunit.client.0.smithi157.stdout:4/405: dwrite da/d26/f3d [0,4194304] 0 2024-04-03T08:39:12.838 INFO:tasks.workunit.client.0.smithi157.stdout:2/443: unlink d3/f6 0 2024-04-03T08:39:12.841 INFO:tasks.workunit.client.0.smithi157.stdout:6/436: unlink d1/d5/d17/d2a/d40/d81/l8f 0 2024-04-03T08:39:12.841 INFO:tasks.workunit.client.1.smithi181.stdout:2/259: rmdir d13/d22/d27 39 2024-04-03T08:39:12.848 INFO:tasks.workunit.client.0.smithi157.stdout:9/365: rename d1/d36/d69/f72 to d1/d15/d27/d5c/d79/f7c 0 2024-04-03T08:39:12.850 INFO:tasks.workunit.client.1.smithi181.stdout:4/270: creat d1/d1e/d2c/f59 x:0 0 0 2024-04-03T08:39:12.852 INFO:tasks.workunit.client.0.smithi157.stdout:5/441: rmdir dc/d29/d56/d49 39 2024-04-03T08:39:12.856 INFO:tasks.workunit.client.0.smithi157.stdout:8/435: mknod d2/d20/c92 0 2024-04-03T08:39:12.863 INFO:tasks.workunit.client.1.smithi181.stdout:7/184: unlink d0/d1/d6/f20 0 2024-04-03T08:39:12.864 INFO:tasks.workunit.client.0.smithi157.stdout:3/397: dread d8/f2c [0,4194304] 0 2024-04-03T08:39:12.871 INFO:tasks.workunit.client.0.smithi157.stdout:4/406: dwrite da/df/d2f/f40 [0,4194304] 0 2024-04-03T08:39:12.872 INFO:tasks.workunit.client.1.smithi181.stdout:8/186: rename d4/d6/db/d14/d31/f22 to d4/d6/db/f3a 0 2024-04-03T08:39:12.882 INFO:tasks.workunit.client.0.smithi157.stdout:6/437: creat d1/d5/d1b/f96 x:0 0 0 2024-04-03T08:39:12.883 INFO:tasks.workunit.client.0.smithi157.stdout:9/366: dwrite d1/d15/d27/f47 [0,4194304] 0 2024-04-03T08:39:12.883 INFO:tasks.workunit.client.0.smithi157.stdout:7/451: truncate d0/d4/f10 3571359 0 2024-04-03T08:39:12.885 INFO:tasks.workunit.client.1.smithi181.stdout:5/230: truncate d4/d18/f28 1107559 0 2024-04-03T08:39:12.886 INFO:tasks.workunit.client.0.smithi157.stdout:0/415: creat d2/d9/dc/df/d1b/d35/f9e x:0 0 0 2024-04-03T08:39:12.887 INFO:tasks.workunit.client.0.smithi157.stdout:5/442: mknod dc/d29/d56/d2e/c98 0 2024-04-03T08:39:12.896 INFO:tasks.workunit.client.1.smithi181.stdout:7/185: write d0/d1/f39 [1009962,32157] 0 2024-04-03T08:39:12.897 INFO:tasks.workunit.client.1.smithi181.stdout:7/186: fsync d0/f3b 0 2024-04-03T08:39:12.902 INFO:tasks.workunit.client.1.smithi181.stdout:9/304: truncate d1/da/f21 1841745 0 2024-04-03T08:39:12.902 INFO:tasks.workunit.client.1.smithi181.stdout:1/210: sync 2024-04-03T08:39:12.906 INFO:tasks.workunit.client.1.smithi181.stdout:9/305: chown d1/da/d13/d41/f26 1753155 1 2024-04-03T08:39:12.907 INFO:tasks.workunit.client.1.smithi181.stdout:1/211: truncate d10/d15/d17/f3f 939836 0 2024-04-03T08:39:12.911 INFO:tasks.workunit.client.0.smithi157.stdout:6/438: dwrite d1/d5/d17/d2a/d37/f76 [0,4194304] 0 2024-04-03T08:39:12.912 INFO:tasks.workunit.client.1.smithi181.stdout:6/229: write d6/d31/d36/f34 [697501,60179] 0 2024-04-03T08:39:12.915 INFO:tasks.workunit.client.0.smithi157.stdout:1/364: mkdir d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74 0 2024-04-03T08:39:12.917 INFO:tasks.workunit.client.0.smithi157.stdout:9/367: dwrite d1/d15/f63 [0,4194304] 0 2024-04-03T08:39:12.919 INFO:tasks.workunit.client.1.smithi181.stdout:4/271: write d1/d16/d1f/d3f/f40 [4130374,59237] 0 2024-04-03T08:39:12.924 INFO:tasks.workunit.client.1.smithi181.stdout:2/260: dread d13/d22/d27/f28 [0,4194304] 0 2024-04-03T08:39:12.930 INFO:tasks.workunit.client.1.smithi181.stdout:7/187: mknod d0/d1/d6/de/d17/c3f 0 2024-04-03T08:39:12.931 INFO:tasks.workunit.client.1.smithi181.stdout:3/222: write d0/d5/d6/f1d [1181335,130810] 0 2024-04-03T08:39:12.932 INFO:tasks.workunit.client.0.smithi157.stdout:7/452: dread d0/f20 [0,4194304] 0 2024-04-03T08:39:12.936 INFO:tasks.workunit.client.1.smithi181.stdout:1/212: truncate fc 7946129 0 2024-04-03T08:39:12.937 INFO:tasks.workunit.client.0.smithi157.stdout:5/443: creat dc/d29/d56/d18/f99 x:0 0 0 2024-04-03T08:39:12.938 INFO:tasks.workunit.client.0.smithi157.stdout:0/416: creat d2/d9/dc/df/d6f/d9d/d6a/f9f x:0 0 0 2024-04-03T08:39:12.941 INFO:tasks.workunit.client.1.smithi181.stdout:1/213: write d10/d15/d17/d23/d27/f3a [107936,83476] 0 2024-04-03T08:39:12.943 INFO:tasks.workunit.client.1.smithi181.stdout:0/221: sync 2024-04-03T08:39:12.944 INFO:tasks.workunit.client.0.smithi157.stdout:0/417: dread - d2/d9/dc/df/d6f/d9d/d6a/f76 zero size 2024-04-03T08:39:12.945 INFO:tasks.workunit.client.1.smithi181.stdout:1/214: fsync d10/d15/d17/d19/f3e 0 2024-04-03T08:39:12.946 INFO:tasks.workunit.client.1.smithi181.stdout:0/222: dread - d5/dc/d14/f3a zero size 2024-04-03T08:39:12.947 INFO:tasks.workunit.client.1.smithi181.stdout:6/230: mkdir d6/d4a 0 2024-04-03T08:39:12.950 INFO:tasks.workunit.client.0.smithi157.stdout:2/444: chown d3/l77 1814 1 2024-04-03T08:39:12.952 INFO:tasks.workunit.client.0.smithi157.stdout:8/436: write d2/d11/f1d [2231909,125893] 0 2024-04-03T08:39:12.953 INFO:tasks.workunit.client.1.smithi181.stdout:6/231: readlink d6/d7/d9/l1d 0 2024-04-03T08:39:12.954 INFO:tasks.workunit.client.0.smithi157.stdout:0/418: truncate d2/d9/dc/df/d6f/d9d/d6a/f9f 91817 0 2024-04-03T08:39:12.955 INFO:tasks.workunit.client.0.smithi157.stdout:6/439: mkdir d1/d5/d1b/d97 0 2024-04-03T08:39:12.955 INFO:tasks.workunit.client.1.smithi181.stdout:2/261: dwrite d13/d22/d27/f62 [0,4194304] 0 2024-04-03T08:39:12.955 INFO:tasks.workunit.client.1.smithi181.stdout:4/272: write d1/d16/d1f/f50 [553701,102774] 0 2024-04-03T08:39:12.956 INFO:tasks.workunit.client.0.smithi157.stdout:1/365: rmdir d2/d11/d24/d39/d3b 39 2024-04-03T08:39:12.956 INFO:tasks.workunit.client.1.smithi181.stdout:9/306: mkdir d1/da/d28/d30/d3e/d4e/d62 0 2024-04-03T08:39:12.959 INFO:tasks.workunit.client.1.smithi181.stdout:3/223: mknod d0/d5/d6/dd/c3e 0 2024-04-03T08:39:12.963 INFO:tasks.workunit.client.1.smithi181.stdout:3/224: truncate d0/d5/f33 897622 0 2024-04-03T08:39:12.970 INFO:tasks.workunit.client.0.smithi157.stdout:7/453: truncate d0/d11/d15/d17/f25 4012675 0 2024-04-03T08:39:12.971 INFO:tasks.workunit.client.0.smithi157.stdout:3/398: dwrite d8/d1e/d2d/d3b/f5a [4194304,4194304] 0 2024-04-03T08:39:12.973 INFO:tasks.workunit.client.0.smithi157.stdout:7/454: fsync d0/d11/d15/d17/d43/d8a/fa6 0 2024-04-03T08:39:12.974 INFO:tasks.workunit.client.1.smithi181.stdout:1/215: dread d10/d15/f34 [0,4194304] 0 2024-04-03T08:39:12.974 INFO:tasks.workunit.client.0.smithi157.stdout:3/399: read - d8/d1e/d2d/d39/f5f zero size 2024-04-03T08:39:12.981 INFO:tasks.workunit.client.0.smithi157.stdout:5/444: truncate dc/d29/f38 2740925 0 2024-04-03T08:39:12.988 INFO:tasks.workunit.client.1.smithi181.stdout:4/273: dwrite d1/d16/d24/f48 [0,4194304] 0 2024-04-03T08:39:12.992 INFO:tasks.workunit.client.0.smithi157.stdout:1/366: write d2/d11/d24/d39/d3b/d2e/d48/d58/f51 [663019,457] 0 2024-04-03T08:39:12.993 INFO:tasks.workunit.client.1.smithi181.stdout:4/274: read d1/d16/d1f/f45 [20482,18234] 0 2024-04-03T08:39:12.999 INFO:tasks.workunit.client.0.smithi157.stdout:6/440: creat d1/d5/d17/d29/d62/f98 x:0 0 0 2024-04-03T08:39:13.018 INFO:tasks.workunit.client.0.smithi157.stdout:6/441: dread d1/fc [4194304,4194304] 0 2024-04-03T08:39:13.026 INFO:tasks.workunit.client.0.smithi157.stdout:9/368: mknod d1/c7d 0 2024-04-03T08:39:13.037 INFO:tasks.workunit.client.0.smithi157.stdout:2/445: mknod d3/c9c 0 2024-04-03T08:39:13.038 INFO:tasks.workunit.client.1.smithi181.stdout:8/187: getdents d4/d6/db/d14/d31/d1c 0 2024-04-03T08:39:13.041 INFO:tasks.workunit.client.0.smithi157.stdout:9/369: dread d1/f3f [0,4194304] 0 2024-04-03T08:39:13.041 INFO:tasks.workunit.client.1.smithi181.stdout:1/216: creat d10/d15/d17/d19/f40 x:0 0 0 2024-04-03T08:39:13.042 INFO:tasks.workunit.client.1.smithi181.stdout:1/217: chown d10/c14 920995 1 2024-04-03T08:39:13.051 INFO:tasks.workunit.client.0.smithi157.stdout:0/419: dwrite d2/d9/d51/f61 [0,4194304] 0 2024-04-03T08:39:13.054 INFO:tasks.workunit.client.0.smithi157.stdout:6/442: mknod d1/d5/d17/d2a/d73/c99 0 2024-04-03T08:39:13.056 INFO:tasks.workunit.client.0.smithi157.stdout:7/455: mkdir d0/d11/d15/d17/d9f/daa 0 2024-04-03T08:39:13.060 INFO:tasks.workunit.client.0.smithi157.stdout:7/456: truncate d0/d75/f86 909974 0 2024-04-03T08:39:13.065 INFO:tasks.workunit.client.0.smithi157.stdout:5/445: creat dc/d29/d56/d49/d53/d6c/f9a x:0 0 0 2024-04-03T08:39:13.070 INFO:tasks.workunit.client.0.smithi157.stdout:5/446: truncate dc/d29/d56/d49/d53/f79 446569 0 2024-04-03T08:39:13.071 INFO:tasks.workunit.client.1.smithi181.stdout:9/307: unlink d1/da/l10 0 2024-04-03T08:39:13.076 INFO:tasks.workunit.client.1.smithi181.stdout:3/225: mkdir d0/d5/d6/d3f 0 2024-04-03T08:39:13.078 INFO:tasks.workunit.client.0.smithi157.stdout:1/367: creat d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/f75 x:0 0 0 2024-04-03T08:39:13.079 INFO:tasks.workunit.client.1.smithi181.stdout:4/275: dwrite d1/d16/d37/d34/f35 [0,4194304] 0 2024-04-03T08:39:13.079 INFO:tasks.workunit.client.1.smithi181.stdout:8/188: mknod d4/d2a/c3b 0 2024-04-03T08:39:13.081 INFO:tasks.workunit.client.0.smithi157.stdout:1/368: read d2/d11/d23/f4d [3364056,71073] 0 2024-04-03T08:39:13.081 INFO:tasks.workunit.client.1.smithi181.stdout:3/226: dread d0/d5/d6/dd/f21 [0,4194304] 0 2024-04-03T08:39:13.084 INFO:tasks.workunit.client.1.smithi181.stdout:1/218: mkdir d10/d15/d41 0 2024-04-03T08:39:13.085 INFO:tasks.workunit.client.1.smithi181.stdout:3/227: truncate d0/d5/f33 1196456 0 2024-04-03T08:39:13.094 INFO:tasks.workunit.client.1.smithi181.stdout:4/276: dread d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:13.095 INFO:tasks.workunit.client.0.smithi157.stdout:0/420: write d2/d9/f4f [122776,60495] 0 2024-04-03T08:39:13.096 INFO:tasks.workunit.client.1.smithi181.stdout:5/231: link d4/l1f d4/l45 0 2024-04-03T08:39:13.102 INFO:tasks.workunit.client.1.smithi181.stdout:3/228: dread d0/d17/d36/d1e/f31 [4194304,4194304] 0 2024-04-03T08:39:13.102 INFO:tasks.workunit.client.1.smithi181.stdout:7/188: getdents d0/d1/d6/de/d17 0 2024-04-03T08:39:13.102 INFO:tasks.workunit.client.0.smithi157.stdout:9/370: truncate d1/f17 538145 0 2024-04-03T08:39:13.103 INFO:tasks.workunit.client.1.smithi181.stdout:3/229: fsync d0/d17/f26 0 2024-04-03T08:39:13.103 INFO:tasks.workunit.client.0.smithi157.stdout:5/447: creat dc/d29/d56/d49/d53/d6c/f9b x:0 0 0 2024-04-03T08:39:13.104 INFO:tasks.workunit.client.1.smithi181.stdout:9/308: mknod d1/da/d28/d30/d3e/d4e/c63 0 2024-04-03T08:39:13.109 INFO:tasks.workunit.client.0.smithi157.stdout:6/443: rename d1/d5/d17/d2a/d37/c13 to d1/d5/d17/d29/d62/d7f/c9a 0 2024-04-03T08:39:13.109 INFO:tasks.workunit.client.1.smithi181.stdout:8/189: creat d4/d6/db/d14/d31/f3c x:0 0 0 2024-04-03T08:39:13.110 INFO:tasks.workunit.client.0.smithi157.stdout:5/448: chown dc/d29/d56/d49/f7a 72 1 2024-04-03T08:39:13.110 INFO:tasks.workunit.client.1.smithi181.stdout:0/223: getdents d5 0 2024-04-03T08:39:13.111 INFO:tasks.workunit.client.0.smithi157.stdout:3/400: getdents d8/d1e/d2d/d3f 0 2024-04-03T08:39:13.112 INFO:tasks.workunit.client.1.smithi181.stdout:1/219: stat d10/d15/d17/d23/c39 0 2024-04-03T08:39:13.113 INFO:tasks.workunit.client.0.smithi157.stdout:2/446: mknod d3/d12/d43/d4b/c9d 0 2024-04-03T08:39:13.113 INFO:tasks.workunit.client.1.smithi181.stdout:6/232: link d6/d31/c35 d6/c4b 0 2024-04-03T08:39:13.114 INFO:tasks.workunit.client.1.smithi181.stdout:4/277: creat d1/d16/f5a x:0 0 0 2024-04-03T08:39:13.115 INFO:tasks.workunit.client.1.smithi181.stdout:2/262: rename d13/d22/d27/d2f/f47 to d13/d22/d27/d2f/d5d/f67 0 2024-04-03T08:39:13.116 INFO:tasks.workunit.client.1.smithi181.stdout:5/232: rename d4/d22 to d4/d22/d46 22 2024-04-03T08:39:13.116 INFO:tasks.workunit.client.0.smithi157.stdout:1/369: read d2/d11/f44 [81952,51805] 0 2024-04-03T08:39:13.117 INFO:tasks.workunit.client.0.smithi157.stdout:9/371: symlink d1/d15/d16/l7e 0 2024-04-03T08:39:13.121 INFO:tasks.workunit.client.0.smithi157.stdout:5/449: dread - dc/d29/d56/d18/f99 zero size 2024-04-03T08:39:13.122 INFO:tasks.workunit.client.1.smithi181.stdout:3/230: mkdir d0/d17/d40 0 2024-04-03T08:39:13.124 INFO:tasks.workunit.client.0.smithi157.stdout:9/372: chown d1/d15/d16/l1c 4260 1 2024-04-03T08:39:13.125 INFO:tasks.workunit.client.0.smithi157.stdout:5/450: chown dc/d29/d56/d49/d7f 101266666 1 2024-04-03T08:39:13.125 INFO:tasks.workunit.client.1.smithi181.stdout:9/309: chown d1/da/d28/d30/d3e/c5f 3936610 1 2024-04-03T08:39:13.129 INFO:tasks.workunit.client.0.smithi157.stdout:0/421: dwrite d2/d9/dc/df/f8a [0,4194304] 0 2024-04-03T08:39:13.134 INFO:tasks.workunit.client.0.smithi157.stdout:6/444: creat d1/d4b/d38/d59/f9b x:0 0 0 2024-04-03T08:39:13.136 INFO:tasks.workunit.client.1.smithi181.stdout:0/224: creat d5/dc/d14/d29/f48 x:0 0 0 2024-04-03T08:39:13.140 INFO:tasks.workunit.client.0.smithi157.stdout:6/445: truncate d1/d5/d17/d2a/d85/f8c 4253190 0 2024-04-03T08:39:13.142 INFO:tasks.workunit.client.1.smithi181.stdout:6/233: rename d6/f17 to d6/d31/d36/f4c 0 2024-04-03T08:39:13.144 INFO:tasks.workunit.client.1.smithi181.stdout:4/278: truncate d1/f7 4484310 0 2024-04-03T08:39:13.144 INFO:tasks.workunit.client.1.smithi181.stdout:6/234: fdatasync d6/d7/f20 0 2024-04-03T08:39:13.145 INFO:tasks.workunit.client.0.smithi157.stdout:9/373: dread d1/d36/f3b [0,4194304] 0 2024-04-03T08:39:13.145 INFO:tasks.workunit.client.0.smithi157.stdout:7/457: getdents d0/d11/d6f/d89/d8c 0 2024-04-03T08:39:13.146 INFO:tasks.workunit.client.1.smithi181.stdout:6/235: fdatasync d6/d7/f3f 0 2024-04-03T08:39:13.150 INFO:tasks.workunit.client.1.smithi181.stdout:3/231: chown d0/d17/d36/d1e/c37 123 1 2024-04-03T08:39:13.151 INFO:tasks.workunit.client.0.smithi157.stdout:7/458: chown d0/d11/d15/d1b/f57 259480 1 2024-04-03T08:39:13.152 INFO:tasks.workunit.client.1.smithi181.stdout:9/310: fdatasync d1/d34/d39/f50 0 2024-04-03T08:39:13.153 INFO:tasks.workunit.client.0.smithi157.stdout:2/447: dwrite d3/db/f1f [0,4194304] 0 2024-04-03T08:39:13.153 INFO:tasks.workunit.client.1.smithi181.stdout:0/225: dread d5/dc/d10/f20 [0,4194304] 0 2024-04-03T08:39:13.155 INFO:tasks.workunit.client.0.smithi157.stdout:9/374: write d1/d15/d27/d5c/f74 [98984,108223] 0 2024-04-03T08:39:13.156 INFO:tasks.workunit.client.1.smithi181.stdout:8/190: creat d4/d2a/d37/f3d x:0 0 0 2024-04-03T08:39:13.157 INFO:tasks.workunit.client.1.smithi181.stdout:8/191: chown d4/d6/f7 76291886 1 2024-04-03T08:39:13.160 INFO:tasks.workunit.client.0.smithi157.stdout:9/375: dread - d1/d36/d46/f56 zero size 2024-04-03T08:39:13.160 INFO:tasks.workunit.client.1.smithi181.stdout:1/220: mknod d10/d15/d41/c42 0 2024-04-03T08:39:13.160 INFO:tasks.workunit.client.0.smithi157.stdout:0/422: dwrite d2/d9/dc/df/d1b/d35/f97 [0,4194304] 0 2024-04-03T08:39:13.163 INFO:tasks.workunit.client.0.smithi157.stdout:1/370: mknod d2/d11/d24/d39/d3b/d2e/d48/d64/c76 0 2024-04-03T08:39:13.166 INFO:tasks.workunit.client.1.smithi181.stdout:5/233: rename d4/c43 to d4/d44/c47 0 2024-04-03T08:39:13.166 INFO:tasks.workunit.client.0.smithi157.stdout:1/371: stat d2/d11/d24/d39/d3b/d2e/d48/d58/f72 0 2024-04-03T08:39:13.167 INFO:tasks.workunit.client.0.smithi157.stdout:6/446: symlink d1/d5/d17/d2a/d37/l9c 0 2024-04-03T08:39:13.176 INFO:tasks.workunit.client.1.smithi181.stdout:6/236: unlink d6/d31/d36/f43 0 2024-04-03T08:39:13.182 INFO:tasks.workunit.client.0.smithi157.stdout:7/459: mknod d0/d11/d15/d17/d9f/cab 0 2024-04-03T08:39:13.184 INFO:tasks.workunit.client.0.smithi157.stdout:7/460: dread - d0/d4/f80 zero size 2024-04-03T08:39:13.184 INFO:tasks.workunit.client.0.smithi157.stdout:3/401: link d8/l18 d8/d13/d1b/d5b/d7f/l8b 0 2024-04-03T08:39:13.185 INFO:tasks.workunit.client.0.smithi157.stdout:6/447: dread d1/f3 [0,4194304] 0 2024-04-03T08:39:13.186 INFO:tasks.workunit.client.1.smithi181.stdout:0/226: mknod d5/dc/d14/d29/c49 0 2024-04-03T08:39:13.187 INFO:tasks.workunit.client.0.smithi157.stdout:9/376: creat d1/d36/d69/f7f x:0 0 0 2024-04-03T08:39:13.189 INFO:tasks.workunit.client.0.smithi157.stdout:9/377: chown d1/d15/d27/f47 33 1 2024-04-03T08:39:13.191 INFO:tasks.workunit.client.1.smithi181.stdout:8/192: mknod d4/d6/db/d14/d31/c3e 0 2024-04-03T08:39:13.192 INFO:tasks.workunit.client.0.smithi157.stdout:0/423: unlink d2/d9/dc/df/d1b/l65 0 2024-04-03T08:39:13.192 INFO:tasks.workunit.client.0.smithi157.stdout:1/372: mknod d2/d11/d24/d39/d3b/d2e/d48/d64/c77 0 2024-04-03T08:39:13.193 INFO:tasks.workunit.client.1.smithi181.stdout:5/234: readlink d4/l1d 0 2024-04-03T08:39:13.196 INFO:tasks.workunit.client.1.smithi181.stdout:2/263: rename d13/d1d to d13/d1c/d4a/d68 0 2024-04-03T08:39:13.196 INFO:tasks.workunit.client.0.smithi157.stdout:3/402: mkdir d8/d1e/d2d/d3b/d8c 0 2024-04-03T08:39:13.200 INFO:tasks.workunit.client.1.smithi181.stdout:1/221: dread f2 [0,4194304] 0 2024-04-03T08:39:13.200 INFO:tasks.workunit.client.1.smithi181.stdout:7/189: getdents d0 0 2024-04-03T08:39:13.204 INFO:tasks.workunit.client.1.smithi181.stdout:0/227: dread d5/dc/d14/f22 [4194304,4194304] 0 2024-04-03T08:39:13.206 INFO:tasks.workunit.client.1.smithi181.stdout:9/311: dwrite d1/f6 [4194304,4194304] 0 2024-04-03T08:39:13.206 INFO:tasks.workunit.client.0.smithi157.stdout:5/451: getdents dc/d29/d51 0 2024-04-03T08:39:13.210 INFO:tasks.workunit.client.1.smithi181.stdout:9/312: truncate d1/d34/d39/f59 822423 0 2024-04-03T08:39:13.210 INFO:tasks.workunit.client.1.smithi181.stdout:9/313: chown d1/f35 13407 1 2024-04-03T08:39:13.218 INFO:tasks.workunit.client.0.smithi157.stdout:6/448: dwrite d1/d5/d17/d29/d62/f98 [0,4194304] 0 2024-04-03T08:39:13.219 INFO:tasks.workunit.client.0.smithi157.stdout:7/461: dread d0/d11/d15/d17/d43/d8a/d8f/f78 [4194304,4194304] 0 2024-04-03T08:39:13.220 INFO:tasks.workunit.client.1.smithi181.stdout:3/232: mknod d0/d5/d6/d32/c41 0 2024-04-03T08:39:13.222 INFO:tasks.workunit.client.0.smithi157.stdout:3/403: unlink d8/d1e/d2d/d39/d51/f4a 0 2024-04-03T08:39:13.224 INFO:tasks.workunit.client.0.smithi157.stdout:7/462: chown d0/d11/d15/d17/d1c/l46 26752 1 2024-04-03T08:39:13.228 INFO:tasks.workunit.client.1.smithi181.stdout:4/279: truncate d1/d16/d37/d34/f35 681724 0 2024-04-03T08:39:13.228 INFO:tasks.workunit.client.1.smithi181.stdout:8/193: creat d4/d2a/d37/f3f x:0 0 0 2024-04-03T08:39:13.229 INFO:tasks.workunit.client.1.smithi181.stdout:5/235: symlink d4/d22/l48 0 2024-04-03T08:39:13.232 INFO:tasks.workunit.client.1.smithi181.stdout:5/236: chown d4/d18/d2c/c2f 840784805 1 2024-04-03T08:39:13.232 INFO:tasks.workunit.client.0.smithi157.stdout:1/373: mknod d2/d11/c78 0 2024-04-03T08:39:13.233 INFO:tasks.workunit.client.1.smithi181.stdout:5/237: chown d4/f3f 1 1 2024-04-03T08:39:13.234 INFO:tasks.workunit.client.1.smithi181.stdout:7/190: symlink d0/d1/d6/de/l40 0 2024-04-03T08:39:13.234 INFO:tasks.workunit.client.0.smithi157.stdout:0/424: dread d2/f5b [0,4194304] 0 2024-04-03T08:39:13.235 INFO:tasks.workunit.client.1.smithi181.stdout:1/222: creat d10/d15/d17/d23/d27/f43 x:0 0 0 2024-04-03T08:39:13.237 INFO:tasks.workunit.client.0.smithi157.stdout:6/449: write d1/fc [5042353,9850] 0 2024-04-03T08:39:13.241 INFO:tasks.workunit.client.1.smithi181.stdout:0/228: write d5/d9/f1d [5265943,127294] 0 2024-04-03T08:39:13.243 INFO:tasks.workunit.client.1.smithi181.stdout:4/280: rmdir d1/d16/d37 39 2024-04-03T08:39:13.244 INFO:tasks.workunit.client.0.smithi157.stdout:7/463: read d0/d4/f10 [2720140,56071] 0 2024-04-03T08:39:13.247 INFO:tasks.workunit.client.1.smithi181.stdout:0/229: write d5/dc/d14/d29/f48 [992195,67700] 0 2024-04-03T08:39:13.248 INFO:tasks.workunit.client.1.smithi181.stdout:4/281: write d1/d16/d1f/f50 [427600,113859] 0 2024-04-03T08:39:13.249 INFO:tasks.workunit.client.0.smithi157.stdout:0/425: mknod d2/d9/dc/df/d1b/d35/d3d/ca0 0 2024-04-03T08:39:13.252 INFO:tasks.workunit.client.1.smithi181.stdout:7/191: unlink d0/l25 0 2024-04-03T08:39:13.252 INFO:tasks.workunit.client.0.smithi157.stdout:0/426: chown d2/d9/dc/df/f8a 32649088 1 2024-04-03T08:39:13.253 INFO:tasks.workunit.client.1.smithi181.stdout:4/282: chown d1/d16/d1f/d2b/l4d 164841631 1 2024-04-03T08:39:13.254 INFO:tasks.workunit.client.0.smithi157.stdout:0/427: fdatasync d2/d9/dc/df/d1b/d35/f9e 0 2024-04-03T08:39:13.257 INFO:tasks.workunit.client.0.smithi157.stdout:9/378: getdents d1/d15/d27 0 2024-04-03T08:39:13.258 INFO:tasks.workunit.client.1.smithi181.stdout:5/238: dwrite d4/f3f [0,4194304] 0 2024-04-03T08:39:13.265 INFO:tasks.workunit.client.0.smithi157.stdout:5/452: rename dc/f8c to dc/f9c 0 2024-04-03T08:39:13.266 INFO:tasks.workunit.client.1.smithi181.stdout:3/233: dread d0/d5/d6/dd/f24 [0,4194304] 0 2024-04-03T08:39:13.268 INFO:tasks.workunit.client.0.smithi157.stdout:5/453: dread - dc/d29/d56/d49/d53/d6c/f9b zero size 2024-04-03T08:39:13.273 INFO:tasks.workunit.client.0.smithi157.stdout:1/374: dread f0 [0,4194304] 0 2024-04-03T08:39:13.279 INFO:tasks.workunit.client.1.smithi181.stdout:6/237: write d6/d31/d36/f4c [1031959,39654] 0 2024-04-03T08:39:13.280 INFO:tasks.workunit.client.0.smithi157.stdout:3/404: truncate d8/d13/f56 583649 0 2024-04-03T08:39:13.284 INFO:tasks.workunit.client.0.smithi157.stdout:3/405: chown d8/d1e/d2d/d39/f6c 11594574 1 2024-04-03T08:39:13.286 INFO:tasks.workunit.client.0.smithi157.stdout:9/379: truncate d1/f33 3182482 0 2024-04-03T08:39:13.288 INFO:tasks.workunit.client.0.smithi157.stdout:9/380: dread - d1/d36/d69/f6e zero size 2024-04-03T08:39:13.299 INFO:tasks.workunit.client.0.smithi157.stdout:6/450: link d1/d4b/d38/d59/f83 d1/d4b/d38/d59/f9d 0 2024-04-03T08:39:13.300 INFO:tasks.workunit.client.0.smithi157.stdout:3/406: dread d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:13.301 INFO:tasks.workunit.client.0.smithi157.stdout:6/451: readlink d1/d4b/d38/l3c 0 2024-04-03T08:39:13.303 INFO:tasks.workunit.client.1.smithi181.stdout:0/230: rename d5/d9/d13/l1a to d5/dc/d14/d29/d46/l4a 0 2024-04-03T08:39:13.303 INFO:tasks.workunit.client.0.smithi157.stdout:3/407: chown d8/d1e/d2d/d39/f68 756 1 2024-04-03T08:39:13.306 INFO:tasks.workunit.client.0.smithi157.stdout:3/408: chown f4 119571 1 2024-04-03T08:39:13.313 INFO:tasks.workunit.client.0.smithi157.stdout:6/452: dread d1/d5/d17/d2a/d73/f5c [0,4194304] 0 2024-04-03T08:39:13.313 INFO:tasks.workunit.client.0.smithi157.stdout:5/454: dread f8 [0,4194304] 0 2024-04-03T08:39:13.321 INFO:tasks.workunit.client.1.smithi181.stdout:5/239: unlink f1 0 2024-04-03T08:39:13.323 INFO:tasks.workunit.client.1.smithi181.stdout:9/314: rmdir d1/da/d28/d30/d3e/d53 0 2024-04-03T08:39:13.325 INFO:tasks.workunit.client.1.smithi181.stdout:9/315: write d1/da/d13/d41/d32/f51 [480619,84327] 0 2024-04-03T08:39:13.328 INFO:tasks.workunit.client.1.smithi181.stdout:8/194: getdents d4 0 2024-04-03T08:39:13.329 INFO:tasks.workunit.client.0.smithi157.stdout:9/381: rename d1/d4a/f58 to d1/d4a/d4d/f80 0 2024-04-03T08:39:13.331 INFO:tasks.workunit.client.1.smithi181.stdout:6/238: fsync d6/d31/d36/f3d 0 2024-04-03T08:39:13.332 INFO:tasks.workunit.client.0.smithi157.stdout:9/382: chown d1/d15/d16/f23 1655830 1 2024-04-03T08:39:13.334 INFO:tasks.workunit.client.1.smithi181.stdout:2/264: link d13/d1c/d4a/f4d d13/d22/d27/f69 0 2024-04-03T08:39:13.334 INFO:tasks.workunit.client.1.smithi181.stdout:5/240: dread d4/f3f [0,4194304] 0 2024-04-03T08:39:13.335 INFO:tasks.workunit.client.1.smithi181.stdout:2/265: fdatasync d13/f41 0 2024-04-03T08:39:13.336 INFO:tasks.workunit.client.0.smithi157.stdout:3/409: chown d8/d1e/c2e 11 1 2024-04-03T08:39:13.337 INFO:tasks.workunit.client.1.smithi181.stdout:2/266: write d13/d22/d27/d46/f52 [705018,41970] 0 2024-04-03T08:39:13.338 INFO:tasks.workunit.client.0.smithi157.stdout:5/455: mkdir dc/d29/d56/d52/d9d 0 2024-04-03T08:39:13.340 INFO:tasks.workunit.client.0.smithi157.stdout:6/453: symlink d1/d5/d17/d29/d87/l9e 0 2024-04-03T08:39:13.342 INFO:tasks.workunit.client.0.smithi157.stdout:5/456: write dc/d29/d56/d49/d53/f5b [984064,28926] 0 2024-04-03T08:39:13.343 INFO:tasks.workunit.client.0.smithi157.stdout:5/457: chown dc/c3d 469890 1 2024-04-03T08:39:13.345 INFO:tasks.workunit.client.1.smithi181.stdout:8/195: dwrite d4/f27 [0,4194304] 0 2024-04-03T08:39:13.348 INFO:tasks.workunit.client.0.smithi157.stdout:9/383: dread d1/d15/f63 [0,4194304] 0 2024-04-03T08:39:13.350 INFO:tasks.workunit.client.1.smithi181.stdout:4/283: write d1/d16/d1f/f45 [1268451,68480] 0 2024-04-03T08:39:13.353 INFO:tasks.workunit.client.0.smithi157.stdout:0/428: link d2/d9/dc/df/d1b/d4a/l70 d2/d9/d5f/d8d/la1 0 2024-04-03T08:39:13.353 INFO:tasks.workunit.client.1.smithi181.stdout:0/231: mknod d5/dc/d10/d30/c4b 0 2024-04-03T08:39:13.357 INFO:tasks.workunit.client.1.smithi181.stdout:3/234: write d0/d5/d6/dd/f21 [1229333,3725] 0 2024-04-03T08:39:13.360 INFO:tasks.workunit.client.1.smithi181.stdout:8/196: dread d4/f27 [0,4194304] 0 2024-04-03T08:39:13.371 INFO:tasks.workunit.client.1.smithi181.stdout:9/316: rmdir d1/da/d1a 39 2024-04-03T08:39:13.378 INFO:tasks.workunit.client.0.smithi157.stdout:7/464: getdents d0/d11/d15/d17 0 2024-04-03T08:39:13.379 INFO:tasks.workunit.client.1.smithi181.stdout:6/239: creat d6/d31/f4d x:0 0 0 2024-04-03T08:39:13.381 INFO:tasks.workunit.client.0.smithi157.stdout:1/375: getdents d2/d11/d24/d39/d3b/d2e/d66 0 2024-04-03T08:39:13.381 INFO:tasks.workunit.client.0.smithi157.stdout:7/465: chown d0/d11/d15/d17/d43/d8a/d8f/d5b 121 1 2024-04-03T08:39:13.383 INFO:tasks.workunit.client.1.smithi181.stdout:7/192: read - d0/d1/d6/de/d17/f24 zero size 2024-04-03T08:39:13.383 INFO:tasks.workunit.client.0.smithi157.stdout:6/454: dread d1/d5/d17/d2a/f82 [0,4194304] 0 2024-04-03T08:39:13.384 INFO:tasks.workunit.client.1.smithi181.stdout:7/193: fdatasync d0/d1/d6/de/f2d 0 2024-04-03T08:39:13.384 INFO:tasks.workunit.client.1.smithi181.stdout:4/284: creat d1/d1e/f5b x:0 0 0 2024-04-03T08:39:13.385 INFO:tasks.workunit.client.1.smithi181.stdout:0/232: mknod d5/dc/d10/d30/c4c 0 2024-04-03T08:39:13.389 INFO:tasks.workunit.client.0.smithi157.stdout:5/458: mkdir dc/d29/d56/d9e 0 2024-04-03T08:39:13.390 INFO:tasks.workunit.client.1.smithi181.stdout:3/235: unlink d0/d5/d6/dd/c1f 0 2024-04-03T08:39:13.394 INFO:tasks.workunit.client.0.smithi157.stdout:1/376: unlink d2/d11/d24/d39/d3b/d2e/d48/d64/c76 0 2024-04-03T08:39:13.396 INFO:tasks.workunit.client.0.smithi157.stdout:7/466: creat d0/d11/d15/d35/fac x:0 0 0 2024-04-03T08:39:13.397 INFO:tasks.workunit.client.0.smithi157.stdout:1/377: write d2/d11/d24/d39/f54 [681259,23525] 0 2024-04-03T08:39:13.404 INFO:tasks.workunit.client.1.smithi181.stdout:6/240: rmdir d6/d7 39 2024-04-03T08:39:13.407 INFO:tasks.workunit.client.0.smithi157.stdout:9/384: write d1/f17 [174613,100036] 0 2024-04-03T08:39:13.407 INFO:tasks.workunit.client.0.smithi157.stdout:3/410: symlink d8/d13/d1b/d4e/d50/l8d 0 2024-04-03T08:39:13.409 INFO:tasks.workunit.client.1.smithi181.stdout:5/241: fdatasync d4/d18/d25/f1c 0 2024-04-03T08:39:13.413 INFO:tasks.workunit.client.0.smithi157.stdout:5/459: unlink dc/d35/f40 0 2024-04-03T08:39:13.414 INFO:tasks.workunit.client.0.smithi157.stdout:6/455: write d1/d4b/f45 [3866031,78868] 0 2024-04-03T08:39:13.416 INFO:tasks.workunit.client.0.smithi157.stdout:5/460: fsync dc/d29/d56/d49/d53/f5a 0 2024-04-03T08:39:13.423 INFO:tasks.workunit.client.0.smithi157.stdout:1/378: readlink d2/d11/d24/d39/d3b/d2e/l5b 0 2024-04-03T08:39:13.423 INFO:tasks.workunit.client.1.smithi181.stdout:0/233: rename d5/d9/fd to d5/dc/d14/d29/f4d 0 2024-04-03T08:39:13.427 INFO:tasks.workunit.client.0.smithi157.stdout:9/385: creat d1/d36/f81 x:0 0 0 2024-04-03T08:39:13.427 INFO:tasks.workunit.client.0.smithi157.stdout:3/411: dwrite d8/d1e/d2d/d39/f47 [0,4194304] 0 2024-04-03T08:39:13.431 INFO:tasks.workunit.client.0.smithi157.stdout:6/456: rmdir d1/d5/d17/d2a/d30 39 2024-04-03T08:39:13.432 INFO:tasks.workunit.client.0.smithi157.stdout:5/461: chown dc/l75 138 1 2024-04-03T08:39:13.442 INFO:tasks.workunit.client.0.smithi157.stdout:3/412: rmdir d8/d1e/d2d/d3f/d4d 39 2024-04-03T08:39:13.445 INFO:tasks.workunit.client.0.smithi157.stdout:3/413: write d8/d1e/d2d/d39/f47 [946339,17193] 0 2024-04-03T08:39:13.446 INFO:tasks.workunit.client.1.smithi181.stdout:8/197: link d4/c17 d4/d2a/d37/c40 0 2024-04-03T08:39:13.447 INFO:tasks.workunit.client.0.smithi157.stdout:6/457: creat d1/d4b/d38/f9f x:0 0 0 2024-04-03T08:39:13.447 INFO:tasks.workunit.client.0.smithi157.stdout:7/467: write d0/d11/d15/d17/f25 [3285378,66935] 0 2024-04-03T08:39:13.449 INFO:tasks.workunit.client.1.smithi181.stdout:0/234: mknod d5/d9/d2e/c4e 0 2024-04-03T08:39:13.449 INFO:tasks.workunit.client.1.smithi181.stdout:8/198: write d4/f19 [695508,49936] 0 2024-04-03T08:39:13.450 INFO:tasks.workunit.client.1.smithi181.stdout:6/241: write d6/d7/d9/f1a [5014459,111871] 0 2024-04-03T08:39:13.450 INFO:tasks.workunit.client.0.smithi157.stdout:5/462: mkdir dc/d29/d43/d9f 0 2024-04-03T08:39:13.452 INFO:tasks.workunit.client.1.smithi181.stdout:6/242: fsync d6/d7/d9/f15 0 2024-04-03T08:39:13.453 INFO:tasks.workunit.client.1.smithi181.stdout:1/223: sync 2024-04-03T08:39:13.454 INFO:tasks.workunit.client.0.smithi157.stdout:9/386: rename d1/d15/d16/l60 to d1/d15/d27/d5c/d79/l82 0 2024-04-03T08:39:13.456 INFO:tasks.workunit.client.1.smithi181.stdout:5/242: chown d4/d18/d2c/f40 1709 1 2024-04-03T08:39:13.456 INFO:tasks.workunit.client.1.smithi181.stdout:1/224: chown d10/d15/f36 692899777 1 2024-04-03T08:39:13.456 INFO:tasks.workunit.client.1.smithi181.stdout:8/199: dread - d4/d6/d9/f25 zero size 2024-04-03T08:39:13.457 INFO:tasks.workunit.client.1.smithi181.stdout:5/243: fdatasync d4/d18/d2c/f40 0 2024-04-03T08:39:13.459 INFO:tasks.workunit.client.1.smithi181.stdout:1/225: write d10/d15/d17/f2a [490150,73717] 0 2024-04-03T08:39:13.461 INFO:tasks.workunit.client.0.smithi157.stdout:5/463: rmdir dc/d29/d56/d49 39 2024-04-03T08:39:13.462 INFO:tasks.workunit.client.1.smithi181.stdout:0/235: rename d5/dc/d14/d29/f41 to d5/d9/d2a/f4f 0 2024-04-03T08:39:13.463 INFO:tasks.workunit.client.0.smithi157.stdout:9/387: rmdir d1/d15/d27/d34 39 2024-04-03T08:39:13.465 INFO:tasks.workunit.client.0.smithi157.stdout:1/379: link d2/d11/d24/d39/d3b/d1b/f30 d2/d11/d23/f79 0 2024-04-03T08:39:13.465 INFO:tasks.workunit.client.1.smithi181.stdout:6/243: creat d6/d3e/d40/f4e x:0 0 0 2024-04-03T08:39:13.466 INFO:tasks.workunit.client.1.smithi181.stdout:7/194: getdents d0/d1/d6/de 0 2024-04-03T08:39:13.467 INFO:tasks.workunit.client.1.smithi181.stdout:3/236: getdents d0/d5/d6/dd/d25 0 2024-04-03T08:39:13.467 INFO:tasks.workunit.client.1.smithi181.stdout:6/244: write d6/d31/d36/f4c [1290257,113662] 0 2024-04-03T08:39:13.472 INFO:tasks.workunit.client.0.smithi157.stdout:3/414: dwrite f4 [4194304,4194304] 0 2024-04-03T08:39:13.472 INFO:tasks.workunit.client.0.smithi157.stdout:6/458: dread d1/d5/f46 [0,4194304] 0 2024-04-03T08:39:13.481 INFO:tasks.workunit.client.1.smithi181.stdout:8/200: rmdir d4/d6/db/d14/d31/d1c 39 2024-04-03T08:39:13.483 INFO:tasks.workunit.client.1.smithi181.stdout:8/201: chown d4/d2a/d37/c40 0 1 2024-04-03T08:39:13.483 INFO:tasks.workunit.client.1.smithi181.stdout:5/244: symlink d4/d44/l49 0 2024-04-03T08:39:13.485 INFO:tasks.workunit.client.0.smithi157.stdout:7/468: dwrite d0/d11/d15/d35/fac [0,4194304] 0 2024-04-03T08:39:13.486 INFO:tasks.workunit.client.1.smithi181.stdout:1/226: creat d10/d15/d41/f44 x:0 0 0 2024-04-03T08:39:13.487 INFO:tasks.workunit.client.0.smithi157.stdout:9/388: symlink d1/d4a/l83 0 2024-04-03T08:39:13.491 INFO:tasks.workunit.client.0.smithi157.stdout:6/459: unlink d1/d5/d17/d2a/d85/f8c 0 2024-04-03T08:39:13.497 INFO:tasks.workunit.client.0.smithi157.stdout:6/460: fsync d1/d5/d17/d2a/d73/f71 0 2024-04-03T08:39:13.500 INFO:tasks.workunit.client.0.smithi157.stdout:1/380: mkdir d2/d11/d24/d7a 0 2024-04-03T08:39:13.502 INFO:tasks.workunit.client.0.smithi157.stdout:6/461: chown d1/d4b/d38/f9f 232874 1 2024-04-03T08:39:13.504 INFO:tasks.workunit.client.1.smithi181.stdout:1/227: dwrite d10/d15/d17/d19/f2f [0,4194304] 0 2024-04-03T08:39:13.505 INFO:tasks.workunit.client.0.smithi157.stdout:7/469: read d0/d11/d15/d1b/f39 [1293881,44628] 0 2024-04-03T08:39:13.509 INFO:tasks.workunit.client.1.smithi181.stdout:0/236: rmdir d5/dc/d14/d29 39 2024-04-03T08:39:13.510 INFO:tasks.workunit.client.1.smithi181.stdout:7/195: fdatasync d0/f3e 0 2024-04-03T08:39:13.515 INFO:tasks.workunit.client.0.smithi157.stdout:5/464: dwrite dc/f9c [0,4194304] 0 2024-04-03T08:39:13.515 INFO:tasks.workunit.client.0.smithi157.stdout:1/381: write d2/d11/d24/d39/d3b/fe [3325068,63244] 0 2024-04-03T08:39:13.516 INFO:tasks.workunit.client.1.smithi181.stdout:6/245: rename d6/d4a to d6/d7/d9/d22/d4f 0 2024-04-03T08:39:13.518 INFO:tasks.workunit.client.1.smithi181.stdout:6/246: chown d6/d7/d9/d22/l32 367 1 2024-04-03T08:39:13.521 INFO:tasks.workunit.client.1.smithi181.stdout:5/245: mkdir d4/d22/d4a 0 2024-04-03T08:39:13.522 INFO:tasks.workunit.client.1.smithi181.stdout:6/247: read d6/d31/d36/f33 [2866080,42883] 0 2024-04-03T08:39:13.523 INFO:tasks.workunit.client.1.smithi181.stdout:1/228: dread d10/f16 [0,4194304] 0 2024-04-03T08:39:13.529 INFO:tasks.workunit.client.1.smithi181.stdout:8/202: symlink d4/d6/db/d14/l41 0 2024-04-03T08:39:13.531 INFO:tasks.workunit.client.0.smithi157.stdout:9/389: mknod d1/d36/d66/d75/c84 0 2024-04-03T08:39:13.538 INFO:tasks.workunit.client.1.smithi181.stdout:8/203: dread d4/f19 [0,4194304] 0 2024-04-03T08:39:13.539 INFO:tasks.workunit.client.0.smithi157.stdout:6/462: unlink d1/d5/d17/f4e 0 2024-04-03T08:39:13.540 INFO:tasks.workunit.client.1.smithi181.stdout:8/204: write d4/d6/f2e [322977,32094] 0 2024-04-03T08:39:13.544 INFO:tasks.workunit.client.0.smithi157.stdout:7/470: write d0/d4/f80 [747359,93943] 0 2024-04-03T08:39:13.546 INFO:tasks.workunit.client.0.smithi157.stdout:3/415: getdents d8/d13 0 2024-04-03T08:39:13.549 INFO:tasks.workunit.client.0.smithi157.stdout:1/382: symlink d2/d11/d24/d39/d3b/d2e/d48/l7b 0 2024-04-03T08:39:13.557 INFO:tasks.workunit.client.0.smithi157.stdout:9/390: mknod d1/d4a/d4d/c85 0 2024-04-03T08:39:13.560 INFO:tasks.workunit.client.0.smithi157.stdout:6/463: creat d1/d4b/d61/fa0 x:0 0 0 2024-04-03T08:39:13.560 INFO:tasks.workunit.client.0.smithi157.stdout:9/391: write d1/d15/d16/f3a [1001845,84847] 0 2024-04-03T08:39:13.561 INFO:tasks.workunit.client.1.smithi181.stdout:5/246: truncate d4/d18/d25/f1c 2889760 0 2024-04-03T08:39:13.563 INFO:tasks.workunit.client.0.smithi157.stdout:7/471: rmdir d0/d75 39 2024-04-03T08:39:13.563 INFO:tasks.workunit.client.1.smithi181.stdout:5/247: fdatasync d4/d22/f38 0 2024-04-03T08:39:13.564 INFO:tasks.workunit.client.0.smithi157.stdout:9/392: read d1/d15/f43 [289590,124688] 0 2024-04-03T08:39:13.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:39:13.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:39:13.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:39:13.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:39:13.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:39:13.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:39:13.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr fail", "who": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:39:13.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: osdmap e48: 6 total, 6 up, 6 in 2024-04-03T08:39:13.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "mgr fail", "who": "smithi157.qfvynr"}]': finished 2024-04-03T08:39:13.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: mgrmap e21: smithi181.mfhidq(active, starting, since 0.00925691s) 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:39:13.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: Manager daemon smithi181.mfhidq is now available 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:39:13.568 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:13.569 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:39:13.569 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:39:13.569 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/trash_purge_schedule"}]: dispatch 2024-04-03T08:39:13.569 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:13 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/trash_purge_schedule"}]: dispatch 2024-04-03T08:39:13.570 INFO:tasks.workunit.client.1.smithi181.stdout:7/196: fdatasync d0/f2f 0 2024-04-03T08:39:13.570 INFO:tasks.workunit.client.0.smithi157.stdout:5/465: unlink dc/d29/d56/d49/d53/l81 0 2024-04-03T08:39:13.570 INFO:tasks.workunit.client.0.smithi157.stdout:3/416: mknod d8/d13/d1b/d5b/c8e 0 2024-04-03T08:39:13.575 INFO:tasks.workunit.client.0.smithi157.stdout:1/383: chown d2/d11/f26 0 1 2024-04-03T08:39:13.584 INFO:tasks.workunit.client.0.smithi157.stdout:5/466: dread dc/d29/d56/d49/d53/f5a [0,4194304] 0 2024-04-03T08:39:13.585 INFO:tasks.workunit.client.0.smithi157.stdout:9/393: dwrite d1/d36/d46/f54 [0,4194304] 0 2024-04-03T08:39:13.586 INFO:tasks.workunit.client.1.smithi181.stdout:6/248: mkdir d6/d7/d50 0 2024-04-03T08:39:13.587 INFO:tasks.workunit.client.0.smithi157.stdout:6/464: rmdir d1/d5 39 2024-04-03T08:39:13.588 INFO:tasks.workunit.client.1.smithi181.stdout:6/249: write d6/d31/f48 [942772,87650] 0 2024-04-03T08:39:13.590 INFO:tasks.workunit.client.1.smithi181.stdout:1/229: fdatasync fc 0 2024-04-03T08:39:13.600 INFO:tasks.workunit.client.1.smithi181.stdout:9/317: sync 2024-04-03T08:39:13.600 INFO:tasks.workunit.client.1.smithi181.stdout:4/285: sync 2024-04-03T08:39:13.600 INFO:tasks.workunit.client.1.smithi181.stdout:2/267: sync 2024-04-03T08:39:13.601 INFO:tasks.workunit.client.1.smithi181.stdout:2/268: dread - d13/f35 zero size 2024-04-03T08:39:13.602 INFO:tasks.workunit.client.1.smithi181.stdout:4/286: read d1/d16/d24/f48 [1047717,104952] 0 2024-04-03T08:39:13.603 INFO:tasks.workunit.client.1.smithi181.stdout:2/269: fdatasync d13/d22/d40/f48 0 2024-04-03T08:39:13.605 INFO:tasks.workunit.client.1.smithi181.stdout:2/270: readlink d13/d1c/l45 0 2024-04-03T08:39:13.605 INFO:tasks.workunit.client.1.smithi181.stdout:7/197: creat d0/d1/d6/de/d17/d27/f41 x:0 0 0 2024-04-03T08:39:13.607 INFO:tasks.workunit.client.1.smithi181.stdout:2/271: read d13/d22/d40/f42 [322496,117034] 0 2024-04-03T08:39:13.608 INFO:tasks.workunit.client.1.smithi181.stdout:3/237: link d0/l1a d0/d17/d36/l42 0 2024-04-03T08:39:13.610 INFO:tasks.workunit.client.0.smithi157.stdout:5/467: mknod dc/d29/d56/d2e/ca0 0 2024-04-03T08:39:13.620 INFO:tasks.workunit.client.0.smithi157.stdout:3/417: mkdir d8/d1e/d2d/d3f/d4d/d8f 0 2024-04-03T08:39:13.620 INFO:tasks.workunit.client.1.smithi181.stdout:1/230: creat d10/d15/d17/d19/f45 x:0 0 0 2024-04-03T08:39:13.622 INFO:tasks.workunit.client.1.smithi181.stdout:5/248: mkdir d4/d18/d3e/d4b 0 2024-04-03T08:39:13.625 INFO:tasks.workunit.client.1.smithi181.stdout:8/205: dwrite d4/d6/db/d14/d31/d1c/f2c [0,4194304] 0 2024-04-03T08:39:13.629 INFO:tasks.workunit.client.0.smithi157.stdout:5/468: rmdir dc/d29/d56/d52 39 2024-04-03T08:39:13.630 INFO:tasks.workunit.client.1.smithi181.stdout:8/206: write d4/d6/db/d14/d31/f30 [505258,127687] 0 2024-04-03T08:39:13.631 INFO:tasks.workunit.client.1.smithi181.stdout:8/207: stat d4/d6/db/d14/d31/d1c/f2f 0 2024-04-03T08:39:13.637 INFO:tasks.workunit.client.0.smithi157.stdout:1/384: creat d2/d11/d24/d39/f7c x:0 0 0 2024-04-03T08:39:13.646 INFO:tasks.workunit.client.0.smithi157.stdout:9/394: write d1/f33 [1148536,122997] 0 2024-04-03T08:39:13.646 INFO:tasks.workunit.client.0.smithi157.stdout:3/418: creat d8/d13/d1b/d5b/f90 x:0 0 0 2024-04-03T08:39:13.647 INFO:tasks.workunit.client.1.smithi181.stdout:7/198: rename d0/d1/d6/de/f23 to d0/d1/d6/de/f42 0 2024-04-03T08:39:13.649 INFO:tasks.workunit.client.1.smithi181.stdout:3/238: mkdir d0/d5/d6/d32/d43 0 2024-04-03T08:39:13.650 INFO:tasks.workunit.client.0.smithi157.stdout:5/469: mkdir dc/d29/d43/da1 0 2024-04-03T08:39:13.651 INFO:tasks.workunit.client.0.smithi157.stdout:9/395: fdatasync d1/d36/d69/f6e 0 2024-04-03T08:39:13.651 INFO:tasks.workunit.client.1.smithi181.stdout:0/237: link d5/d9/d13/c35 d5/dc/d14/d29/c50 0 2024-04-03T08:39:13.652 INFO:tasks.workunit.client.0.smithi157.stdout:3/419: write d8/fc [848876,67760] 0 2024-04-03T08:39:13.652 INFO:tasks.workunit.client.0.smithi157.stdout:7/472: link d0/d11/d15/d17/d43/d8a/d8f/c7a d0/d4/d8e/d96/cad 0 2024-04-03T08:39:13.656 INFO:tasks.workunit.client.0.smithi157.stdout:1/385: chown d2/d11/d24/d39/d3b/d2e/d48/d58/l3d 3 1 2024-04-03T08:39:13.657 INFO:tasks.workunit.client.1.smithi181.stdout:1/231: unlink ca 0 2024-04-03T08:39:13.658 INFO:tasks.workunit.client.0.smithi157.stdout:3/420: chown d8/d1e/d2d/d3f/d4d/c4f 121961405 1 2024-04-03T08:39:13.659 INFO:tasks.workunit.client.1.smithi181.stdout:1/232: stat d10/d15/d17/f2a 0 2024-04-03T08:39:13.661 INFO:tasks.workunit.client.0.smithi157.stdout:3/421: write d8/d1e/d2d/d39/f68 [4019952,6083] 0 2024-04-03T08:39:13.662 INFO:tasks.workunit.client.0.smithi157.stdout:1/386: chown d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74 1533 1 2024-04-03T08:39:13.664 INFO:tasks.workunit.client.0.smithi157.stdout:1/387: fsync d2/f21 0 2024-04-03T08:39:13.666 INFO:tasks.workunit.client.1.smithi181.stdout:8/208: rename d4/d2a/f29 to d4/d6/db/d14/f42 0 2024-04-03T08:39:13.668 INFO:tasks.workunit.client.1.smithi181.stdout:8/209: read - d4/d6/f39 zero size 2024-04-03T08:39:13.677 INFO:tasks.workunit.client.1.smithi181.stdout:2/272: write d13/d22/d27/d2f/f5e [108112,69148] 0 2024-04-03T08:39:13.680 INFO:tasks.workunit.client.1.smithi181.stdout:3/239: creat d0/d5/d6/dd/d25/f44 x:0 0 0 2024-04-03T08:39:13.682 INFO:tasks.workunit.client.1.smithi181.stdout:3/240: write d0/d17/d36/d1e/f28 [6879892,16037] 0 2024-04-03T08:39:13.682 INFO:tasks.workunit.client.0.smithi157.stdout:7/473: dread d0/d11/d15/f2e [0,4194304] 0 2024-04-03T08:39:13.683 INFO:tasks.workunit.client.1.smithi181.stdout:0/238: rmdir d5/dc/d14 39 2024-04-03T08:39:13.687 INFO:tasks.workunit.client.1.smithi181.stdout:4/287: write d1/f32 [1579605,84344] 0 2024-04-03T08:39:13.689 INFO:tasks.workunit.client.1.smithi181.stdout:4/288: fsync d1/d16/d1f/f3c 0 2024-04-03T08:39:13.690 INFO:tasks.workunit.client.1.smithi181.stdout:4/289: stat d1/c19 0 2024-04-03T08:39:13.692 INFO:tasks.workunit.client.1.smithi181.stdout:4/290: write d1/d16/f13 [3095856,45985] 0 2024-04-03T08:39:13.693 INFO:tasks.workunit.client.1.smithi181.stdout:7/199: rename d0/d1/d6/de/d17/c3d to d0/d1/d6/de/d17/d27/c43 0 2024-04-03T08:39:13.695 INFO:tasks.workunit.client.1.smithi181.stdout:9/318: rmdir d1/da/d13/d41/d5c 0 2024-04-03T08:39:13.696 INFO:tasks.workunit.client.0.smithi157.stdout:6/465: mknod d1/d5/d17/d29/ca1 0 2024-04-03T08:39:13.697 INFO:tasks.workunit.client.1.smithi181.stdout:3/241: fsync d0/d5/d6/dd/f24 0 2024-04-03T08:39:13.699 INFO:tasks.workunit.client.1.smithi181.stdout:3/242: chown d0/d5/d6/dd/f21 52710716 1 2024-04-03T08:39:13.702 INFO:tasks.workunit.client.1.smithi181.stdout:1/233: symlink d10/l46 0 2024-04-03T08:39:13.706 INFO:tasks.workunit.client.1.smithi181.stdout:5/249: link d4/l1f d4/d18/d25/l4c 0 2024-04-03T08:39:13.707 INFO:tasks.workunit.client.0.smithi157.stdout:9/396: fdatasync d1/f26 0 2024-04-03T08:39:13.709 INFO:tasks.workunit.client.1.smithi181.stdout:6/250: sync 2024-04-03T08:39:13.710 INFO:tasks.workunit.client.1.smithi181.stdout:6/251: stat d6/d31/d36/l41 0 2024-04-03T08:39:13.715 INFO:tasks.workunit.client.1.smithi181.stdout:2/273: rename d13/d1c/d4a/d68/f65 to d13/d22/d40/f6a 0 2024-04-03T08:39:13.717 INFO:tasks.workunit.client.0.smithi157.stdout:7/474: rename d0/d11/d15/d17/d43/d8a/d8f/c7e to d0/d11/d15/d17/d9f/daa/cae 0 2024-04-03T08:39:13.721 INFO:tasks.workunit.client.1.smithi181.stdout:7/200: creat d0/d1/d6/de/f44 x:0 0 0 2024-04-03T08:39:13.723 INFO:tasks.workunit.client.1.smithi181.stdout:9/319: creat d1/da/d28/f64 x:0 0 0 2024-04-03T08:39:13.725 INFO:tasks.workunit.client.0.smithi157.stdout:1/388: write d2/d11/d23/f4d [41024,60724] 0 2024-04-03T08:39:13.725 INFO:tasks.workunit.client.0.smithi157.stdout:5/470: dwrite f7 [0,4194304] 0 2024-04-03T08:39:13.728 INFO:tasks.workunit.client.0.smithi157.stdout:1/389: write d2/d11/d24/d39/d3b/d2e/d48/d5d/f60 [315464,108821] 0 2024-04-03T08:39:13.739 INFO:tasks.workunit.client.0.smithi157.stdout:5/471: dwrite dc/f1f [0,4194304] 0 2024-04-03T08:39:13.743 INFO:tasks.workunit.client.1.smithi181.stdout:9/320: dwrite d1/d34/d39/f50 [4194304,4194304] 0 2024-04-03T08:39:13.744 INFO:tasks.workunit.client.0.smithi157.stdout:4/407: sync 2024-04-03T08:39:13.744 INFO:tasks.workunit.client.0.smithi157.stdout:8/437: sync 2024-04-03T08:39:13.750 INFO:tasks.workunit.client.0.smithi157.stdout:9/397: rmdir d1/d36/d66 39 2024-04-03T08:39:13.753 INFO:tasks.workunit.client.1.smithi181.stdout:0/239: fsync d5/dc/f1e 0 2024-04-03T08:39:13.753 INFO:tasks.workunit.client.0.smithi157.stdout:9/398: truncate d1/d36/d46/f56 909271 0 2024-04-03T08:39:13.753 INFO:tasks.workunit.client.0.smithi157.stdout:7/475: mkdir d0/d4/daf 0 2024-04-03T08:39:13.759 INFO:tasks.workunit.client.1.smithi181.stdout:8/210: creat d4/d6/db/d14/d31/f43 x:0 0 0 2024-04-03T08:39:13.764 INFO:tasks.workunit.client.1.smithi181.stdout:6/252: unlink d6/d7/d9/l1c 0 2024-04-03T08:39:13.764 INFO:tasks.workunit.client.0.smithi157.stdout:1/390: unlink d2/f21 0 2024-04-03T08:39:13.767 INFO:tasks.workunit.client.1.smithi181.stdout:4/291: symlink d1/d16/d51/l5c 0 2024-04-03T08:39:13.768 INFO:tasks.workunit.client.1.smithi181.stdout:4/292: fsync d1/d16/d1f/f3c 0 2024-04-03T08:39:13.771 INFO:tasks.workunit.client.0.smithi157.stdout:5/472: chown dc/d29/d56/d52/c54 153816 1 2024-04-03T08:39:13.775 INFO:tasks.workunit.client.0.smithi157.stdout:6/466: rename d1/d5/d17/c19 to d1/d5/d17/d2a/d37/ca2 0 2024-04-03T08:39:13.780 INFO:tasks.workunit.client.0.smithi157.stdout:7/476: fsync d0/d11/d15/d17/d43/d8a/d8f/f78 0 2024-04-03T08:39:13.791 INFO:tasks.workunit.client.0.smithi157.stdout:6/467: mkdir d1/d5/d17/d29/da3 0 2024-04-03T08:39:13.792 INFO:tasks.workunit.client.0.smithi157.stdout:9/399: dread d1/d15/d27/f55 [0,4194304] 0 2024-04-03T08:39:13.794 INFO:tasks.workunit.client.1.smithi181.stdout:8/211: rmdir d4/d6/db/d14 39 2024-04-03T08:39:13.795 INFO:tasks.workunit.client.0.smithi157.stdout:8/438: dwrite d2/d11/d10/d24/d5b/d2e/f3f [0,4194304] 0 2024-04-03T08:39:13.795 INFO:tasks.workunit.client.0.smithi157.stdout:7/477: mknod d0/d11/d15/d17/d9f/daa/cb0 0 2024-04-03T08:39:13.796 INFO:tasks.workunit.client.0.smithi157.stdout:4/408: creat da/df/d24/d35/f87 x:0 0 0 2024-04-03T08:39:13.797 INFO:tasks.workunit.client.1.smithi181.stdout:4/293: mkdir d1/d16/d1f/d31/d39/d5d 0 2024-04-03T08:39:13.802 INFO:tasks.workunit.client.1.smithi181.stdout:7/201: symlink d0/d1/d6/l45 0 2024-04-03T08:39:13.804 INFO:tasks.workunit.client.0.smithi157.stdout:8/439: fdatasync d2/d11/d10/d24/d5b/d2e/f80 0 2024-04-03T08:39:13.804 INFO:tasks.workunit.client.0.smithi157.stdout:5/473: rename dc/d29/d56/l47 to dc/d29/d56/d49/la2 0 2024-04-03T08:39:13.810 INFO:tasks.workunit.client.1.smithi181.stdout:2/274: truncate d13/d1c/d4a/d68/f50 697764 0 2024-04-03T08:39:13.811 INFO:tasks.workunit.client.1.smithi181.stdout:7/202: write d0/d1/d6/f9 [5120096,124582] 0 2024-04-03T08:39:13.813 INFO:tasks.workunit.client.1.smithi181.stdout:8/212: dread d4/fc [0,4194304] 0 2024-04-03T08:39:13.813 INFO:tasks.workunit.client.1.smithi181.stdout:9/321: fsync d1/f20 0 2024-04-03T08:39:13.814 INFO:tasks.workunit.client.0.smithi157.stdout:5/474: dread dc/d29/d56/d49/f6e [0,4194304] 0 2024-04-03T08:39:13.814 INFO:tasks.workunit.client.1.smithi181.stdout:3/243: creat d0/d17/d36/f45 x:0 0 0 2024-04-03T08:39:13.816 INFO:tasks.workunit.client.0.smithi157.stdout:8/440: read d2/d11/d10/d24/d5b/f4b [2294889,98886] 0 2024-04-03T08:39:13.818 INFO:tasks.workunit.client.1.smithi181.stdout:2/275: chown d13/d1c/c1f 60005574 1 2024-04-03T08:39:13.818 INFO:tasks.workunit.client.0.smithi157.stdout:5/475: write dc/d29/d56/d18/f99 [771158,3680] 0 2024-04-03T08:39:13.822 INFO:tasks.workunit.client.0.smithi157.stdout:1/391: rename d2/d11/d24/d39/d3b/d1b/f28 to d2/d11/d24/d39/d3b/d2e/f7d 0 2024-04-03T08:39:13.822 INFO:tasks.workunit.client.1.smithi181.stdout:5/250: dwrite d4/d18/d2c/f34 [0,4194304] 0 2024-04-03T08:39:13.824 INFO:tasks.workunit.client.1.smithi181.stdout:3/244: write d0/d17/d36/d1e/f28 [8360183,72000] 0 2024-04-03T08:39:13.826 INFO:tasks.workunit.client.1.smithi181.stdout:3/245: fsync d0/d17/f26 0 2024-04-03T08:39:13.827 INFO:tasks.workunit.client.1.smithi181.stdout:4/294: rename d1/d16/d1f to d1/d16/d24/d5e 0 2024-04-03T08:39:13.833 INFO:tasks.workunit.client.0.smithi157.stdout:6/468: mkdir d1/d5/d17/d29/d62/d7f/d89/da4 0 2024-04-03T08:39:13.835 INFO:tasks.workunit.client.0.smithi157.stdout:6/469: stat d1/d5/d17/d29/d62 0 2024-04-03T08:39:13.836 INFO:tasks.workunit.client.1.smithi181.stdout:1/234: mknod d10/d15/d17/d19/d33/c47 0 2024-04-03T08:39:13.837 INFO:tasks.workunit.client.0.smithi157.stdout:8/441: fsync d2/d20/d23/f5c 0 2024-04-03T08:39:13.839 INFO:tasks.workunit.client.1.smithi181.stdout:3/246: fdatasync d0/d17/d36/d1e/f28 0 2024-04-03T08:39:13.839 INFO:tasks.workunit.client.0.smithi157.stdout:1/392: rmdir d2/d11/d24/d39/d3b/d2e/d48/d64 39 2024-04-03T08:39:13.845 INFO:tasks.workunit.client.0.smithi157.stdout:7/478: link d0/d11/d15/d17/d1c/d4f/d5f/c81 d0/d11/d6f/d89/cb1 0 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:39:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr fail", "who": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: osdmap e48: 6 total, 6 up, 6 in 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.14208 172.21.15.157:0/1087688674' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "mgr fail", "who": "smithi157.qfvynr"}]': finished 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: mgrmap e21: smithi181.mfhidq(active, starting, since 0.00925691s) 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:39:13.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: Manager daemon smithi181.mfhidq is now available 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/trash_purge_schedule"}]: dispatch 2024-04-03T08:39:13.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:13 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi181.mfhidq/trash_purge_schedule"}]: dispatch 2024-04-03T08:39:13.850 INFO:tasks.workunit.client.0.smithi157.stdout:6/470: mkdir d1/d4b/da5 0 2024-04-03T08:39:13.855 INFO:tasks.workunit.client.1.smithi181.stdout:2/276: write f3 [810669,23980] 0 2024-04-03T08:39:13.862 INFO:tasks.workunit.client.1.smithi181.stdout:7/203: symlink d0/d1/l46 0 2024-04-03T08:39:13.862 INFO:tasks.workunit.client.1.smithi181.stdout:4/295: creat d1/d16/d24/d5e/d3f/f5f x:0 0 0 2024-04-03T08:39:13.863 INFO:tasks.workunit.client.0.smithi157.stdout:7/479: creat d0/d4/da5/fb2 x:0 0 0 2024-04-03T08:39:13.864 INFO:tasks.workunit.client.1.smithi181.stdout:7/204: chown d0/d1/d6/de 773 1 2024-04-03T08:39:13.864 INFO:tasks.workunit.client.0.smithi157.stdout:8/442: rename d2/d20/f3b to d2/d11/f93 0 2024-04-03T08:39:13.866 INFO:tasks.workunit.client.1.smithi181.stdout:3/247: symlink d0/d5/d6/dd/d25/l46 0 2024-04-03T08:39:13.867 INFO:tasks.workunit.client.1.smithi181.stdout:8/213: rmdir d4/d6/db/d14 39 2024-04-03T08:39:13.867 INFO:tasks.workunit.client.0.smithi157.stdout:6/471: write d1/d5/d17/d2a/d37/f25 [2008844,53383] 0 2024-04-03T08:39:13.869 INFO:tasks.workunit.client.0.smithi157.stdout:7/480: readlink d0/d11/d15/d17/d1c/d4f/d5f/d61/l9e 0 2024-04-03T08:39:13.871 INFO:tasks.workunit.client.1.smithi181.stdout:4/296: creat d1/d1e/d2c/f60 x:0 0 0 2024-04-03T08:39:13.872 INFO:tasks.workunit.client.0.smithi157.stdout:1/393: rename d2/d11/l34 to d2/d11/d23/d73/l7e 0 2024-04-03T08:39:13.873 INFO:tasks.workunit.client.1.smithi181.stdout:2/277: dwrite d13/d22/d27/d46/f49 [0,4194304] 0 2024-04-03T08:39:13.873 INFO:tasks.workunit.client.1.smithi181.stdout:7/205: mknod d0/d1/d6/de/c47 0 2024-04-03T08:39:13.874 INFO:tasks.workunit.client.0.smithi157.stdout:7/481: chown d0/d11/d15/d17/d1c/d4f/d5f/c6d 15542 1 2024-04-03T08:39:13.874 INFO:tasks.workunit.client.0.smithi157.stdout:8/443: mkdir d2/d11/d10/d24/d5b/d2e/d94 0 2024-04-03T08:39:13.877 INFO:tasks.workunit.client.0.smithi157.stdout:6/472: mkdir d1/d4b/d38/da6 0 2024-04-03T08:39:13.878 INFO:tasks.workunit.client.1.smithi181.stdout:8/214: mkdir d4/d44 0 2024-04-03T08:39:13.880 INFO:tasks.workunit.client.0.smithi157.stdout:1/394: mkdir d2/d11/d24/d39/d3b/d1b/d7f 0 2024-04-03T08:39:13.882 INFO:tasks.workunit.client.0.smithi157.stdout:7/482: truncate d0/d11/d15/d17/d43/d8a/f94 5183245 0 2024-04-03T08:39:13.882 INFO:tasks.workunit.client.1.smithi181.stdout:5/251: rename d4/l45 to d4/d18/l4d 0 2024-04-03T08:39:13.884 INFO:tasks.workunit.client.0.smithi157.stdout:6/473: mkdir d1/d5/d17/d29/da7 0 2024-04-03T08:39:13.886 INFO:tasks.workunit.client.0.smithi157.stdout:1/395: mknod d2/c80 0 2024-04-03T08:39:13.888 INFO:tasks.workunit.client.1.smithi181.stdout:3/248: truncate d0/d5/d6/dd/f24 1130023 0 2024-04-03T08:39:13.891 INFO:tasks.workunit.client.1.smithi181.stdout:9/322: getdents d1/da/d28/d30/d3e/d52 0 2024-04-03T08:39:13.892 INFO:tasks.workunit.client.0.smithi157.stdout:7/483: symlink d0/d4/daf/lb3 0 2024-04-03T08:39:13.895 INFO:tasks.workunit.client.1.smithi181.stdout:3/249: read d0/d5/fa [3842835,98371] 0 2024-04-03T08:39:13.897 INFO:tasks.workunit.client.1.smithi181.stdout:3/250: write d0/d17/f2e [3832824,126809] 0 2024-04-03T08:39:13.898 INFO:tasks.workunit.client.1.smithi181.stdout:0/240: sync 2024-04-03T08:39:13.898 INFO:tasks.workunit.client.1.smithi181.stdout:6/253: sync 2024-04-03T08:39:13.898 INFO:tasks.workunit.client.0.smithi157.stdout:7/484: read d0/d11/d15/d1b/f39 [364378,125162] 0 2024-04-03T08:39:13.900 INFO:tasks.workunit.client.1.smithi181.stdout:0/241: chown d5/d9/d2c 126292208 1 2024-04-03T08:39:13.904 INFO:tasks.workunit.client.1.smithi181.stdout:9/323: unlink d1/f57 0 2024-04-03T08:39:13.910 INFO:tasks.workunit.client.1.smithi181.stdout:4/297: rmdir d1/d16/d24/d5e/d31/d39/d58 0 2024-04-03T08:39:13.911 INFO:tasks.workunit.client.1.smithi181.stdout:9/324: chown d1/da/d28/d30/l4d 60 1 2024-04-03T08:39:13.911 INFO:tasks.workunit.client.0.smithi157.stdout:8/444: getdents d2/d20/d77 0 2024-04-03T08:39:13.913 INFO:tasks.workunit.client.0.smithi157.stdout:7/485: mkdir d0/d11/d15/d1b/db4 0 2024-04-03T08:39:13.914 INFO:tasks.workunit.client.1.smithi181.stdout:7/206: dread d0/d1/d6/de/f2d [0,4194304] 0 2024-04-03T08:39:13.914 INFO:tasks.workunit.client.1.smithi181.stdout:6/254: symlink d6/d3e/l51 0 2024-04-03T08:39:13.916 INFO:tasks.workunit.client.1.smithi181.stdout:6/255: dread - d6/d7/f38 zero size 2024-04-03T08:39:13.916 INFO:tasks.workunit.client.1.smithi181.stdout:0/242: rmdir d5/d9/d2a 39 2024-04-03T08:39:13.917 INFO:tasks.workunit.client.0.smithi157.stdout:6/474: getdents d1/d5/d17/d29 0 2024-04-03T08:39:13.918 INFO:tasks.workunit.client.1.smithi181.stdout:6/256: write d6/d31/d36/f34 [1796714,95366] 0 2024-04-03T08:39:13.920 INFO:tasks.workunit.client.0.smithi157.stdout:7/486: mknod d0/d11/d15/d1b/cb5 0 2024-04-03T08:39:13.921 INFO:tasks.workunit.client.0.smithi157.stdout:6/475: chown d1/d5/d17/d2a/d37/f7b 52 1 2024-04-03T08:39:13.922 INFO:tasks.workunit.client.1.smithi181.stdout:8/215: fdatasync d4/d6/db/d14/d31/f43 0 2024-04-03T08:39:13.925 INFO:tasks.workunit.client.1.smithi181.stdout:4/298: chown d1/d16/d37/d34/c36 30211 1 2024-04-03T08:39:13.926 INFO:tasks.workunit.client.1.smithi181.stdout:9/325: mkdir d1/da/d13/d41/d65 0 2024-04-03T08:39:13.926 INFO:tasks.workunit.client.1.smithi181.stdout:4/299: readlink d1/l5 0 2024-04-03T08:39:13.928 INFO:tasks.workunit.client.0.smithi157.stdout:7/487: mkdir d0/d11/d15/d17/d52/db6 0 2024-04-03T08:39:13.928 INFO:tasks.workunit.client.1.smithi181.stdout:4/300: dread - d1/d1e/f5b zero size 2024-04-03T08:39:13.930 INFO:tasks.workunit.client.1.smithi181.stdout:2/278: dread f11 [0,4194304] 0 2024-04-03T08:39:13.930 INFO:tasks.workunit.client.0.smithi157.stdout:6/476: truncate d1/d5/f1a 1379301 0 2024-04-03T08:39:13.930 INFO:tasks.workunit.client.0.smithi157.stdout:1/396: truncate d2/d11/d24/f1f 6711602 0 2024-04-03T08:39:13.933 INFO:tasks.workunit.client.0.smithi157.stdout:7/488: chown d0/d11/d15/d17/d1c/f5c 70294136 1 2024-04-03T08:39:13.935 INFO:tasks.workunit.client.0.smithi157.stdout:8/445: dwrite d2/d11/f90 [0,4194304] 0 2024-04-03T08:39:13.937 INFO:tasks.workunit.client.1.smithi181.stdout:1/235: rename d10/c13 to d10/d15/d17/c48 0 2024-04-03T08:39:13.938 INFO:tasks.workunit.client.0.smithi157.stdout:6/477: write d1/d5/d17/d29/f7d [3905337,9665] 0 2024-04-03T08:39:13.939 INFO:tasks.workunit.client.1.smithi181.stdout:7/207: symlink d0/d1/l48 0 2024-04-03T08:39:13.941 INFO:tasks.workunit.client.0.smithi157.stdout:7/489: chown d0/d11/d15/f87 0 1 2024-04-03T08:39:13.943 INFO:tasks.workunit.client.1.smithi181.stdout:4/301: mkdir d1/d16/d24/d61 0 2024-04-03T08:39:13.943 INFO:tasks.workunit.client.1.smithi181.stdout:9/326: dwrite d1/da/d13/d41/f1b [0,4194304] 0 2024-04-03T08:39:13.949 INFO:tasks.workunit.client.1.smithi181.stdout:2/279: unlink d13/f1e 0 2024-04-03T08:39:13.949 INFO:tasks.workunit.client.1.smithi181.stdout:0/243: mknod d5/dc/d14/d29/d46/c51 0 2024-04-03T08:39:13.953 INFO:tasks.workunit.client.1.smithi181.stdout:2/280: stat d13/d22/d40/f48 0 2024-04-03T08:39:13.955 INFO:tasks.workunit.client.1.smithi181.stdout:4/302: write d1/d16/d24/d5e/f4a [181405,78966] 0 2024-04-03T08:39:13.957 INFO:tasks.workunit.client.1.smithi181.stdout:3/251: truncate d0/d5/d6/f11 3612613 0 2024-04-03T08:39:13.961 INFO:tasks.workunit.client.0.smithi157.stdout:7/490: dwrite d0/d11/d15/d1b/f57 [0,4194304] 0 2024-04-03T08:39:13.965 INFO:tasks.workunit.client.1.smithi181.stdout:9/327: chown d1/da/d1a/f4c 7618 1 2024-04-03T08:39:13.965 INFO:tasks.workunit.client.0.smithi157.stdout:2/448: sync 2024-04-03T08:39:13.969 INFO:tasks.workunit.client.1.smithi181.stdout:1/236: dread d10/d15/d17/d19/f3e [0,4194304] 0 2024-04-03T08:39:13.971 INFO:tasks.workunit.client.1.smithi181.stdout:6/257: link d6/c2f d6/d31/c52 0 2024-04-03T08:39:13.972 INFO:tasks.workunit.client.0.smithi157.stdout:0/429: sync 2024-04-03T08:39:13.980 INFO:tasks.workunit.client.1.smithi181.stdout:8/216: rename d4/d6 to d4/d45 0 2024-04-03T08:39:13.984 INFO:tasks.workunit.client.1.smithi181.stdout:0/244: write d5/d9/d2c/f2d [334446,108814] 0 2024-04-03T08:39:13.984 INFO:tasks.workunit.client.0.smithi157.stdout:8/446: creat d2/d11/f95 x:0 0 0 2024-04-03T08:39:13.987 INFO:tasks.workunit.client.0.smithi157.stdout:7/491: rename d0/d11/d15/d17/d52/f68 to d0/d11/d15/d17/d43/fb7 0 2024-04-03T08:39:13.991 INFO:tasks.workunit.client.1.smithi181.stdout:4/303: creat d1/d16/d55/f62 x:0 0 0 2024-04-03T08:39:13.995 INFO:tasks.workunit.client.1.smithi181.stdout:2/281: mknod d13/d1c/d4a/c6b 0 2024-04-03T08:39:13.999 INFO:tasks.workunit.client.0.smithi157.stdout:6/478: getdents d1/d5/d17/d29/d62 0 2024-04-03T08:39:14.004 INFO:tasks.workunit.client.0.smithi157.stdout:2/449: dwrite d3/db/d44/f5b [0,4194304] 0 2024-04-03T08:39:14.005 INFO:tasks.workunit.client.1.smithi181.stdout:7/208: link d0/d1/d6/de/d17/d27/f2e d0/d1/d6/de/d17/d27/f49 0 2024-04-03T08:39:14.006 INFO:tasks.workunit.client.1.smithi181.stdout:4/304: dwrite d1/d16/f54 [0,4194304] 0 2024-04-03T08:39:14.007 INFO:tasks.workunit.client.0.smithi157.stdout:1/397: truncate d2/d11/d24/d39/d3b/d2e/f7d 1562890 0 2024-04-03T08:39:14.010 INFO:tasks.workunit.client.1.smithi181.stdout:9/328: symlink d1/da/d28/l66 0 2024-04-03T08:39:14.014 INFO:tasks.workunit.client.0.smithi157.stdout:8/447: rmdir d2/d20 39 2024-04-03T08:39:14.017 INFO:tasks.workunit.client.0.smithi157.stdout:7/492: rename d0/d11/d15/d35 to d0/d11/d15/d1b/db8 0 2024-04-03T08:39:14.019 INFO:tasks.workunit.client.1.smithi181.stdout:6/258: unlink d6/d31/d36/c23 0 2024-04-03T08:39:14.023 INFO:tasks.workunit.client.1.smithi181.stdout:6/259: write d6/d31/f48 [926688,119438] 0 2024-04-03T08:39:14.025 INFO:tasks.workunit.client.1.smithi181.stdout:4/305: dwrite d1/d16/d24/d5e/f53 [0,4194304] 0 2024-04-03T08:39:14.028 INFO:tasks.workunit.client.1.smithi181.stdout:5/252: rename d4/d18/d25/f20 to d4/d18/f4e 0 2024-04-03T08:39:14.028 INFO:tasks.workunit.client.1.smithi181.stdout:3/252: mknod d0/d5/d6/d32/d43/c47 0 2024-04-03T08:39:14.031 INFO:tasks.workunit.client.1.smithi181.stdout:3/253: chown d0/d5/f38 64 1 2024-04-03T08:39:14.032 INFO:tasks.workunit.client.1.smithi181.stdout:5/253: write d4/d18/d2c/f40 [956463,65981] 0 2024-04-03T08:39:14.032 INFO:tasks.workunit.client.1.smithi181.stdout:7/209: rmdir d0/d1/d6/de/d17 39 2024-04-03T08:39:14.035 INFO:tasks.workunit.client.1.smithi181.stdout:9/329: unlink d1/da/f1e 0 2024-04-03T08:39:14.035 INFO:tasks.workunit.client.1.smithi181.stdout:1/237: symlink d10/d15/d17/l49 0 2024-04-03T08:39:14.041 INFO:tasks.workunit.client.0.smithi157.stdout:0/430: getdents d2/d9/d51/d63/d71 0 2024-04-03T08:39:14.043 INFO:tasks.workunit.client.0.smithi157.stdout:6/479: getdents d1/d5/d17/d29/d87 0 2024-04-03T08:39:14.044 INFO:tasks.workunit.client.1.smithi181.stdout:4/306: unlink d1/d16/d24/d5e/d3f/f5f 0 2024-04-03T08:39:14.045 INFO:tasks.workunit.client.1.smithi181.stdout:2/282: mkdir d13/d1c/d6c 0 2024-04-03T08:39:14.046 INFO:tasks.workunit.client.1.smithi181.stdout:4/307: write d1/d16/f54 [2732030,36023] 0 2024-04-03T08:39:14.048 INFO:tasks.workunit.client.1.smithi181.stdout:4/308: chown d1/d16/d24/c38 63458353 1 2024-04-03T08:39:14.048 INFO:tasks.workunit.client.1.smithi181.stdout:0/245: rename d5/d9/d13 to d5/d52 0 2024-04-03T08:39:14.049 INFO:tasks.workunit.client.1.smithi181.stdout:2/283: rename d13 to d13/d22/d27/d46/d6d 22 2024-04-03T08:39:14.050 INFO:tasks.workunit.client.1.smithi181.stdout:0/246: write f2 [3383994,58593] 0 2024-04-03T08:39:14.050 INFO:tasks.workunit.client.1.smithi181.stdout:2/284: readlink d13/l60 0 2024-04-03T08:39:14.052 INFO:tasks.workunit.client.1.smithi181.stdout:3/254: creat d0/d5/d6/d32/d43/f48 x:0 0 0 2024-04-03T08:39:14.052 INFO:tasks.workunit.client.1.smithi181.stdout:4/309: read d1/d16/d24/f47 [150387,112736] 0 2024-04-03T08:39:14.053 INFO:tasks.workunit.client.1.smithi181.stdout:5/254: truncate d4/f5 178654 0 2024-04-03T08:39:14.054 INFO:tasks.workunit.client.0.smithi157.stdout:6/480: dread d1/f3 [0,4194304] 0 2024-04-03T08:39:14.055 INFO:tasks.workunit.client.1.smithi181.stdout:1/238: mkdir d10/d15/d4a 0 2024-04-03T08:39:14.056 INFO:tasks.workunit.client.1.smithi181.stdout:9/330: creat d1/da/d13/d41/d32/f67 x:0 0 0 2024-04-03T08:39:14.057 INFO:tasks.workunit.client.1.smithi181.stdout:7/210: write d0/d1/d6/de/d17/d27/f3a [289579,76759] 0 2024-04-03T08:39:14.058 INFO:tasks.workunit.client.1.smithi181.stdout:9/331: fdatasync d1/da/d13/d22/f2e 0 2024-04-03T08:39:14.059 INFO:tasks.workunit.client.0.smithi157.stdout:0/431: getdents d2/d9/d36/d82 0 2024-04-03T08:39:14.061 INFO:tasks.workunit.client.1.smithi181.stdout:4/310: symlink d1/d16/d24/d5e/d2b/l63 0 2024-04-03T08:39:14.064 INFO:tasks.workunit.client.1.smithi181.stdout:4/311: write d1/d1e/f5b [893519,33979] 0 2024-04-03T08:39:14.064 INFO:tasks.workunit.client.0.smithi157.stdout:0/432: mknod d2/d9/dc/df/d1b/ca2 0 2024-04-03T08:39:14.065 INFO:tasks.workunit.client.1.smithi181.stdout:2/285: symlink d13/d22/l6e 0 2024-04-03T08:39:14.068 INFO:tasks.workunit.client.0.smithi157.stdout:0/433: chown d2/d9/d51/f52 88160026 1 2024-04-03T08:39:14.071 INFO:tasks.workunit.client.1.smithi181.stdout:3/255: rename d0/d5/d6/dd/f24 to d0/d17/d36/d1e/f49 0 2024-04-03T08:39:14.074 INFO:tasks.workunit.client.0.smithi157.stdout:0/434: stat d2/d9/dc/df/d6f/d9d/l84 0 2024-04-03T08:39:14.076 INFO:tasks.workunit.client.0.smithi157.stdout:6/481: dwrite d1/d5/d17/d29/f5a [0,4194304] 0 2024-04-03T08:39:14.076 INFO:tasks.workunit.client.1.smithi181.stdout:5/255: dwrite d4/d18/f35 [0,4194304] 0 2024-04-03T08:39:14.077 INFO:tasks.workunit.client.0.smithi157.stdout:6/482: chown d1/d5/d17/d29/d62/d7f/d89 1281 1 2024-04-03T08:39:14.079 INFO:tasks.workunit.client.1.smithi181.stdout:7/211: link d0/f3b d0/d1/f4a 0 2024-04-03T08:39:14.081 INFO:tasks.workunit.client.0.smithi157.stdout:6/483: fsync d1/d5/d1b/f1c 0 2024-04-03T08:39:14.083 INFO:tasks.workunit.client.0.smithi157.stdout:0/435: getdents d2/d9/dc 0 2024-04-03T08:39:14.085 INFO:tasks.workunit.client.0.smithi157.stdout:0/436: fdatasync d2/f2c 0 2024-04-03T08:39:14.086 INFO:tasks.workunit.client.0.smithi157.stdout:6/484: write d1/d5/d17/d29/d62/f98 [3802989,47306] 0 2024-04-03T08:39:14.096 INFO:tasks.workunit.client.1.smithi181.stdout:2/286: dwrite fa [0,4194304] 0 2024-04-03T08:39:14.099 INFO:tasks.workunit.client.1.smithi181.stdout:7/212: symlink d0/d1/d6/de/d17/d27/l4b 0 2024-04-03T08:39:14.102 INFO:tasks.workunit.client.1.smithi181.stdout:5/256: link d4/l1d d4/d18/l4f 0 2024-04-03T08:39:14.104 INFO:tasks.workunit.client.1.smithi181.stdout:9/332: dwrite d1/da/d1a/f27 [0,4194304] 0 2024-04-03T08:39:14.105 INFO:tasks.workunit.client.1.smithi181.stdout:7/213: stat d0/d1/d6/c30 0 2024-04-03T08:39:14.108 INFO:tasks.workunit.client.1.smithi181.stdout:4/312: dwrite d1/d16/f13 [0,4194304] 0 2024-04-03T08:39:14.108 INFO:tasks.workunit.client.1.smithi181.stdout:5/257: write d4/d18/d2c/f40 [1368075,40066] 0 2024-04-03T08:39:14.116 INFO:tasks.workunit.client.1.smithi181.stdout:2/287: dread - d13/d22/d40/f56 zero size 2024-04-03T08:39:14.117 INFO:tasks.workunit.client.1.smithi181.stdout:7/214: creat d0/d1/d6/de/d17/f4c x:0 0 0 2024-04-03T08:39:14.128 INFO:tasks.workunit.client.1.smithi181.stdout:8/217: read d4/d45/db/f33 [229594,91959] 0 2024-04-03T08:39:14.130 INFO:tasks.workunit.client.1.smithi181.stdout:3/256: dwrite d0/d17/d36/f45 [0,4194304] 0 2024-04-03T08:39:14.130 INFO:tasks.workunit.client.1.smithi181.stdout:9/333: creat d1/da/d28/d30/d3e/d4e/f68 x:0 0 0 2024-04-03T08:39:14.132 INFO:tasks.workunit.client.1.smithi181.stdout:2/288: creat d13/d1c/d4a/d68/f6f x:0 0 0 2024-04-03T08:39:14.136 INFO:tasks.workunit.client.1.smithi181.stdout:5/258: creat d4/d22/d4a/f50 x:0 0 0 2024-04-03T08:39:14.138 INFO:tasks.workunit.client.0.smithi157.stdout:0/437: dread d2/d9/dc/df/d1b/d35/d3d/f58 [0,4194304] 0 2024-04-03T08:39:14.142 INFO:tasks.workunit.client.1.smithi181.stdout:8/218: write d4/d2a/d37/f3d [98762,51408] 0 2024-04-03T08:39:14.143 INFO:tasks.workunit.client.1.smithi181.stdout:9/334: mknod d1/da/d1a/c69 0 2024-04-03T08:39:14.146 INFO:tasks.workunit.client.1.smithi181.stdout:5/259: symlink d4/d18/d3e/l51 0 2024-04-03T08:39:14.147 INFO:tasks.workunit.client.1.smithi181.stdout:8/219: dread - d4/d45/db/d14/d31/f43 zero size 2024-04-03T08:39:14.149 INFO:tasks.workunit.client.1.smithi181.stdout:4/313: dwrite d1/d16/f54 [0,4194304] 0 2024-04-03T08:39:14.151 INFO:tasks.workunit.client.1.smithi181.stdout:2/289: creat d13/d22/d27/d2f/f70 x:0 0 0 2024-04-03T08:39:14.151 INFO:tasks.workunit.client.1.smithi181.stdout:5/260: chown d4/d18/d2c/f34 14 1 2024-04-03T08:39:14.155 INFO:tasks.workunit.client.1.smithi181.stdout:9/335: truncate d1/da/d28/d30/d3e/d4e/f68 4946 0 2024-04-03T08:39:14.156 INFO:tasks.workunit.client.1.smithi181.stdout:9/336: chown d1/da/d13 3 1 2024-04-03T08:39:14.156 INFO:tasks.workunit.client.1.smithi181.stdout:2/290: dread - d13/d22/d40/f56 zero size 2024-04-03T08:39:14.158 INFO:tasks.workunit.client.0.smithi157.stdout:0/438: link d2/d9/d51/c7d d2/d9/dc/df/ca3 0 2024-04-03T08:39:14.163 INFO:tasks.workunit.client.0.smithi157.stdout:2/450: dread d3/d12/fd [0,4194304] 0 2024-04-03T08:39:14.164 INFO:tasks.workunit.client.1.smithi181.stdout:3/257: dwrite d0/d5/d6/d32/d43/f48 [0,4194304] 0 2024-04-03T08:39:14.170 INFO:tasks.workunit.client.1.smithi181.stdout:3/258: chown d0/d5/d6/d32/d43/c47 17848376 1 2024-04-03T08:39:14.181 INFO:tasks.workunit.client.1.smithi181.stdout:2/291: dread d13/f23 [0,4194304] 0 2024-04-03T08:39:14.182 INFO:tasks.workunit.client.1.smithi181.stdout:2/292: read - d13/f41 zero size 2024-04-03T08:39:14.183 INFO:tasks.workunit.client.1.smithi181.stdout:4/314: dwrite d1/d1e/f2e [0,4194304] 0 2024-04-03T08:39:14.183 INFO:tasks.workunit.client.1.smithi181.stdout:2/293: fsync d13/d1c/f38 0 2024-04-03T08:39:14.188 INFO:tasks.workunit.client.1.smithi181.stdout:9/337: dread d1/da/d1a/f56 [0,4194304] 0 2024-04-03T08:39:14.192 INFO:tasks.workunit.client.0.smithi157.stdout:8/448: dread d2/d11/d10/d24/d5b/f4b [0,4194304] 0 2024-04-03T08:39:14.197 INFO:tasks.workunit.client.0.smithi157.stdout:3/422: sync 2024-04-03T08:39:14.204 INFO:tasks.workunit.client.0.smithi157.stdout:3/423: fdatasync d8/f11 0 2024-04-03T08:39:14.207 INFO:tasks.workunit.client.0.smithi157.stdout:3/424: chown d8/d1e/d2d/d3b/f5a 223349 1 2024-04-03T08:39:14.232 INFO:tasks.workunit.client.0.smithi157.stdout:2/451: symlink d3/db/d44/d4c/d5a/l9e 0 2024-04-03T08:39:14.267 INFO:tasks.workunit.client.0.smithi157.stdout:0/439: mknod d2/d9/ca4 0 2024-04-03T08:39:14.272 INFO:tasks.workunit.client.0.smithi157.stdout:7/493: write d0/d4/f10 [741411,42458] 0 2024-04-03T08:39:14.285 INFO:tasks.workunit.client.1.smithi181.stdout:3/259: symlink d0/d17/d36/d3b/l4a 0 2024-04-03T08:39:14.287 INFO:tasks.workunit.client.0.smithi157.stdout:0/440: creat d2/d9/dc/df/d1b/d35/d3d/fa5 x:0 0 0 2024-04-03T08:39:14.292 INFO:tasks.workunit.client.1.smithi181.stdout:9/338: link d1/da/d13/d41/f1b d1/da/d28/d30/f6a 0 2024-04-03T08:39:14.293 INFO:tasks.workunit.client.0.smithi157.stdout:1/398: dwrite d2/d11/d23/f79 [0,4194304] 0 2024-04-03T08:39:14.293 INFO:tasks.workunit.client.0.smithi157.stdout:8/449: dwrite d2/d20/f60 [0,4194304] 0 2024-04-03T08:39:14.294 INFO:tasks.workunit.client.1.smithi181.stdout:9/339: chown d1/f6 104 1 2024-04-03T08:39:14.307 INFO:tasks.workunit.client.1.smithi181.stdout:9/340: dread d1/f6 [4194304,4194304] 0 2024-04-03T08:39:14.310 INFO:tasks.workunit.client.1.smithi181.stdout:6/260: sync 2024-04-03T08:39:14.313 INFO:tasks.workunit.client.1.smithi181.stdout:3/260: symlink d0/d17/d40/l4b 0 2024-04-03T08:39:14.314 INFO:tasks.workunit.client.0.smithi157.stdout:1/399: dwrite d2/d11/d24/d39/d3b/f56 [0,4194304] 0 2024-04-03T08:39:14.317 INFO:tasks.workunit.client.0.smithi157.stdout:0/441: creat d2/d9/d5f/fa6 x:0 0 0 2024-04-03T08:39:14.323 INFO:tasks.workunit.client.0.smithi157.stdout:8/450: creat d2/d11/d10/d24/d5b/d2e/d75/d81/f96 x:0 0 0 2024-04-03T08:39:14.325 INFO:tasks.workunit.client.1.smithi181.stdout:0/247: truncate d5/dc/d14/d29/f47 10185 0 2024-04-03T08:39:14.338 INFO:tasks.workunit.client.1.smithi181.stdout:3/261: dwrite d0/d17/d36/d1e/f28 [0,4194304] 0 2024-04-03T08:39:14.347 INFO:tasks.workunit.client.0.smithi157.stdout:8/451: rename d2/d11/d10/f1f to d2/d6f/d70/f97 0 2024-04-03T08:39:14.350 INFO:tasks.workunit.client.1.smithi181.stdout:1/239: write d10/f16 [48008,85568] 0 2024-04-03T08:39:14.359 INFO:tasks.workunit.client.0.smithi157.stdout:7/494: getdents d0/d11/d15/d1b/db8 0 2024-04-03T08:39:14.362 INFO:tasks.workunit.client.1.smithi181.stdout:3/262: chown d0/d17/d36/d1e/f49 508688144 1 2024-04-03T08:39:14.369 INFO:tasks.workunit.client.0.smithi157.stdout:7/495: unlink d0/d11/f70 0 2024-04-03T08:39:14.370 INFO:tasks.workunit.client.1.smithi181.stdout:1/240: dwrite d10/d15/d17/f2a [0,4194304] 0 2024-04-03T08:39:14.375 INFO:tasks.workunit.client.0.smithi157.stdout:9/400: sync 2024-04-03T08:39:14.383 INFO:tasks.workunit.client.0.smithi157.stdout:9/401: mkdir d1/d4a/d4d/d86 0 2024-04-03T08:39:14.384 INFO:tasks.workunit.client.1.smithi181.stdout:1/241: write d10/d15/f34 [1795716,78079] 0 2024-04-03T08:39:14.391 INFO:tasks.workunit.client.0.smithi157.stdout:7/496: creat d0/d11/d6f/d76/da7/fb9 x:0 0 0 2024-04-03T08:39:14.395 INFO:tasks.workunit.client.0.smithi157.stdout:7/497: write d0/d11/d15/f87 [27786,128390] 0 2024-04-03T08:39:14.396 INFO:tasks.workunit.client.1.smithi181.stdout:7/215: dwrite d0/f2f [0,4194304] 0 2024-04-03T08:39:14.398 INFO:tasks.workunit.client.1.smithi181.stdout:8/220: sync 2024-04-03T08:39:14.405 INFO:tasks.workunit.client.1.smithi181.stdout:8/221: write d4/d45/db/d14/f2d [5035294,30731] 0 2024-04-03T08:39:14.416 INFO:tasks.workunit.client.0.smithi157.stdout:7/498: dwrite d0/d11/f71 [0,4194304] 0 2024-04-03T08:39:14.419 INFO:tasks.workunit.client.1.smithi181.stdout:8/222: dwrite d4/d45/db/d14/f20 [0,4194304] 0 2024-04-03T08:39:14.429 INFO:tasks.workunit.client.0.smithi157.stdout:7/499: truncate d0/d11/d15/d17/d43/d8a/d8f/f3d 1481838 0 2024-04-03T08:39:14.433 INFO:tasks.workunit.client.0.smithi157.stdout:0/442: creat d2/d9/d36/d38/fa7 x:0 0 0 2024-04-03T08:39:14.456 INFO:tasks.workunit.client.0.smithi157.stdout:9/402: creat d1/d36/f87 x:0 0 0 2024-04-03T08:39:14.460 INFO:tasks.workunit.client.0.smithi157.stdout:9/403: dread d1/d4a/d4d/f80 [0,4194304] 0 2024-04-03T08:39:14.464 INFO:tasks.workunit.client.1.smithi181.stdout:2/294: sync 2024-04-03T08:39:14.464 INFO:tasks.workunit.client.1.smithi181.stdout:5/261: sync 2024-04-03T08:39:14.473 INFO:tasks.workunit.client.1.smithi181.stdout:4/315: truncate d1/fb 1790904 0 2024-04-03T08:39:14.475 INFO:tasks.workunit.client.1.smithi181.stdout:2/295: link d13/d22/d27/d2f/c66 d13/d1c/d6c/c71 0 2024-04-03T08:39:14.478 INFO:tasks.workunit.client.0.smithi157.stdout:3/425: dwrite d8/d13/d1b/d4e/d50/f59 [0,4194304] 0 2024-04-03T08:39:14.481 INFO:tasks.workunit.client.1.smithi181.stdout:2/296: mkdir d13/d1c/d4a/d68/d72 0 2024-04-03T08:39:14.482 INFO:tasks.workunit.client.1.smithi181.stdout:5/262: dwrite d4/d18/d2c/f2e [0,4194304] 0 2024-04-03T08:39:14.483 INFO:tasks.workunit.client.0.smithi157.stdout:9/404: dwrite d1/d36/d69/f6e [0,4194304] 0 2024-04-03T08:39:14.485 INFO:tasks.workunit.client.1.smithi181.stdout:2/297: mkdir d13/d1c/d73 0 2024-04-03T08:39:14.497 INFO:tasks.workunit.client.0.smithi157.stdout:9/405: creat d1/d36/d66/d75/f88 x:0 0 0 2024-04-03T08:39:14.504 INFO:tasks.workunit.client.1.smithi181.stdout:2/298: getdents d13/d22/d27/d46 0 2024-04-03T08:39:14.507 INFO:tasks.workunit.client.0.smithi157.stdout:9/406: mknod d1/c89 0 2024-04-03T08:39:14.511 INFO:tasks.workunit.client.1.smithi181.stdout:6/261: write d6/d7/d9/fa [1839958,51531] 0 2024-04-03T08:39:14.512 INFO:tasks.workunit.client.1.smithi181.stdout:6/262: readlink d6/d7/lc 0 2024-04-03T08:39:14.514 INFO:tasks.workunit.client.1.smithi181.stdout:6/263: chown d6/d3e/f46 507513 1 2024-04-03T08:39:14.516 INFO:tasks.workunit.client.0.smithi157.stdout:9/407: creat d1/d15/d27/f8a x:0 0 0 2024-04-03T08:39:14.521 INFO:tasks.workunit.client.0.smithi157.stdout:1/400: dwrite d2/d11/d24/d67/f70 [0,4194304] 0 2024-04-03T08:39:14.528 INFO:tasks.workunit.client.0.smithi157.stdout:9/408: rmdir d1/d4a 39 2024-04-03T08:39:14.531 INFO:tasks.workunit.client.0.smithi157.stdout:9/409: write d1/f17 [909866,22343] 0 2024-04-03T08:39:14.537 INFO:tasks.workunit.client.0.smithi157.stdout:8/452: dwrite d2/d11/d10/f48 [0,4194304] 0 2024-04-03T08:39:14.538 INFO:tasks.workunit.client.1.smithi181.stdout:3/263: dwrite d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:14.542 INFO:tasks.workunit.client.0.smithi157.stdout:2/452: rmdir d3/d12/d43 39 2024-04-03T08:39:14.543 INFO:tasks.workunit.client.1.smithi181.stdout:1/242: dwrite d10/d15/d17/d23/d27/f2c [4194304,4194304] 0 2024-04-03T08:39:14.550 INFO:tasks.workunit.client.1.smithi181.stdout:7/216: dwrite d0/d1/d6/de/d17/d27/f49 [0,4194304] 0 2024-04-03T08:39:14.556 INFO:tasks.workunit.client.1.smithi181.stdout:4/316: sync 2024-04-03T08:39:14.558 INFO:tasks.workunit.client.1.smithi181.stdout:4/317: chown d1/d1e/d2c/f60 0 1 2024-04-03T08:39:14.559 INFO:tasks.workunit.client.0.smithi157.stdout:3/426: mknod d8/d1e/d2d/d39/d51/c91 0 2024-04-03T08:39:14.560 INFO:tasks.workunit.client.0.smithi157.stdout:1/401: dwrite d2/d11/d24/d39/d3b/d2e/d48/d58/f51 [0,4194304] 0 2024-04-03T08:39:14.562 INFO:tasks.workunit.client.0.smithi157.stdout:1/402: dread - d2/d11/d24/d39/f7c zero size 2024-04-03T08:39:14.568 INFO:tasks.workunit.client.1.smithi181.stdout:8/223: creat d4/f46 x:0 0 0 2024-04-03T08:39:14.568 INFO:tasks.workunit.client.0.smithi157.stdout:1/403: chown d2/d11/d24/d39/d3b/l17 122428907 1 2024-04-03T08:39:14.574 INFO:tasks.workunit.client.1.smithi181.stdout:4/318: truncate d1/d16/d24/f47 450749 0 2024-04-03T08:39:14.575 INFO:tasks.workunit.client.0.smithi157.stdout:2/453: mkdir d3/d2e/d32/d9f 0 2024-04-03T08:39:14.581 INFO:tasks.workunit.client.0.smithi157.stdout:1/404: creat d2/d11/d23/f81 x:0 0 0 2024-04-03T08:39:14.600 INFO:tasks.workunit.client.0.smithi157.stdout:2/454: dwrite d3/db/d44/d4c/d5a/d88/f96 [0,4194304] 0 2024-04-03T08:39:14.602 INFO:tasks.workunit.client.1.smithi181.stdout:9/341: rename d1/da/d28/d30/f61 to d1/da/d28/f6b 0 2024-04-03T08:39:14.609 INFO:tasks.workunit.client.0.smithi157.stdout:3/427: getdents d8/d1e/d2d/d3f 0 2024-04-03T08:39:14.613 INFO:tasks.workunit.client.1.smithi181.stdout:7/217: creat d0/d1/d6/f4d x:0 0 0 2024-04-03T08:39:14.613 INFO:tasks.workunit.client.0.smithi157.stdout:2/455: creat d3/db/d44/d4c/d5a/fa0 x:0 0 0 2024-04-03T08:39:14.616 INFO:tasks.workunit.client.0.smithi157.stdout:3/428: mknod d8/d13/d1b/d5b/c92 0 2024-04-03T08:39:14.619 INFO:tasks.workunit.client.0.smithi157.stdout:3/429: fdatasync d8/d1e/d2d/d39/d51/d48/f63 0 2024-04-03T08:39:14.623 INFO:tasks.workunit.client.1.smithi181.stdout:9/342: dwrite d1/da/d28/d30/d3e/d4e/f68 [0,4194304] 0 2024-04-03T08:39:14.627 INFO:tasks.workunit.client.1.smithi181.stdout:6/264: mkdir d6/d53 0 2024-04-03T08:39:14.629 INFO:tasks.workunit.client.1.smithi181.stdout:6/265: read - d6/d7/f49 zero size 2024-04-03T08:39:14.631 INFO:tasks.workunit.client.1.smithi181.stdout:8/224: link d4/d45/d9/l1a d4/d45/db/l47 0 2024-04-03T08:39:14.631 INFO:tasks.workunit.client.1.smithi181.stdout:9/343: write d1/da/d13/d41/d32/f67 [951749,108574] 0 2024-04-03T08:39:14.632 INFO:tasks.workunit.client.0.smithi157.stdout:2/456: dread d3/d12/f24 [0,4194304] 0 2024-04-03T08:39:14.633 INFO:tasks.workunit.client.1.smithi181.stdout:7/218: creat d0/d1/d6/de/d17/d27/f4e x:0 0 0 2024-04-03T08:39:14.633 INFO:tasks.workunit.client.0.smithi157.stdout:3/430: truncate d8/d13/f56 619734 0 2024-04-03T08:39:14.634 INFO:tasks.workunit.client.0.smithi157.stdout:2/457: chown d3/d2e/f90 1 1 2024-04-03T08:39:14.635 INFO:tasks.workunit.client.1.smithi181.stdout:5/263: write d4/ff [4995621,118824] 0 2024-04-03T08:39:14.637 INFO:tasks.workunit.client.1.smithi181.stdout:7/219: write d0/d1/d6/de/d17/f24 [446694,91581] 0 2024-04-03T08:39:14.638 INFO:tasks.workunit.client.1.smithi181.stdout:1/243: mkdir d10/d15/d4b 0 2024-04-03T08:39:14.640 INFO:tasks.workunit.client.1.smithi181.stdout:7/220: stat d0/d1/d6/de/d17/c3f 0 2024-04-03T08:39:14.641 INFO:tasks.workunit.client.1.smithi181.stdout:8/225: unlink d4/d45/f39 0 2024-04-03T08:39:14.645 INFO:tasks.workunit.client.1.smithi181.stdout:9/344: unlink d1/da/d13/d22/f45 0 2024-04-03T08:39:14.646 INFO:tasks.workunit.client.1.smithi181.stdout:2/299: symlink d13/d22/l74 0 2024-04-03T08:39:14.648 INFO:tasks.workunit.client.1.smithi181.stdout:0/248: rename d5/d9/d2c/f2d to d5/d52/f53 0 2024-04-03T08:39:14.649 INFO:tasks.workunit.client.1.smithi181.stdout:0/249: chown d5/d9/d2c 919938058 1 2024-04-03T08:39:14.650 INFO:tasks.workunit.client.1.smithi181.stdout:3/264: creat d0/d5/d6/f4c x:0 0 0 2024-04-03T08:39:14.651 INFO:tasks.workunit.client.1.smithi181.stdout:3/265: fdatasync d0/d17/d36/f45 0 2024-04-03T08:39:14.653 INFO:tasks.workunit.client.1.smithi181.stdout:5/264: creat d4/d18/d25/f52 x:0 0 0 2024-04-03T08:39:14.654 INFO:tasks.workunit.client.1.smithi181.stdout:6/266: creat d6/d7/d50/f54 x:0 0 0 2024-04-03T08:39:14.660 INFO:tasks.workunit.client.0.smithi157.stdout:8/453: write d2/d20/d23/f6c [1303247,95498] 0 2024-04-03T08:39:14.662 INFO:tasks.workunit.client.1.smithi181.stdout:8/226: dread d4/fc [0,4194304] 0 2024-04-03T08:39:14.663 INFO:tasks.workunit.client.0.smithi157.stdout:8/454: write d2/d11/d10/d24/d5b/d2e/f80 [1046594,42248] 0 2024-04-03T08:39:14.665 INFO:tasks.workunit.client.1.smithi181.stdout:8/227: chown d4/d45/db/d14/d31/f3c 21071078 1 2024-04-03T08:39:14.668 INFO:tasks.workunit.client.1.smithi181.stdout:2/300: rename d13/f25 to d13/d22/d40/f75 0 2024-04-03T08:39:14.670 INFO:tasks.workunit.client.1.smithi181.stdout:2/301: dread - d13/d1c/d4a/f57 zero size 2024-04-03T08:39:14.671 INFO:tasks.workunit.client.1.smithi181.stdout:2/302: truncate d13/f59 885297 0 2024-04-03T08:39:14.673 INFO:tasks.workunit.client.1.smithi181.stdout:2/303: write d13/d1c/d4a/d68/f6f [951198,48768] 0 2024-04-03T08:39:14.674 INFO:tasks.workunit.client.1.smithi181.stdout:5/265: readlink d4/d18/l4d 0 2024-04-03T08:39:14.675 INFO:tasks.workunit.client.1.smithi181.stdout:5/266: chown d4/d22/d4a 389253057 1 2024-04-03T08:39:14.675 INFO:tasks.workunit.client.1.smithi181.stdout:2/304: write d13/f41 [139469,67572] 0 2024-04-03T08:39:14.678 INFO:tasks.workunit.client.1.smithi181.stdout:5/267: read d4/d18/f23 [4132273,55354] 0 2024-04-03T08:39:14.680 INFO:tasks.workunit.client.1.smithi181.stdout:5/268: truncate d4/d18/d25/f3c 264592 0 2024-04-03T08:39:14.680 INFO:tasks.workunit.client.1.smithi181.stdout:6/267: unlink d6/d31/d36/f3d 0 2024-04-03T08:39:14.682 INFO:tasks.workunit.client.1.smithi181.stdout:1/244: getdents d10/d15/d17/d37 0 2024-04-03T08:39:14.683 INFO:tasks.workunit.client.1.smithi181.stdout:1/245: chown d10/d15/l35 1 1 2024-04-03T08:39:14.683 INFO:tasks.workunit.client.0.smithi157.stdout:1/405: dwrite f0 [4194304,4194304] 0 2024-04-03T08:39:14.692 INFO:tasks.workunit.client.1.smithi181.stdout:8/228: creat d4/d2a/f48 x:0 0 0 2024-04-03T08:39:14.695 INFO:tasks.workunit.client.1.smithi181.stdout:8/229: dread - d4/d45/d9/f38 zero size 2024-04-03T08:39:14.696 INFO:tasks.workunit.client.1.smithi181.stdout:2/305: dwrite d13/d1c/d4a/d68/f3d [0,4194304] 0 2024-04-03T08:39:14.703 INFO:tasks.workunit.client.1.smithi181.stdout:6/268: dwrite d6/d7/d50/f54 [0,4194304] 0 2024-04-03T08:39:14.713 INFO:tasks.workunit.client.0.smithi157.stdout:2/458: dwrite d3/d12/d43/f78 [0,4194304] 0 2024-04-03T08:39:14.715 INFO:tasks.workunit.client.1.smithi181.stdout:6/269: dread d6/d31/d36/f34 [0,4194304] 0 2024-04-03T08:39:14.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/270: truncate d6/f3a 1244113 0 2024-04-03T08:39:14.720 INFO:tasks.workunit.client.1.smithi181.stdout:5/269: mkdir d4/d22/d53 0 2024-04-03T08:39:14.720 INFO:tasks.workunit.client.0.smithi157.stdout:3/431: link c2 d8/d1e/d2d/c93 0 2024-04-03T08:39:14.721 INFO:tasks.workunit.client.1.smithi181.stdout:6/271: write d6/d3e/f46 [1960226,67830] 0 2024-04-03T08:39:14.723 INFO:tasks.workunit.client.0.smithi157.stdout:2/459: dread d3/d12/d43/d4b/f73 [0,4194304] 0 2024-04-03T08:39:14.724 INFO:tasks.workunit.client.1.smithi181.stdout:7/221: getdents d0 0 2024-04-03T08:39:14.724 INFO:tasks.workunit.client.0.smithi157.stdout:3/432: write d8/d1e/d2d/d39/d51/d48/f63 [289673,27863] 0 2024-04-03T08:39:14.725 INFO:tasks.workunit.client.0.smithi157.stdout:7/500: sync 2024-04-03T08:39:14.725 INFO:tasks.workunit.client.0.smithi157.stdout:6/485: sync 2024-04-03T08:39:14.725 INFO:tasks.workunit.client.0.smithi157.stdout:5/476: sync 2024-04-03T08:39:14.725 INFO:tasks.workunit.client.0.smithi157.stdout:4/409: sync 2024-04-03T08:39:14.730 INFO:tasks.workunit.client.1.smithi181.stdout:4/319: write d1/d16/d24/f47 [725220,6540] 0 2024-04-03T08:39:14.731 INFO:tasks.workunit.client.0.smithi157.stdout:5/477: fsync dc/d29/d56/d49/d7f/f82 0 2024-04-03T08:39:14.732 INFO:tasks.workunit.client.0.smithi157.stdout:4/410: write da/df/d24/d35/d3c/f71 [180045,10169] 0 2024-04-03T08:39:14.739 INFO:tasks.workunit.client.0.smithi157.stdout:1/406: unlink d2/d11/d24/d39/d3b/d2e/l4c 0 2024-04-03T08:39:14.741 INFO:tasks.workunit.client.1.smithi181.stdout:0/250: rename d5/d9/c1c to d5/dc/d10/c54 0 2024-04-03T08:39:14.748 INFO:tasks.workunit.client.1.smithi181.stdout:2/306: rename d13/d1c/d4a/d68/f34 to d13/d1c/d4a/d68/f76 0 2024-04-03T08:39:14.749 INFO:tasks.workunit.client.0.smithi157.stdout:0/443: link d2/d9/d36/l72 d2/d9/dc/df/d1b/la8 0 2024-04-03T08:39:14.749 INFO:tasks.workunit.client.0.smithi157.stdout:7/501: dwrite d0/f93 [0,4194304] 0 2024-04-03T08:39:14.750 INFO:tasks.workunit.client.1.smithi181.stdout:2/307: dread - d13/d22/d40/f75 zero size 2024-04-03T08:39:14.750 INFO:tasks.workunit.client.1.smithi181.stdout:4/320: dwrite d1/d16/d24/d5e/f3c [0,4194304] 0 2024-04-03T08:39:14.752 INFO:tasks.workunit.client.1.smithi181.stdout:2/308: chown d13/d1c/d4a 87929276 1 2024-04-03T08:39:14.756 INFO:tasks.workunit.client.1.smithi181.stdout:3/266: truncate d0/d5/f38 1613848 0 2024-04-03T08:39:14.757 INFO:tasks.workunit.client.0.smithi157.stdout:3/433: mknod d8/d1e/d2d/d3b/c94 0 2024-04-03T08:39:14.757 INFO:tasks.workunit.client.0.smithi157.stdout:6/486: chown d1/d5/d17/d2a/d30/c3f 9934 1 2024-04-03T08:39:14.757 INFO:tasks.workunit.client.1.smithi181.stdout:1/246: dread d10/f22 [0,4194304] 0 2024-04-03T08:39:14.761 INFO:tasks.workunit.client.0.smithi157.stdout:8/455: mknod d2/d11/d10/d24/d5b/c98 0 2024-04-03T08:39:14.763 INFO:tasks.workunit.client.1.smithi181.stdout:6/272: creat d6/d7/d9/d22/d4f/f55 x:0 0 0 2024-04-03T08:39:14.772 INFO:tasks.workunit.client.1.smithi181.stdout:6/273: write d6/d7/d50/f54 [4760566,120119] 0 2024-04-03T08:39:14.773 INFO:tasks.workunit.client.1.smithi181.stdout:8/230: link d4/d2a/f48 d4/d45/db/d14/f49 0 2024-04-03T08:39:14.779 INFO:tasks.workunit.client.0.smithi157.stdout:0/444: chown d2/d9/dc/df/d1b/c74 13 1 2024-04-03T08:39:14.781 INFO:tasks.workunit.client.0.smithi157.stdout:7/502: dread d0/d75/f86 [0,4194304] 0 2024-04-03T08:39:14.783 INFO:tasks.workunit.client.1.smithi181.stdout:2/309: symlink d13/d22/d27/d2f/d5d/l77 0 2024-04-03T08:39:14.783 INFO:tasks.workunit.client.0.smithi157.stdout:9/410: sync 2024-04-03T08:39:14.787 INFO:tasks.workunit.client.1.smithi181.stdout:0/251: dwrite d5/dc/d14/d29/f4d [0,4194304] 0 2024-04-03T08:39:14.790 INFO:tasks.workunit.client.1.smithi181.stdout:5/270: mknod d4/d22/d53/c54 0 2024-04-03T08:39:14.794 INFO:tasks.workunit.client.1.smithi181.stdout:4/321: dread d1/fb [0,4194304] 0 2024-04-03T08:39:14.794 INFO:tasks.workunit.client.1.smithi181.stdout:5/271: truncate d4/ff 6069567 0 2024-04-03T08:39:14.795 INFO:tasks.workunit.client.1.smithi181.stdout:7/222: mknod d0/d1/d6/c4f 0 2024-04-03T08:39:14.797 INFO:tasks.workunit.client.1.smithi181.stdout:4/322: readlink d1/d16/d24/d5e/d3f/d41/l44 0 2024-04-03T08:39:14.798 INFO:tasks.workunit.client.0.smithi157.stdout:1/407: symlink d2/d11/d24/d39/l82 0 2024-04-03T08:39:14.801 INFO:tasks.workunit.client.0.smithi157.stdout:2/460: creat d3/db/fa1 x:0 0 0 2024-04-03T08:39:14.802 INFO:tasks.workunit.client.1.smithi181.stdout:2/310: dwrite d13/d22/d40/f48 [0,4194304] 0 2024-04-03T08:39:14.802 INFO:tasks.workunit.client.1.smithi181.stdout:9/345: creat d1/da/d13/d22/f6c x:0 0 0 2024-04-03T08:39:14.804 INFO:tasks.workunit.client.0.smithi157.stdout:2/461: truncate d3/db/fa1 125841 0 2024-04-03T08:39:14.810 INFO:tasks.workunit.client.0.smithi157.stdout:0/445: unlink d2/d9/ca4 0 2024-04-03T08:39:14.813 INFO:tasks.workunit.client.1.smithi181.stdout:6/274: rename d6/c2f to d6/d7/d9/c56 0 2024-04-03T08:39:14.814 INFO:tasks.workunit.client.0.smithi157.stdout:6/487: mkdir d1/d5/d17/d29/da3/da8 0 2024-04-03T08:39:14.820 INFO:tasks.workunit.client.1.smithi181.stdout:0/252: unlink d5/dc/d14/l44 0 2024-04-03T08:39:14.820 INFO:tasks.workunit.client.0.smithi157.stdout:4/411: link f4 da/df/d6b/f88 0 2024-04-03T08:39:14.826 INFO:tasks.workunit.client.0.smithi157.stdout:4/412: truncate da/df/d24/d35/d53/f84 431265 0 2024-04-03T08:39:14.827 INFO:tasks.workunit.client.1.smithi181.stdout:7/223: creat d0/f50 x:0 0 0 2024-04-03T08:39:14.835 INFO:tasks.workunit.client.0.smithi157.stdout:0/446: creat d2/d9/dc/df/d6f/fa9 x:0 0 0 2024-04-03T08:39:14.835 INFO:tasks.workunit.client.0.smithi157.stdout:2/462: write d3/d2e/f83 [825346,83270] 0 2024-04-03T08:39:14.838 INFO:tasks.workunit.client.0.smithi157.stdout:8/456: creat d2/f99 x:0 0 0 2024-04-03T08:39:14.839 INFO:tasks.workunit.client.0.smithi157.stdout:9/411: dread - d1/d15/d27/d34/f53 zero size 2024-04-03T08:39:14.841 INFO:tasks.workunit.client.1.smithi181.stdout:8/231: symlink d4/d45/l4a 0 2024-04-03T08:39:14.841 INFO:tasks.workunit.client.1.smithi181.stdout:3/267: sync 2024-04-03T08:39:14.841 INFO:tasks.workunit.client.1.smithi181.stdout:6/275: dread d6/d7/d9/f15 [0,4194304] 0 2024-04-03T08:39:14.842 INFO:tasks.workunit.client.1.smithi181.stdout:0/253: truncate d5/dc/f1e 499923 0 2024-04-03T08:39:14.844 INFO:tasks.workunit.client.1.smithi181.stdout:3/268: stat d0/d17/d36/d1e/f49 0 2024-04-03T08:39:14.845 INFO:tasks.workunit.client.0.smithi157.stdout:5/478: getdents dc/d29/d56/d18 0 2024-04-03T08:39:14.845 INFO:tasks.workunit.client.1.smithi181.stdout:8/232: chown d4/d45/db/d14/d31/f43 107777685 1 2024-04-03T08:39:14.845 INFO:tasks.workunit.client.1.smithi181.stdout:0/254: chown d5/dc/d10/f36 185053 1 2024-04-03T08:39:14.847 INFO:tasks.workunit.client.0.smithi157.stdout:4/413: symlink da/df/d24/d35/d6a/d78/l89 0 2024-04-03T08:39:14.848 INFO:tasks.workunit.client.0.smithi157.stdout:1/408: truncate d2/d11/d24/d39/d3b/d2e/f7d 1187596 0 2024-04-03T08:39:14.848 INFO:tasks.workunit.client.0.smithi157.stdout:5/479: chown dc/d29/d56/d49/d53/d6c/f9b 2066 1 2024-04-03T08:39:14.854 INFO:tasks.workunit.client.0.smithi157.stdout:2/463: creat d3/d2e/d65/fa2 x:0 0 0 2024-04-03T08:39:14.854 INFO:tasks.workunit.client.0.smithi157.stdout:3/434: dread d8/d1e/d2d/d39/d51/d4c/d32/f42 [0,4194304] 0 2024-04-03T08:39:14.855 INFO:tasks.workunit.client.1.smithi181.stdout:9/346: mknod d1/da/d13/d41/d65/c6d 0 2024-04-03T08:39:14.857 INFO:tasks.workunit.client.0.smithi157.stdout:6/488: link d1/fc d1/d4b/da5/fa9 0 2024-04-03T08:39:14.858 INFO:tasks.workunit.client.1.smithi181.stdout:1/247: getdents d10/d15 0 2024-04-03T08:39:14.860 INFO:tasks.workunit.client.1.smithi181.stdout:6/276: mknod d6/d7/d9/d22/d4f/c57 0 2024-04-03T08:39:14.861 INFO:tasks.workunit.client.0.smithi157.stdout:0/447: creat d2/d9/dc/df/d1b/d4a/d31/faa x:0 0 0 2024-04-03T08:39:14.862 INFO:tasks.workunit.client.1.smithi181.stdout:1/248: fsync d10/d15/d41/f44 0 2024-04-03T08:39:14.863 INFO:tasks.workunit.client.1.smithi181.stdout:3/269: creat d0/d5/d6/dd/d25/f4d x:0 0 0 2024-04-03T08:39:14.866 INFO:tasks.workunit.client.0.smithi157.stdout:2/464: chown d3/d2e/c2f 1115439660 1 2024-04-03T08:39:14.867 INFO:tasks.workunit.client.1.smithi181.stdout:1/249: chown d10/d15/d17/d37 17131199 1 2024-04-03T08:39:14.867 INFO:tasks.workunit.client.0.smithi157.stdout:0/448: dread d2/f2c [0,4194304] 0 2024-04-03T08:39:14.868 INFO:tasks.workunit.client.0.smithi157.stdout:9/412: mknod d1/d4a/d4d/c8b 0 2024-04-03T08:39:14.869 INFO:tasks.workunit.client.0.smithi157.stdout:3/435: creat d8/d13/d1b/d7d/f95 x:0 0 0 2024-04-03T08:39:14.870 INFO:tasks.workunit.client.0.smithi157.stdout:9/413: dread - d1/d15/d27/f8a zero size 2024-04-03T08:39:14.871 INFO:tasks.workunit.client.1.smithi181.stdout:9/347: symlink d1/da/d1a/l6e 0 2024-04-03T08:39:14.871 INFO:tasks.workunit.client.0.smithi157.stdout:9/414: chown d1/c2f 45084296 1 2024-04-03T08:39:14.872 INFO:tasks.workunit.client.0.smithi157.stdout:6/489: unlink d1/d5/d17/d29/d80/l88 0 2024-04-03T08:39:14.873 INFO:tasks.workunit.client.0.smithi157.stdout:4/414: symlink da/df/d24/d35/l8a 0 2024-04-03T08:39:14.874 INFO:tasks.workunit.client.1.smithi181.stdout:4/323: link d1/f7 d1/d16/d24/d5e/d2b/d56/f64 0 2024-04-03T08:39:14.876 INFO:tasks.workunit.client.0.smithi157.stdout:1/409: mknod d2/d11/d24/d39/d3b/d1b/d7f/c83 0 2024-04-03T08:39:14.876 INFO:tasks.workunit.client.1.smithi181.stdout:8/233: dwrite d4/d45/db/d14/d31/f34 [0,4194304] 0 2024-04-03T08:39:14.876 INFO:tasks.workunit.client.1.smithi181.stdout:3/270: chown d0/d17/d36/d1e/f49 9 1 2024-04-03T08:39:14.878 INFO:tasks.workunit.client.0.smithi157.stdout:2/465: creat d3/d2e/d32/d3c/fa3 x:0 0 0 2024-04-03T08:39:14.879 INFO:tasks.workunit.client.1.smithi181.stdout:0/255: creat d5/dc/d14/f55 x:0 0 0 2024-04-03T08:39:14.882 INFO:tasks.workunit.client.0.smithi157.stdout:3/436: dread d8/d1e/d2d/d39/d51/d48/f5c [4194304,4194304] 0 2024-04-03T08:39:14.883 INFO:tasks.workunit.client.0.smithi157.stdout:8/457: creat d2/d11/d10/d24/d5b/d2e/f9a x:0 0 0 2024-04-03T08:39:14.883 INFO:tasks.workunit.client.1.smithi181.stdout:7/224: write d0/d1/d6/f26 [620515,91458] 0 2024-04-03T08:39:14.885 INFO:tasks.workunit.client.0.smithi157.stdout:0/449: unlink d2/d9/dc/df/d1b/d35/d3d/c42 0 2024-04-03T08:39:14.886 INFO:tasks.workunit.client.1.smithi181.stdout:3/271: chown d0/d5/d6/d29 1529518319 1 2024-04-03T08:39:14.889 INFO:tasks.workunit.client.1.smithi181.stdout:4/324: write d1/d16/d24/f47 [309233,14544] 0 2024-04-03T08:39:14.891 INFO:tasks.workunit.client.0.smithi157.stdout:6/490: dread d1/fc [4194304,4194304] 0 2024-04-03T08:39:14.892 INFO:tasks.workunit.client.1.smithi181.stdout:8/234: fsync d4/d45/db/f13 0 2024-04-03T08:39:14.893 INFO:tasks.workunit.client.0.smithi157.stdout:5/480: creat dc/fa3 x:0 0 0 2024-04-03T08:39:14.894 INFO:tasks.workunit.client.1.smithi181.stdout:2/311: dwrite f11 [0,4194304] 0 2024-04-03T08:39:14.898 INFO:tasks.workunit.client.1.smithi181.stdout:5/272: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:14.903 INFO:tasks.workunit.client.1.smithi181.stdout:4/325: chown d1/f32 15 1 2024-04-03T08:39:14.903 INFO:tasks.workunit.client.1.smithi181.stdout:2/312: chown d13/d22/l74 1511 1 2024-04-03T08:39:14.904 INFO:tasks.workunit.client.0.smithi157.stdout:6/491: dread d1/d5/f46 [0,4194304] 0 2024-04-03T08:39:14.914 INFO:tasks.workunit.client.1.smithi181.stdout:1/250: dwrite d10/d15/d17/d19/f40 [0,4194304] 0 2024-04-03T08:39:14.915 INFO:tasks.workunit.client.1.smithi181.stdout:2/313: write fe [4790207,92196] 0 2024-04-03T08:39:14.917 INFO:tasks.workunit.client.0.smithi157.stdout:9/415: mknod d1/d15/d27/d5c/c8c 0 2024-04-03T08:39:14.917 INFO:tasks.workunit.client.0.smithi157.stdout:0/450: dwrite d2/d9/d5f/fa6 [0,4194304] 0 2024-04-03T08:39:14.922 INFO:tasks.workunit.client.0.smithi157.stdout:5/481: dwrite dc/f13 [4194304,4194304] 0 2024-04-03T08:39:14.923 INFO:tasks.workunit.client.1.smithi181.stdout:9/348: mknod d1/da/d13/d22/d23/d36/c6f 0 2024-04-03T08:39:14.926 INFO:tasks.workunit.client.0.smithi157.stdout:5/482: write dc/d29/d56/f68 [1243042,105508] 0 2024-04-03T08:39:14.936 INFO:tasks.workunit.client.1.smithi181.stdout:9/349: dread d1/da/d1a/f56 [0,4194304] 0 2024-04-03T08:39:14.937 INFO:tasks.workunit.client.1.smithi181.stdout:5/273: dwrite d4/f32 [0,4194304] 0 2024-04-03T08:39:14.939 INFO:tasks.workunit.client.1.smithi181.stdout:0/256: mknod d5/dc/d14/c56 0 2024-04-03T08:39:14.943 INFO:tasks.workunit.client.1.smithi181.stdout:3/272: dwrite d0/d5/d6/dd/d25/f4d [0,4194304] 0 2024-04-03T08:39:14.947 INFO:tasks.workunit.client.1.smithi181.stdout:4/326: creat d1/d16/d24/d5e/d31/f65 x:0 0 0 2024-04-03T08:39:14.950 INFO:tasks.workunit.client.0.smithi157.stdout:6/492: creat d1/d5/d1b/faa x:0 0 0 2024-04-03T08:39:14.955 INFO:tasks.workunit.client.1.smithi181.stdout:0/257: write d5/d9/d2e/f43 [578184,50573] 0 2024-04-03T08:39:14.955 INFO:tasks.workunit.client.1.smithi181.stdout:1/251: unlink d10/d15/f36 0 2024-04-03T08:39:14.957 INFO:tasks.workunit.client.1.smithi181.stdout:1/252: chown fc 323562 1 2024-04-03T08:39:14.959 INFO:tasks.workunit.client.1.smithi181.stdout:6/277: sync 2024-04-03T08:39:14.962 INFO:tasks.workunit.client.0.smithi157.stdout:0/451: symlink d2/d9/d36/lab 0 2024-04-03T08:39:14.963 INFO:tasks.workunit.client.0.smithi157.stdout:4/415: creat da/f8b x:0 0 0 2024-04-03T08:39:14.965 INFO:tasks.workunit.client.1.smithi181.stdout:6/278: fsync d6/d7/d9/f1a 0 2024-04-03T08:39:14.966 INFO:tasks.workunit.client.0.smithi157.stdout:8/458: dwrite d2/d20/d23/f5c [0,4194304] 0 2024-04-03T08:39:14.967 INFO:tasks.workunit.client.0.smithi157.stdout:5/483: mkdir dc/d29/d56/da4 0 2024-04-03T08:39:14.969 INFO:tasks.workunit.client.0.smithi157.stdout:1/410: dwrite d2/f5 [0,4194304] 0 2024-04-03T08:39:14.976 INFO:tasks.workunit.client.1.smithi181.stdout:3/273: dwrite d0/d5/d6/dd/d25/f44 [0,4194304] 0 2024-04-03T08:39:14.978 INFO:tasks.workunit.client.1.smithi181.stdout:1/253: mkdir d10/d15/d17/d19/d4c 0 2024-04-03T08:39:14.978 INFO:tasks.workunit.client.0.smithi157.stdout:1/411: chown d2/d11/d24/d39/d3b/f5c 187 1 2024-04-03T08:39:14.981 INFO:tasks.workunit.client.1.smithi181.stdout:4/327: dwrite d1/d16/d24/d5e/f45 [0,4194304] 0 2024-04-03T08:39:14.982 INFO:tasks.workunit.client.0.smithi157.stdout:8/459: chown d2/d11/d10/d24/d5b/d2e/f64 22 1 2024-04-03T08:39:14.984 INFO:tasks.workunit.client.1.smithi181.stdout:1/254: write d10/d15/d17/d19/f2f [4355392,98962] 0 2024-04-03T08:39:14.984 INFO:tasks.workunit.client.0.smithi157.stdout:5/484: truncate dc/d29/d56/d18/d21/f94 392247 0 2024-04-03T08:39:14.986 INFO:tasks.workunit.client.0.smithi157.stdout:9/416: getdents d1/d36/d46 0 2024-04-03T08:39:14.987 INFO:tasks.workunit.client.1.smithi181.stdout:1/255: fsync d10/d15/d17/d23/d27/f3a 0 2024-04-03T08:39:14.989 INFO:tasks.workunit.client.1.smithi181.stdout:1/256: chown d10/d15/d17/d23/l26 9788 1 2024-04-03T08:39:14.990 INFO:tasks.workunit.client.0.smithi157.stdout:6/493: dwrite d1/d5/d17/d29/f7d [0,4194304] 0 2024-04-03T08:39:14.990 INFO:tasks.workunit.client.0.smithi157.stdout:5/485: readlink l9 0 2024-04-03T08:39:14.991 INFO:tasks.workunit.client.1.smithi181.stdout:1/257: readlink d10/d15/d17/d19/l1c 0 2024-04-03T08:39:14.993 INFO:tasks.workunit.client.1.smithi181.stdout:1/258: rename d10 to d10/d15/d4b/d4d 22 2024-04-03T08:39:14.999 INFO:tasks.workunit.client.0.smithi157.stdout:6/494: chown d1/d5/d17/d2a/d37/f76 37 1 2024-04-03T08:39:15.009 INFO:tasks.workunit.client.0.smithi157.stdout:0/452: dwrite d2/d9/dc/df/d1b/f8b [4194304,4194304] 0 2024-04-03T08:39:15.014 INFO:tasks.workunit.client.1.smithi181.stdout:8/235: write d4/f27 [3790321,101088] 0 2024-04-03T08:39:15.014 INFO:tasks.workunit.client.1.smithi181.stdout:7/225: getdents d0/d1/d6/de/d17 0 2024-04-03T08:39:15.018 INFO:tasks.workunit.client.1.smithi181.stdout:8/236: truncate d4/f36 976552 0 2024-04-03T08:39:15.018 INFO:tasks.workunit.client.1.smithi181.stdout:7/226: read d0/d1/d6/f26 [333185,23877] 0 2024-04-03T08:39:15.024 INFO:tasks.workunit.client.0.smithi157.stdout:1/412: dwrite d2/d11/d24/d39/d3b/d1b/f30 [0,4194304] 0 2024-04-03T08:39:15.027 INFO:tasks.workunit.client.0.smithi157.stdout:0/453: dread d2/d9/f4f [0,4194304] 0 2024-04-03T08:39:15.031 INFO:tasks.workunit.client.0.smithi157.stdout:1/413: fdatasync d2/d11/d24/d39/d3b/d2e/d48/d58/f72 0 2024-04-03T08:39:15.034 INFO:tasks.workunit.client.0.smithi157.stdout:6/495: rename d1/d4b/d38/d59/f83 to d1/d4b/da5/fab 0 2024-04-03T08:39:15.041 INFO:tasks.workunit.client.0.smithi157.stdout:6/496: dread - d1/d4b/d38/d59/f93 zero size 2024-04-03T08:39:15.043 INFO:tasks.workunit.client.1.smithi181.stdout:4/328: mknod d1/d16/d51/c66 0 2024-04-03T08:39:15.048 INFO:tasks.workunit.client.0.smithi157.stdout:4/416: rmdir da/df/d24/d35/d3c/d63 0 2024-04-03T08:39:15.048 INFO:tasks.workunit.client.1.smithi181.stdout:2/314: getdents d13/d1c/d6c 0 2024-04-03T08:39:15.052 INFO:tasks.workunit.client.1.smithi181.stdout:5/274: truncate d4/f3f 1943163 0 2024-04-03T08:39:15.054 INFO:tasks.workunit.client.1.smithi181.stdout:1/259: mknod d10/d15/d41/c4e 0 2024-04-03T08:39:15.054 INFO:tasks.workunit.client.0.smithi157.stdout:8/460: dread d2/d20/f65 [0,4194304] 0 2024-04-03T08:39:15.054 INFO:tasks.workunit.client.0.smithi157.stdout:7/503: sync 2024-04-03T08:39:15.061 INFO:tasks.workunit.client.0.smithi157.stdout:0/454: dwrite d2/d9/dc/df/d6f/fa9 [0,4194304] 0 2024-04-03T08:39:15.061 INFO:tasks.workunit.client.0.smithi157.stdout:5/486: truncate dc/f59 3001225 0 2024-04-03T08:39:15.069 INFO:tasks.workunit.client.0.smithi157.stdout:1/414: mkdir d2/d11/d24/d39/d3b/d1b/d84 0 2024-04-03T08:39:15.070 INFO:tasks.workunit.client.1.smithi181.stdout:9/350: getdents d1/da/d13 0 2024-04-03T08:39:15.071 INFO:tasks.workunit.client.1.smithi181.stdout:9/351: dread - d1/da/d13/d22/f6c zero size 2024-04-03T08:39:15.074 INFO:tasks.workunit.client.0.smithi157.stdout:1/415: dread - d2/d11/d24/d39/f7c zero size 2024-04-03T08:39:15.075 INFO:tasks.workunit.client.1.smithi181.stdout:7/227: chown d0/f3b 4161868 1 2024-04-03T08:39:15.076 INFO:tasks.workunit.client.1.smithi181.stdout:9/352: dread d1/d34/d39/f59 [0,4194304] 0 2024-04-03T08:39:15.078 INFO:tasks.workunit.client.0.smithi157.stdout:7/504: dwrite d0/d11/f21 [4194304,4194304] 0 2024-04-03T08:39:15.080 INFO:tasks.workunit.client.0.smithi157.stdout:9/417: creat d1/d15/f8d x:0 0 0 2024-04-03T08:39:15.088 INFO:tasks.workunit.client.1.smithi181.stdout:3/274: mknod d0/d5/c4e 0 2024-04-03T08:39:15.090 INFO:tasks.workunit.client.1.smithi181.stdout:4/329: write d1/d16/d24/f48 [5209270,46316] 0 2024-04-03T08:39:15.091 INFO:tasks.workunit.client.1.smithi181.stdout:4/330: chown d1/d1e 12441 1 2024-04-03T08:39:15.094 INFO:tasks.workunit.client.1.smithi181.stdout:9/353: dwrite d1/da/d28/d30/f47 [0,4194304] 0 2024-04-03T08:39:15.095 INFO:tasks.workunit.client.1.smithi181.stdout:6/279: truncate d6/d31/f48 1015071 0 2024-04-03T08:39:15.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:14 smithi181 ceph-mon[44183]: Deploying cephadm binary to smithi181 2024-04-03T08:39:15.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:14 smithi181 ceph-mon[44183]: mgrmap e22: smithi181.mfhidq(active, since 1.02542s) 2024-04-03T08:39:15.098 INFO:tasks.workunit.client.0.smithi157.stdout:6/497: dwrite d1/d5/d17/f1d [0,4194304] 0 2024-04-03T08:39:15.104 INFO:tasks.workunit.client.1.smithi181.stdout:0/258: getdents d5/d52 0 2024-04-03T08:39:15.105 INFO:tasks.workunit.client.0.smithi157.stdout:9/418: dwrite d1/d15/d27/d5c/f5f [0,4194304] 0 2024-04-03T08:39:15.106 INFO:tasks.workunit.client.0.smithi157.stdout:5/487: unlink dc/d29/d56/d49/d53/f76 0 2024-04-03T08:39:15.110 INFO:tasks.workunit.client.0.smithi157.stdout:0/455: creat d2/d9/dc/d54/fac x:0 0 0 2024-04-03T08:39:15.113 INFO:tasks.workunit.client.0.smithi157.stdout:0/456: write d2/d9/f57 [3300521,78246] 0 2024-04-03T08:39:15.116 INFO:tasks.workunit.client.0.smithi157.stdout:2/466: sync 2024-04-03T08:39:15.117 INFO:tasks.workunit.client.1.smithi181.stdout:9/354: dread d1/da/d13/d41/d32/f51 [0,4194304] 0 2024-04-03T08:39:15.121 INFO:tasks.workunit.client.1.smithi181.stdout:2/315: mknod d13/d1c/d73/c78 0 2024-04-03T08:39:15.126 INFO:tasks.workunit.client.1.smithi181.stdout:4/331: read d1/f7 [1365634,86942] 0 2024-04-03T08:39:15.127 INFO:tasks.workunit.client.0.smithi157.stdout:4/417: creat da/df/d24/d58/d68/f8c x:0 0 0 2024-04-03T08:39:15.127 INFO:tasks.workunit.client.0.smithi157.stdout:6/498: creat d1/d5/d17/d29/d87/fac x:0 0 0 2024-04-03T08:39:15.128 INFO:tasks.workunit.client.1.smithi181.stdout:5/275: mkdir d4/d18/d55 0 2024-04-03T08:39:15.129 INFO:tasks.workunit.client.1.smithi181.stdout:5/276: stat d4/d44/l49 0 2024-04-03T08:39:15.129 INFO:tasks.workunit.client.1.smithi181.stdout:1/260: dwrite d10/f22 [0,4194304] 0 2024-04-03T08:39:15.130 INFO:tasks.workunit.client.0.smithi157.stdout:9/419: mknod d1/d15/d27/d34/c8e 0 2024-04-03T08:39:15.138 INFO:tasks.workunit.client.1.smithi181.stdout:0/259: rmdir d5/dc/d14/d29/d46 39 2024-04-03T08:39:15.142 INFO:tasks.workunit.client.0.smithi157.stdout:1/416: rename f0 to d2/d11/d24/d39/d3b/d2e/d48/d64/f85 0 2024-04-03T08:39:15.145 INFO:tasks.workunit.client.1.smithi181.stdout:8/237: creat d4/d45/db/f4b x:0 0 0 2024-04-03T08:39:15.153 INFO:tasks.workunit.client.0.smithi157.stdout:7/505: read d0/d11/d6f/d76/da7/f92 [5382695,9037] 0 2024-04-03T08:39:15.155 INFO:tasks.workunit.client.0.smithi157.stdout:4/418: fdatasync da/df/d6b/f88 0 2024-04-03T08:39:15.156 INFO:tasks.workunit.client.0.smithi157.stdout:9/420: creat d1/d15/d16/f8f x:0 0 0 2024-04-03T08:39:15.156 INFO:tasks.workunit.client.0.smithi157.stdout:7/506: dread - d0/d11/d15/d17/f7d zero size 2024-04-03T08:39:15.156 INFO:tasks.workunit.client.0.smithi157.stdout:4/419: dread - da/d7e/f7f zero size 2024-04-03T08:39:15.157 INFO:tasks.workunit.client.1.smithi181.stdout:8/238: dwrite d4/f46 [0,4194304] 0 2024-04-03T08:39:15.158 INFO:tasks.workunit.client.0.smithi157.stdout:9/421: fsync d1/d36/f81 0 2024-04-03T08:39:15.161 INFO:tasks.workunit.client.1.smithi181.stdout:2/316: creat d13/d1c/d4a/d68/f79 x:0 0 0 2024-04-03T08:39:15.165 INFO:tasks.workunit.client.0.smithi157.stdout:5/488: mkdir dc/d29/d56/d52/d9d/da5 0 2024-04-03T08:39:15.166 INFO:tasks.workunit.client.1.smithi181.stdout:4/332: mkdir d1/d1e/d2c/d67 0 2024-04-03T08:39:15.172 INFO:tasks.workunit.client.0.smithi157.stdout:0/457: rename d2/d9/d5f/d8d/d98 to d2/d9/dc/df/d6f/dad 0 2024-04-03T08:39:15.176 INFO:tasks.workunit.client.0.smithi157.stdout:6/499: dwrite d1/d5/f18 [0,4194304] 0 2024-04-03T08:39:15.176 INFO:tasks.workunit.client.0.smithi157.stdout:8/461: link d2/d11/d10/d24/d5b/d2e/c45 d2/d11/d10/d24/d5b/d2e/d75/c9b 0 2024-04-03T08:39:15.180 INFO:tasks.workunit.client.1.smithi181.stdout:2/317: dwrite d13/d1c/f63 [0,4194304] 0 2024-04-03T08:39:15.180 INFO:tasks.workunit.client.1.smithi181.stdout:0/260: chown d5/dc/f12 5399 1 2024-04-03T08:39:15.181 INFO:tasks.workunit.client.0.smithi157.stdout:8/462: write d2/d20/f3c [475966,63668] 0 2024-04-03T08:39:15.183 INFO:tasks.workunit.client.0.smithi157.stdout:4/420: dwrite da/df/d24/d35/d53/f84 [0,4194304] 0 2024-04-03T08:39:15.184 INFO:tasks.workunit.client.1.smithi181.stdout:7/228: creat d0/d1/f51 x:0 0 0 2024-04-03T08:39:15.189 INFO:tasks.workunit.client.0.smithi157.stdout:8/463: write d2/d11/d10/d24/d5b/d2e/f64 [156070,27376] 0 2024-04-03T08:39:15.192 INFO:tasks.workunit.client.1.smithi181.stdout:4/333: dwrite d1/d1e/f52 [0,4194304] 0 2024-04-03T08:39:15.193 INFO:tasks.workunit.client.1.smithi181.stdout:3/275: link d0/d5/c4e d0/d17/d40/c4f 0 2024-04-03T08:39:15.196 INFO:tasks.workunit.client.1.smithi181.stdout:3/276: readlink d0/d17/l1b 0 2024-04-03T08:39:15.196 INFO:tasks.workunit.client.1.smithi181.stdout:1/261: dread d10/f11 [0,4194304] 0 2024-04-03T08:39:15.199 INFO:tasks.workunit.client.0.smithi157.stdout:1/417: mkdir d2/d11/d24/d39/d3b/d2e/d48/d86 0 2024-04-03T08:39:15.202 INFO:tasks.workunit.client.1.smithi181.stdout:1/262: readlink d10/d15/d17/d19/l1c 0 2024-04-03T08:39:15.204 INFO:tasks.workunit.client.0.smithi157.stdout:7/507: dwrite d0/d11/d15/d1b/f39 [0,4194304] 0 2024-04-03T08:39:15.207 INFO:tasks.workunit.client.1.smithi181.stdout:6/280: creat d6/f58 x:0 0 0 2024-04-03T08:39:15.208 INFO:tasks.workunit.client.0.smithi157.stdout:5/489: rename dc/ff to dc/d29/d56/d49/d7f/fa6 0 2024-04-03T08:39:15.208 INFO:tasks.workunit.client.0.smithi157.stdout:5/490: stat dc/d29/d56/d52 0 2024-04-03T08:39:15.210 INFO:tasks.workunit.client.0.smithi157.stdout:0/458: readlink d2/d9/dc/df/d6f/l79 0 2024-04-03T08:39:15.211 INFO:tasks.workunit.client.1.smithi181.stdout:2/318: dread d13/d22/d40/f42 [0,4194304] 0 2024-04-03T08:39:15.215 INFO:tasks.workunit.client.1.smithi181.stdout:3/277: dread d0/d5/d6/f39 [0,4194304] 0 2024-04-03T08:39:15.215 INFO:tasks.workunit.client.0.smithi157.stdout:6/500: creat d1/d5/d17/d29/d62/d7f/fad x:0 0 0 2024-04-03T08:39:15.217 INFO:tasks.workunit.client.1.smithi181.stdout:0/261: fdatasync d5/fb 0 2024-04-03T08:39:15.217 INFO:tasks.workunit.client.1.smithi181.stdout:9/355: link d1/da/d28/l66 d1/da/d28/d30/d3e/d52/l70 0 2024-04-03T08:39:15.221 INFO:tasks.workunit.client.0.smithi157.stdout:4/421: dread da/df/f57 [0,4194304] 0 2024-04-03T08:39:15.222 INFO:tasks.workunit.client.1.smithi181.stdout:5/277: rename d4/d18/d3e/d4b to d4/d56 0 2024-04-03T08:39:15.230 INFO:tasks.workunit.client.1.smithi181.stdout:6/281: mknod d6/d31/c59 0 2024-04-03T08:39:15.231 INFO:tasks.workunit.client.0.smithi157.stdout:5/491: creat dc/d29/fa7 x:0 0 0 2024-04-03T08:39:15.231 INFO:tasks.workunit.client.1.smithi181.stdout:2/319: mkdir d13/d1c/d6c/d7a 0 2024-04-03T08:39:15.234 INFO:tasks.workunit.client.1.smithi181.stdout:2/320: fsync fa 0 2024-04-03T08:39:15.235 INFO:tasks.workunit.client.0.smithi157.stdout:4/422: mknod da/d7e/c8d 0 2024-04-03T08:39:15.235 INFO:tasks.workunit.client.0.smithi157.stdout:5/492: write dc/d29/f4a [1197449,106040] 0 2024-04-03T08:39:15.236 INFO:tasks.workunit.client.1.smithi181.stdout:3/278: truncate d0/d5/fa 2351782 0 2024-04-03T08:39:15.237 INFO:tasks.workunit.client.1.smithi181.stdout:0/262: symlink d5/d52/l57 0 2024-04-03T08:39:15.237 INFO:tasks.workunit.client.1.smithi181.stdout:8/239: write d4/d45/db/f33 [438070,67443] 0 2024-04-03T08:39:15.240 INFO:tasks.workunit.client.0.smithi157.stdout:5/493: read f8 [43248,17143] 0 2024-04-03T08:39:15.240 INFO:tasks.workunit.client.0.smithi157.stdout:1/418: unlink d2/d11/d24/d39/c43 0 2024-04-03T08:39:15.244 INFO:tasks.workunit.client.1.smithi181.stdout:1/263: dwrite d10/d15/d17/d19/f3e [0,4194304] 0 2024-04-03T08:39:15.244 INFO:tasks.workunit.client.1.smithi181.stdout:5/278: creat d4/d18/d3e/f57 x:0 0 0 2024-04-03T08:39:15.245 INFO:tasks.workunit.client.1.smithi181.stdout:4/334: dwrite d1/d16/d24/d5e/d3f/d41/f42 [0,4194304] 0 2024-04-03T08:39:15.248 INFO:tasks.workunit.client.1.smithi181.stdout:3/279: write d0/d5/d6/d32/d43/f48 [1353645,2812] 0 2024-04-03T08:39:15.251 INFO:tasks.workunit.client.1.smithi181.stdout:2/321: write d13/d1c/d4a/f57 [446653,15905] 0 2024-04-03T08:39:15.257 INFO:tasks.workunit.client.1.smithi181.stdout:4/335: chown d1/d16/d24/d5e/d31/d39 175365324 1 2024-04-03T08:39:15.260 INFO:tasks.workunit.client.0.smithi157.stdout:9/422: truncate d1/f42 5195462 0 2024-04-03T08:39:15.262 INFO:tasks.workunit.client.0.smithi157.stdout:1/419: creat d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/f87 x:0 0 0 2024-04-03T08:39:15.263 INFO:tasks.workunit.client.1.smithi181.stdout:7/229: creat d0/d1/d6/de/f52 x:0 0 0 2024-04-03T08:39:15.263 INFO:tasks.workunit.client.1.smithi181.stdout:4/336: readlink d1/l43 0 2024-04-03T08:39:15.265 INFO:tasks.workunit.client.1.smithi181.stdout:7/230: chown d0/d1/d6/de/d17/d27/f3a 1895 1 2024-04-03T08:39:15.266 INFO:tasks.workunit.client.1.smithi181.stdout:9/356: dwrite d1/da/d1a/f4c [0,4194304] 0 2024-04-03T08:39:15.267 INFO:tasks.workunit.client.0.smithi157.stdout:4/423: mknod da/df/d2f/d54/d5f/c8e 0 2024-04-03T08:39:15.269 INFO:tasks.workunit.client.0.smithi157.stdout:9/423: mknod d1/d4a/d4d/c90 0 2024-04-03T08:39:15.271 INFO:tasks.workunit.client.1.smithi181.stdout:0/263: mkdir d5/dc/d10/d58 0 2024-04-03T08:39:15.271 INFO:tasks.workunit.client.0.smithi157.stdout:3/437: sync 2024-04-03T08:39:15.273 INFO:tasks.workunit.client.0.smithi157.stdout:1/420: creat d2/f88 x:0 0 0 2024-04-03T08:39:15.274 INFO:tasks.workunit.client.1.smithi181.stdout:8/240: dread d4/f46 [0,4194304] 0 2024-04-03T08:39:15.275 INFO:tasks.workunit.client.0.smithi157.stdout:7/508: write d0/d11/d15/d17/d43/f45 [505607,58939] 0 2024-04-03T08:39:15.278 INFO:tasks.workunit.client.0.smithi157.stdout:4/424: stat da/l1d 0 2024-04-03T08:39:15.279 INFO:tasks.workunit.client.1.smithi181.stdout:6/282: symlink d6/d7/l5a 0 2024-04-03T08:39:15.282 INFO:tasks.workunit.client.1.smithi181.stdout:2/322: mkdir d13/d7b 0 2024-04-03T08:39:15.282 INFO:tasks.workunit.client.0.smithi157.stdout:4/425: dread - da/df/d24/f75 zero size 2024-04-03T08:39:15.287 INFO:tasks.workunit.client.0.smithi157.stdout:8/464: write d2/d11/d10/d24/d5b/d2e/f58 [1492788,78409] 0 2024-04-03T08:39:15.290 INFO:tasks.workunit.client.0.smithi157.stdout:7/509: creat d0/d11/d15/d1b/db8/fba x:0 0 0 2024-04-03T08:39:15.292 INFO:tasks.workunit.client.0.smithi157.stdout:6/501: dwrite d1/d4b/da5/fab [0,4194304] 0 2024-04-03T08:39:15.295 INFO:tasks.workunit.client.1.smithi181.stdout:3/280: mkdir d0/d5/d6/dd/d25/d50 0 2024-04-03T08:39:15.295 INFO:tasks.workunit.client.0.smithi157.stdout:1/421: symlink d2/d11/d24/d39/d3b/d2e/d48/d5d/l89 0 2024-04-03T08:39:15.296 INFO:tasks.workunit.client.0.smithi157.stdout:1/422: stat d2/c25 0 2024-04-03T08:39:15.297 INFO:tasks.workunit.client.1.smithi181.stdout:4/337: mknod d1/d16/d24/d5e/d3f/d41/c68 0 2024-04-03T08:39:15.304 INFO:tasks.workunit.client.1.smithi181.stdout:9/357: unlink d1/da/fb 0 2024-04-03T08:39:15.305 INFO:tasks.workunit.client.1.smithi181.stdout:9/358: chown d1/da/d28/d30/f6a 2856276 1 2024-04-03T08:39:15.308 INFO:tasks.workunit.client.0.smithi157.stdout:3/438: creat d8/d1e/d2d/d3b/d8c/f96 x:0 0 0 2024-04-03T08:39:15.309 INFO:tasks.workunit.client.1.smithi181.stdout:1/264: mknod d10/d15/d17/c4f 0 2024-04-03T08:39:15.312 INFO:tasks.workunit.client.0.smithi157.stdout:4/426: mkdir da/df/d2f/d64/d8f 0 2024-04-03T08:39:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:14 smithi157 ceph-mon[35083]: Deploying cephadm binary to smithi181 2024-04-03T08:39:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:14 smithi157 ceph-mon[35083]: mgrmap e22: smithi181.mfhidq(active, since 1.02542s) 2024-04-03T08:39:15.316 INFO:tasks.workunit.client.0.smithi157.stdout:8/465: stat d2/d11/d10/d24/d5b/l7a 0 2024-04-03T08:39:15.319 INFO:tasks.workunit.client.0.smithi157.stdout:6/502: unlink d1/d5/f35 0 2024-04-03T08:39:15.321 INFO:tasks.workunit.client.1.smithi181.stdout:6/283: mkdir d6/d7/d50/d5b 0 2024-04-03T08:39:15.323 INFO:tasks.workunit.client.0.smithi157.stdout:6/503: write d1/d5/d17/d29/f7d [735583,79480] 0 2024-04-03T08:39:15.325 INFO:tasks.workunit.client.1.smithi181.stdout:3/281: mknod d0/d5/d6/d32/d43/c51 0 2024-04-03T08:39:15.328 INFO:tasks.workunit.client.1.smithi181.stdout:4/338: mkdir d1/d16/d37/d34/d69 0 2024-04-03T08:39:15.330 INFO:tasks.workunit.client.0.smithi157.stdout:3/439: creat d8/d13/d1b/d37/f97 x:0 0 0 2024-04-03T08:39:15.332 INFO:tasks.workunit.client.0.smithi157.stdout:4/427: write da/df/d11/f66 [1548173,44931] 0 2024-04-03T08:39:15.336 INFO:tasks.workunit.client.0.smithi157.stdout:8/466: chown d2/d11/l2b 26436387 1 2024-04-03T08:39:15.337 INFO:tasks.workunit.client.1.smithi181.stdout:0/264: creat d5/dc/d10/d58/f59 x:0 0 0 2024-04-03T08:39:15.338 INFO:tasks.workunit.client.0.smithi157.stdout:8/467: chown d2/f5a 3831 1 2024-04-03T08:39:15.340 INFO:tasks.workunit.client.1.smithi181.stdout:4/339: dread d1/d16/d24/d5e/f3c [0,4194304] 0 2024-04-03T08:39:15.341 INFO:tasks.workunit.client.1.smithi181.stdout:8/241: unlink d4/c17 0 2024-04-03T08:39:15.343 INFO:tasks.workunit.client.1.smithi181.stdout:6/284: creat d6/d7/d9/f5c x:0 0 0 2024-04-03T08:39:15.344 INFO:tasks.workunit.client.1.smithi181.stdout:7/231: write d0/d1/f4a [865840,9934] 0 2024-04-03T08:39:15.345 INFO:tasks.workunit.client.0.smithi157.stdout:9/424: getdents d1/d15 0 2024-04-03T08:39:15.347 INFO:tasks.workunit.client.1.smithi181.stdout:7/232: dread - d0/d1/d6/de/d17/d27/f41 zero size 2024-04-03T08:39:15.349 INFO:tasks.workunit.client.1.smithi181.stdout:3/282: symlink d0/d17/d40/l52 0 2024-04-03T08:39:15.350 INFO:tasks.workunit.client.0.smithi157.stdout:1/423: dread d2/d11/d24/d39/d3b/d2e/f3e [0,4194304] 0 2024-04-03T08:39:15.350 INFO:tasks.workunit.client.0.smithi157.stdout:4/428: read da/df/d2f/f38 [1689686,27919] 0 2024-04-03T08:39:15.351 INFO:tasks.workunit.client.0.smithi157.stdout:8/468: mknod d2/d7b/c9c 0 2024-04-03T08:39:15.354 INFO:tasks.workunit.client.1.smithi181.stdout:4/340: dread d1/d16/d24/d5e/f3c [0,4194304] 0 2024-04-03T08:39:15.356 INFO:tasks.workunit.client.1.smithi181.stdout:9/359: link d1/da/d13/d41/f2a d1/da/d13/d22/d23/d54/f71 0 2024-04-03T08:39:15.359 INFO:tasks.workunit.client.0.smithi157.stdout:1/424: creat d2/d11/d23/d73/f8a x:0 0 0 2024-04-03T08:39:15.359 INFO:tasks.workunit.client.1.smithi181.stdout:1/265: creat d10/d15/d4b/f50 x:0 0 0 2024-04-03T08:39:15.360 INFO:tasks.workunit.client.0.smithi157.stdout:9/425: symlink d1/d15/d27/l91 0 2024-04-03T08:39:15.361 INFO:tasks.workunit.client.1.smithi181.stdout:8/242: readlink d4/d45/d9/l1a 0 2024-04-03T08:39:15.362 INFO:tasks.workunit.client.0.smithi157.stdout:3/440: dwrite d8/d1e/d2d/f79 [0,4194304] 0 2024-04-03T08:39:15.363 INFO:tasks.workunit.client.0.smithi157.stdout:8/469: rmdir d2/d11/d10/d24/d5b/d2e/d75 39 2024-04-03T08:39:15.365 INFO:tasks.workunit.client.0.smithi157.stdout:3/441: readlink d8/d1e/d2d/d3f/l5d 0 2024-04-03T08:39:15.366 INFO:tasks.workunit.client.0.smithi157.stdout:7/510: write d0/d11/d15/d17/d1c/f4b [4606018,114122] 0 2024-04-03T08:39:15.367 INFO:tasks.workunit.client.1.smithi181.stdout:6/285: dread d6/d31/d36/f33 [0,4194304] 0 2024-04-03T08:39:15.367 INFO:tasks.workunit.client.1.smithi181.stdout:2/323: creat d13/d22/f7c x:0 0 0 2024-04-03T08:39:15.367 INFO:tasks.workunit.client.1.smithi181.stdout:5/279: sync 2024-04-03T08:39:15.369 INFO:tasks.workunit.client.0.smithi157.stdout:8/470: write d2/d11/d10/d24/d5b/d2e/f80 [210793,73016] 0 2024-04-03T08:39:15.372 INFO:tasks.workunit.client.1.smithi181.stdout:3/283: symlink d0/d5/d6/d32/d43/l53 0 2024-04-03T08:39:15.373 INFO:tasks.workunit.client.1.smithi181.stdout:7/233: fdatasync d0/d1/f21 0 2024-04-03T08:39:15.380 INFO:tasks.workunit.client.1.smithi181.stdout:9/360: symlink d1/da/d13/d22/d23/l72 0 2024-04-03T08:39:15.380 INFO:tasks.workunit.client.1.smithi181.stdout:4/341: dwrite d1/d1e/f52 [0,4194304] 0 2024-04-03T08:39:15.381 INFO:tasks.workunit.client.0.smithi157.stdout:3/442: mknod d8/d1e/d2d/d3b/d8c/c98 0 2024-04-03T08:39:15.381 INFO:tasks.workunit.client.1.smithi181.stdout:3/284: chown d0/d5/d6/d32/d43/l53 32625438 1 2024-04-03T08:39:15.384 INFO:tasks.workunit.client.0.smithi157.stdout:7/511: rmdir d0/d11/d6f/d89/d8c 39 2024-04-03T08:39:15.387 INFO:tasks.workunit.client.0.smithi157.stdout:7/512: write d0/d11/d15/d17/f7d [666359,75802] 0 2024-04-03T08:39:15.389 INFO:tasks.workunit.client.0.smithi157.stdout:4/429: write da/df/d24/d35/d6a/f79 [1031134,16592] 0 2024-04-03T08:39:15.391 INFO:tasks.workunit.client.0.smithi157.stdout:7/513: write d0/d11/d15/d17/d43/d8a/d8f/f78 [1207408,55918] 0 2024-04-03T08:39:15.393 INFO:tasks.workunit.client.1.smithi181.stdout:6/286: creat d6/d31/d36/f5d x:0 0 0 2024-04-03T08:39:15.395 INFO:tasks.workunit.client.1.smithi181.stdout:1/266: dwrite f2 [0,4194304] 0 2024-04-03T08:39:15.397 INFO:tasks.workunit.client.1.smithi181.stdout:0/265: creat d5/dc/d14/d29/f5a x:0 0 0 2024-04-03T08:39:15.399 INFO:tasks.workunit.client.0.smithi157.stdout:1/425: truncate d2/f53 773715 0 2024-04-03T08:39:15.401 INFO:tasks.workunit.client.1.smithi181.stdout:0/266: stat d5/dc/d14/f55 0 2024-04-03T08:39:15.401 INFO:tasks.workunit.client.1.smithi181.stdout:6/287: dread - d6/d7/f3f zero size 2024-04-03T08:39:15.404 INFO:tasks.workunit.client.0.smithi157.stdout:4/430: read da/df/d24/f5c [2836388,9798] 0 2024-04-03T08:39:15.405 INFO:tasks.workunit.client.0.smithi157.stdout:1/426: chown d2/d11/d24/d39/d3b/f59 3416148 1 2024-04-03T08:39:15.409 INFO:tasks.workunit.client.1.smithi181.stdout:8/243: write d4/d45/db/d14/f49 [30243,39192] 0 2024-04-03T08:39:15.411 INFO:tasks.workunit.client.1.smithi181.stdout:9/361: rename d1/da/d28/d30/d3e/d52 to d1/da/d13/d73 0 2024-04-03T08:39:15.413 INFO:tasks.workunit.client.1.smithi181.stdout:0/267: read - d5/dc/d14/f3a zero size 2024-04-03T08:39:15.415 INFO:tasks.workunit.client.1.smithi181.stdout:7/234: symlink d0/d1/l53 0 2024-04-03T08:39:15.415 INFO:tasks.workunit.client.1.smithi181.stdout:2/324: dwrite d13/d1c/f3b [0,4194304] 0 2024-04-03T08:39:15.418 INFO:tasks.workunit.client.0.smithi157.stdout:1/427: rmdir d2/d11/d24 39 2024-04-03T08:39:15.420 INFO:tasks.workunit.client.0.smithi157.stdout:7/514: dwrite d0/d11/d15/d1b/f59 [0,4194304] 0 2024-04-03T08:39:15.425 INFO:tasks.workunit.client.0.smithi157.stdout:8/471: dwrite d2/d20/f29 [0,4194304] 0 2024-04-03T08:39:15.426 INFO:tasks.workunit.client.1.smithi181.stdout:1/267: mknod d10/c51 0 2024-04-03T08:39:15.427 INFO:tasks.workunit.client.0.smithi157.stdout:7/515: dread - d0/d11/d15/d1b/db8/fba zero size 2024-04-03T08:39:15.427 INFO:tasks.workunit.client.1.smithi181.stdout:0/268: write d5/dc/d14/f55 [112205,86847] 0 2024-04-03T08:39:15.428 INFO:tasks.workunit.client.1.smithi181.stdout:4/342: dwrite d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:15.429 INFO:tasks.workunit.client.0.smithi157.stdout:4/431: read da/df/d2f/f40 [3121496,87643] 0 2024-04-03T08:39:15.434 INFO:tasks.workunit.client.1.smithi181.stdout:7/235: write d0/d1/f15 [6517302,22271] 0 2024-04-03T08:39:15.436 INFO:tasks.workunit.client.0.smithi157.stdout:8/472: unlink d2/d11/d10/d24/c83 0 2024-04-03T08:39:15.441 INFO:tasks.workunit.client.0.smithi157.stdout:1/428: creat d2/d11/d24/d39/d3b/d2e/d48/d86/f8b x:0 0 0 2024-04-03T08:39:15.444 INFO:tasks.workunit.client.1.smithi181.stdout:3/285: dread d0/d5/f33 [0,4194304] 0 2024-04-03T08:39:15.445 INFO:tasks.workunit.client.0.smithi157.stdout:4/432: mknod da/df/c90 0 2024-04-03T08:39:15.450 INFO:tasks.workunit.client.1.smithi181.stdout:6/288: truncate d6/f3a 604844 0 2024-04-03T08:39:15.452 INFO:tasks.workunit.client.1.smithi181.stdout:3/286: write d0/d5/d6/f4c [30395,76166] 0 2024-04-03T08:39:15.452 INFO:tasks.workunit.client.1.smithi181.stdout:5/280: dwrite d4/d18/f28 [0,4194304] 0 2024-04-03T08:39:15.453 INFO:tasks.workunit.client.1.smithi181.stdout:6/289: dread - d6/d3e/d40/f4e zero size 2024-04-03T08:39:15.456 INFO:tasks.workunit.client.1.smithi181.stdout:1/268: mknod d10/d15/d17/d30/c52 0 2024-04-03T08:39:15.458 INFO:tasks.workunit.client.1.smithi181.stdout:1/269: readlink d10/l46 0 2024-04-03T08:39:15.458 INFO:tasks.workunit.client.1.smithi181.stdout:5/281: write d4/f13 [426321,111079] 0 2024-04-03T08:39:15.459 INFO:tasks.workunit.client.1.smithi181.stdout:6/290: chown d6/d7/d9/f1b 1059 1 2024-04-03T08:39:15.459 INFO:tasks.workunit.client.1.smithi181.stdout:6/291: stat l5 0 2024-04-03T08:39:15.461 INFO:tasks.workunit.client.1.smithi181.stdout:9/362: rename d1/da/d13/d22/d23/d36/c6f to d1/da/d28/d30/d3e/d4e/c74 0 2024-04-03T08:39:15.462 INFO:tasks.workunit.client.0.smithi157.stdout:7/516: dread d0/d4/f10 [0,4194304] 0 2024-04-03T08:39:15.464 INFO:tasks.workunit.client.1.smithi181.stdout:9/363: readlink d1/da/d28/d30/l3c 0 2024-04-03T08:39:15.464 INFO:tasks.workunit.client.1.smithi181.stdout:0/269: chown d5/d52/c34 75 1 2024-04-03T08:39:15.466 INFO:tasks.workunit.client.1.smithi181.stdout:2/325: creat d13/d22/f7d x:0 0 0 2024-04-03T08:39:15.467 INFO:tasks.workunit.client.0.smithi157.stdout:1/429: dwrite d2/d11/d23/f79 [0,4194304] 0 2024-04-03T08:39:15.467 INFO:tasks.workunit.client.1.smithi181.stdout:3/287: creat d0/d17/f54 x:0 0 0 2024-04-03T08:39:15.473 INFO:tasks.workunit.client.0.smithi157.stdout:7/517: write d0/f20 [189155,88053] 0 2024-04-03T08:39:15.476 INFO:tasks.workunit.client.1.smithi181.stdout:3/288: write d0/d17/d36/d1e/f31 [6632,122021] 0 2024-04-03T08:39:15.480 INFO:tasks.workunit.client.1.smithi181.stdout:5/282: rename d4/d18/c1a to d4/d18/d55/c58 0 2024-04-03T08:39:15.484 INFO:tasks.workunit.client.0.smithi157.stdout:3/443: dread d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:15.490 INFO:tasks.workunit.client.0.smithi157.stdout:3/444: chown d8/d13/d1b/d5b/f90 136 1 2024-04-03T08:39:15.492 INFO:tasks.workunit.client.1.smithi181.stdout:6/292: unlink d6/c4b 0 2024-04-03T08:39:15.493 INFO:tasks.workunit.client.1.smithi181.stdout:2/326: dwrite d13/f59 [0,4194304] 0 2024-04-03T08:39:15.493 INFO:tasks.workunit.client.0.smithi157.stdout:1/430: dwrite d2/d11/d24/d39/d3b/d2e/d48/d5d/f60 [0,4194304] 0 2024-04-03T08:39:15.496 INFO:tasks.workunit.client.1.smithi181.stdout:6/293: write d6/d3e/f46 [1414047,1939] 0 2024-04-03T08:39:15.497 INFO:tasks.workunit.client.1.smithi181.stdout:2/327: chown d13/d22/d27/d2f 205459201 1 2024-04-03T08:39:15.504 INFO:tasks.workunit.client.1.smithi181.stdout:5/283: fsync d4/d18/f23 0 2024-04-03T08:39:15.504 INFO:tasks.workunit.client.0.smithi157.stdout:8/473: write d2/d11/ff [280694,122984] 0 2024-04-03T08:39:15.505 INFO:tasks.workunit.client.1.smithi181.stdout:5/284: fsync d4/d18/d25/f3c 0 2024-04-03T08:39:15.505 INFO:tasks.workunit.client.0.smithi157.stdout:4/433: write da/df/d11/f3b [118191,88241] 0 2024-04-03T08:39:15.508 INFO:tasks.workunit.client.0.smithi157.stdout:4/434: chown da/df/d11/l61 39 1 2024-04-03T08:39:15.511 INFO:tasks.workunit.client.0.smithi157.stdout:1/431: rename d2/f5 to d2/d11/d23/f8c 0 2024-04-03T08:39:15.512 INFO:tasks.workunit.client.1.smithi181.stdout:3/289: dwrite d0/d5/d6/d32/d43/f48 [0,4194304] 0 2024-04-03T08:39:15.513 INFO:tasks.workunit.client.1.smithi181.stdout:0/270: dwrite d5/d52/f15 [0,4194304] 0 2024-04-03T08:39:15.513 INFO:tasks.workunit.client.1.smithi181.stdout:6/294: read d6/d31/d36/f44 [3736171,46840] 0 2024-04-03T08:39:15.518 INFO:tasks.workunit.client.1.smithi181.stdout:7/236: truncate d0/d1/f15 7604911 0 2024-04-03T08:39:15.525 INFO:tasks.workunit.client.0.smithi157.stdout:1/432: rename d2/c80 to d2/c8d 0 2024-04-03T08:39:15.526 INFO:tasks.workunit.client.0.smithi157.stdout:4/435: mknod da/df/c91 0 2024-04-03T08:39:15.527 INFO:tasks.workunit.client.0.smithi157.stdout:1/433: stat d2/d11/d24 0 2024-04-03T08:39:15.528 INFO:tasks.workunit.client.1.smithi181.stdout:4/343: dwrite d1/d16/d37/d34/f35 [0,4194304] 0 2024-04-03T08:39:15.529 INFO:tasks.workunit.client.0.smithi157.stdout:4/436: stat da/c25 0 2024-04-03T08:39:15.534 INFO:tasks.workunit.client.0.smithi157.stdout:7/518: write d0/d11/d15/d17/f7c [656373,44036] 0 2024-04-03T08:39:15.536 INFO:tasks.workunit.client.0.smithi157.stdout:7/519: readlink d0/d11/d15/d17/l33 0 2024-04-03T08:39:15.537 INFO:tasks.workunit.client.1.smithi181.stdout:6/295: mkdir d6/d3e/d5e 0 2024-04-03T08:39:15.539 INFO:tasks.workunit.client.1.smithi181.stdout:4/344: write d1/d16/d24/d5e/f53 [1801833,115178] 0 2024-04-03T08:39:15.539 INFO:tasks.workunit.client.1.smithi181.stdout:5/285: dwrite d4/d22/f38 [0,4194304] 0 2024-04-03T08:39:15.540 INFO:tasks.workunit.client.0.smithi157.stdout:4/437: creat da/d26/f92 x:0 0 0 2024-04-03T08:39:15.543 INFO:tasks.workunit.client.0.smithi157.stdout:4/438: write da/df/d11/d5d/f7d [745609,97233] 0 2024-04-03T08:39:15.549 INFO:tasks.workunit.client.0.smithi157.stdout:1/434: rename d2/d11/d24/d39/f4a to d2/d11/d23/d73/f8e 0 2024-04-03T08:39:15.553 INFO:tasks.workunit.client.0.smithi157.stdout:8/474: dread d2/d11/d10/d24/d5b/d2e/d75/f76 [0,4194304] 0 2024-04-03T08:39:15.554 INFO:tasks.workunit.client.1.smithi181.stdout:1/270: link d10/d15/d17/d19/d33/c47 d10/d15/d4a/c53 0 2024-04-03T08:39:15.555 INFO:tasks.workunit.client.0.smithi157.stdout:1/435: write d2/d11/d24/d39/f6f [4573673,18854] 0 2024-04-03T08:39:15.561 INFO:tasks.workunit.client.1.smithi181.stdout:0/271: mknod d5/dc/d10/d30/c5b 0 2024-04-03T08:39:15.563 INFO:tasks.workunit.client.0.smithi157.stdout:4/439: creat da/df/d24/d35/d6a/d78/f93 x:0 0 0 2024-04-03T08:39:15.565 INFO:tasks.workunit.client.1.smithi181.stdout:2/328: creat d13/d7b/f7e x:0 0 0 2024-04-03T08:39:15.565 INFO:tasks.workunit.client.0.smithi157.stdout:8/475: chown d2/d11/d10/d24/d5b/c61 2194 1 2024-04-03T08:39:15.567 INFO:tasks.workunit.client.1.smithi181.stdout:8/244: sync 2024-04-03T08:39:15.568 INFO:tasks.workunit.client.1.smithi181.stdout:2/329: write d13/d1c/d4a/f57 [71024,5979] 0 2024-04-03T08:39:15.569 INFO:tasks.workunit.client.0.smithi157.stdout:8/476: dread - d2/d11/d10/d24/d5b/d2e/d75/d81/f96 zero size 2024-04-03T08:39:15.578 INFO:tasks.workunit.client.0.smithi157.stdout:8/477: mknod d2/d11/d10/d24/d5b/d2e/d75/d81/c9d 0 2024-04-03T08:39:15.581 INFO:tasks.workunit.client.1.smithi181.stdout:8/245: dread d4/d45/db/d14/d31/f34 [0,4194304] 0 2024-04-03T08:39:15.584 INFO:tasks.workunit.client.0.smithi157.stdout:8/478: chown d2/d11/d10/d24/d5b/c37 14008 1 2024-04-03T08:39:15.586 INFO:tasks.workunit.client.1.smithi181.stdout:5/286: fdatasync d4/d18/d25/f1c 0 2024-04-03T08:39:15.589 INFO:tasks.workunit.client.1.smithi181.stdout:2/330: mkdir d13/d1c/d4a/d7f 0 2024-04-03T08:39:15.591 INFO:tasks.workunit.client.1.smithi181.stdout:2/331: chown d13/d22/d27/c3c 249994 1 2024-04-03T08:39:15.592 INFO:tasks.workunit.client.0.smithi157.stdout:8/479: mkdir d2/d6f/d70/d89/d59/d9e 0 2024-04-03T08:39:15.592 INFO:tasks.workunit.client.0.smithi157.stdout:7/520: dwrite d0/d11/d15/d17/d1c/f47 [0,4194304] 0 2024-04-03T08:39:15.594 INFO:tasks.workunit.client.1.smithi181.stdout:6/296: link d6/d3e/d40/f4e d6/d3e/d40/f5f 0 2024-04-03T08:39:15.597 INFO:tasks.workunit.client.0.smithi157.stdout:1/436: truncate d2/f45 661221 0 2024-04-03T08:39:15.598 INFO:tasks.workunit.client.1.smithi181.stdout:7/237: creat d0/f54 x:0 0 0 2024-04-03T08:39:15.598 INFO:tasks.workunit.client.1.smithi181.stdout:3/290: link d0/d5/d6/l3d d0/d5/d6/d32/l55 0 2024-04-03T08:39:15.604 INFO:tasks.workunit.client.0.smithi157.stdout:8/480: symlink d2/d11/d10/d24/d5b/d53/l9f 0 2024-04-03T08:39:15.608 INFO:tasks.workunit.client.1.smithi181.stdout:4/345: creat d1/d16/d24/d5e/f6a x:0 0 0 2024-04-03T08:39:15.613 INFO:tasks.workunit.client.1.smithi181.stdout:2/332: dread d13/d22/d27/f4b [0,4194304] 0 2024-04-03T08:39:15.614 INFO:tasks.workunit.client.1.smithi181.stdout:7/238: dread - d0/d1/d6/de/d17/f38 zero size 2024-04-03T08:39:15.614 INFO:tasks.workunit.client.1.smithi181.stdout:1/271: dwrite d10/f16 [4194304,4194304] 0 2024-04-03T08:39:15.614 INFO:tasks.workunit.client.1.smithi181.stdout:0/272: creat d5/dc/d14/f5c x:0 0 0 2024-04-03T08:39:15.617 INFO:tasks.workunit.client.0.smithi157.stdout:8/481: mknod d2/d11/d10/d24/d5b/ca0 0 2024-04-03T08:39:15.618 INFO:tasks.workunit.client.1.smithi181.stdout:7/239: read d0/d1/d6/de/d17/f24 [292043,11474] 0 2024-04-03T08:39:15.620 INFO:tasks.workunit.client.1.smithi181.stdout:7/240: stat d0/d1/d6/de/d17/f31 0 2024-04-03T08:39:15.624 INFO:tasks.workunit.client.1.smithi181.stdout:9/364: sync 2024-04-03T08:39:15.625 INFO:tasks.workunit.client.0.smithi157.stdout:7/521: dwrite d0/d11/d6f/d76/da7/f62 [4194304,4194304] 0 2024-04-03T08:39:15.629 INFO:tasks.workunit.client.0.smithi157.stdout:1/437: truncate d2/d11/d23/f8c 2126919 0 2024-04-03T08:39:15.630 INFO:tasks.workunit.client.1.smithi181.stdout:4/346: creat d1/d16/d24/d5e/d3f/f6b x:0 0 0 2024-04-03T08:39:15.633 INFO:tasks.workunit.client.0.smithi157.stdout:2/467: sync 2024-04-03T08:39:15.633 INFO:tasks.workunit.client.0.smithi157.stdout:5/494: sync 2024-04-03T08:39:15.633 INFO:tasks.workunit.client.0.smithi157.stdout:0/459: sync 2024-04-03T08:39:15.636 INFO:tasks.workunit.client.0.smithi157.stdout:1/438: fsync d2/d11/d24/d39/f54 0 2024-04-03T08:39:15.637 INFO:tasks.workunit.client.1.smithi181.stdout:0/273: chown d5/dc/c3b 99360235 1 2024-04-03T08:39:15.638 INFO:tasks.workunit.client.1.smithi181.stdout:7/241: dwrite d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:15.639 INFO:tasks.workunit.client.1.smithi181.stdout:2/333: unlink d13/d22/l6e 0 2024-04-03T08:39:15.644 INFO:tasks.workunit.client.0.smithi157.stdout:8/482: creat d2/d11/d10/d24/fa1 x:0 0 0 2024-04-03T08:39:15.646 INFO:tasks.workunit.client.0.smithi157.stdout:2/468: rename d3/db/l5e to d3/db/d44/d4c/d5a/d88/la4 0 2024-04-03T08:39:15.647 INFO:tasks.workunit.client.0.smithi157.stdout:0/460: dread d2/d9/dc/df/d1b/d35/d3d/f58 [0,4194304] 0 2024-04-03T08:39:15.649 INFO:tasks.workunit.client.1.smithi181.stdout:5/287: write d4/f8 [2390734,5616] 0 2024-04-03T08:39:15.650 INFO:tasks.workunit.client.1.smithi181.stdout:8/246: link d4/d45/db/f33 d4/d45/db/f4c 0 2024-04-03T08:39:15.651 INFO:tasks.workunit.client.1.smithi181.stdout:1/272: chown d10/d15/d17/c48 10984 1 2024-04-03T08:39:15.652 INFO:tasks.workunit.client.1.smithi181.stdout:6/297: rename d6/f42 to d6/f60 0 2024-04-03T08:39:15.654 INFO:tasks.workunit.client.1.smithi181.stdout:8/247: chown d4/d2a/f24 76032470 1 2024-04-03T08:39:15.654 INFO:tasks.workunit.client.1.smithi181.stdout:7/242: creat d0/d1/d6/de/d17/f55 x:0 0 0 2024-04-03T08:39:15.656 INFO:tasks.workunit.client.1.smithi181.stdout:0/274: read d5/d52/f53 [90551,39777] 0 2024-04-03T08:39:15.657 INFO:tasks.workunit.client.0.smithi157.stdout:5/495: creat dc/d29/d43/da1/fa8 x:0 0 0 2024-04-03T08:39:15.659 INFO:tasks.workunit.client.1.smithi181.stdout:9/365: mknod d1/da/d13/d22/c75 0 2024-04-03T08:39:15.659 INFO:tasks.workunit.client.0.smithi157.stdout:0/461: chown d2/f2c 29821 1 2024-04-03T08:39:15.661 INFO:tasks.workunit.client.1.smithi181.stdout:5/288: mkdir d4/d18/d25/d59 0 2024-04-03T08:39:15.664 INFO:tasks.workunit.client.1.smithi181.stdout:3/291: getdents d0/d5/d6/d29 0 2024-04-03T08:39:15.667 INFO:tasks.workunit.client.1.smithi181.stdout:6/298: creat d6/d7/d50/f61 x:0 0 0 2024-04-03T08:39:15.667 INFO:tasks.workunit.client.1.smithi181.stdout:3/292: truncate d0/d17/f54 570997 0 2024-04-03T08:39:15.669 INFO:tasks.workunit.client.1.smithi181.stdout:7/243: creat d0/d1/d6/de/d17/d27/f56 x:0 0 0 2024-04-03T08:39:15.670 INFO:tasks.workunit.client.1.smithi181.stdout:3/293: fsync d0/d17/d36/d1e/f31 0 2024-04-03T08:39:15.670 INFO:tasks.workunit.client.1.smithi181.stdout:6/299: chown d6/d7/d9/f1a 1 1 2024-04-03T08:39:15.671 INFO:tasks.workunit.client.0.smithi157.stdout:1/439: dwrite d2/d11/d24/d67/f70 [0,4194304] 0 2024-04-03T08:39:15.672 INFO:tasks.workunit.client.1.smithi181.stdout:1/273: dread f2 [0,4194304] 0 2024-04-03T08:39:15.673 INFO:tasks.workunit.client.1.smithi181.stdout:9/366: chown d1/da/d13/d41/c38 337450865 1 2024-04-03T08:39:15.673 INFO:tasks.workunit.client.0.smithi157.stdout:8/483: dread d2/d20/d23/f6c [0,4194304] 0 2024-04-03T08:39:15.674 INFO:tasks.workunit.client.1.smithi181.stdout:5/289: mkdir d4/d18/d55/d5a 0 2024-04-03T08:39:15.675 INFO:tasks.workunit.client.1.smithi181.stdout:8/248: dread d4/f46 [0,4194304] 0 2024-04-03T08:39:15.675 INFO:tasks.workunit.client.1.smithi181.stdout:5/290: stat d4/ff 0 2024-04-03T08:39:15.678 INFO:tasks.workunit.client.0.smithi157.stdout:7/522: dwrite d0/d11/f74 [0,4194304] 0 2024-04-03T08:39:15.682 INFO:tasks.workunit.client.1.smithi181.stdout:4/347: getdents d1/d16/d24/d5e/d3f/d41 0 2024-04-03T08:39:15.684 INFO:tasks.workunit.client.1.smithi181.stdout:9/367: stat d1/da/d13/d22/f31 0 2024-04-03T08:39:15.686 INFO:tasks.workunit.client.1.smithi181.stdout:0/275: rename d5/dc/d10/d58/f59 to d5/d52/f5d 0 2024-04-03T08:39:15.690 INFO:tasks.workunit.client.0.smithi157.stdout:1/440: dwrite d2/d11/d23/f4d [0,4194304] 0 2024-04-03T08:39:15.691 INFO:tasks.workunit.client.1.smithi181.stdout:4/348: chown d1/d16/c22 216459527 1 2024-04-03T08:39:15.693 INFO:tasks.workunit.client.1.smithi181.stdout:4/349: write d1/d16/f5a [260694,48785] 0 2024-04-03T08:39:15.693 INFO:tasks.workunit.client.1.smithi181.stdout:9/368: mknod d1/da/d28/d30/c76 0 2024-04-03T08:39:15.695 INFO:tasks.workunit.client.1.smithi181.stdout:8/249: getdents d4/d44 0 2024-04-03T08:39:15.697 INFO:tasks.workunit.client.1.smithi181.stdout:6/300: rename d6/d7/d9/l29 to d6/d7/d9/d22/l62 0 2024-04-03T08:39:15.697 INFO:tasks.workunit.client.1.smithi181.stdout:9/369: write d1/da/d1a/f1f [3893263,53222] 0 2024-04-03T08:39:15.703 INFO:tasks.workunit.client.1.smithi181.stdout:4/350: unlink d1/d16/d24/f48 0 2024-04-03T08:39:15.706 INFO:tasks.workunit.client.1.smithi181.stdout:0/276: dread d5/dc/d10/f20 [0,4194304] 0 2024-04-03T08:39:15.709 INFO:tasks.workunit.client.1.smithi181.stdout:7/244: getdents d0/d1 0 2024-04-03T08:39:15.711 INFO:tasks.workunit.client.1.smithi181.stdout:1/274: getdents d10/d15/d17 0 2024-04-03T08:39:15.713 INFO:tasks.workunit.client.1.smithi181.stdout:0/277: fdatasync d5/d9/f3e 0 2024-04-03T08:39:15.717 INFO:tasks.workunit.client.1.smithi181.stdout:4/351: mkdir d1/d16/d24/d5e/d3f/d6c 0 2024-04-03T08:39:15.717 INFO:tasks.workunit.client.0.smithi157.stdout:0/462: chown d2/d9/dc/df/ca3 15551 1 2024-04-03T08:39:15.718 INFO:tasks.workunit.client.0.smithi157.stdout:5/496: rename dc/d35/c4f to dc/d29/d56/d49/d53/ca9 0 2024-04-03T08:39:15.718 INFO:tasks.workunit.client.1.smithi181.stdout:1/275: readlink d10/d15/d17/d19/l1c 0 2024-04-03T08:39:15.720 INFO:tasks.workunit.client.0.smithi157.stdout:5/497: truncate dc/f83 33707 0 2024-04-03T08:39:15.723 INFO:tasks.workunit.client.1.smithi181.stdout:4/352: chown d1/d16/d24/d5e/f4f 63094 1 2024-04-03T08:39:15.723 INFO:tasks.workunit.client.0.smithi157.stdout:5/498: fsync dc/d29/f4a 0 2024-04-03T08:39:15.723 INFO:tasks.workunit.client.1.smithi181.stdout:0/278: dread - d5/f40 zero size 2024-04-03T08:39:15.724 INFO:tasks.workunit.client.1.smithi181.stdout:1/276: chown d10/d15/d17/d19/d33 6934089 1 2024-04-03T08:39:15.725 INFO:tasks.workunit.client.1.smithi181.stdout:3/294: dread d0/d17/d36/d1e/f31 [4194304,4194304] 0 2024-04-03T08:39:15.727 INFO:tasks.workunit.client.1.smithi181.stdout:6/301: dwrite d6/d7/d9/d22/d4f/f55 [0,4194304] 0 2024-04-03T08:39:15.731 INFO:tasks.workunit.client.1.smithi181.stdout:5/291: dread d4/d18/d25/f1c [0,4194304] 0 2024-04-03T08:39:15.732 INFO:tasks.workunit.client.0.smithi157.stdout:8/484: mknod d2/d6f/d70/d89/d59/d9e/ca2 0 2024-04-03T08:39:15.732 INFO:tasks.workunit.client.1.smithi181.stdout:2/334: write d13/d1c/d4a/f4d [2357900,3747] 0 2024-04-03T08:39:15.734 INFO:tasks.workunit.client.1.smithi181.stdout:7/245: mkdir d0/d1/d6/de/d57 0 2024-04-03T08:39:15.735 INFO:tasks.workunit.client.0.smithi157.stdout:2/469: write d3/d2e/d32/d3c/f52 [233123,89308] 0 2024-04-03T08:39:15.737 INFO:tasks.workunit.client.1.smithi181.stdout:7/246: chown d0/d1/d6/f9 15 1 2024-04-03T08:39:15.744 INFO:tasks.workunit.client.1.smithi181.stdout:4/353: dread d1/d16/d24/d5e/d3f/d41/f42 [0,4194304] 0 2024-04-03T08:39:15.745 INFO:tasks.workunit.client.1.smithi181.stdout:4/354: stat d1/d16/d24/d61 0 2024-04-03T08:39:15.747 INFO:tasks.workunit.client.0.smithi157.stdout:5/499: dwrite dc/d29/d56/d49/d53/f8f [0,4194304] 0 2024-04-03T08:39:15.749 INFO:tasks.workunit.client.0.smithi157.stdout:0/463: mkdir d2/d9/dc/df/d6f/d9d/d6a/d91/dae 0 2024-04-03T08:39:15.753 INFO:tasks.workunit.client.0.smithi157.stdout:8/485: symlink d2/d11/d10/d24/d5b/d53/la3 0 2024-04-03T08:39:15.755 INFO:tasks.workunit.client.1.smithi181.stdout:8/250: link d4/fc d4/d45/d9/f4d 0 2024-04-03T08:39:15.756 INFO:tasks.workunit.client.0.smithi157.stdout:2/470: dread d3/d12/d43/f78 [0,4194304] 0 2024-04-03T08:39:15.762 INFO:tasks.workunit.client.1.smithi181.stdout:5/292: chown d4/c33 14 1 2024-04-03T08:39:15.763 INFO:tasks.workunit.client.1.smithi181.stdout:0/279: dread d5/fb [0,4194304] 0 2024-04-03T08:39:15.767 INFO:tasks.workunit.client.1.smithi181.stdout:5/293: truncate d4/d18/d25/f3c 705078 0 2024-04-03T08:39:15.768 INFO:tasks.workunit.client.1.smithi181.stdout:3/295: dwrite d0/d5/f33 [0,4194304] 0 2024-04-03T08:39:15.769 INFO:tasks.workunit.client.0.smithi157.stdout:0/464: write d2/d9/d51/d63/d71/f81 [295658,28085] 0 2024-04-03T08:39:15.770 INFO:tasks.workunit.client.1.smithi181.stdout:1/277: creat d10/d15/d17/d37/f54 x:0 0 0 2024-04-03T08:39:15.770 INFO:tasks.workunit.client.1.smithi181.stdout:5/294: read d4/d18/f4e [478098,82629] 0 2024-04-03T08:39:15.772 INFO:tasks.workunit.client.1.smithi181.stdout:6/302: fsync d6/d7/d9/fa 0 2024-04-03T08:39:15.773 INFO:tasks.workunit.client.1.smithi181.stdout:1/278: read - d10/d15/d17/d19/f45 zero size 2024-04-03T08:39:15.775 INFO:tasks.workunit.client.1.smithi181.stdout:5/295: read d4/d18/f23 [1726369,117663] 0 2024-04-03T08:39:15.778 INFO:tasks.workunit.client.1.smithi181.stdout:6/303: write d6/d7/f20 [2309532,90720] 0 2024-04-03T08:39:15.782 INFO:tasks.workunit.client.1.smithi181.stdout:0/280: chown d5/dc/d14/d29/d46/c51 449516 1 2024-04-03T08:39:15.782 INFO:tasks.workunit.client.1.smithi181.stdout:7/247: symlink d0/d1/d6/l58 0 2024-04-03T08:39:15.783 INFO:tasks.workunit.client.1.smithi181.stdout:0/281: fsync d5/dc/f21 0 2024-04-03T08:39:15.785 INFO:tasks.workunit.client.1.smithi181.stdout:0/282: write d5/d9/d2e/f43 [1127625,48778] 0 2024-04-03T08:39:15.786 INFO:tasks.workunit.client.0.smithi157.stdout:1/441: getdents d2/d11/d24/d39/d3b/d2e 0 2024-04-03T08:39:15.788 INFO:tasks.workunit.client.1.smithi181.stdout:3/296: mkdir d0/d17/d56 0 2024-04-03T08:39:15.789 INFO:tasks.workunit.client.1.smithi181.stdout:0/283: write d5/dc/d10/f20 [2301713,40896] 0 2024-04-03T08:39:15.790 INFO:tasks.workunit.client.1.smithi181.stdout:3/297: chown d0/d17/d36/f45 25421424 1 2024-04-03T08:39:15.791 INFO:tasks.workunit.client.1.smithi181.stdout:0/284: read - d5/d9/d2e/f39 zero size 2024-04-03T08:39:15.792 INFO:tasks.workunit.client.1.smithi181.stdout:3/298: chown d0/d5/d6/f4c 413 1 2024-04-03T08:39:15.794 INFO:tasks.workunit.client.1.smithi181.stdout:5/296: creat d4/d22/d4a/f5b x:0 0 0 2024-04-03T08:39:15.796 INFO:tasks.workunit.client.0.smithi157.stdout:0/465: dwrite d2/d9/dc/df/d1b/f59 [0,4194304] 0 2024-04-03T08:39:15.798 INFO:tasks.workunit.client.1.smithi181.stdout:6/304: mkdir d6/d3e/d40/d63 0 2024-04-03T08:39:15.799 INFO:tasks.workunit.client.0.smithi157.stdout:7/523: getdents d0/d11/d15/d17 0 2024-04-03T08:39:15.799 INFO:tasks.workunit.client.0.smithi157.stdout:8/486: link d2/d11/d10/d24/l33 d2/d6f/d70/la4 0 2024-04-03T08:39:15.805 INFO:tasks.workunit.client.1.smithi181.stdout:1/279: creat d10/d15/d17/d30/f55 x:0 0 0 2024-04-03T08:39:15.805 INFO:tasks.workunit.client.0.smithi157.stdout:2/471: dread d3/d12/f7c [0,4194304] 0 2024-04-03T08:39:15.808 INFO:tasks.workunit.client.0.smithi157.stdout:2/472: read d3/d12/f7c [1862676,49402] 0 2024-04-03T08:39:15.809 INFO:tasks.workunit.client.0.smithi157.stdout:1/442: symlink d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/l8f 0 2024-04-03T08:39:15.816 INFO:tasks.workunit.client.1.smithi181.stdout:0/285: dread d5/dc/f12 [0,4194304] 0 2024-04-03T08:39:15.819 INFO:tasks.workunit.client.0.smithi157.stdout:8/487: symlink d2/d6f/d70/d89/d59/d9e/la5 0 2024-04-03T08:39:15.821 INFO:tasks.workunit.client.0.smithi157.stdout:6/504: sync 2024-04-03T08:39:15.821 INFO:tasks.workunit.client.1.smithi181.stdout:4/355: link d1/d16/d24/d5e/d3f/d41/f42 d1/f6d 0 2024-04-03T08:39:15.824 INFO:tasks.workunit.client.1.smithi181.stdout:6/305: dread d6/d31/d36/f44 [0,4194304] 0 2024-04-03T08:39:15.825 INFO:tasks.workunit.client.1.smithi181.stdout:3/299: mkdir d0/d57 0 2024-04-03T08:39:15.825 INFO:tasks.workunit.client.0.smithi157.stdout:6/505: readlink d1/d5/d17/d29/d62/d7f/l94 0 2024-04-03T08:39:15.825 INFO:tasks.workunit.client.0.smithi157.stdout:7/524: dwrite d0/d11/d15/d1b/db8/fac [0,4194304] 0 2024-04-03T08:39:15.827 INFO:tasks.workunit.client.0.smithi157.stdout:1/443: mkdir d2/d11/d24/d39/d3b/d1b/d90 0 2024-04-03T08:39:15.827 INFO:tasks.workunit.client.0.smithi157.stdout:6/506: fdatasync d1/d5/d1b/faa 0 2024-04-03T08:39:15.832 INFO:tasks.workunit.client.1.smithi181.stdout:5/297: unlink d4/f12 0 2024-04-03T08:39:15.835 INFO:tasks.workunit.client.1.smithi181.stdout:9/370: write d1/d34/d39/f59 [1638306,43975] 0 2024-04-03T08:39:15.836 INFO:tasks.workunit.client.1.smithi181.stdout:7/248: mknod d0/d1/d6/de/d57/c59 0 2024-04-03T08:39:15.841 INFO:tasks.workunit.client.0.smithi157.stdout:6/507: mknod d1/d5/d17/d2a/d30/cae 0 2024-04-03T08:39:15.847 INFO:tasks.workunit.client.1.smithi181.stdout:4/356: dwrite d1/d16/d24/d5e/f45 [0,4194304] 0 2024-04-03T08:39:15.848 INFO:tasks.workunit.client.1.smithi181.stdout:6/306: dwrite d6/d31/d36/f33 [0,4194304] 0 2024-04-03T08:39:15.853 INFO:tasks.workunit.client.1.smithi181.stdout:0/286: symlink d5/dc/d14/d29/l5e 0 2024-04-03T08:39:15.856 INFO:tasks.workunit.client.0.smithi157.stdout:2/473: creat d3/d2e/fa5 x:0 0 0 2024-04-03T08:39:15.858 INFO:tasks.workunit.client.0.smithi157.stdout:6/508: creat d1/d5/d17/d29/faf x:0 0 0 2024-04-03T08:39:15.859 INFO:tasks.workunit.client.1.smithi181.stdout:9/371: mkdir d1/da/d28/d30/d3e/d77 0 2024-04-03T08:39:15.860 INFO:tasks.workunit.client.0.smithi157.stdout:1/444: mkdir d2/d11/d24/d39/d3b/d2e/d66/d91 0 2024-04-03T08:39:15.860 INFO:tasks.workunit.client.1.smithi181.stdout:1/280: rmdir d10/d15/d17/d37 39 2024-04-03T08:39:15.861 INFO:tasks.workunit.client.0.smithi157.stdout:2/474: chown d3/d12/fd 0 1 2024-04-03T08:39:15.862 INFO:tasks.workunit.client.1.smithi181.stdout:4/357: creat d1/d16/d55/f6e x:0 0 0 2024-04-03T08:39:15.863 INFO:tasks.workunit.client.1.smithi181.stdout:9/372: chown d1/da/f21 11 1 2024-04-03T08:39:15.863 INFO:tasks.workunit.client.1.smithi181.stdout:1/281: fsync d10/f22 0 2024-04-03T08:39:15.866 INFO:tasks.workunit.client.0.smithi157.stdout:6/509: write d1/d5/d17/d29/f5a [4653098,3151] 0 2024-04-03T08:39:15.866 INFO:tasks.workunit.client.0.smithi157.stdout:7/525: rename d0/d11/d15/d17/d43/d8a/d8f/f3d to d0/d11/d15/d17/d1c/d4f/d5f/fbb 0 2024-04-03T08:39:15.868 INFO:tasks.workunit.client.1.smithi181.stdout:8/251: sync 2024-04-03T08:39:15.869 INFO:tasks.workunit.client.1.smithi181.stdout:2/335: write d13/d1c/d4a/d68/f50 [527990,63475] 0 2024-04-03T08:39:15.872 INFO:tasks.workunit.client.1.smithi181.stdout:4/358: creat d1/d1e/d2c/f6f x:0 0 0 2024-04-03T08:39:15.874 INFO:tasks.workunit.client.1.smithi181.stdout:6/307: dwrite d6/d7/d9/f28 [0,4194304] 0 2024-04-03T08:39:15.874 INFO:tasks.workunit.client.0.smithi157.stdout:5/500: dwrite dc/d29/d56/d18/d21/f94 [0,4194304] 0 2024-04-03T08:39:15.878 INFO:tasks.workunit.client.1.smithi181.stdout:6/308: chown d6/d7/d50/f54 7192 1 2024-04-03T08:39:15.879 INFO:tasks.workunit.client.1.smithi181.stdout:5/298: rmdir d4/d22/d4a 39 2024-04-03T08:39:15.880 INFO:tasks.workunit.client.0.smithi157.stdout:5/501: stat dc/d29/d56/d49/d7f 0 2024-04-03T08:39:15.880 INFO:tasks.workunit.client.0.smithi157.stdout:5/502: stat dc/d29/d56/d9e 0 2024-04-03T08:39:15.881 INFO:tasks.workunit.client.0.smithi157.stdout:5/503: chown dc/fd 4142213 1 2024-04-03T08:39:15.884 INFO:tasks.workunit.client.0.smithi157.stdout:6/510: rmdir d1/d5/d17/d2a/d73 39 2024-04-03T08:39:15.887 INFO:tasks.workunit.client.1.smithi181.stdout:0/287: symlink d5/dc/d14/l5f 0 2024-04-03T08:39:15.888 INFO:tasks.workunit.client.0.smithi157.stdout:7/526: dread d0/d11/d15/d17/d1c/f47 [0,4194304] 0 2024-04-03T08:39:15.893 INFO:tasks.workunit.client.1.smithi181.stdout:7/249: rename d0/d1/d6/de/f2d to d0/d1/d6/de/f5a 0 2024-04-03T08:39:15.897 INFO:tasks.workunit.client.0.smithi157.stdout:2/475: fdatasync d3/db/f2a 0 2024-04-03T08:39:15.902 INFO:tasks.workunit.client.0.smithi157.stdout:9/426: sync 2024-04-03T08:39:15.905 INFO:tasks.workunit.client.0.smithi157.stdout:2/476: write d3/d12/d43/d4b/d55/f59 [1925742,87127] 0 2024-04-03T08:39:15.906 INFO:tasks.workunit.client.0.smithi157.stdout:0/466: dwrite d2/d9/dc/df/d1b/d4a/f2f [0,4194304] 0 2024-04-03T08:39:15.908 INFO:tasks.workunit.client.0.smithi157.stdout:6/511: read d1/d5/d1b/f54 [829792,29334] 0 2024-04-03T08:39:15.908 INFO:tasks.workunit.client.0.smithi157.stdout:7/527: creat d0/d11/d15/d17/fbc x:0 0 0 2024-04-03T08:39:15.915 INFO:tasks.workunit.client.0.smithi157.stdout:2/477: truncate d3/d2e/d32/d3c/fa3 915423 0 2024-04-03T08:39:15.919 INFO:tasks.workunit.client.1.smithi181.stdout:1/282: dwrite d10/d15/d17/d19/f45 [0,4194304] 0 2024-04-03T08:39:15.919 INFO:tasks.workunit.client.1.smithi181.stdout:8/252: mknod d4/d45/c4e 0 2024-04-03T08:39:15.920 INFO:tasks.workunit.client.0.smithi157.stdout:5/504: dread dc/f11 [0,4194304] 0 2024-04-03T08:39:15.922 INFO:tasks.workunit.client.0.smithi157.stdout:2/478: stat d3/db/d44/d4c/d5a/d88/f8c 0 2024-04-03T08:39:15.924 INFO:tasks.workunit.client.0.smithi157.stdout:9/427: creat d1/d36/d46/f92 x:0 0 0 2024-04-03T08:39:15.930 INFO:tasks.workunit.client.0.smithi157.stdout:8/488: dwrite d2/d11/f3e [0,4194304] 0 2024-04-03T08:39:15.932 INFO:tasks.workunit.client.1.smithi181.stdout:6/309: fdatasync d6/f3a 0 2024-04-03T08:39:15.932 INFO:tasks.workunit.client.0.smithi157.stdout:1/445: rename d2/d11/f44 to d2/d11/f92 0 2024-04-03T08:39:15.934 INFO:tasks.workunit.client.0.smithi157.stdout:7/528: write d0/d11/d6f/d76/fa2 [2945104,64401] 0 2024-04-03T08:39:15.938 INFO:tasks.workunit.client.0.smithi157.stdout:7/529: chown d0/d11/d15/d1b/db8/l9a 6 1 2024-04-03T08:39:15.942 INFO:tasks.workunit.client.1.smithi181.stdout:3/300: dread d0/d17/d36/d1e/f31 [4194304,4194304] 0 2024-04-03T08:39:15.942 INFO:tasks.workunit.client.1.smithi181.stdout:9/373: dwrite d1/da/d28/f49 [0,4194304] 0 2024-04-03T08:39:15.943 INFO:tasks.workunit.client.0.smithi157.stdout:2/479: write d3/f34 [131060,69116] 0 2024-04-03T08:39:15.944 INFO:tasks.workunit.client.1.smithi181.stdout:4/359: link d1/l5 d1/d16/d24/d5e/d31/d39/l70 0 2024-04-03T08:39:15.944 INFO:tasks.workunit.client.0.smithi157.stdout:8/489: rmdir d2/d6f/d70/d89/d59 39 2024-04-03T08:39:15.948 INFO:tasks.workunit.client.0.smithi157.stdout:2/480: chown d3/d12/d43/d4b/f73 140 1 2024-04-03T08:39:15.948 INFO:tasks.workunit.client.0.smithi157.stdout:0/467: link d2/d9/dc/df/d1b/d35/d3d/f99 d2/d9/d36/d38/faf 0 2024-04-03T08:39:15.950 INFO:tasks.workunit.client.1.smithi181.stdout:5/299: creat d4/d18/f5c x:0 0 0 2024-04-03T08:39:15.950 INFO:tasks.workunit.client.0.smithi157.stdout:8/490: write d2/d20/f3c [463333,58201] 0 2024-04-03T08:39:15.951 INFO:tasks.workunit.client.1.smithi181.stdout:6/310: rmdir d6/d7/d9/d22 39 2024-04-03T08:39:15.953 INFO:tasks.workunit.client.0.smithi157.stdout:5/505: mkdir dc/d29/d56/d52/d9d/da5/daa 0 2024-04-03T08:39:15.955 INFO:tasks.workunit.client.0.smithi157.stdout:3/445: sync 2024-04-03T08:39:15.955 INFO:tasks.workunit.client.1.smithi181.stdout:2/336: rename d13/d1c/d6c/c71 to d13/d1c/c80 0 2024-04-03T08:39:15.956 INFO:tasks.workunit.client.0.smithi157.stdout:4/440: sync 2024-04-03T08:39:15.958 INFO:tasks.workunit.client.1.smithi181.stdout:2/337: dread - d13/d22/d40/f56 zero size 2024-04-03T08:39:15.959 INFO:tasks.workunit.client.1.smithi181.stdout:1/283: creat d10/d15/d17/d37/f56 x:0 0 0 2024-04-03T08:39:15.961 INFO:tasks.workunit.client.1.smithi181.stdout:0/288: getdents d5/d9/d2c 0 2024-04-03T08:39:15.963 INFO:tasks.workunit.client.0.smithi157.stdout:9/428: creat d1/f93 x:0 0 0 2024-04-03T08:39:15.963 INFO:tasks.workunit.client.1.smithi181.stdout:0/289: chown d5/dc/f21 0 1 2024-04-03T08:39:15.966 INFO:tasks.workunit.client.0.smithi157.stdout:2/481: mkdir d3/da6 0 2024-04-03T08:39:15.970 INFO:tasks.workunit.client.1.smithi181.stdout:6/311: mkdir d6/d7/d50/d64 0 2024-04-03T08:39:15.970 INFO:tasks.workunit.client.0.smithi157.stdout:4/441: rename da/df/d11/f3b to da/df/d6b/f94 0 2024-04-03T08:39:15.971 INFO:tasks.workunit.client.0.smithi157.stdout:5/506: fdatasync dc/d29/f38 0 2024-04-03T08:39:15.973 INFO:tasks.workunit.client.0.smithi157.stdout:9/429: readlink d1/lf 0 2024-04-03T08:39:15.975 INFO:tasks.workunit.client.0.smithi157.stdout:5/507: chown dc/d29/d56/d2e/l3c 0 1 2024-04-03T08:39:15.978 INFO:tasks.workunit.client.1.smithi181.stdout:1/284: dwrite d10/d15/d17/d19/f40 [0,4194304] 0 2024-04-03T08:39:15.978 INFO:tasks.workunit.client.1.smithi181.stdout:9/374: dread d1/da/d1a/f27 [0,4194304] 0 2024-04-03T08:39:15.979 INFO:tasks.workunit.client.0.smithi157.stdout:8/491: symlink d2/d11/d10/d24/la6 0 2024-04-03T08:39:15.983 INFO:tasks.workunit.client.1.smithi181.stdout:5/300: creat d4/d22/d4a/f5d x:0 0 0 2024-04-03T08:39:15.983 INFO:tasks.workunit.client.1.smithi181.stdout:8/253: getdents d4/d45/db/d14/d31 0 2024-04-03T08:39:15.984 INFO:tasks.workunit.client.0.smithi157.stdout:4/442: mkdir da/df/d6b/d95 0 2024-04-03T08:39:15.986 INFO:tasks.workunit.client.1.smithi181.stdout:1/285: write d10/d15/d41/f44 [727635,86954] 0 2024-04-03T08:39:15.986 INFO:tasks.workunit.client.1.smithi181.stdout:5/301: write d4/f13 [3500554,124560] 0 2024-04-03T08:39:15.988 INFO:tasks.workunit.client.0.smithi157.stdout:5/508: creat dc/d29/d56/d18/fab x:0 0 0 2024-04-03T08:39:15.991 INFO:tasks.workunit.client.1.smithi181.stdout:3/301: symlink d0/d5/d6/l58 0 2024-04-03T08:39:15.991 INFO:tasks.workunit.client.1.smithi181.stdout:5/302: truncate d4/d22/d4a/f50 255424 0 2024-04-03T08:39:15.994 INFO:tasks.workunit.client.1.smithi181.stdout:0/290: mkdir d5/d9/d60 0 2024-04-03T08:39:15.995 INFO:tasks.workunit.client.1.smithi181.stdout:9/375: rmdir d1/d34 39 2024-04-03T08:39:15.997 INFO:tasks.workunit.client.1.smithi181.stdout:0/291: chown d5/dc/d10/f20 1 1 2024-04-03T08:39:15.998 INFO:tasks.workunit.client.0.smithi157.stdout:4/443: creat da/df/d2f/d64/f96 x:0 0 0 2024-04-03T08:39:16.000 INFO:tasks.workunit.client.1.smithi181.stdout:7/250: rename d0/d1/d6/de/d17/d27/f41 to d0/f5b 0 2024-04-03T08:39:16.002 INFO:tasks.workunit.client.0.smithi157.stdout:4/444: chown da/df/d2f/d54/f65 289 1 2024-04-03T08:39:16.003 INFO:tasks.workunit.client.0.smithi157.stdout:9/430: rename d1/d36/d66 to d1/d94 0 2024-04-03T08:39:16.006 INFO:tasks.workunit.client.1.smithi181.stdout:8/254: mknod d4/d45/db/d14/d31/c4f 0 2024-04-03T08:39:16.007 INFO:tasks.workunit.client.0.smithi157.stdout:5/509: mknod dc/d29/d56/da4/cac 0 2024-04-03T08:39:16.012 INFO:tasks.workunit.client.0.smithi157.stdout:4/445: mkdir da/df/d2f/d97 0 2024-04-03T08:39:16.013 INFO:tasks.workunit.client.1.smithi181.stdout:6/312: truncate d6/d7/d9/f15 3793002 0 2024-04-03T08:39:16.023 INFO:tasks.workunit.client.1.smithi181.stdout:9/376: symlink d1/da/d13/l78 0 2024-04-03T08:39:16.023 INFO:tasks.workunit.client.0.smithi157.stdout:4/446: symlink da/df/d24/d35/d3c/l98 0 2024-04-03T08:39:16.026 INFO:tasks.workunit.client.1.smithi181.stdout:9/377: fsync d1/da/d28/f49 0 2024-04-03T08:39:16.026 INFO:tasks.workunit.client.1.smithi181.stdout:8/255: dwrite d4/d2a/f48 [0,4194304] 0 2024-04-03T08:39:16.029 INFO:tasks.workunit.client.1.smithi181.stdout:4/360: rename d1/d1e/d2c/f6f to d1/d16/d24/d5e/d2b/d56/f71 0 2024-04-03T08:39:16.030 INFO:tasks.workunit.client.0.smithi157.stdout:7/530: dwrite d0/d16/f6b [0,4194304] 0 2024-04-03T08:39:16.046 INFO:tasks.workunit.client.0.smithi157.stdout:0/468: dwrite d2/d9/dc/df/d1b/f6d [0,4194304] 0 2024-04-03T08:39:16.046 INFO:tasks.workunit.client.0.smithi157.stdout:8/492: rmdir d2/d11/d10 39 2024-04-03T08:39:16.050 INFO:tasks.workunit.client.1.smithi181.stdout:3/302: rename d0/d5/d6/d29 to d0/d5/d6/d32/d59 0 2024-04-03T08:39:16.050 INFO:tasks.workunit.client.1.smithi181.stdout:0/292: write d5/d9/d2a/f4f [287768,99419] 0 2024-04-03T08:39:16.051 INFO:tasks.workunit.client.1.smithi181.stdout:2/338: truncate f3 293365 0 2024-04-03T08:39:16.052 INFO:tasks.workunit.client.1.smithi181.stdout:3/303: chown d0/d5/d6/d32 44 1 2024-04-03T08:39:16.053 INFO:tasks.workunit.client.1.smithi181.stdout:0/293: write d5/dc/f21 [2042856,1177] 0 2024-04-03T08:39:16.054 INFO:tasks.workunit.client.1.smithi181.stdout:8/256: creat d4/d45/db/d14/f50 x:0 0 0 2024-04-03T08:39:16.055 INFO:tasks.workunit.client.1.smithi181.stdout:3/304: fdatasync d0/d17/f26 0 2024-04-03T08:39:16.057 INFO:tasks.workunit.client.0.smithi157.stdout:8/493: read d2/d6f/d70/f97 [2140395,128376] 0 2024-04-03T08:39:16.059 INFO:tasks.workunit.client.1.smithi181.stdout:4/361: unlink d1/d16/d24/d5e/f6a 0 2024-04-03T08:39:16.060 INFO:tasks.workunit.client.0.smithi157.stdout:7/531: dread d0/d11/d15/d1b/db8/f95 [0,4194304] 0 2024-04-03T08:39:16.063 INFO:tasks.workunit.client.1.smithi181.stdout:1/286: mkdir d10/d15/d17/d23/d57 0 2024-04-03T08:39:16.065 INFO:tasks.workunit.client.1.smithi181.stdout:6/313: getdents d6/d7/d50/d5b 0 2024-04-03T08:39:16.068 INFO:tasks.workunit.client.0.smithi157.stdout:0/469: rename d2/d9/dc/df/d1b/d4a/l19 to d2/d9/d5f/d85/lb0 0 2024-04-03T08:39:16.070 INFO:tasks.workunit.client.1.smithi181.stdout:5/303: creat d4/f5e x:0 0 0 2024-04-03T08:39:16.072 INFO:tasks.workunit.client.0.smithi157.stdout:0/470: chown d2/d9/d5f/fa6 2009161 1 2024-04-03T08:39:16.072 INFO:tasks.workunit.client.0.smithi157.stdout:2/482: dwrite d3/f21 [4194304,4194304] 0 2024-04-03T08:39:16.080 INFO:tasks.workunit.client.0.smithi157.stdout:7/532: dread d0/d11/d15/d17/d43/fb7 [0,4194304] 0 2024-04-03T08:39:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:15 smithi181 ceph-mon[44183]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:15 smithi181 ceph-mon[44183]: Deploying cephadm binary to smithi157 2024-04-03T08:39:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:15 smithi181 ceph-mon[44183]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:15 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:16.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:15 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:16.101 INFO:tasks.workunit.client.0.smithi157.stdout:7/533: symlink d0/d11/d15/d17/d9f/daa/lbd 0 2024-04-03T08:39:16.102 INFO:tasks.workunit.client.0.smithi157.stdout:9/431: dwrite d1/d15/f50 [0,4194304] 0 2024-04-03T08:39:16.104 INFO:tasks.workunit.client.1.smithi181.stdout:3/305: dread d0/d5/f38 [0,4194304] 0 2024-04-03T08:39:16.105 INFO:tasks.workunit.client.0.smithi157.stdout:2/483: mkdir d3/d2e/d32/d9f/da7 0 2024-04-03T08:39:16.106 INFO:tasks.workunit.client.0.smithi157.stdout:1/446: dwrite d2/d11/f92 [0,4194304] 0 2024-04-03T08:39:16.108 INFO:tasks.workunit.client.0.smithi157.stdout:8/494: dwrite d2/f63 [4194304,4194304] 0 2024-04-03T08:39:16.109 INFO:tasks.workunit.client.1.smithi181.stdout:9/378: symlink d1/da/d28/d30/d3e/d4e/d62/l79 0 2024-04-03T08:39:16.111 INFO:tasks.workunit.client.1.smithi181.stdout:9/379: stat d1/da/d28/d30/d3e/c60 0 2024-04-03T08:39:16.113 INFO:tasks.workunit.client.1.smithi181.stdout:9/380: readlink d1/da/d1a/l6e 0 2024-04-03T08:39:16.114 INFO:tasks.workunit.client.1.smithi181.stdout:9/381: chown d1/da/d28/d30/d3e/d4e 224 1 2024-04-03T08:39:16.117 INFO:tasks.workunit.client.1.smithi181.stdout:9/382: readlink d1/da/d28/d30/l4d 0 2024-04-03T08:39:16.118 INFO:tasks.workunit.client.1.smithi181.stdout:1/287: truncate d10/d15/f18 667347 0 2024-04-03T08:39:16.118 INFO:tasks.workunit.client.0.smithi157.stdout:2/484: chown d3/d12/f7c 18753789 1 2024-04-03T08:39:16.119 INFO:tasks.workunit.client.0.smithi157.stdout:7/534: creat d0/d4/daf/fbe x:0 0 0 2024-04-03T08:39:16.119 INFO:tasks.workunit.client.0.smithi157.stdout:8/495: chown d2/d20/d23/f5c 20764 1 2024-04-03T08:39:16.120 INFO:tasks.workunit.client.1.smithi181.stdout:1/288: fdatasync d10/d15/d17/d19/f2f 0 2024-04-03T08:39:16.121 INFO:tasks.workunit.client.1.smithi181.stdout:6/314: fdatasync d6/d7/d9/d22/f3c 0 2024-04-03T08:39:16.122 INFO:tasks.workunit.client.0.smithi157.stdout:4/447: dwrite da/fc [4194304,4194304] 0 2024-04-03T08:39:16.122 INFO:tasks.workunit.client.0.smithi157.stdout:9/432: creat d1/d4a/d4d/f95 x:0 0 0 2024-04-03T08:39:16.125 INFO:tasks.workunit.client.1.smithi181.stdout:5/304: rename d4/d18/f4e to d4/d44/f5f 0 2024-04-03T08:39:16.129 INFO:tasks.workunit.client.1.smithi181.stdout:7/251: getdents d0/d1/d6/de/d17 0 2024-04-03T08:39:16.129 INFO:tasks.workunit.client.0.smithi157.stdout:7/535: write d0/d4/da5/fb2 [520798,66925] 0 2024-04-03T08:39:16.135 INFO:tasks.workunit.client.0.smithi157.stdout:0/471: dread d2/f37 [0,4194304] 0 2024-04-03T08:39:16.135 INFO:tasks.workunit.client.0.smithi157.stdout:4/448: write da/df/d24/d35/d6a/f77 [922094,55171] 0 2024-04-03T08:39:16.136 INFO:tasks.workunit.client.1.smithi181.stdout:0/294: link d5/dc/d10/f38 d5/d9/d60/f61 0 2024-04-03T08:39:16.138 INFO:tasks.workunit.client.1.smithi181.stdout:4/362: write d1/f6d [2827311,89684] 0 2024-04-03T08:39:16.139 INFO:tasks.workunit.client.0.smithi157.stdout:2/485: mknod d3/d2e/d32/ca8 0 2024-04-03T08:39:16.140 INFO:tasks.workunit.client.0.smithi157.stdout:0/472: chown d2/d9/dc/df/d6f/d9d/d6a/d91 0 1 2024-04-03T08:39:16.140 INFO:tasks.workunit.client.0.smithi157.stdout:1/447: creat d2/d11/d24/d39/d3b/d1b/d90/f93 x:0 0 0 2024-04-03T08:39:16.142 INFO:tasks.workunit.client.1.smithi181.stdout:2/339: getdents d13/d1c/d4a/d68/d72 0 2024-04-03T08:39:16.144 INFO:tasks.workunit.client.1.smithi181.stdout:2/340: dread - d13/d22/d40/f56 zero size 2024-04-03T08:39:16.149 INFO:tasks.workunit.client.1.smithi181.stdout:3/306: mkdir d0/d17/d36/d3b/d5a 0 2024-04-03T08:39:16.149 INFO:tasks.workunit.client.1.smithi181.stdout:0/295: dread d5/dc/d14/f22 [0,4194304] 0 2024-04-03T08:39:16.151 INFO:tasks.workunit.client.0.smithi157.stdout:8/496: dwrite d2/fb [8388608,4194304] 0 2024-04-03T08:39:16.158 INFO:tasks.workunit.client.0.smithi157.stdout:0/473: truncate d2/f25 933958 0 2024-04-03T08:39:16.161 INFO:tasks.workunit.client.0.smithi157.stdout:1/448: mkdir d2/d11/d24/d39/d3b/d2e/d48/d58/d94 0 2024-04-03T08:39:16.165 INFO:tasks.workunit.client.0.smithi157.stdout:4/449: mkdir da/df/d99 0 2024-04-03T08:39:16.168 INFO:tasks.workunit.client.1.smithi181.stdout:8/257: mkdir d4/d45/db/d14/d31/d1c/d51 0 2024-04-03T08:39:16.169 INFO:tasks.workunit.client.0.smithi157.stdout:0/474: mknod d2/d9/dc/df/d9b/cb1 0 2024-04-03T08:39:16.169 INFO:tasks.workunit.client.0.smithi157.stdout:1/449: chown d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/l8f 65752 1 2024-04-03T08:39:16.171 INFO:tasks.workunit.client.0.smithi157.stdout:9/433: dwrite d1/d36/f3b [0,4194304] 0 2024-04-03T08:39:16.172 INFO:tasks.workunit.client.0.smithi157.stdout:8/497: chown d2/d11/d10/d24/d5b/c1a 18399 1 2024-04-03T08:39:16.172 INFO:tasks.workunit.client.1.smithi181.stdout:2/341: mkdir d13/d22/d27/d46/d81 0 2024-04-03T08:39:16.175 INFO:tasks.workunit.client.0.smithi157.stdout:4/450: write da/df/d6b/f94 [221322,64908] 0 2024-04-03T08:39:16.175 INFO:tasks.workunit.client.0.smithi157.stdout:7/536: dread d0/d11/d15/d17/d1c/f4b [0,4194304] 0 2024-04-03T08:39:16.178 INFO:tasks.workunit.client.1.smithi181.stdout:6/315: creat d6/d7/d50/d5b/f65 x:0 0 0 2024-04-03T08:39:16.180 INFO:tasks.workunit.client.0.smithi157.stdout:1/450: read d2/d11/d24/d39/d3b/f59 [899291,105266] 0 2024-04-03T08:39:16.181 INFO:tasks.workunit.client.1.smithi181.stdout:5/305: unlink d4/d18/d2c/c2f 0 2024-04-03T08:39:16.182 INFO:tasks.workunit.client.0.smithi157.stdout:8/498: stat d2/d11/d10/d24/d5b/c13 0 2024-04-03T08:39:16.184 INFO:tasks.workunit.client.1.smithi181.stdout:4/363: creat d1/d1e/d2c/d67/f72 x:0 0 0 2024-04-03T08:39:16.186 INFO:tasks.workunit.client.0.smithi157.stdout:0/475: rename d2/d9/dc/df/d1b/d35/f97 to d2/d9/dc/df/d1b/fb2 0 2024-04-03T08:39:16.186 INFO:tasks.workunit.client.1.smithi181.stdout:8/258: dwrite d4/f27 [0,4194304] 0 2024-04-03T08:39:16.188 INFO:tasks.workunit.client.0.smithi157.stdout:0/476: dread - d2/d9/dc/d54/f8c zero size 2024-04-03T08:39:16.192 INFO:tasks.workunit.client.0.smithi157.stdout:8/499: rmdir d2 39 2024-04-03T08:39:16.194 INFO:tasks.workunit.client.1.smithi181.stdout:8/259: write d4/d45/db/d14/d31/d1c/f2c [5154329,3494] 0 2024-04-03T08:39:16.195 INFO:tasks.workunit.client.1.smithi181.stdout:5/306: creat d4/d22/d4a/f60 x:0 0 0 2024-04-03T08:39:16.196 INFO:tasks.workunit.client.0.smithi157.stdout:1/451: chown d2/d11/d24/c20 0 1 2024-04-03T08:39:16.198 INFO:tasks.workunit.client.1.smithi181.stdout:1/289: dread d10/d15/f18 [0,4194304] 0 2024-04-03T08:39:16.200 INFO:tasks.workunit.client.1.smithi181.stdout:3/307: dread d0/d5/fa [0,4194304] 0 2024-04-03T08:39:16.200 INFO:tasks.workunit.client.1.smithi181.stdout:5/307: write d4/d22/d4a/f5d [37514,6485] 0 2024-04-03T08:39:16.200 INFO:tasks.workunit.client.1.smithi181.stdout:2/342: link d13/d22/d27/d46/f49 d13/d1c/d4a/f82 0 2024-04-03T08:39:16.201 INFO:tasks.workunit.client.0.smithi157.stdout:9/434: link d1/d36/f81 d1/d94/f96 0 2024-04-03T08:39:16.201 INFO:tasks.workunit.client.1.smithi181.stdout:1/290: chown d10/f11 174778 1 2024-04-03T08:39:16.203 INFO:tasks.workunit.client.0.smithi157.stdout:4/451: creat da/df/d2f/d97/f9a x:0 0 0 2024-04-03T08:39:16.206 INFO:tasks.workunit.client.1.smithi181.stdout:4/364: dwrite d1/d1e/f1a [0,4194304] 0 2024-04-03T08:39:16.207 INFO:tasks.workunit.client.0.smithi157.stdout:0/477: creat d2/d9/dc/fb3 x:0 0 0 2024-04-03T08:39:16.209 INFO:tasks.workunit.client.1.smithi181.stdout:6/316: link d6/f58 d6/d7/d9/d22/d4f/f66 0 2024-04-03T08:39:16.209 INFO:tasks.workunit.client.0.smithi157.stdout:4/452: write da/df/d24/d35/f87 [370909,126448] 0 2024-04-03T08:39:16.215 INFO:tasks.workunit.client.1.smithi181.stdout:0/296: link d5/dc/d10/c54 d5/d9/d60/c62 0 2024-04-03T08:39:16.216 INFO:tasks.workunit.client.1.smithi181.stdout:2/343: dread f0 [0,4194304] 0 2024-04-03T08:39:16.220 INFO:tasks.workunit.client.1.smithi181.stdout:3/308: creat d0/d17/f5b x:0 0 0 2024-04-03T08:39:16.222 INFO:tasks.workunit.client.0.smithi157.stdout:6/512: sync 2024-04-03T08:39:16.222 INFO:tasks.workunit.client.0.smithi157.stdout:1/452: dread d2/d11/f92 [0,4194304] 0 2024-04-03T08:39:16.222 INFO:tasks.workunit.client.0.smithi157.stdout:6/513: chown d1/d5/d1b 826521720 1 2024-04-03T08:39:16.229 INFO:tasks.workunit.client.1.smithi181.stdout:4/365: creat d1/d1e/d2c/f73 x:0 0 0 2024-04-03T08:39:16.232 INFO:tasks.workunit.client.1.smithi181.stdout:9/383: dwrite d1/d34/f37 [0,4194304] 0 2024-04-03T08:39:16.234 INFO:tasks.workunit.client.1.smithi181.stdout:2/344: truncate f0 4407628 0 2024-04-03T08:39:16.234 INFO:tasks.workunit.client.0.smithi157.stdout:9/435: rename d1/d15/d27/c29 to d1/d4a/d4d/c97 0 2024-04-03T08:39:16.240 INFO:tasks.workunit.client.0.smithi157.stdout:7/537: getdents d0/d11/d15/d17/d43 0 2024-04-03T08:39:16.244 INFO:tasks.workunit.client.1.smithi181.stdout:1/291: rename d10/d15/d17/d30/c52 to d10/d15/d17/d37/c58 0 2024-04-03T08:39:16.245 INFO:tasks.workunit.client.1.smithi181.stdout:1/292: write d10/f16 [4117187,58594] 0 2024-04-03T08:39:16.248 INFO:tasks.workunit.client.0.smithi157.stdout:2/486: dwrite d3/d12/f11 [0,4194304] 0 2024-04-03T08:39:16.248 INFO:tasks.workunit.client.0.smithi157.stdout:4/453: dwrite da/df/d24/d35/d6a/f79 [0,4194304] 0 2024-04-03T08:39:16.250 INFO:tasks.workunit.client.1.smithi181.stdout:1/293: write d10/d15/d41/f44 [542950,9080] 0 2024-04-03T08:39:16.250 INFO:tasks.workunit.client.1.smithi181.stdout:9/384: dwrite d1/d34/d39/f50 [4194304,4194304] 0 2024-04-03T08:39:16.259 INFO:tasks.workunit.client.1.smithi181.stdout:4/366: symlink d1/d16/d37/l74 0 2024-04-03T08:39:16.263 INFO:tasks.workunit.client.1.smithi181.stdout:6/317: creat d6/d7/d50/d64/f67 x:0 0 0 2024-04-03T08:39:16.265 INFO:tasks.workunit.client.0.smithi157.stdout:8/500: dwrite d2/d11/d10/d24/d5b/d2e/d75/f76 [0,4194304] 0 2024-04-03T08:39:16.267 INFO:tasks.workunit.client.0.smithi157.stdout:9/436: read d1/d15/d16/f67 [792070,130711] 0 2024-04-03T08:39:16.268 INFO:tasks.workunit.client.0.smithi157.stdout:4/454: mknod da/df/d24/d35/d53/c9b 0 2024-04-03T08:39:16.270 INFO:tasks.workunit.client.1.smithi181.stdout:0/297: link d5/dc/d14/d29/f4d d5/dc/d14/d29/d46/f63 0 2024-04-03T08:39:16.274 INFO:tasks.workunit.client.0.smithi157.stdout:5/510: sync 2024-04-03T08:39:16.275 INFO:tasks.workunit.client.0.smithi157.stdout:3/446: sync 2024-04-03T08:39:16.275 INFO:tasks.workunit.client.0.smithi157.stdout:0/478: dread d2/d9/d36/d38/f83 [4194304,4194304] 0 2024-04-03T08:39:16.276 INFO:tasks.workunit.client.1.smithi181.stdout:8/260: dwrite d4/d45/db/f33 [0,4194304] 0 2024-04-03T08:39:16.279 INFO:tasks.workunit.client.1.smithi181.stdout:7/252: sync 2024-04-03T08:39:16.286 INFO:tasks.workunit.client.0.smithi157.stdout:7/538: rename d0/d4/l42 to d0/d11/d15/d17/d52/db6/lbf 0 2024-04-03T08:39:16.290 INFO:tasks.workunit.client.1.smithi181.stdout:4/367: dwrite d1/d1e/f1a [4194304,4194304] 0 2024-04-03T08:39:16.290 INFO:tasks.workunit.client.1.smithi181.stdout:5/308: link d4/d18/d25/f52 d4/d18/f61 0 2024-04-03T08:39:16.291 INFO:tasks.workunit.client.1.smithi181.stdout:7/253: truncate d0/d1/d6/de/f52 353282 0 2024-04-03T08:39:16.292 INFO:tasks.workunit.client.0.smithi157.stdout:8/501: symlink d2/d20/la7 0 2024-04-03T08:39:16.298 INFO:tasks.workunit.client.1.smithi181.stdout:2/345: symlink d13/d1c/l83 0 2024-04-03T08:39:16.298 INFO:tasks.workunit.client.1.smithi181.stdout:6/318: dwrite d6/d7/d9/f5c [0,4194304] 0 2024-04-03T08:39:16.305 INFO:tasks.workunit.client.0.smithi157.stdout:2/487: rename d3/db/d44/l67 to d3/db/d44/d4c/d5a/d88/la9 0 2024-04-03T08:39:16.309 INFO:tasks.workunit.client.0.smithi157.stdout:1/453: dwrite d2/d11/d24/f1c [0,4194304] 0 2024-04-03T08:39:16.312 INFO:tasks.workunit.client.0.smithi157.stdout:7/539: unlink d0/d4/c83 0 2024-04-03T08:39:16.312 INFO:tasks.workunit.client.0.smithi157.stdout:0/479: dwrite d2/d9/f57 [0,4194304] 0 2024-04-03T08:39:16.312 INFO:tasks.workunit.client.0.smithi157.stdout:3/447: dwrite d8/f2f [0,4194304] 0 2024-04-03T08:39:16.313 INFO:tasks.workunit.client.1.smithi181.stdout:1/294: dread d10/d15/d17/d23/d27/f2c [0,4194304] 0 2024-04-03T08:39:16.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:15 smithi157 ceph-mon[35083]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:16.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:15 smithi157 ceph-mon[35083]: Deploying cephadm binary to smithi157 2024-04-03T08:39:16.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:15 smithi157 ceph-mon[35083]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:16.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:15 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:16.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:15 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:16.315 INFO:tasks.workunit.client.1.smithi181.stdout:1/295: truncate d10/d15/d17/d30/f38 4575849 0 2024-04-03T08:39:16.317 INFO:tasks.workunit.client.0.smithi157.stdout:0/480: fsync d2/d9/d51/f7f 0 2024-04-03T08:39:16.319 INFO:tasks.workunit.client.0.smithi157.stdout:3/448: write d8/d1e/d2d/f54 [1077252,80033] 0 2024-04-03T08:39:16.319 INFO:tasks.workunit.client.0.smithi157.stdout:4/455: creat da/df/d24/d35/d53/d69/f9c x:0 0 0 2024-04-03T08:39:16.320 INFO:tasks.workunit.client.0.smithi157.stdout:8/502: dread - d2/d6f/f71 zero size 2024-04-03T08:39:16.322 INFO:tasks.workunit.client.0.smithi157.stdout:5/511: getdents dc/d29/d51 0 2024-04-03T08:39:16.333 INFO:tasks.workunit.client.1.smithi181.stdout:3/309: truncate d0/d5/d6/dd/d25/f4d 2347205 0 2024-04-03T08:39:16.336 INFO:tasks.workunit.client.1.smithi181.stdout:3/310: write d0/d5/d6/f1d [449207,77783] 0 2024-04-03T08:39:16.336 INFO:tasks.workunit.client.0.smithi157.stdout:2/488: fsync d3/d12/d43/d4b/f73 0 2024-04-03T08:39:16.340 INFO:tasks.workunit.client.0.smithi157.stdout:2/489: chown d3/d12/d43/d4b/l99 3 1 2024-04-03T08:39:16.342 INFO:tasks.workunit.client.1.smithi181.stdout:8/261: rename d4/d45/db/d14/d31/f34 to d4/d45/db/d14/d31/d1c/d51/f52 0 2024-04-03T08:39:16.342 INFO:tasks.workunit.client.1.smithi181.stdout:2/346: dread f0 [0,4194304] 0 2024-04-03T08:39:16.343 INFO:tasks.workunit.client.0.smithi157.stdout:7/540: dread - d0/d11/d15/d17/d1c/f5d zero size 2024-04-03T08:39:16.347 INFO:tasks.workunit.client.0.smithi157.stdout:7/541: dread - d0/d11/d15/d17/d1c/f5d zero size 2024-04-03T08:39:16.353 INFO:tasks.workunit.client.1.smithi181.stdout:9/385: link d1/da/d13/l1d d1/da/d28/l7a 0 2024-04-03T08:39:16.357 INFO:tasks.workunit.client.0.smithi157.stdout:1/454: read d2/d11/d24/d39/f61 [956101,127297] 0 2024-04-03T08:39:16.359 INFO:tasks.workunit.client.1.smithi181.stdout:6/319: creat d6/d3e/d40/d63/f68 x:0 0 0 2024-04-03T08:39:16.361 INFO:tasks.workunit.client.1.smithi181.stdout:6/320: write d6/d7/f20 [2655704,69830] 0 2024-04-03T08:39:16.362 INFO:tasks.workunit.client.0.smithi157.stdout:3/449: creat d8/d13/d1b/d4e/f99 x:0 0 0 2024-04-03T08:39:16.364 INFO:tasks.workunit.client.0.smithi157.stdout:9/437: dwrite d1/f42 [4194304,4194304] 0 2024-04-03T08:39:16.369 INFO:tasks.workunit.client.1.smithi181.stdout:3/311: rmdir d0/d17/d36/d3b 39 2024-04-03T08:39:16.371 INFO:tasks.workunit.client.0.smithi157.stdout:5/512: mknod dc/d29/d56/d52/d9d/cad 0 2024-04-03T08:39:16.373 INFO:tasks.workunit.client.0.smithi157.stdout:3/450: readlink d8/d1e/d2d/d3f/d4d/l86 0 2024-04-03T08:39:16.374 INFO:tasks.workunit.client.1.smithi181.stdout:0/298: dwrite d5/dc/f12 [0,4194304] 0 2024-04-03T08:39:16.376 INFO:tasks.workunit.client.0.smithi157.stdout:8/503: mknod d2/d11/d10/d24/d5b/d2e/d75/ca8 0 2024-04-03T08:39:16.377 INFO:tasks.workunit.client.1.smithi181.stdout:0/299: write d5/dc/d14/f3a [457519,25104] 0 2024-04-03T08:39:16.378 INFO:tasks.workunit.client.0.smithi157.stdout:5/513: chown dc/f85 463305 1 2024-04-03T08:39:16.382 INFO:tasks.workunit.client.0.smithi157.stdout:5/514: dread - dc/d29/d56/d52/f58 zero size 2024-04-03T08:39:16.384 INFO:tasks.workunit.client.1.smithi181.stdout:8/262: creat d4/d45/db/d14/d31/d1c/f53 x:0 0 0 2024-04-03T08:39:16.389 INFO:tasks.workunit.client.0.smithi157.stdout:7/542: symlink d0/d4/lc0 0 2024-04-03T08:39:16.397 INFO:tasks.workunit.client.0.smithi157.stdout:6/514: sync 2024-04-03T08:39:16.397 INFO:tasks.workunit.client.1.smithi181.stdout:3/312: rmdir d0/d17/d36/d1e 39 2024-04-03T08:39:16.398 INFO:tasks.workunit.client.0.smithi157.stdout:3/451: creat d8/d1e/d2d/d3f/d4d/f9a x:0 0 0 2024-04-03T08:39:16.401 INFO:tasks.workunit.client.0.smithi157.stdout:0/481: truncate d2/d9/dc/df/d1b/d35/f66 4698709 0 2024-04-03T08:39:16.402 INFO:tasks.workunit.client.1.smithi181.stdout:0/300: creat d5/d9/d2a/f64 x:0 0 0 2024-04-03T08:39:16.402 INFO:tasks.workunit.client.1.smithi181.stdout:5/309: dwrite d4/f3f [0,4194304] 0 2024-04-03T08:39:16.404 INFO:tasks.workunit.client.0.smithi157.stdout:8/504: mkdir d2/d11/d10/d24/d5b/d2e/d75/da9 0 2024-04-03T08:39:16.406 INFO:tasks.workunit.client.1.smithi181.stdout:7/254: rename d0/d1/d6/c30 to d0/c5c 0 2024-04-03T08:39:16.408 INFO:tasks.workunit.client.0.smithi157.stdout:5/515: read dc/d29/d56/d18/f63 [3068714,84408] 0 2024-04-03T08:39:16.411 INFO:tasks.workunit.client.0.smithi157.stdout:7/543: creat d0/d11/d15/d17/d43/d8a/d8f/fc1 x:0 0 0 2024-04-03T08:39:16.414 INFO:tasks.workunit.client.1.smithi181.stdout:5/310: symlink d4/d18/d3e/l62 0 2024-04-03T08:39:16.416 INFO:tasks.workunit.client.0.smithi157.stdout:9/438: rename d1/d15/d27/f51 to d1/d15/d16/f98 0 2024-04-03T08:39:16.417 INFO:tasks.workunit.client.1.smithi181.stdout:7/255: dread d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:16.418 INFO:tasks.workunit.client.1.smithi181.stdout:1/296: getdents d10 0 2024-04-03T08:39:16.420 INFO:tasks.workunit.client.1.smithi181.stdout:1/297: write d10/d15/d17/d19/f2f [1576668,89861] 0 2024-04-03T08:39:16.422 INFO:tasks.workunit.client.1.smithi181.stdout:9/386: write d1/da/d28/f6b [154741,47254] 0 2024-04-03T08:39:16.422 INFO:tasks.workunit.client.0.smithi157.stdout:6/515: dread d1/d5/d1b/f54 [0,4194304] 0 2024-04-03T08:39:16.422 INFO:tasks.workunit.client.0.smithi157.stdout:2/490: write d3/d12/fd [597266,22086] 0 2024-04-03T08:39:16.423 INFO:tasks.workunit.client.0.smithi157.stdout:1/455: dread d2/d11/d24/d39/f6f [0,4194304] 0 2024-04-03T08:39:16.424 INFO:tasks.workunit.client.1.smithi181.stdout:1/298: fsync d10/d15/d17/d19/f40 0 2024-04-03T08:39:16.425 INFO:tasks.workunit.client.1.smithi181.stdout:4/368: rename d1/d16/d24/d5e/f4a to d1/d16/d24/d5e/d31/f75 0 2024-04-03T08:39:16.426 INFO:tasks.workunit.client.0.smithi157.stdout:3/452: symlink d8/d1e/d2d/d39/d51/d48/l9b 0 2024-04-03T08:39:16.429 INFO:tasks.workunit.client.0.smithi157.stdout:0/482: rename d2/d9/dc/df/d1b/f94 to d2/d9/dc/df/d1b/fb4 0 2024-04-03T08:39:16.432 INFO:tasks.workunit.client.0.smithi157.stdout:8/505: creat d2/d11/d10/d24/d5b/d2e/d75/faa x:0 0 0 2024-04-03T08:39:16.432 INFO:tasks.workunit.client.0.smithi157.stdout:4/456: dwrite da/df/f57 [0,4194304] 0 2024-04-03T08:39:16.433 INFO:tasks.workunit.client.1.smithi181.stdout:7/256: creat d0/d1/d6/de/d17/d27/f5d x:0 0 0 2024-04-03T08:39:16.436 INFO:tasks.workunit.client.0.smithi157.stdout:5/516: creat dc/d29/d56/d49/d53/fae x:0 0 0 2024-04-03T08:39:16.442 INFO:tasks.workunit.client.0.smithi157.stdout:9/439: write d1/d15/d27/d5c/d79/f7c [3619491,95857] 0 2024-04-03T08:39:16.444 INFO:tasks.workunit.client.1.smithi181.stdout:8/263: creat d4/d45/db/d14/d31/f54 x:0 0 0 2024-04-03T08:39:16.444 INFO:tasks.workunit.client.0.smithi157.stdout:4/457: write da/f8b [1016871,22397] 0 2024-04-03T08:39:16.448 INFO:tasks.workunit.client.1.smithi181.stdout:9/387: mknod d1/da/d13/d41/c7b 0 2024-04-03T08:39:16.450 INFO:tasks.workunit.client.0.smithi157.stdout:2/491: rmdir d3 39 2024-04-03T08:39:16.451 INFO:tasks.workunit.client.1.smithi181.stdout:4/369: creat d1/d1e/d2c/d67/f76 x:0 0 0 2024-04-03T08:39:16.455 INFO:tasks.workunit.client.0.smithi157.stdout:1/456: creat d2/d11/d24/d39/d3b/d2e/d48/d58/d62/f95 x:0 0 0 2024-04-03T08:39:16.455 INFO:tasks.workunit.client.0.smithi157.stdout:8/506: creat d2/d6f/d70/fab x:0 0 0 2024-04-03T08:39:16.455 INFO:tasks.workunit.client.0.smithi157.stdout:0/483: mknod d2/d9/dc/df/d1b/cb5 0 2024-04-03T08:39:16.460 INFO:tasks.workunit.client.0.smithi157.stdout:6/516: creat d1/d5/d17/d29/da7/fb0 x:0 0 0 2024-04-03T08:39:16.460 INFO:tasks.workunit.client.1.smithi181.stdout:0/301: dread d5/dc/d14/d29/d46/f63 [0,4194304] 0 2024-04-03T08:39:16.463 INFO:tasks.workunit.client.0.smithi157.stdout:4/458: symlink da/df/d24/d58/l9d 0 2024-04-03T08:39:16.466 INFO:tasks.workunit.client.0.smithi157.stdout:4/459: chown da/df/d2f/d54/d5f 160 1 2024-04-03T08:39:16.467 INFO:tasks.workunit.client.1.smithi181.stdout:4/370: dwrite d1/f6d [0,4194304] 0 2024-04-03T08:39:16.471 INFO:tasks.workunit.client.0.smithi157.stdout:5/517: dwrite dc/d29/f57 [0,4194304] 0 2024-04-03T08:39:16.475 INFO:tasks.workunit.client.0.smithi157.stdout:5/518: stat dc/d35 0 2024-04-03T08:39:16.477 INFO:tasks.workunit.client.0.smithi157.stdout:1/457: dread d2/d11/d24/f1c [0,4194304] 0 2024-04-03T08:39:16.481 INFO:tasks.workunit.client.0.smithi157.stdout:3/453: link d8/f57 d8/d1e/d2d/d3b/d8c/f9c 0 2024-04-03T08:39:16.485 INFO:tasks.workunit.client.0.smithi157.stdout:8/507: symlink d2/d11/d10/d24/lac 0 2024-04-03T08:39:16.485 INFO:tasks.workunit.client.1.smithi181.stdout:3/313: sync 2024-04-03T08:39:16.487 INFO:tasks.workunit.client.1.smithi181.stdout:9/388: mkdir d1/d34/d39/d7c 0 2024-04-03T08:39:16.487 INFO:tasks.workunit.client.1.smithi181.stdout:3/314: fsync d0/d5/d6/f1d 0 2024-04-03T08:39:16.488 INFO:tasks.workunit.client.1.smithi181.stdout:4/371: dread d1/f32 [0,4194304] 0 2024-04-03T08:39:16.489 INFO:tasks.workunit.client.0.smithi157.stdout:0/484: creat d2/d9/dc/df/d6f/d9d/d6a/d91/dae/fb6 x:0 0 0 2024-04-03T08:39:16.492 INFO:tasks.workunit.client.0.smithi157.stdout:5/519: creat dc/d29/d56/d49/d7f/faf x:0 0 0 2024-04-03T08:39:16.496 INFO:tasks.workunit.client.0.smithi157.stdout:1/458: creat d2/f96 x:0 0 0 2024-04-03T08:39:16.497 INFO:tasks.workunit.client.1.smithi181.stdout:1/299: truncate d10/d15/d17/d19/f40 997990 0 2024-04-03T08:39:16.497 INFO:tasks.workunit.client.0.smithi157.stdout:6/517: mknod d1/d5/cb1 0 2024-04-03T08:39:16.499 INFO:tasks.workunit.client.0.smithi157.stdout:9/440: dwrite d1/d36/d46/f54 [4194304,4194304] 0 2024-04-03T08:39:16.502 INFO:tasks.workunit.client.0.smithi157.stdout:4/460: dwrite da/df/d24/d35/d53/d69/f9c [0,4194304] 0 2024-04-03T08:39:16.504 INFO:tasks.workunit.client.0.smithi157.stdout:0/485: truncate d2/d9/d51/d63/d71/f81 1127545 0 2024-04-03T08:39:16.505 INFO:tasks.workunit.client.1.smithi181.stdout:0/302: symlink d5/d9/d2e/l65 0 2024-04-03T08:39:16.506 INFO:tasks.workunit.client.0.smithi157.stdout:1/459: write d2/d11/d24/d39/d3b/f5c [1322037,92476] 0 2024-04-03T08:39:16.506 INFO:tasks.workunit.client.1.smithi181.stdout:0/303: chown d5/d9 1858 1 2024-04-03T08:39:16.510 INFO:tasks.workunit.client.1.smithi181.stdout:0/304: write d5/d9/d2a/f4f [729990,123121] 0 2024-04-03T08:39:16.512 INFO:tasks.workunit.client.0.smithi157.stdout:3/454: creat d8/d13/d1b/d7d/f9d x:0 0 0 2024-04-03T08:39:16.512 INFO:tasks.workunit.client.1.smithi181.stdout:2/347: rename f0 to d13/d22/f84 0 2024-04-03T08:39:16.513 INFO:tasks.workunit.client.0.smithi157.stdout:2/492: link d3/db/d44/f71 d3/db/d44/d4c/d5a/d88/d97/faa 0 2024-04-03T08:39:16.514 INFO:tasks.workunit.client.0.smithi157.stdout:8/508: dwrite d2/d11/d10/f48 [0,4194304] 0 2024-04-03T08:39:16.514 INFO:tasks.workunit.client.1.smithi181.stdout:1/300: dwrite d10/d15/d17/d19/f3e [0,4194304] 0 2024-04-03T08:39:16.517 INFO:tasks.workunit.client.1.smithi181.stdout:1/301: dread - d10/d15/d17/d37/f54 zero size 2024-04-03T08:39:16.518 INFO:tasks.workunit.client.0.smithi157.stdout:8/509: chown d2/d11/d10/d24/d5b/c13 1022288 1 2024-04-03T08:39:16.520 INFO:tasks.workunit.client.0.smithi157.stdout:8/510: write d2/d11/d10/d24/f54 [2010980,110530] 0 2024-04-03T08:39:16.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/511: chown d2/d11/d10/d24/d5b/d2e/d75/f76 22619 1 2024-04-03T08:39:16.524 INFO:tasks.workunit.client.1.smithi181.stdout:7/257: creat d0/d1/d6/de/f5e x:0 0 0 2024-04-03T08:39:16.526 INFO:tasks.workunit.client.0.smithi157.stdout:8/512: dread - d2/d11/d10/d24/d5b/d53/f79 zero size 2024-04-03T08:39:16.527 INFO:tasks.workunit.client.0.smithi157.stdout:4/461: rmdir da 39 2024-04-03T08:39:16.531 INFO:tasks.workunit.client.0.smithi157.stdout:0/486: rmdir d2/d9/d51/d63/d71 39 2024-04-03T08:39:16.535 INFO:tasks.workunit.client.0.smithi157.stdout:2/493: unlink d3/db/d44/f5b 0 2024-04-03T08:39:16.538 INFO:tasks.workunit.client.0.smithi157.stdout:6/518: dwrite d1/d5/d17/f56 [0,4194304] 0 2024-04-03T08:39:16.538 INFO:tasks.workunit.client.0.smithi157.stdout:3/455: mkdir d8/d1e/d2d/d3b/d9e 0 2024-04-03T08:39:16.549 INFO:tasks.workunit.client.0.smithi157.stdout:1/460: mkdir d2/d11/d24/d39/d3b/d2e/d66/d91/d97 0 2024-04-03T08:39:16.549 INFO:tasks.workunit.client.0.smithi157.stdout:3/456: stat d8/d1e/d2d/d39/d51/d48/f5c 0 2024-04-03T08:39:16.554 INFO:tasks.workunit.client.1.smithi181.stdout:0/305: dread d5/dc/d14/f55 [0,4194304] 0 2024-04-03T08:39:16.555 INFO:tasks.workunit.client.1.smithi181.stdout:0/306: dread - d5/d9/d2e/f39 zero size 2024-04-03T08:39:16.558 INFO:tasks.workunit.client.0.smithi157.stdout:5/520: creat dc/d29/d56/fb0 x:0 0 0 2024-04-03T08:39:16.566 INFO:tasks.workunit.client.1.smithi181.stdout:0/307: dread d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:16.567 INFO:tasks.workunit.client.0.smithi157.stdout:0/487: unlink d2/d9/dc/df/d6f/d9d/l84 0 2024-04-03T08:39:16.568 INFO:tasks.workunit.client.1.smithi181.stdout:2/348: mkdir d13/d22/d85 0 2024-04-03T08:39:16.569 INFO:tasks.workunit.client.1.smithi181.stdout:2/349: readlink d13/l32 0 2024-04-03T08:39:16.570 INFO:tasks.workunit.client.0.smithi157.stdout:4/462: dwrite da/d26/f3d [0,4194304] 0 2024-04-03T08:39:16.570 INFO:tasks.workunit.client.0.smithi157.stdout:0/488: fdatasync d2/d9/dc/df/d1b/f8b 0 2024-04-03T08:39:16.571 INFO:tasks.workunit.client.1.smithi181.stdout:2/350: write d13/d1c/f63 [2375379,57397] 0 2024-04-03T08:39:16.572 INFO:tasks.workunit.client.1.smithi181.stdout:2/351: chown d13/d1c/d4a 2309 1 2024-04-03T08:39:16.574 INFO:tasks.workunit.client.0.smithi157.stdout:6/519: unlink d1/d4b/f45 0 2024-04-03T08:39:16.574 INFO:tasks.workunit.client.1.smithi181.stdout:8/264: truncate d4/d45/db/f3a 4831101 0 2024-04-03T08:39:16.576 INFO:tasks.workunit.client.0.smithi157.stdout:1/461: chown d2/d11/d24/d39/d3b/d2e/d48/d58/c65 486193 1 2024-04-03T08:39:16.577 INFO:tasks.workunit.client.1.smithi181.stdout:1/302: symlink d10/d15/d17/d19/d4c/l59 0 2024-04-03T08:39:16.577 INFO:tasks.workunit.client.1.smithi181.stdout:1/303: fdatasync d10/f16 0 2024-04-03T08:39:16.580 INFO:tasks.workunit.client.1.smithi181.stdout:1/304: dread - d10/d15/d4b/f50 zero size 2024-04-03T08:39:16.582 INFO:tasks.workunit.client.1.smithi181.stdout:1/305: write d10/f22 [3683493,3233] 0 2024-04-03T08:39:16.588 INFO:tasks.workunit.client.0.smithi157.stdout:2/494: mkdir d3/dab 0 2024-04-03T08:39:16.590 INFO:tasks.workunit.client.1.smithi181.stdout:9/389: getdents d1/da/d13/d22 0 2024-04-03T08:39:16.590 INFO:tasks.workunit.client.0.smithi157.stdout:2/495: chown d3/d12/d43/c60 366 1 2024-04-03T08:39:16.595 INFO:tasks.workunit.client.1.smithi181.stdout:6/321: rename d6/d7/d9/l16 to d6/d7/l69 0 2024-04-03T08:39:16.596 INFO:tasks.workunit.client.1.smithi181.stdout:6/322: chown d6/f58 27356860 1 2024-04-03T08:39:16.598 INFO:tasks.workunit.client.1.smithi181.stdout:6/323: write d6/d31/f4d [444559,86438] 0 2024-04-03T08:39:16.598 INFO:tasks.workunit.client.0.smithi157.stdout:4/463: mknod da/df/d2f/d64/c9e 0 2024-04-03T08:39:16.600 INFO:tasks.workunit.client.1.smithi181.stdout:8/265: rmdir d4/d45/db/d14 39 2024-04-03T08:39:16.606 INFO:tasks.workunit.client.1.smithi181.stdout:7/258: truncate d0/d1/d6/de/d17/d27/f49 3507934 0 2024-04-03T08:39:16.609 INFO:tasks.workunit.client.0.smithi157.stdout:8/513: truncate d2/d11/d10/d24/d5b/d2e/f64 3886280 0 2024-04-03T08:39:16.610 INFO:tasks.workunit.client.1.smithi181.stdout:4/372: getdents d1/d16/d24/d5e 0 2024-04-03T08:39:16.611 INFO:tasks.workunit.client.0.smithi157.stdout:6/520: dread d1/d5/d17/d2a/d37/f3b [0,4194304] 0 2024-04-03T08:39:16.611 INFO:tasks.workunit.client.0.smithi157.stdout:8/514: dread - d2/d6f/d70/f7e zero size 2024-04-03T08:39:16.612 INFO:tasks.workunit.client.0.smithi157.stdout:3/457: creat d8/d13/d1b/d5b/d7f/f9f x:0 0 0 2024-04-03T08:39:16.613 INFO:tasks.workunit.client.1.smithi181.stdout:6/324: dwrite d6/d31/d36/f4c [0,4194304] 0 2024-04-03T08:39:16.613 INFO:tasks.workunit.client.1.smithi181.stdout:1/306: unlink d10/d15/f18 0 2024-04-03T08:39:16.614 INFO:tasks.workunit.client.0.smithi157.stdout:8/515: fdatasync d2/d11/f51 0 2024-04-03T08:39:16.618 INFO:tasks.workunit.client.1.smithi181.stdout:8/266: dwrite d4/d45/db/f4c [0,4194304] 0 2024-04-03T08:39:16.620 INFO:tasks.workunit.client.0.smithi157.stdout:2/496: creat d3/d2e/d65/fac x:0 0 0 2024-04-03T08:39:16.629 INFO:tasks.workunit.client.1.smithi181.stdout:7/259: write d0/f3b [1841443,50170] 0 2024-04-03T08:39:16.633 INFO:tasks.workunit.client.1.smithi181.stdout:4/373: creat d1/d1e/d2c/f77 x:0 0 0 2024-04-03T08:39:16.633 INFO:tasks.workunit.client.1.smithi181.stdout:1/307: creat d10/d15/d17/d30/f5a x:0 0 0 2024-04-03T08:39:16.638 INFO:tasks.workunit.client.0.smithi157.stdout:1/462: creat d2/d11/f98 x:0 0 0 2024-04-03T08:39:16.639 INFO:tasks.workunit.client.1.smithi181.stdout:2/352: link d13/d1c/f5a d13/d1c/d4a/d68/f86 0 2024-04-03T08:39:16.639 INFO:tasks.workunit.client.1.smithi181.stdout:7/260: mknod d0/d1/c5f 0 2024-04-03T08:39:16.639 INFO:tasks.workunit.client.1.smithi181.stdout:2/353: chown d13/f19 46125 1 2024-04-03T08:39:16.641 INFO:tasks.workunit.client.0.smithi157.stdout:5/521: getdents dc/d35 0 2024-04-03T08:39:16.642 INFO:tasks.workunit.client.0.smithi157.stdout:0/489: dwrite d2/d9/d36/d38/f83 [8388608,4194304] 0 2024-04-03T08:39:16.643 INFO:tasks.workunit.client.0.smithi157.stdout:3/458: dwrite d8/d1e/d2d/d39/f5f [0,4194304] 0 2024-04-03T08:39:16.645 INFO:tasks.workunit.client.1.smithi181.stdout:4/374: mkdir d1/d1e/d78 0 2024-04-03T08:39:16.646 INFO:tasks.workunit.client.0.smithi157.stdout:5/522: dread - dc/d29/d56/d52/f58 zero size 2024-04-03T08:39:16.647 INFO:tasks.workunit.client.0.smithi157.stdout:3/459: stat d8/d1e/d2d/d3b/c94 0 2024-04-03T08:39:16.649 INFO:tasks.workunit.client.1.smithi181.stdout:4/375: truncate d1/d1e/d2c/f77 850723 0 2024-04-03T08:39:16.649 INFO:tasks.workunit.client.0.smithi157.stdout:0/490: dread - d2/d9/dc/df/d1b/fb4 zero size 2024-04-03T08:39:16.656 INFO:tasks.workunit.client.1.smithi181.stdout:9/390: write d1/da/d13/d41/f1b [505443,97893] 0 2024-04-03T08:39:16.656 INFO:tasks.workunit.client.1.smithi181.stdout:4/376: write d1/d16/d24/f47 [748106,17961] 0 2024-04-03T08:39:16.658 INFO:tasks.workunit.client.1.smithi181.stdout:5/311: rename d4/f8 to d4/d22/f63 0 2024-04-03T08:39:16.662 INFO:tasks.workunit.client.1.smithi181.stdout:4/377: chown d1/d16/d24/d5e/f50 66 1 2024-04-03T08:39:16.667 INFO:tasks.workunit.client.0.smithi157.stdout:7/544: sync 2024-04-03T08:39:16.667 INFO:tasks.workunit.client.1.smithi181.stdout:8/267: symlink d4/d45/l55 0 2024-04-03T08:39:16.669 INFO:tasks.workunit.client.0.smithi157.stdout:6/521: write d1/d4b/d38/f4c [1009285,127524] 0 2024-04-03T08:39:16.670 INFO:tasks.workunit.client.0.smithi157.stdout:4/464: truncate da/df/d2f/d64/f81 223448 0 2024-04-03T08:39:16.670 INFO:tasks.workunit.client.1.smithi181.stdout:1/308: dwrite d10/d15/d17/d23/d27/f2c [4194304,4194304] 0 2024-04-03T08:39:16.670 INFO:tasks.workunit.client.1.smithi181.stdout:4/378: truncate d1/d16/d24/d5e/d2b/d56/f71 848811 0 2024-04-03T08:39:16.673 INFO:tasks.workunit.client.0.smithi157.stdout:6/522: fdatasync d1/d5/f18 0 2024-04-03T08:39:16.673 INFO:tasks.workunit.client.1.smithi181.stdout:4/379: fsync d1/d16/d55/f6e 0 2024-04-03T08:39:16.674 INFO:tasks.workunit.client.0.smithi157.stdout:8/516: rename d2/d11/d10/d24/d5b/d2e/f9a to d2/fad 0 2024-04-03T08:39:16.675 INFO:tasks.workunit.client.1.smithi181.stdout:1/309: truncate d10/d15/d41/f44 1397045 0 2024-04-03T08:39:16.677 INFO:tasks.workunit.client.1.smithi181.stdout:9/391: dwrite d1/da/d13/d22/d23/f5e [4194304,4194304] 0 2024-04-03T08:39:16.678 INFO:tasks.workunit.client.0.smithi157.stdout:6/523: write d1/d5/d17/d29/faf [850201,65642] 0 2024-04-03T08:39:16.678 INFO:tasks.workunit.client.0.smithi157.stdout:8/517: write d2/d11/d10/d24/d5b/d53/f8a [1018748,60062] 0 2024-04-03T08:39:16.686 INFO:tasks.workunit.client.0.smithi157.stdout:6/524: dread d1/d5/d17/d2a/d37/f3b [0,4194304] 0 2024-04-03T08:39:16.689 INFO:tasks.workunit.client.0.smithi157.stdout:2/497: creat d3/fad x:0 0 0 2024-04-03T08:39:16.689 INFO:tasks.workunit.client.0.smithi157.stdout:0/491: write d2/d9/d51/d63/d71/f81 [2100391,66474] 0 2024-04-03T08:39:16.690 INFO:tasks.workunit.client.1.smithi181.stdout:3/315: rename d0/d17/d36/d1e/l20 to d0/d5/d6/d3f/l5c 0 2024-04-03T08:39:16.690 INFO:tasks.workunit.client.0.smithi157.stdout:9/441: sync 2024-04-03T08:39:16.691 INFO:tasks.workunit.client.0.smithi157.stdout:6/525: chown d1/d4b/d38/d59/f9b 23 1 2024-04-03T08:39:16.695 INFO:tasks.workunit.client.0.smithi157.stdout:9/442: fdatasync d1/f93 0 2024-04-03T08:39:16.697 INFO:tasks.workunit.client.1.smithi181.stdout:8/268: fdatasync d4/d45/db/d14/f50 0 2024-04-03T08:39:16.705 INFO:tasks.workunit.client.1.smithi181.stdout:1/310: unlink d10/d15/d17/d23/d27/f2c 0 2024-04-03T08:39:16.706 INFO:tasks.workunit.client.1.smithi181.stdout:1/311: fsync d10/f16 0 2024-04-03T08:39:16.707 INFO:tasks.workunit.client.0.smithi157.stdout:6/526: dread d1/d5/f46 [0,4194304] 0 2024-04-03T08:39:16.708 INFO:tasks.workunit.client.1.smithi181.stdout:1/312: write d10/d15/f34 [2450497,102771] 0 2024-04-03T08:39:16.711 INFO:tasks.workunit.client.0.smithi157.stdout:6/527: fdatasync d1/d4b/d61/f91 0 2024-04-03T08:39:16.713 INFO:tasks.workunit.client.1.smithi181.stdout:8/269: dwrite d4/d45/db/d14/f20 [4194304,4194304] 0 2024-04-03T08:39:16.713 INFO:tasks.workunit.client.0.smithi157.stdout:0/492: dwrite d2/d9/d5f/d85/f86 [4194304,4194304] 0 2024-04-03T08:39:16.720 INFO:tasks.workunit.client.1.smithi181.stdout:7/261: unlink d0/d1/f3 0 2024-04-03T08:39:16.735 INFO:tasks.workunit.client.1.smithi181.stdout:1/313: unlink d10/d15/d17/d30/f5a 0 2024-04-03T08:39:16.740 INFO:tasks.workunit.client.1.smithi181.stdout:5/312: link d4/d18/d3e/l51 d4/d18/d25/l64 0 2024-04-03T08:39:16.749 INFO:tasks.workunit.client.1.smithi181.stdout:0/308: rename d5/dc/d10/d30/c4c to d5/dc/c66 0 2024-04-03T08:39:16.750 INFO:tasks.workunit.client.1.smithi181.stdout:8/270: getdents d4/d44 0 2024-04-03T08:39:16.753 INFO:tasks.workunit.client.1.smithi181.stdout:7/262: unlink d0/d1/f39 0 2024-04-03T08:39:16.755 INFO:tasks.workunit.client.1.smithi181.stdout:4/380: getdents d1/d1e/d2c 0 2024-04-03T08:39:16.755 INFO:tasks.workunit.client.1.smithi181.stdout:2/354: link d13/d22/d27/d2f/c3f d13/d1c/c87 0 2024-04-03T08:39:16.756 INFO:tasks.workunit.client.1.smithi181.stdout:2/355: stat d13/d1c/c2b 0 2024-04-03T08:39:16.759 INFO:tasks.workunit.client.1.smithi181.stdout:0/309: creat d5/d9/d2a/f67 x:0 0 0 2024-04-03T08:39:16.761 INFO:tasks.workunit.client.1.smithi181.stdout:0/310: chown d5/dc/d14/d29/f47 196760 1 2024-04-03T08:39:16.762 INFO:tasks.workunit.client.0.smithi157.stdout:5/523: unlink dc/d29/d56/f4d 0 2024-04-03T08:39:16.765 INFO:tasks.workunit.client.1.smithi181.stdout:4/381: mknod d1/d16/d24/d5e/d31/c79 0 2024-04-03T08:39:16.766 INFO:tasks.workunit.client.0.smithi157.stdout:8/518: write d2/d11/f93 [230822,7726] 0 2024-04-03T08:39:16.767 INFO:tasks.workunit.client.1.smithi181.stdout:4/382: chown d1/d16/d24/d5e/f45 66159 1 2024-04-03T08:39:16.767 INFO:tasks.workunit.client.1.smithi181.stdout:5/313: dwrite d4/f39 [0,4194304] 0 2024-04-03T08:39:16.769 INFO:tasks.workunit.client.1.smithi181.stdout:1/314: rmdir d10/d15/d17/d23/d57 0 2024-04-03T08:39:16.772 INFO:tasks.workunit.client.0.smithi157.stdout:3/460: symlink d8/d1e/d2d/d3b/d9e/la0 0 2024-04-03T08:39:16.773 INFO:tasks.workunit.client.1.smithi181.stdout:2/356: creat d13/d22/d27/d46/f88 x:0 0 0 2024-04-03T08:39:16.774 INFO:tasks.workunit.client.1.smithi181.stdout:2/357: read - d13/d22/d40/f6a zero size 2024-04-03T08:39:16.775 INFO:tasks.workunit.client.1.smithi181.stdout:6/325: rename d6/d7/d9/f21 to d6/d7/d50/d5b/f6a 0 2024-04-03T08:39:16.776 INFO:tasks.workunit.client.1.smithi181.stdout:4/383: dread d1/d1e/f5b [0,4194304] 0 2024-04-03T08:39:16.779 INFO:tasks.workunit.client.1.smithi181.stdout:4/384: truncate d1/d16/d24/d5e/d31/f75 1247903 0 2024-04-03T08:39:16.780 INFO:tasks.workunit.client.0.smithi157.stdout:2/498: mkdir d3/d2e/d65/dae 0 2024-04-03T08:39:16.780 INFO:tasks.workunit.client.1.smithi181.stdout:4/385: chown d1/d16/d24/c38 7718297 1 2024-04-03T08:39:16.782 INFO:tasks.workunit.client.1.smithi181.stdout:4/386: chown d1/d16/c22 475 1 2024-04-03T08:39:16.785 INFO:tasks.workunit.client.0.smithi157.stdout:9/443: fdatasync d1/d15/d27/f55 0 2024-04-03T08:39:16.787 INFO:tasks.workunit.client.0.smithi157.stdout:0/493: symlink d2/d9/dc/df/d1b/d35/d3d/lb7 0 2024-04-03T08:39:16.788 INFO:tasks.workunit.client.0.smithi157.stdout:9/444: read d1/fe [870160,109727] 0 2024-04-03T08:39:16.791 INFO:tasks.workunit.client.0.smithi157.stdout:8/519: dwrite d2/d11/d10/d24/fa1 [0,4194304] 0 2024-04-03T08:39:16.795 INFO:tasks.workunit.client.0.smithi157.stdout:4/465: mknod da/df/d99/c9f 0 2024-04-03T08:39:16.802 INFO:tasks.workunit.client.0.smithi157.stdout:5/524: symlink dc/d29/d56/d52/lb1 0 2024-04-03T08:39:16.804 INFO:tasks.workunit.client.0.smithi157.stdout:3/461: truncate d8/d1e/d2d/d39/d51/d4c/f29 2677320 0 2024-04-03T08:39:16.810 INFO:tasks.workunit.client.0.smithi157.stdout:0/494: readlink d2/d9/dc/df/d6f/l95 0 2024-04-03T08:39:16.811 INFO:tasks.workunit.client.0.smithi157.stdout:1/463: link d2/d11/d24/ld d2/d11/d24/d39/d3b/d2e/l99 0 2024-04-03T08:39:16.812 INFO:tasks.workunit.client.0.smithi157.stdout:8/520: dwrite d2/d11/d10/d24/d5b/d53/f8a [0,4194304] 0 2024-04-03T08:39:16.815 INFO:tasks.workunit.client.1.smithi181.stdout:0/311: mkdir d5/dc/d10/d30/d68 0 2024-04-03T08:39:16.816 INFO:tasks.workunit.client.0.smithi157.stdout:7/545: link d0/d11/d6f/d76/da7/f92 d0/d11/d15/d17/d43/d8a/fc2 0 2024-04-03T08:39:16.816 INFO:tasks.workunit.client.1.smithi181.stdout:5/314: dwrite d4/d18/d2c/f40 [0,4194304] 0 2024-04-03T08:39:16.817 INFO:tasks.workunit.client.1.smithi181.stdout:9/392: rename d1/da/f11 to d1/da/d13/d73/f7d 0 2024-04-03T08:39:16.818 INFO:tasks.workunit.client.0.smithi157.stdout:5/525: fdatasync dc/d29/d51/f64 0 2024-04-03T08:39:16.819 INFO:tasks.workunit.client.0.smithi157.stdout:2/499: link d3/d2e/f83 d3/d2e/d65/dae/faf 0 2024-04-03T08:39:16.823 INFO:tasks.workunit.client.1.smithi181.stdout:8/271: creat d4/d45/db/f56 x:0 0 0 2024-04-03T08:39:16.823 INFO:tasks.workunit.client.0.smithi157.stdout:3/462: rmdir d8/d1e/d2d/d39 39 2024-04-03T08:39:16.826 INFO:tasks.workunit.client.0.smithi157.stdout:6/528: link d1/c39 d1/d5/d17/d29/d62/cb2 0 2024-04-03T08:39:16.826 INFO:tasks.workunit.client.1.smithi181.stdout:5/315: write d4/d18/d25/f41 [609005,59067] 0 2024-04-03T08:39:16.828 INFO:tasks.workunit.client.1.smithi181.stdout:5/316: read d4/d18/f28 [3506977,15913] 0 2024-04-03T08:39:16.830 INFO:tasks.workunit.client.1.smithi181.stdout:5/317: write d4/d18/d25/f41 [2861626,66656] 0 2024-04-03T08:39:16.832 INFO:tasks.workunit.client.1.smithi181.stdout:4/387: mknod d1/d16/d24/d5e/c7a 0 2024-04-03T08:39:16.833 INFO:tasks.workunit.client.0.smithi157.stdout:0/495: readlink d2/d9/dc/l77 0 2024-04-03T08:39:16.837 INFO:tasks.workunit.client.0.smithi157.stdout:0/496: write d2/d9/d51/f61 [1022595,47311] 0 2024-04-03T08:39:16.839 INFO:tasks.workunit.client.1.smithi181.stdout:0/312: creat d5/d9/d2c/f69 x:0 0 0 2024-04-03T08:39:16.840 INFO:tasks.workunit.client.1.smithi181.stdout:5/318: dread d4/d44/f5f [0,4194304] 0 2024-04-03T08:39:16.840 INFO:tasks.workunit.client.0.smithi157.stdout:1/464: truncate d2/f3 1855927 0 2024-04-03T08:39:16.842 INFO:tasks.workunit.client.0.smithi157.stdout:0/497: write d2/d9/dc/df/d1b/d35/f9e [582240,110994] 0 2024-04-03T08:39:16.842 INFO:tasks.workunit.client.1.smithi181.stdout:7/263: getdents d0 0 2024-04-03T08:39:16.843 INFO:tasks.workunit.client.0.smithi157.stdout:8/521: fsync d2/d20/d23/f30 0 2024-04-03T08:39:16.847 INFO:tasks.workunit.client.1.smithi181.stdout:4/388: dread d1/f6d [0,4194304] 0 2024-04-03T08:39:16.848 INFO:tasks.workunit.client.1.smithi181.stdout:3/316: rename d0/d5/c4e to d0/d5/d6/d32/d43/c5d 0 2024-04-03T08:39:16.850 INFO:tasks.workunit.client.1.smithi181.stdout:4/389: write d1/d16/d55/f62 [631655,43473] 0 2024-04-03T08:39:16.850 INFO:tasks.workunit.client.0.smithi157.stdout:7/546: creat d0/d11/d15/d17/d1c/d4f/d5f/fc3 x:0 0 0 2024-04-03T08:39:16.854 INFO:tasks.workunit.client.1.smithi181.stdout:9/393: mkdir d1/da/d13/d73/d7e 0 2024-04-03T08:39:16.856 INFO:tasks.workunit.client.1.smithi181.stdout:0/313: dread d5/dc/f12 [0,4194304] 0 2024-04-03T08:39:16.857 INFO:tasks.workunit.client.1.smithi181.stdout:0/314: dread - d5/d9/d60/f61 zero size 2024-04-03T08:39:16.858 INFO:tasks.workunit.client.0.smithi157.stdout:2/500: dread - d3/f84 zero size 2024-04-03T08:39:16.862 INFO:tasks.workunit.client.1.smithi181.stdout:0/315: write d5/dc/d14/f3a [720760,111449] 0 2024-04-03T08:39:16.864 INFO:tasks.workunit.client.1.smithi181.stdout:2/358: link d13/d22/d27/d46/f49 d13/d1c/d4a/d7f/f89 0 2024-04-03T08:39:16.865 INFO:tasks.workunit.client.1.smithi181.stdout:3/317: dwrite d0/d17/d36/f45 [0,4194304] 0 2024-04-03T08:39:16.867 INFO:tasks.workunit.client.0.smithi157.stdout:4/466: link f4 da/df/d2f/d54/fa0 0 2024-04-03T08:39:16.870 INFO:tasks.workunit.client.0.smithi157.stdout:1/465: mkdir d2/d11/d24/d39/d3b/d2e/d48/d5d/d9a 0 2024-04-03T08:39:16.874 INFO:tasks.workunit.client.1.smithi181.stdout:5/319: dread d4/d18/d2c/f2e [0,4194304] 0 2024-04-03T08:39:16.877 INFO:tasks.workunit.client.1.smithi181.stdout:9/394: fsync d1/f6 0 2024-04-03T08:39:16.878 INFO:tasks.workunit.client.0.smithi157.stdout:8/522: creat d2/d7b/fae x:0 0 0 2024-04-03T08:39:16.880 INFO:tasks.workunit.client.1.smithi181.stdout:8/272: mknod d4/d45/db/c57 0 2024-04-03T08:39:16.882 INFO:tasks.workunit.client.0.smithi157.stdout:8/523: chown d2/d11/d10/d24/d5b/ca0 166448 1 2024-04-03T08:39:16.885 INFO:tasks.workunit.client.0.smithi157.stdout:8/524: fsync d2/d11/d10/d24/d5b/d2e/f3f 0 2024-04-03T08:39:16.888 INFO:tasks.workunit.client.0.smithi157.stdout:9/445: getdents d1/d36/d69 0 2024-04-03T08:39:16.890 INFO:tasks.workunit.client.1.smithi181.stdout:7/264: dwrite d0/d1/d6/f4d [0,4194304] 0 2024-04-03T08:39:16.893 INFO:tasks.workunit.client.0.smithi157.stdout:6/529: creat d1/d4b/d38/da6/fb3 x:0 0 0 2024-04-03T08:39:16.896 INFO:tasks.workunit.client.0.smithi157.stdout:6/530: chown d1/d4b/d38/l5f 32646 1 2024-04-03T08:39:16.896 INFO:tasks.workunit.client.1.smithi181.stdout:2/359: dread d13/d22/d27/f62 [0,4194304] 0 2024-04-03T08:39:16.898 INFO:tasks.workunit.client.0.smithi157.stdout:4/467: unlink l2 0 2024-04-03T08:39:16.898 INFO:tasks.workunit.client.1.smithi181.stdout:2/360: chown d13/d22/d27/c3e 1565 1 2024-04-03T08:39:16.899 INFO:tasks.workunit.client.0.smithi157.stdout:5/526: write dc/d29/d56/f28 [4972084,32849] 0 2024-04-03T08:39:16.904 INFO:tasks.workunit.client.1.smithi181.stdout:6/326: sync 2024-04-03T08:39:16.904 INFO:tasks.workunit.client.1.smithi181.stdout:1/315: sync 2024-04-03T08:39:16.905 INFO:tasks.workunit.client.1.smithi181.stdout:6/327: chown d6/d7/l2c 3757 1 2024-04-03T08:39:16.906 INFO:tasks.workunit.client.0.smithi157.stdout:0/498: creat d2/d9/dc/df/d1b/d4a/d31/d93/fb8 x:0 0 0 2024-04-03T08:39:16.906 INFO:tasks.workunit.client.1.smithi181.stdout:3/318: fsync d0/d5/d6/f39 0 2024-04-03T08:39:16.907 INFO:tasks.workunit.client.0.smithi157.stdout:8/525: unlink d2/d20/d23/f30 0 2024-04-03T08:39:16.908 INFO:tasks.workunit.client.1.smithi181.stdout:9/395: fdatasync d1/f20 0 2024-04-03T08:39:16.908 INFO:tasks.workunit.client.0.smithi157.stdout:3/463: dread d8/d13/f1a [0,4194304] 0 2024-04-03T08:39:16.911 INFO:tasks.workunit.client.0.smithi157.stdout:9/446: rename d1/d36/f87 to d1/d15/d27/d5c/d79/f99 0 2024-04-03T08:39:16.918 INFO:tasks.workunit.client.0.smithi157.stdout:8/526: truncate d2/d11/d10/d24/d5b/d2e/d75/f85 516404 0 2024-04-03T08:39:16.921 INFO:tasks.workunit.client.1.smithi181.stdout:3/319: dwrite d0/d5/d6/dd/f21 [0,4194304] 0 2024-04-03T08:39:16.923 INFO:tasks.workunit.client.1.smithi181.stdout:3/320: fdatasync d0/d5/d6/d32/d43/f48 0 2024-04-03T08:39:16.923 INFO:tasks.workunit.client.0.smithi157.stdout:5/527: unlink dc/c95 0 2024-04-03T08:39:16.924 INFO:tasks.workunit.client.1.smithi181.stdout:3/321: readlink d0/d17/l3a 0 2024-04-03T08:39:16.924 INFO:tasks.workunit.client.0.smithi157.stdout:2/501: dwrite d3/db/d44/d4c/d5a/d88/d97/faa [0,4194304] 0 2024-04-03T08:39:16.926 INFO:tasks.workunit.client.1.smithi181.stdout:0/316: unlink d5/d9/d60/c62 0 2024-04-03T08:39:16.929 INFO:tasks.workunit.client.0.smithi157.stdout:6/531: dwrite d1/d5/d17/d29/d62/f98 [0,4194304] 0 2024-04-03T08:39:16.930 INFO:tasks.workunit.client.0.smithi157.stdout:4/468: fsync da/df/d2f/f4f 0 2024-04-03T08:39:16.933 INFO:tasks.workunit.client.0.smithi157.stdout:1/466: write d2/d11/d24/d39/d3b/d2e/f7d [882985,60394] 0 2024-04-03T08:39:16.939 INFO:tasks.workunit.client.1.smithi181.stdout:2/361: creat d13/d22/d27/f8a x:0 0 0 2024-04-03T08:39:16.941 INFO:tasks.workunit.client.1.smithi181.stdout:0/317: dread d5/d52/f15 [0,4194304] 0 2024-04-03T08:39:16.944 INFO:tasks.workunit.client.1.smithi181.stdout:3/322: dread d0/d5/d6/f39 [0,4194304] 0 2024-04-03T08:39:16.946 INFO:tasks.workunit.client.1.smithi181.stdout:5/320: write d4/d18/f23 [2998453,22705] 0 2024-04-03T08:39:16.947 INFO:tasks.workunit.client.0.smithi157.stdout:9/447: dwrite d1/d4a/d4d/f95 [0,4194304] 0 2024-04-03T08:39:16.954 INFO:tasks.workunit.client.1.smithi181.stdout:4/390: mknod d1/d16/d24/d5e/c7b 0 2024-04-03T08:39:16.966 INFO:tasks.workunit.client.0.smithi157.stdout:8/527: creat d2/d11/d10/d24/d5b/d53/faf x:0 0 0 2024-04-03T08:39:16.969 INFO:tasks.workunit.client.0.smithi157.stdout:2/502: fdatasync d3/f84 0 2024-04-03T08:39:16.972 INFO:tasks.workunit.client.0.smithi157.stdout:5/528: rmdir dc/d29/d56/d49 39 2024-04-03T08:39:16.973 INFO:tasks.workunit.client.0.smithi157.stdout:0/499: write d2/f21 [669685,40610] 0 2024-04-03T08:39:16.980 INFO:tasks.workunit.client.0.smithi157.stdout:6/532: mknod d1/d4b/d38/da6/cb4 0 2024-04-03T08:39:16.981 INFO:tasks.workunit.client.0.smithi157.stdout:4/469: write da/df/d6b/f88 [140175,30276] 0 2024-04-03T08:39:16.981 INFO:tasks.workunit.client.1.smithi181.stdout:7/265: mknod d0/d1/d6/de/c60 0 2024-04-03T08:39:16.981 INFO:tasks.workunit.client.1.smithi181.stdout:8/273: write d4/d2a/d37/f3d [360430,54459] 0 2024-04-03T08:39:16.986 INFO:tasks.workunit.client.1.smithi181.stdout:2/362: mkdir d13/d1c/d73/d8b 0 2024-04-03T08:39:16.987 INFO:tasks.workunit.client.1.smithi181.stdout:2/363: readlink d13/d1c/l45 0 2024-04-03T08:39:16.990 INFO:tasks.workunit.client.0.smithi157.stdout:2/503: creat d3/db/d44/d4c/d5a/d88/fb0 x:0 0 0 2024-04-03T08:39:16.990 INFO:tasks.workunit.client.1.smithi181.stdout:1/316: mkdir d10/d15/d17/d23/d5b 0 2024-04-03T08:39:16.991 INFO:tasks.workunit.client.1.smithi181.stdout:9/396: dwrite d1/da/d13/d22/f31 [0,4194304] 0 2024-04-03T08:39:16.992 INFO:tasks.workunit.client.0.smithi157.stdout:3/464: dwrite d8/d1e/d2d/d3f/f44 [0,4194304] 0 2024-04-03T08:39:16.992 INFO:tasks.workunit.client.1.smithi181.stdout:5/321: unlink d4/d22/l30 0 2024-04-03T08:39:16.993 INFO:tasks.workunit.client.1.smithi181.stdout:9/397: fdatasync d1/da/d28/d30/f6a 0 2024-04-03T08:39:16.995 INFO:tasks.workunit.client.0.smithi157.stdout:0/500: mknod d2/d9/d5f/cb9 0 2024-04-03T08:39:16.995 INFO:tasks.workunit.client.1.smithi181.stdout:9/398: fsync d1/da/d28/d30/d3e/d4e/f68 0 2024-04-03T08:39:16.996 INFO:tasks.workunit.client.0.smithi157.stdout:3/465: dread - d8/d13/d1b/d4e/f99 zero size 2024-04-03T08:39:16.996 INFO:tasks.workunit.client.1.smithi181.stdout:9/399: stat d1/da/d13/d41/d32 0 2024-04-03T08:39:17.001 INFO:tasks.workunit.client.0.smithi157.stdout:1/467: symlink d2/d11/l9b 0 2024-04-03T08:39:17.001 INFO:tasks.workunit.client.0.smithi157.stdout:4/470: symlink da/df/d24/d58/la1 0 2024-04-03T08:39:17.006 INFO:tasks.workunit.client.1.smithi181.stdout:7/266: truncate d0/d1/f4a 2053793 0 2024-04-03T08:39:17.006 INFO:tasks.workunit.client.0.smithi157.stdout:6/533: dwrite d1/d5/d17/d29/d62/f6b [0,4194304] 0 2024-04-03T08:39:17.013 INFO:tasks.workunit.client.0.smithi157.stdout:6/534: chown d1/d5/d17/d2a/f82 161483 1 2024-04-03T08:39:17.013 INFO:tasks.workunit.client.0.smithi157.stdout:5/529: creat dc/d29/d56/d52/d9d/da5/daa/fb2 x:0 0 0 2024-04-03T08:39:17.014 INFO:tasks.workunit.client.0.smithi157.stdout:5/530: read - dc/fa3 zero size 2024-04-03T08:39:17.016 INFO:tasks.workunit.client.0.smithi157.stdout:5/531: chown dc/d29/d56/fb0 15871216 1 2024-04-03T08:39:17.019 INFO:tasks.workunit.client.1.smithi181.stdout:6/328: truncate d6/d7/d9/d22/d4f/f55 2253923 0 2024-04-03T08:39:17.023 INFO:tasks.workunit.client.1.smithi181.stdout:2/364: rename fe to d13/d22/d27/d2f/d5d/f8c 0 2024-04-03T08:39:17.026 INFO:tasks.workunit.client.1.smithi181.stdout:1/317: rmdir d10/d15/d17/d37 39 2024-04-03T08:39:17.033 INFO:tasks.workunit.client.0.smithi157.stdout:4/471: mknod da/df/d24/d58/d68/ca2 0 2024-04-03T08:39:17.037 INFO:tasks.workunit.client.1.smithi181.stdout:0/318: creat d5/f6a x:0 0 0 2024-04-03T08:39:17.040 INFO:tasks.workunit.client.0.smithi157.stdout:1/468: dwrite d2/d11/d23/d73/f8e [0,4194304] 0 2024-04-03T08:39:17.043 INFO:tasks.workunit.client.1.smithi181.stdout:3/323: creat d0/d5/d6/f5e x:0 0 0 2024-04-03T08:39:17.045 INFO:tasks.workunit.client.0.smithi157.stdout:8/528: getdents d2/d6f/d70/d89 0 2024-04-03T08:39:17.045 INFO:tasks.workunit.client.0.smithi157.stdout:2/504: truncate d3/f34 134287 0 2024-04-03T08:39:17.046 INFO:tasks.workunit.client.0.smithi157.stdout:1/469: fdatasync d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/f75 0 2024-04-03T08:39:17.046 INFO:tasks.workunit.client.1.smithi181.stdout:6/329: creat d6/d31/f6b x:0 0 0 2024-04-03T08:39:17.048 INFO:tasks.workunit.client.1.smithi181.stdout:4/391: dwrite d1/d16/d24/d5e/d31/f65 [0,4194304] 0 2024-04-03T08:39:17.049 INFO:tasks.workunit.client.1.smithi181.stdout:8/274: truncate d4/d45/db/d14/f42 3447775 0 2024-04-03T08:39:17.051 INFO:tasks.workunit.client.0.smithi157.stdout:9/448: rename d1/l4 to d1/d36/l9a 0 2024-04-03T08:39:17.051 INFO:tasks.workunit.client.0.smithi157.stdout:3/466: creat d8/d13/d1b/fa1 x:0 0 0 2024-04-03T08:39:17.055 INFO:tasks.workunit.client.0.smithi157.stdout:5/532: unlink dc/d29/d56/d49/d53/d6c/c8d 0 2024-04-03T08:39:17.056 INFO:tasks.workunit.client.1.smithi181.stdout:1/318: symlink d10/d15/d41/l5c 0 2024-04-03T08:39:17.057 INFO:tasks.workunit.client.0.smithi157.stdout:5/533: dread - dc/d29/d56/d18/f37 zero size 2024-04-03T08:39:17.062 INFO:tasks.workunit.client.1.smithi181.stdout:0/319: truncate d5/d52/f5d 214738 0 2024-04-03T08:39:17.063 INFO:tasks.workunit.client.1.smithi181.stdout:3/324: mkdir d0/d5/d6/dd/d5f 0 2024-04-03T08:39:17.063 INFO:tasks.workunit.client.0.smithi157.stdout:8/529: dread d2/d11/d10/d24/fa1 [0,4194304] 0 2024-04-03T08:39:17.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:16 smithi157 ceph-mon[35083]: mgrmap e23: smithi181.mfhidq(active, since 3s) 2024-04-03T08:39:17.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:16 smithi157 ceph-mon[35083]: [03/Apr/2024:08:39:16] ENGINE Bus STARTING 2024-04-03T08:39:17.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:16 smithi157 ceph-mon[35083]: [03/Apr/2024:08:39:16] ENGINE Serving on http://172.21.15.181:8765 2024-04-03T08:39:17.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:16 smithi157 ceph-mon[35083]: [03/Apr/2024:08:39:16] ENGINE Serving on https://172.21.15.181:7150 2024-04-03T08:39:17.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:16 smithi157 ceph-mon[35083]: [03/Apr/2024:08:39:16] ENGINE Bus STARTED 2024-04-03T08:39:17.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:16 smithi157 ceph-mon[35083]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:17.067 INFO:tasks.workunit.client.0.smithi157.stdout:9/449: creat d1/d4a/d4d/f9b x:0 0 0 2024-04-03T08:39:17.067 INFO:tasks.workunit.client.0.smithi157.stdout:0/501: link d2/d9/dc/df/d1b/d4a/c73 d2/d9/d5f/d85/cba 0 2024-04-03T08:39:17.071 INFO:tasks.workunit.client.0.smithi157.stdout:5/534: creat dc/d29/d56/d2e/fb3 x:0 0 0 2024-04-03T08:39:17.071 INFO:tasks.workunit.client.1.smithi181.stdout:5/322: creat d4/d18/f65 x:0 0 0 2024-04-03T08:39:17.072 INFO:tasks.workunit.client.1.smithi181.stdout:9/400: link d1/f2f d1/da/d13/d73/f7f 0 2024-04-03T08:39:17.073 INFO:tasks.workunit.client.0.smithi157.stdout:8/530: rmdir d2/d11/d10/d24 39 2024-04-03T08:39:17.074 INFO:tasks.workunit.client.1.smithi181.stdout:7/267: creat d0/d1/d6/f61 x:0 0 0 2024-04-03T08:39:17.076 INFO:tasks.workunit.client.0.smithi157.stdout:3/467: fdatasync d8/d1e/d2d/d39/f6c 0 2024-04-03T08:39:17.077 INFO:tasks.workunit.client.1.smithi181.stdout:1/319: creat d10/d15/d41/f5d x:0 0 0 2024-04-03T08:39:17.078 INFO:tasks.workunit.client.0.smithi157.stdout:0/502: truncate d2/d9/dc/df/d6f/d9d/d6a/f9f 325533 0 2024-04-03T08:39:17.080 INFO:tasks.workunit.client.0.smithi157.stdout:4/472: rename da/df/d24/c2c to da/ca3 0 2024-04-03T08:39:17.087 INFO:tasks.workunit.client.1.smithi181.stdout:3/325: creat d0/d5/d6/d32/d43/f60 x:0 0 0 2024-04-03T08:39:17.089 INFO:tasks.workunit.client.0.smithi157.stdout:2/505: dwrite d3/db/d44/f92 [0,4194304] 0 2024-04-03T08:39:17.090 INFO:tasks.workunit.client.1.smithi181.stdout:4/392: mknod d1/d16/d24/d5e/d3f/d41/c7c 0 2024-04-03T08:39:17.094 INFO:tasks.workunit.client.1.smithi181.stdout:2/365: creat d13/d22/d27/d2f/f8d x:0 0 0 2024-04-03T08:39:17.098 INFO:tasks.workunit.client.0.smithi157.stdout:8/531: dread d2/d11/d10/f48 [0,4194304] 0 2024-04-03T08:39:17.098 INFO:tasks.workunit.client.1.smithi181.stdout:2/366: chown d13/d7b/f7e 62840 1 2024-04-03T08:39:17.100 INFO:tasks.workunit.client.0.smithi157.stdout:8/532: write d2/d20/f29 [1402905,28852] 0 2024-04-03T08:39:17.101 INFO:tasks.workunit.client.0.smithi157.stdout:9/450: rename d1/d36/d69/c77 to d1/d15/d16/c9c 0 2024-04-03T08:39:17.102 INFO:tasks.workunit.client.1.smithi181.stdout:7/268: readlink d0/d1/l1d 0 2024-04-03T08:39:17.106 INFO:tasks.workunit.client.0.smithi157.stdout:9/451: stat d1/d4a/d4d/f9b 0 2024-04-03T08:39:17.106 INFO:tasks.workunit.client.0.smithi157.stdout:0/503: dread d2/d9/dc/df/d1b/d35/f9e [0,4194304] 0 2024-04-03T08:39:17.109 INFO:tasks.workunit.client.0.smithi157.stdout:9/452: stat d1/d4a/d4d/l6b 0 2024-04-03T08:39:17.111 INFO:tasks.workunit.client.0.smithi157.stdout:4/473: creat da/df/d24/d58/fa4 x:0 0 0 2024-04-03T08:39:17.112 INFO:tasks.workunit.client.1.smithi181.stdout:4/393: dwrite d1/d1e/f1c [0,4194304] 0 2024-04-03T08:39:17.113 INFO:tasks.workunit.client.0.smithi157.stdout:5/535: dread dc/d29/d56/d18/f3a [0,4194304] 0 2024-04-03T08:39:17.114 INFO:tasks.workunit.client.0.smithi157.stdout:9/453: chown d1/f1b 1492 1 2024-04-03T08:39:17.114 INFO:tasks.workunit.client.1.smithi181.stdout:0/320: mknod d5/dc/d14/d29/d46/c6b 0 2024-04-03T08:39:17.115 INFO:tasks.workunit.client.1.smithi181.stdout:4/394: dread - d1/d16/f23 zero size 2024-04-03T08:39:17.115 INFO:tasks.workunit.client.0.smithi157.stdout:3/468: dread d8/d1e/d2d/d3b/f6e [0,4194304] 0 2024-04-03T08:39:17.115 INFO:tasks.workunit.client.1.smithi181.stdout:0/321: dread - d5/f6a zero size 2024-04-03T08:39:17.116 INFO:tasks.workunit.client.1.smithi181.stdout:3/326: symlink d0/d5/d6/d32/d59/l61 0 2024-04-03T08:39:17.117 INFO:tasks.workunit.client.0.smithi157.stdout:9/454: chown d1/d36/d69 1595 1 2024-04-03T08:39:17.119 INFO:tasks.workunit.client.0.smithi157.stdout:6/535: dwrite d1/d5/d17/d2a/d40/f7c [0,4194304] 0 2024-04-03T08:39:17.124 INFO:tasks.workunit.client.1.smithi181.stdout:8/275: creat d4/d45/db/f58 x:0 0 0 2024-04-03T08:39:17.125 INFO:tasks.workunit.client.1.smithi181.stdout:5/323: mknod d4/d18/d2c/c66 0 2024-04-03T08:39:17.126 INFO:tasks.workunit.client.0.smithi157.stdout:9/455: write d1/d15/d27/d5c/d79/f7c [1607667,44322] 0 2024-04-03T08:39:17.130 INFO:tasks.workunit.client.1.smithi181.stdout:2/367: creat d13/d1c/d6c/f8e x:0 0 0 2024-04-03T08:39:17.131 INFO:tasks.workunit.client.1.smithi181.stdout:2/368: stat d13/f19 0 2024-04-03T08:39:17.132 INFO:tasks.workunit.client.1.smithi181.stdout:7/269: creat d0/d1/d6/de/d17/f62 x:0 0 0 2024-04-03T08:39:17.132 INFO:tasks.workunit.client.0.smithi157.stdout:4/474: symlink da/df/d24/la5 0 2024-04-03T08:39:17.139 INFO:tasks.workunit.client.1.smithi181.stdout:3/327: dwrite d0/d5/d6/d32/d43/f48 [0,4194304] 0 2024-04-03T08:39:17.148 INFO:tasks.workunit.client.1.smithi181.stdout:5/324: rename d4/d18/d3e/l51 to d4/d18/d55/l67 0 2024-04-03T08:39:17.148 INFO:tasks.workunit.client.0.smithi157.stdout:6/536: creat d1/d4b/d38/da6/fb5 x:0 0 0 2024-04-03T08:39:17.152 INFO:tasks.workunit.client.0.smithi157.stdout:8/533: truncate d2/d11/d10/d24/d5b/f47 948726 0 2024-04-03T08:39:17.154 INFO:tasks.workunit.client.1.smithi181.stdout:6/330: sync 2024-04-03T08:39:17.159 INFO:tasks.workunit.client.1.smithi181.stdout:7/270: chown d0/d1/d6/de/d17/c22 3955330 1 2024-04-03T08:39:17.160 INFO:tasks.workunit.client.0.smithi157.stdout:2/506: write d3/d2e/f80 [532668,50393] 0 2024-04-03T08:39:17.161 INFO:tasks.workunit.client.1.smithi181.stdout:8/276: mkdir d4/d44/d59 0 2024-04-03T08:39:17.164 INFO:tasks.workunit.client.0.smithi157.stdout:3/469: write d8/d1e/d2d/d39/d51/d4c/d32/f42 [1362926,58781] 0 2024-04-03T08:39:17.165 INFO:tasks.workunit.client.1.smithi181.stdout:3/328: dwrite d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:17.165 INFO:tasks.workunit.client.1.smithi181.stdout:9/401: getdents d1/da/d13/d41/d65 0 2024-04-03T08:39:17.166 INFO:tasks.workunit.client.0.smithi157.stdout:3/470: dread - d8/d13/d1b/d4e/f99 zero size 2024-04-03T08:39:17.167 INFO:tasks.workunit.client.1.smithi181.stdout:1/320: getdents d10/d15/d41 0 2024-04-03T08:39:17.168 INFO:tasks.workunit.client.0.smithi157.stdout:8/534: fdatasync d2/d20/f65 0 2024-04-03T08:39:17.169 INFO:tasks.workunit.client.1.smithi181.stdout:5/325: mkdir d4/d18/d25/d68 0 2024-04-03T08:39:17.170 INFO:tasks.workunit.client.0.smithi157.stdout:9/456: write d1/d36/f61 [349075,114273] 0 2024-04-03T08:39:17.170 INFO:tasks.workunit.client.0.smithi157.stdout:8/535: dread - d2/d6f/d70/f7e zero size 2024-04-03T08:39:17.171 INFO:tasks.workunit.client.1.smithi181.stdout:4/395: dwrite d1/f6d [0,4194304] 0 2024-04-03T08:39:17.174 INFO:tasks.workunit.client.0.smithi157.stdout:5/536: rename dc/d29/d56/f22 to dc/d29/d56/fb4 0 2024-04-03T08:39:17.179 INFO:tasks.workunit.client.1.smithi181.stdout:6/331: truncate d6/d7/d9/fa 714201 0 2024-04-03T08:39:17.183 INFO:tasks.workunit.client.1.smithi181.stdout:7/271: write d0/d1/f21 [1298666,37348] 0 2024-04-03T08:39:17.184 INFO:tasks.workunit.client.1.smithi181.stdout:8/277: write d4/d2a/f24 [2162847,21967] 0 2024-04-03T08:39:17.186 INFO:tasks.workunit.client.1.smithi181.stdout:9/402: mkdir d1/da/d28/d80 0 2024-04-03T08:39:17.187 INFO:tasks.workunit.client.1.smithi181.stdout:8/278: truncate d4/f36 1545911 0 2024-04-03T08:39:17.187 INFO:tasks.workunit.client.0.smithi157.stdout:4/475: dwrite da/df/d2f/d54/f67 [0,4194304] 0 2024-04-03T08:39:17.187 INFO:tasks.workunit.client.1.smithi181.stdout:7/272: write d0/d1/d6/f4d [2626839,15420] 0 2024-04-03T08:39:17.189 INFO:tasks.workunit.client.0.smithi157.stdout:0/504: getdents d2/d9/dc/df/d1b/d35 0 2024-04-03T08:39:17.190 INFO:tasks.workunit.client.0.smithi157.stdout:7/547: sync 2024-04-03T08:39:17.190 INFO:tasks.workunit.client.1.smithi181.stdout:7/273: stat d0/d1/d6/de/d17/f2c 0 2024-04-03T08:39:17.191 INFO:tasks.workunit.client.1.smithi181.stdout:3/329: mknod d0/d5/d6/dd/d25/c62 0 2024-04-03T08:39:17.193 INFO:tasks.workunit.client.1.smithi181.stdout:7/274: read d0/d1/f21 [955032,37548] 0 2024-04-03T08:39:17.193 INFO:tasks.workunit.client.1.smithi181.stdout:2/369: write d13/d1c/d4a/d68/f76 [1832754,35141] 0 2024-04-03T08:39:17.194 INFO:tasks.workunit.client.0.smithi157.stdout:7/548: dread - d0/d11/d15/d1b/db8/fba zero size 2024-04-03T08:39:17.195 INFO:tasks.workunit.client.1.smithi181.stdout:2/370: chown fa 2158381 1 2024-04-03T08:39:17.198 INFO:tasks.workunit.client.1.smithi181.stdout:7/275: dread - d0/d1/d6/de/d17/d27/f56 zero size 2024-04-03T08:39:17.202 INFO:tasks.workunit.client.1.smithi181.stdout:0/322: dwrite d5/d9/f28 [0,4194304] 0 2024-04-03T08:39:17.209 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:16 smithi181 ceph-mon[44183]: mgrmap e23: smithi181.mfhidq(active, since 3s) 2024-04-03T08:39:17.210 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:16 smithi181 ceph-mon[44183]: [03/Apr/2024:08:39:16] ENGINE Bus STARTING 2024-04-03T08:39:17.210 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:16 smithi181 ceph-mon[44183]: [03/Apr/2024:08:39:16] ENGINE Serving on http://172.21.15.181:8765 2024-04-03T08:39:17.210 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:16 smithi181 ceph-mon[44183]: [03/Apr/2024:08:39:16] ENGINE Serving on https://172.21.15.181:7150 2024-04-03T08:39:17.210 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:16 smithi181 ceph-mon[44183]: [03/Apr/2024:08:39:16] ENGINE Bus STARTED 2024-04-03T08:39:17.210 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:16 smithi181 ceph-mon[44183]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:17.211 INFO:tasks.workunit.client.0.smithi157.stdout:2/507: dwrite d3/d12/d43/f78 [0,4194304] 0 2024-04-03T08:39:17.212 INFO:tasks.workunit.client.0.smithi157.stdout:8/536: symlink d2/d7b/lb0 0 2024-04-03T08:39:17.213 INFO:tasks.workunit.client.1.smithi181.stdout:5/326: creat d4/d18/d55/f69 x:0 0 0 2024-04-03T08:39:17.214 INFO:tasks.workunit.client.0.smithi157.stdout:4/476: dwrite da/d26/f92 [0,4194304] 0 2024-04-03T08:39:17.221 INFO:tasks.workunit.client.0.smithi157.stdout:8/537: chown d2/d11/d10/d24/d5b/d2e/d75/f85 134214738 1 2024-04-03T08:39:17.225 INFO:tasks.workunit.client.0.smithi157.stdout:3/471: creat d8/d1e/d2d/d3f/d4d/d8f/fa2 x:0 0 0 2024-04-03T08:39:17.227 INFO:tasks.workunit.client.1.smithi181.stdout:8/279: creat d4/d44/f5a x:0 0 0 2024-04-03T08:39:17.229 INFO:tasks.workunit.client.1.smithi181.stdout:9/403: creat d1/da/d28/d30/d3e/d4e/f81 x:0 0 0 2024-04-03T08:39:17.230 INFO:tasks.workunit.client.0.smithi157.stdout:6/537: dread d1/d5/d17/f64 [0,4194304] 0 2024-04-03T08:39:17.235 INFO:tasks.workunit.client.1.smithi181.stdout:3/330: mkdir d0/d17/d63 0 2024-04-03T08:39:17.237 INFO:tasks.workunit.client.1.smithi181.stdout:2/371: mkdir d13/d22/d27/d46/d8f 0 2024-04-03T08:39:17.237 INFO:tasks.workunit.client.0.smithi157.stdout:2/508: creat d3/d12/d43/fb1 x:0 0 0 2024-04-03T08:39:17.238 INFO:tasks.workunit.client.1.smithi181.stdout:4/396: write d1/f32 [1904924,47223] 0 2024-04-03T08:39:17.240 INFO:tasks.workunit.client.1.smithi181.stdout:4/397: write d1/d1e/f1c [5513420,30134] 0 2024-04-03T08:39:17.242 INFO:tasks.workunit.client.0.smithi157.stdout:4/477: write da/df/d2f/d54/f5a [414637,44401] 0 2024-04-03T08:39:17.242 INFO:tasks.workunit.client.1.smithi181.stdout:2/372: truncate d13/d22/f7c 586626 0 2024-04-03T08:39:17.243 INFO:tasks.workunit.client.0.smithi157.stdout:3/472: mkdir d8/d1e/d2d/d39/d51/d48/da3 0 2024-04-03T08:39:17.244 INFO:tasks.workunit.client.1.smithi181.stdout:2/373: chown d13/d1c/d4a/d68/f6f 22664 1 2024-04-03T08:39:17.246 INFO:tasks.workunit.client.1.smithi181.stdout:5/327: chown d4/d18/d2c/c36 108073483 1 2024-04-03T08:39:17.247 INFO:tasks.workunit.client.0.smithi157.stdout:3/473: fdatasync d8/d13/d1b/d7d/f89 0 2024-04-03T08:39:17.247 INFO:tasks.workunit.client.0.smithi157.stdout:9/457: link d1/d94/f96 d1/d15/d27/d5c/d79/f9d 0 2024-04-03T08:39:17.248 INFO:tasks.workunit.client.1.smithi181.stdout:5/328: dread d4/d44/f5f [0,4194304] 0 2024-04-03T08:39:17.250 INFO:tasks.workunit.client.1.smithi181.stdout:5/329: truncate d4/f5e 982673 0 2024-04-03T08:39:17.251 INFO:tasks.workunit.client.0.smithi157.stdout:9/458: chown d1/d4a/d4d/l64 6368 1 2024-04-03T08:39:17.253 INFO:tasks.workunit.client.1.smithi181.stdout:6/332: truncate d6/d7/d50/d5b/f6a 1180234 0 2024-04-03T08:39:17.254 INFO:tasks.workunit.client.1.smithi181.stdout:6/333: fdatasync d6/d7/d50/d64/f67 0 2024-04-03T08:39:17.254 INFO:tasks.workunit.client.0.smithi157.stdout:8/538: mkdir d2/d20/db1 0 2024-04-03T08:39:17.255 INFO:tasks.workunit.client.1.smithi181.stdout:6/334: chown d6/d7/f3f 1481440 1 2024-04-03T08:39:17.256 INFO:tasks.workunit.client.1.smithi181.stdout:8/280: creat d4/d44/f5b x:0 0 0 2024-04-03T08:39:17.258 INFO:tasks.workunit.client.0.smithi157.stdout:6/538: getdents d1/d5/d1b/d97 0 2024-04-03T08:39:17.259 INFO:tasks.workunit.client.0.smithi157.stdout:0/505: dwrite d2/f50 [0,4194304] 0 2024-04-03T08:39:17.260 INFO:tasks.workunit.client.0.smithi157.stdout:5/537: dread dc/d29/d56/d49/d53/d6c/f6f [0,4194304] 0 2024-04-03T08:39:17.262 INFO:tasks.workunit.client.0.smithi157.stdout:4/478: mkdir da/df/d24/d58/d68/da6 0 2024-04-03T08:39:17.263 INFO:tasks.workunit.client.1.smithi181.stdout:3/331: mknod d0/d17/d40/c64 0 2024-04-03T08:39:17.264 INFO:tasks.workunit.client.0.smithi157.stdout:2/509: creat d3/dab/fb2 x:0 0 0 2024-04-03T08:39:17.265 INFO:tasks.workunit.client.0.smithi157.stdout:0/506: chown d2/d9/dc/df/d1b/f34 3400264 1 2024-04-03T08:39:17.266 INFO:tasks.workunit.client.0.smithi157.stdout:6/539: fdatasync d1/d5/d17/d2a/f86 0 2024-04-03T08:39:17.268 INFO:tasks.workunit.client.1.smithi181.stdout:1/321: dwrite d10/d15/d17/f2a [4194304,4194304] 0 2024-04-03T08:39:17.269 INFO:tasks.workunit.client.0.smithi157.stdout:5/538: write dc/d29/d56/fb0 [250997,56824] 0 2024-04-03T08:39:17.269 INFO:tasks.workunit.client.0.smithi157.stdout:0/507: truncate d2/f21 1513558 0 2024-04-03T08:39:17.270 INFO:tasks.workunit.client.0.smithi157.stdout:2/510: chown d3/d2e/d32/d9f 6906996 1 2024-04-03T08:39:17.273 INFO:tasks.workunit.client.1.smithi181.stdout:4/398: creat d1/d16/d37/f7d x:0 0 0 2024-04-03T08:39:17.275 INFO:tasks.workunit.client.0.smithi157.stdout:3/474: link d8/d1e/f7b d8/d1e/d2d/d39/d51/d7e/fa4 0 2024-04-03T08:39:17.276 INFO:tasks.workunit.client.0.smithi157.stdout:4/479: truncate da/df/d24/d35/d6a/d78/f93 857593 0 2024-04-03T08:39:17.276 INFO:tasks.workunit.client.1.smithi181.stdout:6/335: dwrite d6/d31/f4d [0,4194304] 0 2024-04-03T08:39:17.279 INFO:tasks.workunit.client.1.smithi181.stdout:2/374: unlink d13/d1c/d4a/c6b 0 2024-04-03T08:39:17.280 INFO:tasks.workunit.client.1.smithi181.stdout:8/281: dwrite d4/d44/f5b [0,4194304] 0 2024-04-03T08:39:17.282 INFO:tasks.workunit.client.1.smithi181.stdout:8/282: chown d4/d45/db/d14/d31 605 1 2024-04-03T08:39:17.283 INFO:tasks.workunit.client.0.smithi157.stdout:6/540: truncate d1/d5/d17/d2a/d37/f8e 67797 0 2024-04-03T08:39:17.284 INFO:tasks.workunit.client.0.smithi157.stdout:8/539: mknod d2/d20/cb2 0 2024-04-03T08:39:17.284 INFO:tasks.workunit.client.0.smithi157.stdout:5/539: write dc/d29/d56/d49/d53/f79 [1361435,102122] 0 2024-04-03T08:39:17.291 INFO:tasks.workunit.client.0.smithi157.stdout:3/475: chown d8/d13/l22 108438 1 2024-04-03T08:39:17.292 INFO:tasks.workunit.client.0.smithi157.stdout:2/511: mknod d3/d2e/d32/d9f/cb3 0 2024-04-03T08:39:17.294 INFO:tasks.workunit.client.1.smithi181.stdout:0/323: write d5/dc/f1e [1233387,106180] 0 2024-04-03T08:39:17.294 INFO:tasks.workunit.client.0.smithi157.stdout:9/459: dwrite d1/d94/d75/f88 [0,4194304] 0 2024-04-03T08:39:17.297 INFO:tasks.workunit.client.0.smithi157.stdout:4/480: read da/df/d2f/f40 [1351758,62615] 0 2024-04-03T08:39:17.298 INFO:tasks.workunit.client.1.smithi181.stdout:0/324: write d5/d9/d2c/f69 [326974,21459] 0 2024-04-03T08:39:17.304 INFO:tasks.workunit.client.0.smithi157.stdout:3/476: readlink d8/d1e/d2d/d3f/d4d/l86 0 2024-04-03T08:39:17.307 INFO:tasks.workunit.client.1.smithi181.stdout:6/336: mknod d6/d31/d36/c6c 0 2024-04-03T08:39:17.308 INFO:tasks.workunit.client.0.smithi157.stdout:3/477: write d8/d13/d1b/fa1 [314919,48481] 0 2024-04-03T08:39:17.313 INFO:tasks.workunit.client.0.smithi157.stdout:3/478: chown d8/d1e/d2d/d3f/d4d/d8f 4803 1 2024-04-03T08:39:17.315 INFO:tasks.workunit.client.1.smithi181.stdout:2/375: mknod d13/d1c/d4a/d68/c90 0 2024-04-03T08:39:17.316 INFO:tasks.workunit.client.0.smithi157.stdout:9/460: symlink d1/d15/l9e 0 2024-04-03T08:39:17.319 INFO:tasks.workunit.client.1.smithi181.stdout:5/330: symlink d4/d22/l6a 0 2024-04-03T08:39:17.320 INFO:tasks.workunit.client.0.smithi157.stdout:6/541: symlink d1/d5/d17/d2a/d37/lb6 0 2024-04-03T08:39:17.321 INFO:tasks.workunit.client.1.smithi181.stdout:1/322: dwrite d10/d15/d17/d37/f54 [0,4194304] 0 2024-04-03T08:39:17.325 INFO:tasks.workunit.client.0.smithi157.stdout:0/508: rename d2/d9/dc/df/d1b/d4a/d31/d93 to d2/d9/dc/df/d6f/dad/dbb 0 2024-04-03T08:39:17.329 INFO:tasks.workunit.client.1.smithi181.stdout:3/332: symlink d0/l65 0 2024-04-03T08:39:17.334 INFO:tasks.workunit.client.1.smithi181.stdout:7/276: getdents d0/d1 0 2024-04-03T08:39:17.336 INFO:tasks.workunit.client.1.smithi181.stdout:4/399: creat d1/d16/d24/d5e/d2b/d56/f7e x:0 0 0 2024-04-03T08:39:17.338 INFO:tasks.workunit.client.0.smithi157.stdout:5/540: mkdir dc/d29/d56/d9e/db5 0 2024-04-03T08:39:17.342 INFO:tasks.workunit.client.0.smithi157.stdout:3/479: dread d8/d1e/d2d/f79 [0,4194304] 0 2024-04-03T08:39:17.344 INFO:tasks.workunit.client.1.smithi181.stdout:8/283: dwrite d4/d2a/d37/f3f [0,4194304] 0 2024-04-03T08:39:17.346 INFO:tasks.workunit.client.1.smithi181.stdout:4/400: dread d1/f32 [0,4194304] 0 2024-04-03T08:39:17.348 INFO:tasks.workunit.client.0.smithi157.stdout:6/542: mknod d1/d5/d17/d2a/d37/cb7 0 2024-04-03T08:39:17.349 INFO:tasks.workunit.client.1.smithi181.stdout:4/401: readlink d1/d1e/d2c/l4c 0 2024-04-03T08:39:17.350 INFO:tasks.workunit.client.0.smithi157.stdout:4/481: rename da/df/d6b/f83 to da/df/d24/d35/d3c/fa7 0 2024-04-03T08:39:17.352 INFO:tasks.workunit.client.1.smithi181.stdout:4/402: chown d1/d16/f23 3 1 2024-04-03T08:39:17.352 INFO:tasks.workunit.client.0.smithi157.stdout:2/512: mknod d3/d12/cb4 0 2024-04-03T08:39:17.354 INFO:tasks.workunit.client.0.smithi157.stdout:6/543: read d1/d5/d17/d29/f7d [1439991,7913] 0 2024-04-03T08:39:17.355 INFO:tasks.workunit.client.0.smithi157.stdout:5/541: truncate dc/f62 1702103 0 2024-04-03T08:39:17.357 INFO:tasks.workunit.client.1.smithi181.stdout:3/333: fsync d0/d17/d36/d1e/f28 0 2024-04-03T08:39:17.361 INFO:tasks.workunit.client.1.smithi181.stdout:0/325: dwrite d5/fe [4194304,4194304] 0 2024-04-03T08:39:17.362 INFO:tasks.workunit.client.0.smithi157.stdout:3/480: mkdir d8/d1e/d2d/d39/d51/d48/da5 0 2024-04-03T08:39:17.363 INFO:tasks.workunit.client.1.smithi181.stdout:9/404: sync 2024-04-03T08:39:17.368 INFO:tasks.workunit.client.0.smithi157.stdout:5/542: dread dc/d29/f4a [0,4194304] 0 2024-04-03T08:39:17.370 INFO:tasks.workunit.client.1.smithi181.stdout:2/376: creat d13/d22/d27/d46/d81/f91 x:0 0 0 2024-04-03T08:39:17.371 INFO:tasks.workunit.client.1.smithi181.stdout:2/377: readlink d13/l60 0 2024-04-03T08:39:17.373 INFO:tasks.workunit.client.1.smithi181.stdout:8/284: dwrite d4/d45/d9/f38 [0,4194304] 0 2024-04-03T08:39:17.373 INFO:tasks.workunit.client.1.smithi181.stdout:2/378: chown d13/d22/d27 48 1 2024-04-03T08:39:17.374 INFO:tasks.workunit.client.0.smithi157.stdout:8/540: rename d2/d11/d10/d24/d5b/c37 to d2/d6f/d70/d89/d59/d9e/cb3 0 2024-04-03T08:39:17.375 INFO:tasks.workunit.client.1.smithi181.stdout:1/323: dwrite f2 [0,4194304] 0 2024-04-03T08:39:17.375 INFO:tasks.workunit.client.1.smithi181.stdout:2/379: chown d13/d22/d40 64135 1 2024-04-03T08:39:17.376 INFO:tasks.workunit.client.1.smithi181.stdout:8/285: chown d4/d45/db/d14/f20 18 1 2024-04-03T08:39:17.378 INFO:tasks.workunit.client.1.smithi181.stdout:8/286: chown d4/d45/db/f56 30 1 2024-04-03T08:39:17.378 INFO:tasks.workunit.client.0.smithi157.stdout:0/509: link d2/d9/d51/f7f d2/d9/d51/d63/d71/fbc 0 2024-04-03T08:39:17.381 INFO:tasks.workunit.client.1.smithi181.stdout:4/403: mknod d1/d16/d37/c7f 0 2024-04-03T08:39:17.384 INFO:tasks.workunit.client.1.smithi181.stdout:7/277: symlink d0/d1/d6/de/l63 0 2024-04-03T08:39:17.387 INFO:tasks.workunit.client.0.smithi157.stdout:3/481: dwrite d8/f2f [0,4194304] 0 2024-04-03T08:39:17.387 INFO:tasks.workunit.client.0.smithi157.stdout:2/513: fdatasync d3/d2e/f83 0 2024-04-03T08:39:17.388 INFO:tasks.workunit.client.1.smithi181.stdout:7/278: fsync d0/d1/d6/de/d17/f4c 0 2024-04-03T08:39:17.389 INFO:tasks.workunit.client.1.smithi181.stdout:3/334: rmdir d0/d17/d40 39 2024-04-03T08:39:17.394 INFO:tasks.workunit.client.0.smithi157.stdout:6/544: readlink d1/d5/d17/l75 0 2024-04-03T08:39:17.395 INFO:tasks.workunit.client.1.smithi181.stdout:8/287: dwrite d4/d45/db/f4c [0,4194304] 0 2024-04-03T08:39:17.398 INFO:tasks.workunit.client.1.smithi181.stdout:6/337: creat d6/d7/f6d x:0 0 0 2024-04-03T08:39:17.400 INFO:tasks.workunit.client.0.smithi157.stdout:9/461: mkdir d1/d15/d16/d9f 0 2024-04-03T08:39:17.400 INFO:tasks.workunit.client.1.smithi181.stdout:0/326: rename d5/d52 to d5/dc/d10/d58/d6c 0 2024-04-03T08:39:17.407 INFO:tasks.workunit.client.1.smithi181.stdout:1/324: mknod d10/c5e 0 2024-04-03T08:39:17.411 INFO:tasks.workunit.client.1.smithi181.stdout:7/279: mkdir d0/d1/d6/de/d17/d64 0 2024-04-03T08:39:17.412 INFO:tasks.workunit.client.1.smithi181.stdout:7/280: stat d0/d1/d6/f9 0 2024-04-03T08:39:17.412 INFO:tasks.workunit.client.0.smithi157.stdout:8/541: dread d2/d6f/d70/d89/f5e [0,4194304] 0 2024-04-03T08:39:17.414 INFO:tasks.workunit.client.1.smithi181.stdout:7/281: write d0/f3e [999972,4314] 0 2024-04-03T08:39:17.415 INFO:tasks.workunit.client.0.smithi157.stdout:0/510: link d2/f2c d2/d9/dc/df/d1b/d4a/fbd 0 2024-04-03T08:39:17.418 INFO:tasks.workunit.client.1.smithi181.stdout:5/331: getdents d4/d18/d3e 0 2024-04-03T08:39:17.421 INFO:tasks.workunit.client.1.smithi181.stdout:5/332: chown d4/d22/d4a/f5d 989 1 2024-04-03T08:39:17.422 INFO:tasks.workunit.client.1.smithi181.stdout:8/288: dread d4/d45/d9/f4d [0,4194304] 0 2024-04-03T08:39:17.426 INFO:tasks.workunit.client.0.smithi157.stdout:2/514: rename d3/db/d44/f71 to d3/d2e/fb5 0 2024-04-03T08:39:17.431 INFO:tasks.workunit.client.0.smithi157.stdout:3/482: dread d8/fc [0,4194304] 0 2024-04-03T08:39:17.432 INFO:tasks.workunit.client.1.smithi181.stdout:0/327: dread d5/dc/d10/f20 [0,4194304] 0 2024-04-03T08:39:17.433 INFO:tasks.workunit.client.0.smithi157.stdout:8/542: mknod d2/cb4 0 2024-04-03T08:39:17.434 INFO:tasks.workunit.client.1.smithi181.stdout:0/328: stat d5/dc/d14/d29/d46/f63 0 2024-04-03T08:39:17.435 INFO:tasks.workunit.client.1.smithi181.stdout:4/404: link d1/d1e/d2c/f73 d1/d16/d24/d5e/d31/d39/f80 0 2024-04-03T08:39:17.439 INFO:tasks.workunit.client.1.smithi181.stdout:5/333: dwrite d4/f32 [0,4194304] 0 2024-04-03T08:39:17.442 INFO:tasks.workunit.client.0.smithi157.stdout:4/482: dwrite da/df/f74 [0,4194304] 0 2024-04-03T08:39:17.443 INFO:tasks.workunit.client.1.smithi181.stdout:4/405: truncate d1/d1e/d2c/d67/f76 91405 0 2024-04-03T08:39:17.446 INFO:tasks.workunit.client.1.smithi181.stdout:7/282: dread d0/d1/f15 [0,4194304] 0 2024-04-03T08:39:17.446 INFO:tasks.workunit.client.0.smithi157.stdout:4/483: chown da/d26/l49 125546 1 2024-04-03T08:39:17.446 INFO:tasks.workunit.client.0.smithi157.stdout:6/545: rename d1/d5/d17/d29/da7/fb0 to d1/d5/d17/d29/d62/d7f/fb8 0 2024-04-03T08:39:17.451 INFO:tasks.workunit.client.0.smithi157.stdout:6/546: dread - d1/d4b/d38/da6/fb5 zero size 2024-04-03T08:39:17.454 INFO:tasks.workunit.client.0.smithi157.stdout:8/543: mkdir d2/d6f/db5 0 2024-04-03T08:39:17.455 INFO:tasks.workunit.client.0.smithi157.stdout:8/544: dread - d2/d7b/fae zero size 2024-04-03T08:39:17.462 INFO:tasks.workunit.client.0.smithi157.stdout:9/462: rename d1/d15/d16/c4b to d1/d15/d27/d34/ca0 0 2024-04-03T08:39:17.465 INFO:tasks.workunit.client.0.smithi157.stdout:4/484: chown da/d26/f2e 736458791 1 2024-04-03T08:39:17.466 INFO:tasks.workunit.client.0.smithi157.stdout:2/515: rmdir d3/d2e 39 2024-04-03T08:39:17.467 INFO:tasks.workunit.client.0.smithi157.stdout:6/547: mkdir d1/d5/d17/d29/da7/db9 0 2024-04-03T08:39:17.469 INFO:tasks.workunit.client.0.smithi157.stdout:0/511: write d2/d9/d36/f80 [218460,95837] 0 2024-04-03T08:39:17.470 INFO:tasks.workunit.client.0.smithi157.stdout:8/545: creat d2/d6f/fb6 x:0 0 0 2024-04-03T08:39:17.472 INFO:tasks.workunit.client.1.smithi181.stdout:0/329: symlink d5/dc/d14/d29/d46/l6d 0 2024-04-03T08:39:17.473 INFO:tasks.workunit.client.1.smithi181.stdout:0/330: readlink d5/dc/d14/l5f 0 2024-04-03T08:39:17.475 INFO:tasks.workunit.client.1.smithi181.stdout:0/331: write d5/d9/f28 [3368674,120456] 0 2024-04-03T08:39:17.476 INFO:tasks.workunit.client.0.smithi157.stdout:3/483: rename d8/d13/d1b/d7d to d8/d13/d1b/d4e/da6 0 2024-04-03T08:39:17.477 INFO:tasks.workunit.client.1.smithi181.stdout:0/332: chown d5/dc/d14/d29/f48 867 1 2024-04-03T08:39:17.478 INFO:tasks.workunit.client.1.smithi181.stdout:3/335: creat d0/d5/d6/dd/d25/d50/f66 x:0 0 0 2024-04-03T08:39:17.479 INFO:tasks.workunit.client.0.smithi157.stdout:9/463: mkdir d1/d4a/da1 0 2024-04-03T08:39:17.480 INFO:tasks.workunit.client.1.smithi181.stdout:6/338: truncate d6/d31/f4d 2078781 0 2024-04-03T08:39:17.484 INFO:tasks.workunit.client.0.smithi157.stdout:4/485: mkdir da/df/d99/da8 0 2024-04-03T08:39:17.486 INFO:tasks.workunit.client.0.smithi157.stdout:4/486: read da/df/f2a [246450,59679] 0 2024-04-03T08:39:17.487 INFO:tasks.workunit.client.0.smithi157.stdout:4/487: dread - da/d7e/f7f zero size 2024-04-03T08:39:17.489 INFO:tasks.workunit.client.0.smithi157.stdout:8/546: fsync d2/d6f/d70/f97 0 2024-04-03T08:39:17.491 INFO:tasks.workunit.client.0.smithi157.stdout:3/484: chown c7 55296 1 2024-04-03T08:39:17.493 INFO:tasks.workunit.client.0.smithi157.stdout:2/516: symlink d3/d12/lb6 0 2024-04-03T08:39:17.493 INFO:tasks.workunit.client.1.smithi181.stdout:0/333: dwrite d5/d9/f3e [0,4194304] 0 2024-04-03T08:39:17.496 INFO:tasks.workunit.client.0.smithi157.stdout:0/512: mkdir d2/d9/dc/dbe 0 2024-04-03T08:39:17.498 INFO:tasks.workunit.client.1.smithi181.stdout:4/406: mkdir d1/d16/d24/d5e/d3f/d81 0 2024-04-03T08:39:17.500 INFO:tasks.workunit.client.1.smithi181.stdout:9/405: rename d1/da/d28/d30/d3e/c60 to d1/c82 0 2024-04-03T08:39:17.501 INFO:tasks.workunit.client.1.smithi181.stdout:2/380: getdents d13/d1c/d73 0 2024-04-03T08:39:17.502 INFO:tasks.workunit.client.0.smithi157.stdout:1/470: sync 2024-04-03T08:39:17.503 INFO:tasks.workunit.client.1.smithi181.stdout:8/289: mkdir d4/d45/db/d5c 0 2024-04-03T08:39:17.503 INFO:tasks.workunit.client.1.smithi181.stdout:2/381: truncate d13/f35 737017 0 2024-04-03T08:39:17.505 INFO:tasks.workunit.client.1.smithi181.stdout:1/325: truncate d10/d15/d17/d19/f45 5156086 0 2024-04-03T08:39:17.506 INFO:tasks.workunit.client.0.smithi157.stdout:3/485: symlink d8/d1e/d2d/d39/d51/d4c/d32/la7 0 2024-04-03T08:39:17.506 INFO:tasks.workunit.client.1.smithi181.stdout:8/290: write d4/d45/f2e [1216503,68955] 0 2024-04-03T08:39:17.508 INFO:tasks.workunit.client.1.smithi181.stdout:1/326: dread - d10/d15/d17/d23/d27/f43 zero size 2024-04-03T08:39:17.508 INFO:tasks.workunit.client.0.smithi157.stdout:6/548: creat d1/d5/d17/fba x:0 0 0 2024-04-03T08:39:17.512 INFO:tasks.workunit.client.0.smithi157.stdout:6/549: readlink d1/d5/d17/d2a/d30/l7a 0 2024-04-03T08:39:17.519 INFO:tasks.workunit.client.1.smithi181.stdout:4/407: rmdir d1/d16/d24/d5e/d3f/d41 39 2024-04-03T08:39:17.519 INFO:tasks.workunit.client.1.smithi181.stdout:4/408: stat d1/d16/d24/d5e 0 2024-04-03T08:39:17.520 INFO:tasks.workunit.client.1.smithi181.stdout:9/406: creat d1/d34/f83 x:0 0 0 2024-04-03T08:39:17.524 INFO:tasks.workunit.client.0.smithi157.stdout:8/547: dread d2/d11/f1d [0,4194304] 0 2024-04-03T08:39:17.524 INFO:tasks.workunit.client.0.smithi157.stdout:0/513: unlink d2/d9/d5f/d85/lb0 0 2024-04-03T08:39:17.525 INFO:tasks.workunit.client.1.smithi181.stdout:2/382: read d13/d22/d40/f42 [1641480,53381] 0 2024-04-03T08:39:17.527 INFO:tasks.workunit.client.0.smithi157.stdout:3/486: mkdir d8/d13/d1b/d4e/da6/da8 0 2024-04-03T08:39:17.528 INFO:tasks.workunit.client.1.smithi181.stdout:3/336: symlink d0/d5/d6/l67 0 2024-04-03T08:39:17.528 INFO:tasks.workunit.client.0.smithi157.stdout:0/514: read - d2/d9/d36/d38/fa7 zero size 2024-04-03T08:39:17.529 INFO:tasks.workunit.client.0.smithi157.stdout:4/488: link da/d26/f2e da/df/d24/d35/d53/fa9 0 2024-04-03T08:39:17.530 INFO:tasks.workunit.client.1.smithi181.stdout:8/291: creat d4/d2a/f5d x:0 0 0 2024-04-03T08:39:17.532 INFO:tasks.workunit.client.1.smithi181.stdout:8/292: read d4/d45/d9/f4d [69820,7759] 0 2024-04-03T08:39:17.532 INFO:tasks.workunit.client.0.smithi157.stdout:6/550: rmdir d1/d5/d17/d29/d62 39 2024-04-03T08:39:17.533 INFO:tasks.workunit.client.0.smithi157.stdout:3/487: truncate d8/d13/d1b/d4e/da6/f9d 1006726 0 2024-04-03T08:39:17.535 INFO:tasks.workunit.client.1.smithi181.stdout:6/339: symlink d6/d7/l6e 0 2024-04-03T08:39:17.539 INFO:tasks.workunit.client.0.smithi157.stdout:9/464: getdents d1/d36/d46 0 2024-04-03T08:39:17.542 INFO:tasks.workunit.client.0.smithi157.stdout:2/517: rename d3/f48 to d3/d2e/d32/fb7 0 2024-04-03T08:39:17.542 INFO:tasks.workunit.client.0.smithi157.stdout:1/471: dread d2/d11/d24/d39/d3b/fe [0,4194304] 0 2024-04-03T08:39:17.545 INFO:tasks.workunit.client.0.smithi157.stdout:8/548: symlink d2/d11/d10/d24/d5b/d53/lb7 0 2024-04-03T08:39:17.550 INFO:tasks.workunit.client.1.smithi181.stdout:2/383: symlink d13/d22/d27/d46/d81/l92 0 2024-04-03T08:39:17.554 INFO:tasks.workunit.client.0.smithi157.stdout:4/489: dwrite da/df/d24/f75 [0,4194304] 0 2024-04-03T08:39:17.555 INFO:tasks.workunit.client.0.smithi157.stdout:3/488: dread d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:17.556 INFO:tasks.workunit.client.1.smithi181.stdout:4/409: dwrite d1/d16/d24/d5e/d2b/d56/f71 [0,4194304] 0 2024-04-03T08:39:17.560 INFO:tasks.workunit.client.1.smithi181.stdout:9/407: dread d1/da/d13/d41/f26 [0,4194304] 0 2024-04-03T08:39:17.561 INFO:tasks.workunit.client.0.smithi157.stdout:4/490: read da/df/d2f/d54/f67 [1381592,98375] 0 2024-04-03T08:39:17.561 INFO:tasks.workunit.client.0.smithi157.stdout:9/465: mknod d1/d4a/ca2 0 2024-04-03T08:39:17.561 INFO:tasks.workunit.client.1.smithi181.stdout:6/340: chown d6/d7/d9/d22/d4f/f55 10290 1 2024-04-03T08:39:17.562 INFO:tasks.workunit.client.1.smithi181.stdout:6/341: readlink d6/d7/l5a 0 2024-04-03T08:39:17.563 INFO:tasks.workunit.client.0.smithi157.stdout:9/466: chown d1/d15/d16/f1e 2 1 2024-04-03T08:39:17.567 INFO:tasks.workunit.client.1.smithi181.stdout:5/334: rename d4/d22/l2a to d4/l6b 0 2024-04-03T08:39:17.569 INFO:tasks.workunit.client.0.smithi157.stdout:2/518: mknod d3/d12/d43/d4b/d55/cb8 0 2024-04-03T08:39:17.570 INFO:tasks.workunit.client.1.smithi181.stdout:3/337: mknod d0/d17/d40/c68 0 2024-04-03T08:39:17.571 INFO:tasks.workunit.client.0.smithi157.stdout:8/549: stat d2/d11/d10/d24/d5b/c1e 0 2024-04-03T08:39:17.572 INFO:tasks.workunit.client.1.smithi181.stdout:3/338: fsync d0/d17/d36/d1e/f31 0 2024-04-03T08:39:17.573 INFO:tasks.workunit.client.0.smithi157.stdout:7/549: sync 2024-04-03T08:39:17.574 INFO:tasks.workunit.client.1.smithi181.stdout:4/410: mkdir d1/d1e/d82 0 2024-04-03T08:39:17.574 INFO:tasks.workunit.client.0.smithi157.stdout:3/489: symlink d8/d13/la9 0 2024-04-03T08:39:17.578 INFO:tasks.workunit.client.0.smithi157.stdout:1/472: mknod d2/d11/c9c 0 2024-04-03T08:39:17.579 INFO:tasks.workunit.client.1.smithi181.stdout:9/408: symlink d1/da/d28/d30/d3e/d4e/l84 0 2024-04-03T08:39:17.580 INFO:tasks.workunit.client.0.smithi157.stdout:9/467: rmdir d1/d94 39 2024-04-03T08:39:17.581 INFO:tasks.workunit.client.1.smithi181.stdout:6/342: symlink d6/d31/l6f 0 2024-04-03T08:39:17.582 INFO:tasks.workunit.client.0.smithi157.stdout:9/468: chown d1/d15/d16/l1c 31 1 2024-04-03T08:39:17.585 INFO:tasks.workunit.client.1.smithi181.stdout:2/384: creat d13/d22/d27/d46/d8f/f93 x:0 0 0 2024-04-03T08:39:17.586 INFO:tasks.workunit.client.1.smithi181.stdout:2/385: chown d13/d1c/f38 5085816 1 2024-04-03T08:39:17.587 INFO:tasks.workunit.client.1.smithi181.stdout:9/409: dread d1/da/d13/d73/f7d [0,4194304] 0 2024-04-03T08:39:17.590 INFO:tasks.workunit.client.0.smithi157.stdout:6/551: link d1/d5/d17/d2a/d30/cae d1/d4b/da5/cbb 0 2024-04-03T08:39:17.596 INFO:tasks.workunit.client.1.smithi181.stdout:3/339: symlink d0/d5/d6/d32/d59/l69 0 2024-04-03T08:39:17.599 INFO:tasks.workunit.client.0.smithi157.stdout:4/491: dread da/df/d24/d35/d6a/d78/f7a [0,4194304] 0 2024-04-03T08:39:17.600 INFO:tasks.workunit.client.1.smithi181.stdout:9/410: dwrite d1/d34/d39/f50 [4194304,4194304] 0 2024-04-03T08:39:17.607 INFO:tasks.workunit.client.1.smithi181.stdout:1/327: getdents d10/d15 0 2024-04-03T08:39:17.611 INFO:tasks.workunit.client.1.smithi181.stdout:5/335: rmdir d4/d22 39 2024-04-03T08:39:17.612 INFO:tasks.workunit.client.1.smithi181.stdout:5/336: write d4/f39 [2482537,122509] 0 2024-04-03T08:39:17.613 INFO:tasks.workunit.client.0.smithi157.stdout:1/473: creat d2/d11/d23/f9d x:0 0 0 2024-04-03T08:39:17.616 INFO:tasks.workunit.client.0.smithi157.stdout:1/474: chown d2/d11/c9c 0 1 2024-04-03T08:39:17.618 INFO:tasks.workunit.client.0.smithi157.stdout:2/519: creat d3/da6/fb9 x:0 0 0 2024-04-03T08:39:17.618 INFO:tasks.workunit.client.0.smithi157.stdout:5/543: sync 2024-04-03T08:39:17.621 INFO:tasks.workunit.client.0.smithi157.stdout:9/469: fdatasync d1/d15/d27/d34/f53 0 2024-04-03T08:39:17.623 INFO:tasks.workunit.client.0.smithi157.stdout:9/470: write d1/f42 [7422387,113451] 0 2024-04-03T08:39:17.624 INFO:tasks.workunit.client.1.smithi181.stdout:7/283: rename d0/d1/d6/c18 to d0/d1/d6/de/d17/d27/c65 0 2024-04-03T08:39:17.626 INFO:tasks.workunit.client.0.smithi157.stdout:0/515: link d2/d9/dc/df/d1b/d4a/f20 d2/d9/dc/df/d6f/d9d/d6a/d91/fbf 0 2024-04-03T08:39:17.631 INFO:tasks.workunit.client.0.smithi157.stdout:6/552: rename d1/l84 to d1/d4b/d61/lbc 0 2024-04-03T08:39:17.634 INFO:tasks.workunit.client.0.smithi157.stdout:8/550: truncate d2/d11/d10/d24/d5b/f47 1982480 0 2024-04-03T08:39:17.637 INFO:tasks.workunit.client.0.smithi157.stdout:4/492: creat da/d7e/faa x:0 0 0 2024-04-03T08:39:17.638 INFO:tasks.workunit.client.1.smithi181.stdout:8/293: dwrite d4/f19 [0,4194304] 0 2024-04-03T08:39:17.642 INFO:tasks.workunit.client.0.smithi157.stdout:7/550: symlink d0/d11/d6f/d89/d8c/lc4 0 2024-04-03T08:39:17.643 INFO:tasks.workunit.client.0.smithi157.stdout:7/551: chown d0/d11/d6f 15495 1 2024-04-03T08:39:17.644 INFO:tasks.workunit.client.0.smithi157.stdout:3/490: mkdir d8/d13/d1b/d4e/d50/d7c/daa 0 2024-04-03T08:39:17.653 INFO:tasks.workunit.client.0.smithi157.stdout:1/475: chown d2/d11/c22 5 1 2024-04-03T08:39:17.654 INFO:tasks.workunit.client.0.smithi157.stdout:5/544: unlink dc/l2a 0 2024-04-03T08:39:17.656 INFO:tasks.workunit.client.1.smithi181.stdout:8/294: dwrite d4/d44/f5b [0,4194304] 0 2024-04-03T08:39:17.658 INFO:tasks.workunit.client.0.smithi157.stdout:2/520: mknod d3/dab/cba 0 2024-04-03T08:39:17.660 INFO:tasks.workunit.client.1.smithi181.stdout:4/411: link d1/d16/d24/c26 d1/d16/d24/d5e/d3f/d6c/c83 0 2024-04-03T08:39:17.662 INFO:tasks.workunit.client.1.smithi181.stdout:7/284: chown d0/d1/d6/ca 24815 1 2024-04-03T08:39:17.665 INFO:tasks.workunit.client.1.smithi181.stdout:1/328: dwrite d10/d15/d17/f3f [0,4194304] 0 2024-04-03T08:39:17.667 INFO:tasks.workunit.client.1.smithi181.stdout:7/285: chown d0/d1/d6/de/f44 101 1 2024-04-03T08:39:17.671 INFO:tasks.workunit.client.1.smithi181.stdout:6/343: creat d6/f70 x:0 0 0 2024-04-03T08:39:17.672 INFO:tasks.workunit.client.1.smithi181.stdout:3/340: dwrite d0/d17/d36/d1e/f49 [0,4194304] 0 2024-04-03T08:39:17.673 INFO:tasks.workunit.client.0.smithi157.stdout:0/516: mkdir d2/d9/dc/df/d1b/d35/dc0 0 2024-04-03T08:39:17.673 INFO:tasks.workunit.client.1.smithi181.stdout:7/286: read d0/f3e [748852,75230] 0 2024-04-03T08:39:17.674 INFO:tasks.workunit.client.0.smithi157.stdout:6/553: creat d1/d4b/d38/da6/fbd x:0 0 0 2024-04-03T08:39:17.675 INFO:tasks.workunit.client.1.smithi181.stdout:6/344: write d6/d31/d36/f5d [222091,78376] 0 2024-04-03T08:39:17.676 INFO:tasks.workunit.client.1.smithi181.stdout:3/341: chown d0/d17/l35 32738963 1 2024-04-03T08:39:17.680 INFO:tasks.workunit.client.0.smithi157.stdout:4/493: creat da/df/d99/fab x:0 0 0 2024-04-03T08:39:17.682 INFO:tasks.workunit.client.0.smithi157.stdout:8/551: dread d2/d11/d10/d24/d5b/d2e/f3f [0,4194304] 0 2024-04-03T08:39:17.686 INFO:tasks.workunit.client.1.smithi181.stdout:5/337: symlink d4/d22/d4a/l6c 0 2024-04-03T08:39:17.687 INFO:tasks.workunit.client.1.smithi181.stdout:2/386: dwrite d13/d1c/d4a/d68/f86 [0,4194304] 0 2024-04-03T08:39:17.688 INFO:tasks.workunit.client.1.smithi181.stdout:2/387: fdatasync d13/d1c/f3b 0 2024-04-03T08:39:17.690 INFO:tasks.workunit.client.0.smithi157.stdout:5/545: write dc/d29/d56/fb4 [239463,42227] 0 2024-04-03T08:39:17.692 INFO:tasks.workunit.client.1.smithi181.stdout:0/334: rename d5/dc/d14/d29/d46/l4a to d5/dc/d10/d30/d68/l6e 0 2024-04-03T08:39:17.693 INFO:tasks.workunit.client.0.smithi157.stdout:1/476: rmdir d2/d11/d24/d39/d3b/d2e/d48/d58/d62 39 2024-04-03T08:39:17.696 INFO:tasks.workunit.client.0.smithi157.stdout:1/477: chown d2/d11/d24/d39/d3b/f59 366510975 1 2024-04-03T08:39:17.697 INFO:tasks.workunit.client.0.smithi157.stdout:2/521: creat d3/db/d44/d4c/d5a/fbb x:0 0 0 2024-04-03T08:39:17.701 INFO:tasks.workunit.client.0.smithi157.stdout:9/471: mkdir d1/d36/da3 0 2024-04-03T08:39:17.707 INFO:tasks.workunit.client.1.smithi181.stdout:3/342: rmdir d0 39 2024-04-03T08:39:17.712 INFO:tasks.workunit.client.1.smithi181.stdout:6/345: symlink d6/d7/d50/d5b/l71 0 2024-04-03T08:39:17.717 INFO:tasks.workunit.client.1.smithi181.stdout:5/338: read d4/f16 [91772,44125] 0 2024-04-03T08:39:17.722 INFO:tasks.workunit.client.0.smithi157.stdout:9/472: dwrite d1/f42 [0,4194304] 0 2024-04-03T08:39:17.723 INFO:tasks.workunit.client.0.smithi157.stdout:9/473: chown d1/d36 151409 1 2024-04-03T08:39:17.724 INFO:tasks.workunit.client.1.smithi181.stdout:2/388: creat d13/d1c/d4a/d68/f94 x:0 0 0 2024-04-03T08:39:17.724 INFO:tasks.workunit.client.1.smithi181.stdout:9/411: sync 2024-04-03T08:39:17.724 INFO:tasks.workunit.client.1.smithi181.stdout:2/389: truncate d13/f35 1407578 0 2024-04-03T08:39:17.724 INFO:tasks.workunit.client.1.smithi181.stdout:8/295: mkdir d4/d45/db/d5c/d5e 0 2024-04-03T08:39:17.725 INFO:tasks.workunit.client.1.smithi181.stdout:1/329: symlink d10/d15/d17/l5f 0 2024-04-03T08:39:17.737 INFO:tasks.workunit.client.1.smithi181.stdout:5/339: rmdir d4/d18/d3e 39 2024-04-03T08:39:17.738 INFO:tasks.workunit.client.1.smithi181.stdout:5/340: chown d4/d22/f38 907706374 1 2024-04-03T08:39:17.740 INFO:tasks.workunit.client.1.smithi181.stdout:5/341: fsync d4/f39 0 2024-04-03T08:39:17.740 INFO:tasks.workunit.client.1.smithi181.stdout:2/390: read - d13/d1c/f51 zero size 2024-04-03T08:39:17.740 INFO:tasks.workunit.client.0.smithi157.stdout:9/474: dwrite d1/d36/d46/f56 [0,4194304] 0 2024-04-03T08:39:17.749 INFO:tasks.workunit.client.0.smithi157.stdout:9/475: read d1/f33 [2546115,75661] 0 2024-04-03T08:39:17.751 INFO:tasks.workunit.client.1.smithi181.stdout:8/296: getdents d4/d45/db/d5c/d5e 0 2024-04-03T08:39:17.753 INFO:tasks.workunit.client.1.smithi181.stdout:2/391: mknod d13/d1c/d4a/c95 0 2024-04-03T08:39:17.755 INFO:tasks.workunit.client.1.smithi181.stdout:3/343: creat d0/d5/d6/dd/d5f/f6a x:0 0 0 2024-04-03T08:39:17.755 INFO:tasks.workunit.client.1.smithi181.stdout:2/392: read d13/d22/f7c [547488,110044] 0 2024-04-03T08:39:17.756 INFO:tasks.workunit.client.1.smithi181.stdout:6/346: write d6/d3e/d40/f4e [474457,123880] 0 2024-04-03T08:39:17.757 INFO:tasks.workunit.client.1.smithi181.stdout:3/344: fdatasync d0/d17/f5b 0 2024-04-03T08:39:17.757 INFO:tasks.workunit.client.1.smithi181.stdout:7/287: link d0/d1/d6/de/d17/d27/f2e d0/d1/f66 0 2024-04-03T08:39:17.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.755+0000 7f2483200700 1 -- 172.21.15.157:0/356063510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 msgr2=0x7f247c070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:17.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.755+0000 7f2483200700 1 --2- 172.21.15.157:0/356063510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 0x7f247c070d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2468004940 tx=0x7f2468009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:17.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.756+0000 7f2483200700 1 -- 172.21.15.157:0/356063510 shutdown_connections 2024-04-03T08:39:17.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.756+0000 7f2483200700 1 --2- 172.21.15.157:0/356063510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 0x7f247c070d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:17.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.756+0000 7f2483200700 1 --2- 172.21.15.157:0/356063510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:17.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.756+0000 7f2483200700 1 -- 172.21.15.157:0/356063510 >> 172.21.15.157:0/356063510 conn(0x7f247c0f8560 msgr2=0x7f247c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:17.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.756+0000 7f2483200700 1 -- 172.21.15.157:0/356063510 shutdown_connections 2024-04-03T08:39:17.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.757+0000 7f2483200700 1 -- 172.21.15.157:0/356063510 wait complete. 2024-04-03T08:39:17.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.758+0000 7f2483200700 1 Processor -- start 2024-04-03T08:39:17.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.758+0000 7f2483200700 1 -- start start 2024-04-03T08:39:17.759 INFO:tasks.workunit.client.1.smithi181.stdout:3/345: readlink d0/d5/d6/l58 0 2024-04-03T08:39:17.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.758+0000 7f2483200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 0x7f247c113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:17.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.758+0000 7f2483200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:17.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.758+0000 7f2483200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c114b00 con 0x7f247c071ea0 2024-04-03T08:39:17.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.758+0000 7f2483200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c115350 con 0x7f247c0708f0 2024-04-03T08:39:17.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:17.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c114500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48270/0 (socket says 172.21.15.157:48270) 2024-04-03T08:39:17.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247b400700 1 -- 172.21.15.157:0/848248610 learned_addr learned my addr 172.21.15.157:0/848248610 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:17.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247be00700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 0x7f247c113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:17.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247b400700 1 -- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 msgr2=0x7f247c113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:17.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247b400700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 0x7f247c113fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:17.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.759+0000 7f247b400700 1 -- 172.21.15.157:0/848248610 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468005040 con 0x7f247c071ea0 2024-04-03T08:39:17.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.760+0000 7f247b400700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c114500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f246800b0d0 tx=0x7f2468009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:17.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.760+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f246800e070 con 0x7f247c071ea0 2024-04-03T08:39:17.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.760+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c1155d0 con 0x7f247c071ea0 2024-04-03T08:39:17.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.760+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f246800b410 con 0x7f247c071ea0 2024-04-03T08:39:17.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.760+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c115b10 con 0x7f247c071ea0 2024-04-03T08:39:17.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.760+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24680125a0 con 0x7f247c071ea0 2024-04-03T08:39:17.765 INFO:tasks.workunit.client.1.smithi181.stdout:9/412: write d1/da/d1a/f56 [1245385,74269] 0 2024-04-03T08:39:17.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.762+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 23) v1 ==== 45874+0+0 (secure 0 0 0) 0x7f246800ba80 con 0x7f247c071ea0 2024-04-03T08:39:17.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.763+0000 7f2473e00700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f24600389d0 0x7f246003ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:17.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.763+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2468002770 con 0x7f247c071ea0 2024-04-03T08:39:17.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.763+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c05f5f0 con 0x7f247c071ea0 2024-04-03T08:39:17.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.764+0000 7f247be00700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f24600389d0 0x7f246003ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:17.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.766+0000 7f247be00700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f24600389d0 0x7f246003ae80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f246c009b80 tx=0x7f246c00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:17.768 INFO:tasks.workunit.client.1.smithi181.stdout:2/393: mknod d13/d22/d27/c96 0 2024-04-03T08:39:17.768 INFO:tasks.workunit.client.1.smithi181.stdout:8/297: mkdir d4/d44/d59/d5f 0 2024-04-03T08:39:17.770 INFO:tasks.workunit.client.1.smithi181.stdout:3/346: mkdir d0/d5/d6/d32/d43/d6b 0 2024-04-03T08:39:17.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.770+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f246801b770 con 0x7f247c071ea0 2024-04-03T08:39:17.771 INFO:tasks.workunit.client.1.smithi181.stdout:1/330: dread fc [0,4194304] 0 2024-04-03T08:39:17.775 INFO:tasks.workunit.client.1.smithi181.stdout:9/413: rename d1/da/d28/d30/d3e/d4e/l84 to d1/da/d13/d22/d23/d36/l85 0 2024-04-03T08:39:17.777 INFO:tasks.workunit.client.1.smithi181.stdout:6/347: symlink d6/d7/l72 0 2024-04-03T08:39:17.778 INFO:tasks.workunit.client.1.smithi181.stdout:2/394: mknod d13/d22/d27/d2f/d5d/c97 0 2024-04-03T08:39:17.780 INFO:tasks.workunit.client.1.smithi181.stdout:2/395: chown d13/d22/d40/f75 203 1 2024-04-03T08:39:17.781 INFO:tasks.workunit.client.1.smithi181.stdout:3/347: chown d0/d5/d6/c19 2 1 2024-04-03T08:39:17.783 INFO:tasks.workunit.client.1.smithi181.stdout:3/348: chown d0/d5/d6/d32/d43/d6b 1204454 1 2024-04-03T08:39:17.786 INFO:tasks.workunit.client.1.smithi181.stdout:7/288: write d0/d1/d6/f9 [4327438,90788] 0 2024-04-03T08:39:17.787 INFO:tasks.workunit.client.1.smithi181.stdout:6/348: mkdir d6/d31/d36/d73 0 2024-04-03T08:39:17.789 INFO:tasks.workunit.client.1.smithi181.stdout:2/396: mknod d13/d22/d27/d46/c98 0 2024-04-03T08:39:17.790 INFO:tasks.workunit.client.0.smithi157.stdout:7/552: creat d0/d11/d15/d17/d1c/d88/fc5 x:0 0 0 2024-04-03T08:39:17.790 INFO:tasks.workunit.client.0.smithi157.stdout:0/517: dread d2/d9/fe [0,4194304] 0 2024-04-03T08:39:17.791 INFO:tasks.workunit.client.1.smithi181.stdout:6/349: chown d6/d31/f6b 100158 1 2024-04-03T08:39:17.791 INFO:tasks.workunit.client.1.smithi181.stdout:7/289: truncate d0/d1/d6/f61 631935 0 2024-04-03T08:39:17.791 INFO:tasks.workunit.client.0.smithi157.stdout:1/478: unlink d2/d11/d23/f9d 0 2024-04-03T08:39:17.793 INFO:tasks.workunit.client.1.smithi181.stdout:1/331: symlink d10/l60 0 2024-04-03T08:39:17.795 INFO:tasks.workunit.client.1.smithi181.stdout:7/290: write d0/d1/d6/de/d17/f62 [378510,47051] 0 2024-04-03T08:39:17.796 INFO:tasks.workunit.client.1.smithi181.stdout:9/414: mkdir d1/d34/d39/d7c/d86 0 2024-04-03T08:39:17.796 INFO:tasks.workunit.client.1.smithi181.stdout:8/298: dwrite d4/d45/db/d14/d31/f30 [0,4194304] 0 2024-04-03T08:39:17.798 INFO:tasks.workunit.client.1.smithi181.stdout:3/349: mknod d0/d5/d6/dd/d25/c6c 0 2024-04-03T08:39:17.798 INFO:tasks.workunit.client.1.smithi181.stdout:2/397: rmdir d13/d22/d40 39 2024-04-03T08:39:17.799 INFO:tasks.workunit.client.0.smithi157.stdout:1/479: chown d2/d11/d24/d39/d3b/d2e/d48/d58/c65 11 1 2024-04-03T08:39:17.800 INFO:tasks.workunit.client.1.smithi181.stdout:6/350: rmdir d6/d7/d50/d64 39 2024-04-03T08:39:17.801 INFO:tasks.workunit.client.1.smithi181.stdout:2/398: dread - d13/d22/d27/d46/f88 zero size 2024-04-03T08:39:17.803 INFO:tasks.workunit.client.1.smithi181.stdout:2/399: chown d13/d1c/c1f 4 1 2024-04-03T08:39:17.803 INFO:tasks.workunit.client.0.smithi157.stdout:1/480: fdatasync d2/d11/d23/f79 0 2024-04-03T08:39:17.805 INFO:tasks.workunit.client.0.smithi157.stdout:6/554: creat d1/d5/d1b/d97/fbe x:0 0 0 2024-04-03T08:39:17.805 INFO:tasks.workunit.client.1.smithi181.stdout:4/412: sync 2024-04-03T08:39:17.814 INFO:tasks.workunit.client.0.smithi157.stdout:4/494: symlink da/df/d24/d58/d68/da6/lac 0 2024-04-03T08:39:17.815 INFO:tasks.workunit.client.0.smithi157.stdout:0/518: dread d2/f50 [0,4194304] 0 2024-04-03T08:39:17.816 INFO:tasks.workunit.client.0.smithi157.stdout:4/495: dread - da/df/d2f/d97/f9a zero size 2024-04-03T08:39:17.818 INFO:tasks.workunit.client.0.smithi157.stdout:0/519: write d2/d9/dc/df/d6f/fa9 [745832,124652] 0 2024-04-03T08:39:17.821 INFO:tasks.workunit.client.1.smithi181.stdout:3/350: symlink d0/d5/d6/d3f/l6d 0 2024-04-03T08:39:17.821 INFO:tasks.workunit.client.1.smithi181.stdout:1/332: creat d10/d15/d41/f61 x:0 0 0 2024-04-03T08:39:17.822 INFO:tasks.workunit.client.0.smithi157.stdout:5/546: getdents dc/d29/d43/d9f 0 2024-04-03T08:39:17.823 INFO:tasks.workunit.client.1.smithi181.stdout:3/351: fdatasync d0/d17/f2e 0 2024-04-03T08:39:17.826 INFO:tasks.workunit.client.1.smithi181.stdout:4/413: chown d1/c9 55 1 2024-04-03T08:39:17.828 INFO:tasks.workunit.client.1.smithi181.stdout:7/291: mknod d0/d1/d6/de/c67 0 2024-04-03T08:39:17.833 INFO:tasks.workunit.client.0.smithi157.stdout:9/476: dread d1/f1b [0,4194304] 0 2024-04-03T08:39:17.833 INFO:tasks.workunit.client.1.smithi181.stdout:8/299: mkdir d4/d60 0 2024-04-03T08:39:17.838 INFO:tasks.workunit.client.1.smithi181.stdout:9/415: truncate d1/da/d13/d41/f1b 1966579 0 2024-04-03T08:39:17.839 INFO:tasks.workunit.client.1.smithi181.stdout:9/416: chown d1/da/d1a/l6e 49 1 2024-04-03T08:39:17.841 INFO:tasks.workunit.client.1.smithi181.stdout:9/417: write d1/da/d28/f64 [86500,38086] 0 2024-04-03T08:39:17.843 INFO:tasks.workunit.client.0.smithi157.stdout:2/522: dwrite d3/db/f7b [4194304,4194304] 0 2024-04-03T08:39:17.847 INFO:tasks.workunit.client.0.smithi157.stdout:3/491: getdents d8/d1e 0 2024-04-03T08:39:17.853 INFO:tasks.workunit.client.0.smithi157.stdout:8/552: creat d2/fb8 x:0 0 0 2024-04-03T08:39:17.858 INFO:tasks.workunit.client.0.smithi157.stdout:5/547: mknod dc/d29/d56/d49/d53/cb6 0 2024-04-03T08:39:17.863 INFO:tasks.workunit.client.1.smithi181.stdout:2/400: rename d13/d22/d27/d46/d81/f91 to d13/d1c/f99 0 2024-04-03T08:39:17.863 INFO:tasks.workunit.client.1.smithi181.stdout:2/401: chown c6 5 1 2024-04-03T08:39:17.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:17.862+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f246800b580 con 0x7f247c071ea0 2024-04-03T08:39:17.872 INFO:tasks.workunit.client.1.smithi181.stdout:4/414: mkdir d1/d1e/d82/d84 0 2024-04-03T08:39:17.874 INFO:tasks.workunit.client.0.smithi157.stdout:9/477: mkdir d1/d4a/d4d/da4 0 2024-04-03T08:39:17.875 INFO:tasks.workunit.client.0.smithi157.stdout:3/492: dwrite d8/d13/d1b/fa1 [0,4194304] 0 2024-04-03T08:39:17.875 INFO:tasks.workunit.client.1.smithi181.stdout:1/333: dread d10/f11 [4194304,4194304] 0 2024-04-03T08:39:17.882 INFO:tasks.workunit.client.1.smithi181.stdout:9/418: dwrite d1/da/d13/d41/f26 [0,4194304] 0 2024-04-03T08:39:17.887 INFO:tasks.workunit.client.1.smithi181.stdout:8/300: rename d4/d45/l55 to d4/d44/d59/l61 0 2024-04-03T08:39:17.888 INFO:tasks.workunit.client.0.smithi157.stdout:7/553: truncate d0/d11/d15/d1b/db8/fac 1114079 0 2024-04-03T08:39:17.889 INFO:tasks.workunit.client.1.smithi181.stdout:8/301: dread - d4/d45/db/d14/f50 zero size 2024-04-03T08:39:17.892 INFO:tasks.workunit.client.1.smithi181.stdout:8/302: write d4/d45/d9/f25 [382690,24882] 0 2024-04-03T08:39:17.893 INFO:tasks.workunit.client.0.smithi157.stdout:6/555: symlink d1/d5/d17/d2a/d30/d77/lbf 0 2024-04-03T08:39:17.893 INFO:tasks.workunit.client.1.smithi181.stdout:2/402: creat d13/d1c/d4a/d68/f9a x:0 0 0 2024-04-03T08:39:17.900 INFO:tasks.workunit.client.1.smithi181.stdout:3/352: creat d0/d17/f6e x:0 0 0 2024-04-03T08:39:17.904 INFO:tasks.workunit.client.1.smithi181.stdout:0/335: sync 2024-04-03T08:39:17.905 INFO:tasks.workunit.client.1.smithi181.stdout:7/292: creat d0/d1/d6/f68 x:0 0 0 2024-04-03T08:39:17.908 INFO:tasks.workunit.client.1.smithi181.stdout:4/415: mkdir d1/d16/d37/d34/d85 0 2024-04-03T08:39:17.909 INFO:tasks.workunit.client.1.smithi181.stdout:1/334: mkdir d10/d15/d4b/d62 0 2024-04-03T08:39:17.910 INFO:tasks.workunit.client.1.smithi181.stdout:7/293: chown d0/d1/d6/de/d17/d27/f4e 83 1 2024-04-03T08:39:17.911 INFO:tasks.workunit.client.1.smithi181.stdout:4/416: fdatasync d1/d1e/f2e 0 2024-04-03T08:39:17.911 INFO:tasks.workunit.client.0.smithi157.stdout:3/493: truncate d8/d1e/d2d/d39/f6c 501416 0 2024-04-03T08:39:17.912 INFO:tasks.workunit.client.0.smithi157.stdout:5/548: dread dc/d29/d56/d49/d53/f5a [0,4194304] 0 2024-04-03T08:39:17.914 INFO:tasks.workunit.client.1.smithi181.stdout:9/419: dread d1/da/d28/d30/f47 [0,4194304] 0 2024-04-03T08:39:17.915 INFO:tasks.workunit.client.1.smithi181.stdout:4/417: readlink d1/d16/d24/d5e/d31/d39/l3d 0 2024-04-03T08:39:17.915 INFO:tasks.workunit.client.0.smithi157.stdout:1/481: dwrite d2/d11/d23/f8c [0,4194304] 0 2024-04-03T08:39:17.916 INFO:tasks.workunit.client.0.smithi157.stdout:7/554: rmdir d0/d11/d15/d17/d43/d8a/d8f/d5b 39 2024-04-03T08:39:17.916 INFO:tasks.workunit.client.1.smithi181.stdout:2/403: dwrite d13/d7b/f7e [0,4194304] 0 2024-04-03T08:39:17.918 INFO:tasks.workunit.client.0.smithi157.stdout:5/549: chown dc/d29/d56/d18/f3e 710 1 2024-04-03T08:39:17.920 INFO:tasks.workunit.client.0.smithi157.stdout:7/555: chown d0/d11/d15/d17/d1c/d88 9566 1 2024-04-03T08:39:17.926 INFO:tasks.workunit.client.1.smithi181.stdout:9/420: dread d1/d34/d39/f59 [0,4194304] 0 2024-04-03T08:39:17.930 INFO:tasks.workunit.client.0.smithi157.stdout:7/556: fdatasync d0/d11/d15/d1b/db8/f95 0 2024-04-03T08:39:17.934 INFO:tasks.workunit.client.1.smithi181.stdout:5/342: sync 2024-04-03T08:39:17.934 INFO:tasks.workunit.client.1.smithi181.stdout:6/351: sync 2024-04-03T08:39:17.951 INFO:tasks.workunit.client.1.smithi181.stdout:2/404: rename d13/c15 to d13/d7b/c9b 0 2024-04-03T08:39:17.954 INFO:tasks.workunit.client.0.smithi157.stdout:3/494: rename d8/d1e/d2d/d39/d51/d48/da5 to d8/d1e/d2d/d39/d51/d48/dab 0 2024-04-03T08:39:17.956 INFO:tasks.workunit.client.0.smithi157.stdout:8/553: dwrite d2/f5a [0,4194304] 0 2024-04-03T08:39:17.957 INFO:tasks.workunit.client.0.smithi157.stdout:8/554: chown d2 237858 1 2024-04-03T08:39:17.960 INFO:tasks.workunit.client.0.smithi157.stdout:2/523: getdents d3/d2e/d65 0 2024-04-03T08:39:17.960 INFO:tasks.workunit.client.0.smithi157.stdout:0/520: dwrite d2/f25 [0,4194304] 0 2024-04-03T08:39:17.963 INFO:tasks.workunit.client.0.smithi157.stdout:2/524: write d3/db/fa1 [185448,109524] 0 2024-04-03T08:39:17.966 INFO:tasks.workunit.client.0.smithi157.stdout:5/550: write dc/d29/d56/f26 [4613479,6876] 0 2024-04-03T08:39:17.969 INFO:tasks.workunit.client.0.smithi157.stdout:5/551: truncate dc/d29/fa7 505668 0 2024-04-03T08:39:17.970 INFO:tasks.workunit.client.1.smithi181.stdout:0/336: dwrite d5/dc/d10/d58/d6c/f15 [0,4194304] 0 2024-04-03T08:39:17.977 INFO:tasks.workunit.client.0.smithi157.stdout:7/557: mkdir d0/d11/d6f/d89/d8c/dc6 0 2024-04-03T08:39:17.981 INFO:tasks.workunit.client.1.smithi181.stdout:3/353: truncate d0/d5/d6/f11 1412793 0 2024-04-03T08:39:17.986 INFO:tasks.workunit.client.1.smithi181.stdout:4/418: truncate d1/d16/d24/d5e/d2b/d56/f64 5318108 0 2024-04-03T08:39:17.989 INFO:tasks.workunit.client.1.smithi181.stdout:1/335: creat d10/d15/d4a/f63 x:0 0 0 2024-04-03T08:39:17.990 INFO:tasks.workunit.client.0.smithi157.stdout:9/478: getdents d1/d36/d69 0 2024-04-03T08:39:17.996 INFO:tasks.workunit.client.1.smithi181.stdout:3/354: dwrite d0/d17/f54 [0,4194304] 0 2024-04-03T08:39:17.998 INFO:tasks.workunit.client.1.smithi181.stdout:5/343: creat d4/d22/d53/f6d x:0 0 0 2024-04-03T08:39:18.009 INFO:tasks.workunit.client.1.smithi181.stdout:0/337: creat d5/dc/d10/d30/f6f x:0 0 0 2024-04-03T08:39:18.011 INFO:tasks.workunit.client.1.smithi181.stdout:0/338: chown d5/dc/d10/d58/d6c/f5d 58204935 1 2024-04-03T08:39:18.015 INFO:tasks.workunit.client.0.smithi157.stdout:2/525: read d3/d12/f68 [629470,76831] 0 2024-04-03T08:39:18.017 INFO:tasks.workunit.client.0.smithi157.stdout:5/552: rename dc/d29/d56/d18/d21/f93 to dc/d29/d43/fb7 0 2024-04-03T08:39:18.019 INFO:tasks.workunit.client.1.smithi181.stdout:6/352: unlink d6/d31/f48 0 2024-04-03T08:39:18.022 INFO:tasks.workunit.client.0.smithi157.stdout:7/558: creat d0/d11/d15/d17/d52/db6/fc7 x:0 0 0 2024-04-03T08:39:18.022 INFO:tasks.workunit.client.0.smithi157.stdout:5/553: write dc/d29/d56/d2e/fb3 [103840,105188] 0 2024-04-03T08:39:18.023 INFO:tasks.workunit.client.1.smithi181.stdout:1/336: creat d10/d15/d17/d19/d33/f64 x:0 0 0 2024-04-03T08:39:18.023 INFO:tasks.workunit.client.0.smithi157.stdout:6/556: getdents d1/d5/d17/d2a 0 2024-04-03T08:39:18.025 INFO:tasks.workunit.client.1.smithi181.stdout:1/337: chown d10/d15/d17/d19/d4c/l59 656513459 1 2024-04-03T08:39:18.026 INFO:tasks.workunit.client.1.smithi181.stdout:7/294: creat d0/d1/d6/de/f69 x:0 0 0 2024-04-03T08:39:18.027 INFO:tasks.workunit.client.0.smithi157.stdout:1/482: creat d2/d11/d24/d39/d3b/d2e/d48/f9e x:0 0 0 2024-04-03T08:39:18.027 INFO:tasks.workunit.client.0.smithi157.stdout:8/555: symlink d2/d11/lb9 0 2024-04-03T08:39:18.028 INFO:tasks.workunit.client.1.smithi181.stdout:5/344: mkdir d4/d18/d25/d6e 0 2024-04-03T08:39:18.029 INFO:tasks.workunit.client.0.smithi157.stdout:7/559: dread - d0/d11/d15/d17/d43/d8a/d8f/fc1 zero size 2024-04-03T08:39:18.029 INFO:tasks.workunit.client.1.smithi181.stdout:8/303: getdents d4/d2a/d37 0 2024-04-03T08:39:18.031 INFO:tasks.workunit.client.0.smithi157.stdout:1/483: chown d2/d11/d24/d39/d3b 23 1 2024-04-03T08:39:18.031 INFO:tasks.workunit.client.0.smithi157.stdout:8/556: stat d2/d11/d10/d24/d5b/d2e/d94 0 2024-04-03T08:39:18.032 INFO:tasks.workunit.client.0.smithi157.stdout:7/560: chown d0/d11/d15/d17/d43/d8a/fa6 26857 1 2024-04-03T08:39:18.034 INFO:tasks.workunit.client.1.smithi181.stdout:2/405: symlink d13/d22/d40/l9c 0 2024-04-03T08:39:18.035 INFO:tasks.workunit.client.0.smithi157.stdout:8/557: read d2/fb [12391152,112231] 0 2024-04-03T08:39:18.040 INFO:tasks.workunit.client.1.smithi181.stdout:0/339: unlink d5/d9/d2c/l31 0 2024-04-03T08:39:18.042 INFO:tasks.workunit.client.1.smithi181.stdout:4/419: fsync d1/d16/d24/d5e/f4f 0 2024-04-03T08:39:18.042 INFO:tasks.workunit.client.0.smithi157.stdout:5/554: creat dc/d29/d56/d9e/fb8 x:0 0 0 2024-04-03T08:39:18.044 INFO:tasks.workunit.client.1.smithi181.stdout:9/421: dwrite d1/f2f [0,4194304] 0 2024-04-03T08:39:18.045 INFO:tasks.workunit.client.1.smithi181.stdout:6/353: read d6/d31/f4d [546215,120737] 0 2024-04-03T08:39:18.045 INFO:tasks.workunit.client.0.smithi157.stdout:1/484: rmdir d2/d11/d24/d39/d3b/d1b 39 2024-04-03T08:39:18.048 INFO:tasks.workunit.client.0.smithi157.stdout:7/561: mknod d0/d11/d15/d17/d43/cc8 0 2024-04-03T08:39:18.049 INFO:tasks.workunit.client.1.smithi181.stdout:7/295: symlink d0/d1/d6/de/d17/l6a 0 2024-04-03T08:39:18.051 INFO:tasks.workunit.client.0.smithi157.stdout:8/558: creat d2/d6f/d70/d89/fba x:0 0 0 2024-04-03T08:39:18.054 INFO:tasks.workunit.client.1.smithi181.stdout:2/406: dread d13/d22/d27/f28 [0,4194304] 0 2024-04-03T08:39:18.055 INFO:tasks.workunit.client.1.smithi181.stdout:8/304: rename d4/d45/db/f4c to d4/d45/db/d14/f62 0 2024-04-03T08:39:18.061 INFO:tasks.workunit.client.1.smithi181.stdout:1/338: dwrite d10/f22 [0,4194304] 0 2024-04-03T08:39:18.064 INFO:tasks.workunit.client.0.smithi157.stdout:3/495: getdents d8/d1e/d2d/d39/d51/d48 0 2024-04-03T08:39:18.064 INFO:tasks.workunit.client.1.smithi181.stdout:0/340: write d5/dc/d10/d58/d6c/f5d [275123,116260] 0 2024-04-03T08:39:18.066 INFO:tasks.workunit.client.0.smithi157.stdout:4/496: sync 2024-04-03T08:39:18.070 INFO:tasks.workunit.client.1.smithi181.stdout:0/341: dread d5/dc/d10/d58/d6c/f53 [0,4194304] 0 2024-04-03T08:39:18.072 INFO:tasks.workunit.client.0.smithi157.stdout:5/555: symlink dc/d29/d56/d18/lb9 0 2024-04-03T08:39:18.074 INFO:tasks.workunit.client.0.smithi157.stdout:7/562: dwrite d0/d11/d15/d1b/db8/f3b [0,4194304] 0 2024-04-03T08:39:18.074 INFO:tasks.workunit.client.0.smithi157.stdout:5/556: write dc/f44 [1596941,126586] 0 2024-04-03T08:39:18.080 INFO:tasks.workunit.client.1.smithi181.stdout:4/420: mkdir d1/d16/d37/d34/d86 0 2024-04-03T08:39:18.082 INFO:tasks.workunit.client.0.smithi157.stdout:9/479: rename d1/d15/d16/f8f to d1/fa5 0 2024-04-03T08:39:18.083 INFO:tasks.workunit.client.1.smithi181.stdout:5/345: creat d4/d18/d3e/f6f x:0 0 0 2024-04-03T08:39:18.085 INFO:tasks.workunit.client.0.smithi157.stdout:3/496: mkdir d8/d1e/d2d/d39/d51/d48/dac 0 2024-04-03T08:39:18.088 INFO:tasks.workunit.client.0.smithi157.stdout:2/526: dwrite d3/d12/fe [0,4194304] 0 2024-04-03T08:39:18.089 INFO:tasks.workunit.client.1.smithi181.stdout:7/296: rename d0/d1/d6/de/d17/d27/l4b to d0/d1/d6/de/d17/d64/l6b 0 2024-04-03T08:39:18.091 INFO:tasks.workunit.client.1.smithi181.stdout:8/305: mknod d4/d45/db/d14/c63 0 2024-04-03T08:39:18.097 INFO:tasks.workunit.client.0.smithi157.stdout:1/485: unlink d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/l8f 0 2024-04-03T08:39:18.102 INFO:tasks.workunit.client.0.smithi157.stdout:1/486: dread - d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/f75 zero size 2024-04-03T08:39:18.105 INFO:tasks.workunit.client.1.smithi181.stdout:1/339: rmdir d10/d15/d4b 39 2024-04-03T08:39:18.109 INFO:tasks.workunit.client.0.smithi157.stdout:7/563: creat d0/d11/d15/d17/d43/fc9 x:0 0 0 2024-04-03T08:39:18.110 INFO:tasks.workunit.client.1.smithi181.stdout:4/421: dread d1/d1e/f1a [0,4194304] 0 2024-04-03T08:39:18.110 INFO:tasks.workunit.client.1.smithi181.stdout:8/306: read d4/d45/db/d14/d31/d1c/f2c [2050760,107179] 0 2024-04-03T08:39:18.115 INFO:tasks.workunit.client.0.smithi157.stdout:9/480: chown d1/d4a/l5d 2 1 2024-04-03T08:39:18.117 INFO:tasks.workunit.client.1.smithi181.stdout:5/346: creat d4/d18/d55/f70 x:0 0 0 2024-04-03T08:39:18.124 INFO:tasks.workunit.client.1.smithi181.stdout:7/297: mkdir d0/d6c 0 2024-04-03T08:39:18.124 INFO:tasks.workunit.client.1.smithi181.stdout:3/355: sync 2024-04-03T08:39:18.126 INFO:tasks.workunit.client.1.smithi181.stdout:3/356: write d0/d5/d6/f4c [931811,113677] 0 2024-04-03T08:39:18.126 INFO:tasks.workunit.client.0.smithi157.stdout:2/527: creat d3/d12/d43/d4b/d55/fbc x:0 0 0 2024-04-03T08:39:18.128 INFO:tasks.workunit.client.0.smithi157.stdout:5/557: mknod dc/d29/d56/d87/cba 0 2024-04-03T08:39:18.130 INFO:tasks.workunit.client.1.smithi181.stdout:9/422: truncate d1/da/d1a/f27 694200 0 2024-04-03T08:39:18.134 INFO:tasks.workunit.client.1.smithi181.stdout:0/342: symlink d5/dc/l70 0 2024-04-03T08:39:18.134 INFO:tasks.workunit.client.0.smithi157.stdout:3/497: write d8/d1e/d2d/d3b/f43 [2547673,4374] 0 2024-04-03T08:39:18.134 INFO:tasks.workunit.client.0.smithi157.stdout:7/564: chown d0/d11/d15/d17/d43/d8a/d8f/l9c 77677 1 2024-04-03T08:39:18.138 INFO:tasks.workunit.client.0.smithi157.stdout:3/498: write d8/f2f [6295527,3347] 0 2024-04-03T08:39:18.138 INFO:tasks.workunit.client.0.smithi157.stdout:9/481: mkdir d1/d15/d27/d34/da6 0 2024-04-03T08:39:18.140 INFO:tasks.workunit.client.1.smithi181.stdout:4/422: rmdir d1/d16/d24/d5e/d2b/d56 39 2024-04-03T08:39:18.141 INFO:tasks.workunit.client.0.smithi157.stdout:3/499: chown d8/d13/d1b/d4e/d50/d7c 11 1 2024-04-03T08:39:18.141 INFO:tasks.workunit.client.1.smithi181.stdout:4/423: chown d1/d16/d24/d5e 64 1 2024-04-03T08:39:18.143 INFO:tasks.workunit.client.0.smithi157.stdout:4/497: creat da/fad x:0 0 0 2024-04-03T08:39:18.145 INFO:tasks.workunit.client.0.smithi157.stdout:2/528: mkdir d3/d2e/d32/d9f/dbd 0 2024-04-03T08:39:18.157 INFO:tasks.workunit.client.0.smithi157.stdout:7/565: mkdir d0/d11/d15/d17/dca 0 2024-04-03T08:39:18.160 INFO:tasks.workunit.client.0.smithi157.stdout:9/482: stat d1/d15/d27/d5c/d79/f9d 0 2024-04-03T08:39:18.162 INFO:tasks.workunit.client.0.smithi157.stdout:3/500: symlink d8/d13/d1b/d4e/d50/lad 0 2024-04-03T08:39:18.165 INFO:tasks.workunit.client.1.smithi181.stdout:3/357: write d0/d5/d6/dd/f21 [4095050,120859] 0 2024-04-03T08:39:18.168 INFO:tasks.workunit.client.0.smithi157.stdout:4/498: rmdir da/df/d11 39 2024-04-03T08:39:18.170 INFO:tasks.workunit.client.1.smithi181.stdout:3/358: chown d0/d5/d6/dd/d25 439364880 1 2024-04-03T08:39:18.170 INFO:tasks.workunit.client.0.smithi157.stdout:5/558: mkdir dc/dbb 0 2024-04-03T08:39:18.173 INFO:tasks.workunit.client.1.smithi181.stdout:3/359: fdatasync d0/d17/f2e 0 2024-04-03T08:39:18.173 INFO:tasks.workunit.client.1.smithi181.stdout:6/354: sync 2024-04-03T08:39:18.176 INFO:tasks.workunit.client.0.smithi157.stdout:1/487: link d2/d11/d24/d39/d3b/d2e/f3e d2/d11/d24/d39/d3b/d2e/d48/d64/f9f 0 2024-04-03T08:39:18.176 INFO:tasks.workunit.client.1.smithi181.stdout:7/298: mkdir d0/d1/d6/de/d6d 0 2024-04-03T08:39:18.176 INFO:tasks.workunit.client.1.smithi181.stdout:6/355: readlink d6/d3e/l51 0 2024-04-03T08:39:18.177 INFO:tasks.workunit.client.1.smithi181.stdout:7/299: chown d0/d1/d6/de/d57 19983 1 2024-04-03T08:39:18.180 INFO:tasks.workunit.client.0.smithi157.stdout:6/557: rename d1/d5/d17/d2a/d40/d81 to d1/d5/d17/d29/dc0 0 2024-04-03T08:39:18.180 INFO:tasks.workunit.client.1.smithi181.stdout:8/307: write d4/d45/db/d14/f42 [4012342,90760] 0 2024-04-03T08:39:18.184 INFO:tasks.workunit.client.1.smithi181.stdout:3/360: dread d0/d5/d6/f4c [0,4194304] 0 2024-04-03T08:39:18.184 INFO:tasks.workunit.client.0.smithi157.stdout:3/501: unlink d8/d1e/d2d/d3f/l6d 0 2024-04-03T08:39:18.188 INFO:tasks.workunit.client.0.smithi157.stdout:5/559: truncate dc/d29/d43/f48 2609796 0 2024-04-03T08:39:18.190 INFO:tasks.workunit.client.0.smithi157.stdout:9/483: dwrite d1/d36/d46/f92 [0,4194304] 0 2024-04-03T08:39:18.190 INFO:tasks.workunit.client.0.smithi157.stdout:7/566: symlink d0/d11/d15/d1b/db4/lcb 0 2024-04-03T08:39:18.191 INFO:tasks.workunit.client.1.smithi181.stdout:4/424: rmdir d1/d16/d24/d5e/d3f/d41 39 2024-04-03T08:39:18.193 INFO:tasks.workunit.client.1.smithi181.stdout:4/425: read d1/d16/d24/d5e/d3f/f40 [658806,71073] 0 2024-04-03T08:39:18.194 INFO:tasks.workunit.client.0.smithi157.stdout:0/521: rename d2/d9/dc/df/d6f/d9d/d6a/f9f to d2/d9/dc/df/d1b/d35/d3d/fc1 0 2024-04-03T08:39:18.195 INFO:tasks.workunit.client.1.smithi181.stdout:4/426: chown d1/d16/d55 104572679 1 2024-04-03T08:39:18.196 INFO:tasks.workunit.client.1.smithi181.stdout:4/427: write d1/d1e/d2c/f77 [462766,78202] 0 2024-04-03T08:39:18.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.196+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f247c115e20 con 0x7f24600389d0 2024-04-03T08:39:18.199 INFO:tasks.workunit.client.0.smithi157.stdout:6/558: chown d1/d5/f1a 91 1 2024-04-03T08:39:18.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.199+0000 7f2473e00700 1 -- 172.21.15.157:0/848248610 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f247c115e20 con 0x7f24600389d0 2024-04-03T08:39:18.201 INFO:tasks.workunit.client.0.smithi157.stdout:2/529: dwrite d3/d12/d43/d4b/d55/f95 [0,4194304] 0 2024-04-03T08:39:18.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f24600389d0 msgr2=0x7f246003ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f24600389d0 0x7f246003ae80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f246c009b80 tx=0x7f246c00b040 comp rx=0 tx=0).stop 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 msgr2=0x7f247c114500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c114500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f246800b0d0 tx=0x7f2468009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 shutdown_connections 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f24600389d0 0x7f246003ae80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f247c0708f0 0x7f247c113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 --2- 172.21.15.157:0/848248610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f247c071ea0 0x7f247c114500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 >> 172.21.15.157:0/848248610 conn(0x7f247c0f8560 msgr2=0x7f247c0fa060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 shutdown_connections 2024-04-03T08:39:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.206+0000 7f2483200700 1 -- 172.21.15.157:0/848248610 wait complete. 2024-04-03T08:39:18.211 INFO:tasks.workunit.client.0.smithi157.stdout:4/499: link da/df/d2f/f4f da/df/d2f/d64/d8f/fae 0 2024-04-03T08:39:18.211 INFO:tasks.workunit.client.1.smithi181.stdout:1/340: rmdir d10/d15/d4b/d62 0 2024-04-03T08:39:18.214 INFO:tasks.workunit.client.0.smithi157.stdout:3/502: mknod d8/d1e/d2d/d3b/d8c/cae 0 2024-04-03T08:39:18.216 INFO:tasks.workunit.client.1.smithi181.stdout:9/423: link d1/da/d13/d22/f42 d1/da/d28/d30/f87 0 2024-04-03T08:39:18.218 INFO:tasks.workunit.client.1.smithi181.stdout:8/308: readlink d4/d45/db/l10 0 2024-04-03T08:39:18.220 INFO:tasks.workunit.client.1.smithi181.stdout:0/343: creat d5/dc/f71 x:0 0 0 2024-04-03T08:39:18.221 INFO:tasks.workunit.client.0.smithi157.stdout:9/484: chown d1/l10 1635098 1 2024-04-03T08:39:18.226 INFO:tasks.workunit.client.1.smithi181.stdout:5/347: getdents d4/d18/d25 0 2024-04-03T08:39:18.226 INFO:tasks.workunit.client.0.smithi157.stdout:5/560: mkdir dc/d29/d56/d49/d7f/dbc 0 2024-04-03T08:39:18.226 INFO:tasks.workunit.client.0.smithi157.stdout:9/485: chown d1/d15/d27/d34/f53 0 1 2024-04-03T08:39:18.229 INFO:tasks.workunit.client.0.smithi157.stdout:4/500: dread da/df/d6b/f88 [0,4194304] 0 2024-04-03T08:39:18.229 INFO:tasks.workunit.client.0.smithi157.stdout:8/559: rename d2/d11/f51 to d2/d6f/d70/fbb 0 2024-04-03T08:39:18.235 INFO:tasks.workunit.client.0.smithi157.stdout:9/486: truncate d1/d15/d27/d5c/d79/f7c 5033757 0 2024-04-03T08:39:18.236 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:39:18.238 INFO:tasks.workunit.client.1.smithi181.stdout:2/407: sync 2024-04-03T08:39:18.243 INFO:tasks.workunit.client.0.smithi157.stdout:0/522: truncate d2/d9/dc/df/d6f/d9d/f48 753421 0 2024-04-03T08:39:18.244 INFO:tasks.workunit.client.1.smithi181.stdout:6/356: getdents d6/d3e/d5e 0 2024-04-03T08:39:18.248 INFO:tasks.workunit.client.1.smithi181.stdout:9/424: stat d1/da/d13/d73/l70 0 2024-04-03T08:39:18.249 INFO:tasks.workunit.client.1.smithi181.stdout:8/309: creat d4/d44/f64 x:0 0 0 2024-04-03T08:39:18.250 INFO:tasks.workunit.client.1.smithi181.stdout:9/425: chown d1/d34/d39/f59 60 1 2024-04-03T08:39:18.250 INFO:tasks.workunit.client.0.smithi157.stdout:5/561: symlink dc/d29/d51/lbd 0 2024-04-03T08:39:18.251 INFO:tasks.workunit.client.0.smithi157.stdout:3/503: write d8/fc [1695207,20581] 0 2024-04-03T08:39:18.251 INFO:tasks.workunit.client.1.smithi181.stdout:8/310: read - d4/d45/db/d14/d31/d1c/f53 zero size 2024-04-03T08:39:18.253 INFO:tasks.workunit.client.0.smithi157.stdout:7/567: mknod d0/d11/d15/d17/d43/d8a/d8f/ccc 0 2024-04-03T08:39:18.254 INFO:tasks.workunit.client.0.smithi157.stdout:1/488: rename d2/d11/d24/f13 to d2/d11/d24/d39/d3b/d2e/d48/d86/fa0 0 2024-04-03T08:39:18.256 INFO:tasks.workunit.client.1.smithi181.stdout:3/361: truncate d0/d17/f2e 700037 0 2024-04-03T08:39:18.257 INFO:tasks.workunit.client.1.smithi181.stdout:0/344: fdatasync d5/dc/d14/d29/f4d 0 2024-04-03T08:39:18.258 INFO:tasks.workunit.client.1.smithi181.stdout:4/428: dwrite d1/d1e/f1a [4194304,4194304] 0 2024-04-03T08:39:18.258 INFO:tasks.workunit.client.0.smithi157.stdout:6/559: dread d1/d5/d17/d29/f5a [0,4194304] 0 2024-04-03T08:39:18.258 INFO:tasks.workunit.client.0.smithi157.stdout:4/501: creat da/df/d2f/d64/faf x:0 0 0 2024-04-03T08:39:18.258 INFO:tasks.workunit.client.0.smithi157.stdout:7/568: write d0/d11/d15/d17/fbc [314538,105729] 0 2024-04-03T08:39:18.259 INFO:tasks.workunit.client.1.smithi181.stdout:5/348: mkdir d4/d44/d71 0 2024-04-03T08:39:18.261 INFO:tasks.workunit.client.1.smithi181.stdout:4/429: read d1/d16/d24/d5e/d31/f65 [2354692,34536] 0 2024-04-03T08:39:18.261 INFO:tasks.workunit.client.0.smithi157.stdout:0/523: dread d2/d9/d36/f80 [0,4194304] 0 2024-04-03T08:39:18.261 INFO:tasks.workunit.client.0.smithi157.stdout:8/560: unlink d2/d11/d10/d24/d5b/d53/f8a 0 2024-04-03T08:39:18.263 INFO:tasks.workunit.client.1.smithi181.stdout:4/430: write d1/d1e/f1a [1711016,127065] 0 2024-04-03T08:39:18.274 INFO:tasks.workunit.client.1.smithi181.stdout:6/357: unlink d6/d7/d50/d5b/f65 0 2024-04-03T08:39:18.286 INFO:tasks.workunit.client.1.smithi181.stdout:2/408: write d13/d1c/d4a/d7f/f89 [2600093,33211] 0 2024-04-03T08:39:18.294 INFO:tasks.workunit.client.1.smithi181.stdout:7/300: truncate d0/d1/f15 6374914 0 2024-04-03T08:39:18.294 INFO:tasks.workunit.client.1.smithi181.stdout:2/409: dread d13/d1c/d4a/d68/f6f [0,4194304] 0 2024-04-03T08:39:18.295 INFO:tasks.workunit.client.0.smithi157.stdout:9/487: mkdir d1/d4a/da1/da7 0 2024-04-03T08:39:18.297 INFO:tasks.workunit.client.0.smithi157.stdout:6/560: mknod d1/d5/d17/d29/d80/cc1 0 2024-04-03T08:39:18.299 INFO:tasks.workunit.client.1.smithi181.stdout:0/345: creat d5/dc/d10/d30/d68/f72 x:0 0 0 2024-04-03T08:39:18.299 INFO:tasks.workunit.client.1.smithi181.stdout:0/346: stat d5/dc/d10/d30/l3d 0 2024-04-03T08:39:18.300 INFO:tasks.workunit.client.1.smithi181.stdout:0/347: fdatasync d5/dc/d10/f36 0 2024-04-03T08:39:18.301 INFO:tasks.workunit.client.0.smithi157.stdout:7/569: dread d0/f20 [0,4194304] 0 2024-04-03T08:39:18.302 INFO:tasks.workunit.client.0.smithi157.stdout:4/502: truncate da/f3e 4037961 0 2024-04-03T08:39:18.305 INFO:tasks.workunit.client.0.smithi157.stdout:6/561: truncate d1/d5/d17/fba 199644 0 2024-04-03T08:39:18.305 INFO:tasks.workunit.client.0.smithi157.stdout:0/524: write d2/d9/dc/df/d1b/fb4 [467550,116145] 0 2024-04-03T08:39:18.305 INFO:tasks.workunit.client.1.smithi181.stdout:0/348: fdatasync d5/d9/d2e/f39 0 2024-04-03T08:39:18.309 INFO:tasks.workunit.client.1.smithi181.stdout:8/311: symlink d4/d45/db/l65 0 2024-04-03T08:39:18.311 INFO:tasks.workunit.client.1.smithi181.stdout:0/349: chown d5/dc/d14/d29/f48 6 1 2024-04-03T08:39:18.312 INFO:tasks.workunit.client.1.smithi181.stdout:1/341: dwrite d10/d15/d17/f21 [0,4194304] 0 2024-04-03T08:39:18.313 INFO:tasks.workunit.client.1.smithi181.stdout:8/312: fsync d4/d45/db/d14/d31/d1c/f53 0 2024-04-03T08:39:18.315 INFO:tasks.workunit.client.1.smithi181.stdout:0/350: write d5/d9/f1d [444365,2115] 0 2024-04-03T08:39:18.315 INFO:tasks.workunit.client.0.smithi157.stdout:1/489: mkdir d2/d11/d24/d39/d3b/d2e/d48/da1 0 2024-04-03T08:39:18.316 INFO:tasks.workunit.client.1.smithi181.stdout:1/342: fsync d10/d15/d17/d37/f56 0 2024-04-03T08:39:18.317 INFO:tasks.workunit.client.1.smithi181.stdout:2/410: dwrite d13/d1c/f54 [0,4194304] 0 2024-04-03T08:39:18.321 INFO:tasks.workunit.client.0.smithi157.stdout:8/561: mkdir d2/d20/db1/dbc 0 2024-04-03T08:39:18.324 INFO:tasks.workunit.client.0.smithi157.stdout:2/530: getdents d3/d12/d43/d4b/d55 0 2024-04-03T08:39:18.333 INFO:tasks.workunit.client.1.smithi181.stdout:9/426: truncate d1/da/d13/d41/f26 132730 0 2024-04-03T08:39:18.335 INFO:tasks.workunit.client.0.smithi157.stdout:5/562: creat dc/fbe x:0 0 0 2024-04-03T08:39:18.337 INFO:tasks.workunit.client.1.smithi181.stdout:2/411: dwrite f11 [0,4194304] 0 2024-04-03T08:39:18.339 INFO:tasks.workunit.client.0.smithi157.stdout:3/504: link d8/d1e/d2d/d39/l77 d8/d1e/d2d/d39/d51/d4c/d32/laf 0 2024-04-03T08:39:18.342 INFO:tasks.workunit.client.1.smithi181.stdout:6/358: symlink d6/d31/d36/d73/l74 0 2024-04-03T08:39:18.344 INFO:tasks.workunit.client.1.smithi181.stdout:6/359: dread - d6/d7/f38 zero size 2024-04-03T08:39:18.350 INFO:tasks.workunit.client.0.smithi157.stdout:1/490: readlink d2/d11/d24/d39/d3b/l17 0 2024-04-03T08:39:18.350 INFO:tasks.workunit.client.0.smithi157.stdout:9/488: rmdir d1/d94/d75 39 2024-04-03T08:39:18.363 INFO:tasks.workunit.client.1.smithi181.stdout:3/362: rename d0/d5/d6/d32/d59 to d0/d5/d6f 0 2024-04-03T08:39:18.366 INFO:tasks.workunit.client.0.smithi157.stdout:1/491: read d2/d11/d23/f79 [1961319,60865] 0 2024-04-03T08:39:18.366 INFO:tasks.workunit.client.0.smithi157.stdout:7/570: dwrite d0/d11/d15/d17/d1c/f4b [0,4194304] 0 2024-04-03T08:39:18.367 INFO:tasks.workunit.client.1.smithi181.stdout:5/349: sync 2024-04-03T08:39:18.368 INFO:tasks.workunit.client.1.smithi181.stdout:5/350: truncate d4/d22/d4a/f50 823682 0 2024-04-03T08:39:18.375 INFO:tasks.workunit.client.1.smithi181.stdout:9/427: mkdir d1/d34/d39/d88 0 2024-04-03T08:39:18.380 INFO:tasks.workunit.client.0.smithi157.stdout:4/503: dwrite da/df/d24/d58/f5b [0,4194304] 0 2024-04-03T08:39:18.387 INFO:tasks.workunit.client.0.smithi157.stdout:2/531: symlink d3/lbe 0 2024-04-03T08:39:18.387 INFO:tasks.workunit.client.0.smithi157.stdout:5/563: dwrite dc/d29/d43/da1/fa8 [0,4194304] 0 2024-04-03T08:39:18.390 INFO:tasks.workunit.client.1.smithi181.stdout:4/431: rename d1/d1e/f1c to d1/d16/d24/d5e/d3f/d41/f87 0 2024-04-03T08:39:18.391 INFO:tasks.workunit.client.0.smithi157.stdout:6/562: dwrite d1/d5/d17/d2a/d73/f5c [0,4194304] 0 2024-04-03T08:39:18.395 INFO:tasks.workunit.client.1.smithi181.stdout:3/363: symlink d0/d5/d6f/l70 0 2024-04-03T08:39:18.397 INFO:tasks.workunit.client.1.smithi181.stdout:3/364: stat d0/d5/d6/l67 0 2024-04-03T08:39:18.400 INFO:tasks.workunit.client.0.smithi157.stdout:0/525: link d2/d9/dc/df/d1b/d35/d3d/f58 d2/d9/dc/df/fc2 0 2024-04-03T08:39:18.402 INFO:tasks.workunit.client.0.smithi157.stdout:5/564: read dc/d29/f38 [1864636,3885] 0 2024-04-03T08:39:18.404 INFO:tasks.workunit.client.0.smithi157.stdout:2/532: dread d3/d2e/d32/d3c/f52 [0,4194304] 0 2024-04-03T08:39:18.414 INFO:tasks.workunit.client.0.smithi157.stdout:3/505: rmdir d8/d13/d1b/d4e/d50/d7c/daa 0 2024-04-03T08:39:18.416 INFO:tasks.workunit.client.1.smithi181.stdout:6/360: mknod d6/d53/c75 0 2024-04-03T08:39:18.416 INFO:tasks.workunit.client.1.smithi181.stdout:7/301: dwrite d0/d1/f66 [0,4194304] 0 2024-04-03T08:39:18.421 INFO:tasks.workunit.client.1.smithi181.stdout:8/313: creat d4/d45/db/f66 x:0 0 0 2024-04-03T08:39:18.426 INFO:tasks.workunit.client.1.smithi181.stdout:0/351: creat d5/dc/d14/d29/f73 x:0 0 0 2024-04-03T08:39:18.428 INFO:tasks.workunit.client.0.smithi157.stdout:4/504: rename f4 to da/df/d24/d35/d6a/d78/fb0 0 2024-04-03T08:39:18.428 INFO:tasks.workunit.client.1.smithi181.stdout:0/352: truncate d5/f6a 713462 0 2024-04-03T08:39:18.431 INFO:tasks.workunit.client.0.smithi157.stdout:6/563: fdatasync d1/d5/f46 0 2024-04-03T08:39:18.434 INFO:tasks.workunit.client.1.smithi181.stdout:6/361: dwrite d6/d31/d36/f4c [4194304,4194304] 0 2024-04-03T08:39:18.436 INFO:tasks.workunit.client.0.smithi157.stdout:5/565: dwrite f7 [0,4194304] 0 2024-04-03T08:39:18.438 INFO:tasks.workunit.client.0.smithi157.stdout:8/562: dread d2/fb [8388608,4194304] 0 2024-04-03T08:39:18.439 INFO:tasks.workunit.client.0.smithi157.stdout:6/564: write d1/d5/d17/d2a/d37/f8e [223979,37871] 0 2024-04-03T08:39:18.439 INFO:tasks.workunit.client.0.smithi157.stdout:7/571: dread d0/d11/f1d [0,4194304] 0 2024-04-03T08:39:18.447 INFO:tasks.workunit.client.0.smithi157.stdout:5/566: truncate dc/d29/d56/d9e/fb8 216877 0 2024-04-03T08:39:18.450 INFO:tasks.workunit.client.1.smithi181.stdout:0/353: dwrite d5/dc/d14/d29/d46/f63 [0,4194304] 0 2024-04-03T08:39:18.452 INFO:tasks.workunit.client.0.smithi157.stdout:9/489: creat d1/d15/d27/fa8 x:0 0 0 2024-04-03T08:39:18.456 INFO:tasks.workunit.client.0.smithi157.stdout:3/506: creat d8/d13/fb0 x:0 0 0 2024-04-03T08:39:18.457 INFO:tasks.workunit.client.1.smithi181.stdout:5/351: mkdir d4/d22/d72 0 2024-04-03T08:39:18.459 INFO:tasks.workunit.client.1.smithi181.stdout:5/352: chown d4/d18/c2b 26 1 2024-04-03T08:39:18.459 INFO:tasks.workunit.client.0.smithi157.stdout:1/492: write d2/f3 [1493877,9429] 0 2024-04-03T08:39:18.460 INFO:tasks.workunit.client.1.smithi181.stdout:2/412: write d13/d22/d27/d2f/f5c [1879581,39696] 0 2024-04-03T08:39:18.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.464+0000 7f038fe00700 1 -- 172.21.15.157:0/3987295327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fce80 msgr2=0x7f03880fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:18.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.464+0000 7f038fe00700 1 --2- 172.21.15.157:0/3987295327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fce80 0x7f03880fd290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f037c004940 tx=0x7f037c009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:18.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.465+0000 7f038fe00700 1 -- 172.21.15.157:0/3987295327 shutdown_connections 2024-04-03T08:39:18.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.465+0000 7f038fe00700 1 --2- 172.21.15.157:0/3987295327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03880fdff0 0x7f03880fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.465+0000 7f038fe00700 1 --2- 172.21.15.157:0/3987295327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fce80 0x7f03880fd290 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.465+0000 7f038fe00700 1 -- 172.21.15.157:0/3987295327 >> 172.21.15.157:0/3987295327 conn(0x7f03880f8560 msgr2=0x7f03880fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:18.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.465+0000 7f038fe00700 1 -- 172.21.15.157:0/3987295327 shutdown_connections 2024-04-03T08:39:18.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.467+0000 7f038fe00700 1 -- 172.21.15.157:0/3987295327 wait complete. 2024-04-03T08:39:18.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.468+0000 7f038fe00700 1 Processor -- start 2024-04-03T08:39:18.469 INFO:tasks.workunit.client.0.smithi157.stdout:0/526: rename d2/d9/dc/df/d1b/d4a/f2f to d2/d9/dc/df/d6f/dad/dbb/fc3 0 2024-04-03T08:39:18.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.469+0000 7f038fe00700 1 -- start start 2024-04-03T08:39:18.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.469+0000 7f038fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03880fce80 0x7f038810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:18.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.469+0000 7f038fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 0x7f03881100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:18.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.469+0000 7f038fe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03881106d0 con 0x7f03880fdff0 2024-04-03T08:39:18.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.469+0000 7f038fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388110f20 con 0x7f03880fce80 2024-04-03T08:39:18.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.472+0000 7f038ca00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 0x7f03881100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:18.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.472+0000 7f038ca00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 0x7f03881100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48286/0 (socket says 172.21.15.157:48286) 2024-04-03T08:39:18.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.472+0000 7f038ca00700 1 -- 172.21.15.157:0/477093732 learned_addr learned my addr 172.21.15.157:0/477093732 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:18.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.472+0000 7f038ca00700 1 -- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03880fce80 msgr2=0x7f038810fb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-03T08:39:18.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.472+0000 7f038ca00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03880fce80 0x7f038810fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.472+0000 7f038ca00700 1 -- 172.21.15.157:0/477093732 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c005040 con 0x7f03880fdff0 2024-04-03T08:39:18.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.473+0000 7f038ca00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 0x7f03881100d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f037400eb40 tx=0x7f037400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:18.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.473+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0374007cc0 con 0x7f03880fdff0 2024-04-03T08:39:18.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.473+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f037400f040 con 0x7f03880fdff0 2024-04-03T08:39:18.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.473+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03740095e0 con 0x7f03880fdff0 2024-04-03T08:39:18.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.473+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03881111a0 con 0x7f03880fdff0 2024-04-03T08:39:18.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.474+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03881116e0 con 0x7f03880fdff0 2024-04-03T08:39:18.476 INFO:tasks.workunit.client.0.smithi157.stdout:4/505: creat da/df/d6b/fb1 x:0 0 0 2024-04-03T08:39:18.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.475+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0388101980 con 0x7f03880fdff0 2024-04-03T08:39:18.476 INFO:tasks.workunit.client.1.smithi181.stdout:7/302: write d0/d1/d6/de/f42 [657583,43037] 0 2024-04-03T08:39:18.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.476+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f0374009740 con 0x7f03880fdff0 2024-04-03T08:39:18.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.477+0000 7f0385600700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f0370038a70 0x7f037003af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:18.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.477+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f037404c200 con 0x7f03880fdff0 2024-04-03T08:39:18.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.477+0000 7f038d400700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f0370038a70 0x7f037003af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:18.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.478+0000 7f038d400700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f0370038a70 0x7f037003af20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f037c009fd0 tx=0x7f037c009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:18.480 INFO:tasks.workunit.client.1.smithi181.stdout:1/343: getdents d10/d15/d17 0 2024-04-03T08:39:18.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.484+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f037400c680 con 0x7f03880fdff0 2024-04-03T08:39:18.484 INFO:tasks.workunit.client.1.smithi181.stdout:9/428: write d1/da/d1a/f27 [1021575,37193] 0 2024-04-03T08:39:18.487 INFO:tasks.workunit.client.0.smithi157.stdout:7/572: mkdir d0/d11/d15/d17/d1c/d4f/dcd 0 2024-04-03T08:39:18.489 INFO:tasks.workunit.client.1.smithi181.stdout:8/314: sync 2024-04-03T08:39:18.490 INFO:tasks.workunit.client.0.smithi157.stdout:7/573: readlink d0/d11/d15/d17/d1c/d4f/l97 0 2024-04-03T08:39:18.492 INFO:tasks.workunit.client.0.smithi157.stdout:5/567: unlink dc/d29/d56/d2e/ca0 0 2024-04-03T08:39:18.493 INFO:tasks.workunit.client.0.smithi157.stdout:9/490: unlink d1/d15/d27/d5c/c8c 0 2024-04-03T08:39:18.504 INFO:tasks.workunit.client.0.smithi157.stdout:0/527: chown d2/d9/dc/df/d1b/la8 1050580 1 2024-04-03T08:39:18.504 INFO:tasks.workunit.client.1.smithi181.stdout:9/429: dread d1/da/d1a/f4c [0,4194304] 0 2024-04-03T08:39:18.507 INFO:tasks.workunit.client.0.smithi157.stdout:0/528: stat d2/d9/dc/df/d1b/d35/d3d/fc1 0 2024-04-03T08:39:18.511 INFO:tasks.workunit.client.0.smithi157.stdout:2/533: dwrite d3/f4e [0,4194304] 0 2024-04-03T08:39:18.512 INFO:tasks.workunit.client.1.smithi181.stdout:4/432: creat d1/d16/d24/d5e/d31/d39/d5d/f88 x:0 0 0 2024-04-03T08:39:18.513 INFO:tasks.workunit.client.0.smithi157.stdout:0/529: truncate d2/d9/d5f/d85/f86 8816479 0 2024-04-03T08:39:18.515 INFO:tasks.workunit.client.0.smithi157.stdout:0/530: dread - d2/d9/d36/d38/fa7 zero size 2024-04-03T08:39:18.516 INFO:tasks.workunit.client.1.smithi181.stdout:0/354: unlink d5/d9/c42 0 2024-04-03T08:39:18.523 INFO:tasks.workunit.client.1.smithi181.stdout:7/303: chown d0/d1/f4a 19977840 1 2024-04-03T08:39:18.529 INFO:tasks.workunit.client.0.smithi157.stdout:8/563: link d2/d11/d10/d24/d5b/d2e/d75/ca8 d2/d20/d77/cbd 0 2024-04-03T08:39:18.536 INFO:tasks.workunit.client.0.smithi157.stdout:3/507: dread d8/d1e/d2d/d3f/f44 [0,4194304] 0 2024-04-03T08:39:18.542 INFO:tasks.workunit.client.0.smithi157.stdout:0/531: creat d2/d9/dc/df/d1b/d4a/fc4 x:0 0 0 2024-04-03T08:39:18.545 INFO:tasks.workunit.client.0.smithi157.stdout:8/564: dread d2/d11/d10/d24/fa1 [0,4194304] 0 2024-04-03T08:39:18.549 INFO:tasks.workunit.client.0.smithi157.stdout:8/565: write d2/d6f/fb6 [943834,42776] 0 2024-04-03T08:39:18.549 INFO:tasks.workunit.client.0.smithi157.stdout:6/565: rename d1/d5/d17/d29/d62/d7f/fad to d1/d5/fc2 0 2024-04-03T08:39:18.552 INFO:tasks.workunit.client.0.smithi157.stdout:4/506: dread da/df/f18 [0,4194304] 0 2024-04-03T08:39:18.557 INFO:tasks.workunit.client.0.smithi157.stdout:9/491: dwrite d1/d15/d16/f65 [0,4194304] 0 2024-04-03T08:39:18.559 INFO:tasks.workunit.client.0.smithi157.stdout:2/534: unlink d3/d12/l1c 0 2024-04-03T08:39:18.561 INFO:tasks.workunit.client.0.smithi157.stdout:5/568: creat dc/d29/d56/fbf x:0 0 0 2024-04-03T08:39:18.562 INFO:tasks.workunit.client.1.smithi181.stdout:7/304: chown d0/d1/d6/cb 450276 1 2024-04-03T08:39:18.564 INFO:tasks.workunit.client.1.smithi181.stdout:7/305: fdatasync d0/d1/d6/de/f5e 0 2024-04-03T08:39:18.566 INFO:tasks.workunit.client.1.smithi181.stdout:8/315: dread d4/d45/db/f3a [0,4194304] 0 2024-04-03T08:39:18.566 INFO:tasks.workunit.client.1.smithi181.stdout:1/344: unlink l7 0 2024-04-03T08:39:18.569 INFO:tasks.workunit.client.1.smithi181.stdout:6/362: rename d6/d7/d9/l11 to d6/l76 0 2024-04-03T08:39:18.570 INFO:tasks.workunit.client.0.smithi157.stdout:3/508: dread d8/d13/f56 [0,4194304] 0 2024-04-03T08:39:18.572 INFO:tasks.workunit.client.0.smithi157.stdout:7/574: rename d0/d4/d8e/d96/f98 to d0/d11/d15/d1b/db8/fce 0 2024-04-03T08:39:18.575 INFO:tasks.workunit.client.1.smithi181.stdout:4/433: mknod d1/d1e/d82/d84/c89 0 2024-04-03T08:39:18.575 INFO:tasks.workunit.client.1.smithi181.stdout:0/355: sync 2024-04-03T08:39:18.576 INFO:tasks.workunit.client.1.smithi181.stdout:3/365: link d0/d17/d36/d1e/c37 d0/d17/d36/d3b/d5a/c71 0 2024-04-03T08:39:18.577 INFO:tasks.workunit.client.1.smithi181.stdout:4/434: write d1/d16/d24/f47 [1502120,78956] 0 2024-04-03T08:39:18.578 INFO:tasks.workunit.client.1.smithi181.stdout:5/353: creat d4/d18/f73 x:0 0 0 2024-04-03T08:39:18.579 INFO:tasks.workunit.client.0.smithi157.stdout:9/492: rmdir d1/d15/d27/d5c/d79 39 2024-04-03T08:39:18.581 INFO:tasks.workunit.client.1.smithi181.stdout:2/413: creat d13/d1c/f9d x:0 0 0 2024-04-03T08:39:18.581 INFO:tasks.workunit.client.1.smithi181.stdout:4/435: truncate d1/d1e/f2e 4570042 0 2024-04-03T08:39:18.582 INFO:tasks.workunit.client.1.smithi181.stdout:2/414: dread - d13/d1c/d4a/d68/f9a zero size 2024-04-03T08:39:18.582 INFO:tasks.workunit.client.1.smithi181.stdout:4/436: readlink d1/d16/d24/d5e/d3f/d41/l44 0 2024-04-03T08:39:18.584 INFO:tasks.workunit.client.1.smithi181.stdout:2/415: stat d13/d1c/d6c/d7a 0 2024-04-03T08:39:18.588 INFO:tasks.workunit.client.1.smithi181.stdout:8/316: mkdir d4/d2a/d37/d67 0 2024-04-03T08:39:18.589 INFO:tasks.workunit.client.1.smithi181.stdout:8/317: dread - d4/d45/db/f66 zero size 2024-04-03T08:39:18.592 INFO:tasks.workunit.client.1.smithi181.stdout:6/363: fdatasync d6/d7/d50/d64/f67 0 2024-04-03T08:39:18.592 INFO:tasks.workunit.client.1.smithi181.stdout:3/366: dwrite d0/d17/d36/d1e/f31 [4194304,4194304] 0 2024-04-03T08:39:18.592 INFO:tasks.workunit.client.1.smithi181.stdout:8/318: rename d4/d44/d59 to d4/d44/d59/d68 22 2024-04-03T08:39:18.595 INFO:tasks.workunit.client.1.smithi181.stdout:3/367: chown d0/d17/d36/c3c 0 1 2024-04-03T08:39:18.595 INFO:tasks.workunit.client.1.smithi181.stdout:9/430: write d1/da/d28/d30/f6a [106039,110430] 0 2024-04-03T08:39:18.598 INFO:tasks.workunit.client.0.smithi157.stdout:8/566: rename d2/d7b/c84 to d2/d11/d10/d24/d5b/d53/cbe 0 2024-04-03T08:39:18.602 INFO:tasks.workunit.client.0.smithi157.stdout:7/575: stat d0/d11/d15/d17/d43/d8a/d8f/d5b/c6c 0 2024-04-03T08:39:18.604 INFO:tasks.workunit.client.1.smithi181.stdout:5/354: mknod d4/d18/d25/c74 0 2024-04-03T08:39:18.605 INFO:tasks.workunit.client.0.smithi157.stdout:6/566: getdents d1/d4b/d61/d92 0 2024-04-03T08:39:18.605 INFO:tasks.workunit.client.1.smithi181.stdout:7/306: creat d0/d1/d6/de/d6d/f6e x:0 0 0 2024-04-03T08:39:18.607 INFO:tasks.workunit.client.1.smithi181.stdout:7/307: chown d0/d1/d6/l35 55 1 2024-04-03T08:39:18.607 INFO:tasks.workunit.client.0.smithi157.stdout:7/576: write d0/d11/d15/d1b/f39 [2643171,14887] 0 2024-04-03T08:39:18.610 INFO:tasks.workunit.client.1.smithi181.stdout:2/416: truncate d13/f23 4787156 0 2024-04-03T08:39:18.611 INFO:tasks.workunit.client.1.smithi181.stdout:2/417: stat d13/d1c/c2b 0 2024-04-03T08:39:18.611 INFO:tasks.workunit.client.0.smithi157.stdout:6/567: stat d1/d5/f1a 0 2024-04-03T08:39:18.615 INFO:tasks.workunit.client.0.smithi157.stdout:5/569: dwrite dc/d29/d51/f64 [0,4194304] 0 2024-04-03T08:39:18.615 INFO:tasks.workunit.client.1.smithi181.stdout:6/364: mkdir d6/d7/d9/d22/d4f/d77 0 2024-04-03T08:39:18.618 INFO:tasks.workunit.client.0.smithi157.stdout:5/570: dread - dc/d29/d56/d18/fab zero size 2024-04-03T08:39:18.619 INFO:tasks.workunit.client.0.smithi157.stdout:7/577: truncate d0/d11/d6f/d76/da7/fb9 65956 0 2024-04-03T08:39:18.621 INFO:tasks.workunit.client.0.smithi157.stdout:3/509: mkdir d8/d1e/d2d/d39/d51/d7e/db1 0 2024-04-03T08:39:18.623 INFO:tasks.workunit.client.1.smithi181.stdout:7/308: dwrite d0/f3b [0,4194304] 0 2024-04-03T08:39:18.624 INFO:tasks.workunit.client.1.smithi181.stdout:9/431: creat d1/da/d13/d22/d23/f89 x:0 0 0 2024-04-03T08:39:18.625 INFO:tasks.workunit.client.0.smithi157.stdout:3/510: stat d8/d1e/d2d/d39/d51/d48/l9b 0 2024-04-03T08:39:18.626 INFO:tasks.workunit.client.0.smithi157.stdout:8/567: dwrite d2/d6f/fb6 [0,4194304] 0 2024-04-03T08:39:18.626 INFO:tasks.workunit.client.0.smithi157.stdout:4/507: rename da/df/d2f/d54/fa0 to da/df/d11/d5d/fb2 0 2024-04-03T08:39:18.632 INFO:tasks.workunit.client.1.smithi181.stdout:1/345: sync 2024-04-03T08:39:18.637 INFO:tasks.workunit.client.0.smithi157.stdout:3/511: chown d8/d1e/d2d/d39/d51/d4c/f78 249672856 1 2024-04-03T08:39:18.637 INFO:tasks.workunit.client.0.smithi157.stdout:8/568: write d2/d11/f90 [3044984,128887] 0 2024-04-03T08:39:18.643 INFO:tasks.workunit.client.0.smithi157.stdout:5/571: dread dc/d29/f46 [0,4194304] 0 2024-04-03T08:39:18.645 INFO:tasks.workunit.client.1.smithi181.stdout:1/346: dread d10/f22 [0,4194304] 0 2024-04-03T08:39:18.646 INFO:tasks.workunit.client.1.smithi181.stdout:3/368: write d0/d5/fa [2258228,126485] 0 2024-04-03T08:39:18.648 INFO:tasks.workunit.client.1.smithi181.stdout:4/437: mknod d1/d16/d37/d34/d85/c8a 0 2024-04-03T08:39:18.650 INFO:tasks.workunit.client.1.smithi181.stdout:8/319: dwrite d4/d45/db/f3a [0,4194304] 0 2024-04-03T08:39:18.650 INFO:tasks.workunit.client.0.smithi157.stdout:9/493: mknod d1/d94/ca9 0 2024-04-03T08:39:18.653 INFO:tasks.workunit.client.1.smithi181.stdout:6/365: symlink d6/d3e/d40/d63/l78 0 2024-04-03T08:39:18.658 INFO:tasks.workunit.client.0.smithi157.stdout:9/494: write d1/f93 [650595,72695] 0 2024-04-03T08:39:18.662 INFO:tasks.workunit.client.0.smithi157.stdout:7/578: fdatasync d0/d11/d15/f1f 0 2024-04-03T08:39:18.662 INFO:tasks.workunit.client.0.smithi157.stdout:9/495: chown d1/d15/d27 0 1 2024-04-03T08:39:18.663 INFO:tasks.workunit.client.1.smithi181.stdout:5/355: write d4/d22/f26 [7530915,125113] 0 2024-04-03T08:39:18.665 INFO:tasks.workunit.client.0.smithi157.stdout:4/508: dwrite da/d26/f3d [4194304,4194304] 0 2024-04-03T08:39:18.666 INFO:tasks.workunit.client.0.smithi157.stdout:7/579: chown d0/d11/d15/d17/d52/db6/fc7 249 1 2024-04-03T08:39:18.668 INFO:tasks.workunit.client.1.smithi181.stdout:7/309: rmdir d0/d1 39 2024-04-03T08:39:18.677 INFO:tasks.workunit.client.1.smithi181.stdout:9/432: mknod d1/da/d28/d30/c8a 0 2024-04-03T08:39:18.678 INFO:tasks.workunit.client.1.smithi181.stdout:9/433: chown d1/d34 58267155 1 2024-04-03T08:39:18.681 INFO:tasks.workunit.client.1.smithi181.stdout:0/356: creat d5/f74 x:0 0 0 2024-04-03T08:39:18.684 INFO:tasks.workunit.client.0.smithi157.stdout:2/535: getdents d3/d2e 0 2024-04-03T08:39:18.686 INFO:tasks.workunit.client.0.smithi157.stdout:2/536: fdatasync d3/da6/fb9 0 2024-04-03T08:39:18.689 INFO:tasks.workunit.client.1.smithi181.stdout:1/347: rmdir d10/d15 39 2024-04-03T08:39:18.692 INFO:tasks.workunit.client.1.smithi181.stdout:3/369: symlink d0/d5/d6/dd/d25/l72 0 2024-04-03T08:39:18.695 INFO:tasks.workunit.client.0.smithi157.stdout:4/509: fsync da/df/d2f/d64/d8f/fae 0 2024-04-03T08:39:18.700 INFO:tasks.workunit.client.1.smithi181.stdout:5/356: creat d4/d56/f75 x:0 0 0 2024-04-03T08:39:18.701 INFO:tasks.workunit.client.1.smithi181.stdout:5/357: dread - d4/d18/d3e/f57 zero size 2024-04-03T08:39:18.704 INFO:tasks.workunit.client.1.smithi181.stdout:8/320: write d4/fc [2071047,109075] 0 2024-04-03T08:39:18.705 INFO:tasks.workunit.client.0.smithi157.stdout:4/510: dread da/f8b [0,4194304] 0 2024-04-03T08:39:18.705 INFO:tasks.workunit.client.0.smithi157.stdout:6/568: dwrite d1/d5/d17/d2a/d40/f7e [0,4194304] 0 2024-04-03T08:39:18.706 INFO:tasks.workunit.client.1.smithi181.stdout:8/321: stat d4/d45/db/d14/f50 0 2024-04-03T08:39:18.711 INFO:tasks.workunit.client.1.smithi181.stdout:1/348: dread - d10/d15/d17/d23/d27/f43 zero size 2024-04-03T08:39:18.712 INFO:tasks.workunit.client.1.smithi181.stdout:3/370: symlink d0/d17/d40/l73 0 2024-04-03T08:39:18.717 INFO:tasks.workunit.client.1.smithi181.stdout:2/418: creat d13/d22/d27/d2f/f9e x:0 0 0 2024-04-03T08:39:18.719 INFO:tasks.workunit.client.1.smithi181.stdout:5/358: dwrite d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:18.723 INFO:tasks.workunit.client.1.smithi181.stdout:5/359: chown d4/f5e 6 1 2024-04-03T08:39:18.726 INFO:tasks.workunit.client.1.smithi181.stdout:9/434: symlink d1/l8b 0 2024-04-03T08:39:18.728 INFO:tasks.workunit.client.1.smithi181.stdout:0/357: dwrite d5/d9/d60/f61 [0,4194304] 0 2024-04-03T08:39:18.731 INFO:tasks.workunit.client.1.smithi181.stdout:5/360: read d4/ff [2526339,52273] 0 2024-04-03T08:39:18.736 INFO:tasks.workunit.client.1.smithi181.stdout:7/310: dread d0/d1/f21 [0,4194304] 0 2024-04-03T08:39:18.738 INFO:tasks.workunit.client.1.smithi181.stdout:1/349: creat d10/d15/d17/d30/f65 x:0 0 0 2024-04-03T08:39:18.739 INFO:tasks.workunit.client.1.smithi181.stdout:6/366: write d6/d7/d9/f15 [3561493,16314] 0 2024-04-03T08:39:18.741 INFO:tasks.workunit.client.1.smithi181.stdout:7/311: write d0/d1/d6/de/d17/f55 [137320,37131] 0 2024-04-03T08:39:18.742 INFO:tasks.workunit.client.1.smithi181.stdout:6/367: dread - d6/d7/d9/d22/d4f/f66 zero size 2024-04-03T08:39:18.745 INFO:tasks.workunit.client.1.smithi181.stdout:6/368: dread - d6/f70 zero size 2024-04-03T08:39:18.748 INFO:tasks.workunit.client.1.smithi181.stdout:8/322: dread d4/d45/f7 [0,4194304] 0 2024-04-03T08:39:18.748 INFO:tasks.workunit.client.1.smithi181.stdout:0/358: dread - d5/dc/d14/f3c zero size 2024-04-03T08:39:18.749 INFO:tasks.workunit.client.1.smithi181.stdout:4/438: link d1/d16/d24/d5e/d2b/l4d d1/d16/l8b 0 2024-04-03T08:39:18.751 INFO:tasks.workunit.client.1.smithi181.stdout:3/371: getdents d0/d17/d56 0 2024-04-03T08:39:18.760 INFO:tasks.workunit.client.1.smithi181.stdout:7/312: creat d0/d1/d6/de/d57/f6f x:0 0 0 2024-04-03T08:39:18.764 INFO:tasks.workunit.client.1.smithi181.stdout:0/359: dread d5/d9/f1d [4194304,4194304] 0 2024-04-03T08:39:18.766 INFO:tasks.workunit.client.1.smithi181.stdout:9/435: write d1/da/d28/d30/f87 [382169,40983] 0 2024-04-03T08:39:18.767 INFO:tasks.workunit.client.1.smithi181.stdout:5/361: truncate d4/f39 4164553 0 2024-04-03T08:39:18.771 INFO:tasks.workunit.client.0.smithi157.stdout:7/580: symlink d0/d11/d15/lcf 0 2024-04-03T08:39:18.784 INFO:tasks.workunit.client.1.smithi181.stdout:2/419: rename d13/d1c/d4a/d68/c2d to d13/d22/c9f 0 2024-04-03T08:39:18.784 INFO:tasks.workunit.client.0.smithi157.stdout:8/569: link d2/d7b/lb0 d2/d6f/lbf 0 2024-04-03T08:39:18.785 INFO:tasks.workunit.client.1.smithi181.stdout:6/369: write d6/d7/d9/d22/d4f/f55 [600690,9335] 0 2024-04-03T08:39:18.788 INFO:tasks.workunit.client.1.smithi181.stdout:4/439: dwrite d1/d16/d24/d5e/d2b/d56/f71 [0,4194304] 0 2024-04-03T08:39:18.790 INFO:tasks.workunit.client.0.smithi157.stdout:9/496: creat d1/d15/d27/d5c/faa x:0 0 0 2024-04-03T08:39:18.791 INFO:tasks.workunit.client.1.smithi181.stdout:7/313: mknod d0/d1/d6/de/d17/d27/c70 0 2024-04-03T08:39:18.806 INFO:tasks.workunit.client.0.smithi157.stdout:6/569: dwrite d1/f42 [0,4194304] 0 2024-04-03T08:39:18.807 INFO:tasks.workunit.client.1.smithi181.stdout:3/372: mknod d0/d57/c74 0 2024-04-03T08:39:18.810 INFO:tasks.workunit.client.0.smithi157.stdout:4/511: dwrite da/f6f [0,4194304] 0 2024-04-03T08:39:18.810 INFO:tasks.workunit.client.1.smithi181.stdout:9/436: rename d1/da/d28/d30/l4d to d1/da/d28/d30/d3e/d77/l8c 0 2024-04-03T08:39:18.820 INFO:tasks.workunit.client.1.smithi181.stdout:6/370: rmdir d6/d31 39 2024-04-03T08:39:18.825 INFO:tasks.workunit.client.1.smithi181.stdout:3/373: dwrite d0/d5/d6/f39 [0,4194304] 0 2024-04-03T08:39:18.826 INFO:tasks.workunit.client.0.smithi157.stdout:8/570: stat d2/d6f/d70/d89/d59/d9e/ca2 0 2024-04-03T08:39:18.826 INFO:tasks.workunit.client.1.smithi181.stdout:1/350: rmdir d10/d15/d17/d23/d5b 0 2024-04-03T08:39:18.827 INFO:tasks.workunit.client.0.smithi157.stdout:2/537: link d3/db/l3a d3/d2e/d65/lbf 0 2024-04-03T08:39:18.828 INFO:tasks.workunit.client.0.smithi157.stdout:4/512: dwrite da/df/d24/d35/f87 [0,4194304] 0 2024-04-03T08:39:18.830 INFO:tasks.workunit.client.1.smithi181.stdout:1/351: fdatasync d10/d15/d17/d19/d33/f64 0 2024-04-03T08:39:18.831 INFO:tasks.workunit.client.0.smithi157.stdout:2/538: write d3/d2e/d65/fac [55962,92212] 0 2024-04-03T08:39:18.832 INFO:tasks.workunit.client.1.smithi181.stdout:5/362: write d4/f16 [1614939,27229] 0 2024-04-03T08:39:18.832 INFO:tasks.workunit.client.1.smithi181.stdout:1/352: write d10/d15/d17/d37/f54 [432811,129541] 0 2024-04-03T08:39:18.832 INFO:tasks.workunit.client.1.smithi181.stdout:7/314: rmdir d0/d1/d6/de/d17/d27 39 2024-04-03T08:39:18.837 INFO:tasks.workunit.client.1.smithi181.stdout:1/353: read - d10/d15/d17/d30/f65 zero size 2024-04-03T08:39:18.841 INFO:tasks.workunit.client.0.smithi157.stdout:9/497: write d1/f2e [616421,103491] 0 2024-04-03T08:39:18.842 INFO:tasks.workunit.client.0.smithi157.stdout:8/571: creat d2/d6f/d70/fc0 x:0 0 0 2024-04-03T08:39:18.845 INFO:tasks.workunit.client.0.smithi157.stdout:7/581: truncate d0/d11/d6f/d76/da7/f62 6241630 0 2024-04-03T08:39:18.845 INFO:tasks.workunit.client.0.smithi157.stdout:4/513: readlink da/df/l12 0 2024-04-03T08:39:18.846 INFO:tasks.workunit.client.1.smithi181.stdout:6/371: dwrite d6/d7/d9/f15 [0,4194304] 0 2024-04-03T08:39:18.849 INFO:tasks.workunit.client.0.smithi157.stdout:1/493: sync 2024-04-03T08:39:18.851 INFO:tasks.workunit.client.1.smithi181.stdout:8/323: dwrite d4/f5 [4194304,4194304] 0 2024-04-03T08:39:18.853 INFO:tasks.workunit.client.1.smithi181.stdout:6/372: chown d6/d7/f3f 1360355 1 2024-04-03T08:39:18.853 INFO:tasks.workunit.client.1.smithi181.stdout:8/324: stat d4/f27 0 2024-04-03T08:39:18.857 INFO:tasks.workunit.client.1.smithi181.stdout:9/437: fsync d1/da/d28/d30/f47 0 2024-04-03T08:39:18.867 INFO:tasks.workunit.client.1.smithi181.stdout:3/374: creat d0/d5/d6f/f75 x:0 0 0 2024-04-03T08:39:18.867 INFO:tasks.workunit.client.0.smithi157.stdout:2/539: fdatasync d3/d12/f11 0 2024-04-03T08:39:18.873 INFO:tasks.workunit.client.0.smithi157.stdout:9/498: mkdir d1/dab 0 2024-04-03T08:39:18.875 INFO:tasks.workunit.client.1.smithi181.stdout:0/360: truncate d5/dc/d14/d29/f4d 498252 0 2024-04-03T08:39:18.876 INFO:tasks.workunit.client.1.smithi181.stdout:0/361: chown d5/d9/f32 54956203 1 2024-04-03T08:39:18.880 INFO:tasks.workunit.client.0.smithi157.stdout:1/494: dwrite d2/f88 [0,4194304] 0 2024-04-03T08:39:18.886 INFO:tasks.workunit.client.0.smithi157.stdout:6/570: getdents d1/d4b/da5 0 2024-04-03T08:39:18.888 INFO:tasks.workunit.client.0.smithi157.stdout:4/514: dwrite da/df/d2f/d97/f9a [0,4194304] 0 2024-04-03T08:39:18.889 INFO:tasks.workunit.client.1.smithi181.stdout:1/354: unlink d10/d15/d17/c4f 0 2024-04-03T08:39:18.893 INFO:tasks.workunit.client.1.smithi181.stdout:2/420: dwrite d13/d22/d40/f42 [0,4194304] 0 2024-04-03T08:39:18.894 INFO:tasks.workunit.client.1.smithi181.stdout:4/440: write d1/d16/d24/d5e/f50 [193337,72173] 0 2024-04-03T08:39:18.895 INFO:tasks.workunit.client.1.smithi181.stdout:6/373: creat d6/d53/f79 x:0 0 0 2024-04-03T08:39:18.896 INFO:tasks.workunit.client.1.smithi181.stdout:4/441: stat d1/d16/c22 0 2024-04-03T08:39:18.901 INFO:tasks.workunit.client.0.smithi157.stdout:9/499: rmdir d1/d15/d27/d5c 39 2024-04-03T08:39:18.904 INFO:tasks.workunit.client.0.smithi157.stdout:6/571: mknod d1/d4b/d38/da6/cc3 0 2024-04-03T08:39:18.905 INFO:tasks.workunit.client.0.smithi157.stdout:1/495: truncate d2/d11/d24/d39/f61 2045514 0 2024-04-03T08:39:18.906 INFO:tasks.workunit.client.0.smithi157.stdout:4/515: creat da/df/d2f/d54/d5f/fb3 x:0 0 0 2024-04-03T08:39:18.906 INFO:tasks.workunit.client.0.smithi157.stdout:9/500: dread - d1/d4a/d4d/f9b zero size 2024-04-03T08:39:18.907 INFO:tasks.workunit.client.0.smithi157.stdout:8/572: dwrite d2/d6f/d70/d89/f5e [0,4194304] 0 2024-04-03T08:39:18.909 INFO:tasks.workunit.client.0.smithi157.stdout:5/572: sync 2024-04-03T08:39:18.912 INFO:tasks.workunit.client.1.smithi181.stdout:7/315: symlink d0/l71 0 2024-04-03T08:39:18.913 INFO:tasks.workunit.client.0.smithi157.stdout:7/582: link d0/d11/d15/d17/d1c/d4f/d5f/l7f d0/d11/ld0 0 2024-04-03T08:39:18.913 INFO:tasks.workunit.client.0.smithi157.stdout:0/532: sync 2024-04-03T08:39:18.915 INFO:tasks.workunit.client.0.smithi157.stdout:5/573: read dc/d29/d56/d18/d21/f94 [3481040,76514] 0 2024-04-03T08:39:18.915 INFO:tasks.workunit.client.0.smithi157.stdout:3/512: sync 2024-04-03T08:39:18.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.916+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0388111950 con 0x7f0370038a70 2024-04-03T08:39:18.923 INFO:tasks.workunit.client.1.smithi181.stdout:8/325: write d4/d45/db/d14/d31/d1c/f2c [3994446,3534] 0 2024-04-03T08:39:18.927 INFO:tasks.workunit.client.1.smithi181.stdout:4/442: mknod d1/d16/d55/c8c 0 2024-04-03T08:39:18.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.924+0000 7f0385600700 1 -- 172.21.15.157:0/477093732 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0388111950 con 0x7f0370038a70 2024-04-03T08:39:18.931 INFO:tasks.workunit.client.1.smithi181.stdout:9/438: truncate d1/da/d13/d41/f26 371618 0 2024-04-03T08:39:18.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f0370038a70 msgr2=0x7f037003af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f0370038a70 0x7f037003af20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f037c009fd0 tx=0x7f037c009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 msgr2=0x7f03881100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 0x7f03881100d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f037400eb40 tx=0x7f037400b040 comp rx=0 tx=0).stop 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 shutdown_connections 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f0370038a70 0x7f037003af20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03880fce80 0x7f038810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 --2- 172.21.15.157:0/477093732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03880fdff0 0x7f03881100d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.930+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 >> 172.21.15.157:0/477093732 conn(0x7f03880f8560 msgr2=0x7f03880f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.931+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 shutdown_connections 2024-04-03T08:39:18.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:18.931+0000 7f038fe00700 1 -- 172.21.15.157:0/477093732 wait complete. 2024-04-03T08:39:18.933 INFO:tasks.workunit.client.1.smithi181.stdout:3/375: creat d0/d17/d63/f76 x:0 0 0 2024-04-03T08:39:18.934 INFO:tasks.workunit.client.1.smithi181.stdout:0/362: mkdir d5/dc/d75 0 2024-04-03T08:39:18.934 INFO:tasks.workunit.client.1.smithi181.stdout:9/439: chown d1/da/d13/d22/d23/l72 163 1 2024-04-03T08:39:18.936 INFO:tasks.workunit.client.0.smithi157.stdout:7/583: fdatasync d0/d4/f2d 0 2024-04-03T08:39:18.939 INFO:tasks.workunit.client.0.smithi157.stdout:0/533: stat d2/d9/dc/c9c 0 2024-04-03T08:39:18.939 INFO:tasks.workunit.client.1.smithi181.stdout:7/316: fdatasync d0/d1/f51 0 2024-04-03T08:39:18.939 INFO:tasks.workunit.client.1.smithi181.stdout:2/421: dread ff [0,4194304] 0 2024-04-03T08:39:18.941 INFO:tasks.workunit.client.1.smithi181.stdout:7/317: dread - d0/d1/d6/f68 zero size 2024-04-03T08:39:18.944 INFO:tasks.workunit.client.0.smithi157.stdout:7/584: write d0/d11/d15/f87 [801635,82828] 0 2024-04-03T08:39:18.944 INFO:tasks.workunit.client.0.smithi157.stdout:5/574: creat dc/d29/d51/fc0 x:0 0 0 2024-04-03T08:39:18.949 INFO:tasks.workunit.client.1.smithi181.stdout:5/363: write d4/f39 [1666457,78438] 0 2024-04-03T08:39:18.951 INFO:tasks.workunit.client.1.smithi181.stdout:0/363: dwrite d5/dc/d14/d29/f47 [0,4194304] 0 2024-04-03T08:39:18.953 INFO:tasks.workunit.client.0.smithi157.stdout:1/496: rename d2/d11/d23/d73/f8a to d2/d11/d24/d39/d3b/d1b/d84/fa2 0 2024-04-03T08:39:18.957 INFO:tasks.workunit.client.0.smithi157.stdout:4/516: dwrite da/df/d24/d35/d3c/fa7 [0,4194304] 0 2024-04-03T08:39:18.957 INFO:tasks.workunit.client.0.smithi157.stdout:8/573: write d2/d6f/f71 [613593,115320] 0 2024-04-03T08:39:18.962 INFO:tasks.workunit.client.1.smithi181.stdout:4/443: unlink d1/d1e/f1a 0 2024-04-03T08:39:18.974 INFO:tasks.workunit.client.0.smithi157.stdout:2/540: truncate d3/d12/f20 471648 0 2024-04-03T08:39:18.981 INFO:tasks.workunit.client.0.smithi157.stdout:3/513: creat d8/d13/d1b/d83/fb2 x:0 0 0 2024-04-03T08:39:18.984 INFO:tasks.workunit.client.1.smithi181.stdout:1/355: mkdir d10/d15/d17/d19/d4c/d66 0 2024-04-03T08:39:18.985 INFO:tasks.workunit.client.1.smithi181.stdout:9/440: creat d1/da/d13/d22/f8d x:0 0 0 2024-04-03T08:39:18.985 INFO:tasks.workunit.client.1.smithi181.stdout:9/441: stat d1/da/d13/d73 0 2024-04-03T08:39:18.987 INFO:tasks.workunit.client.1.smithi181.stdout:2/422: rename d13/d22/d27/c3e to d13/d1c/d4a/d7f/ca0 0 2024-04-03T08:39:18.990 INFO:tasks.workunit.client.0.smithi157.stdout:5/575: mknod dc/d29/d56/d9e/cc1 0 2024-04-03T08:39:18.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/514: write d8/fc [4099322,2393] 0 2024-04-03T08:39:18.995 INFO:tasks.workunit.client.0.smithi157.stdout:8/574: dread d2/d20/f65 [0,4194304] 0 2024-04-03T08:39:18.996 INFO:tasks.workunit.client.1.smithi181.stdout:0/364: creat d5/d9/d2c/f76 x:0 0 0 2024-04-03T08:39:18.997 INFO:tasks.workunit.client.0.smithi157.stdout:1/497: dwrite d2/d11/d24/d39/d3b/f5c [0,4194304] 0 2024-04-03T08:39:18.998 INFO:tasks.workunit.client.1.smithi181.stdout:8/326: mknod d4/d45/db/d5c/d5e/c69 0 2024-04-03T08:39:19.004 INFO:tasks.workunit.client.0.smithi157.stdout:4/517: dwrite da/df/d24/d35/d3c/fa7 [0,4194304] 0 2024-04-03T08:39:19.008 INFO:tasks.workunit.client.0.smithi157.stdout:2/541: rename d3/db/d44/d4c/l5d to d3/db/d44/d4c/lc0 0 2024-04-03T08:39:19.010 INFO:tasks.workunit.client.0.smithi157.stdout:5/576: write dc/d29/d56/f26 [3529625,96856] 0 2024-04-03T08:39:19.012 INFO:tasks.workunit.client.0.smithi157.stdout:4/518: read - da/df/d2f/d54/d5f/fb3 zero size 2024-04-03T08:39:19.019 INFO:tasks.workunit.client.0.smithi157.stdout:0/534: write d2/d9/d36/f80 [295530,74106] 0 2024-04-03T08:39:19.021 INFO:tasks.workunit.client.1.smithi181.stdout:3/376: mkdir d0/d5/d77 0 2024-04-03T08:39:19.025 INFO:tasks.workunit.client.1.smithi181.stdout:2/423: chown d13/d22/d27/d2f/c3f 106268809 1 2024-04-03T08:39:19.026 INFO:tasks.workunit.client.0.smithi157.stdout:3/515: creat d8/d13/d1b/d4e/d50/d7c/fb3 x:0 0 0 2024-04-03T08:39:19.027 INFO:tasks.workunit.client.0.smithi157.stdout:8/575: mkdir d2/d6f/d70/d89/d59/dc1 0 2024-04-03T08:39:19.029 INFO:tasks.workunit.client.1.smithi181.stdout:5/364: creat d4/d18/d55/d5a/f76 x:0 0 0 2024-04-03T08:39:19.033 INFO:tasks.workunit.client.1.smithi181.stdout:6/374: truncate d6/d31/d36/f5d 37182 0 2024-04-03T08:39:19.038 INFO:tasks.workunit.client.0.smithi157.stdout:4/519: creat da/df/d2f/d54/fb4 x:0 0 0 2024-04-03T08:39:19.042 INFO:tasks.workunit.client.0.smithi157.stdout:0/535: unlink d2/d9/d36/d82/l9a 0 2024-04-03T08:39:19.051 INFO:tasks.workunit.client.0.smithi157.stdout:2/542: symlink d3/d2e/d65/dae/lc1 0 2024-04-03T08:39:19.052 INFO:tasks.workunit.client.0.smithi157.stdout:1/498: write d2/d11/d23/f57 [1045139,87197] 0 2024-04-03T08:39:19.053 INFO:tasks.workunit.client.1.smithi181.stdout:8/327: symlink d4/d45/db/d5c/d5e/l6a 0 2024-04-03T08:39:19.054 INFO:tasks.workunit.client.1.smithi181.stdout:4/444: fdatasync d1/d16/d24/d5e/f3c 0 2024-04-03T08:39:19.055 INFO:tasks.workunit.client.1.smithi181.stdout:6/375: read - d6/d7/f3f zero size 2024-04-03T08:39:19.057 INFO:tasks.workunit.client.0.smithi157.stdout:8/576: mknod d2/d20/d77/cc2 0 2024-04-03T08:39:19.057 INFO:tasks.workunit.client.0.smithi157.stdout:7/585: dwrite d0/d11/d15/d17/d43/d8a/fc2 [0,4194304] 0 2024-04-03T08:39:19.059 INFO:tasks.workunit.client.1.smithi181.stdout:6/376: read d6/d7/f20 [2466676,108439] 0 2024-04-03T08:39:19.059 INFO:tasks.workunit.client.0.smithi157.stdout:3/516: mkdir d8/d1e/d2d/d3b/d8c/db4 0 2024-04-03T08:39:19.060 INFO:tasks.workunit.client.0.smithi157.stdout:5/577: symlink dc/dbb/lc2 0 2024-04-03T08:39:19.063 INFO:tasks.workunit.client.1.smithi181.stdout:5/365: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:19.063 INFO:tasks.workunit.client.1.smithi181.stdout:6/377: truncate d6/d7/d50/d64/f67 678114 0 2024-04-03T08:39:19.064 INFO:tasks.workunit.client.1.smithi181.stdout:5/366: fsync d4/f5e 0 2024-04-03T08:39:19.069 INFO:tasks.workunit.client.1.smithi181.stdout:1/356: link d10/d15/c29 d10/d15/d4b/c67 0 2024-04-03T08:39:19.070 INFO:tasks.workunit.client.1.smithi181.stdout:2/424: mkdir d13/d1c/d4a/d68/d72/da1 0 2024-04-03T08:39:19.071 INFO:tasks.workunit.client.1.smithi181.stdout:2/425: chown ff 1820 1 2024-04-03T08:39:19.072 INFO:tasks.workunit.client.0.smithi157.stdout:4/520: fdatasync da/df/d11/d5d/fb2 0 2024-04-03T08:39:19.073 INFO:tasks.workunit.client.1.smithi181.stdout:5/367: chown d4/d18/d2c/f2e 810869287 1 2024-04-03T08:39:19.074 INFO:tasks.workunit.client.1.smithi181.stdout:0/365: rename d5/dc/f12 to d5/dc/d14/f77 0 2024-04-03T08:39:19.076 INFO:tasks.workunit.client.0.smithi157.stdout:0/536: symlink d2/d9/dc/df/d6f/d9d/d6a/d91/lc5 0 2024-04-03T08:39:19.077 INFO:tasks.workunit.client.1.smithi181.stdout:5/368: read d4/f13 [311148,46994] 0 2024-04-03T08:39:19.080 INFO:tasks.workunit.client.0.smithi157.stdout:2/543: creat d3/d2e/d65/fc2 x:0 0 0 2024-04-03T08:39:19.081 INFO:tasks.workunit.client.1.smithi181.stdout:4/445: mknod d1/d16/d24/d5e/d3f/d41/c8d 0 2024-04-03T08:39:19.081 INFO:tasks.workunit.client.0.smithi157.stdout:1/499: dread d2/d11/d23/f8c [0,4194304] 0 2024-04-03T08:39:19.082 INFO:tasks.workunit.client.1.smithi181.stdout:4/446: dread - d1/d16/d24/d5e/f4f zero size 2024-04-03T08:39:19.082 INFO:tasks.workunit.client.0.smithi157.stdout:2/544: readlink d3/lbe 0 2024-04-03T08:39:19.084 INFO:tasks.workunit.client.1.smithi181.stdout:7/318: sync 2024-04-03T08:39:19.089 INFO:tasks.workunit.client.0.smithi157.stdout:7/586: symlink d0/d11/d15/d17/d9f/ld1 0 2024-04-03T08:39:19.090 INFO:tasks.workunit.client.0.smithi157.stdout:8/577: rename d2/d11/d10/d24/fa1 to d2/d11/d10/d24/d5b/d2e/d75/da9/fc3 0 2024-04-03T08:39:19.093 INFO:tasks.workunit.client.0.smithi157.stdout:8/578: truncate d2/d11/ff 1943843 0 2024-04-03T08:39:19.097 INFO:tasks.workunit.client.0.smithi157.stdout:0/537: creat d2/d9/d36/fc6 x:0 0 0 2024-04-03T08:39:19.098 INFO:tasks.workunit.client.1.smithi181.stdout:2/426: truncate d13/d22/f7c 9070 0 2024-04-03T08:39:19.099 INFO:tasks.workunit.client.0.smithi157.stdout:0/538: dread - d2/d9/d36/d38/faf zero size 2024-04-03T08:39:19.100 INFO:tasks.workunit.client.1.smithi181.stdout:0/366: dread - d5/f40 zero size 2024-04-03T08:39:19.102 INFO:tasks.workunit.client.1.smithi181.stdout:1/357: dread d10/d15/d17/f21 [0,4194304] 0 2024-04-03T08:39:19.102 INFO:tasks.workunit.client.1.smithi181.stdout:0/367: chown d5/d9/d2a 52410280 1 2024-04-03T08:39:19.103 INFO:tasks.workunit.client.1.smithi181.stdout:0/368: read - d5/dc/f71 zero size 2024-04-03T08:39:19.104 INFO:tasks.workunit.client.1.smithi181.stdout:5/369: unlink d4/d18/d25/c37 0 2024-04-03T08:39:19.104 INFO:tasks.workunit.client.1.smithi181.stdout:0/369: write d5/d9/d2a/f64 [249317,31970] 0 2024-04-03T08:39:19.106 INFO:tasks.workunit.client.1.smithi181.stdout:0/370: fsync d5/f40 0 2024-04-03T08:39:19.108 INFO:tasks.workunit.client.1.smithi181.stdout:4/447: unlink d1/d16/d24/d5e/d3f/d41/c8d 0 2024-04-03T08:39:19.110 INFO:tasks.workunit.client.0.smithi157.stdout:7/587: unlink d0/d11/d15/d17/d1c/f5c 0 2024-04-03T08:39:19.114 INFO:tasks.workunit.client.0.smithi157.stdout:4/521: symlink da/df/lb5 0 2024-04-03T08:39:19.116 INFO:tasks.workunit.client.0.smithi157.stdout:8/579: symlink d2/d6f/d70/d89/d59/lc4 0 2024-04-03T08:39:19.122 INFO:tasks.workunit.client.1.smithi181.stdout:2/427: rename f11 to d13/d1c/d6c/fa2 0 2024-04-03T08:39:19.123 INFO:tasks.workunit.client.0.smithi157.stdout:2/545: mknod d3/cc3 0 2024-04-03T08:39:19.126 INFO:tasks.workunit.client.0.smithi157.stdout:0/539: mknod d2/d9/dc/df/d6f/d9d/d6a/d91/cc7 0 2024-04-03T08:39:19.127 INFO:tasks.workunit.client.1.smithi181.stdout:0/371: stat d5/dc/d10/d58/d6c/f26 0 2024-04-03T08:39:19.129 INFO:tasks.workunit.client.1.smithi181.stdout:0/372: fsync d5/dc/d14/d29/f73 0 2024-04-03T08:39:19.129 INFO:tasks.workunit.client.0.smithi157.stdout:1/500: mkdir d2/d11/d24/d39/d3b/d2e/d48/d58/d94/da3 0 2024-04-03T08:39:19.132 INFO:tasks.workunit.client.0.smithi157.stdout:0/540: dread d2/d9/dc/df/fc2 [0,4194304] 0 2024-04-03T08:39:19.137 INFO:tasks.workunit.client.1.smithi181.stdout:7/319: chown d0/d1/d6/de/d17/d27/c43 1586544 1 2024-04-03T08:39:19.138 INFO:tasks.workunit.client.0.smithi157.stdout:7/588: symlink d0/d75/ld2 0 2024-04-03T08:39:19.141 INFO:tasks.workunit.client.0.smithi157.stdout:4/522: fdatasync da/df/d24/f59 0 2024-04-03T08:39:19.142 INFO:tasks.workunit.client.1.smithi181.stdout:9/442: sync 2024-04-03T08:39:19.148 INFO:tasks.workunit.client.1.smithi181.stdout:2/428: creat d13/d1c/d4a/d68/fa3 x:0 0 0 2024-04-03T08:39:19.150 INFO:tasks.workunit.client.1.smithi181.stdout:5/370: mkdir d4/d18/d25/d68/d77 0 2024-04-03T08:39:19.151 INFO:tasks.workunit.client.1.smithi181.stdout:5/371: chown d4/d56 20408 1 2024-04-03T08:39:19.152 INFO:tasks.workunit.client.1.smithi181.stdout:5/372: dread - d4/d18/d25/f52 zero size 2024-04-03T08:39:19.153 INFO:tasks.workunit.client.0.smithi157.stdout:3/517: rename d8/d1e/d2d/d39/d51/d48/l9b to d8/d13/d1b/lb5 0 2024-04-03T08:39:19.157 INFO:tasks.workunit.client.1.smithi181.stdout:4/448: creat d1/d16/d37/d34/d69/f8e x:0 0 0 2024-04-03T08:39:19.158 INFO:tasks.workunit.client.0.smithi157.stdout:1/501: dread d2/d11/d23/d73/f8e [0,4194304] 0 2024-04-03T08:39:19.158 INFO:tasks.workunit.client.1.smithi181.stdout:8/328: getdents d4/d45/db/d14/d31/d1c 0 2024-04-03T08:39:19.159 INFO:tasks.workunit.client.1.smithi181.stdout:4/449: dread - d1/d16/d24/d5e/d3f/f6b zero size 2024-04-03T08:39:19.159 INFO:tasks.workunit.client.0.smithi157.stdout:2/546: symlink d3/d12/lc4 0 2024-04-03T08:39:19.161 INFO:tasks.workunit.client.1.smithi181.stdout:6/378: getdents d6/d7/d50/d64 0 2024-04-03T08:39:19.163 INFO:tasks.workunit.client.0.smithi157.stdout:8/580: rename d2/d11/d10/d24/d5b/d2e/f80 to d2/d20/d23/fc5 0 2024-04-03T08:39:19.164 INFO:tasks.workunit.client.0.smithi157.stdout:1/502: dread - d2/d11/d24/d39/d3b/d2e/d48/d58/d62/f95 zero size 2024-04-03T08:39:19.168 INFO:tasks.workunit.client.1.smithi181.stdout:1/358: rename d10/d15/d17/f2a to d10/d15/d17/d19/f68 0 2024-04-03T08:39:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 -- 172.21.15.157:0/1470425193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8070890 msgr2=0x7f7ba8070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 --2- 172.21.15.157:0/1470425193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8070890 0x7f7ba8070d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b94004970 tx=0x7f7b94009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 -- 172.21.15.157:0/1470425193 shutdown_connections 2024-04-03T08:39:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 --2- 172.21.15.157:0/1470425193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8070890 0x7f7ba8070d00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 --2- 172.21.15.157:0/1470425193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8071e40 0x7f7ba8070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 -- 172.21.15.157:0/1470425193 >> 172.21.15.157:0/1470425193 conn(0x7f7ba80f8540 msgr2=0x7f7ba80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:19.170 INFO:tasks.workunit.client.0.smithi157.stdout:3/518: mknod d8/d1e/d2d/d39/d51/cb6 0 2024-04-03T08:39:19.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.169+0000 7f7bafc00700 1 -- 172.21.15.157:0/1470425193 shutdown_connections 2024-04-03T08:39:19.171 INFO:tasks.workunit.client.0.smithi157.stdout:3/519: fdatasync d8/d13/fb0 0 2024-04-03T08:39:19.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.170+0000 7f7bafc00700 1 -- 172.21.15.157:0/1470425193 wait complete. 2024-04-03T08:39:19.171 INFO:tasks.workunit.client.1.smithi181.stdout:2/429: rmdir d13/d1c/d4a/d7f 39 2024-04-03T08:39:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.171+0000 7f7bafc00700 1 Processor -- start 2024-04-03T08:39:19.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.172+0000 7f7bafc00700 1 -- start start 2024-04-03T08:39:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.173+0000 7f7bafc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8070890 0x7f7ba806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:19.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.173+0000 7f7bafc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 0x7f7ba806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.173+0000 7f7bafc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba806eec0 con 0x7f7ba8070890 2024-04-03T08:39:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.174+0000 7f7bafc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba806f000 con 0x7f7ba8071e40 2024-04-03T08:39:19.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.174+0000 7f7b9fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 0x7f7ba806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:19.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.174+0000 7f7b9fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 0x7f7ba806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:56860/0 (socket says 172.21.15.157:56860) 2024-04-03T08:39:19.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.174+0000 7f7b9fe00700 1 -- 172.21.15.157:0/938717552 learned_addr learned my addr 172.21.15.157:0/938717552 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:19.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.174+0000 7f7bad200700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8070890 0x7f7ba806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:19.175 INFO:tasks.workunit.client.0.smithi157.stdout:2/547: truncate d3/d12/fd 1494499 0 2024-04-03T08:39:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.175+0000 7f7b9fe00700 1 -- 172.21.15.157:0/938717552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8070890 msgr2=0x7f7ba806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.175+0000 7f7b9fe00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8070890 0x7f7ba806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.175+0000 7f7b9fe00700 1 -- 172.21.15.157:0/938717552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94005040 con 0x7f7ba8071e40 2024-04-03T08:39:19.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.175+0000 7f7bad200700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8070890 0x7f7ba806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:39:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.176+0000 7f7b9fe00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 0x7f7ba806e980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b94007d40 tx=0x7f7b94009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.176+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9400e030 con 0x7f7ba8071e40 2024-04-03T08:39:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.176+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b9400bbb0 con 0x7f7ba8071e40 2024-04-03T08:39:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.176+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9401c640 con 0x7f7ba8071e40 2024-04-03T08:39:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.176+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba806f280 con 0x7f7ba8071e40 2024-04-03T08:39:19.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.177+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba811e2f0 con 0x7f7ba8071e40 2024-04-03T08:39:19.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.178+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f7b9400bd20 con 0x7f7ba8071e40 2024-04-03T08:39:19.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.178+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba805f5f0 con 0x7f7ba8071e40 2024-04-03T08:39:19.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.178+0000 7f7ba5600700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f7b8c038a60 0x7f7b8c03af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:19.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.178+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7b9404df10 con 0x7f7ba8071e40 2024-04-03T08:39:19.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.179+0000 7f7bad200700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f7b8c038a60 0x7f7b8c03af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:19.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.181+0000 7f7bad200700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f7b8c038a60 0x7f7b8c03af10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7ba806fcb0 tx=0x7f7b980096a0 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:19.189 INFO:tasks.workunit.client.1.smithi181.stdout:2/430: dwrite f12 [4194304,4194304] 0 2024-04-03T08:39:19.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.190+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f7b94023540 con 0x7f7ba8071e40 2024-04-03T08:39:19.213 INFO:tasks.workunit.client.0.smithi157.stdout:7/589: rename d0/f93 to d0/d11/d15/d17/d1c/da1/fd3 0 2024-04-03T08:39:19.215 INFO:tasks.workunit.client.1.smithi181.stdout:3/377: sync 2024-04-03T08:39:19.217 INFO:tasks.workunit.client.1.smithi181.stdout:3/378: fsync d0/d17/f26 0 2024-04-03T08:39:19.256 INFO:tasks.workunit.client.1.smithi181.stdout:5/373: readlink d4/d18/d55/l67 0 2024-04-03T08:39:19.258 INFO:tasks.workunit.client.0.smithi157.stdout:6/572: sync 2024-04-03T08:39:19.259 INFO:tasks.workunit.client.1.smithi181.stdout:7/320: write d0/d1/f21 [1287710,94555] 0 2024-04-03T08:39:19.262 INFO:tasks.workunit.client.0.smithi157.stdout:1/503: write d2/d11/d23/f8c [4142910,24200] 0 2024-04-03T08:39:19.264 INFO:tasks.workunit.client.0.smithi157.stdout:1/504: readlink d2/d11/d24/d39/l52 0 2024-04-03T08:39:19.266 INFO:tasks.workunit.client.1.smithi181.stdout:8/329: symlink d4/d45/db/d14/d31/d1c/l6b 0 2024-04-03T08:39:19.266 INFO:tasks.workunit.client.0.smithi157.stdout:3/520: truncate d8/d1e/f7b 1265607 0 2024-04-03T08:39:19.270 INFO:tasks.workunit.client.0.smithi157.stdout:2/548: chown d3/d12/d43/d4b/f79 22 1 2024-04-03T08:39:19.280 INFO:tasks.workunit.client.1.smithi181.stdout:7/321: dwrite d0/d1/d6/de/d17/d27/f3a [0,4194304] 0 2024-04-03T08:39:19.286 INFO:tasks.workunit.client.0.smithi157.stdout:8/581: symlink d2/d6f/d70/d89/lc6 0 2024-04-03T08:39:19.289 INFO:tasks.workunit.client.0.smithi157.stdout:8/582: chown d2/d11/f93 11 1 2024-04-03T08:39:19.291 INFO:tasks.workunit.client.0.smithi157.stdout:0/541: getdents d2/d9/d51 0 2024-04-03T08:39:19.297 INFO:tasks.workunit.client.0.smithi157.stdout:2/549: dwrite d3/da6/fb9 [0,4194304] 0 2024-04-03T08:39:19.299 INFO:tasks.workunit.client.0.smithi157.stdout:6/573: write d1/d5/d17/f64 [2524660,62373] 0 2024-04-03T08:39:19.303 INFO:tasks.workunit.client.0.smithi157.stdout:8/583: truncate d2/d11/d10/d24/d5b/d2e/d75/faa 548544 0 2024-04-03T08:39:19.308 INFO:tasks.workunit.client.0.smithi157.stdout:3/521: creat d8/d13/d1b/d4e/d50/d7c/fb7 x:0 0 0 2024-04-03T08:39:19.312 INFO:tasks.workunit.client.1.smithi181.stdout:3/379: truncate d0/d5/d6/f4c 389159 0 2024-04-03T08:39:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:18 smithi157 ceph-mon[35083]: mgrmap e24: smithi181.mfhidq(active, since 5s) 2024-04-03T08:39:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:18 smithi157 ceph-mon[35083]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:18 smithi157 ceph-mon[35083]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:19.323 INFO:tasks.workunit.client.0.smithi157.stdout:1/505: symlink d2/d11/la4 0 2024-04-03T08:39:19.326 INFO:tasks.workunit.client.1.smithi181.stdout:8/330: rename d4/d60 to d4/d44/d59/d5f/d6c 0 2024-04-03T08:39:19.334 INFO:tasks.workunit.client.0.smithi157.stdout:8/584: dwrite d2/fb8 [0,4194304] 0 2024-04-03T08:39:19.337 INFO:tasks.workunit.client.1.smithi181.stdout:9/443: dread d1/da/d13/d22/d23/f5e [0,4194304] 0 2024-04-03T08:39:19.338 INFO:tasks.workunit.client.0.smithi157.stdout:6/574: creat d1/d5/d17/d2a/d73/fc4 x:0 0 0 2024-04-03T08:39:19.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:18 smithi181 ceph-mon[44183]: mgrmap e24: smithi181.mfhidq(active, since 5s) 2024-04-03T08:39:19.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:18 smithi181 ceph-mon[44183]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:19.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:18 smithi181 ceph-mon[44183]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-04-03T08:39:19.348 INFO:tasks.workunit.client.0.smithi157.stdout:0/542: mknod d2/d9/dc/df/d1b/d35/dc0/cc8 0 2024-04-03T08:39:19.352 INFO:tasks.workunit.client.1.smithi181.stdout:1/359: mkdir d10/d69 0 2024-04-03T08:39:19.357 INFO:tasks.workunit.client.1.smithi181.stdout:3/380: mknod d0/d5/d6/dd/d5f/c78 0 2024-04-03T08:39:19.359 INFO:tasks.workunit.client.1.smithi181.stdout:5/374: mkdir d4/d22/d78 0 2024-04-03T08:39:19.366 INFO:tasks.workunit.client.0.smithi157.stdout:7/590: getdents d0/d11/d15/d17/d52/db6 0 2024-04-03T08:39:19.369 INFO:tasks.workunit.client.1.smithi181.stdout:7/322: rename d0/d6c to d0/d1/d6/de/d17/d27/d72 0 2024-04-03T08:39:19.372 INFO:tasks.workunit.client.0.smithi157.stdout:0/543: symlink d2/lc9 0 2024-04-03T08:39:19.374 INFO:tasks.workunit.client.1.smithi181.stdout:5/375: dwrite d4/d22/d53/f6d [0,4194304] 0 2024-04-03T08:39:19.378 INFO:tasks.workunit.client.0.smithi157.stdout:1/506: dwrite d2/d11/d24/d39/d3b/fe [0,4194304] 0 2024-04-03T08:39:19.389 INFO:tasks.workunit.client.0.smithi157.stdout:6/575: creat d1/d5/d17/d29/da3/da8/fc5 x:0 0 0 2024-04-03T08:39:19.392 INFO:tasks.workunit.client.0.smithi157.stdout:7/591: chown d0/d11/ld0 4402023 1 2024-04-03T08:39:19.393 INFO:tasks.workunit.client.1.smithi181.stdout:9/444: mknod d1/da/d28/c8e 0 2024-04-03T08:39:19.402 INFO:tasks.workunit.client.1.smithi181.stdout:9/445: dread d1/da/d28/f6b [0,4194304] 0 2024-04-03T08:39:19.403 INFO:tasks.workunit.client.0.smithi157.stdout:6/576: creat d1/d5/d17/d29/d80/fc6 x:0 0 0 2024-04-03T08:39:19.403 INFO:tasks.workunit.client.1.smithi181.stdout:9/446: readlink d1/l15 0 2024-04-03T08:39:19.409 INFO:tasks.workunit.client.0.smithi157.stdout:7/592: unlink d0/d11/d15/d17/d1c/d4f/c60 0 2024-04-03T08:39:19.414 INFO:tasks.workunit.client.1.smithi181.stdout:5/376: chown d4/l6b 1097999 1 2024-04-03T08:39:19.416 INFO:tasks.workunit.client.1.smithi181.stdout:6/379: link d6/d7/d50/d5b/f6a d6/d7/d9/d22/d4f/f7a 0 2024-04-03T08:39:19.419 INFO:tasks.workunit.client.0.smithi157.stdout:7/593: write d0/d11/d15/d17/d43/fb7 [89802,50176] 0 2024-04-03T08:39:19.423 INFO:tasks.workunit.client.1.smithi181.stdout:9/447: fsync d1/f6 0 2024-04-03T08:39:19.425 INFO:tasks.workunit.client.1.smithi181.stdout:7/323: truncate d0/d1/f15 3842248 0 2024-04-03T08:39:19.428 INFO:tasks.workunit.client.1.smithi181.stdout:1/360: creat d10/d15/d17/d19/d33/f6a x:0 0 0 2024-04-03T08:39:19.432 INFO:tasks.workunit.client.1.smithi181.stdout:7/324: symlink d0/d1/d6/de/d57/l73 0 2024-04-03T08:39:19.432 INFO:tasks.workunit.client.1.smithi181.stdout:5/377: dwrite d4/d18/d3e/f57 [0,4194304] 0 2024-04-03T08:39:19.433 INFO:tasks.workunit.client.1.smithi181.stdout:6/380: mkdir d6/d7b 0 2024-04-03T08:39:19.434 INFO:tasks.workunit.client.1.smithi181.stdout:6/381: chown d6/d31/c59 1290 1 2024-04-03T08:39:19.437 INFO:tasks.workunit.client.1.smithi181.stdout:6/382: write d6/d3e/d40/d63/f68 [96486,37713] 0 2024-04-03T08:39:19.438 INFO:tasks.workunit.client.1.smithi181.stdout:9/448: unlink d1/da/d13/d22/d23/d36/l85 0 2024-04-03T08:39:19.440 INFO:tasks.workunit.client.1.smithi181.stdout:5/378: mkdir d4/d18/d25/d79 0 2024-04-03T08:39:19.443 INFO:tasks.workunit.client.1.smithi181.stdout:6/383: dread d6/d7/d50/d64/f67 [0,4194304] 0 2024-04-03T08:39:19.443 INFO:tasks.workunit.client.1.smithi181.stdout:9/449: chown d1/da/d13/d22/f42 16749 1 2024-04-03T08:39:19.446 INFO:tasks.workunit.client.0.smithi157.stdout:7/594: dwrite d0/d11/d15/d17/d1c/da1/fd3 [0,4194304] 0 2024-04-03T08:39:19.446 INFO:tasks.workunit.client.1.smithi181.stdout:6/384: chown d6/d7/c10 3471 1 2024-04-03T08:39:19.448 INFO:tasks.workunit.client.1.smithi181.stdout:8/331: creat d4/d2a/f6d x:0 0 0 2024-04-03T08:39:19.450 INFO:tasks.workunit.client.0.smithi157.stdout:7/595: chown d0/d11/f21 27648 1 2024-04-03T08:39:19.453 INFO:tasks.workunit.client.1.smithi181.stdout:7/325: creat d0/d1/f74 x:0 0 0 2024-04-03T08:39:19.455 INFO:tasks.workunit.client.1.smithi181.stdout:0/373: creat d5/dc/d14/d29/f78 x:0 0 0 2024-04-03T08:39:19.457 INFO:tasks.workunit.client.1.smithi181.stdout:9/450: write d1/f5 [462002,45586] 0 2024-04-03T08:39:19.457 INFO:tasks.workunit.client.0.smithi157.stdout:9/501: sync 2024-04-03T08:39:19.458 INFO:tasks.workunit.client.1.smithi181.stdout:0/374: write d5/dc/d10/f38 [4794964,105408] 0 2024-04-03T08:39:19.460 INFO:tasks.workunit.client.0.smithi157.stdout:7/596: truncate d0/d11/d15/d17/d1c/f5d 44137 0 2024-04-03T08:39:19.460 INFO:tasks.workunit.client.1.smithi181.stdout:0/375: write d5/d9/d2a/f67 [598439,2035] 0 2024-04-03T08:39:19.462 INFO:tasks.workunit.client.1.smithi181.stdout:9/451: chown d1/da/d28/d30/d3e/d4e 27 1 2024-04-03T08:39:19.463 INFO:tasks.workunit.client.1.smithi181.stdout:0/376: chown d5/d9/d2a 27 1 2024-04-03T08:39:19.486 INFO:tasks.workunit.client.1.smithi181.stdout:5/379: creat d4/d22/d78/f7a x:0 0 0 2024-04-03T08:39:19.492 INFO:tasks.workunit.client.1.smithi181.stdout:9/452: unlink d1/da/d13/d22/d23/f89 0 2024-04-03T08:39:19.492 INFO:tasks.workunit.client.0.smithi157.stdout:9/502: dread d1/d15/d27/f45 [0,4194304] 0 2024-04-03T08:39:19.493 INFO:tasks.workunit.client.1.smithi181.stdout:8/332: mknod d4/d45/c6e 0 2024-04-03T08:39:19.495 INFO:tasks.workunit.client.1.smithi181.stdout:8/333: chown d4/d45/db/d14/f42 136674 1 2024-04-03T08:39:19.496 INFO:tasks.workunit.client.1.smithi181.stdout:2/431: write d13/d1c/f51 [45889,76725] 0 2024-04-03T08:39:19.501 INFO:tasks.workunit.client.0.smithi157.stdout:4/523: sync 2024-04-03T08:39:19.501 INFO:tasks.workunit.client.0.smithi157.stdout:5/578: sync 2024-04-03T08:39:19.506 INFO:tasks.workunit.client.1.smithi181.stdout:2/432: fsync d13/d1c/d4a/d7f/f89 0 2024-04-03T08:39:19.510 INFO:tasks.workunit.client.0.smithi157.stdout:9/503: rename d1/d15/d27/d34/c57 to d1/d15/d27/d5c/d79/cac 0 2024-04-03T08:39:19.511 INFO:tasks.workunit.client.0.smithi157.stdout:4/524: dread da/df/d2f/d54/f5a [0,4194304] 0 2024-04-03T08:39:19.513 INFO:tasks.workunit.client.0.smithi157.stdout:5/579: mkdir dc/d29/d56/d9e/dc3 0 2024-04-03T08:39:19.516 INFO:tasks.workunit.client.0.smithi157.stdout:9/504: truncate d1/d15/d27/fa8 31142 0 2024-04-03T08:39:19.517 INFO:tasks.workunit.client.0.smithi157.stdout:4/525: dread - da/df/d24/d58/d68/f8c zero size 2024-04-03T08:39:19.518 INFO:tasks.workunit.client.0.smithi157.stdout:5/580: write dc/d29/d56/d18/f99 [1352211,81402] 0 2024-04-03T08:39:19.521 INFO:tasks.workunit.client.1.smithi181.stdout:9/453: dread d1/f5 [0,4194304] 0 2024-04-03T08:39:19.528 INFO:tasks.workunit.client.1.smithi181.stdout:9/454: creat d1/d34/d39/f8f x:0 0 0 2024-04-03T08:39:19.528 INFO:tasks.workunit.client.1.smithi181.stdout:4/450: truncate d1/d16/d24/d5e/d3f/d41/f42 3483992 0 2024-04-03T08:39:19.529 INFO:tasks.workunit.client.1.smithi181.stdout:9/455: fdatasync d1/da/d1a/f27 0 2024-04-03T08:39:19.531 INFO:tasks.workunit.client.0.smithi157.stdout:9/505: mkdir d1/dab/dad 0 2024-04-03T08:39:19.532 INFO:tasks.workunit.client.0.smithi157.stdout:5/581: read dc/d29/d56/d18/d21/f5d [769840,90897] 0 2024-04-03T08:39:19.537 INFO:tasks.workunit.client.0.smithi157.stdout:5/582: stat dc/d29/d56/d52/l96 0 2024-04-03T08:39:19.537 INFO:tasks.workunit.client.0.smithi157.stdout:9/506: dread - d1/d15/d16/f98 zero size 2024-04-03T08:39:19.537 INFO:tasks.workunit.client.1.smithi181.stdout:3/381: sync 2024-04-03T08:39:19.538 INFO:tasks.workunit.client.1.smithi181.stdout:3/382: read d0/d5/d6/f39 [1780046,47964] 0 2024-04-03T08:39:19.543 INFO:tasks.workunit.client.0.smithi157.stdout:3/522: dwrite d8/d1e/d2d/d3b/f5a [4194304,4194304] 0 2024-04-03T08:39:19.545 INFO:tasks.workunit.client.0.smithi157.stdout:9/507: readlink d1/l70 0 2024-04-03T08:39:19.545 INFO:tasks.workunit.client.0.smithi157.stdout:4/526: dwrite da/d7e/f7f [0,4194304] 0 2024-04-03T08:39:19.551 INFO:tasks.workunit.client.0.smithi157.stdout:5/583: truncate dc/d29/d56/d49/d53/fae 899712 0 2024-04-03T08:39:19.551 INFO:tasks.workunit.client.1.smithi181.stdout:3/383: dwrite d0/d5/f33 [0,4194304] 0 2024-04-03T08:39:19.554 INFO:tasks.workunit.client.0.smithi157.stdout:4/527: symlink da/df/d2f/lb6 0 2024-04-03T08:39:19.557 INFO:tasks.workunit.client.0.smithi157.stdout:5/584: creat dc/d29/d56/d18/d21/fc4 x:0 0 0 2024-04-03T08:39:19.558 INFO:tasks.workunit.client.0.smithi157.stdout:3/523: truncate d8/d13/d1b/d37/f85 487078 0 2024-04-03T08:39:19.562 INFO:tasks.workunit.client.0.smithi157.stdout:4/528: creat da/d7e/fb7 x:0 0 0 2024-04-03T08:39:19.565 INFO:tasks.workunit.client.0.smithi157.stdout:7/597: mkdir d0/d4/dd4 0 2024-04-03T08:39:19.566 INFO:tasks.workunit.client.0.smithi157.stdout:5/585: creat dc/d29/d56/d18/d21/fc5 x:0 0 0 2024-04-03T08:39:19.570 INFO:tasks.workunit.client.0.smithi157.stdout:3/524: rename d8/d1e/d2d/l6a to d8/d1e/d2d/d39/d51/d4c/d32/lb8 0 2024-04-03T08:39:19.572 INFO:tasks.workunit.client.0.smithi157.stdout:7/598: write d0/d11/d15/d17/d43/d8a/f94 [280387,19066] 0 2024-04-03T08:39:19.572 INFO:tasks.workunit.client.0.smithi157.stdout:0/544: unlink d2/d9/dc/df/fc2 0 2024-04-03T08:39:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.574+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ba8103d80 con 0x7f7b8c038a60 2024-04-03T08:39:19.575 INFO:tasks.workunit.client.0.smithi157.stdout:4/529: mknod da/df/d24/d35/cb8 0 2024-04-03T08:39:19.576 INFO:tasks.workunit.client.0.smithi157.stdout:6/577: write d1/d4b/d38/d59/f9b [964813,5056] 0 2024-04-03T08:39:19.576 INFO:tasks.workunit.client.0.smithi157.stdout:1/507: symlink d2/d11/d24/d39/d3b/d2e/d48/la5 0 2024-04-03T08:39:19.577 INFO:tasks.workunit.client.0.smithi157.stdout:9/508: dread d1/f93 [0,4194304] 0 2024-04-03T08:39:19.578 INFO:tasks.workunit.client.0.smithi157.stdout:5/586: creat dc/d29/d43/fc6 x:0 0 0 2024-04-03T08:39:19.581 INFO:tasks.workunit.client.0.smithi157.stdout:3/525: creat d8/d1e/fb9 x:0 0 0 2024-04-03T08:39:19.582 INFO:tasks.workunit.client.0.smithi157.stdout:8/585: mknod d2/d6f/cc7 0 2024-04-03T08:39:19.582 INFO:tasks.workunit.client.0.smithi157.stdout:1/508: readlink d2/d11/d24/d39/d3b/d2e/l5e 0 2024-04-03T08:39:19.583 INFO:tasks.workunit.client.0.smithi157.stdout:6/578: chown d1/d4b/d38/d59/f9b 1348001393 1 2024-04-03T08:39:19.584 INFO:tasks.workunit.client.1.smithi181.stdout:7/326: truncate d0/d1/f15 4638270 0 2024-04-03T08:39:19.588 INFO:tasks.workunit.client.0.smithi157.stdout:4/530: mkdir da/df/d6b/db9 0 2024-04-03T08:39:19.589 INFO:tasks.workunit.client.1.smithi181.stdout:7/327: mknod d0/c75 0 2024-04-03T08:39:19.591 INFO:tasks.workunit.client.1.smithi181.stdout:5/380: write d4/d18/d3e/f57 [4734944,64985] 0 2024-04-03T08:39:19.591 INFO:tasks.workunit.client.1.smithi181.stdout:4/451: symlink d1/d16/d24/d5e/d3f/l8f 0 2024-04-03T08:39:19.594 INFO:tasks.workunit.client.0.smithi157.stdout:5/587: truncate dc/d35/f97 271950 0 2024-04-03T08:39:19.594 INFO:tasks.workunit.client.1.smithi181.stdout:5/381: truncate d4/d44/f5f 1578382 0 2024-04-03T08:39:19.596 INFO:tasks.workunit.client.1.smithi181.stdout:5/382: chown d4/d18/d25/d68 7 1 2024-04-03T08:39:19.596 INFO:tasks.workunit.client.0.smithi157.stdout:5/588: chown dc/d29/f57 56 1 2024-04-03T08:39:19.596 INFO:tasks.workunit.client.1.smithi181.stdout:7/328: truncate d0/d1/d6/de/d17/f38 783039 0 2024-04-03T08:39:19.597 INFO:tasks.workunit.client.1.smithi181.stdout:5/383: readlink d4/d22/l6a 0 2024-04-03T08:39:19.597 INFO:tasks.workunit.client.1.smithi181.stdout:4/452: truncate d1/d16/d24/d5e/d31/d39/d5d/f88 62870 0 2024-04-03T08:39:19.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.597+0000 7f7ba5600700 1 -- 172.21.15.157:0/938717552 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7ba8103d80 con 0x7f7b8c038a60 2024-04-03T08:39:19.598 INFO:tasks.workunit.client.1.smithi181.stdout:7/329: write d0/f54 [433659,20875] 0 2024-04-03T08:39:19.600 INFO:tasks.workunit.client.0.smithi157.stdout:8/586: chown d2/d11/d10/d24/d5b/d2e/d75/ca8 23255 1 2024-04-03T08:39:19.600 INFO:tasks.workunit.client.1.smithi181.stdout:7/330: chown d0/d1/f4a 1670364795 1 2024-04-03T08:39:19.601 INFO:tasks.workunit.client.0.smithi157.stdout:4/531: read - da/df/d11/f82 zero size 2024-04-03T08:39:19.602 INFO:tasks.workunit.client.1.smithi181.stdout:1/361: truncate d10/d15/d17/f3f 1863147 0 2024-04-03T08:39:19.603 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:39:19.603 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (7m) 2m ago 9m 12.9M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:39:19.603 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (9m) 2m ago 9m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:39:19.603 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (8m) 29s ago 8m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (7m) 2m ago 9m 72.2M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (3m) 2m ago 3m 10.5M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (3m) 2m ago 3m 12.7M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (3m) 29s ago 3m 11.2M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (3m) 29s ago 3m 90.1M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (11m) 2m ago 11m 481M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (34s) 29s ago 8m 57.1M - 19.0.0-1670-g1fb5d106 c318aa90b546 b4f1b4d00cca 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (11m) 2m ago 11m 44.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (8m) 29s ago 8m 39.4M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (9m) 2m ago 9m 7948k - 1.5.0 0da6a335fe13 2baa04300c28 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (8m) 29s ago 8m 7578k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (7m) 2m ago 7m 44.0M 4348M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (6m) 2m ago 6m 44.4M 4348M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (6m) 2m ago 6m 43.3M 4348M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:39:19.604 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (5m) 29s ago 5m 122M 5372M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (5m) 29s ago 5m 112M 5372M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (4m) 29s ago 4m 104M 5372M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (7m) 2m ago 8m 44.9M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.602+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f7b8c038a60 msgr2=0x7f7b8c03af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.602+0000 7f7bafc00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f7b8c038a60 0x7f7b8c03af10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7ba806fcb0 tx=0x7f7b980096a0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.602+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 msgr2=0x7f7ba806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.602+0000 7f7bafc00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 0x7f7ba806e980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b94007d40 tx=0x7f7b94009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:19.605 INFO:tasks.workunit.client.0.smithi157.stdout:9/509: symlink d1/d4a/d4d/d86/lae 0 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.603+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 shutdown_connections 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.603+0000 7f7bafc00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f7b8c038a60 0x7f7b8c03af10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.603+0000 7f7bafc00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8070890 0x7f7ba806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.603+0000 7f7bafc00700 1 --2- 172.21.15.157:0/938717552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba8071e40 0x7f7ba806e980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.603+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 >> 172.21.15.157:0/938717552 conn(0x7f7ba80f8540 msgr2=0x7f7ba80f9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.603+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 shutdown_connections 2024-04-03T08:39:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.604+0000 7f7bafc00700 1 -- 172.21.15.157:0/938717552 wait complete. 2024-04-03T08:39:19.607 INFO:tasks.workunit.client.0.smithi157.stdout:8/587: write d2/d20/f3c [1217678,130713] 0 2024-04-03T08:39:19.609 INFO:tasks.workunit.client.1.smithi181.stdout:0/377: sync 2024-04-03T08:39:19.609 INFO:tasks.workunit.client.1.smithi181.stdout:5/384: rmdir d4/d18/d25 39 2024-04-03T08:39:19.610 INFO:tasks.workunit.client.1.smithi181.stdout:0/378: dread - d5/dc/d10/d30/f6f zero size 2024-04-03T08:39:19.612 INFO:tasks.workunit.client.1.smithi181.stdout:5/385: read d4/d22/f38 [2373507,54272] 0 2024-04-03T08:39:19.614 INFO:tasks.workunit.client.1.smithi181.stdout:0/379: write d5/dc/d10/d58/d6c/f15 [3673029,20391] 0 2024-04-03T08:39:19.614 INFO:tasks.workunit.client.1.smithi181.stdout:5/386: chown d4/d18/d2c/f2e 2704691 1 2024-04-03T08:39:19.615 INFO:tasks.workunit.client.1.smithi181.stdout:0/380: fsync d5/dc/d14/f5c 0 2024-04-03T08:39:19.617 INFO:tasks.workunit.client.0.smithi157.stdout:9/510: dread d1/fe [0,4194304] 0 2024-04-03T08:39:19.619 INFO:tasks.workunit.client.0.smithi157.stdout:1/509: dread d2/d11/d24/d39/d3b/f59 [0,4194304] 0 2024-04-03T08:39:19.619 INFO:tasks.workunit.client.0.smithi157.stdout:2/550: unlink d3/f21 0 2024-04-03T08:39:19.622 INFO:tasks.workunit.client.1.smithi181.stdout:7/331: mknod d0/d1/d6/de/d17/d64/c76 0 2024-04-03T08:39:19.622 INFO:tasks.workunit.client.1.smithi181.stdout:6/385: dwrite d6/f3a [0,4194304] 0 2024-04-03T08:39:19.624 INFO:tasks.workunit.client.1.smithi181.stdout:1/362: readlink d10/d15/d17/d23/l32 0 2024-04-03T08:39:19.624 INFO:tasks.workunit.client.0.smithi157.stdout:0/545: dread d2/d9/dc/df/f8a [0,4194304] 0 2024-04-03T08:39:19.625 INFO:tasks.workunit.client.1.smithi181.stdout:1/363: chown d10/d15/d41 11 1 2024-04-03T08:39:19.628 INFO:tasks.workunit.client.1.smithi181.stdout:1/364: readlink d10/d15/d17/d23/d27/l2d 0 2024-04-03T08:39:19.630 INFO:tasks.workunit.client.0.smithi157.stdout:5/589: truncate dc/d29/d56/d49/f5e 955578 0 2024-04-03T08:39:19.633 INFO:tasks.workunit.client.0.smithi157.stdout:4/532: unlink da/d26/f2e 0 2024-04-03T08:39:19.634 INFO:tasks.workunit.client.0.smithi157.stdout:4/533: chown da/d26 12198346 1 2024-04-03T08:39:19.634 INFO:tasks.workunit.client.1.smithi181.stdout:5/387: dwrite d4/d22/d78/f7a [0,4194304] 0 2024-04-03T08:39:19.637 INFO:tasks.workunit.client.0.smithi157.stdout:4/534: dread - da/df/d24/d58/d68/f8c zero size 2024-04-03T08:39:19.637 INFO:tasks.workunit.client.1.smithi181.stdout:0/381: readlink d5/l6 0 2024-04-03T08:39:19.639 INFO:tasks.workunit.client.1.smithi181.stdout:0/382: chown d5/d9/d2e/c4e 8909619 1 2024-04-03T08:39:19.642 INFO:tasks.workunit.client.1.smithi181.stdout:7/332: dwrite d0/d1/d6/de/d17/d27/f5d [0,4194304] 0 2024-04-03T08:39:19.643 INFO:tasks.workunit.client.1.smithi181.stdout:6/386: rename d6/d7 to d6/d3e/d5e/d7c 0 2024-04-03T08:39:19.644 INFO:tasks.workunit.client.1.smithi181.stdout:7/333: write d0/d1/d6/f61 [216785,75224] 0 2024-04-03T08:39:19.647 INFO:tasks.workunit.client.1.smithi181.stdout:7/334: dread - d0/d1/d6/de/d17/d27/f56 zero size 2024-04-03T08:39:19.648 INFO:tasks.workunit.client.0.smithi157.stdout:0/546: fsync d2/d9/d36/f3f 0 2024-04-03T08:39:19.653 INFO:tasks.workunit.client.1.smithi181.stdout:9/456: sync 2024-04-03T08:39:19.653 INFO:tasks.workunit.client.1.smithi181.stdout:4/453: link d1/c9 d1/d16/d37/c90 0 2024-04-03T08:39:19.653 INFO:tasks.workunit.client.1.smithi181.stdout:8/334: write d4/d45/db/d14/d31/d1c/f2f [197310,44004] 0 2024-04-03T08:39:19.655 INFO:tasks.workunit.client.1.smithi181.stdout:9/457: write d1/d34/d39/f50 [2788028,66313] 0 2024-04-03T08:39:19.658 INFO:tasks.workunit.client.1.smithi181.stdout:8/335: chown d4/d45/db/l65 7 1 2024-04-03T08:39:19.660 INFO:tasks.workunit.client.1.smithi181.stdout:5/388: write d4/d22/f63 [2833487,70971] 0 2024-04-03T08:39:19.661 INFO:tasks.workunit.client.0.smithi157.stdout:5/590: mknod dc/d29/d56/d2e/cc7 0 2024-04-03T08:39:19.663 INFO:tasks.workunit.client.0.smithi157.stdout:4/535: rmdir da/df/d2f/d97 39 2024-04-03T08:39:19.664 INFO:tasks.workunit.client.1.smithi181.stdout:2/433: write d13/d1c/d4a/d68/f76 [1873990,22703] 0 2024-04-03T08:39:19.668 INFO:tasks.workunit.client.1.smithi181.stdout:0/383: unlink d5/dc/d14/d29/d46/c6b 0 2024-04-03T08:39:19.672 INFO:tasks.workunit.client.0.smithi157.stdout:1/510: symlink d2/d11/d24/d39/d3b/d2e/d48/d58/d94/da3/la6 0 2024-04-03T08:39:19.672 INFO:tasks.workunit.client.1.smithi181.stdout:1/365: mknod d10/d69/c6b 0 2024-04-03T08:39:19.675 INFO:tasks.workunit.client.1.smithi181.stdout:6/387: creat d6/d3e/d5e/d7c/d9/d22/d4f/f7d x:0 0 0 2024-04-03T08:39:19.678 INFO:tasks.workunit.client.0.smithi157.stdout:0/547: creat d2/d9/d51/fca x:0 0 0 2024-04-03T08:39:19.678 INFO:tasks.workunit.client.1.smithi181.stdout:6/388: dread - d6/d3e/d5e/d7c/d9/d22/d4f/f7d zero size 2024-04-03T08:39:19.679 INFO:tasks.workunit.client.1.smithi181.stdout:6/389: readlink d6/d31/d36/l41 0 2024-04-03T08:39:19.684 INFO:tasks.workunit.client.1.smithi181.stdout:9/458: mknod d1/d34/d39/d7c/c90 0 2024-04-03T08:39:19.685 INFO:tasks.workunit.client.0.smithi157.stdout:4/536: mkdir da/d7e/dba 0 2024-04-03T08:39:19.685 INFO:tasks.workunit.client.0.smithi157.stdout:0/548: chown d2/d9/dc/df/d1b/d4a/fbd 354389 1 2024-04-03T08:39:19.686 INFO:tasks.workunit.client.1.smithi181.stdout:7/335: dread d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:19.687 INFO:tasks.workunit.client.0.smithi157.stdout:9/511: rename d1/d4a/da1 to d1/d15/d27/daf 0 2024-04-03T08:39:19.687 INFO:tasks.workunit.client.1.smithi181.stdout:1/366: dwrite d10/d15/f34 [4194304,4194304] 0 2024-04-03T08:39:19.689 INFO:tasks.workunit.client.1.smithi181.stdout:8/336: creat d4/d44/f6f x:0 0 0 2024-04-03T08:39:19.693 INFO:tasks.workunit.client.0.smithi157.stdout:1/511: unlink d2/d11/d23/f4d 0 2024-04-03T08:39:19.694 INFO:tasks.workunit.client.1.smithi181.stdout:5/389: truncate d4/d18/f61 59743 0 2024-04-03T08:39:19.696 INFO:tasks.workunit.client.0.smithi157.stdout:1/512: read d2/d11/d24/d39/d3b/f5c [1023017,26703] 0 2024-04-03T08:39:19.698 INFO:tasks.workunit.client.1.smithi181.stdout:3/384: dwrite d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:19.701 INFO:tasks.workunit.client.1.smithi181.stdout:2/434: rename d13/d22/d40/f42 to d13/d1c/d73/fa4 0 2024-04-03T08:39:19.706 INFO:tasks.workunit.client.1.smithi181.stdout:0/384: symlink d5/dc/d14/d29/d46/l79 0 2024-04-03T08:39:19.707 INFO:tasks.workunit.client.1.smithi181.stdout:0/385: fsync d5/d9/d2c/f69 0 2024-04-03T08:39:19.713 INFO:tasks.workunit.client.1.smithi181.stdout:6/390: creat d6/d3e/f7e x:0 0 0 2024-04-03T08:39:19.716 INFO:tasks.workunit.client.1.smithi181.stdout:7/336: fdatasync d0/d1/d6/de/d17/f1b 0 2024-04-03T08:39:19.718 INFO:tasks.workunit.client.1.smithi181.stdout:7/337: write d0/d1/d6/de/f69 [963865,129264] 0 2024-04-03T08:39:19.722 INFO:tasks.workunit.client.1.smithi181.stdout:4/454: truncate d1/d16/d24/d5e/f3c 2409699 0 2024-04-03T08:39:19.723 INFO:tasks.workunit.client.0.smithi157.stdout:7/599: write d0/d11/d15/f2e [2917678,73286] 0 2024-04-03T08:39:19.738 INFO:tasks.workunit.client.0.smithi157.stdout:6/579: dwrite d1/d5/d17/d2a/d73/f71 [0,4194304] 0 2024-04-03T08:39:19.741 INFO:tasks.workunit.client.1.smithi181.stdout:9/459: rename d1/d34/d39/d88 to d1/da/d13/d22/d23/d36/d91 0 2024-04-03T08:39:19.748 INFO:tasks.workunit.client.1.smithi181.stdout:0/386: creat d5/d9/d2c/f7a x:0 0 0 2024-04-03T08:39:19.751 INFO:tasks.workunit.client.1.smithi181.stdout:6/391: write d6/f60 [1383323,120664] 0 2024-04-03T08:39:19.753 INFO:tasks.workunit.client.0.smithi157.stdout:8/588: truncate d2/d11/f90 4193685 0 2024-04-03T08:39:19.757 INFO:tasks.workunit.client.1.smithi181.stdout:7/338: chown d0/d1/l46 390361408 1 2024-04-03T08:39:19.758 INFO:tasks.workunit.client.0.smithi157.stdout:4/537: mknod da/d7e/cbb 0 2024-04-03T08:39:19.759 INFO:tasks.workunit.client.1.smithi181.stdout:7/339: chown d0/d1/d6/de/d17/f1b 8374677 1 2024-04-03T08:39:19.760 INFO:tasks.workunit.client.1.smithi181.stdout:4/455: mknod d1/d16/d37/d34/d69/c91 0 2024-04-03T08:39:19.762 INFO:tasks.workunit.client.0.smithi157.stdout:0/549: symlink d2/d9/dc/df/d1b/d4a/d31/lcb 0 2024-04-03T08:39:19.764 INFO:tasks.workunit.client.1.smithi181.stdout:8/337: mkdir d4/d45/d9/d70 0 2024-04-03T08:39:19.768 INFO:tasks.workunit.client.0.smithi157.stdout:2/551: getdents d3 0 2024-04-03T08:39:19.769 INFO:tasks.workunit.client.1.smithi181.stdout:1/367: sync 2024-04-03T08:39:19.773 INFO:tasks.workunit.client.1.smithi181.stdout:2/435: mkdir d13/d1c/da5 0 2024-04-03T08:39:19.779 INFO:tasks.workunit.client.0.smithi157.stdout:1/513: read d2/f53 [190471,21985] 0 2024-04-03T08:39:19.780 INFO:tasks.workunit.client.1.smithi181.stdout:0/387: rename d5/dc/d14/d29/l5e to d5/dc/d75/l7b 0 2024-04-03T08:39:19.796 INFO:tasks.workunit.client.0.smithi157.stdout:5/591: dwrite dc/f7e [0,4194304] 0 2024-04-03T08:39:19.798 INFO:tasks.workunit.client.1.smithi181.stdout:1/368: mkdir d10/d15/d4b/d6c 0 2024-04-03T08:39:19.801 INFO:tasks.workunit.client.0.smithi157.stdout:1/514: dwrite d2/d11/f26 [0,4194304] 0 2024-04-03T08:39:19.817 INFO:tasks.workunit.client.1.smithi181.stdout:6/392: mkdir d6/d3e/d5e/d7c/d9/d7f 0 2024-04-03T08:39:19.820 INFO:tasks.workunit.client.0.smithi157.stdout:3/526: creat d8/d1e/d2d/d30/fba x:0 0 0 2024-04-03T08:39:19.823 INFO:tasks.workunit.client.0.smithi157.stdout:5/592: mknod dc/d29/d56/d49/d53/d6c/cc8 0 2024-04-03T08:39:19.824 INFO:tasks.workunit.client.1.smithi181.stdout:3/385: getdents d0 0 2024-04-03T08:39:19.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.826+0000 7f5c47c00700 1 -- 172.21.15.157:0/464029280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fcee0 msgr2=0x7f5c400fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:19.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.826+0000 7f5c47c00700 1 --2- 172.21.15.157:0/464029280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fcee0 0x7f5c400fd310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c34004940 tx=0x7f5c34009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:19.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.827+0000 7f5c47c00700 1 -- 172.21.15.157:0/464029280 shutdown_connections 2024-04-03T08:39:19.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.827+0000 7f5c47c00700 1 --2- 172.21.15.157:0/464029280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fe0d0 0x7f5c400fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.827+0000 7f5c47c00700 1 --2- 172.21.15.157:0/464029280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fcee0 0x7f5c400fd310 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.827+0000 7f5c47c00700 1 -- 172.21.15.157:0/464029280 >> 172.21.15.157:0/464029280 conn(0x7f5c400f8560 msgr2=0x7f5c400fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:19.829 INFO:tasks.workunit.client.0.smithi157.stdout:1/515: creat d2/d11/d24/d39/d3b/d1b/d7f/fa7 x:0 0 0 2024-04-03T08:39:19.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.827+0000 7f5c47c00700 1 -- 172.21.15.157:0/464029280 shutdown_connections 2024-04-03T08:39:19.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.827+0000 7f5c47c00700 1 -- 172.21.15.157:0/464029280 wait complete. 2024-04-03T08:39:19.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.828+0000 7f5c47c00700 1 Processor -- start 2024-04-03T08:39:19.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.829+0000 7f5c47c00700 1 -- start start 2024-04-03T08:39:19.831 INFO:tasks.workunit.client.0.smithi157.stdout:8/589: mknod d2/d6f/db5/cc8 0 2024-04-03T08:39:19.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.829+0000 7f5c47c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 0x7f5c4010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:19.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.829+0000 7f5c47c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fe0d0 0x7f5c40110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.829+0000 7f5c47c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40110860 con 0x7f5c400fe0d0 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.829+0000 7f5c47c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40110fa0 con 0x7f5c400fcee0 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.830+0000 7f5c45200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 0x7f5c4010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.830+0000 7f5c45200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 0x7f5c4010fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:56872/0 (socket says 172.21.15.157:56872) 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.830+0000 7f5c45200700 1 -- 172.21.15.157:0/142326778 learned_addr learned my addr 172.21.15.157:0/142326778 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.831+0000 7f5c45200700 1 -- 172.21.15.157:0/142326778 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fe0d0 msgr2=0x7f5c40110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.831+0000 7f5c45200700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fe0d0 0x7f5c40110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.831+0000 7f5c45200700 1 -- 172.21.15.157:0/142326778 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c34005040 con 0x7f5c400fcee0 2024-04-03T08:39:19.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.831+0000 7f5c45200700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 0x7f5c4010fd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c34000c00 tx=0x7f5c34009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:19.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.832+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c3400e030 con 0x7f5c400fcee0 2024-04-03T08:39:19.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.832+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c34013420 con 0x7f5c400fcee0 2024-04-03T08:39:19.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.832+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c3400bee0 con 0x7f5c400fcee0 2024-04-03T08:39:19.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.832+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c40111220 con 0x7f5c400fcee0 2024-04-03T08:39:19.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.832+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401117e0 con 0x7f5c400fcee0 2024-04-03T08:39:19.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.834+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40101a60 con 0x7f5c400fcee0 2024-04-03T08:39:19.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.835+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f5c34013a90 con 0x7f5c400fcee0 2024-04-03T08:39:19.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.835+0000 7f5c3cc00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5c28038ac0 0x7f5c2803af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:19.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.835+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5c3404dad0 con 0x7f5c400fcee0 2024-04-03T08:39:19.837 INFO:tasks.workunit.client.0.smithi157.stdout:0/550: mknod d2/d9/d51/d63/ccc 0 2024-04-03T08:39:19.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.836+0000 7f5c3fe00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5c28038ac0 0x7f5c2803af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:19.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.837+0000 7f5c3fe00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5c28038ac0 0x7f5c2803af70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c004d00 tx=0x7f5c2c009ce0 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:19.838 INFO:tasks.workunit.client.1.smithi181.stdout:5/390: truncate d4/d18/d2c/f2e 2312398 0 2024-04-03T08:39:19.840 INFO:tasks.workunit.client.1.smithi181.stdout:5/391: write d4/d18/f23 [3598416,27571] 0 2024-04-03T08:39:19.840 INFO:tasks.workunit.client.0.smithi157.stdout:2/552: symlink d3/d2e/d32/d9f/dbd/lc5 0 2024-04-03T08:39:19.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:19.841+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5c34013590 con 0x7f5c400fcee0 2024-04-03T08:39:19.845 INFO:tasks.workunit.client.1.smithi181.stdout:6/393: rename d6/d3e/d40/d63 to d6/d53/d80 0 2024-04-03T08:39:19.847 INFO:tasks.workunit.client.0.smithi157.stdout:1/516: creat d2/d11/d24/d39/d3b/d2e/d48/d58/d94/da3/fa8 x:0 0 0 2024-04-03T08:39:19.849 INFO:tasks.workunit.client.1.smithi181.stdout:6/394: truncate d6/d3e/d5e/d7c/d9/f28 5011465 0 2024-04-03T08:39:19.849 INFO:tasks.workunit.client.1.smithi181.stdout:8/338: creat d4/d45/f71 x:0 0 0 2024-04-03T08:39:19.850 INFO:tasks.workunit.client.1.smithi181.stdout:6/395: readlink d6/d53/d80/l78 0 2024-04-03T08:39:19.852 INFO:tasks.workunit.client.0.smithi157.stdout:4/538: rename da/df/d24/d58/d68/da6 to da/df/d2f/dbc 0 2024-04-03T08:39:19.855 INFO:tasks.workunit.client.0.smithi157.stdout:4/539: chown da/df/d99/da8 479 1 2024-04-03T08:39:19.855 INFO:tasks.workunit.client.1.smithi181.stdout:9/460: dwrite d1/da/d28/f6b [0,4194304] 0 2024-04-03T08:39:19.859 INFO:tasks.workunit.client.0.smithi157.stdout:6/580: write d1/d5/d1b/f41 [3307571,64645] 0 2024-04-03T08:39:19.860 INFO:tasks.workunit.client.0.smithi157.stdout:3/527: symlink d8/d1e/d2d/d3f/d4d/d8f/lbb 0 2024-04-03T08:39:19.861 INFO:tasks.workunit.client.0.smithi157.stdout:6/581: dread - d1/d5/d17/d29/d80/fc6 zero size 2024-04-03T08:39:19.862 INFO:tasks.workunit.client.1.smithi181.stdout:0/388: creat d5/f7c x:0 0 0 2024-04-03T08:39:19.864 INFO:tasks.workunit.client.1.smithi181.stdout:0/389: readlink d5/dc/d14/d29/d46/l79 0 2024-04-03T08:39:19.865 INFO:tasks.workunit.client.1.smithi181.stdout:7/340: dwrite d0/f3e [0,4194304] 0 2024-04-03T08:39:19.866 INFO:tasks.workunit.client.0.smithi157.stdout:2/553: mkdir d3/db/d44/d4c/d5a/d88/dc6 0 2024-04-03T08:39:19.866 INFO:tasks.workunit.client.1.smithi181.stdout:2/436: write d13/d22/d27/f4f [353456,74388] 0 2024-04-03T08:39:19.868 INFO:tasks.workunit.client.1.smithi181.stdout:7/341: dread - d0/d1/f74 zero size 2024-04-03T08:39:19.869 INFO:tasks.workunit.client.0.smithi157.stdout:1/517: mkdir d2/d11/d24/d67/da9 0 2024-04-03T08:39:19.869 INFO:tasks.workunit.client.1.smithi181.stdout:6/396: rmdir d6/d31 39 2024-04-03T08:39:19.871 INFO:tasks.workunit.client.1.smithi181.stdout:6/397: fsync d6/d3e/d5e/d7c/f49 0 2024-04-03T08:39:19.871 INFO:tasks.workunit.client.0.smithi157.stdout:7/600: dwrite d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:19.882 INFO:tasks.workunit.client.0.smithi157.stdout:0/551: mknod d2/d9/dc/dbe/ccd 0 2024-04-03T08:39:19.882 INFO:tasks.workunit.client.1.smithi181.stdout:8/339: creat d4/d45/db/d5c/f72 x:0 0 0 2024-04-03T08:39:19.882 INFO:tasks.workunit.client.1.smithi181.stdout:4/456: truncate d1/d16/d37/d34/f35 1523161 0 2024-04-03T08:39:19.885 INFO:tasks.workunit.client.1.smithi181.stdout:3/386: symlink d0/d5/d6/d32/d43/d6b/l79 0 2024-04-03T08:39:19.888 INFO:tasks.workunit.client.1.smithi181.stdout:3/387: chown d0/d5/d6/dd/d25/c2b 3 1 2024-04-03T08:39:19.888 INFO:tasks.workunit.client.1.smithi181.stdout:9/461: write d1/f5 [2950496,18665] 0 2024-04-03T08:39:19.893 INFO:tasks.workunit.client.0.smithi157.stdout:6/582: unlink d1/d5/d17/d29/d87/fac 0 2024-04-03T08:39:19.895 INFO:tasks.workunit.client.0.smithi157.stdout:6/583: fsync d1/d4b/d38/d59/f93 0 2024-04-03T08:39:19.895 INFO:tasks.workunit.client.1.smithi181.stdout:1/369: sync 2024-04-03T08:39:19.898 INFO:tasks.workunit.client.0.smithi157.stdout:6/584: fsync d1/d5/d17/d2a/d37/f8e 0 2024-04-03T08:39:19.900 INFO:tasks.workunit.client.0.smithi157.stdout:3/528: symlink d8/d13/d1b/d4e/da6/lbc 0 2024-04-03T08:39:19.901 INFO:tasks.workunit.client.0.smithi157.stdout:3/529: chown d8/d1e/d2d/d3b 1332 1 2024-04-03T08:39:19.905 INFO:tasks.workunit.client.0.smithi157.stdout:9/512: rename d1/d15/d27/d5c/d79/cac to d1/d94/d75/cb0 0 2024-04-03T08:39:19.910 INFO:tasks.workunit.client.0.smithi157.stdout:7/601: mknod d0/d16/cd5 0 2024-04-03T08:39:19.911 INFO:tasks.workunit.client.1.smithi181.stdout:2/437: truncate d13/d22/d27/d46/f61 1765468 0 2024-04-03T08:39:19.912 INFO:tasks.workunit.client.0.smithi157.stdout:8/590: link d2/d11/d10/d24/d5b/c13 d2/d20/db1/cc9 0 2024-04-03T08:39:19.914 INFO:tasks.workunit.client.1.smithi181.stdout:7/342: fdatasync d0/d1/d6/de/d17/f31 0 2024-04-03T08:39:19.916 INFO:tasks.workunit.client.0.smithi157.stdout:1/518: creat d2/d11/d24/d39/d3b/d1b/d7f/faa x:0 0 0 2024-04-03T08:39:19.921 INFO:tasks.workunit.client.1.smithi181.stdout:4/457: read d1/d16/d24/d5e/d3f/d41/f42 [1205803,76880] 0 2024-04-03T08:39:19.922 INFO:tasks.workunit.client.0.smithi157.stdout:0/552: write d2/d9/d51/d63/d71/f92 [4274073,43307] 0 2024-04-03T08:39:19.924 INFO:tasks.workunit.client.1.smithi181.stdout:5/392: truncate d4/f16 733020 0 2024-04-03T08:39:19.928 INFO:tasks.workunit.client.1.smithi181.stdout:9/462: mkdir d1/da/d1a/d92 0 2024-04-03T08:39:19.930 INFO:tasks.workunit.client.0.smithi157.stdout:2/554: write d3/db/f31 [549334,52311] 0 2024-04-03T08:39:19.932 INFO:tasks.workunit.client.1.smithi181.stdout:1/370: creat d10/d15/d17/d19/f6d x:0 0 0 2024-04-03T08:39:19.933 INFO:tasks.workunit.client.0.smithi157.stdout:6/585: mkdir d1/d4b/da5/dc7 0 2024-04-03T08:39:19.935 INFO:tasks.workunit.client.1.smithi181.stdout:0/390: symlink d5/dc/d14/d29/l7d 0 2024-04-03T08:39:19.935 INFO:tasks.workunit.client.0.smithi157.stdout:2/555: dread d3/d2e/f75 [0,4194304] 0 2024-04-03T08:39:19.936 INFO:tasks.workunit.client.1.smithi181.stdout:0/391: chown d5/dc/c25 45764938 1 2024-04-03T08:39:19.936 INFO:tasks.workunit.client.1.smithi181.stdout:0/392: chown d5/d9/d60 1948199 1 2024-04-03T08:39:19.937 INFO:tasks.workunit.client.1.smithi181.stdout:2/438: mknod d13/d22/d27/ca6 0 2024-04-03T08:39:19.939 INFO:tasks.workunit.client.0.smithi157.stdout:5/593: rename dc/d29/d56/d49/d7f/dbc to dc/d29/d56/d9e/db5/dc9 0 2024-04-03T08:39:19.940 INFO:tasks.workunit.client.1.smithi181.stdout:7/343: creat d0/d1/d6/de/d6d/f77 x:0 0 0 2024-04-03T08:39:19.941 INFO:tasks.workunit.client.0.smithi157.stdout:9/513: truncate d1/d15/d27/d34/f53 568093 0 2024-04-03T08:39:19.941 INFO:tasks.workunit.client.0.smithi157.stdout:5/594: chown dc/d29/d56/d49/d53/d6c/f9a 33 1 2024-04-03T08:39:19.946 INFO:tasks.workunit.client.0.smithi157.stdout:1/519: mknod d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/cab 0 2024-04-03T08:39:19.949 INFO:tasks.workunit.client.0.smithi157.stdout:1/520: chown d2/d11/d24/d39/d3b/d1b 3390810 1 2024-04-03T08:39:19.949 INFO:tasks.workunit.client.0.smithi157.stdout:0/553: creat d2/d9/d36/fce x:0 0 0 2024-04-03T08:39:19.951 INFO:tasks.workunit.client.1.smithi181.stdout:5/393: unlink d4/d18/d3e/f57 0 2024-04-03T08:39:19.952 INFO:tasks.workunit.client.0.smithi157.stdout:1/521: write d2/d11/f98 [397654,129131] 0 2024-04-03T08:39:19.953 INFO:tasks.workunit.client.1.smithi181.stdout:3/388: symlink d0/d5/d6/l7a 0 2024-04-03T08:39:19.955 INFO:tasks.workunit.client.1.smithi181.stdout:3/389: chown d0/d17/d40 998 1 2024-04-03T08:39:19.956 INFO:tasks.workunit.client.0.smithi157.stdout:6/586: creat d1/d5/d17/d29/d62/d7f/fc8 x:0 0 0 2024-04-03T08:39:19.958 INFO:tasks.workunit.client.1.smithi181.stdout:3/390: write d0/d5/fa [195689,41479] 0 2024-04-03T08:39:19.958 INFO:tasks.workunit.client.1.smithi181.stdout:0/393: dread d5/d9/f3e [0,4194304] 0 2024-04-03T08:39:19.961 INFO:tasks.workunit.client.0.smithi157.stdout:6/587: write d1/d5/d17/d2a/d40/f7e [4900161,11141] 0 2024-04-03T08:39:19.963 INFO:tasks.workunit.client.0.smithi157.stdout:2/556: symlink d3/db/d44/d4c/d5a/d88/lc7 0 2024-04-03T08:39:19.973 INFO:tasks.workunit.client.0.smithi157.stdout:7/602: dread d0/d11/d6f/d76/da7/f3a [0,4194304] 0 2024-04-03T08:39:19.973 INFO:tasks.workunit.client.1.smithi181.stdout:2/439: rename d13/d22 to d13/da7 0 2024-04-03T08:39:19.975 INFO:tasks.workunit.client.1.smithi181.stdout:8/340: truncate d4/d45/db/d14/f20 7787317 0 2024-04-03T08:39:19.977 INFO:tasks.workunit.client.1.smithi181.stdout:8/341: read - d4/d45/db/f56 zero size 2024-04-03T08:39:19.977 INFO:tasks.workunit.client.1.smithi181.stdout:3/391: dwrite d0/d5/f33 [0,4194304] 0 2024-04-03T08:39:19.978 INFO:tasks.workunit.client.0.smithi157.stdout:9/514: fsync d1/d15/d16/f3a 0 2024-04-03T08:39:19.982 INFO:tasks.workunit.client.1.smithi181.stdout:3/392: write d0/d17/d36/d1e/f49 [1654217,130198] 0 2024-04-03T08:39:19.982 INFO:tasks.workunit.client.0.smithi157.stdout:0/554: rmdir d2/d9/dc/df/d9b 39 2024-04-03T08:39:19.984 INFO:tasks.workunit.client.1.smithi181.stdout:5/394: symlink d4/d18/d3e/l7b 0 2024-04-03T08:39:19.984 INFO:tasks.workunit.client.0.smithi157.stdout:6/588: dwrite d1/d5/d17/d29/faf [0,4194304] 0 2024-04-03T08:39:19.988 INFO:tasks.workunit.client.1.smithi181.stdout:4/458: dwrite d1/d16/f54 [0,4194304] 0 2024-04-03T08:39:19.989 INFO:tasks.workunit.client.0.smithi157.stdout:6/589: fdatasync d1/d4b/d38/da6/fbd 0 2024-04-03T08:39:19.992 INFO:tasks.workunit.client.0.smithi157.stdout:1/522: read - d2/d11/d23/f81 zero size 2024-04-03T08:39:19.992 INFO:tasks.workunit.client.0.smithi157.stdout:6/590: fsync d1/d5/d17/d2a/d40/f7e 0 2024-04-03T08:39:19.992 INFO:tasks.workunit.client.1.smithi181.stdout:4/459: truncate d1/d16/f23 628673 0 2024-04-03T08:39:19.993 INFO:tasks.workunit.client.0.smithi157.stdout:3/530: getdents d8/d1e 0 2024-04-03T08:39:19.994 INFO:tasks.workunit.client.1.smithi181.stdout:4/460: chown d1/d16/d37/f7d 6636 1 2024-04-03T08:39:19.998 INFO:tasks.workunit.client.1.smithi181.stdout:1/371: fdatasync d10/d15/d17/d19/f40 0 2024-04-03T08:39:20.000 INFO:tasks.workunit.client.0.smithi157.stdout:2/557: truncate d3/d2e/d32/f94 864835 0 2024-04-03T08:39:20.005 INFO:tasks.workunit.client.1.smithi181.stdout:4/461: dread d1/d1e/d2c/f77 [0,4194304] 0 2024-04-03T08:39:20.006 INFO:tasks.workunit.client.1.smithi181.stdout:6/398: getdents d6/d3e/d5e 0 2024-04-03T08:39:20.007 INFO:tasks.workunit.client.1.smithi181.stdout:8/342: rmdir d4/d45/db/d14/d31/d1c 39 2024-04-03T08:39:20.009 INFO:tasks.workunit.client.1.smithi181.stdout:4/462: truncate d1/d16/f5a 793807 0 2024-04-03T08:39:20.022 INFO:tasks.workunit.client.0.smithi157.stdout:4/540: getdents da/df/d2f/d97 0 2024-04-03T08:39:20.024 INFO:tasks.workunit.client.1.smithi181.stdout:3/393: creat d0/d5/d6/d32/f7b x:0 0 0 2024-04-03T08:39:20.026 INFO:tasks.workunit.client.1.smithi181.stdout:5/395: stat d4/d18/d25/l64 0 2024-04-03T08:39:20.030 INFO:tasks.workunit.client.1.smithi181.stdout:1/372: dread d10/d15/d17/d19/f45 [0,4194304] 0 2024-04-03T08:39:20.035 INFO:tasks.workunit.client.1.smithi181.stdout:9/463: link d1/da/d13/d22/f3b d1/da/d28/d80/f93 0 2024-04-03T08:39:20.037 INFO:tasks.workunit.client.1.smithi181.stdout:2/440: dwrite d13/da7/d27/d2f/f5e [0,4194304] 0 2024-04-03T08:39:20.038 INFO:tasks.workunit.client.0.smithi157.stdout:0/555: write d2/d9/d36/f3f [1021050,116338] 0 2024-04-03T08:39:20.038 INFO:tasks.workunit.client.1.smithi181.stdout:2/441: readlink d13/da7/d40/l9c 0 2024-04-03T08:39:20.039 INFO:tasks.workunit.client.0.smithi157.stdout:1/523: read d2/d11/d24/d39/d3b/d1b/f2a [1210656,77801] 0 2024-04-03T08:39:20.039 INFO:tasks.workunit.client.0.smithi157.stdout:3/531: rmdir d8/d1e/d2d/d39/d51/d7e 39 2024-04-03T08:39:20.042 INFO:tasks.workunit.client.0.smithi157.stdout:1/524: readlink d2/d11/d24/d39/d3b/d2e/l5b 0 2024-04-03T08:39:20.044 INFO:tasks.workunit.client.0.smithi157.stdout:3/532: fdatasync d8/d13/d1b/d4e/d50/d7c/fb3 0 2024-04-03T08:39:20.051 INFO:tasks.workunit.client.0.smithi157.stdout:8/591: getdents d2 0 2024-04-03T08:39:20.053 INFO:tasks.workunit.client.0.smithi157.stdout:9/515: mknod d1/d94/cb1 0 2024-04-03T08:39:20.054 INFO:tasks.workunit.client.0.smithi157.stdout:9/516: readlink d1/l11 0 2024-04-03T08:39:20.057 INFO:tasks.workunit.client.1.smithi181.stdout:7/344: creat d0/d1/f78 x:0 0 0 2024-04-03T08:39:20.061 INFO:tasks.workunit.client.0.smithi157.stdout:4/541: rename da/df/d24/d58 to da/df/d2f/d64/d8f/dbd 0 2024-04-03T08:39:20.065 INFO:tasks.workunit.client.1.smithi181.stdout:3/394: creat d0/d5/d6/d32/f7c x:0 0 0 2024-04-03T08:39:20.067 INFO:tasks.workunit.client.1.smithi181.stdout:3/395: write d0/d5/fa [939221,35381] 0 2024-04-03T08:39:20.068 INFO:tasks.workunit.client.1.smithi181.stdout:3/396: readlink d0/d5/d6/l67 0 2024-04-03T08:39:20.069 INFO:tasks.workunit.client.1.smithi181.stdout:0/394: creat d5/dc/d14/d29/f7e x:0 0 0 2024-04-03T08:39:20.070 INFO:tasks.workunit.client.0.smithi157.stdout:5/595: getdents dc/d29/d56/d49/d53 0 2024-04-03T08:39:20.071 INFO:tasks.workunit.client.1.smithi181.stdout:3/397: chown d0/d5/d6/dd/d25/d50/f66 5 1 2024-04-03T08:39:20.071 INFO:tasks.workunit.client.1.smithi181.stdout:0/395: dread - d5/dc/d14/d29/f7e zero size 2024-04-03T08:39:20.072 INFO:tasks.workunit.client.1.smithi181.stdout:3/398: chown d0/d5/d6/f5e 2186703 1 2024-04-03T08:39:20.079 INFO:tasks.workunit.client.1.smithi181.stdout:6/399: mkdir d6/d3e/d5e/d7c/d9/d7f/d81 0 2024-04-03T08:39:20.082 INFO:tasks.workunit.client.1.smithi181.stdout:7/345: rmdir d0 39 2024-04-03T08:39:20.085 INFO:tasks.workunit.client.0.smithi157.stdout:3/533: creat d8/d1e/d2d/d3b/d8c/db4/fbd x:0 0 0 2024-04-03T08:39:20.088 INFO:tasks.workunit.client.0.smithi157.stdout:5/596: creat dc/d29/d56/d52/fca x:0 0 0 2024-04-03T08:39:20.089 INFO:tasks.workunit.client.1.smithi181.stdout:9/464: dwrite d1/da/d13/f5b [0,4194304] 0 2024-04-03T08:39:20.090 INFO:tasks.workunit.client.1.smithi181.stdout:3/399: dwrite d0/d5/fa [0,4194304] 0 2024-04-03T08:39:20.091 INFO:tasks.workunit.client.0.smithi157.stdout:7/603: getdents d0/d11/d6f/d89 0 2024-04-03T08:39:20.092 INFO:tasks.workunit.client.0.smithi157.stdout:1/525: write d2/d11/d24/d39/f61 [1743122,105454] 0 2024-04-03T08:39:20.093 INFO:tasks.workunit.client.1.smithi181.stdout:1/373: symlink d10/d15/d17/d19/d4c/d66/l6e 0 2024-04-03T08:39:20.097 INFO:tasks.workunit.client.1.smithi181.stdout:4/463: creat d1/f92 x:0 0 0 2024-04-03T08:39:20.099 INFO:tasks.workunit.client.0.smithi157.stdout:5/597: read dc/d29/d56/d18/f3a [832558,7902] 0 2024-04-03T08:39:20.100 INFO:tasks.workunit.client.0.smithi157.stdout:0/556: link d2/d9/dc/df/d1b/d4a/c27 d2/d9/dc/df/d6f/ccf 0 2024-04-03T08:39:20.101 INFO:tasks.workunit.client.0.smithi157.stdout:6/591: getdents d1/d4b 0 2024-04-03T08:39:20.104 INFO:tasks.workunit.client.0.smithi157.stdout:4/542: dwrite da/df/d2f/f38 [0,4194304] 0 2024-04-03T08:39:20.105 INFO:tasks.workunit.client.0.smithi157.stdout:5/598: fsync dc/fbe 0 2024-04-03T08:39:20.107 INFO:tasks.workunit.client.1.smithi181.stdout:9/465: creat d1/da/d13/d22/d23/f94 x:0 0 0 2024-04-03T08:39:20.109 INFO:tasks.workunit.client.1.smithi181.stdout:9/466: fsync d1/da/f5a 0 2024-04-03T08:39:20.110 INFO:tasks.workunit.client.1.smithi181.stdout:1/374: mkdir d10/d15/d4a/d6f 0 2024-04-03T08:39:20.110 INFO:tasks.workunit.client.0.smithi157.stdout:7/604: creat d0/d11/d6f/d89/fd6 x:0 0 0 2024-04-03T08:39:20.114 INFO:tasks.workunit.client.1.smithi181.stdout:4/464: dwrite d1/d16/f5a [0,4194304] 0 2024-04-03T08:39:20.116 INFO:tasks.workunit.client.1.smithi181.stdout:4/465: readlink d1/d16/d24/d5e/d2b/l63 0 2024-04-03T08:39:20.121 INFO:tasks.workunit.client.1.smithi181.stdout:3/400: rename d0/d5/d6/d32/d43/l53 to d0/d5/d6/dd/d25/d50/l7d 0 2024-04-03T08:39:20.122 INFO:tasks.workunit.client.1.smithi181.stdout:3/401: chown d0 92867119 1 2024-04-03T08:39:20.124 INFO:tasks.workunit.client.0.smithi157.stdout:8/592: link d2/d11/d10/d24/d5b/f4b d2/d11/fca 0 2024-04-03T08:39:20.125 INFO:tasks.workunit.client.1.smithi181.stdout:8/343: link d4/d45/c6e d4/d45/db/d14/d31/d1c/c73 0 2024-04-03T08:39:20.127 INFO:tasks.workunit.client.1.smithi181.stdout:8/344: write d4/f36 [710143,20087] 0 2024-04-03T08:39:20.130 INFO:tasks.workunit.client.0.smithi157.stdout:8/593: truncate d2/d11/ff 2551996 0 2024-04-03T08:39:20.131 INFO:tasks.workunit.client.0.smithi157.stdout:4/543: dread da/df/d24/d35/d6a/f77 [0,4194304] 0 2024-04-03T08:39:20.132 INFO:tasks.workunit.client.1.smithi181.stdout:5/396: getdents d4/d18/d55 0 2024-04-03T08:39:20.132 INFO:tasks.workunit.client.1.smithi181.stdout:6/400: dread d6/d31/d36/f5d [0,4194304] 0 2024-04-03T08:39:20.134 INFO:tasks.workunit.client.1.smithi181.stdout:2/442: getdents d13/d1c/d4a/d7f 0 2024-04-03T08:39:20.134 INFO:tasks.workunit.client.0.smithi157.stdout:5/599: unlink dc/d29/d56/d18/f63 0 2024-04-03T08:39:20.134 INFO:tasks.workunit.client.1.smithi181.stdout:5/397: chown d4/d22/l48 5 1 2024-04-03T08:39:20.135 INFO:tasks.workunit.client.1.smithi181.stdout:7/346: truncate d0/d1/d6/de/d17/f24 1361358 0 2024-04-03T08:39:20.136 INFO:tasks.workunit.client.1.smithi181.stdout:5/398: chown d4/l1f 14675350 1 2024-04-03T08:39:20.138 INFO:tasks.workunit.client.0.smithi157.stdout:6/592: dread d1/f6d [0,4194304] 0 2024-04-03T08:39:20.143 INFO:tasks.workunit.client.0.smithi157.stdout:4/544: write da/df/d2f/d64/d8f/dbd/d68/f8c [983684,6800] 0 2024-04-03T08:39:20.144 INFO:tasks.workunit.client.1.smithi181.stdout:1/375: mkdir d10/d15/d17/d19/d33/d70 0 2024-04-03T08:39:20.146 INFO:tasks.workunit.client.1.smithi181.stdout:1/376: chown d10/d15/d17/d19/d4c/d66 270692917 1 2024-04-03T08:39:20.146 INFO:tasks.workunit.client.1.smithi181.stdout:4/466: mkdir d1/d1e/d2c/d67/d93 0 2024-04-03T08:39:20.146 INFO:tasks.workunit.client.0.smithi157.stdout:4/545: truncate da/df/d6b/fb1 435114 0 2024-04-03T08:39:20.154 INFO:tasks.workunit.client.1.smithi181.stdout:9/467: rename d1/da/d28/d30/d3e/d4e/d62/l79 to d1/da/d13/d73/l95 0 2024-04-03T08:39:20.155 INFO:tasks.workunit.client.1.smithi181.stdout:9/468: chown d1/da/d28 2 1 2024-04-03T08:39:20.157 INFO:tasks.workunit.client.1.smithi181.stdout:9/469: chown d1/da/d13/d22/d23/c44 74086 1 2024-04-03T08:39:20.157 INFO:tasks.workunit.client.1.smithi181.stdout:3/402: creat d0/d17/d36/d1e/f7e x:0 0 0 2024-04-03T08:39:20.158 INFO:tasks.workunit.client.0.smithi157.stdout:0/557: dread d2/d9/d51/f61 [0,4194304] 0 2024-04-03T08:39:20.159 INFO:tasks.workunit.client.1.smithi181.stdout:9/470: fsync d1/da/d13/d22/f42 0 2024-04-03T08:39:20.159 INFO:tasks.workunit.client.0.smithi157.stdout:1/526: rmdir d2/d11/d24/d67/da9 0 2024-04-03T08:39:20.162 INFO:tasks.workunit.client.0.smithi157.stdout:9/517: dwrite d1/d15/f1a [4194304,4194304] 0 2024-04-03T08:39:20.166 INFO:tasks.workunit.client.1.smithi181.stdout:7/347: creat d0/d1/d6/de/d57/f79 x:0 0 0 2024-04-03T08:39:20.167 INFO:tasks.workunit.client.1.smithi181.stdout:6/401: dread d6/d31/d36/f44 [0,4194304] 0 2024-04-03T08:39:20.168 INFO:tasks.workunit.client.1.smithi181.stdout:5/399: mknod d4/d18/d25/d68/c7c 0 2024-04-03T08:39:20.169 INFO:tasks.workunit.client.0.smithi157.stdout:6/593: unlink d1/d5/d17/d2a/d37/f76 0 2024-04-03T08:39:20.169 INFO:tasks.workunit.client.0.smithi157.stdout:8/594: mknod d2/d6f/d70/d89/ccb 0 2024-04-03T08:39:20.170 INFO:tasks.workunit.client.1.smithi181.stdout:0/396: sync 2024-04-03T08:39:20.173 INFO:tasks.workunit.client.0.smithi157.stdout:8/595: fdatasync d2/d11/d10/d24/d5b/d2e/d75/d81/f96 0 2024-04-03T08:39:20.175 INFO:tasks.workunit.client.1.smithi181.stdout:1/377: symlink d10/d15/d4b/l71 0 2024-04-03T08:39:20.177 INFO:tasks.workunit.client.0.smithi157.stdout:9/518: fdatasync d1/f93 0 2024-04-03T08:39:20.178 INFO:tasks.workunit.client.0.smithi157.stdout:5/600: creat dc/d29/d56/d9e/dc3/fcb x:0 0 0 2024-04-03T08:39:20.183 INFO:tasks.workunit.client.1.smithi181.stdout:9/471: symlink d1/da/d28/d30/d3e/d4e/d62/l96 0 2024-04-03T08:39:20.184 INFO:tasks.workunit.client.1.smithi181.stdout:6/402: dwrite d6/d31/d36/f4c [4194304,4194304] 0 2024-04-03T08:39:20.186 INFO:tasks.workunit.client.1.smithi181.stdout:6/403: read - d6/d3e/d5e/d7c/d9/d22/d4f/f7d zero size 2024-04-03T08:39:20.189 INFO:tasks.workunit.client.1.smithi181.stdout:6/404: fdatasync d6/d31/f6b 0 2024-04-03T08:39:20.192 INFO:tasks.workunit.client.1.smithi181.stdout:2/443: creat d13/da7/d85/fa8 x:0 0 0 2024-04-03T08:39:20.192 INFO:tasks.workunit.client.0.smithi157.stdout:1/527: dwrite d2/d11/d24/d39/d3b/d1b/f30 [4194304,4194304] 0 2024-04-03T08:39:20.199 INFO:tasks.workunit.client.1.smithi181.stdout:7/348: creat d0/d1/d6/de/d57/f7a x:0 0 0 2024-04-03T08:39:20.203 INFO:tasks.workunit.client.1.smithi181.stdout:7/349: write d0/d1/d6/de/f69 [631377,75024] 0 2024-04-03T08:39:20.207 INFO:tasks.workunit.client.0.smithi157.stdout:5/601: dwrite dc/d29/d56/d52/f58 [0,4194304] 0 2024-04-03T08:39:20.209 INFO:tasks.workunit.client.1.smithi181.stdout:7/350: chown d0/d1/d6/de/d17 1887652298 1 2024-04-03T08:39:20.210 INFO:tasks.workunit.client.1.smithi181.stdout:1/378: dread d10/d15/d17/d19/f2f [0,4194304] 0 2024-04-03T08:39:20.211 INFO:tasks.workunit.client.0.smithi157.stdout:7/605: getdents d0/d11/d15/d17/d9f 0 2024-04-03T08:39:20.216 INFO:tasks.workunit.client.1.smithi181.stdout:8/345: dread d4/d2a/d37/f3f [0,4194304] 0 2024-04-03T08:39:20.217 INFO:tasks.workunit.client.0.smithi157.stdout:6/594: getdents d1/d4b/d61/d92 0 2024-04-03T08:39:20.219 INFO:tasks.workunit.client.1.smithi181.stdout:6/405: dwrite d6/d3e/d40/f4e [0,4194304] 0 2024-04-03T08:39:20.221 INFO:tasks.workunit.client.1.smithi181.stdout:6/406: chown d6/d53/d80/f68 1910514 1 2024-04-03T08:39:20.227 INFO:tasks.workunit.client.1.smithi181.stdout:4/467: write d1/d1e/f5b [744389,35508] 0 2024-04-03T08:39:20.230 INFO:tasks.workunit.client.1.smithi181.stdout:0/397: dread d5/dc/d14/d29/f48 [0,4194304] 0 2024-04-03T08:39:20.233 INFO:tasks.workunit.client.0.smithi157.stdout:0/558: link d2/d9/dc/c9c d2/d9/dc/df/d6f/dad/cd0 0 2024-04-03T08:39:20.240 INFO:tasks.workunit.client.1.smithi181.stdout:9/472: dwrite d1/da/d13/d22/f6c [0,4194304] 0 2024-04-03T08:39:20.248 INFO:tasks.workunit.client.0.smithi157.stdout:5/602: truncate dc/f85 737514 0 2024-04-03T08:39:20.252 INFO:tasks.workunit.client.1.smithi181.stdout:5/400: symlink d4/d18/d2c/l7d 0 2024-04-03T08:39:20.253 INFO:tasks.workunit.client.1.smithi181.stdout:5/401: fsync d4/d18/d25/f3c 0 2024-04-03T08:39:20.254 INFO:tasks.workunit.client.0.smithi157.stdout:4/546: dwrite da/df/d2f/d64/f81 [0,4194304] 0 2024-04-03T08:39:20.254 INFO:tasks.workunit.client.0.smithi157.stdout:8/596: dwrite d2/f39 [0,4194304] 0 2024-04-03T08:39:20.256 INFO:tasks.workunit.client.0.smithi157.stdout:5/603: read dc/d29/d56/d18/f99 [131464,115203] 0 2024-04-03T08:39:20.267 INFO:tasks.workunit.client.1.smithi181.stdout:7/351: mknod d0/d1/d6/de/d17/d27/d72/c7b 0 2024-04-03T08:39:20.269 INFO:tasks.workunit.client.0.smithi157.stdout:6/595: mknod d1/d5/d17/d2a/d37/cc9 0 2024-04-03T08:39:20.273 INFO:tasks.workunit.client.1.smithi181.stdout:1/379: creat d10/d15/d17/d19/d33/f72 x:0 0 0 2024-04-03T08:39:20.275 INFO:tasks.workunit.client.0.smithi157.stdout:9/519: creat d1/d36/fb2 x:0 0 0 2024-04-03T08:39:20.276 INFO:tasks.workunit.client.1.smithi181.stdout:3/403: link d0/c18 d0/d5/d6/d32/c7f 0 2024-04-03T08:39:20.278 INFO:tasks.workunit.client.0.smithi157.stdout:9/520: chown d1/d36/da3 64742 1 2024-04-03T08:39:20.279 INFO:tasks.workunit.client.0.smithi157.stdout:1/528: dwrite d2/d11/d24/d39/d3b/d1b/f4e [0,4194304] 0 2024-04-03T08:39:20.286 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:19 smithi157 ceph-mon[35083]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:20.287 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:19 smithi157 ceph-mon[35083]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:20.287 INFO:tasks.workunit.client.1.smithi181.stdout:4/468: mkdir d1/d16/d24/d5e/d31/d39/d5d/d94 0 2024-04-03T08:39:20.295 INFO:tasks.workunit.client.0.smithi157.stdout:8/597: fsync d2/d11/d10/d24/d5b/d2e/d75/da9/fc3 0 2024-04-03T08:39:20.303 INFO:tasks.workunit.client.0.smithi157.stdout:5/604: creat dc/d29/d51/fcc x:0 0 0 2024-04-03T08:39:20.304 INFO:tasks.workunit.client.0.smithi157.stdout:1/529: dwrite d2/d11/d24/d39/d3b/d2e/f7d [0,4194304] 0 2024-04-03T08:39:20.304 INFO:tasks.workunit.client.1.smithi181.stdout:6/407: sync 2024-04-03T08:39:20.308 INFO:tasks.workunit.client.1.smithi181.stdout:6/408: write d6/d3e/d5e/d7c/d50/f61 [854257,63938] 0 2024-04-03T08:39:20.311 INFO:tasks.workunit.client.0.smithi157.stdout:7/606: mknod d0/d11/d15/d17/d1c/d4f/dcd/cd7 0 2024-04-03T08:39:20.311 INFO:tasks.workunit.client.1.smithi181.stdout:6/409: dread - d6/d3e/d5e/d7c/f6d zero size 2024-04-03T08:39:20.313 INFO:tasks.workunit.client.0.smithi157.stdout:6/596: mkdir d1/d5/d17/d2a/d37/dca 0 2024-04-03T08:39:20.316 INFO:tasks.workunit.client.1.smithi181.stdout:9/473: rename d1/d34/d39/f50 to d1/da/d28/d80/f97 0 2024-04-03T08:39:20.320 INFO:tasks.workunit.client.0.smithi157.stdout:9/521: chown d1/d15/d27/f32 10 1 2024-04-03T08:39:20.329 INFO:tasks.workunit.client.1.smithi181.stdout:7/352: creat d0/d1/d6/de/d17/d64/f7c x:0 0 0 2024-04-03T08:39:20.329 INFO:tasks.workunit.client.1.smithi181.stdout:0/398: dread d5/dc/d10/f27 [0,4194304] 0 2024-04-03T08:39:20.331 INFO:tasks.workunit.client.0.smithi157.stdout:0/559: dwrite d2/d9/d51/d63/d71/fbc [0,4194304] 0 2024-04-03T08:39:20.333 INFO:tasks.workunit.client.1.smithi181.stdout:1/380: creat d10/d15/d17/d19/d33/f73 x:0 0 0 2024-04-03T08:39:20.335 INFO:tasks.workunit.client.0.smithi157.stdout:8/598: mknod d2/d7b/ccc 0 2024-04-03T08:39:20.337 INFO:tasks.workunit.client.0.smithi157.stdout:4/547: write da/df/d24/d35/f80 [23078,23314] 0 2024-04-03T08:39:20.338 INFO:tasks.workunit.client.1.smithi181.stdout:2/444: truncate d13/d1c/f63 1381996 0 2024-04-03T08:39:20.340 INFO:tasks.workunit.client.1.smithi181.stdout:2/445: dread d13/d1c/f51 [0,4194304] 0 2024-04-03T08:39:20.341 INFO:tasks.workunit.client.1.smithi181.stdout:8/346: symlink d4/d45/l74 0 2024-04-03T08:39:20.342 INFO:tasks.workunit.client.0.smithi157.stdout:5/605: creat dc/d29/d56/d9e/dc3/fcd x:0 0 0 2024-04-03T08:39:20.343 INFO:tasks.workunit.client.0.smithi157.stdout:6/597: dread d1/d5/d17/d2a/d73/f71 [0,4194304] 0 2024-04-03T08:39:20.344 INFO:tasks.workunit.client.1.smithi181.stdout:2/446: fsync d13/d1c/f9d 0 2024-04-03T08:39:20.344 INFO:tasks.workunit.client.1.smithi181.stdout:8/347: chown d4/d45/db/d14/f49 21 1 2024-04-03T08:39:20.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:19 smithi181 ceph-mon[44183]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:20.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:19 smithi181 ceph-mon[44183]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:20.347 INFO:tasks.workunit.client.0.smithi157.stdout:5/606: fdatasync dc/d29/d56/d9e/dc3/fcb 0 2024-04-03T08:39:20.348 INFO:tasks.workunit.client.1.smithi181.stdout:4/469: unlink d1/d1e/d2c/d67/f76 0 2024-04-03T08:39:20.349 INFO:tasks.workunit.client.0.smithi157.stdout:5/607: read dc/d29/d51/f64 [345758,2281] 0 2024-04-03T08:39:20.352 INFO:tasks.workunit.client.1.smithi181.stdout:9/474: chown d1/da/d13/l1d 87645391 1 2024-04-03T08:39:20.352 INFO:tasks.workunit.client.0.smithi157.stdout:5/608: chown dc/d29/d56/d2e/c98 49925 1 2024-04-03T08:39:20.353 INFO:tasks.workunit.client.1.smithi181.stdout:5/402: creat d4/d18/d25/d6e/f7e x:0 0 0 2024-04-03T08:39:20.355 INFO:tasks.workunit.client.1.smithi181.stdout:0/399: rmdir d5/d9/d2a 39 2024-04-03T08:39:20.355 INFO:tasks.workunit.client.1.smithi181.stdout:9/475: dread - d1/da/d28/d80/f93 zero size 2024-04-03T08:39:20.356 INFO:tasks.workunit.client.0.smithi157.stdout:0/560: mkdir d2/d9/dc/df/d6f/dad/dbb/dd1 0 2024-04-03T08:39:20.358 INFO:tasks.workunit.client.1.smithi181.stdout:5/403: write d4/d18/d55/d5a/f76 [241233,29787] 0 2024-04-03T08:39:20.360 INFO:tasks.workunit.client.1.smithi181.stdout:0/400: chown d5/dc/d10/d58/d6c/f26 515630497 1 2024-04-03T08:39:20.360 INFO:tasks.workunit.client.0.smithi157.stdout:8/599: truncate d2/d20/d23/f4e 5085582 0 2024-04-03T08:39:20.364 INFO:tasks.workunit.client.0.smithi157.stdout:0/561: read d2/f25 [1634335,52529] 0 2024-04-03T08:39:20.366 INFO:tasks.workunit.client.0.smithi157.stdout:1/530: creat d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fac x:0 0 0 2024-04-03T08:39:20.366 INFO:tasks.workunit.client.0.smithi157.stdout:6/598: fdatasync d1/d5/d17/d29/d62/d7f/f90 0 2024-04-03T08:39:20.366 INFO:tasks.workunit.client.0.smithi157.stdout:8/600: write d2/d11/d10/d24/d5b/d53/faf [747700,77658] 0 2024-04-03T08:39:20.366 INFO:tasks.workunit.client.1.smithi181.stdout:8/348: creat d4/d44/d59/d5f/f75 x:0 0 0 2024-04-03T08:39:20.369 INFO:tasks.workunit.client.0.smithi157.stdout:6/599: write d1/d5/d17/fba [997787,115918] 0 2024-04-03T08:39:20.370 INFO:tasks.workunit.client.1.smithi181.stdout:6/410: mknod d6/d7b/c82 0 2024-04-03T08:39:20.380 INFO:tasks.workunit.client.0.smithi157.stdout:9/522: symlink d1/d94/lb3 0 2024-04-03T08:39:20.382 INFO:tasks.workunit.client.1.smithi181.stdout:3/404: dwrite d0/d5/d6/f39 [0,4194304] 0 2024-04-03T08:39:20.385 INFO:tasks.workunit.client.0.smithi157.stdout:0/562: readlink d2/d9/d5f/d8d/la1 0 2024-04-03T08:39:20.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.389+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c4004bed0 con 0x7f5c400fcee0 2024-04-03T08:39:20.391 INFO:tasks.workunit.client.1.smithi181.stdout:1/381: symlink d10/d15/d17/d37/l74 0 2024-04-03T08:39:20.391 INFO:tasks.workunit.client.0.smithi157.stdout:4/548: dwrite da/df/d11/f1f [0,4194304] 0 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.390+0000 7f5c3cc00700 1 -- 172.21.15.157:0/142326778 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f5c34020070 con 0x7f5c400fcee0 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:39:20.392 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 12, 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:39:20.393 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:39:20.394 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5c28038ac0 msgr2=0x7f5c2803af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5c28038ac0 0x7f5c2803af70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c004d00 tx=0x7f5c2c009ce0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 msgr2=0x7f5c4010fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 0x7f5c4010fd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c34000c00 tx=0x7f5c34009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 shutdown_connections 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5c28038ac0 0x7f5c2803af70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c400fcee0 0x7f5c4010fd20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 --2- 172.21.15.157:0/142326778 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c400fe0d0 0x7f5c40110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.394+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 >> 172.21.15.157:0/142326778 conn(0x7f5c400f8560 msgr2=0x7f5c400f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:20.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.396+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 shutdown_connections 2024-04-03T08:39:20.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.396+0000 7f5c47c00700 1 -- 172.21.15.157:0/142326778 wait complete. 2024-04-03T08:39:20.410 INFO:tasks.workunit.client.0.smithi157.stdout:8/601: unlink d2/d11/d10/d24/d5b/d2e/d75/da9/fc3 0 2024-04-03T08:39:20.413 INFO:tasks.workunit.client.0.smithi157.stdout:4/549: dwrite da/df/d24/d35/d6a/d78/f93 [0,4194304] 0 2024-04-03T08:39:20.418 INFO:tasks.workunit.client.1.smithi181.stdout:8/349: dread d4/d45/db/d14/d31/d1c/d51/f52 [0,4194304] 0 2024-04-03T08:39:20.421 INFO:tasks.workunit.client.1.smithi181.stdout:4/470: symlink d1/d16/d24/d5e/d2b/l95 0 2024-04-03T08:39:20.427 INFO:tasks.workunit.client.1.smithi181.stdout:3/405: creat d0/d17/d36/d1e/f80 x:0 0 0 2024-04-03T08:39:20.429 INFO:tasks.workunit.client.1.smithi181.stdout:7/353: truncate d0/d1/d6/de/d17/d27/f49 1669229 0 2024-04-03T08:39:20.429 INFO:tasks.workunit.client.1.smithi181.stdout:7/354: chown d0/f5b 303162197 1 2024-04-03T08:39:20.431 INFO:tasks.workunit.client.0.smithi157.stdout:5/609: dwrite dc/f1d [4194304,4194304] 0 2024-04-03T08:39:20.437 INFO:tasks.workunit.client.0.smithi157.stdout:0/563: write d2/d9/dc/df/d1b/fb2 [2125181,88932] 0 2024-04-03T08:39:20.438 INFO:tasks.workunit.client.1.smithi181.stdout:2/447: sync 2024-04-03T08:39:20.445 INFO:tasks.workunit.client.1.smithi181.stdout:5/404: write d4/d18/d25/f41 [4663655,2124] 0 2024-04-03T08:39:20.449 INFO:tasks.workunit.client.0.smithi157.stdout:7/607: getdents d0/d11/d15/d17/d43/d8a/d8f 0 2024-04-03T08:39:20.449 INFO:tasks.workunit.client.0.smithi157.stdout:6/600: write d1/d5/d17/d2a/f4d [328556,53409] 0 2024-04-03T08:39:20.450 INFO:tasks.workunit.client.0.smithi157.stdout:4/550: mkdir da/df/d2f/dbc/dbe 0 2024-04-03T08:39:20.450 INFO:tasks.workunit.client.1.smithi181.stdout:3/406: mkdir d0/d17/d63/d81 0 2024-04-03T08:39:20.457 INFO:tasks.workunit.client.1.smithi181.stdout:9/476: rmdir d1/d34/d39/d7c/d86 0 2024-04-03T08:39:20.457 INFO:tasks.workunit.client.0.smithi157.stdout:4/551: truncate da/df/d24/f75 4818845 0 2024-04-03T08:39:20.458 INFO:tasks.workunit.client.1.smithi181.stdout:7/355: creat d0/d1/d6/de/d6d/f7d x:0 0 0 2024-04-03T08:39:20.459 INFO:tasks.workunit.client.0.smithi157.stdout:4/552: fdatasync da/df/d2f/d54/d5f/fb3 0 2024-04-03T08:39:20.461 INFO:tasks.workunit.client.0.smithi157.stdout:0/564: dread d2/d9/d36/f3f [0,4194304] 0 2024-04-03T08:39:20.462 INFO:tasks.workunit.client.0.smithi157.stdout:9/523: mknod d1/d15/d27/d34/da6/cb4 0 2024-04-03T08:39:20.462 INFO:tasks.workunit.client.1.smithi181.stdout:7/356: write d0/d1/f4a [736723,119082] 0 2024-04-03T08:39:20.463 INFO:tasks.workunit.client.1.smithi181.stdout:0/401: creat d5/d9/f7f x:0 0 0 2024-04-03T08:39:20.466 INFO:tasks.workunit.client.1.smithi181.stdout:8/350: mknod d4/d45/d9/c76 0 2024-04-03T08:39:20.467 INFO:tasks.workunit.client.1.smithi181.stdout:0/402: write d5/d9/d2c/f76 [196988,55949] 0 2024-04-03T08:39:20.467 INFO:tasks.workunit.client.0.smithi157.stdout:4/553: truncate da/df/d24/d35/d3c/f71 1447299 0 2024-04-03T08:39:20.469 INFO:tasks.workunit.client.1.smithi181.stdout:4/471: dwrite d1/d16/d24/d5e/f45 [0,4194304] 0 2024-04-03T08:39:20.471 INFO:tasks.workunit.client.0.smithi157.stdout:1/531: creat d2/d11/d24/d39/d3b/fad x:0 0 0 2024-04-03T08:39:20.472 INFO:tasks.workunit.client.1.smithi181.stdout:5/405: creat d4/d22/d78/f7f x:0 0 0 2024-04-03T08:39:20.474 INFO:tasks.workunit.client.1.smithi181.stdout:1/382: write d10/d15/d17/f3f [1951968,99531] 0 2024-04-03T08:39:20.476 INFO:tasks.workunit.client.1.smithi181.stdout:3/407: dwrite d0/d5/d6/dd/d25/f44 [0,4194304] 0 2024-04-03T08:39:20.478 INFO:tasks.workunit.client.0.smithi157.stdout:5/610: mkdir dc/dce 0 2024-04-03T08:39:20.479 INFO:tasks.workunit.client.1.smithi181.stdout:3/408: chown d0/d5/d6/d32/f7c 5400097 1 2024-04-03T08:39:20.483 INFO:tasks.workunit.client.0.smithi157.stdout:1/532: dread d2/d11/d24/d39/d3b/d2e/d48/d58/f72 [0,4194304] 0 2024-04-03T08:39:20.494 INFO:tasks.workunit.client.0.smithi157.stdout:4/554: symlink da/df/d2f/d54/d5f/lbf 0 2024-04-03T08:39:20.498 INFO:tasks.workunit.client.0.smithi157.stdout:0/565: dread d2/d9/dc/df/d1b/d35/d3d/f58 [0,4194304] 0 2024-04-03T08:39:20.500 INFO:tasks.workunit.client.0.smithi157.stdout:9/524: mknod d1/d15/d27/daf/da7/cb5 0 2024-04-03T08:39:20.505 INFO:tasks.workunit.client.0.smithi157.stdout:7/608: dwrite d0/d11/f71 [4194304,4194304] 0 2024-04-03T08:39:20.514 INFO:tasks.workunit.client.1.smithi181.stdout:6/411: getdents d6/d31/d36 0 2024-04-03T08:39:20.514 INFO:tasks.workunit.client.1.smithi181.stdout:8/351: rmdir d4/d44/d59 39 2024-04-03T08:39:20.515 INFO:tasks.workunit.client.0.smithi157.stdout:0/566: chown d2/d9/d51/c7d 28 1 2024-04-03T08:39:20.516 INFO:tasks.workunit.client.0.smithi157.stdout:5/611: dwrite dc/f7e [4194304,4194304] 0 2024-04-03T08:39:20.517 INFO:tasks.workunit.client.1.smithi181.stdout:8/352: read d4/d45/f2e [631197,106074] 0 2024-04-03T08:39:20.517 INFO:tasks.workunit.client.1.smithi181.stdout:0/403: unlink d5/dc/d10/d58/d6c/l57 0 2024-04-03T08:39:20.528 INFO:tasks.workunit.client.1.smithi181.stdout:3/409: unlink d0/d17/d40/c68 0 2024-04-03T08:39:20.529 INFO:tasks.workunit.client.0.smithi157.stdout:6/601: write d1/d5/d17/f67 [3586420,23437] 0 2024-04-03T08:39:20.536 INFO:tasks.workunit.client.0.smithi157.stdout:9/525: dwrite d1/f42 [0,4194304] 0 2024-04-03T08:39:20.537 INFO:tasks.workunit.client.0.smithi157.stdout:0/567: mkdir d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2 0 2024-04-03T08:39:20.543 INFO:tasks.workunit.client.0.smithi157.stdout:7/609: fdatasync d0/d11/d6f/d76/da7/f62 0 2024-04-03T08:39:20.543 INFO:tasks.workunit.client.0.smithi157.stdout:1/533: write d2/d11/d24/d39/d3b/d1b/f2a [4507828,100714] 0 2024-04-03T08:39:20.543 INFO:tasks.workunit.client.1.smithi181.stdout:9/477: truncate d1/da/d28/d30/d3e/d4e/f68 1718937 0 2024-04-03T08:39:20.545 INFO:tasks.workunit.client.0.smithi157.stdout:4/555: dwrite da/df/d2f/f40 [4194304,4194304] 0 2024-04-03T08:39:20.546 INFO:tasks.workunit.client.0.smithi157.stdout:5/612: fsync dc/f85 0 2024-04-03T08:39:20.546 INFO:tasks.workunit.client.1.smithi181.stdout:2/448: sync 2024-04-03T08:39:20.547 INFO:tasks.workunit.client.1.smithi181.stdout:2/449: dread - d13/d1c/d4a/d68/f9a zero size 2024-04-03T08:39:20.550 INFO:tasks.workunit.client.1.smithi181.stdout:3/410: dread d0/d5/f38 [0,4194304] 0 2024-04-03T08:39:20.552 INFO:tasks.workunit.client.0.smithi157.stdout:4/556: chown da/df/d24/f59 303 1 2024-04-03T08:39:20.560 INFO:tasks.workunit.client.1.smithi181.stdout:9/478: dwrite d1/da/d13/d22/f8d [0,4194304] 0 2024-04-03T08:39:20.563 INFO:tasks.workunit.client.1.smithi181.stdout:5/406: mkdir d4/d80 0 2024-04-03T08:39:20.565 INFO:tasks.workunit.client.0.smithi157.stdout:7/610: dwrite d0/d11/d6f/d76/da7/fb9 [0,4194304] 0 2024-04-03T08:39:20.566 INFO:tasks.workunit.client.0.smithi157.stdout:0/568: mknod d2/d9/dc/df/d1b/cd3 0 2024-04-03T08:39:20.571 INFO:tasks.workunit.client.1.smithi181.stdout:4/472: rename d1/d16/d37/c90 to d1/d16/d37/d34/d69/c96 0 2024-04-03T08:39:20.572 INFO:tasks.workunit.client.0.smithi157.stdout:2/558: sync 2024-04-03T08:39:20.572 INFO:tasks.workunit.client.1.smithi181.stdout:0/404: dwrite d5/dc/d14/f77 [4194304,4194304] 0 2024-04-03T08:39:20.577 INFO:tasks.workunit.client.1.smithi181.stdout:7/357: creat d0/d1/f7e x:0 0 0 2024-04-03T08:39:20.598 INFO:tasks.workunit.client.0.smithi157.stdout:2/559: symlink d3/db/d44/lc8 0 2024-04-03T08:39:20.598 INFO:tasks.workunit.client.0.smithi157.stdout:6/602: creat d1/fcb x:0 0 0 2024-04-03T08:39:20.598 INFO:tasks.workunit.client.1.smithi181.stdout:1/383: rename d10/d15/d17/d19/d4c/d66/l6e to d10/d15/d17/d23/d27/l75 0 2024-04-03T08:39:20.600 INFO:tasks.workunit.client.0.smithi157.stdout:7/611: chown d0/d16/ca8 105676551 1 2024-04-03T08:39:20.601 INFO:tasks.workunit.client.0.smithi157.stdout:4/557: creat da/df/d2f/fc0 x:0 0 0 2024-04-03T08:39:20.602 INFO:tasks.workunit.client.1.smithi181.stdout:4/473: truncate d1/f32 520704 0 2024-04-03T08:39:20.606 INFO:tasks.workunit.client.0.smithi157.stdout:6/603: write d1/fc [5343140,16673] 0 2024-04-03T08:39:20.607 INFO:tasks.workunit.client.1.smithi181.stdout:0/405: truncate d5/dc/d10/d58/d6c/f26 1590447 0 2024-04-03T08:39:20.609 INFO:tasks.workunit.client.0.smithi157.stdout:0/569: dwrite d2/d9/dc/df/d6f/d9d/d6a/d91/dae/fb6 [0,4194304] 0 2024-04-03T08:39:20.609 INFO:tasks.workunit.client.0.smithi157.stdout:7/612: write d0/d11/d15/d17/d1c/f4b [2776767,14552] 0 2024-04-03T08:39:20.614 INFO:tasks.workunit.client.0.smithi157.stdout:0/570: read - d2/d9/d36/d38/faf zero size 2024-04-03T08:39:20.617 INFO:tasks.workunit.client.0.smithi157.stdout:7/613: write d0/d11/d6f/d76/da7/fb9 [2205686,80044] 0 2024-04-03T08:39:20.617 INFO:tasks.workunit.client.0.smithi157.stdout:5/613: dwrite dc/f11 [0,4194304] 0 2024-04-03T08:39:20.618 INFO:tasks.workunit.client.1.smithi181.stdout:8/353: creat d4/d44/f77 x:0 0 0 2024-04-03T08:39:20.627 INFO:tasks.workunit.client.1.smithi181.stdout:6/412: truncate d6/d3e/d5e/d7c/d9/d22/d4f/f55 1178114 0 2024-04-03T08:39:20.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.631+0000 7f41b3000700 1 -- 172.21.15.157:0/2968266140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 msgr2=0x7f41ac06e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:20.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.631+0000 7f41b3000700 1 --2- 172.21.15.157:0/2968266140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac06e460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4198004940 tx=0x7f4198009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:20.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.632+0000 7f41b3000700 1 -- 172.21.15.157:0/2968266140 shutdown_connections 2024-04-03T08:39:20.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.632+0000 7f41b3000700 1 --2- 172.21.15.157:0/2968266140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.632+0000 7f41b3000700 1 --2- 172.21.15.157:0/2968266140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac06e460 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.632+0000 7f41b3000700 1 -- 172.21.15.157:0/2968266140 >> 172.21.15.157:0/2968266140 conn(0x7f41ac069de0 msgr2=0x7f41ac06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:20.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.634+0000 7f41b3000700 1 -- 172.21.15.157:0/2968266140 shutdown_connections 2024-04-03T08:39:20.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.634+0000 7f41b3000700 1 -- 172.21.15.157:0/2968266140 wait complete. 2024-04-03T08:39:20.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.636+0000 7f41b3000700 1 Processor -- start 2024-04-03T08:39:20.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.637+0000 7f41b3000700 1 -- start start 2024-04-03T08:39:20.639 INFO:tasks.workunit.client.1.smithi181.stdout:5/407: dwrite d4/d18/d25/f1c [0,4194304] 0 2024-04-03T08:39:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.640+0000 7f41b3000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac118300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.640+0000 7f41b3000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac118840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.640+0000 7f41b3000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac118ed0 con 0x7f41ac06f9d0 2024-04-03T08:39:20.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.640+0000 7f41b3000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac11d870 con 0x7f41ac06e9a0 2024-04-03T08:39:20.643 INFO:tasks.workunit.client.0.smithi157.stdout:1/534: dwrite d2/d11/d24/d39/d3b/d2e/f3e [0,4194304] 0 2024-04-03T08:39:20.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.641+0000 7f41abe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac118300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.641+0000 7f41abe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac118300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:56882/0 (socket says 172.21.15.157:56882) 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.641+0000 7f41abe00700 1 -- 172.21.15.157:0/2212906800 learned_addr learned my addr 172.21.15.157:0/2212906800 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.641+0000 7f41ab400700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac118840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.642+0000 7f41abe00700 1 -- 172.21.15.157:0/2212906800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 msgr2=0x7f41ac118840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.642+0000 7f41abe00700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac118840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.642+0000 7f41abe00700 1 -- 172.21.15.157:0/2212906800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198005040 con 0x7f41ac06e9a0 2024-04-03T08:39:20.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.642+0000 7f41ab400700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac118840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:39:20.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.645+0000 7f41abe00700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac118300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f419800b3b0 tx=0x7f4198009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.647+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419800e040 con 0x7f41ac06e9a0 2024-04-03T08:39:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.647+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4198004290 con 0x7f41ac06e9a0 2024-04-03T08:39:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.647+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419801c630 con 0x7f41ac06e9a0 2024-04-03T08:39:20.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.647+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac11da70 con 0x7f41ac06e9a0 2024-04-03T08:39:20.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.647+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac11dfe0 con 0x7f41ac06e9a0 2024-04-03T08:39:20.650 INFO:tasks.workunit.client.0.smithi157.stdout:9/526: dwrite d1/d15/d27/f47 [0,4194304] 0 2024-04-03T08:39:20.651 INFO:tasks.workunit.client.1.smithi181.stdout:4/474: fsync d1/d16/d24/d5e/d31/f65 0 2024-04-03T08:39:20.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.649+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac04c710 con 0x7f41ac06e9a0 2024-04-03T08:39:20.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.651+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f419800bbf0 con 0x7f41ac06e9a0 2024-04-03T08:39:20.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.652+0000 7f41a3e00700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4190038a60 0x7f419003af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:20.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.653+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f41980137a0 con 0x7f41ac06e9a0 2024-04-03T08:39:20.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.654+0000 7f41ab400700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4190038a60 0x7f419003af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:20.656 INFO:tasks.workunit.client.1.smithi181.stdout:9/479: write d1/da/d13/d22/f2e [2004810,34843] 0 2024-04-03T08:39:20.659 INFO:tasks.workunit.client.0.smithi157.stdout:5/614: rmdir dc/d29/d56/d18/d21 39 2024-04-03T08:39:20.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.658+0000 7f41ab400700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4190038a60 0x7f419003af10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f41a4001370 tx=0x7f41a40096a0 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:20.660 INFO:tasks.workunit.client.1.smithi181.stdout:9/480: write d1/da/d13/d22/f8d [681572,126315] 0 2024-04-03T08:39:20.663 INFO:tasks.workunit.client.0.smithi157.stdout:6/604: dwrite d1/d4b/da5/fa9 [0,4194304] 0 2024-04-03T08:39:20.666 INFO:tasks.workunit.client.1.smithi181.stdout:0/406: chown d5/c11 903590 1 2024-04-03T08:39:20.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:20.665+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4198013420 con 0x7f41ac06e9a0 2024-04-03T08:39:20.667 INFO:tasks.workunit.client.0.smithi157.stdout:6/605: dread - d1/d5/d17/d29/d62/d7f/fc8 zero size 2024-04-03T08:39:20.672 INFO:tasks.workunit.client.0.smithi157.stdout:6/606: truncate d1/d5/fc2 962406 0 2024-04-03T08:39:20.672 INFO:tasks.workunit.client.1.smithi181.stdout:3/411: creat d0/d17/f82 x:0 0 0 2024-04-03T08:39:20.674 INFO:tasks.workunit.client.1.smithi181.stdout:3/412: dread - d0/d17/f5b zero size 2024-04-03T08:39:20.674 INFO:tasks.workunit.client.1.smithi181.stdout:3/413: stat d0/d17/d56 0 2024-04-03T08:39:20.677 INFO:tasks.workunit.client.1.smithi181.stdout:8/354: rmdir d4/d45/db/d5c 39 2024-04-03T08:39:20.682 INFO:tasks.workunit.client.0.smithi157.stdout:9/527: rename d1/f17 to d1/d15/d27/d34/da6/fb6 0 2024-04-03T08:39:20.686 INFO:tasks.workunit.client.0.smithi157.stdout:3/534: sync 2024-04-03T08:39:20.690 INFO:tasks.workunit.client.1.smithi181.stdout:3/414: dwrite d0/d5/d6/d32/f7c [0,4194304] 0 2024-04-03T08:39:20.697 INFO:tasks.workunit.client.1.smithi181.stdout:2/450: rename d13/da7/d27/d2f/l58 to d13/d1c/d73/d8b/la9 0 2024-04-03T08:39:20.698 INFO:tasks.workunit.client.1.smithi181.stdout:2/451: chown d13/da7/d27/d46/d8f/f93 95140 1 2024-04-03T08:39:20.700 INFO:tasks.workunit.client.0.smithi157.stdout:0/571: link d2/d9/d5f/fa6 d2/d9/dc/df/d6f/fd4 0 2024-04-03T08:39:20.701 INFO:tasks.workunit.client.0.smithi157.stdout:5/615: creat dc/d29/d56/d52/d9d/da5/daa/fcf x:0 0 0 2024-04-03T08:39:20.701 INFO:tasks.workunit.client.1.smithi181.stdout:1/384: creat d10/d15/d17/d19/d33/d70/f76 x:0 0 0 2024-04-03T08:39:20.706 INFO:tasks.workunit.client.0.smithi157.stdout:7/614: creat d0/d11/d15/d17/dca/fd8 x:0 0 0 2024-04-03T08:39:20.707 INFO:tasks.workunit.client.0.smithi157.stdout:2/560: dwrite d3/db/d44/d4c/d5a/d88/f8c [0,4194304] 0 2024-04-03T08:39:20.708 INFO:tasks.workunit.client.0.smithi157.stdout:0/572: read d2/d9/d36/f80 [229634,76779] 0 2024-04-03T08:39:20.709 INFO:tasks.workunit.client.0.smithi157.stdout:1/535: dwrite d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/f87 [0,4194304] 0 2024-04-03T08:39:20.713 INFO:tasks.workunit.client.1.smithi181.stdout:6/413: write d6/d31/d36/f34 [2669298,36021] 0 2024-04-03T08:39:20.718 INFO:tasks.workunit.client.0.smithi157.stdout:7/615: chown d0/d4/f2d 1035251 1 2024-04-03T08:39:20.718 INFO:tasks.workunit.client.0.smithi157.stdout:9/528: dread d1/d15/d27/f55 [0,4194304] 0 2024-04-03T08:39:20.721 INFO:tasks.workunit.client.0.smithi157.stdout:5/616: write dc/d29/d56/d9e/fb8 [1063727,61435] 0 2024-04-03T08:39:20.722 INFO:tasks.workunit.client.1.smithi181.stdout:0/407: unlink d5/d9/d2c/f76 0 2024-04-03T08:39:20.727 INFO:tasks.workunit.client.1.smithi181.stdout:6/414: dread d6/d3e/d40/f4e [0,4194304] 0 2024-04-03T08:39:20.731 INFO:tasks.workunit.client.0.smithi157.stdout:4/558: dwrite da/df/d24/d35/d6a/d78/fb0 [0,4194304] 0 2024-04-03T08:39:20.738 INFO:tasks.workunit.client.0.smithi157.stdout:6/607: dwrite d1/d5/d17/d2a/f4d [0,4194304] 0 2024-04-03T08:39:20.741 INFO:tasks.workunit.client.1.smithi181.stdout:3/415: rmdir d0/d17/d40 39 2024-04-03T08:39:20.744 INFO:tasks.workunit.client.1.smithi181.stdout:3/416: truncate d0/d17/f6e 280470 0 2024-04-03T08:39:20.744 INFO:tasks.workunit.client.0.smithi157.stdout:6/608: dread - d1/d5/d17/d29/da3/da8/fc5 zero size 2024-04-03T08:39:20.755 INFO:tasks.workunit.client.1.smithi181.stdout:4/475: rename d1/d16/d37/d34/d69/f8e to d1/d1e/d78/f97 0 2024-04-03T08:39:20.758 INFO:tasks.workunit.client.1.smithi181.stdout:2/452: mknod d13/caa 0 2024-04-03T08:39:20.760 INFO:tasks.workunit.client.1.smithi181.stdout:3/417: dwrite d0/d17/d36/f45 [4194304,4194304] 0 2024-04-03T08:39:20.760 INFO:tasks.workunit.client.1.smithi181.stdout:2/453: chown d13/da7/d27/d46/f52 22406593 1 2024-04-03T08:39:20.762 INFO:tasks.workunit.client.1.smithi181.stdout:3/418: write d0/d5/d6/d32/d43/f60 [314349,91560] 0 2024-04-03T08:39:20.762 INFO:tasks.workunit.client.1.smithi181.stdout:1/385: creat d10/d69/f77 x:0 0 0 2024-04-03T08:39:20.765 INFO:tasks.workunit.client.1.smithi181.stdout:3/419: dread - d0/d17/f26 zero size 2024-04-03T08:39:20.766 INFO:tasks.workunit.client.1.smithi181.stdout:5/408: mkdir d4/d18/d25/d59/d81 0 2024-04-03T08:39:20.766 INFO:tasks.workunit.client.1.smithi181.stdout:1/386: write d10/d15/d17/d19/d33/d70/f76 [832264,2211] 0 2024-04-03T08:39:20.769 INFO:tasks.workunit.client.1.smithi181.stdout:7/358: link d0/c12 d0/d1/d6/de/d17/c7f 0 2024-04-03T08:39:20.774 INFO:tasks.workunit.client.0.smithi157.stdout:6/609: dread d1/d4b/d61/f68 [4194304,4194304] 0 2024-04-03T08:39:20.774 INFO:tasks.workunit.client.1.smithi181.stdout:0/408: read d5/d9/d2a/f64 [261999,10819] 0 2024-04-03T08:39:20.776 INFO:tasks.workunit.client.1.smithi181.stdout:8/355: creat d4/d44/d59/f78 x:0 0 0 2024-04-03T08:39:20.784 INFO:tasks.workunit.client.1.smithi181.stdout:6/415: dread d6/d3e/d5e/d7c/d9/d22/d4f/f55 [0,4194304] 0 2024-04-03T08:39:20.785 INFO:tasks.workunit.client.1.smithi181.stdout:4/476: unlink d1/d16/d51/c66 0 2024-04-03T08:39:20.787 INFO:tasks.workunit.client.1.smithi181.stdout:4/477: fsync d1/d1e/d2c/d67/f72 0 2024-04-03T08:39:20.788 INFO:tasks.workunit.client.1.smithi181.stdout:2/454: mknod d13/d1c/d73/cab 0 2024-04-03T08:39:20.796 INFO:tasks.workunit.client.1.smithi181.stdout:5/409: mknod d4/d18/d25/c82 0 2024-04-03T08:39:20.799 INFO:tasks.workunit.client.1.smithi181.stdout:9/481: link d1/da/d13/d41/d32/f67 d1/da/d13/d22/d23/d54/f98 0 2024-04-03T08:39:20.801 INFO:tasks.workunit.client.1.smithi181.stdout:2/455: dwrite d13/da7/d40/f56 [0,4194304] 0 2024-04-03T08:39:20.802 INFO:tasks.workunit.client.1.smithi181.stdout:2/456: chown d13/l17 691 1 2024-04-03T08:39:20.804 INFO:tasks.workunit.client.1.smithi181.stdout:2/457: readlink d13/l60 0 2024-04-03T08:39:20.805 INFO:tasks.workunit.client.1.smithi181.stdout:0/409: rmdir d5/d9/d2e 39 2024-04-03T08:39:20.808 INFO:tasks.workunit.client.1.smithi181.stdout:8/356: write d4/d45/db/f33 [2403667,5315] 0 2024-04-03T08:39:20.813 INFO:tasks.workunit.client.1.smithi181.stdout:4/478: unlink d1/l6 0 2024-04-03T08:39:20.816 INFO:tasks.workunit.client.1.smithi181.stdout:8/357: dread d4/d45/f7 [0,4194304] 0 2024-04-03T08:39:20.816 INFO:tasks.workunit.client.1.smithi181.stdout:5/410: dwrite d4/d18/d55/d5a/f76 [0,4194304] 0 2024-04-03T08:39:20.816 INFO:tasks.workunit.client.1.smithi181.stdout:4/479: write d1/d16/d24/d5e/f45 [4400361,61902] 0 2024-04-03T08:39:20.818 INFO:tasks.workunit.client.1.smithi181.stdout:3/420: rename d0/d17/d40/l52 to d0/d5/d6/d32/d43/d6b/l83 0 2024-04-03T08:39:20.834 INFO:tasks.workunit.client.1.smithi181.stdout:9/482: creat d1/da/d13/d41/d65/f99 x:0 0 0 2024-04-03T08:39:20.834 INFO:tasks.workunit.client.1.smithi181.stdout:8/358: dread d4/d45/d9/f4d [0,4194304] 0 2024-04-03T08:39:20.834 INFO:tasks.workunit.client.0.smithi157.stdout:0/573: mknod d2/d9/dc/df/d6f/d9d/d6a/d91/cd5 0 2024-04-03T08:39:20.835 INFO:tasks.workunit.client.1.smithi181.stdout:5/411: dwrite d4/d22/d4a/f5b [0,4194304] 0 2024-04-03T08:39:20.837 INFO:tasks.workunit.client.0.smithi157.stdout:9/529: creat d1/d15/d27/d34/fb7 x:0 0 0 2024-04-03T08:39:20.840 INFO:tasks.workunit.client.0.smithi157.stdout:5/617: creat dc/d29/d56/d52/d9d/da5/daa/fd0 x:0 0 0 2024-04-03T08:39:20.840 INFO:tasks.workunit.client.1.smithi181.stdout:2/458: chown d13/da7/d27/d2f/c4e 507502 1 2024-04-03T08:39:20.841 INFO:tasks.workunit.client.1.smithi181.stdout:0/410: creat d5/dc/d10/f80 x:0 0 0 2024-04-03T08:39:20.853 INFO:tasks.workunit.client.1.smithi181.stdout:4/480: stat d1/l5 0 2024-04-03T08:39:20.853 INFO:tasks.workunit.client.1.smithi181.stdout:8/359: dwrite d4/fc [0,4194304] 0 2024-04-03T08:39:20.858 INFO:tasks.workunit.client.0.smithi157.stdout:2/561: write d3/db/d44/d4c/d5a/d88/f96 [653094,120049] 0 2024-04-03T08:39:20.860 INFO:tasks.workunit.client.0.smithi157.stdout:9/530: rmdir d1/d94/d75 39 2024-04-03T08:39:20.860 INFO:tasks.workunit.client.1.smithi181.stdout:1/387: creat d10/d15/d17/d23/f78 x:0 0 0 2024-04-03T08:39:20.861 INFO:tasks.workunit.client.1.smithi181.stdout:0/411: dwrite d5/f7c [0,4194304] 0 2024-04-03T08:39:20.863 INFO:tasks.workunit.client.1.smithi181.stdout:3/421: symlink d0/d5/d6/dd/d5f/l84 0 2024-04-03T08:39:20.864 INFO:tasks.workunit.client.1.smithi181.stdout:0/412: chown d5/f74 204 1 2024-04-03T08:39:20.865 INFO:tasks.workunit.client.1.smithi181.stdout:7/359: creat d0/d1/d6/f80 x:0 0 0 2024-04-03T08:39:20.867 INFO:tasks.workunit.client.1.smithi181.stdout:6/416: truncate d6/d31/d36/f34 885747 0 2024-04-03T08:39:20.867 INFO:tasks.workunit.client.1.smithi181.stdout:0/413: write d5/dc/d10/f80 [238068,15118] 0 2024-04-03T08:39:20.868 INFO:tasks.workunit.client.0.smithi157.stdout:5/618: mkdir dc/d29/d56/d87/dd1 0 2024-04-03T08:39:20.871 INFO:tasks.workunit.client.1.smithi181.stdout:2/459: rmdir d13/da7/d27 39 2024-04-03T08:39:20.872 INFO:tasks.workunit.client.0.smithi157.stdout:6/610: symlink d1/d5/d17/d2a/d40/lcc 0 2024-04-03T08:39:20.875 INFO:tasks.workunit.client.1.smithi181.stdout:8/360: truncate d4/d45/db/f13 404961 0 2024-04-03T08:39:20.878 INFO:tasks.workunit.client.0.smithi157.stdout:2/562: rename d3/db/d44/d4c/c57 to d3/d2e/d32/d9f/da7/cc9 0 2024-04-03T08:39:20.881 INFO:tasks.workunit.client.1.smithi181.stdout:6/417: unlink d6/d3e/d5e/d7c/d9/f5c 0 2024-04-03T08:39:20.882 INFO:tasks.workunit.client.1.smithi181.stdout:0/414: mknod d5/dc/d10/d58/c81 0 2024-04-03T08:39:20.884 INFO:tasks.workunit.client.1.smithi181.stdout:0/415: chown d5/l6 5107218 1 2024-04-03T08:39:20.886 INFO:tasks.workunit.client.0.smithi157.stdout:5/619: unlink dc/d29/d56/d49/d7f/fa6 0 2024-04-03T08:39:20.887 INFO:tasks.workunit.client.1.smithi181.stdout:9/483: rename d1/da/d13/d41/f26 to d1/da/d28/f9a 0 2024-04-03T08:39:20.890 INFO:tasks.workunit.client.1.smithi181.stdout:9/484: read d1/d34/f37 [364683,73600] 0 2024-04-03T08:39:20.891 INFO:tasks.workunit.client.0.smithi157.stdout:9/531: mkdir d1/d4a/d4d/da4/db8 0 2024-04-03T08:39:20.896 INFO:tasks.workunit.client.1.smithi181.stdout:3/422: mkdir d0/d17/d36/d3b/d5a/d85 0 2024-04-03T08:39:20.898 INFO:tasks.workunit.client.1.smithi181.stdout:1/388: dread d10/d15/d17/d19/f68 [4194304,4194304] 0 2024-04-03T08:39:20.898 INFO:tasks.workunit.client.0.smithi157.stdout:2/563: unlink d3/l77 0 2024-04-03T08:39:20.898 INFO:tasks.workunit.client.0.smithi157.stdout:8/602: sync 2024-04-03T08:39:20.898 INFO:tasks.workunit.client.1.smithi181.stdout:3/423: chown d0/d5/d6/dd/d25/l46 472963 1 2024-04-03T08:39:20.901 INFO:tasks.workunit.client.1.smithi181.stdout:3/424: chown d0/d5/d6/f11 26 1 2024-04-03T08:39:20.904 INFO:tasks.workunit.client.0.smithi157.stdout:4/559: dwrite da/df/d24/f59 [0,4194304] 0 2024-04-03T08:39:20.904 INFO:tasks.workunit.client.0.smithi157.stdout:3/535: dwrite d8/f28 [0,4194304] 0 2024-04-03T08:39:20.905 INFO:tasks.workunit.client.0.smithi157.stdout:6/611: mkdir d1/d4b/d61/d92/dcd 0 2024-04-03T08:39:20.907 INFO:tasks.workunit.client.0.smithi157.stdout:7/616: dwrite d0/d11/d15/d17/d43/f45 [0,4194304] 0 2024-04-03T08:39:20.907 INFO:tasks.workunit.client.1.smithi181.stdout:8/361: symlink d4/d45/db/d14/d31/d1c/l79 0 2024-04-03T08:39:20.917 INFO:tasks.workunit.client.0.smithi157.stdout:6/612: chown d1/d4b/d38/l3c 52984 1 2024-04-03T08:39:20.918 INFO:tasks.workunit.client.0.smithi157.stdout:0/574: dread d2/d9/d51/d63/d71/f92 [0,4194304] 0 2024-04-03T08:39:20.922 INFO:tasks.workunit.client.1.smithi181.stdout:8/362: dread d4/d45/db/d14/d31/d1c/d51/f52 [0,4194304] 0 2024-04-03T08:39:20.925 INFO:tasks.workunit.client.1.smithi181.stdout:8/363: read - d4/d44/d59/f78 zero size 2024-04-03T08:39:20.934 INFO:tasks.workunit.client.1.smithi181.stdout:6/418: creat d6/d53/d80/f83 x:0 0 0 2024-04-03T08:39:20.944 INFO:tasks.workunit.client.1.smithi181.stdout:0/416: rename d5/dc/d10/f20 to d5/d9/d60/f82 0 2024-04-03T08:39:20.945 INFO:tasks.workunit.client.1.smithi181.stdout:6/419: dread d6/d3e/d40/f4e [0,4194304] 0 2024-04-03T08:39:20.946 INFO:tasks.workunit.client.0.smithi157.stdout:8/603: rmdir d2/d11/d10 39 2024-04-03T08:39:20.953 INFO:tasks.workunit.client.0.smithi157.stdout:3/536: creat d8/d1e/fbe x:0 0 0 2024-04-03T08:39:20.953 INFO:tasks.workunit.client.1.smithi181.stdout:5/412: creat d4/d18/f83 x:0 0 0 2024-04-03T08:39:20.954 INFO:tasks.workunit.client.1.smithi181.stdout:2/460: mkdir d13/d1c/da5/dac 0 2024-04-03T08:39:20.955 INFO:tasks.workunit.client.1.smithi181.stdout:4/481: write d1/d16/d37/d34/f35 [2294912,56117] 0 2024-04-03T08:39:20.957 INFO:tasks.workunit.client.0.smithi157.stdout:7/617: mknod d0/d4/d8e/d96/cd9 0 2024-04-03T08:39:20.963 INFO:tasks.workunit.client.0.smithi157.stdout:1/536: sync 2024-04-03T08:39:20.963 INFO:tasks.workunit.client.0.smithi157.stdout:9/532: write d1/d15/d27/f55 [1337950,44833] 0 2024-04-03T08:39:20.967 INFO:tasks.workunit.client.0.smithi157.stdout:5/620: rename dc/d29/d56/d18/d21/fc4 to dc/d29/d56/d9e/db5/fd2 0 2024-04-03T08:39:20.976 INFO:tasks.workunit.client.1.smithi181.stdout:3/425: rename d0/d5/d6/l67 to d0/d17/d63/l86 0 2024-04-03T08:39:20.978 INFO:tasks.workunit.client.0.smithi157.stdout:4/560: getdents da/df/d24/d35/d6a/d76 0 2024-04-03T08:39:20.983 INFO:tasks.workunit.client.0.smithi157.stdout:7/618: mkdir d0/d11/d15/d17/d52/db6/dda 0 2024-04-03T08:39:20.984 INFO:tasks.workunit.client.0.smithi157.stdout:4/561: dread - da/df/d99/fab zero size 2024-04-03T08:39:20.984 INFO:tasks.workunit.client.0.smithi157.stdout:8/604: dread d2/d6f/d70/fbb [0,4194304] 0 2024-04-03T08:39:20.985 INFO:tasks.workunit.client.1.smithi181.stdout:1/389: dread d10/d15/d17/d23/d27/f3a [0,4194304] 0 2024-04-03T08:39:20.987 INFO:tasks.workunit.client.0.smithi157.stdout:8/605: write d2/d6f/d70/f97 [1557840,65555] 0 2024-04-03T08:39:20.988 INFO:tasks.workunit.client.0.smithi157.stdout:6/613: dwrite d1/d5/d17/f1d [0,4194304] 0 2024-04-03T08:39:20.993 INFO:tasks.workunit.client.1.smithi181.stdout:5/413: symlink d4/d18/d25/d6e/l84 0 2024-04-03T08:39:20.995 INFO:tasks.workunit.client.1.smithi181.stdout:5/414: fsync d4/d22/f38 0 2024-04-03T08:39:20.998 INFO:tasks.workunit.client.0.smithi157.stdout:0/575: unlink d2/d9/d51/d63/c87 0 2024-04-03T08:39:20.998 INFO:tasks.workunit.client.0.smithi157.stdout:3/537: write d8/d13/f56 [399161,12661] 0 2024-04-03T08:39:21.000 INFO:tasks.workunit.client.1.smithi181.stdout:4/482: mkdir d1/d1e/d78/d98 0 2024-04-03T08:39:21.003 INFO:tasks.workunit.client.0.smithi157.stdout:5/621: rmdir dc/d29/d56/d9e 39 2024-04-03T08:39:21.007 INFO:tasks.workunit.client.1.smithi181.stdout:7/360: link d0/d1/d6/de/d17/f24 d0/d1/d6/de/d17/d64/f81 0 2024-04-03T08:39:21.008 INFO:tasks.workunit.client.0.smithi157.stdout:2/564: rmdir d3/d12 39 2024-04-03T08:39:21.008 INFO:tasks.workunit.client.1.smithi181.stdout:8/364: creat d4/d45/db/d5c/d5e/f7a x:0 0 0 2024-04-03T08:39:21.009 INFO:tasks.workunit.client.1.smithi181.stdout:7/361: dread - d0/d1/d6/de/d17/f4c zero size 2024-04-03T08:39:21.011 INFO:tasks.workunit.client.1.smithi181.stdout:2/461: dwrite d13/da7/f84 [0,4194304] 0 2024-04-03T08:39:21.011 INFO:tasks.workunit.client.0.smithi157.stdout:7/619: mknod d0/d4/da5/cdb 0 2024-04-03T08:39:21.013 INFO:tasks.workunit.client.1.smithi181.stdout:2/462: dread - d13/da7/d85/fa8 zero size 2024-04-03T08:39:21.014 INFO:tasks.workunit.client.0.smithi157.stdout:7/620: chown d0/d11/c91 39 1 2024-04-03T08:39:21.015 INFO:tasks.workunit.client.1.smithi181.stdout:0/417: rename d5/dc/d14/d29/f73 to d5/d9/d2a/f83 0 2024-04-03T08:39:21.018 INFO:tasks.workunit.client.0.smithi157.stdout:4/562: rmdir da/d7e 39 2024-04-03T08:39:21.019 INFO:tasks.workunit.client.1.smithi181.stdout:3/426: rename d0/d17/d40/l73 to d0/d17/d40/l87 0 2024-04-03T08:39:21.025 INFO:tasks.workunit.client.1.smithi181.stdout:9/485: truncate d1/da/d13/f5b 441282 0 2024-04-03T08:39:21.026 INFO:tasks.workunit.client.1.smithi181.stdout:6/420: getdents d6/d3e/d5e/d7c/d50/d64 0 2024-04-03T08:39:21.031 INFO:tasks.workunit.client.0.smithi157.stdout:9/533: dwrite d1/d15/d16/f98 [0,4194304] 0 2024-04-03T08:39:21.037 INFO:tasks.workunit.client.0.smithi157.stdout:6/614: unlink d1/d4b/d38/da6/fb5 0 2024-04-03T08:39:21.038 INFO:tasks.workunit.client.0.smithi157.stdout:0/576: dread d2/d9/dc/df/d1b/f59 [0,4194304] 0 2024-04-03T08:39:21.044 INFO:tasks.workunit.client.1.smithi181.stdout:5/415: rename d4/d22/d78/f7a to d4/d22/d78/f85 0 2024-04-03T08:39:21.055 INFO:tasks.workunit.client.1.smithi181.stdout:7/362: mkdir d0/d1/d6/de/d17/d64/d82 0 2024-04-03T08:39:21.059 INFO:tasks.workunit.client.0.smithi157.stdout:7/621: creat d0/d4/da5/fdc x:0 0 0 2024-04-03T08:39:21.061 INFO:tasks.workunit.client.1.smithi181.stdout:0/418: stat d5/dc/d75/l7b 0 2024-04-03T08:39:21.061 INFO:tasks.workunit.client.0.smithi157.stdout:5/622: dread dc/d29/d56/d18/f99 [0,4194304] 0 2024-04-03T08:39:21.062 INFO:tasks.workunit.client.1.smithi181.stdout:0/419: readlink d5/dc/d14/l16 0 2024-04-03T08:39:21.062 INFO:tasks.workunit.client.0.smithi157.stdout:8/606: symlink d2/d11/d10/d24/d5b/d53/lcd 0 2024-04-03T08:39:21.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:20 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/142326778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:39:21.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:20 smithi157 ceph-mon[35083]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-04-03T08:39:21.064 INFO:tasks.workunit.client.1.smithi181.stdout:3/427: rename d0/d5/d6/dd/d5f/f6a to d0/d17/d63/d81/f88 0 2024-04-03T08:39:21.067 INFO:tasks.workunit.client.1.smithi181.stdout:9/486: read d1/da/d28/f9a [46814,34098] 0 2024-04-03T08:39:21.067 INFO:tasks.workunit.client.0.smithi157.stdout:9/534: symlink d1/d4a/d4d/lb9 0 2024-04-03T08:39:21.069 INFO:tasks.workunit.client.0.smithi157.stdout:9/535: write d1/d4a/d4d/f9b [1040375,53106] 0 2024-04-03T08:39:21.069 INFO:tasks.workunit.client.1.smithi181.stdout:6/421: creat d6/d3e/d5e/d7c/d50/d64/f84 x:0 0 0 2024-04-03T08:39:21.071 INFO:tasks.workunit.client.1.smithi181.stdout:1/390: creat d10/d15/d17/d30/f79 x:0 0 0 2024-04-03T08:39:21.073 INFO:tasks.workunit.client.0.smithi157.stdout:6/615: creat d1/d4b/fce x:0 0 0 2024-04-03T08:39:21.080 INFO:tasks.workunit.client.1.smithi181.stdout:4/483: creat d1/d16/d24/d5e/d3f/d81/f99 x:0 0 0 2024-04-03T08:39:21.083 INFO:tasks.workunit.client.0.smithi157.stdout:0/577: rename d2/d9/d51/c53 to d2/d9/dc/df/d6f/d9d/d6a/cd6 0 2024-04-03T08:39:21.088 INFO:tasks.workunit.client.0.smithi157.stdout:7/622: fsync d0/d4/f80 0 2024-04-03T08:39:21.089 INFO:tasks.workunit.client.1.smithi181.stdout:2/463: mknod d13/da7/d27/d2f/d5d/cad 0 2024-04-03T08:39:21.097 INFO:tasks.workunit.client.0.smithi157.stdout:9/536: symlink d1/d15/d27/d34/lba 0 2024-04-03T08:39:21.102 INFO:tasks.workunit.client.0.smithi157.stdout:6/616: dread d1/d5/d17/d29/d62/f98 [0,4194304] 0 2024-04-03T08:39:21.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.103+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f41ac11e480 con 0x7f41ac06e9a0 2024-04-03T08:39:21.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.104+0000 7f41a3e00700 1 -- 172.21.15.157:0/2212906800 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f41980243b0 con 0x7f41ac06e9a0 2024-04-03T08:39:21.106 INFO:tasks.workunit.client.0.smithi157.stdout:2/565: unlink d3/db/d44/d4c/d5a/f8b 0 2024-04-03T08:39:21.106 INFO:tasks.workunit.client.1.smithi181.stdout:4/484: mkdir d1/d16/d24/d5e/d31/d39/d5d/d9a 0 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:39:21.109 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:39:21.110 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:39:21.111 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:21.112 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:21.112 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:21.112 INFO:tasks.workunit.client.1.smithi181.stdout:0/420: dread d5/dc/d14/f22 [0,4194304] 0 2024-04-03T08:39:21.112 INFO:tasks.workunit.client.0.smithi157.stdout:7/623: dwrite d0/d16/f6b [0,4194304] 0 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4190038a60 msgr2=0x7f419003af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4190038a60 0x7f419003af10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f41a4001370 tx=0x7f41a40096a0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 msgr2=0x7f41ac118300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac118300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f419800b3b0 tx=0x7f4198009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 shutdown_connections 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4190038a60 0x7f419003af10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41ac06e9a0 0x7f41ac118300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 --2- 172.21.15.157:0/2212906800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41ac06f9d0 0x7f41ac118840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.108+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 >> 172.21.15.157:0/2212906800 conn(0x7f41ac069de0 msgr2=0x7f41ac06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:21.114 INFO:tasks.workunit.client.0.smithi157.stdout:0/578: truncate d2/d9/dc/df/d1b/d4a/d31/faa 672495 0 2024-04-03T08:39:21.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.109+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 shutdown_connections 2024-04-03T08:39:21.114 INFO:tasks.workunit.client.0.smithi157.stdout:7/624: stat d0/d11/d15 0 2024-04-03T08:39:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.110+0000 7f41b3000700 1 -- 172.21.15.157:0/2212906800 wait complete. 2024-04-03T08:39:21.115 INFO:tasks.workunit.client.0.smithi157.stdout:8/607: symlink d2/d6f/d70/d89/lce 0 2024-04-03T08:39:21.115 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:39:21.115 INFO:tasks.workunit.client.0.smithi157.stdout:8/608: readlink d2/d7b/lb0 0 2024-04-03T08:39:21.116 INFO:tasks.workunit.client.1.smithi181.stdout:0/421: chown d5/dc/d10/d30 854 1 2024-04-03T08:39:21.116 INFO:tasks.workunit.client.1.smithi181.stdout:1/391: creat d10/d15/d4a/d6f/f7a x:0 0 0 2024-04-03T08:39:21.116 INFO:tasks.workunit.client.1.smithi181.stdout:5/416: creat d4/f86 x:0 0 0 2024-04-03T08:39:21.119 INFO:tasks.workunit.client.0.smithi157.stdout:9/537: creat d1/d15/d27/daf/da7/fbb x:0 0 0 2024-04-03T08:39:21.120 INFO:tasks.workunit.client.1.smithi181.stdout:7/363: creat d0/d1/d6/f83 x:0 0 0 2024-04-03T08:39:21.123 INFO:tasks.workunit.client.1.smithi181.stdout:2/464: mkdir d13/da7/d27/d2f/dae 0 2024-04-03T08:39:21.123 INFO:tasks.workunit.client.0.smithi157.stdout:9/538: fdatasync d1/d15/d16/f1e 0 2024-04-03T08:39:21.125 INFO:tasks.workunit.client.0.smithi157.stdout:4/563: rename da/df/d24/d35/d53/c9b to da/df/d24/d35/d6a/cc1 0 2024-04-03T08:39:21.128 INFO:tasks.workunit.client.1.smithi181.stdout:0/422: dwrite d5/dc/d10/f36 [0,4194304] 0 2024-04-03T08:39:21.128 INFO:tasks.workunit.client.1.smithi181.stdout:4/485: rename d1/d16/d24/c28 to d1/d16/d24/d5e/d2b/d56/c9b 0 2024-04-03T08:39:21.130 INFO:tasks.workunit.client.1.smithi181.stdout:3/428: creat d0/d5/d6/f89 x:0 0 0 2024-04-03T08:39:21.130 INFO:tasks.workunit.client.0.smithi157.stdout:2/566: chown d3/d2e/d32/d9f/dbd 194361316 1 2024-04-03T08:39:21.130 INFO:tasks.workunit.client.1.smithi181.stdout:0/423: stat d5/d9/d2a 0 2024-04-03T08:39:21.134 INFO:tasks.workunit.client.1.smithi181.stdout:0/424: chown d5/d9/d2a/f67 11 1 2024-04-03T08:39:21.134 INFO:tasks.workunit.client.1.smithi181.stdout:6/422: link d6/d3e/d5e/d7c/d9/f15 d6/d3e/d5e/d7c/f85 0 2024-04-03T08:39:21.134 INFO:tasks.workunit.client.1.smithi181.stdout:5/417: dwrite d4/d18/f73 [0,4194304] 0 2024-04-03T08:39:21.134 INFO:tasks.workunit.client.0.smithi157.stdout:6/617: mknod d1/d5/d17/d2a/d30/d77/ccf 0 2024-04-03T08:39:21.136 INFO:tasks.workunit.client.1.smithi181.stdout:3/429: write d0/d5/d6/d32/d43/f48 [6403,72119] 0 2024-04-03T08:39:21.136 INFO:tasks.workunit.client.0.smithi157.stdout:5/623: fsync dc/d29/d56/d49/d53/d6c/f8e 0 2024-04-03T08:39:21.138 INFO:tasks.workunit.client.0.smithi157.stdout:5/624: stat dc/d29/d56/d18/d21 0 2024-04-03T08:39:21.144 INFO:tasks.workunit.client.0.smithi157.stdout:8/609: fsync d2/d20/d23/f6c 0 2024-04-03T08:39:21.145 INFO:tasks.workunit.client.0.smithi157.stdout:3/538: symlink d8/d1e/d2d/d39/d51/d7e/db1/lbf 0 2024-04-03T08:39:21.145 INFO:tasks.workunit.client.0.smithi157.stdout:1/537: sync 2024-04-03T08:39:21.151 INFO:tasks.workunit.client.0.smithi157.stdout:9/539: fdatasync d1/d15/d27/d34/f6d 0 2024-04-03T08:39:21.152 INFO:tasks.workunit.client.1.smithi181.stdout:1/392: mknod d10/d15/c7b 0 2024-04-03T08:39:21.153 INFO:tasks.workunit.client.0.smithi157.stdout:9/540: dread - d1/d15/d27/d5c/faa zero size 2024-04-03T08:39:21.156 INFO:tasks.workunit.client.0.smithi157.stdout:4/564: rename da/df/d24/c45 to da/df/d99/cc2 0 2024-04-03T08:39:21.162 INFO:tasks.workunit.client.1.smithi181.stdout:2/465: mknod d13/da7/caf 0 2024-04-03T08:39:21.166 INFO:tasks.workunit.client.1.smithi181.stdout:3/430: creat d0/d5/d6/d32/d43/f8a x:0 0 0 2024-04-03T08:39:21.170 INFO:tasks.workunit.client.1.smithi181.stdout:7/364: rename d0/d1/l7 to d0/d1/d6/de/d57/l84 0 2024-04-03T08:39:21.173 INFO:tasks.workunit.client.1.smithi181.stdout:1/393: mknod d10/d15/d4b/c7c 0 2024-04-03T08:39:21.174 INFO:tasks.workunit.client.0.smithi157.stdout:4/565: dwrite da/df/d2f/f40 [4194304,4194304] 0 2024-04-03T08:39:21.175 INFO:tasks.workunit.client.1.smithi181.stdout:1/394: fdatasync d10/d15/d17/d19/f3e 0 2024-04-03T08:39:21.177 INFO:tasks.workunit.client.1.smithi181.stdout:1/395: chown d10/d15/d17/d30/f65 23 1 2024-04-03T08:39:21.178 INFO:tasks.workunit.client.0.smithi157.stdout:5/625: write dc/d29/d56/d9e/fb8 [1923273,126645] 0 2024-04-03T08:39:21.179 INFO:tasks.workunit.client.1.smithi181.stdout:6/423: fsync d6/d3e/d5e/d7c/d9/d22/d4f/f7a 0 2024-04-03T08:39:21.180 INFO:tasks.workunit.client.1.smithi181.stdout:1/396: write d10/d15/d17/d37/f56 [951581,32902] 0 2024-04-03T08:39:21.181 INFO:tasks.workunit.client.1.smithi181.stdout:6/424: fdatasync d6/f3a 0 2024-04-03T08:39:21.181 INFO:tasks.workunit.client.0.smithi157.stdout:5/626: dread - dc/d29/d56/d18/fab zero size 2024-04-03T08:39:21.182 INFO:tasks.workunit.client.1.smithi181.stdout:1/397: write d10/d15/d4a/f63 [589457,61540] 0 2024-04-03T08:39:21.183 INFO:tasks.workunit.client.1.smithi181.stdout:6/425: chown d6/d3e/d5e/d7c/d9/d22/d4f/f55 224 1 2024-04-03T08:39:21.185 INFO:tasks.workunit.client.1.smithi181.stdout:6/426: chown d6/d3e/d5e/d7c/d9/f15 173 1 2024-04-03T08:39:21.186 INFO:tasks.workunit.client.1.smithi181.stdout:3/431: symlink d0/d17/d40/l8b 0 2024-04-03T08:39:21.188 INFO:tasks.workunit.client.1.smithi181.stdout:7/365: mkdir d0/d1/d6/de/d17/d64/d85 0 2024-04-03T08:39:21.189 INFO:tasks.workunit.client.0.smithi157.stdout:3/539: truncate d8/d13/d1b/d5b/f8a 2576524 0 2024-04-03T08:39:21.189 INFO:tasks.workunit.client.0.smithi157.stdout:8/610: unlink d2/d11/f87 0 2024-04-03T08:39:21.191 INFO:tasks.workunit.client.0.smithi157.stdout:1/538: symlink d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/lae 0 2024-04-03T08:39:21.195 INFO:tasks.workunit.client.1.smithi181.stdout:4/486: dwrite d1/d1e/d2c/f77 [0,4194304] 0 2024-04-03T08:39:21.197 INFO:tasks.workunit.client.0.smithi157.stdout:3/540: write d8/d13/d1b/d4e/d50/d7c/fb7 [158444,6349] 0 2024-04-03T08:39:21.198 INFO:tasks.workunit.client.1.smithi181.stdout:4/487: read - d1/d16/d24/d5e/f4f zero size 2024-04-03T08:39:21.202 INFO:tasks.workunit.client.1.smithi181.stdout:1/398: rmdir d10/d15/d4a 39 2024-04-03T08:39:21.202 INFO:tasks.workunit.client.1.smithi181.stdout:5/418: dwrite d4/f13 [0,4194304] 0 2024-04-03T08:39:21.202 INFO:tasks.workunit.client.0.smithi157.stdout:9/541: write d1/d15/d27/f45 [3011134,73342] 0 2024-04-03T08:39:21.202 INFO:tasks.workunit.client.0.smithi157.stdout:4/566: dread da/df/d11/d5d/fb2 [0,4194304] 0 2024-04-03T08:39:21.203 INFO:tasks.workunit.client.0.smithi157.stdout:2/567: dread d3/d12/d43/d4b/d55/f62 [0,4194304] 0 2024-04-03T08:39:21.205 INFO:tasks.workunit.client.1.smithi181.stdout:1/399: write d10/d15/d41/f44 [1736207,80789] 0 2024-04-03T08:39:21.207 INFO:tasks.workunit.client.0.smithi157.stdout:7/625: symlink d0/d11/d6f/d89/d8c/ldd 0 2024-04-03T08:39:21.208 INFO:tasks.workunit.client.1.smithi181.stdout:6/427: creat d6/d53/d80/f86 x:0 0 0 2024-04-03T08:39:21.209 INFO:tasks.workunit.client.1.smithi181.stdout:6/428: stat d6/d31/d36/f33 0 2024-04-03T08:39:21.216 INFO:tasks.workunit.client.1.smithi181.stdout:3/432: dread d0/d5/d6/f4c [0,4194304] 0 2024-04-03T08:39:21.217 INFO:tasks.workunit.client.1.smithi181.stdout:3/433: chown d0/d17/d40 18 1 2024-04-03T08:39:21.226 INFO:tasks.workunit.client.0.smithi157.stdout:1/539: rename d2/c5f to d2/d11/d24/d67/caf 0 2024-04-03T08:39:21.230 INFO:tasks.workunit.client.0.smithi157.stdout:4/567: dread da/df/d24/d35/d3c/f71 [0,4194304] 0 2024-04-03T08:39:21.232 INFO:tasks.workunit.client.0.smithi157.stdout:6/618: rmdir d1/d5/d17/d2a/d85 0 2024-04-03T08:39:21.233 INFO:tasks.workunit.client.1.smithi181.stdout:3/434: dwrite d0/d5/d6/dd/f21 [0,4194304] 0 2024-04-03T08:39:21.237 INFO:tasks.workunit.client.1.smithi181.stdout:5/419: mkdir d4/d18/d25/d68/d87 0 2024-04-03T08:39:21.239 INFO:tasks.workunit.client.0.smithi157.stdout:0/579: link d2/d9/dc/d54/fac d2/d9/d36/d38/fd7 0 2024-04-03T08:39:21.240 INFO:tasks.workunit.client.1.smithi181.stdout:1/400: creat d10/d15/d17/d19/d33/f7d x:0 0 0 2024-04-03T08:39:21.240 INFO:tasks.workunit.client.0.smithi157.stdout:9/542: mknod d1/d15/d27/daf/cbc 0 2024-04-03T08:39:21.241 INFO:tasks.workunit.client.1.smithi181.stdout:1/401: fsync d10/d15/d17/d23/d27/f43 0 2024-04-03T08:39:21.243 INFO:tasks.workunit.client.1.smithi181.stdout:7/366: mkdir d0/d86 0 2024-04-03T08:39:21.243 INFO:tasks.workunit.client.0.smithi157.stdout:2/568: write d3/f4e [4107398,76176] 0 2024-04-03T08:39:21.243 INFO:tasks.workunit.client.0.smithi157.stdout:5/627: dwrite dc/d29/d56/d49/d53/f79 [0,4194304] 0 2024-04-03T08:39:21.244 INFO:tasks.workunit.client.1.smithi181.stdout:7/367: chown d0/d1/d6/f61 432 1 2024-04-03T08:39:21.252 INFO:tasks.workunit.client.0.smithi157.stdout:7/626: mkdir d0/d11/d15/d1b/dde 0 2024-04-03T08:39:21.255 INFO:tasks.workunit.client.1.smithi181.stdout:2/466: getdents d13/da7/d27/d2f 0 2024-04-03T08:39:21.256 INFO:tasks.workunit.client.1.smithi181.stdout:9/487: sync 2024-04-03T08:39:21.256 INFO:tasks.workunit.client.1.smithi181.stdout:8/365: sync 2024-04-03T08:39:21.257 INFO:tasks.workunit.client.0.smithi157.stdout:3/541: write d8/d1e/d2d/d39/d51/d48/f5c [3014599,14755] 0 2024-04-03T08:39:21.258 INFO:tasks.workunit.client.1.smithi181.stdout:4/488: symlink d1/d1e/d2c/d67/d93/l9c 0 2024-04-03T08:39:21.261 INFO:tasks.workunit.client.0.smithi157.stdout:8/611: dwrite d2/d11/f95 [0,4194304] 0 2024-04-03T08:39:21.261 INFO:tasks.workunit.client.1.smithi181.stdout:7/368: dwrite d0/d1/d6/de/f52 [0,4194304] 0 2024-04-03T08:39:21.264 INFO:tasks.workunit.client.1.smithi181.stdout:5/420: creat d4/d18/d25/d68/f88 x:0 0 0 2024-04-03T08:39:21.267 INFO:tasks.workunit.client.1.smithi181.stdout:1/402: chown d10/d15/d17/c48 1 1 2024-04-03T08:39:21.270 INFO:tasks.workunit.client.0.smithi157.stdout:8/612: write d2/f63 [8645538,84305] 0 2024-04-03T08:39:21.274 INFO:tasks.workunit.client.1.smithi181.stdout:2/467: creat d13/d1c/d73/fb0 x:0 0 0 2024-04-03T08:39:21.275 INFO:tasks.workunit.client.0.smithi157.stdout:4/568: dwrite da/df/f74 [0,4194304] 0 2024-04-03T08:39:21.276 INFO:tasks.workunit.client.1.smithi181.stdout:2/468: chown d13/da7/d27 650096 1 2024-04-03T08:39:21.281 INFO:tasks.workunit.client.1.smithi181.stdout:2/469: write d13/d1c/d4a/f4d [1023237,95893] 0 2024-04-03T08:39:21.282 INFO:tasks.workunit.client.1.smithi181.stdout:8/366: rename d4/d45/db/l65 to d4/d45/d9/d70/l7b 0 2024-04-03T08:39:21.285 INFO:tasks.workunit.client.1.smithi181.stdout:2/470: write d13/d1c/d4a/d68/f86 [4649059,96409] 0 2024-04-03T08:39:21.298 INFO:tasks.workunit.client.1.smithi181.stdout:3/435: mkdir d0/d17/d36/d8c 0 2024-04-03T08:39:21.300 INFO:tasks.workunit.client.1.smithi181.stdout:0/425: sync 2024-04-03T08:39:21.301 INFO:tasks.workunit.client.0.smithi157.stdout:7/627: dread d0/d11/d15/d1b/db8/fce [0,4194304] 0 2024-04-03T08:39:21.303 INFO:tasks.workunit.client.1.smithi181.stdout:0/426: truncate d5/dc/d14/f5c 675082 0 2024-04-03T08:39:21.307 INFO:tasks.workunit.client.1.smithi181.stdout:5/421: creat d4/d18/d55/d5a/f89 x:0 0 0 2024-04-03T08:39:21.311 INFO:tasks.workunit.client.1.smithi181.stdout:1/403: creat d10/d15/d17/d30/f7e x:0 0 0 2024-04-03T08:39:21.312 INFO:tasks.workunit.client.1.smithi181.stdout:1/404: chown d10/d15/d17/d23/d27/l2d 4299 1 2024-04-03T08:39:21.312 INFO:tasks.workunit.client.0.smithi157.stdout:1/540: symlink d2/d11/d24/d39/d3b/d2e/d48/d58/lb0 0 2024-04-03T08:39:21.328 INFO:tasks.workunit.client.1.smithi181.stdout:8/367: mknod d4/d45/db/d14/d31/d1c/d51/c7c 0 2024-04-03T08:39:21.331 INFO:tasks.workunit.client.0.smithi157.stdout:6/619: dwrite d1/d5/f1a [0,4194304] 0 2024-04-03T08:39:21.331 INFO:tasks.workunit.client.1.smithi181.stdout:2/471: write d13/da7/d27/d2f/d5d/f67 [2148258,122312] 0 2024-04-03T08:39:21.337 INFO:tasks.workunit.client.1.smithi181.stdout:4/489: fsync d1/d16/d24/d5e/d2b/d56/f64 0 2024-04-03T08:39:21.340 INFO:tasks.workunit.client.0.smithi157.stdout:5/628: write dc/d29/d56/d18/f3e [1447429,35431] 0 2024-04-03T08:39:21.341 INFO:tasks.workunit.client.0.smithi157.stdout:9/543: mkdir d1/d15/d27/d5c/dbd 0 2024-04-03T08:39:21.343 INFO:tasks.workunit.client.1.smithi181.stdout:7/369: mkdir d0/d1/d6/de/d17/d64/d85/d87 0 2024-04-03T08:39:21.344 INFO:tasks.workunit.client.1.smithi181.stdout:7/370: stat d0/d1/d6/de/f52 0 2024-04-03T08:39:21.346 INFO:tasks.workunit.client.1.smithi181.stdout:7/371: chown d0/d1/d6/de/d17/d27 9 1 2024-04-03T08:39:21.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:20 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/142326778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:39:21.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:20 smithi181 ceph-mon[44183]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-04-03T08:39:21.348 INFO:tasks.workunit.client.1.smithi181.stdout:7/372: chown d0/d1/d6/de/d17/d27/f3a 456669708 1 2024-04-03T08:39:21.350 INFO:tasks.workunit.client.1.smithi181.stdout:7/373: write d0/d1/d6/de/d17/f4c [724659,46733] 0 2024-04-03T08:39:21.351 INFO:tasks.workunit.client.1.smithi181.stdout:7/374: fdatasync d0/f3e 0 2024-04-03T08:39:21.352 INFO:tasks.workunit.client.0.smithi157.stdout:3/542: fdatasync d8/d13/d1b/d5b/f8a 0 2024-04-03T08:39:21.353 INFO:tasks.workunit.client.1.smithi181.stdout:7/375: chown d0/d1/d6/l35 118 1 2024-04-03T08:39:21.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.356+0000 7f2a0f000700 1 -- 172.21.15.157:0/374517256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 msgr2=0x7f2a080ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:21.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.356+0000 7f2a0f000700 1 --2- 172.21.15.157:0/374517256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080ff9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29f8004940 tx=0x7f29f8009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:21.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.356+0000 7f2a0f000700 1 -- 172.21.15.157:0/374517256 shutdown_connections 2024-04-03T08:39:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.356+0000 7f2a0f000700 1 --2- 172.21.15.157:0/374517256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 0x7f2a08102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.356+0000 7f2a0f000700 1 --2- 172.21.15.157:0/374517256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080ff9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.357+0000 7f2a0f000700 1 -- 172.21.15.157:0/374517256 >> 172.21.15.157:0/374517256 conn(0x7f2a080f7430 msgr2=0x7f2a080f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.357+0000 7f2a0f000700 1 -- 172.21.15.157:0/374517256 shutdown_connections 2024-04-03T08:39:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.357+0000 7f2a0f000700 1 -- 172.21.15.157:0/374517256 wait complete. 2024-04-03T08:39:21.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.359+0000 7f2a0f000700 1 Processor -- start 2024-04-03T08:39:21.362 INFO:tasks.workunit.client.1.smithi181.stdout:4/490: mkdir d1/d1e/d2c/d67/d9d 0 2024-04-03T08:39:21.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.361+0000 7f2a0f000700 1 -- start start 2024-04-03T08:39:21.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a0f000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a0f000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 0x7f2a080fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a0f000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08111650 con 0x7f2a080fff00 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a0f000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081117c0 con 0x7f2a080662e0 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a07e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a07e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080fd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:56908/0 (socket says 172.21.15.157:56908) 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.362+0000 7f2a07e00700 1 -- 172.21.15.157:0/2955515382 learned_addr learned my addr 172.21.15.157:0/2955515382 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.363+0000 7f2a07400700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 0x7f2a080fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.363+0000 7f2a07e00700 1 -- 172.21.15.157:0/2955515382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 msgr2=0x7f2a080fb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.363+0000 7f2a07e00700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 0x7f2a080fb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.363+0000 7f2a07e00700 1 -- 172.21.15.157:0/2955515382 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8005040 con 0x7f2a080662e0 2024-04-03T08:39:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.363+0000 7f2a07400700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 0x7f2a080fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:39:21.365 INFO:tasks.workunit.client.0.smithi157.stdout:6/620: rename d1/d5/d17/d29/d62/d7f/fb8 to d1/d5/d17/d29/da7/fd0 0 2024-04-03T08:39:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.364+0000 7f2a07e00700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080fd3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29f800b3b0 tx=0x7f29f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.364+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f800e030 con 0x7f2a080662e0 2024-04-03T08:39:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.365+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29f800bbf0 con 0x7f2a080662e0 2024-04-03T08:39:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.365+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f8013e60 con 0x7f2a080662e0 2024-04-03T08:39:21.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.366+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a080fbec0 con 0x7f2a080662e0 2024-04-03T08:39:21.367 INFO:tasks.workunit.client.1.smithi181.stdout:9/488: dwrite d1/da/d28/d30/d3e/d4e/f68 [0,4194304] 0 2024-04-03T08:39:21.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.366+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a080fc400 con 0x7f2a080662e0 2024-04-03T08:39:21.369 INFO:tasks.workunit.client.0.smithi157.stdout:8/613: dread d2/d11/d10/d24/d5b/f4b [0,4194304] 0 2024-04-03T08:39:21.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.368+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f29f800bd60 con 0x7f2a080662e0 2024-04-03T08:39:21.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.368+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0805f5f0 con 0x7f2a080662e0 2024-04-03T08:39:21.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.368+0000 7f29ffe00700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f29ec038ab0 0x7f29ec03af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:21.370 INFO:tasks.workunit.client.0.smithi157.stdout:4/569: dread da/df/d2f/d54/f65 [0,4194304] 0 2024-04-03T08:39:21.370 INFO:tasks.workunit.client.0.smithi157.stdout:7/628: creat d0/d11/d15/d17/d52/db6/dda/fdf x:0 0 0 2024-04-03T08:39:21.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.369+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f29f804dd80 con 0x7f2a080662e0 2024-04-03T08:39:21.372 INFO:tasks.workunit.client.0.smithi157.stdout:4/570: fdatasync da/df/d2f/f40 0 2024-04-03T08:39:21.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.373+0000 7f2a07400700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f29ec038ab0 0x7f29ec03af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:21.376 INFO:tasks.workunit.client.0.smithi157.stdout:5/629: creat dc/d29/d56/d87/fd3 x:0 0 0 2024-04-03T08:39:21.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.374+0000 7f2a07400700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f29ec038ab0 0x7f29ec03af60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f29f4004fd0 tx=0x7f29f400b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:21.379 INFO:tasks.workunit.client.1.smithi181.stdout:3/436: rename d0/d57/c74 to d0/d17/d36/c8d 0 2024-04-03T08:39:21.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.378+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f29f802cdd0 con 0x7f2a080662e0 2024-04-03T08:39:21.381 INFO:tasks.workunit.client.1.smithi181.stdout:6/429: sync 2024-04-03T08:39:21.382 INFO:tasks.workunit.client.0.smithi157.stdout:2/569: link d3/d12/l9b d3/d12/d43/d4b/lca 0 2024-04-03T08:39:21.384 INFO:tasks.workunit.client.1.smithi181.stdout:2/472: dwrite d13/da7/d27/f2c [0,4194304] 0 2024-04-03T08:39:21.387 INFO:tasks.workunit.client.0.smithi157.stdout:9/544: mkdir d1/d94/dbe 0 2024-04-03T08:39:21.390 INFO:tasks.workunit.client.0.smithi157.stdout:9/545: fdatasync d1/d15/d16/f65 0 2024-04-03T08:39:21.391 INFO:tasks.workunit.client.0.smithi157.stdout:7/629: dwrite d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:21.401 INFO:tasks.workunit.client.1.smithi181.stdout:6/430: rmdir d6/d3e/d5e/d7c 39 2024-04-03T08:39:21.403 INFO:tasks.workunit.client.0.smithi157.stdout:0/580: getdents d2/d9/dc/df/d6f/d9d/d6a/d91 0 2024-04-03T08:39:21.403 INFO:tasks.workunit.client.1.smithi181.stdout:5/422: getdents d4/d22 0 2024-04-03T08:39:21.406 INFO:tasks.workunit.client.0.smithi157.stdout:5/630: fsync dc/d29/d56/d49/f7a 0 2024-04-03T08:39:21.409 INFO:tasks.workunit.client.1.smithi181.stdout:7/376: dwrite d0/d1/d6/de/d17/d27/f49 [0,4194304] 0 2024-04-03T08:39:21.409 INFO:tasks.workunit.client.1.smithi181.stdout:3/437: mknod d0/d5/d6/c8e 0 2024-04-03T08:39:21.409 INFO:tasks.workunit.client.1.smithi181.stdout:5/423: chown d4/d18/f23 709 1 2024-04-03T08:39:21.410 INFO:tasks.workunit.client.1.smithi181.stdout:7/377: fdatasync d0/d1/d6/de/d17/f31 0 2024-04-03T08:39:21.414 INFO:tasks.workunit.client.1.smithi181.stdout:6/431: creat d6/d31/d36/f87 x:0 0 0 2024-04-03T08:39:21.414 INFO:tasks.workunit.client.1.smithi181.stdout:1/405: sync 2024-04-03T08:39:21.415 INFO:tasks.workunit.client.1.smithi181.stdout:5/424: chown d4/d18/d25/c74 0 1 2024-04-03T08:39:21.416 INFO:tasks.workunit.client.0.smithi157.stdout:6/621: chown d1/d5/d17/d2a/d37/f25 213 1 2024-04-03T08:39:21.417 INFO:tasks.workunit.client.0.smithi157.stdout:2/570: creat d3/d2e/d32/d9f/fcb x:0 0 0 2024-04-03T08:39:21.418 INFO:tasks.workunit.client.1.smithi181.stdout:7/378: write d0/d1/d6/de/d17/f62 [274726,84380] 0 2024-04-03T08:39:21.421 INFO:tasks.workunit.client.1.smithi181.stdout:1/406: chown d10/d15/d17/d37/f56 2356 1 2024-04-03T08:39:21.421 INFO:tasks.workunit.client.1.smithi181.stdout:0/427: rename d5/c7 to d5/dc/d14/d29/c84 0 2024-04-03T08:39:21.423 INFO:tasks.workunit.client.0.smithi157.stdout:2/571: fdatasync d3/d2e/d32/d3c/fa3 0 2024-04-03T08:39:21.423 INFO:tasks.workunit.client.0.smithi157.stdout:2/572: readlink d3/db/l2d 0 2024-04-03T08:39:21.426 INFO:tasks.workunit.client.1.smithi181.stdout:0/428: chown d5/dc/f71 22 1 2024-04-03T08:39:21.426 INFO:tasks.workunit.client.1.smithi181.stdout:5/425: chown d4/cb 1 1 2024-04-03T08:39:21.431 INFO:tasks.workunit.client.0.smithi157.stdout:4/571: symlink da/df/lc3 0 2024-04-03T08:39:21.432 INFO:tasks.workunit.client.1.smithi181.stdout:3/438: creat d0/d5/d77/f8f x:0 0 0 2024-04-03T08:39:21.436 INFO:tasks.workunit.client.1.smithi181.stdout:1/407: read d10/f22 [1053244,28075] 0 2024-04-03T08:39:21.437 INFO:tasks.workunit.client.0.smithi157.stdout:0/581: dread d2/d9/dc/df/f8a [0,4194304] 0 2024-04-03T08:39:21.438 INFO:tasks.workunit.client.1.smithi181.stdout:8/368: rename d4/d45/db/f4b to d4/d45/db/d5c/f7d 0 2024-04-03T08:39:21.440 INFO:tasks.workunit.client.1.smithi181.stdout:1/408: chown d10/d15/d17/d23/d27/l28 161049 1 2024-04-03T08:39:21.443 INFO:tasks.workunit.client.1.smithi181.stdout:0/429: unlink d5/dc/d14/d29/c49 0 2024-04-03T08:39:21.443 INFO:tasks.workunit.client.0.smithi157.stdout:8/614: write d2/d11/d10/f16 [116625,70770] 0 2024-04-03T08:39:21.448 INFO:tasks.workunit.client.1.smithi181.stdout:6/432: creat d6/d3e/d5e/d7c/d9/d22/f88 x:0 0 0 2024-04-03T08:39:21.448 INFO:tasks.workunit.client.0.smithi157.stdout:9/546: truncate d1/d15/d16/f1e 7097545 0 2024-04-03T08:39:21.449 INFO:tasks.workunit.client.1.smithi181.stdout:5/426: truncate d4/d18/d2c/f34 403602 0 2024-04-03T08:39:21.450 INFO:tasks.workunit.client.0.smithi157.stdout:6/622: dread - d1/d5/d17/d2a/d73/fc4 zero size 2024-04-03T08:39:21.452 INFO:tasks.workunit.client.0.smithi157.stdout:2/573: creat d3/d2e/d32/d9f/fcc x:0 0 0 2024-04-03T08:39:21.460 INFO:tasks.workunit.client.1.smithi181.stdout:0/430: dwrite d5/f7c [0,4194304] 0 2024-04-03T08:39:21.461 INFO:tasks.workunit.client.1.smithi181.stdout:4/491: rename d1/d16/d51 to d1/d16/d37/d34/d86/d9e 0 2024-04-03T08:39:21.464 INFO:tasks.workunit.client.0.smithi157.stdout:8/615: dwrite d2/d11/d10/d24/d5b/d2e/d75/f85 [0,4194304] 0 2024-04-03T08:39:21.465 INFO:tasks.workunit.client.1.smithi181.stdout:0/431: truncate d5/dc/d14/d29/f7e 800451 0 2024-04-03T08:39:21.466 INFO:tasks.workunit.client.1.smithi181.stdout:7/379: symlink d0/d1/d6/de/d17/d64/d82/l88 0 2024-04-03T08:39:21.471 INFO:tasks.workunit.client.0.smithi157.stdout:3/543: link d8/d1e/d2d/d3f/c72 d8/d1e/d2d/d3f/d4d/d8f/cc0 0 2024-04-03T08:39:21.471 INFO:tasks.workunit.client.0.smithi157.stdout:8/616: readlink d2/d11/d10/d24/la6 0 2024-04-03T08:39:21.472 INFO:tasks.workunit.client.1.smithi181.stdout:3/439: creat d0/d17/d36/d3b/d5a/d85/f90 x:0 0 0 2024-04-03T08:39:21.476 INFO:tasks.workunit.client.0.smithi157.stdout:9/547: dwrite d1/d36/d46/f54 [0,4194304] 0 2024-04-03T08:39:21.493 INFO:tasks.workunit.client.0.smithi157.stdout:7/630: link d0/d11/d6f/d76/da7/f62 d0/d11/d15/d17/d43/d8a/fe0 0 2024-04-03T08:39:21.495 INFO:tasks.workunit.client.1.smithi181.stdout:8/369: write d4/d45/db/d5c/f7d [593820,6341] 0 2024-04-03T08:39:21.497 INFO:tasks.workunit.client.0.smithi157.stdout:4/572: mknod da/df/d24/d35/d53/d69/cc4 0 2024-04-03T08:39:21.505 INFO:tasks.workunit.client.0.smithi157.stdout:5/631: link dc/c2c dc/d29/d56/d49/cd4 0 2024-04-03T08:39:21.507 INFO:tasks.workunit.client.0.smithi157.stdout:5/632: chown dc/d29/d56/d9e/dc3 5211 1 2024-04-03T08:39:21.511 INFO:tasks.workunit.client.0.smithi157.stdout:3/544: read d8/f62 [1907831,5138] 0 2024-04-03T08:39:21.514 INFO:tasks.workunit.client.0.smithi157.stdout:6/623: rmdir d1/d5/d17/d2a/d30 39 2024-04-03T08:39:21.518 INFO:tasks.workunit.client.0.smithi157.stdout:2/574: rename d3/db/l3d to d3/db/d44/d4c/d5a/d88/dc6/lcd 0 2024-04-03T08:39:21.520 INFO:tasks.workunit.client.0.smithi157.stdout:0/582: truncate d2/d9/dc/df/d6f/d9d/d6a/d91/dae/fb6 2400508 0 2024-04-03T08:39:21.522 INFO:tasks.workunit.client.0.smithi157.stdout:1/541: sync 2024-04-03T08:39:21.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/617: dwrite d2/d20/f60 [0,4194304] 0 2024-04-03T08:39:21.527 INFO:tasks.workunit.client.0.smithi157.stdout:5/633: fsync dc/f85 0 2024-04-03T08:39:21.528 INFO:tasks.workunit.client.0.smithi157.stdout:9/548: mkdir d1/d94/dbe/dbf 0 2024-04-03T08:39:21.532 INFO:tasks.workunit.client.1.smithi181.stdout:9/489: rename d1/da/d13/d73/l58 to d1/da/d13/d41/d32/l9b 0 2024-04-03T08:39:21.534 INFO:tasks.workunit.client.1.smithi181.stdout:9/490: fsync d1/da/d28/f6b 0 2024-04-03T08:39:21.535 INFO:tasks.workunit.client.1.smithi181.stdout:4/492: mknod d1/d16/d24/d5e/d31/c9f 0 2024-04-03T08:39:21.549 INFO:tasks.workunit.client.1.smithi181.stdout:8/370: dread - d4/d45/db/d14/d31/f3c zero size 2024-04-03T08:39:21.555 INFO:tasks.workunit.client.0.smithi157.stdout:5/634: write dc/d29/d56/d49/d53/fae [915798,77692] 0 2024-04-03T08:39:21.557 INFO:tasks.workunit.client.1.smithi181.stdout:2/473: rename d13/d1c/d4a/f82 to d13/d1c/d4a/d68/fb1 0 2024-04-03T08:39:21.559 INFO:tasks.workunit.client.0.smithi157.stdout:9/549: mknod d1/d15/d27/d34/cc0 0 2024-04-03T08:39:21.560 INFO:tasks.workunit.client.0.smithi157.stdout:2/575: write d3/db/d44/f61 [842572,16613] 0 2024-04-03T08:39:21.566 INFO:tasks.workunit.client.1.smithi181.stdout:1/409: creat d10/d15/d17/f7f x:0 0 0 2024-04-03T08:39:21.567 INFO:tasks.workunit.client.0.smithi157.stdout:8/618: dread d2/d6f/d70/f97 [0,4194304] 0 2024-04-03T08:39:21.572 INFO:tasks.workunit.client.1.smithi181.stdout:9/491: write d1/da/d13/d22/f3b [271443,124273] 0 2024-04-03T08:39:21.573 INFO:tasks.workunit.client.1.smithi181.stdout:8/371: mknod d4/d45/db/d14/c7e 0 2024-04-03T08:39:21.574 INFO:tasks.workunit.client.1.smithi181.stdout:9/492: chown d1/da/d13/d41/d65 67266882 1 2024-04-03T08:39:21.574 INFO:tasks.workunit.client.1.smithi181.stdout:8/372: fsync d4/d45/db/f66 0 2024-04-03T08:39:21.576 INFO:tasks.workunit.client.1.smithi181.stdout:6/433: rename d6/d3e/d5e/d7c/d50/d64/f67 to d6/d31/f89 0 2024-04-03T08:39:21.576 INFO:tasks.workunit.client.1.smithi181.stdout:8/373: dread - d4/d45/db/f58 zero size 2024-04-03T08:39:21.578 INFO:tasks.workunit.client.1.smithi181.stdout:6/434: stat d6/d3e/d5e/d7c/d50/d5b/l71 0 2024-04-03T08:39:21.579 INFO:tasks.workunit.client.0.smithi157.stdout:2/576: truncate d3/d2e/d32/d9f/fcb 677351 0 2024-04-03T08:39:21.579 INFO:tasks.workunit.client.0.smithi157.stdout:4/573: rename da/df/d2f/l34 to da/df/d11/lc5 0 2024-04-03T08:39:21.580 INFO:tasks.workunit.client.1.smithi181.stdout:6/435: chown d6/d31/d36/c6c 0 1 2024-04-03T08:39:21.584 INFO:tasks.workunit.client.1.smithi181.stdout:3/440: creat d0/d17/f91 x:0 0 0 2024-04-03T08:39:21.590 INFO:tasks.workunit.client.0.smithi157.stdout:7/631: dwrite d0/d11/d15/d17/d1c/f5d [0,4194304] 0 2024-04-03T08:39:21.590 INFO:tasks.workunit.client.0.smithi157.stdout:9/550: symlink d1/d4a/lc1 0 2024-04-03T08:39:21.592 INFO:tasks.workunit.client.1.smithi181.stdout:5/427: rename d4/d18/d25/d68/d87 to d4/d18/d25/d59/d81/d8a 0 2024-04-03T08:39:21.592 INFO:tasks.workunit.client.0.smithi157.stdout:1/542: dwrite d2/d11/d24/d39/f6f [0,4194304] 0 2024-04-03T08:39:21.593 INFO:tasks.workunit.client.1.smithi181.stdout:4/493: link d1/d16/d24/d5e/c7a d1/d16/d24/d5e/d31/d39/d5d/d94/ca0 0 2024-04-03T08:39:21.593 INFO:tasks.workunit.client.0.smithi157.stdout:0/583: dwrite d2/d9/dc/df/d6f/d9d/d6a/f96 [0,4194304] 0 2024-04-03T08:39:21.596 INFO:tasks.workunit.client.1.smithi181.stdout:3/441: dread d0/d5/f33 [0,4194304] 0 2024-04-03T08:39:21.599 INFO:tasks.workunit.client.1.smithi181.stdout:0/432: rename d5/dc/d10/d58/d6c/c37 to d5/dc/d10/d58/d6c/c85 0 2024-04-03T08:39:21.600 INFO:tasks.workunit.client.1.smithi181.stdout:0/433: fdatasync d5/dc/d14/d29/f78 0 2024-04-03T08:39:21.601 INFO:tasks.workunit.client.0.smithi157.stdout:8/619: truncate d2/d20/f3c 1670479 0 2024-04-03T08:39:21.602 INFO:tasks.workunit.client.0.smithi157.stdout:2/577: readlink d3/d12/l2b 0 2024-04-03T08:39:21.605 INFO:tasks.workunit.client.0.smithi157.stdout:3/545: dwrite d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:21.609 INFO:tasks.workunit.client.0.smithi157.stdout:6/624: rename d1/d4b/d61/lbc to d1/d5/d1b/ld1 0 2024-04-03T08:39:21.609 INFO:tasks.workunit.client.0.smithi157.stdout:8/620: chown d2/d11/d10/d24/d5b/c61 6 1 2024-04-03T08:39:21.610 INFO:tasks.workunit.client.1.smithi181.stdout:2/474: creat d13/da7/fb2 x:0 0 0 2024-04-03T08:39:21.611 INFO:tasks.workunit.client.0.smithi157.stdout:9/551: write d1/d94/d75/f88 [1882268,69659] 0 2024-04-03T08:39:21.611 INFO:tasks.workunit.client.1.smithi181.stdout:0/434: dread d5/dc/d10/f27 [0,4194304] 0 2024-04-03T08:39:21.615 INFO:tasks.workunit.client.0.smithi157.stdout:7/632: symlink d0/d11/d15/d1b/db8/le1 0 2024-04-03T08:39:21.616 INFO:tasks.workunit.client.0.smithi157.stdout:6/625: stat d1/fc 0 2024-04-03T08:39:21.618 INFO:tasks.workunit.client.0.smithi157.stdout:0/584: mkdir d2/dd8 0 2024-04-03T08:39:21.619 INFO:tasks.workunit.client.1.smithi181.stdout:6/436: write d6/d3e/f46 [2321264,35231] 0 2024-04-03T08:39:21.622 INFO:tasks.workunit.client.1.smithi181.stdout:7/380: rename d0/d1/d6/f83 to d0/d1/d6/de/d57/f89 0 2024-04-03T08:39:21.623 INFO:tasks.workunit.client.1.smithi181.stdout:5/428: rmdir d4/d44 39 2024-04-03T08:39:21.624 INFO:tasks.workunit.client.1.smithi181.stdout:6/437: truncate d6/d53/f79 146924 0 2024-04-03T08:39:21.625 INFO:tasks.workunit.client.0.smithi157.stdout:5/635: rename dc/d29/d56/d49/d53/fae to dc/d29/d56/d2e/fd5 0 2024-04-03T08:39:21.626 INFO:tasks.workunit.client.1.smithi181.stdout:4/494: rmdir d1/d1e/d2c/d67/d93 39 2024-04-03T08:39:21.626 INFO:tasks.workunit.client.1.smithi181.stdout:9/493: dwrite d1/da/d13/d22/d23/f5e [0,4194304] 0 2024-04-03T08:39:21.626 INFO:tasks.workunit.client.1.smithi181.stdout:5/429: readlink d4/d18/d3e/l7b 0 2024-04-03T08:39:21.629 INFO:tasks.workunit.client.1.smithi181.stdout:5/430: stat d4/d18/d3e/l7b 0 2024-04-03T08:39:21.629 INFO:tasks.workunit.client.1.smithi181.stdout:3/442: mknod d0/d5/d6/dd/c92 0 2024-04-03T08:39:21.632 INFO:tasks.workunit.client.1.smithi181.stdout:1/410: creat d10/d15/f80 x:0 0 0 2024-04-03T08:39:21.634 INFO:tasks.workunit.client.1.smithi181.stdout:0/435: creat d5/dc/d10/f86 x:0 0 0 2024-04-03T08:39:21.638 INFO:tasks.workunit.client.0.smithi157.stdout:4/574: creat da/df/d24/d35/d6a/d76/fc6 x:0 0 0 2024-04-03T08:39:21.638 INFO:tasks.workunit.client.1.smithi181.stdout:7/381: mknod d0/d1/d6/de/d17/d64/d85/c8a 0 2024-04-03T08:39:21.640 INFO:tasks.workunit.client.0.smithi157.stdout:6/626: mknod d1/d5/d17/d29/da7/cd2 0 2024-04-03T08:39:21.640 INFO:tasks.workunit.client.1.smithi181.stdout:4/495: mkdir d1/d16/d24/d5e/d31/d39/da1 0 2024-04-03T08:39:21.642 INFO:tasks.workunit.client.1.smithi181.stdout:5/431: mknod d4/d22/d78/c8b 0 2024-04-03T08:39:21.642 INFO:tasks.workunit.client.0.smithi157.stdout:2/578: creat d3/db/d44/d4c/d5a/d88/d97/fce x:0 0 0 2024-04-03T08:39:21.643 INFO:tasks.workunit.client.1.smithi181.stdout:6/438: dwrite d6/f3a [0,4194304] 0 2024-04-03T08:39:21.646 INFO:tasks.workunit.client.1.smithi181.stdout:3/443: mkdir d0/d17/d36/d3b/d5a/d93 0 2024-04-03T08:39:21.648 INFO:tasks.workunit.client.1.smithi181.stdout:1/411: write d10/d15/d17/d19/f68 [7147590,18968] 0 2024-04-03T08:39:21.651 INFO:tasks.workunit.client.0.smithi157.stdout:7/633: symlink d0/d11/d6f/d89/le2 0 2024-04-03T08:39:21.656 INFO:tasks.workunit.client.0.smithi157.stdout:8/621: mkdir d2/d11/d10/d24/d5b/d2e/dcf 0 2024-04-03T08:39:21.658 INFO:tasks.workunit.client.1.smithi181.stdout:4/496: creat d1/d1e/fa2 x:0 0 0 2024-04-03T08:39:21.661 INFO:tasks.workunit.client.1.smithi181.stdout:3/444: dread d0/d17/d36/f45 [4194304,4194304] 0 2024-04-03T08:39:21.662 INFO:tasks.workunit.client.1.smithi181.stdout:6/439: symlink d6/d3e/d5e/d7c/d9/d22/l8a 0 2024-04-03T08:39:21.665 INFO:tasks.workunit.client.0.smithi157.stdout:4/575: creat da/df/d2f/d64/d8f/dbd/d68/fc7 x:0 0 0 2024-04-03T08:39:21.666 INFO:tasks.workunit.client.1.smithi181.stdout:9/494: truncate d1/da/d13/d22/d23/d54/f98 1836888 0 2024-04-03T08:39:21.672 INFO:tasks.workunit.client.0.smithi157.stdout:2/579: symlink d3/db/d44/d4c/d5a/lcf 0 2024-04-03T08:39:21.674 INFO:tasks.workunit.client.1.smithi181.stdout:5/432: dread d4/d18/d2c/f2e [0,4194304] 0 2024-04-03T08:39:21.677 INFO:tasks.workunit.client.1.smithi181.stdout:8/374: rename d4/d45/db/d14/d31/d1c/l6b to d4/d44/l7f 0 2024-04-03T08:39:21.678 INFO:tasks.workunit.client.0.smithi157.stdout:7/634: mkdir d0/d4/de3 0 2024-04-03T08:39:21.679 INFO:tasks.workunit.client.1.smithi181.stdout:8/375: write d4/d44/f5b [5168593,42722] 0 2024-04-03T08:39:21.681 INFO:tasks.workunit.client.0.smithi157.stdout:0/585: creat d2/d9/d51/d63/fd9 x:0 0 0 2024-04-03T08:39:21.683 INFO:tasks.workunit.client.1.smithi181.stdout:1/412: rename d10/d15/d17/d19/d33/d70/f76 to d10/d15/d17/d19/d33/d70/f81 0 2024-04-03T08:39:21.683 INFO:tasks.workunit.client.1.smithi181.stdout:1/413: stat d10/d15/c25 0 2024-04-03T08:39:21.684 INFO:tasks.workunit.client.1.smithi181.stdout:1/414: fdatasync f2 0 2024-04-03T08:39:21.685 INFO:tasks.workunit.client.0.smithi157.stdout:8/622: creat d2/d11/d10/d24/d5b/d2e/d75/d81/fd0 x:0 0 0 2024-04-03T08:39:21.686 INFO:tasks.workunit.client.0.smithi157.stdout:9/552: link d1/d15/d16/f3a d1/d94/dbe/dbf/fc2 0 2024-04-03T08:39:21.689 INFO:tasks.workunit.client.0.smithi157.stdout:3/546: truncate d8/f2f 201807 0 2024-04-03T08:39:21.692 INFO:tasks.workunit.client.1.smithi181.stdout:9/495: mkdir d1/da/d13/d22/d23/d36/d9c 0 2024-04-03T08:39:21.694 INFO:tasks.workunit.client.1.smithi181.stdout:0/436: write d5/dc/d14/d29/f48 [1265781,86665] 0 2024-04-03T08:39:21.699 INFO:tasks.workunit.client.0.smithi157.stdout:1/543: truncate d2/d11/d24/d39/d3b/d2e/f7d 2111120 0 2024-04-03T08:39:21.699 INFO:tasks.workunit.client.0.smithi157.stdout:6/627: creat d1/d5/d17/d29/da7/db9/fd3 x:0 0 0 2024-04-03T08:39:21.699 INFO:tasks.workunit.client.1.smithi181.stdout:2/475: rename d13/da7/d27/d46 to d13/d1c/d4a/d7f/db3 0 2024-04-03T08:39:21.704 INFO:tasks.workunit.client.0.smithi157.stdout:7/635: creat d0/d11/d15/d17/d1c/d4f/d5f/fe4 x:0 0 0 2024-04-03T08:39:21.707 INFO:tasks.workunit.client.1.smithi181.stdout:8/376: write d4/d45/d9/f4d [2449298,4073] 0 2024-04-03T08:39:21.710 INFO:tasks.workunit.client.0.smithi157.stdout:5/636: write dc/d29/d43/f48 [738503,75267] 0 2024-04-03T08:39:21.711 INFO:tasks.workunit.client.1.smithi181.stdout:8/377: truncate d4/d45/db/d14/f2d 5194142 0 2024-04-03T08:39:21.712 INFO:tasks.workunit.client.1.smithi181.stdout:8/378: dread - d4/d44/d59/d5f/f75 zero size 2024-04-03T08:39:21.713 INFO:tasks.workunit.client.1.smithi181.stdout:8/379: chown d4/d2a 47497849 1 2024-04-03T08:39:21.713 INFO:tasks.workunit.client.0.smithi157.stdout:9/553: unlink d1/d15/d27/fa8 0 2024-04-03T08:39:21.718 INFO:tasks.workunit.client.0.smithi157.stdout:4/576: unlink da/df/d24/d35/d6a/cc1 0 2024-04-03T08:39:21.719 INFO:tasks.workunit.client.0.smithi157.stdout:4/577: stat da/df/d24/d35/d6a/f79 0 2024-04-03T08:39:21.724 INFO:tasks.workunit.client.0.smithi157.stdout:4/578: truncate da/df/d6b/fb1 435776 0 2024-04-03T08:39:21.726 INFO:tasks.workunit.client.1.smithi181.stdout:1/415: creat d10/d15/d17/d30/f82 x:0 0 0 2024-04-03T08:39:21.726 INFO:tasks.workunit.client.1.smithi181.stdout:6/440: mkdir d6/d3e/d5e/d7c/d9/d22/d4f/d77/d8b 0 2024-04-03T08:39:21.727 INFO:tasks.workunit.client.0.smithi157.stdout:3/547: creat d8/d1e/d2d/d39/d51/d48/fc1 x:0 0 0 2024-04-03T08:39:21.743 INFO:tasks.workunit.client.0.smithi157.stdout:6/628: dread d1/d5/d1b/f1c [4194304,4194304] 0 2024-04-03T08:39:21.745 INFO:tasks.workunit.client.1.smithi181.stdout:2/476: dread - d13/d1c/f38 zero size 2024-04-03T08:39:21.747 INFO:tasks.workunit.client.1.smithi181.stdout:7/382: getdents d0/d1/d6/de/d57 0 2024-04-03T08:39:21.753 INFO:tasks.workunit.client.1.smithi181.stdout:8/380: unlink d4/d45/f7 0 2024-04-03T08:39:21.762 INFO:tasks.workunit.client.1.smithi181.stdout:6/441: truncate d6/d31/f4d 919203 0 2024-04-03T08:39:21.764 INFO:tasks.workunit.client.1.smithi181.stdout:6/442: readlink d6/d3e/d5e/d7c/d50/d5b/l71 0 2024-04-03T08:39:21.765 INFO:tasks.workunit.client.1.smithi181.stdout:9/496: unlink d1/da/d13/f5b 0 2024-04-03T08:39:21.765 INFO:tasks.workunit.client.1.smithi181.stdout:2/477: dread d13/d1c/d4a/d68/fb1 [0,4194304] 0 2024-04-03T08:39:21.769 INFO:tasks.workunit.client.1.smithi181.stdout:8/381: dwrite d4/d44/f6f [0,4194304] 0 2024-04-03T08:39:21.769 INFO:tasks.workunit.client.1.smithi181.stdout:4/497: rename d1/d16/d24/d5e/c4e to d1/d1e/d82/d84/ca3 0 2024-04-03T08:39:21.770 INFO:tasks.workunit.client.1.smithi181.stdout:6/443: write d6/d3e/d5e/d7c/d9/f28 [5741159,66959] 0 2024-04-03T08:39:21.773 INFO:tasks.workunit.client.1.smithi181.stdout:7/383: mkdir d0/d1/d6/de/d6d/d8b 0 2024-04-03T08:39:21.773 INFO:tasks.workunit.client.1.smithi181.stdout:4/498: chown d1/d16/d24/d5e/d3f 1660 1 2024-04-03T08:39:21.774 INFO:tasks.workunit.client.1.smithi181.stdout:3/445: getdents d0/d5/d6/dd/d5f 0 2024-04-03T08:39:21.776 INFO:tasks.workunit.client.1.smithi181.stdout:3/446: dread - d0/d17/f26 zero size 2024-04-03T08:39:21.779 INFO:tasks.workunit.client.1.smithi181.stdout:1/416: dwrite d10/d15/d17/d19/d33/d70/f81 [0,4194304] 0 2024-04-03T08:39:21.790 INFO:tasks.workunit.client.1.smithi181.stdout:0/437: rename d5/d9/d2e/c4e to d5/d9/d60/c87 0 2024-04-03T08:39:21.802 INFO:tasks.workunit.client.1.smithi181.stdout:6/444: symlink d6/d3e/d5e/d7c/d9/d22/d4f/l8c 0 2024-04-03T08:39:21.804 INFO:tasks.workunit.client.1.smithi181.stdout:7/384: symlink d0/d1/d6/de/d57/l8c 0 2024-04-03T08:39:21.806 INFO:tasks.workunit.client.1.smithi181.stdout:6/445: dread - d6/d3e/d5e/d7c/d9/d22/f88 zero size 2024-04-03T08:39:21.807 INFO:tasks.workunit.client.1.smithi181.stdout:1/417: unlink d10/d15/d17/c48 0 2024-04-03T08:39:21.810 INFO:tasks.workunit.client.1.smithi181.stdout:2/478: creat d13/d1c/da5/dac/fb4 x:0 0 0 2024-04-03T08:39:21.817 INFO:tasks.workunit.client.1.smithi181.stdout:5/433: sync 2024-04-03T08:39:21.822 INFO:tasks.workunit.client.1.smithi181.stdout:9/497: rename d1/d34 to d1/da/d13/d22/d23/d36/d91/d9d 0 2024-04-03T08:39:21.824 INFO:tasks.workunit.client.1.smithi181.stdout:8/382: dread d4/d45/db/d14/f20 [0,4194304] 0 2024-04-03T08:39:21.824 INFO:tasks.workunit.client.1.smithi181.stdout:9/498: chown d1/da/d28/d30/d3e/d77 114 1 2024-04-03T08:39:21.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.827+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a080f8f70 con 0x7f29ec038ab0 2024-04-03T08:39:21.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.828+0000 7f29ffe00700 1 -- 172.21.15.157:0/2955515382 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f2a080f8f70 con 0x7f29ec038ab0 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "1/21 daemons upgraded", 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:39:21.830 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:39:21.833 INFO:tasks.workunit.client.1.smithi181.stdout:3/447: write d0/d5/d6/f4c [536430,87519] 0 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.831+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f29ec038ab0 msgr2=0x7f29ec03af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f29ec038ab0 0x7f29ec03af60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f29f4004fd0 tx=0x7f29f400b040 comp rx=0 tx=0).stop 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 msgr2=0x7f2a080fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080fd3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29f800b3b0 tx=0x7f29f8009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 shutdown_connections 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f29ec038ab0 0x7f29ec03af60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a080662e0 0x7f2a080fd3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 --2- 172.21.15.157:0/2955515382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a080fff00 0x7f2a080fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 >> 172.21.15.157:0/2955515382 conn(0x7f2a080f7430 msgr2=0x7f2a080f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 shutdown_connections 2024-04-03T08:39:21.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:21.832+0000 7f2a0f000700 1 -- 172.21.15.157:0/2955515382 wait complete. 2024-04-03T08:39:21.835 INFO:tasks.workunit.client.1.smithi181.stdout:3/448: fdatasync d0/d5/d6/d32/f7c 0 2024-04-03T08:39:21.835 INFO:tasks.workunit.client.1.smithi181.stdout:6/446: mkdir d6/d53/d8d 0 2024-04-03T08:39:21.837 INFO:tasks.workunit.client.1.smithi181.stdout:3/449: write d0/d5/d6/f39 [914236,19474] 0 2024-04-03T08:39:21.838 INFO:tasks.workunit.client.1.smithi181.stdout:1/418: creat d10/d15/d41/f83 x:0 0 0 2024-04-03T08:39:21.841 INFO:tasks.workunit.client.1.smithi181.stdout:2/479: fdatasync d13/da7/d27/f4b 0 2024-04-03T08:39:21.847 INFO:tasks.workunit.client.1.smithi181.stdout:5/434: rmdir d4/d18/d3e 39 2024-04-03T08:39:21.851 INFO:tasks.workunit.client.1.smithi181.stdout:0/438: mknod d5/dc/c88 0 2024-04-03T08:39:21.855 INFO:tasks.workunit.client.1.smithi181.stdout:9/499: rmdir d1/da/d13/d73 39 2024-04-03T08:39:21.858 INFO:tasks.workunit.client.1.smithi181.stdout:4/499: creat d1/fa4 x:0 0 0 2024-04-03T08:39:21.861 INFO:tasks.workunit.client.1.smithi181.stdout:7/385: mknod d0/d1/d6/de/c8d 0 2024-04-03T08:39:21.862 INFO:tasks.workunit.client.1.smithi181.stdout:7/386: chown d0/d1/d6/l45 57118934 1 2024-04-03T08:39:21.864 INFO:tasks.workunit.client.1.smithi181.stdout:7/387: dread - d0/d1/d6/de/d17/d64/f7c zero size 2024-04-03T08:39:21.864 INFO:tasks.workunit.client.0.smithi157.stdout:0/586: getdents d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2 0 2024-04-03T08:39:21.865 INFO:tasks.workunit.client.1.smithi181.stdout:7/388: chown d0/d1/d6/f26 0 1 2024-04-03T08:39:21.866 INFO:tasks.workunit.client.1.smithi181.stdout:6/447: creat d6/d3e/d5e/d7c/d9/d7f/f8e x:0 0 0 2024-04-03T08:39:21.867 INFO:tasks.workunit.client.1.smithi181.stdout:6/448: fdatasync d6/f60 0 2024-04-03T08:39:21.868 INFO:tasks.workunit.client.1.smithi181.stdout:3/450: rmdir d0/d17/d36/d3b 39 2024-04-03T08:39:21.869 INFO:tasks.workunit.client.0.smithi157.stdout:8/623: rename d2/d20/d23/f4e to d2/d6f/fd1 0 2024-04-03T08:39:21.870 INFO:tasks.workunit.client.1.smithi181.stdout:3/451: write d0/d5/d6/f39 [994156,37422] 0 2024-04-03T08:39:21.874 INFO:tasks.workunit.client.0.smithi157.stdout:9/554: chown d1/d15/d16/f1e 1975886797 1 2024-04-03T08:39:21.875 INFO:tasks.workunit.client.1.smithi181.stdout:0/439: dread d5/dc/d10/d58/d6c/f15 [0,4194304] 0 2024-04-03T08:39:21.875 INFO:tasks.workunit.client.0.smithi157.stdout:4/579: truncate da/df/d2f/d54/f5a 515867 0 2024-04-03T08:39:21.880 INFO:tasks.workunit.client.0.smithi157.stdout:3/548: fdatasync d8/d13/f1a 0 2024-04-03T08:39:21.880 INFO:tasks.workunit.client.1.smithi181.stdout:5/435: dread - d4/d18/f5c zero size 2024-04-03T08:39:21.882 INFO:tasks.workunit.client.1.smithi181.stdout:5/436: dread - d4/d18/d55/d5a/f89 zero size 2024-04-03T08:39:21.883 INFO:tasks.workunit.client.1.smithi181.stdout:3/452: dread d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:21.884 INFO:tasks.workunit.client.0.smithi157.stdout:3/549: truncate d8/d13/d1b/d83/fb2 1017477 0 2024-04-03T08:39:21.887 INFO:tasks.workunit.client.1.smithi181.stdout:0/440: dread d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:21.887 INFO:tasks.workunit.client.0.smithi157.stdout:7/636: dread d0/d11/d15/d17/d1c/d4f/d5f/fbb [0,4194304] 0 2024-04-03T08:39:21.888 INFO:tasks.workunit.client.1.smithi181.stdout:9/500: rmdir d1/da/d13/d22/d23/d36/d91 39 2024-04-03T08:39:21.891 INFO:tasks.workunit.client.1.smithi181.stdout:2/480: write d13/d1c/d4a/d68/f79 [425317,94547] 0 2024-04-03T08:39:21.894 INFO:tasks.workunit.client.0.smithi157.stdout:0/587: fdatasync d2/d9/dc/df/d1b/d35/d3d/fa5 0 2024-04-03T08:39:21.895 INFO:tasks.workunit.client.1.smithi181.stdout:7/389: mknod d0/d1/d6/de/d57/c8e 0 2024-04-03T08:39:21.897 INFO:tasks.workunit.client.1.smithi181.stdout:1/419: dwrite d10/f22 [0,4194304] 0 2024-04-03T08:39:21.897 INFO:tasks.workunit.client.1.smithi181.stdout:6/449: fdatasync d6/d3e/d5e/d7c/d50/d5b/f6a 0 2024-04-03T08:39:21.898 INFO:tasks.workunit.client.0.smithi157.stdout:4/580: mkdir da/df/d2f/d97/dc8 0 2024-04-03T08:39:21.901 INFO:tasks.workunit.client.1.smithi181.stdout:6/450: write d6/d53/f79 [1128537,39744] 0 2024-04-03T08:39:21.902 INFO:tasks.workunit.client.0.smithi157.stdout:7/637: creat d0/d4/da5/fe5 x:0 0 0 2024-04-03T08:39:21.903 INFO:tasks.workunit.client.1.smithi181.stdout:8/383: dwrite d4/d45/d9/f1b [0,4194304] 0 2024-04-03T08:39:21.907 INFO:tasks.workunit.client.0.smithi157.stdout:2/580: getdents d3/d2e/d32 0 2024-04-03T08:39:21.914 INFO:tasks.workunit.client.1.smithi181.stdout:0/441: write d5/dc/d10/d58/d6c/f53 [350114,102782] 0 2024-04-03T08:39:21.916 INFO:tasks.workunit.client.1.smithi181.stdout:9/501: mkdir d1/da/d28/d9e 0 2024-04-03T08:39:21.917 INFO:tasks.workunit.client.1.smithi181.stdout:5/437: dread d4/ff [4194304,4194304] 0 2024-04-03T08:39:21.917 INFO:tasks.workunit.client.1.smithi181.stdout:0/442: chown d5/d9/f32 11069 1 2024-04-03T08:39:21.918 INFO:tasks.workunit.client.0.smithi157.stdout:5/637: sync 2024-04-03T08:39:21.918 INFO:tasks.workunit.client.0.smithi157.stdout:8/624: mkdir d2/d11/d10/d24/d5b/d2e/dcf/dd2 0 2024-04-03T08:39:21.918 INFO:tasks.workunit.client.1.smithi181.stdout:4/500: link d1/d16/d24/d5e/f50 d1/d16/d24/d5e/d31/fa5 0 2024-04-03T08:39:21.920 INFO:tasks.workunit.client.0.smithi157.stdout:8/625: chown d2/cc 2110828849 1 2024-04-03T08:39:21.921 INFO:tasks.workunit.client.0.smithi157.stdout:0/588: fdatasync d2/d9/dc/df/d1b/f8b 0 2024-04-03T08:39:21.922 INFO:tasks.workunit.client.1.smithi181.stdout:0/443: write d5/d9/d60/f61 [727395,89174] 0 2024-04-03T08:39:21.923 INFO:tasks.workunit.client.1.smithi181.stdout:6/451: dwrite d6/f70 [0,4194304] 0 2024-04-03T08:39:21.925 INFO:tasks.workunit.client.1.smithi181.stdout:7/390: fsync d0/d1/d6/de/d17/d27/f28 0 2024-04-03T08:39:21.926 INFO:tasks.workunit.client.1.smithi181.stdout:0/444: write d5/dc/f71 [493645,90789] 0 2024-04-03T08:39:21.929 INFO:tasks.workunit.client.1.smithi181.stdout:6/452: readlink d6/d3e/d5e/d7c/d9/d22/d4f/l8c 0 2024-04-03T08:39:21.930 INFO:tasks.workunit.client.1.smithi181.stdout:1/420: fsync d10/d15/d17/d30/f55 0 2024-04-03T08:39:21.930 INFO:tasks.workunit.client.0.smithi157.stdout:7/638: mkdir d0/d11/d15/d17/d52/db6/dda/de6 0 2024-04-03T08:39:21.932 INFO:tasks.workunit.client.1.smithi181.stdout:6/453: stat d6/d31/d36/f87 0 2024-04-03T08:39:21.938 INFO:tasks.workunit.client.1.smithi181.stdout:5/438: stat d4/c31 0 2024-04-03T08:39:21.938 INFO:tasks.workunit.client.1.smithi181.stdout:5/439: readlink d4/d22/l3b 0 2024-04-03T08:39:21.939 INFO:tasks.workunit.client.0.smithi157.stdout:1/544: getdents d2/d11/d24/d39/d3b/d2e/d48/d64 0 2024-04-03T08:39:21.939 INFO:tasks.workunit.client.0.smithi157.stdout:9/555: creat d1/d94/fc3 x:0 0 0 2024-04-03T08:39:21.940 INFO:tasks.workunit.client.1.smithi181.stdout:2/481: symlink d13/da7/lb5 0 2024-04-03T08:39:21.941 INFO:tasks.workunit.client.1.smithi181.stdout:5/440: truncate d4/d18/f83 988490 0 2024-04-03T08:39:21.943 INFO:tasks.workunit.client.1.smithi181.stdout:2/482: stat d13/da7/d27/d2f/d5d/cad 0 2024-04-03T08:39:21.944 INFO:tasks.workunit.client.1.smithi181.stdout:5/441: truncate d4/f32 4691343 0 2024-04-03T08:39:21.945 INFO:tasks.workunit.client.1.smithi181.stdout:2/483: read - d13/da7/d40/f6a zero size 2024-04-03T08:39:21.947 INFO:tasks.workunit.client.1.smithi181.stdout:2/484: chown d13/d1c/d73/d8b 0 1 2024-04-03T08:39:21.947 INFO:tasks.workunit.client.0.smithi157.stdout:5/638: truncate dc/d29/f46 365843 0 2024-04-03T08:39:21.947 INFO:tasks.workunit.client.0.smithi157.stdout:8/626: symlink d2/d7b/ld3 0 2024-04-03T08:39:21.948 INFO:tasks.workunit.client.1.smithi181.stdout:6/454: dwrite d6/d3e/d5e/d7c/f6d [0,4194304] 0 2024-04-03T08:39:21.949 INFO:tasks.workunit.client.1.smithi181.stdout:2/485: chown d13/da7/d27/f4f 77 1 2024-04-03T08:39:21.950 INFO:tasks.workunit.client.1.smithi181.stdout:4/501: symlink d1/d16/d24/d5e/d3f/d41/la6 0 2024-04-03T08:39:21.956 INFO:tasks.workunit.client.0.smithi157.stdout:6/629: getdents d1/d5/d17/d2a/d37 0 2024-04-03T08:39:21.960 INFO:tasks.workunit.client.0.smithi157.stdout:3/550: creat d8/fc2 x:0 0 0 2024-04-03T08:39:21.962 INFO:tasks.workunit.client.0.smithi157.stdout:0/589: rmdir d2/d9/d36/d38 39 2024-04-03T08:39:21.969 INFO:tasks.workunit.client.1.smithi181.stdout:0/445: mknod d5/dc/d75/c89 0 2024-04-03T08:39:21.969 INFO:tasks.workunit.client.1.smithi181.stdout:4/502: dwrite d1/d1e/d2c/f77 [0,4194304] 0 2024-04-03T08:39:21.971 INFO:tasks.workunit.client.0.smithi157.stdout:7/639: mknod d0/d4/d8e/d96/ce7 0 2024-04-03T08:39:21.972 INFO:tasks.workunit.client.1.smithi181.stdout:4/503: readlink d1/d16/d24/d5e/d2b/l95 0 2024-04-03T08:39:21.972 INFO:tasks.workunit.client.0.smithi157.stdout:4/581: dwrite da/df/d24/f5c [0,4194304] 0 2024-04-03T08:39:21.976 INFO:tasks.workunit.client.1.smithi181.stdout:0/446: dread - d5/dc/d10/f86 zero size 2024-04-03T08:39:21.978 INFO:tasks.workunit.client.1.smithi181.stdout:4/504: rename d1/d16/d37/d34/d86/d9e to d1/d16/d37/d34/d86/d9e/da7 22 2024-04-03T08:39:21.980 INFO:tasks.workunit.client.1.smithi181.stdout:4/505: chown d1/d1e/d82/d84 368046 1 2024-04-03T08:39:21.982 INFO:tasks.workunit.client.1.smithi181.stdout:3/453: link d0/d17/d36/d3b/d5a/d85/f90 d0/d17/d63/d81/f94 0 2024-04-03T08:39:21.985 INFO:tasks.workunit.client.0.smithi157.stdout:9/556: mkdir d1/d4a/dc4 0 2024-04-03T08:39:21.985 INFO:tasks.workunit.client.1.smithi181.stdout:3/454: write d0/d5/d77/f8f [712172,104987] 0 2024-04-03T08:39:21.987 INFO:tasks.workunit.client.1.smithi181.stdout:3/455: stat d0/d5/d6/d32/d43/f60 0 2024-04-03T08:39:21.989 INFO:tasks.workunit.client.1.smithi181.stdout:8/384: symlink d4/d45/db/d14/d31/d1c/d51/l80 0 2024-04-03T08:39:21.992 INFO:tasks.workunit.client.0.smithi157.stdout:1/545: creat d2/d11/d24/d39/d3b/d1b/d7f/fb1 x:0 0 0 2024-04-03T08:39:21.997 INFO:tasks.workunit.client.1.smithi181.stdout:5/442: mknod d4/d18/d25/d68/c8c 0 2024-04-03T08:39:22.002 INFO:tasks.workunit.client.0.smithi157.stdout:3/551: dread - d8/f88 zero size 2024-04-03T08:39:22.009 INFO:tasks.workunit.client.1.smithi181.stdout:8/385: dwrite d4/d45/db/d14/d31/d1c/f2f [0,4194304] 0 2024-04-03T08:39:22.010 INFO:tasks.workunit.client.1.smithi181.stdout:7/391: mknod d0/d1/c8f 0 2024-04-03T08:39:22.010 INFO:tasks.workunit.client.0.smithi157.stdout:8/627: write d2/d11/f3e [471798,128713] 0 2024-04-03T08:39:22.013 INFO:tasks.workunit.client.0.smithi157.stdout:6/630: write d1/d5/d17/d2a/d73/f71 [3647112,48965] 0 2024-04-03T08:39:22.013 INFO:tasks.workunit.client.0.smithi157.stdout:2/581: link d3/d12/l2b d3/db/d44/d4c/d5a/d88/dc6/ld0 0 2024-04-03T08:39:22.014 INFO:tasks.workunit.client.1.smithi181.stdout:7/392: read d0/d1/d6/de/f69 [1045847,36026] 0 2024-04-03T08:39:22.021 INFO:tasks.workunit.client.1.smithi181.stdout:4/506: symlink d1/d16/d24/d5e/d3f/d81/la8 0 2024-04-03T08:39:22.022 INFO:tasks.workunit.client.1.smithi181.stdout:4/507: rename d1/d16 to d1/d16/d24/d5e/d3f/d41/da9 22 2024-04-03T08:39:22.024 INFO:tasks.workunit.client.1.smithi181.stdout:5/443: readlink d4/d18/d3e/l7b 0 2024-04-03T08:39:22.024 INFO:tasks.workunit.client.1.smithi181.stdout:2/486: dwrite d13/da7/d27/d2f/f70 [0,4194304] 0 2024-04-03T08:39:22.027 INFO:tasks.workunit.client.0.smithi157.stdout:3/552: creat d8/d13/fc3 x:0 0 0 2024-04-03T08:39:22.038 INFO:tasks.workunit.client.0.smithi157.stdout:4/582: mknod da/df/d99/da8/cc9 0 2024-04-03T08:39:22.042 INFO:tasks.workunit.client.0.smithi157.stdout:8/628: symlink d2/d6f/db5/ld4 0 2024-04-03T08:39:22.043 INFO:tasks.workunit.client.0.smithi157.stdout:2/582: symlink d3/db/d44/ld1 0 2024-04-03T08:39:22.046 INFO:tasks.workunit.client.0.smithi157.stdout:2/583: fdatasync d3/d12/d43/f78 0 2024-04-03T08:39:22.047 INFO:tasks.workunit.client.0.smithi157.stdout:9/557: dwrite d1/d36/f81 [0,4194304] 0 2024-04-03T08:39:22.047 INFO:tasks.workunit.client.0.smithi157.stdout:5/639: link dc/f1d dc/d29/d56/d49/d53/fd6 0 2024-04-03T08:39:22.058 INFO:tasks.workunit.client.1.smithi181.stdout:9/502: getdents d1/da/d13/d41 0 2024-04-03T08:39:22.060 INFO:tasks.workunit.client.1.smithi181.stdout:0/447: write d5/dc/ff [1342877,47831] 0 2024-04-03T08:39:22.064 INFO:tasks.workunit.client.0.smithi157.stdout:0/590: link d2/d9/d36/l5e d2/d9/d51/lda 0 2024-04-03T08:39:22.067 INFO:tasks.workunit.client.0.smithi157.stdout:4/583: dread da/df/d11/d5d/fb2 [0,4194304] 0 2024-04-03T08:39:22.068 INFO:tasks.workunit.client.1.smithi181.stdout:5/444: symlink d4/d18/d25/d68/l8d 0 2024-04-03T08:39:22.069 INFO:tasks.workunit.client.0.smithi157.stdout:7/640: creat d0/d11/d6f/d89/d8c/dc6/fe8 x:0 0 0 2024-04-03T08:39:22.072 INFO:tasks.workunit.client.1.smithi181.stdout:5/445: fdatasync d4/d18/d25/f1c 0 2024-04-03T08:39:22.074 INFO:tasks.workunit.client.1.smithi181.stdout:5/446: write d4/d18/d55/f70 [634869,35426] 0 2024-04-03T08:39:22.075 INFO:tasks.workunit.client.1.smithi181.stdout:9/503: dwrite d1/da/d28/d30/d3e/d4e/f81 [0,4194304] 0 2024-04-03T08:39:22.077 INFO:tasks.workunit.client.1.smithi181.stdout:8/386: link d4/d45/db/f3a d4/d44/d59/d5f/d6c/f81 0 2024-04-03T08:39:22.079 INFO:tasks.workunit.client.0.smithi157.stdout:2/584: creat d3/db/d44/d4c/d5a/d88/dc6/fd2 x:0 0 0 2024-04-03T08:39:22.080 INFO:tasks.workunit.client.1.smithi181.stdout:1/421: getdents d10 0 2024-04-03T08:39:22.081 INFO:tasks.workunit.client.1.smithi181.stdout:1/422: chown fc 312 1 2024-04-03T08:39:22.082 INFO:tasks.workunit.client.0.smithi157.stdout:5/640: rename dc/f7e to dc/dbb/fd7 0 2024-04-03T08:39:22.083 INFO:tasks.workunit.client.1.smithi181.stdout:3/456: truncate d0/d5/fa 198149 0 2024-04-03T08:39:22.087 INFO:tasks.workunit.client.0.smithi157.stdout:1/546: creat d2/d11/d24/fb2 x:0 0 0 2024-04-03T08:39:22.089 INFO:tasks.workunit.client.0.smithi157.stdout:3/553: mkdir d8/d13/d1b/dc4 0 2024-04-03T08:39:22.090 INFO:tasks.workunit.client.1.smithi181.stdout:4/508: mknod d1/d16/d24/d5e/d3f/d6c/caa 0 2024-04-03T08:39:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.092+0000 7fc2a9c00700 1 -- 172.21.15.157:0/3235840695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fe0d0 msgr2=0x7fc2a40fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.092+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/3235840695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fe0d0 0x7fc2a40fe540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc290004970 tx=0x7fc290009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.093+0000 7fc2a9c00700 1 -- 172.21.15.157:0/3235840695 shutdown_connections 2024-04-03T08:39:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.093+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/3235840695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fe0d0 0x7fc2a40fe540 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.093+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/3235840695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2a40fcee0 0x7fc2a40fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.093+0000 7fc2a9c00700 1 -- 172.21.15.157:0/3235840695 >> 172.21.15.157:0/3235840695 conn(0x7fc2a40f8560 msgr2=0x7fc2a40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:22.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.094+0000 7fc2a9c00700 1 -- 172.21.15.157:0/3235840695 shutdown_connections 2024-04-03T08:39:22.095 INFO:tasks.workunit.client.0.smithi157.stdout:9/558: write d1/d94/f73 [922323,28062] 0 2024-04-03T08:39:22.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.094+0000 7fc2a9c00700 1 -- 172.21.15.157:0/3235840695 wait complete. 2024-04-03T08:39:22.096 INFO:tasks.workunit.client.1.smithi181.stdout:2/487: mknod d13/d1c/d4a/d68/d72/da1/cb6 0 2024-04-03T08:39:22.098 INFO:tasks.workunit.client.0.smithi157.stdout:3/554: truncate d8/d13/d1b/d4e/f99 558461 0 2024-04-03T08:39:22.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.096+0000 7fc2a9c00700 1 Processor -- start 2024-04-03T08:39:22.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.097+0000 7fc2a9c00700 1 -- start start 2024-04-03T08:39:22.099 INFO:tasks.workunit.client.0.smithi157.stdout:6/631: creat d1/d5/d17/d2a/fd4 x:0 0 0 2024-04-03T08:39:22.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.099+0000 7fc2a9c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 0x7fc2a4113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:22.101 INFO:tasks.workunit.client.1.smithi181.stdout:6/455: getdents d6/d31/d36/d73 0 2024-04-03T08:39:22.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.099+0000 7fc2a9c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2a40fe0d0 0x7fc2a41144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:22.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.099+0000 7fc2a9c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4114af0 con 0x7fc2a40fe0d0 2024-04-03T08:39:22.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.099+0000 7fc2a9c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4115340 con 0x7fc2a40fcee0 2024-04-03T08:39:22.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.099+0000 7fc2a2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 0x7fc2a4113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:22.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.099+0000 7fc2a2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 0x7fc2a4113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:56934/0 (socket says 172.21.15.157:56934) 2024-04-03T08:39:22.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.100+0000 7fc2a2a00700 1 -- 172.21.15.157:0/1252402613 learned_addr learned my addr 172.21.15.157:0/1252402613 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:22.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.100+0000 7fc2a2a00700 1 -- 172.21.15.157:0/1252402613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2a40fe0d0 msgr2=0x7fc2a41144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:22.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.100+0000 7fc2a2a00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2a40fe0d0 0x7fc2a41144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.100+0000 7fc2a2a00700 1 -- 172.21.15.157:0/1252402613 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290005040 con 0x7fc2a40fcee0 2024-04-03T08:39:22.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.100+0000 7fc2a2a00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 0x7fc2a4113fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc294002a80 tx=0x7fc2940046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:22.103 INFO:tasks.workunit.client.0.smithi157.stdout:8/629: mknod d2/d11/cd5 0 2024-04-03T08:39:22.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.101+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc294007cc0 con 0x7fc2a40fcee0 2024-04-03T08:39:22.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.101+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a4115620 con 0x7fc2a40fcee0 2024-04-03T08:39:22.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.101+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a4115b60 con 0x7fc2a40fcee0 2024-04-03T08:39:22.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.102+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc29400f040 con 0x7fc2a40fcee0 2024-04-03T08:39:22.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.102+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc294009610 con 0x7fc2a40fcee0 2024-04-03T08:39:22.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.103+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7fc294009770 con 0x7fc2a40fcee0 2024-04-03T08:39:22.105 INFO:tasks.workunit.client.0.smithi157.stdout:3/555: dread - d8/d1e/d2d/d3f/d4d/d8f/fa2 zero size 2024-04-03T08:39:22.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.104+0000 7fc29aa00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc288038ab0 0x7fc28803af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:22.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.104+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc29404c3b0 con 0x7fc2a40fcee0 2024-04-03T08:39:22.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.105+0000 7fc2a2000700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc288038ab0 0x7fc28803af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:22.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.105+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2840052e0 con 0x7fc2a40fcee0 2024-04-03T08:39:22.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.106+0000 7fc2a2000700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc288038ab0 0x7fc28803af60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc29000b370 tx=0x7fc290009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:22.109 INFO:tasks.workunit.client.0.smithi157.stdout:0/591: write d2/f15 [3911780,83316] 0 2024-04-03T08:39:22.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.112+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc29401c4e0 con 0x7fc2a40fcee0 2024-04-03T08:39:22.115 INFO:tasks.workunit.client.0.smithi157.stdout:7/641: rename d0/d11/f74 to d0/d11/d6f/fe9 0 2024-04-03T08:39:22.115 INFO:tasks.workunit.client.0.smithi157.stdout:0/592: chown d2/d9/dc/dbe 34 1 2024-04-03T08:39:22.117 INFO:tasks.workunit.client.1.smithi181.stdout:1/423: mknod d10/c84 0 2024-04-03T08:39:22.119 INFO:tasks.workunit.client.0.smithi157.stdout:0/593: fdatasync d2/d9/d51/f7f 0 2024-04-03T08:39:22.121 INFO:tasks.workunit.client.1.smithi181.stdout:7/393: link d0/d1/d6/de/c34 d0/d1/d6/de/d6d/d8b/c90 0 2024-04-03T08:39:22.121 INFO:tasks.workunit.client.0.smithi157.stdout:7/642: write d0/d11/d15/d17/d52/db6/fc7 [11376,61576] 0 2024-04-03T08:39:22.121 INFO:tasks.workunit.client.1.smithi181.stdout:7/394: chown d0/d1 4699182 1 2024-04-03T08:39:22.123 INFO:tasks.workunit.client.1.smithi181.stdout:3/457: mkdir d0/d5/d6/dd/d5f/d95 0 2024-04-03T08:39:22.126 INFO:tasks.workunit.client.1.smithi181.stdout:4/509: rmdir d1/d16 39 2024-04-03T08:39:22.128 INFO:tasks.workunit.client.0.smithi157.stdout:7/643: chown d0/d11/d15/f1f 1042701900 1 2024-04-03T08:39:22.129 INFO:tasks.workunit.client.0.smithi157.stdout:6/632: creat d1/d4b/d38/d59/fd5 x:0 0 0 2024-04-03T08:39:22.132 INFO:tasks.workunit.client.0.smithi157.stdout:7/644: write d0/d11/f71 [2559321,48753] 0 2024-04-03T08:39:22.133 INFO:tasks.workunit.client.0.smithi157.stdout:5/641: rename dc/d29/d51/lbd to dc/d29/d43/da1/ld8 0 2024-04-03T08:39:22.134 INFO:tasks.workunit.client.1.smithi181.stdout:5/447: creat d4/d80/f8e x:0 0 0 2024-04-03T08:39:22.135 INFO:tasks.workunit.client.0.smithi157.stdout:6/633: fdatasync d1/d5/f1a 0 2024-04-03T08:39:22.137 INFO:tasks.workunit.client.1.smithi181.stdout:9/504: rename d1/da/d1a/c55 to d1/da/d13/d22/d23/d36/d91/d9d/d39/c9f 0 2024-04-03T08:39:22.151 INFO:tasks.workunit.client.0.smithi157.stdout:8/630: dwrite d2/d11/d10/d24/d5b/d2e/d75/d81/fd0 [0,4194304] 0 2024-04-03T08:39:22.152 INFO:tasks.workunit.client.0.smithi157.stdout:3/556: dwrite d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:22.153 INFO:tasks.workunit.client.0.smithi157.stdout:1/547: dread d2/d11/d24/d39/d3b/d1b/f4e [0,4194304] 0 2024-04-03T08:39:22.154 INFO:tasks.workunit.client.0.smithi157.stdout:9/559: link d1/d36/f3b d1/d15/d27/d34/da6/fc5 0 2024-04-03T08:39:22.156 INFO:tasks.workunit.client.1.smithi181.stdout:2/488: creat d13/da7/d27/d2f/dae/fb7 x:0 0 0 2024-04-03T08:39:22.157 INFO:tasks.workunit.client.0.smithi157.stdout:8/631: write d2/f39 [3391693,65402] 0 2024-04-03T08:39:22.157 INFO:tasks.workunit.client.0.smithi157.stdout:7/645: fsync d0/d4/f2d 0 2024-04-03T08:39:22.161 INFO:tasks.workunit.client.0.smithi157.stdout:3/557: fdatasync d8/d13/fb0 0 2024-04-03T08:39:22.161 INFO:tasks.workunit.client.0.smithi157.stdout:2/585: truncate d3/db/f31 652722 0 2024-04-03T08:39:22.169 INFO:tasks.workunit.client.1.smithi181.stdout:2/489: dread f12 [0,4194304] 0 2024-04-03T08:39:22.171 INFO:tasks.workunit.client.1.smithi181.stdout:2/490: truncate d13/d1c/f99 196036 0 2024-04-03T08:39:22.173 INFO:tasks.workunit.client.1.smithi181.stdout:8/387: creat d4/d44/f82 x:0 0 0 2024-04-03T08:39:22.175 INFO:tasks.workunit.client.1.smithi181.stdout:8/388: truncate d4/fc 4289008 0 2024-04-03T08:39:22.176 INFO:tasks.workunit.client.1.smithi181.stdout:5/448: creat d4/d18/d55/d5a/f8f x:0 0 0 2024-04-03T08:39:22.182 INFO:tasks.workunit.client.0.smithi157.stdout:9/560: creat d1/d15/d16/fc6 x:0 0 0 2024-04-03T08:39:22.185 INFO:tasks.workunit.client.1.smithi181.stdout:1/424: fdatasync d10/d15/d41/f83 0 2024-04-03T08:39:22.185 INFO:tasks.workunit.client.0.smithi157.stdout:6/634: dread d1/d5/d17/d29/d62/f98 [0,4194304] 0 2024-04-03T08:39:22.187 INFO:tasks.workunit.client.1.smithi181.stdout:1/425: write d10/d15/d41/f44 [2701638,98100] 0 2024-04-03T08:39:22.188 INFO:tasks.workunit.client.1.smithi181.stdout:0/448: getdents d5 0 2024-04-03T08:39:22.190 INFO:tasks.workunit.client.0.smithi157.stdout:8/632: creat d2/d11/d10/d24/d5b/d2e/d75/d81/fd6 x:0 0 0 2024-04-03T08:39:22.190 INFO:tasks.workunit.client.0.smithi157.stdout:2/586: symlink d3/d12/d43/ld3 0 2024-04-03T08:39:22.191 INFO:tasks.workunit.client.1.smithi181.stdout:0/449: chown d5/d9/d2a/f64 52 1 2024-04-03T08:39:22.192 INFO:tasks.workunit.client.0.smithi157.stdout:3/558: truncate d8/d13/d1b/d37/f97 441668 0 2024-04-03T08:39:22.196 INFO:tasks.workunit.client.0.smithi157.stdout:3/559: write d8/d13/d1b/d4e/f99 [969548,4522] 0 2024-04-03T08:39:22.197 INFO:tasks.workunit.client.1.smithi181.stdout:2/491: unlink d13/f35 0 2024-04-03T08:39:22.201 INFO:tasks.workunit.client.1.smithi181.stdout:5/449: unlink d4/d18/d25/d6e/f7e 0 2024-04-03T08:39:22.203 INFO:tasks.workunit.client.1.smithi181.stdout:9/505: dread d1/da/d13/d41/d32/f67 [0,4194304] 0 2024-04-03T08:39:22.204 INFO:tasks.workunit.client.1.smithi181.stdout:8/389: rename d4/d2a/f48 to d4/d2a/f83 0 2024-04-03T08:39:22.207 INFO:tasks.workunit.client.0.smithi157.stdout:8/633: readlink d2/d11/d10/d24/d5b/l4c 0 2024-04-03T08:39:22.208 INFO:tasks.workunit.client.1.smithi181.stdout:2/492: dread d13/d1c/d4a/d7f/f89 [0,4194304] 0 2024-04-03T08:39:22.208 INFO:tasks.workunit.client.0.smithi157.stdout:0/594: dwrite d2/d9/dc/df/d9b/f6e [0,4194304] 0 2024-04-03T08:39:22.209 INFO:tasks.workunit.client.0.smithi157.stdout:6/635: mkdir d1/d4b/d61/d92/dd6 0 2024-04-03T08:39:22.210 INFO:tasks.workunit.client.1.smithi181.stdout:3/458: write d0/d17/f2e [744522,24032] 0 2024-04-03T08:39:22.212 INFO:tasks.workunit.client.0.smithi157.stdout:2/587: creat d3/db/d44/d4c/d5a/fd4 x:0 0 0 2024-04-03T08:39:22.213 INFO:tasks.workunit.client.1.smithi181.stdout:1/426: readlink d10/d15/d17/l49 0 2024-04-03T08:39:22.214 INFO:tasks.workunit.client.1.smithi181.stdout:0/450: dread - d5/d9/f32 zero size 2024-04-03T08:39:22.217 INFO:tasks.workunit.client.1.smithi181.stdout:6/456: getdents d6/d3e/d5e/d7c/d9/d22 0 2024-04-03T08:39:22.221 INFO:tasks.workunit.client.0.smithi157.stdout:1/548: rmdir d2/d11/d24/d7a 0 2024-04-03T08:39:22.224 INFO:tasks.workunit.client.0.smithi157.stdout:7/646: creat d0/d11/d6f/d89/fea x:0 0 0 2024-04-03T08:39:22.226 INFO:tasks.workunit.client.1.smithi181.stdout:7/395: rename d0/d1/d6/de/d57/l8c to d0/d1/d6/de/l91 0 2024-04-03T08:39:22.229 INFO:tasks.workunit.client.0.smithi157.stdout:7/647: stat d0/d11/d15/d17/d9f/ld1 0 2024-04-03T08:39:22.231 INFO:tasks.workunit.client.1.smithi181.stdout:1/427: dwrite d10/d15/d17/d37/f56 [0,4194304] 0 2024-04-03T08:39:22.234 INFO:tasks.workunit.client.1.smithi181.stdout:6/457: truncate d6/d3e/d5e/d7c/d9/f1a 4822646 0 2024-04-03T08:39:22.234 INFO:tasks.workunit.client.1.smithi181.stdout:1/428: dread - d10/d15/d17/d30/f65 zero size 2024-04-03T08:39:22.234 INFO:tasks.workunit.client.0.smithi157.stdout:3/560: mknod d8/d13/d1b/cc5 0 2024-04-03T08:39:22.235 INFO:tasks.workunit.client.0.smithi157.stdout:3/561: fdatasync d8/d1e/fb9 0 2024-04-03T08:39:22.237 INFO:tasks.workunit.client.0.smithi157.stdout:9/561: rmdir d1/d36/da3 0 2024-04-03T08:39:22.241 INFO:tasks.workunit.client.0.smithi157.stdout:9/562: chown d1/d15/d16/fc6 202206 1 2024-04-03T08:39:22.241 INFO:tasks.workunit.client.0.smithi157.stdout:9/563: chown d1/d15 1 1 2024-04-03T08:39:22.243 INFO:tasks.workunit.client.1.smithi181.stdout:5/450: rename d4/d18/d25/d6e to d4/d18/d25/d59/d81/d90 0 2024-04-03T08:39:22.249 INFO:tasks.workunit.client.1.smithi181.stdout:3/459: truncate d0/d5/fa 1178465 0 2024-04-03T08:39:22.250 INFO:tasks.workunit.client.0.smithi157.stdout:0/595: fsync d2/d9/dc/df/d1b/d35/f66 0 2024-04-03T08:39:22.252 INFO:tasks.workunit.client.1.smithi181.stdout:8/390: link d4/d45/db/d5c/d5e/l6a d4/d45/db/d14/l84 0 2024-04-03T08:39:22.254 INFO:tasks.workunit.client.0.smithi157.stdout:1/549: mknod d2/d11/d24/cb3 0 2024-04-03T08:39:22.258 INFO:tasks.workunit.client.0.smithi157.stdout:9/564: mkdir d1/d15/d27/d34/dc7 0 2024-04-03T08:39:22.259 INFO:tasks.workunit.client.1.smithi181.stdout:7/396: rename d0/d1/d6/l35 to d0/d1/d6/de/d17/d64/d85/d87/l92 0 2024-04-03T08:39:22.265 INFO:tasks.workunit.client.0.smithi157.stdout:3/562: dwrite d8/d13/d1b/d4e/da6/f89 [0,4194304] 0 2024-04-03T08:39:22.266 INFO:tasks.workunit.client.1.smithi181.stdout:5/451: mkdir d4/d18/d55/d5a/d91 0 2024-04-03T08:39:22.269 INFO:tasks.workunit.client.0.smithi157.stdout:7/648: dwrite d0/d11/d15/d17/d43/d8a/f94 [0,4194304] 0 2024-04-03T08:39:22.270 INFO:tasks.workunit.client.0.smithi157.stdout:6/636: rename d1/d4b/d38/f4c to d1/d5/d17/fd7 0 2024-04-03T08:39:22.274 INFO:tasks.workunit.client.1.smithi181.stdout:3/460: mknod d0/d57/c96 0 2024-04-03T08:39:22.275 INFO:tasks.workunit.client.1.smithi181.stdout:9/506: dwrite d1/f6 [4194304,4194304] 0 2024-04-03T08:39:22.276 INFO:tasks.workunit.client.0.smithi157.stdout:8/634: write d2/d11/d10/d24/d5b/d2e/f58 [3425537,69513] 0 2024-04-03T08:39:22.276 INFO:tasks.workunit.client.1.smithi181.stdout:3/461: dread - d0/d17/d63/f76 zero size 2024-04-03T08:39:22.278 INFO:tasks.workunit.client.1.smithi181.stdout:6/458: mknod d6/d53/d8d/c8f 0 2024-04-03T08:39:22.279 INFO:tasks.workunit.client.0.smithi157.stdout:7/649: chown d0/d11/d6f/d89/d8c 31322 1 2024-04-03T08:39:22.279 INFO:tasks.workunit.client.1.smithi181.stdout:2/493: write d13/d1c/f63 [2342086,8036] 0 2024-04-03T08:39:22.281 INFO:tasks.workunit.client.1.smithi181.stdout:8/391: creat d4/d45/db/d14/d31/d1c/f85 x:0 0 0 2024-04-03T08:39:22.285 INFO:tasks.workunit.client.0.smithi157.stdout:1/550: mkdir d2/d11/d24/d39/d3b/d2e/d48/d5d/db4 0 2024-04-03T08:39:22.290 INFO:tasks.workunit.client.1.smithi181.stdout:7/397: rename d0/d1/d6/de/d6d/d8b to d0/d1/d6/de/d17/d27/d93 0 2024-04-03T08:39:22.290 INFO:tasks.workunit.client.0.smithi157.stdout:3/563: fsync d8/f11 0 2024-04-03T08:39:22.291 INFO:tasks.workunit.client.1.smithi181.stdout:7/398: stat d0/d1/d6/de/d6d/f6e 0 2024-04-03T08:39:22.293 INFO:tasks.workunit.client.1.smithi181.stdout:7/399: write d0/f3e [856790,28248] 0 2024-04-03T08:39:22.299 INFO:tasks.workunit.client.0.smithi157.stdout:4/584: sync 2024-04-03T08:39:22.301 INFO:tasks.workunit.client.0.smithi157.stdout:5/642: sync 2024-04-03T08:39:22.302 INFO:tasks.workunit.client.0.smithi157.stdout:6/637: mknod d1/d5/d17/d29/da3/cd8 0 2024-04-03T08:39:22.303 INFO:tasks.workunit.client.1.smithi181.stdout:3/462: creat d0/d17/d36/d3b/d5a/f97 x:0 0 0 2024-04-03T08:39:22.305 INFO:tasks.workunit.client.0.smithi157.stdout:8/635: creat d2/d20/db1/fd7 x:0 0 0 2024-04-03T08:39:22.308 INFO:tasks.workunit.client.1.smithi181.stdout:1/429: dwrite d10/d15/d17/d19/f40 [0,4194304] 0 2024-04-03T08:39:22.311 INFO:tasks.workunit.client.0.smithi157.stdout:7/650: read d0/f20 [2004609,93968] 0 2024-04-03T08:39:22.315 INFO:tasks.workunit.client.1.smithi181.stdout:5/452: creat d4/d44/f92 x:0 0 0 2024-04-03T08:39:22.318 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:21 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2212906800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:39:22.318 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:21 smithi157 ceph-mon[35083]: from='client.24543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:22.318 INFO:tasks.workunit.client.1.smithi181.stdout:4/510: sync 2024-04-03T08:39:22.319 INFO:tasks.workunit.client.1.smithi181.stdout:5/453: chown d4/d18/d25/d59/d81/d90/l84 0 1 2024-04-03T08:39:22.320 INFO:tasks.workunit.client.0.smithi157.stdout:4/585: unlink da/df/d24/d35/f80 0 2024-04-03T08:39:22.324 INFO:tasks.workunit.client.0.smithi157.stdout:5/643: rmdir dc/d29/d56/da4 39 2024-04-03T08:39:22.328 INFO:tasks.workunit.client.1.smithi181.stdout:3/463: creat d0/d5/d6/dd/d5f/f98 x:0 0 0 2024-04-03T08:39:22.333 INFO:tasks.workunit.client.0.smithi157.stdout:5/644: write dc/d29/d56/d18/fab [95403,17812] 0 2024-04-03T08:39:22.334 INFO:tasks.workunit.client.0.smithi157.stdout:8/636: mknod d2/cd8 0 2024-04-03T08:39:22.339 INFO:tasks.workunit.client.0.smithi157.stdout:6/638: mkdir d1/d4b/da5/dd9 0 2024-04-03T08:39:22.339 INFO:tasks.workunit.client.1.smithi181.stdout:1/430: mknod d10/d15/d4b/c85 0 2024-04-03T08:39:22.343 INFO:tasks.workunit.client.0.smithi157.stdout:7/651: mkdir d0/d11/d6f/d89/d8c/deb 0 2024-04-03T08:39:22.343 INFO:tasks.workunit.client.0.smithi157.stdout:2/588: dwrite d3/db/f31 [0,4194304] 0 2024-04-03T08:39:22.346 INFO:tasks.workunit.client.1.smithi181.stdout:7/400: mkdir d0/d1/d94 0 2024-04-03T08:39:22.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:21 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2212906800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:39:22.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:21 smithi181 ceph-mon[44183]: from='client.24543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:22.347 INFO:tasks.workunit.client.1.smithi181.stdout:7/401: readlink d0/d1/d6/l58 0 2024-04-03T08:39:22.349 INFO:tasks.workunit.client.0.smithi157.stdout:0/596: getdents d2/d9/d5f 0 2024-04-03T08:39:22.349 INFO:tasks.workunit.client.1.smithi181.stdout:8/392: dread d4/d44/d59/d5f/d6c/f81 [0,4194304] 0 2024-04-03T08:39:22.357 INFO:tasks.workunit.client.1.smithi181.stdout:9/507: truncate d1/da/d13/d22/f8d 2546520 0 2024-04-03T08:39:22.362 INFO:tasks.workunit.client.1.smithi181.stdout:1/431: read d10/f22 [1778726,115947] 0 2024-04-03T08:39:22.365 INFO:tasks.workunit.client.1.smithi181.stdout:6/459: creat d6/d3e/d5e/f90 x:0 0 0 2024-04-03T08:39:22.367 INFO:tasks.workunit.client.0.smithi157.stdout:9/565: dwrite d1/d15/d16/f3a [0,4194304] 0 2024-04-03T08:39:22.369 INFO:tasks.workunit.client.0.smithi157.stdout:6/639: symlink d1/d5/d17/d2a/d73/lda 0 2024-04-03T08:39:22.369 INFO:tasks.workunit.client.1.smithi181.stdout:1/432: chown d10/d15/d41/c42 261435569 1 2024-04-03T08:39:22.369 INFO:tasks.workunit.client.0.smithi157.stdout:4/586: dwrite da/df/d2f/d64/d8f/dbd/fa4 [0,4194304] 0 2024-04-03T08:39:22.373 INFO:tasks.workunit.client.0.smithi157.stdout:9/566: chown d1/d4a/l83 58360720 1 2024-04-03T08:39:22.375 INFO:tasks.workunit.client.0.smithi157.stdout:9/567: chown d1/d15/d16/c41 14 1 2024-04-03T08:39:22.378 INFO:tasks.workunit.client.0.smithi157.stdout:1/551: creat d2/d11/d24/d39/d3b/fb5 x:0 0 0 2024-04-03T08:39:22.384 INFO:tasks.workunit.client.0.smithi157.stdout:2/589: mknod d3/d2e/d32/d9f/dbd/cd5 0 2024-04-03T08:39:22.387 INFO:tasks.workunit.client.1.smithi181.stdout:5/454: unlink d4/l1d 0 2024-04-03T08:39:22.388 INFO:tasks.workunit.client.0.smithi157.stdout:3/564: creat d8/d1e/d2d/fc6 x:0 0 0 2024-04-03T08:39:22.388 INFO:tasks.workunit.client.1.smithi181.stdout:9/508: mknod d1/da/d28/d80/ca0 0 2024-04-03T08:39:22.395 INFO:tasks.workunit.client.1.smithi181.stdout:3/464: truncate d0/d5/fa 264190 0 2024-04-03T08:39:22.400 INFO:tasks.workunit.client.1.smithi181.stdout:1/433: write d10/f16 [135325,79431] 0 2024-04-03T08:39:22.401 INFO:tasks.workunit.client.0.smithi157.stdout:1/552: symlink d2/d11/d24/d39/d3b/d2e/d66/d91/d97/lb6 0 2024-04-03T08:39:22.402 INFO:tasks.workunit.client.1.smithi181.stdout:6/460: truncate d6/d3e/d5e/d7c/d9/d22/d4f/f66 95463 0 2024-04-03T08:39:22.405 INFO:tasks.workunit.client.0.smithi157.stdout:3/565: creat d8/d13/d1b/d5b/fc7 x:0 0 0 2024-04-03T08:39:22.405 INFO:tasks.workunit.client.0.smithi157.stdout:2/590: mknod d3/db/d44/d4c/d5a/cd6 0 2024-04-03T08:39:22.408 INFO:tasks.workunit.client.0.smithi157.stdout:7/652: rename d0/d11/d15/d17/d9f/daa/cae to d0/d4/cec 0 2024-04-03T08:39:22.411 INFO:tasks.workunit.client.1.smithi181.stdout:3/465: dwrite d0/d17/d36/d1e/f7e [0,4194304] 0 2024-04-03T08:39:22.412 INFO:tasks.workunit.client.0.smithi157.stdout:5/645: dread f7 [0,4194304] 0 2024-04-03T08:39:22.413 INFO:tasks.workunit.client.1.smithi181.stdout:3/466: fdatasync d0/d5/d6/d32/d43/f8a 0 2024-04-03T08:39:22.414 INFO:tasks.workunit.client.1.smithi181.stdout:3/467: read - d0/d17/d63/d81/f94 zero size 2024-04-03T08:39:22.417 INFO:tasks.workunit.client.0.smithi157.stdout:1/553: creat d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/fb7 x:0 0 0 2024-04-03T08:39:22.420 INFO:tasks.workunit.client.1.smithi181.stdout:0/451: sync 2024-04-03T08:39:22.420 INFO:tasks.workunit.client.1.smithi181.stdout:1/434: truncate d10/d15/d17/d23/d27/f3a 4642924 0 2024-04-03T08:39:22.424 INFO:tasks.workunit.client.0.smithi157.stdout:2/591: symlink d3/d2e/d32/ld7 0 2024-04-03T08:39:22.425 INFO:tasks.workunit.client.1.smithi181.stdout:5/455: mkdir d4/d22/d72/d93 0 2024-04-03T08:39:22.426 INFO:tasks.workunit.client.1.smithi181.stdout:1/435: write d10/d15/d17/d30/f79 [897232,115936] 0 2024-04-03T08:39:22.428 INFO:tasks.workunit.client.0.smithi157.stdout:2/592: dread - d3/d2e/d65/fc2 zero size 2024-04-03T08:39:22.429 INFO:tasks.workunit.client.1.smithi181.stdout:5/456: fsync d4/d18/d25/f3c 0 2024-04-03T08:39:22.432 INFO:tasks.workunit.client.0.smithi157.stdout:0/597: rename d2/d9/dc/df/d1b/f8b to d2/d9/d51/fdb 0 2024-04-03T08:39:22.434 INFO:tasks.workunit.client.1.smithi181.stdout:1/436: chown d10/d15/d17/d19/d4c/d66 17252475 1 2024-04-03T08:39:22.435 INFO:tasks.workunit.client.1.smithi181.stdout:9/509: getdents d1/da/d13/d22/d23/d36/d9c 0 2024-04-03T08:39:22.439 INFO:tasks.workunit.client.1.smithi181.stdout:5/457: truncate d4/d18/f83 1426393 0 2024-04-03T08:39:22.449 INFO:tasks.workunit.client.1.smithi181.stdout:0/452: dwrite d5/f74 [0,4194304] 0 2024-04-03T08:39:22.452 INFO:tasks.workunit.client.0.smithi157.stdout:8/637: dread d2/d11/d10/d24/d5b/d2e/d75/faa [0,4194304] 0 2024-04-03T08:39:22.453 INFO:tasks.workunit.client.1.smithi181.stdout:3/468: dwrite d0/d17/f6e [0,4194304] 0 2024-04-03T08:39:22.456 INFO:tasks.workunit.client.1.smithi181.stdout:4/511: dwrite d1/d16/d24/d5e/f4f [0,4194304] 0 2024-04-03T08:39:22.459 INFO:tasks.workunit.client.0.smithi157.stdout:3/566: mkdir d8/d1e/d2d/d3f/dc8 0 2024-04-03T08:39:22.464 INFO:tasks.workunit.client.0.smithi157.stdout:2/593: fsync d3/d2e/f83 0 2024-04-03T08:39:22.467 INFO:tasks.workunit.client.1.smithi181.stdout:0/453: read - d5/dc/d10/d30/f6f zero size 2024-04-03T08:39:22.467 INFO:tasks.workunit.client.1.smithi181.stdout:1/437: chown d10/f11 90 1 2024-04-03T08:39:22.469 INFO:tasks.workunit.client.1.smithi181.stdout:8/393: dwrite d4/d45/db/d14/d31/d1c/f2f [4194304,4194304] 0 2024-04-03T08:39:22.469 INFO:tasks.workunit.client.1.smithi181.stdout:7/402: dwrite d0/d1/d6/de/d17/f24 [0,4194304] 0 2024-04-03T08:39:22.469 INFO:tasks.workunit.client.1.smithi181.stdout:0/454: readlink d5/d9/l3f 0 2024-04-03T08:39:22.473 INFO:tasks.workunit.client.0.smithi157.stdout:6/640: dwrite d1/d5/d1b/f1c [4194304,4194304] 0 2024-04-03T08:39:22.476 INFO:tasks.workunit.client.1.smithi181.stdout:4/512: write d1/d16/d37/d34/f35 [3393599,3721] 0 2024-04-03T08:39:22.479 INFO:tasks.workunit.client.1.smithi181.stdout:1/438: truncate d10/d15/d17/d30/f7e 500253 0 2024-04-03T08:39:22.480 INFO:tasks.workunit.client.1.smithi181.stdout:4/513: write d1/d16/f54 [86929,109496] 0 2024-04-03T08:39:22.482 INFO:tasks.workunit.client.1.smithi181.stdout:9/510: creat d1/da/d28/d80/fa1 x:0 0 0 2024-04-03T08:39:22.483 INFO:tasks.workunit.client.1.smithi181.stdout:1/439: write d10/d15/f34 [8742312,100074] 0 2024-04-03T08:39:22.487 INFO:tasks.workunit.client.1.smithi181.stdout:4/514: dread - d1/d16/d24/d5e/d3f/f6b zero size 2024-04-03T08:39:22.488 INFO:tasks.workunit.client.1.smithi181.stdout:1/440: write d10/d15/d17/d19/f68 [4851946,520] 0 2024-04-03T08:39:22.490 INFO:tasks.workunit.client.1.smithi181.stdout:4/515: chown d1/d16/d37/f7d 44 1 2024-04-03T08:39:22.491 INFO:tasks.workunit.client.1.smithi181.stdout:1/441: write d10/d15/d17/d19/d33/f64 [289437,59242] 0 2024-04-03T08:39:22.493 INFO:tasks.workunit.client.1.smithi181.stdout:5/458: creat d4/d18/d25/d59/d81/d90/f94 x:0 0 0 2024-04-03T08:39:22.496 INFO:tasks.workunit.client.1.smithi181.stdout:2/494: sync 2024-04-03T08:39:22.507 INFO:tasks.workunit.client.0.smithi157.stdout:4/587: getdents da/df/d2f/d64/d8f 0 2024-04-03T08:39:22.517 INFO:tasks.workunit.client.1.smithi181.stdout:6/461: sync 2024-04-03T08:39:22.519 INFO:tasks.workunit.client.0.smithi157.stdout:3/567: creat d8/d13/d1b/d4e/d50/fc9 x:0 0 0 2024-04-03T08:39:22.526 INFO:tasks.workunit.client.0.smithi157.stdout:7/653: creat d0/d11/fed x:0 0 0 2024-04-03T08:39:22.529 INFO:tasks.workunit.client.0.smithi157.stdout:1/554: creat d2/d11/d24/fb8 x:0 0 0 2024-04-03T08:39:22.531 INFO:tasks.workunit.client.0.smithi157.stdout:1/555: fdatasync d2/d11/f98 0 2024-04-03T08:39:22.535 INFO:tasks.workunit.client.0.smithi157.stdout:2/594: symlink d3/ld8 0 2024-04-03T08:39:22.538 INFO:tasks.workunit.client.0.smithi157.stdout:2/595: write d3/db/d44/d4c/d5a/fbb [632603,59609] 0 2024-04-03T08:39:22.542 INFO:tasks.workunit.client.0.smithi157.stdout:0/598: rename d2/f37 to d2/d9/dc/df/fdc 0 2024-04-03T08:39:22.547 INFO:tasks.workunit.client.0.smithi157.stdout:6/641: creat d1/d5/d17/d2a/d30/d77/fdb x:0 0 0 2024-04-03T08:39:22.551 INFO:tasks.workunit.client.0.smithi157.stdout:1/556: dwrite d2/d11/d23/f4f [0,4194304] 0 2024-04-03T08:39:22.559 INFO:tasks.workunit.client.0.smithi157.stdout:4/588: link da/df/d2f/f38 da/df/d24/d35/d53/d69/fca 0 2024-04-03T08:39:22.559 INFO:tasks.workunit.client.0.smithi157.stdout:7/654: mkdir d0/d11/d15/d17/d43/d8a/d8f/dee 0 2024-04-03T08:39:22.566 INFO:tasks.workunit.client.0.smithi157.stdout:7/655: write d0/d11/d15/d17/d52/db6/fc7 [23689,86190] 0 2024-04-03T08:39:22.577 INFO:tasks.workunit.client.0.smithi157.stdout:5/646: dwrite dc/f59 [0,4194304] 0 2024-04-03T08:39:22.577 INFO:tasks.workunit.client.0.smithi157.stdout:3/568: rename d8/d1e/d2d/d39/l77 to d8/d1e/d2d/d3f/dc8/lca 0 2024-04-03T08:39:22.581 INFO:tasks.workunit.client.0.smithi157.stdout:8/638: getdents d2/d6f/d70/d89/d59/dc1 0 2024-04-03T08:39:22.583 INFO:tasks.workunit.client.0.smithi157.stdout:9/568: sync 2024-04-03T08:39:22.584 INFO:tasks.workunit.client.0.smithi157.stdout:4/589: symlink da/df/d24/lcb 0 2024-04-03T08:39:22.588 INFO:tasks.workunit.client.0.smithi157.stdout:3/569: dread - d8/d1e/d2d/d3b/d8c/db4/fbd zero size 2024-04-03T08:39:22.590 INFO:tasks.workunit.client.0.smithi157.stdout:9/569: chown d1/dab/dad 138636 1 2024-04-03T08:39:22.592 INFO:tasks.workunit.client.0.smithi157.stdout:4/590: write da/fad [703786,107967] 0 2024-04-03T08:39:22.594 INFO:tasks.workunit.client.1.smithi181.stdout:0/455: truncate d5/d9/f1d 3054250 0 2024-04-03T08:39:22.597 INFO:tasks.workunit.client.0.smithi157.stdout:2/596: creat d3/db/fd9 x:0 0 0 2024-04-03T08:39:22.599 INFO:tasks.workunit.client.0.smithi157.stdout:6/642: dread d1/d5/d1b/f65 [0,4194304] 0 2024-04-03T08:39:22.605 INFO:tasks.workunit.client.0.smithi157.stdout:1/557: dwrite d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/fb7 [0,4194304] 0 2024-04-03T08:39:22.609 INFO:tasks.workunit.client.0.smithi157.stdout:5/647: creat dc/d29/d56/d18/fd9 x:0 0 0 2024-04-03T08:39:22.611 INFO:tasks.workunit.client.0.smithi157.stdout:1/558: stat d2/d11/d24/d39/d3b/d2e/l5b 0 2024-04-03T08:39:22.614 INFO:tasks.workunit.client.0.smithi157.stdout:0/599: dwrite d2/d9/d36/d38/fa7 [0,4194304] 0 2024-04-03T08:39:22.617 INFO:tasks.workunit.client.0.smithi157.stdout:1/559: chown d2/d11/d24/d39/d3b/d2e/d48/d58 298 1 2024-04-03T08:39:22.631 INFO:tasks.workunit.client.1.smithi181.stdout:2/495: read d13/d1c/d4a/d68/f6f [399871,118470] 0 2024-04-03T08:39:22.632 INFO:tasks.workunit.client.0.smithi157.stdout:6/643: mknod d1/d5/d17/d29/d80/cdc 0 2024-04-03T08:39:22.639 INFO:tasks.workunit.client.0.smithi157.stdout:8/639: dread d2/d11/d10/d24/d5b/d2e/f64 [0,4194304] 0 2024-04-03T08:39:22.639 INFO:tasks.workunit.client.0.smithi157.stdout:2/597: dread d3/d12/f24 [0,4194304] 0 2024-04-03T08:39:22.641 INFO:tasks.workunit.client.1.smithi181.stdout:3/469: mknod d0/d17/c99 0 2024-04-03T08:39:22.642 INFO:tasks.workunit.client.1.smithi181.stdout:3/470: fsync d0/d17/f82 0 2024-04-03T08:39:22.643 INFO:tasks.workunit.client.1.smithi181.stdout:6/462: creat d6/d53/f91 x:0 0 0 2024-04-03T08:39:22.644 INFO:tasks.workunit.client.1.smithi181.stdout:6/463: readlink d6/d31/d36/l41 0 2024-04-03T08:39:22.653 INFO:tasks.workunit.client.0.smithi157.stdout:5/648: dread dc/d29/f5f [0,4194304] 0 2024-04-03T08:39:22.653 INFO:tasks.workunit.client.1.smithi181.stdout:0/456: unlink d5/dc/d75/c89 0 2024-04-03T08:39:22.657 INFO:tasks.workunit.client.1.smithi181.stdout:3/471: dwrite d0/d5/d6/dd/d5f/f98 [0,4194304] 0 2024-04-03T08:39:22.662 INFO:tasks.workunit.client.0.smithi157.stdout:0/600: unlink d2/d9/dc/df/d6f/dad/dbb/fc3 0 2024-04-03T08:39:22.663 INFO:tasks.workunit.client.0.smithi157.stdout:4/591: dread da/df/d24/d35/d53/fa9 [0,4194304] 0 2024-04-03T08:39:22.674 INFO:tasks.workunit.client.0.smithi157.stdout:1/560: rename d2/d11/d24/d39/d3b/d2e/d48/d64/f9f to d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 0 2024-04-03T08:39:22.676 INFO:tasks.workunit.client.1.smithi181.stdout:1/442: mkdir d10/d15/d4a/d86 0 2024-04-03T08:39:22.676 INFO:tasks.workunit.client.0.smithi157.stdout:1/561: stat d2/d11/d24/d39/d3b/l19 0 2024-04-03T08:39:22.679 INFO:tasks.workunit.client.0.smithi157.stdout:7/656: stat d0/d11/d15/d17/d43/d8a/d8f/d5b 0 2024-04-03T08:39:22.679 INFO:tasks.workunit.client.1.smithi181.stdout:5/459: mknod d4/d44/d71/c95 0 2024-04-03T08:39:22.683 INFO:tasks.workunit.client.1.smithi181.stdout:4/516: getdents d1/d16/d24/d5e/d31/d39/d5d/d9a 0 2024-04-03T08:39:22.683 INFO:tasks.workunit.client.0.smithi157.stdout:6/644: creat d1/d5/d1b/fdd x:0 0 0 2024-04-03T08:39:22.685 INFO:tasks.workunit.client.1.smithi181.stdout:4/517: read d1/d16/f23 [10637,84974] 0 2024-04-03T08:39:22.685 INFO:tasks.workunit.client.0.smithi157.stdout:0/601: dwrite d2/d9/d36/fce [0,4194304] 0 2024-04-03T08:39:22.688 INFO:tasks.workunit.client.0.smithi157.stdout:1/562: read d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 [1592735,119117] 0 2024-04-03T08:39:22.689 INFO:tasks.workunit.client.1.smithi181.stdout:2/496: rename d13/da7/lb5 to d13/d1c/d6c/d7a/lb8 0 2024-04-03T08:39:22.691 INFO:tasks.workunit.client.0.smithi157.stdout:0/602: fsync d2/f15 0 2024-04-03T08:39:22.695 INFO:tasks.workunit.client.1.smithi181.stdout:6/464: mknod d6/d53/d8d/c92 0 2024-04-03T08:39:22.697 INFO:tasks.workunit.client.0.smithi157.stdout:1/563: chown d2/d11/d24/d39/d3b/d2e/d48/d58/lb0 125 1 2024-04-03T08:39:22.697 INFO:tasks.workunit.client.0.smithi157.stdout:9/570: getdents d1/d15/d27/d34 0 2024-04-03T08:39:22.704 INFO:tasks.workunit.client.1.smithi181.stdout:8/394: dwrite d4/d45/db/d14/d31/f43 [0,4194304] 0 2024-04-03T08:39:22.709 INFO:tasks.workunit.client.0.smithi157.stdout:4/592: fdatasync da/df/d24/d35/d53/d69/f9c 0 2024-04-03T08:39:22.711 INFO:tasks.workunit.client.1.smithi181.stdout:7/403: link d0/d1/d6/de/d57/c59 d0/d1/d6/de/d17/d27/c95 0 2024-04-03T08:39:22.713 INFO:tasks.workunit.client.1.smithi181.stdout:9/511: link d1/da/d28/d30/d3e/c43 d1/da/d28/d30/ca2 0 2024-04-03T08:39:22.716 INFO:tasks.workunit.client.1.smithi181.stdout:1/443: unlink d10/d15/d17/d23/d27/l28 0 2024-04-03T08:39:22.723 INFO:tasks.workunit.client.0.smithi157.stdout:6/645: symlink d1/d4b/d38/da6/lde 0 2024-04-03T08:39:22.727 INFO:tasks.workunit.client.0.smithi157.stdout:6/646: dread - d1/d5/d17/d2a/d30/d77/fdb zero size 2024-04-03T08:39:22.728 INFO:tasks.workunit.client.1.smithi181.stdout:4/518: chown d1/d1e/d2c/c33 3076507 1 2024-04-03T08:39:22.730 INFO:tasks.workunit.client.1.smithi181.stdout:1/444: dwrite d10/d15/d17/d19/f68 [8388608,4194304] 0 2024-04-03T08:39:22.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.729+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc284005860 con 0x7fc2a40fcee0 2024-04-03T08:39:22.731 INFO:tasks.workunit.client.1.smithi181.stdout:1/445: fsync d10/f16 0 2024-04-03T08:39:22.732 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:39:22.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.729+0000 7fc29aa00700 1 -- 172.21.15.157:0/1252402613 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc29403f090 con 0x7fc2a40fcee0 2024-04-03T08:39:22.732 INFO:tasks.workunit.client.0.smithi157.stdout:8/640: dwrite d2/d11/d10/d24/d5b/d2e/d75/f76 [0,4194304] 0 2024-04-03T08:39:22.735 INFO:tasks.workunit.client.1.smithi181.stdout:3/472: rename d0/d5/d6/dd/d25/c6c to d0/d5/d6/d32/c9a 0 2024-04-03T08:39:22.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.734+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc288038ab0 msgr2=0x7fc28803af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:22.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.734+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc288038ab0 0x7fc28803af60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc29000b370 tx=0x7fc290009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:22.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.734+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 msgr2=0x7fc2a4113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.734+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 0x7fc2a4113fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc294002a80 tx=0x7fc2940046b0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 shutdown_connections 2024-04-03T08:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc288038ab0 0x7fc28803af60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a40fcee0 0x7fc2a4113fb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 --2- 172.21.15.157:0/1252402613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2a40fe0d0 0x7fc2a41144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:22.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 >> 172.21.15.157:0/1252402613 conn(0x7fc2a40f8560 msgr2=0x7fc2a40f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:22.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 shutdown_connections 2024-04-03T08:39:22.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:22.735+0000 7fc2a9c00700 1 -- 172.21.15.157:0/1252402613 wait complete. 2024-04-03T08:39:22.739 INFO:tasks.workunit.client.1.smithi181.stdout:2/497: mknod d13/d1c/d4a/d68/cb9 0 2024-04-03T08:39:22.745 INFO:tasks.workunit.client.0.smithi157.stdout:9/571: unlink d1/d15/d27/d5c/f74 0 2024-04-03T08:39:22.750 INFO:tasks.workunit.client.1.smithi181.stdout:0/457: mknod d5/dc/d14/d29/c8a 0 2024-04-03T08:39:22.754 INFO:tasks.workunit.client.1.smithi181.stdout:7/404: mkdir d0/d1/d6/de/d6d/d96 0 2024-04-03T08:39:22.757 INFO:tasks.workunit.client.1.smithi181.stdout:9/512: mkdir d1/da/d28/d30/d3e/d4e/da3 0 2024-04-03T08:39:22.769 INFO:tasks.workunit.client.1.smithi181.stdout:7/405: dwrite d0/f3e [4194304,4194304] 0 2024-04-03T08:39:22.771 INFO:tasks.workunit.client.1.smithi181.stdout:7/406: stat d0/l71 0 2024-04-03T08:39:22.773 INFO:tasks.workunit.client.1.smithi181.stdout:1/446: dread - d10/d15/d41/f5d zero size 2024-04-03T08:39:22.773 INFO:tasks.workunit.client.1.smithi181.stdout:3/473: creat d0/d5/d6/d32/d43/f9b x:0 0 0 2024-04-03T08:39:22.773 INFO:tasks.workunit.client.1.smithi181.stdout:2/498: truncate d13/d1c/d4a/d7f/db3/f53 736759 0 2024-04-03T08:39:22.777 INFO:tasks.workunit.client.1.smithi181.stdout:0/458: creat d5/dc/d10/d58/f8b x:0 0 0 2024-04-03T08:39:22.779 INFO:tasks.workunit.client.1.smithi181.stdout:9/513: dread d1/da/d28/d30/d3e/d4e/f68 [0,4194304] 0 2024-04-03T08:39:22.781 INFO:tasks.workunit.client.1.smithi181.stdout:2/499: chown d13/da7/d40 7224251 1 2024-04-03T08:39:22.782 INFO:tasks.workunit.client.1.smithi181.stdout:7/407: dread - d0/d1/d6/de/d57/f6f zero size 2024-04-03T08:39:22.784 INFO:tasks.workunit.client.1.smithi181.stdout:6/465: dwrite d6/d3e/d5e/d7c/f85 [0,4194304] 0 2024-04-03T08:39:22.790 INFO:tasks.workunit.client.1.smithi181.stdout:5/460: dwrite d4/d18/d25/f3c [0,4194304] 0 2024-04-03T08:39:22.790 INFO:tasks.workunit.client.1.smithi181.stdout:6/466: write d6/d3e/d5e/d7c/d50/f61 [803970,68918] 0 2024-04-03T08:39:22.792 INFO:tasks.workunit.client.1.smithi181.stdout:7/408: truncate d0/d1/d6/de/d6d/f6e 334094 0 2024-04-03T08:39:22.794 INFO:tasks.workunit.client.1.smithi181.stdout:7/409: truncate d0/f5b 903628 0 2024-04-03T08:39:22.797 INFO:tasks.workunit.client.1.smithi181.stdout:8/395: creat d4/d45/d9/f86 x:0 0 0 2024-04-03T08:39:22.797 INFO:tasks.workunit.client.1.smithi181.stdout:4/519: write d1/d16/d24/d5e/d3f/d41/f42 [1742981,44392] 0 2024-04-03T08:39:22.799 INFO:tasks.workunit.client.0.smithi157.stdout:5/649: sync 2024-04-03T08:39:22.800 INFO:tasks.workunit.client.1.smithi181.stdout:7/410: stat d0/d1/d6/de/d17/d27/d93 0 2024-04-03T08:39:22.803 INFO:tasks.workunit.client.1.smithi181.stdout:7/411: stat d0/d1/d6/l45 0 2024-04-03T08:39:22.806 INFO:tasks.workunit.client.1.smithi181.stdout:2/500: mkdir d13/d1c/d4a/d68/dba 0 2024-04-03T08:39:22.806 INFO:tasks.workunit.client.1.smithi181.stdout:0/459: truncate d5/d9/d2e/f43 2199499 0 2024-04-03T08:39:22.810 INFO:tasks.workunit.client.1.smithi181.stdout:0/460: write d5/dc/d10/d58/f8b [1013663,25103] 0 2024-04-03T08:39:22.819 INFO:tasks.workunit.client.1.smithi181.stdout:6/467: rmdir d6/d3e/d5e/d7c/d9/d22/d4f 39 2024-04-03T08:39:22.821 INFO:tasks.workunit.client.0.smithi157.stdout:5/650: dwrite dc/d29/fa7 [0,4194304] 0 2024-04-03T08:39:22.822 INFO:tasks.workunit.client.1.smithi181.stdout:1/447: unlink d10/d15/d17/c20 0 2024-04-03T08:39:22.823 INFO:tasks.workunit.client.1.smithi181.stdout:4/520: truncate d1/d16/f23 1534441 0 2024-04-03T08:39:22.824 INFO:tasks.workunit.client.1.smithi181.stdout:6/468: fdatasync d6/d3e/d5e/d7c/f85 0 2024-04-03T08:39:22.826 INFO:tasks.workunit.client.1.smithi181.stdout:9/514: dread d1/f20 [0,4194304] 0 2024-04-03T08:39:22.826 INFO:tasks.workunit.client.0.smithi157.stdout:3/570: link d8/d1e/d2d/d39/d51/d4c/l87 d8/d1e/lcb 0 2024-04-03T08:39:22.827 INFO:tasks.workunit.client.1.smithi181.stdout:8/396: truncate d4/d45/db/d14/f2d 1025687 0 2024-04-03T08:39:22.827 INFO:tasks.workunit.client.0.smithi157.stdout:3/571: stat d8/d1e/fb9 0 2024-04-03T08:39:22.829 INFO:tasks.workunit.client.1.smithi181.stdout:2/501: creat d13/da7/d40/fbb x:0 0 0 2024-04-03T08:39:22.832 INFO:tasks.workunit.client.1.smithi181.stdout:0/461: rmdir d5/dc/d10 39 2024-04-03T08:39:22.834 INFO:tasks.workunit.client.0.smithi157.stdout:4/593: mknod da/df/d2f/d64/d8f/ccc 0 2024-04-03T08:39:22.836 INFO:tasks.workunit.client.1.smithi181.stdout:9/515: fdatasync d1/da/d13/d41/f1b 0 2024-04-03T08:39:22.836 INFO:tasks.workunit.client.0.smithi157.stdout:2/598: creat d3/fda x:0 0 0 2024-04-03T08:39:22.837 INFO:tasks.workunit.client.0.smithi157.stdout:0/603: mkdir d2/d9/ddd 0 2024-04-03T08:39:22.842 INFO:tasks.workunit.client.0.smithi157.stdout:6/647: rename d1/d5/d17/d2a/d73/f71 to d1/d5/d17/d29/d80/fdf 0 2024-04-03T08:39:22.842 INFO:tasks.workunit.client.0.smithi157.stdout:8/641: fsync d2/d11/d10/d24/d5b/d2e/f3f 0 2024-04-03T08:39:22.843 INFO:tasks.workunit.client.1.smithi181.stdout:0/462: fsync f2 0 2024-04-03T08:39:22.846 INFO:tasks.workunit.client.0.smithi157.stdout:9/572: rmdir d1/d94/dbe/dbf 39 2024-04-03T08:39:22.853 INFO:tasks.workunit.client.1.smithi181.stdout:8/397: mkdir d4/d45/db/d14/d31/d1c/d51/d87 0 2024-04-03T08:39:22.853 INFO:tasks.workunit.client.1.smithi181.stdout:5/461: dread d4/d18/f35 [0,4194304] 0 2024-04-03T08:39:22.855 INFO:tasks.workunit.client.1.smithi181.stdout:6/469: dread d6/d3e/d5e/d7c/d50/d5b/f6a [0,4194304] 0 2024-04-03T08:39:22.856 INFO:tasks.workunit.client.1.smithi181.stdout:1/448: dwrite d10/d15/d17/d19/d33/f6a [0,4194304] 0 2024-04-03T08:39:22.857 INFO:tasks.workunit.client.1.smithi181.stdout:8/398: dread - d4/d45/db/d14/d31/d1c/f85 zero size 2024-04-03T08:39:22.858 INFO:tasks.workunit.client.1.smithi181.stdout:1/449: stat d10/d15/d17/d19 0 2024-04-03T08:39:22.859 INFO:tasks.workunit.client.0.smithi157.stdout:5/651: dread dc/d29/d56/fb0 [0,4194304] 0 2024-04-03T08:39:22.863 INFO:tasks.workunit.client.1.smithi181.stdout:9/516: mknod d1/da/d28/d30/d3e/d4e/d62/ca4 0 2024-04-03T08:39:22.865 INFO:tasks.workunit.client.0.smithi157.stdout:9/573: dwrite d1/d15/d27/f32 [4194304,4194304] 0 2024-04-03T08:39:22.871 INFO:tasks.workunit.client.0.smithi157.stdout:9/574: chown d1/d36/f61 27 1 2024-04-03T08:39:22.873 INFO:tasks.workunit.client.1.smithi181.stdout:7/412: write d0/d1/d6/de/d17/d27/f28 [605065,77018] 0 2024-04-03T08:39:22.883 INFO:tasks.workunit.client.1.smithi181.stdout:5/462: mkdir d4/d18/d25/d59/d81/d96 0 2024-04-03T08:39:22.887 INFO:tasks.workunit.client.1.smithi181.stdout:5/463: truncate d4/d18/d25/d68/f88 360372 0 2024-04-03T08:39:22.890 INFO:tasks.workunit.client.1.smithi181.stdout:7/413: dwrite d0/d1/d6/de/d17/d27/f28 [0,4194304] 0 2024-04-03T08:39:22.894 INFO:tasks.workunit.client.1.smithi181.stdout:1/450: dread - d10/d69/f77 zero size 2024-04-03T08:39:22.896 INFO:tasks.workunit.client.1.smithi181.stdout:3/474: sync 2024-04-03T08:39:22.896 INFO:tasks.workunit.client.1.smithi181.stdout:4/521: getdents d1/d16/d24/d5e 0 2024-04-03T08:39:22.897 INFO:tasks.workunit.client.0.smithi157.stdout:3/572: creat d8/d13/d1b/dc4/fcc x:0 0 0 2024-04-03T08:39:22.900 INFO:tasks.workunit.client.1.smithi181.stdout:1/451: write d10/d15/d17/d30/f38 [1904866,13902] 0 2024-04-03T08:39:22.902 INFO:tasks.workunit.client.0.smithi157.stdout:6/648: write d1/d5/d17/d29/f7d [394898,14881] 0 2024-04-03T08:39:22.904 INFO:tasks.workunit.client.0.smithi157.stdout:5/652: symlink dc/d29/d51/lda 0 2024-04-03T08:39:22.904 INFO:tasks.workunit.client.1.smithi181.stdout:2/502: truncate d13/d1c/d4a/d7f/db3/f49 2286978 0 2024-04-03T08:39:22.905 INFO:tasks.workunit.client.1.smithi181.stdout:9/517: creat d1/da/d28/d30/d3e/fa5 x:0 0 0 2024-04-03T08:39:22.907 INFO:tasks.workunit.client.0.smithi157.stdout:7/657: getdents d0/d11/d15/d1b 0 2024-04-03T08:39:22.907 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:22 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1252402613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:39:22.907 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:22 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:22.907 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:22 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:22.907 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:22 smithi157 ceph-mon[35083]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 111 MiB/s wr, 220 op/s 2024-04-03T08:39:22.908 INFO:tasks.workunit.client.1.smithi181.stdout:1/452: chown d10/d15/d17/d19/d33/f72 5 1 2024-04-03T08:39:22.909 INFO:tasks.workunit.client.1.smithi181.stdout:0/463: dwrite d5/d9/d2a/f64 [0,4194304] 0 2024-04-03T08:39:22.911 INFO:tasks.workunit.client.0.smithi157.stdout:4/594: creat da/df/d2f/dbc/dbe/fcd x:0 0 0 2024-04-03T08:39:22.913 INFO:tasks.workunit.client.1.smithi181.stdout:1/453: write d10/d69/f77 [664522,86016] 0 2024-04-03T08:39:22.915 INFO:tasks.workunit.client.1.smithi181.stdout:7/414: fdatasync d0/d1/d6/de/d17/d27/f4e 0 2024-04-03T08:39:22.916 INFO:tasks.workunit.client.0.smithi157.stdout:2/599: link d3/db/d44/d4c/d5a/fd4 d3/d2e/d65/dae/fdb 0 2024-04-03T08:39:22.917 INFO:tasks.workunit.client.1.smithi181.stdout:4/522: dread - d1/d16/d55/f6e zero size 2024-04-03T08:39:22.917 INFO:tasks.workunit.client.0.smithi157.stdout:1/564: getdents d2/d11/d24/d39/d3b/d2e 0 2024-04-03T08:39:22.919 INFO:tasks.workunit.client.0.smithi157.stdout:8/642: dwrite d2/d11/d10/d24/d5b/f1c [0,4194304] 0 2024-04-03T08:39:22.921 INFO:tasks.workunit.client.0.smithi157.stdout:1/565: chown d2/f53 357679 1 2024-04-03T08:39:22.921 INFO:tasks.workunit.client.1.smithi181.stdout:0/464: dread d5/d9/d2c/f69 [0,4194304] 0 2024-04-03T08:39:22.922 INFO:tasks.workunit.client.1.smithi181.stdout:0/465: dread - d5/f40 zero size 2024-04-03T08:39:22.924 INFO:tasks.workunit.client.1.smithi181.stdout:2/503: unlink d13/da7/d27/f28 0 2024-04-03T08:39:22.926 INFO:tasks.workunit.client.1.smithi181.stdout:2/504: truncate d13/d1c/f5a 5510617 0 2024-04-03T08:39:22.927 INFO:tasks.workunit.client.0.smithi157.stdout:8/643: chown d2/d11/d10/l52 110001 1 2024-04-03T08:39:22.928 INFO:tasks.workunit.client.0.smithi157.stdout:6/649: rmdir d1/d5/d17/d2a/d30/d77 39 2024-04-03T08:39:22.933 INFO:tasks.workunit.client.1.smithi181.stdout:8/399: creat d4/f88 x:0 0 0 2024-04-03T08:39:22.935 INFO:tasks.workunit.client.0.smithi157.stdout:7/658: mkdir d0/d4/da5/def 0 2024-04-03T08:39:22.939 INFO:tasks.workunit.client.0.smithi157.stdout:5/653: mkdir dc/d29/d56/d49/d53/d6c/ddb 0 2024-04-03T08:39:22.943 INFO:tasks.workunit.client.1.smithi181.stdout:6/470: truncate d6/d3e/d5e/d7c/d9/d22/d4f/f66 1078178 0 2024-04-03T08:39:22.945 INFO:tasks.workunit.client.1.smithi181.stdout:1/454: creat d10/d15/d17/d23/d27/f87 x:0 0 0 2024-04-03T08:39:22.945 INFO:tasks.workunit.client.0.smithi157.stdout:2/600: chown d3/d12/d43/f86 10403 1 2024-04-03T08:39:22.949 INFO:tasks.workunit.client.1.smithi181.stdout:1/455: truncate d10/d15/d17/d30/f79 1431905 0 2024-04-03T08:39:22.949 INFO:tasks.workunit.client.0.smithi157.stdout:4/595: mkdir da/df/d2f/d64/d8f/dbd/d68/dce 0 2024-04-03T08:39:22.952 INFO:tasks.workunit.client.0.smithi157.stdout:0/604: dwrite d2/d9/dc/df/d1b/d35/f9e [0,4194304] 0 2024-04-03T08:39:22.953 INFO:tasks.workunit.client.1.smithi181.stdout:3/475: mkdir d0/d17/d36/d3b/d5a/d93/d9c 0 2024-04-03T08:39:22.953 INFO:tasks.workunit.client.0.smithi157.stdout:4/596: chown da/df/d2f/d64/d8f/dbd/d68/fc7 15393391 1 2024-04-03T08:39:22.957 INFO:tasks.workunit.client.0.smithi157.stdout:3/573: mkdir d8/d1e/d2d/d3b/d9e/dcd 0 2024-04-03T08:39:22.958 INFO:tasks.workunit.client.0.smithi157.stdout:1/566: symlink d2/d11/d24/d39/d3b/d2e/d66/d91/lba 0 2024-04-03T08:39:22.964 INFO:tasks.workunit.client.1.smithi181.stdout:0/466: creat d5/f8c x:0 0 0 2024-04-03T08:39:22.965 INFO:tasks.workunit.client.0.smithi157.stdout:6/650: read d1/f3 [1106414,112233] 0 2024-04-03T08:39:22.967 INFO:tasks.workunit.client.1.smithi181.stdout:2/505: unlink d13/d1c/d6c/f8e 0 2024-04-03T08:39:22.969 INFO:tasks.workunit.client.1.smithi181.stdout:8/400: write d4/d2a/d37/f3f [3859597,26692] 0 2024-04-03T08:39:22.975 INFO:tasks.workunit.client.1.smithi181.stdout:1/456: truncate d10/d15/d4b/f50 160984 0 2024-04-03T08:39:22.976 INFO:tasks.workunit.client.0.smithi157.stdout:0/605: symlink d2/lde 0 2024-04-03T08:39:22.976 INFO:tasks.workunit.client.0.smithi157.stdout:3/574: mkdir d8/d1e/d2d/d39/d51/d48/dce 0 2024-04-03T08:39:22.980 INFO:tasks.workunit.client.0.smithi157.stdout:9/575: dwrite d1/d15/d27/f49 [0,4194304] 0 2024-04-03T08:39:22.982 INFO:tasks.workunit.client.0.smithi157.stdout:9/576: chown d1/d4a/f4c 18482 1 2024-04-03T08:39:22.985 INFO:tasks.workunit.client.0.smithi157.stdout:6/651: mkdir d1/d5/d1b/d97/de0 0 2024-04-03T08:39:22.991 INFO:tasks.workunit.client.1.smithi181.stdout:4/523: symlink d1/d16/d24/d61/lab 0 2024-04-03T08:39:22.995 INFO:tasks.workunit.client.0.smithi157.stdout:4/597: creat da/df/d6b/db9/fcf x:0 0 0 2024-04-03T08:39:22.999 INFO:tasks.workunit.client.0.smithi157.stdout:0/606: unlink d2/d9/dc/df/ca3 0 2024-04-03T08:39:23.001 INFO:tasks.workunit.client.1.smithi181.stdout:2/506: rmdir d13/da7/d85 39 2024-04-03T08:39:23.003 INFO:tasks.workunit.client.1.smithi181.stdout:2/507: dread - d13/da7/d27/d2f/dae/fb7 zero size 2024-04-03T08:39:23.005 INFO:tasks.workunit.client.1.smithi181.stdout:5/464: getdents d4/d22/d72 0 2024-04-03T08:39:23.007 INFO:tasks.workunit.client.1.smithi181.stdout:5/465: dread - d4/d22/d78/f7f zero size 2024-04-03T08:39:23.008 INFO:tasks.workunit.client.1.smithi181.stdout:7/415: truncate d0/d1/f66 3272738 0 2024-04-03T08:39:23.008 INFO:tasks.workunit.client.0.smithi157.stdout:7/659: dwrite d0/d11/d15/d17/d43/d8a/fe0 [0,4194304] 0 2024-04-03T08:39:23.008 INFO:tasks.workunit.client.0.smithi157.stdout:5/654: dwrite dc/f44 [0,4194304] 0 2024-04-03T08:39:23.010 INFO:tasks.workunit.client.1.smithi181.stdout:6/471: dwrite d6/d31/d36/f5d [0,4194304] 0 2024-04-03T08:39:23.012 INFO:tasks.workunit.client.1.smithi181.stdout:8/401: rmdir d4/d45/db/d14/d31/d1c 39 2024-04-03T08:39:23.014 INFO:tasks.workunit.client.1.smithi181.stdout:9/518: truncate d1/da/d13/d22/d23/d36/d91/d9d/f37 2727483 0 2024-04-03T08:39:23.016 INFO:tasks.workunit.client.1.smithi181.stdout:6/472: fsync d6/d3e/d5e/d7c/d50/d64/f84 0 2024-04-03T08:39:23.017 INFO:tasks.workunit.client.1.smithi181.stdout:9/519: chown d1/da/d28/f64 3098 1 2024-04-03T08:39:23.017 INFO:tasks.workunit.client.0.smithi157.stdout:1/567: creat d2/d11/d24/d39/d3b/d2e/d48/da1/fbb x:0 0 0 2024-04-03T08:39:23.018 INFO:tasks.workunit.client.0.smithi157.stdout:7/660: readlink d0/d11/d6f/d89/d8c/ldd 0 2024-04-03T08:39:23.019 INFO:tasks.workunit.client.1.smithi181.stdout:1/457: symlink d10/d15/d17/d19/d33/d70/l88 0 2024-04-03T08:39:23.025 INFO:tasks.workunit.client.1.smithi181.stdout:4/524: symlink d1/d1e/d82/d84/lac 0 2024-04-03T08:39:23.026 INFO:tasks.workunit.client.0.smithi157.stdout:0/607: truncate d2/d9/dc/fb3 874887 0 2024-04-03T08:39:23.031 INFO:tasks.workunit.client.0.smithi157.stdout:5/655: dread - dc/d29/d56/d49/d53/d6c/f9b zero size 2024-04-03T08:39:23.038 INFO:tasks.workunit.client.0.smithi157.stdout:2/601: getdents d3/d2e/d32/d9f/da7 0 2024-04-03T08:39:23.039 INFO:tasks.workunit.client.0.smithi157.stdout:4/598: mknod da/df/d11/cd0 0 2024-04-03T08:39:23.041 INFO:tasks.workunit.client.0.smithi157.stdout:0/608: creat d2/fdf x:0 0 0 2024-04-03T08:39:23.044 INFO:tasks.workunit.client.0.smithi157.stdout:5/656: symlink dc/d29/d56/d18/d21/ldc 0 2024-04-03T08:39:23.046 INFO:tasks.workunit.client.0.smithi157.stdout:9/577: dwrite d1/d15/d16/f1e [0,4194304] 0 2024-04-03T08:39:23.046 INFO:tasks.workunit.client.0.smithi157.stdout:4/599: read - da/df/d2f/d54/d5f/fb3 zero size 2024-04-03T08:39:23.048 INFO:tasks.workunit.client.1.smithi181.stdout:6/473: unlink d6/d53/d80/f83 0 2024-04-03T08:39:23.052 INFO:tasks.workunit.client.0.smithi157.stdout:3/575: getdents d8/d1e/d2d/d3f/dc8 0 2024-04-03T08:39:23.053 INFO:tasks.workunit.client.1.smithi181.stdout:9/520: unlink d1/da/d28/f49 0 2024-04-03T08:39:23.059 INFO:tasks.workunit.client.0.smithi157.stdout:2/602: fdatasync d3/d12/d43/fb1 0 2024-04-03T08:39:23.060 INFO:tasks.workunit.client.1.smithi181.stdout:9/521: dread d1/da/d28/d30/f87 [0,4194304] 0 2024-04-03T08:39:23.061 INFO:tasks.workunit.client.1.smithi181.stdout:3/476: creat d0/d5/f9d x:0 0 0 2024-04-03T08:39:23.061 INFO:tasks.workunit.client.0.smithi157.stdout:4/600: chown da/df/d24/d35/d6a/d78/l89 332 1 2024-04-03T08:39:23.066 INFO:tasks.workunit.client.0.smithi157.stdout:0/609: truncate d2/d9/f4f 1330915 0 2024-04-03T08:39:23.073 INFO:tasks.workunit.client.0.smithi157.stdout:6/652: dread d1/d5/d17/d2a/d30/d95/f2e [0,4194304] 0 2024-04-03T08:39:23.075 INFO:tasks.workunit.client.1.smithi181.stdout:2/508: symlink d13/d1c/d4a/lbc 0 2024-04-03T08:39:23.076 INFO:tasks.workunit.client.0.smithi157.stdout:6/653: chown d1/d5/d1b/c43 676 1 2024-04-03T08:39:23.076 INFO:tasks.workunit.client.0.smithi157.stdout:5/657: symlink dc/d29/d56/d87/ldd 0 2024-04-03T08:39:23.077 INFO:tasks.workunit.client.1.smithi181.stdout:2/509: readlink d13/da7/d27/d2f/d5d/l77 0 2024-04-03T08:39:23.080 INFO:tasks.workunit.client.1.smithi181.stdout:5/466: unlink d4/d18/d2c/f2e 0 2024-04-03T08:39:23.081 INFO:tasks.workunit.client.1.smithi181.stdout:5/467: chown d4/l1f 42056 1 2024-04-03T08:39:23.086 INFO:tasks.workunit.client.0.smithi157.stdout:2/603: readlink d3/d12/l29 0 2024-04-03T08:39:23.087 INFO:tasks.workunit.client.0.smithi157.stdout:7/661: truncate d0/d11/d6f/d76/da7/f62 5125964 0 2024-04-03T08:39:23.089 INFO:tasks.workunit.client.0.smithi157.stdout:2/604: chown d3/d2e/fa5 57283 1 2024-04-03T08:39:23.093 INFO:tasks.workunit.client.0.smithi157.stdout:4/601: rename da/df/d24/d35/d53/d69/f9c to da/df/d2f/d64/d8f/fd1 0 2024-04-03T08:39:23.093 INFO:tasks.workunit.client.0.smithi157.stdout:3/576: write d8/d13/d1b/f6b [1774487,53675] 0 2024-04-03T08:39:23.094 INFO:tasks.workunit.client.1.smithi181.stdout:2/510: dwrite d13/d1c/d4a/d68/f94 [0,4194304] 0 2024-04-03T08:39:23.095 INFO:tasks.workunit.client.1.smithi181.stdout:9/522: creat d1/da/d13/d41/d65/fa6 x:0 0 0 2024-04-03T08:39:23.097 INFO:tasks.workunit.client.0.smithi157.stdout:5/658: fsync dc/d29/d43/f66 0 2024-04-03T08:39:23.098 INFO:tasks.workunit.client.1.smithi181.stdout:3/477: unlink d0/d17/f6e 0 2024-04-03T08:39:23.099 INFO:tasks.workunit.client.0.smithi157.stdout:3/577: chown d8/d13/d1b/d5b/c8e 3679 1 2024-04-03T08:39:23.099 INFO:tasks.workunit.client.1.smithi181.stdout:4/525: dwrite d1/d1e/d2c/f73 [0,4194304] 0 2024-04-03T08:39:23.099 INFO:tasks.workunit.client.1.smithi181.stdout:2/511: write d13/da7/d40/f56 [2001682,109277] 0 2024-04-03T08:39:23.100 INFO:tasks.workunit.client.0.smithi157.stdout:3/578: dread - d8/fc2 zero size 2024-04-03T08:39:23.103 INFO:tasks.workunit.client.1.smithi181.stdout:0/467: mkdir d5/dc/d14/d8d 0 2024-04-03T08:39:23.103 INFO:tasks.workunit.client.1.smithi181.stdout:2/512: chown d13/d1c/d4a/d7f/db3/d8f/f93 9540901 1 2024-04-03T08:39:23.108 INFO:tasks.workunit.client.1.smithi181.stdout:8/402: creat d4/d45/d9/f89 x:0 0 0 2024-04-03T08:39:23.111 INFO:tasks.workunit.client.1.smithi181.stdout:7/416: truncate d0/d1/d6/de/d17/d27/f3a 2277873 0 2024-04-03T08:39:23.111 INFO:tasks.workunit.client.1.smithi181.stdout:5/468: creat d4/d18/d25/d68/f97 x:0 0 0 2024-04-03T08:39:23.112 INFO:tasks.workunit.client.0.smithi157.stdout:2/605: chown d3/db/l19 14357995 1 2024-04-03T08:39:23.118 INFO:tasks.workunit.client.0.smithi157.stdout:4/602: write da/df/d6b/f88 [4917412,3508] 0 2024-04-03T08:39:23.120 INFO:tasks.workunit.client.1.smithi181.stdout:7/417: dread d0/d1/d6/de/d17/f2c [0,4194304] 0 2024-04-03T08:39:23.129 INFO:tasks.workunit.client.0.smithi157.stdout:7/662: dread d0/d16/f6b [0,4194304] 0 2024-04-03T08:39:23.130 INFO:tasks.workunit.client.0.smithi157.stdout:6/654: creat d1/d5/d17/d29/d62/d7f/d89/da4/fe1 x:0 0 0 2024-04-03T08:39:23.131 INFO:tasks.workunit.client.1.smithi181.stdout:6/474: truncate d6/d31/d36/f34 1321197 0 2024-04-03T08:39:23.132 INFO:tasks.workunit.client.1.smithi181.stdout:6/475: read - d6/d3e/d5e/f90 zero size 2024-04-03T08:39:23.134 INFO:tasks.workunit.client.0.smithi157.stdout:0/610: write d2/d9/dc/f3c [4106613,11829] 0 2024-04-03T08:39:23.135 INFO:tasks.workunit.client.0.smithi157.stdout:3/579: fdatasync d8/f88 0 2024-04-03T08:39:23.142 INFO:tasks.workunit.client.0.smithi157.stdout:5/659: mkdir dc/d29/d56/d9e/dc3/dde 0 2024-04-03T08:39:23.156 INFO:tasks.workunit.client.0.smithi157.stdout:9/578: getdents d1/d94/dbe 0 2024-04-03T08:39:23.156 INFO:tasks.workunit.client.0.smithi157.stdout:9/579: readlink d1/l62 0 2024-04-03T08:39:23.160 INFO:tasks.workunit.client.0.smithi157.stdout:2/606: symlink d3/db/d44/d4c/ldc 0 2024-04-03T08:39:23.161 INFO:tasks.workunit.client.1.smithi181.stdout:3/478: symlink d0/d5/d6/d32/d43/d6b/l9e 0 2024-04-03T08:39:23.161 INFO:tasks.workunit.client.0.smithi157.stdout:2/607: stat d3/db/d44/f61 0 2024-04-03T08:39:23.162 INFO:tasks.workunit.client.1.smithi181.stdout:3/479: fdatasync d0/d5/d6/d32/d43/f9b 0 2024-04-03T08:39:23.165 INFO:tasks.workunit.client.0.smithi157.stdout:4/603: read da/df/d11/f66 [1050260,126540] 0 2024-04-03T08:39:23.171 INFO:tasks.workunit.client.0.smithi157.stdout:9/580: dread d1/f42 [4194304,4194304] 0 2024-04-03T08:39:23.171 INFO:tasks.workunit.client.0.smithi157.stdout:2/608: dread d3/d2e/f83 [0,4194304] 0 2024-04-03T08:39:23.171 INFO:tasks.workunit.client.0.smithi157.stdout:7/663: chown d0/d11/d15/d17/d43/d8a/d8f/c41 171069567 1 2024-04-03T08:39:23.175 INFO:tasks.workunit.client.1.smithi181.stdout:3/480: dwrite d0/d17/d36/d1e/f28 [0,4194304] 0 2024-04-03T08:39:23.179 INFO:tasks.workunit.client.0.smithi157.stdout:5/660: creat dc/d29/d56/d9e/dc3/fdf x:0 0 0 2024-04-03T08:39:23.180 INFO:tasks.workunit.client.1.smithi181.stdout:8/403: dread d4/d45/f2e [0,4194304] 0 2024-04-03T08:39:23.181 INFO:tasks.workunit.client.1.smithi181.stdout:7/418: stat d0/d1/f15 0 2024-04-03T08:39:23.188 INFO:tasks.workunit.client.1.smithi181.stdout:1/458: link d10/d15/d17/d23/c39 d10/d15/d4a/d86/c89 0 2024-04-03T08:39:23.193 INFO:tasks.workunit.client.0.smithi157.stdout:4/604: rename da/df/d2f/dbc/dbe/fcd to da/d26/fd2 0 2024-04-03T08:39:23.194 INFO:tasks.workunit.client.1.smithi181.stdout:4/526: mknod d1/d16/d24/d5e/d31/d39/da1/cad 0 2024-04-03T08:39:23.195 INFO:tasks.workunit.client.1.smithi181.stdout:7/419: dwrite d0/d1/d6/de/d17/f4c [0,4194304] 0 2024-04-03T08:39:23.196 INFO:tasks.workunit.client.1.smithi181.stdout:4/527: chown d1/d16/d37/d34/l3b 25 1 2024-04-03T08:39:23.198 INFO:tasks.workunit.client.1.smithi181.stdout:7/420: write d0/d1/d6/de/d57/f79 [62848,1640] 0 2024-04-03T08:39:23.199 INFO:tasks.workunit.client.0.smithi157.stdout:7/664: creat d0/d4/da5/ff0 x:0 0 0 2024-04-03T08:39:23.201 INFO:tasks.workunit.client.1.smithi181.stdout:0/468: mkdir d5/dc/d8e 0 2024-04-03T08:39:23.203 INFO:tasks.workunit.client.1.smithi181.stdout:2/513: mkdir d13/da7/d85/dbd 0 2024-04-03T08:39:23.203 INFO:tasks.workunit.client.0.smithi157.stdout:6/655: write d1/d5/d17/fd7 [1755973,46898] 0 2024-04-03T08:39:23.204 INFO:tasks.workunit.client.0.smithi157.stdout:2/609: symlink d3/d2e/d65/dae/ldd 0 2024-04-03T08:39:23.205 INFO:tasks.workunit.client.1.smithi181.stdout:2/514: readlink d13/d1c/d4a/lbc 0 2024-04-03T08:39:23.205 INFO:tasks.workunit.client.1.smithi181.stdout:0/469: dread d5/dc/d14/f5c [0,4194304] 0 2024-04-03T08:39:23.208 INFO:tasks.workunit.client.0.smithi157.stdout:3/580: creat d8/d1e/d2d/d39/d51/d48/dce/fcf x:0 0 0 2024-04-03T08:39:23.209 INFO:tasks.workunit.client.1.smithi181.stdout:6/476: dwrite d6/d31/d36/f33 [0,4194304] 0 2024-04-03T08:39:23.209 INFO:tasks.workunit.client.1.smithi181.stdout:5/469: unlink d4/f16 0 2024-04-03T08:39:23.211 INFO:tasks.workunit.client.0.smithi157.stdout:3/581: write d8/fc2 [306975,70104] 0 2024-04-03T08:39:23.218 INFO:tasks.workunit.client.1.smithi181.stdout:3/481: creat d0/d17/d36/d3b/d5a/d85/f9f x:0 0 0 2024-04-03T08:39:23.223 INFO:tasks.workunit.client.0.smithi157.stdout:9/581: symlink d1/d15/d27/d5c/dbd/lc8 0 2024-04-03T08:39:23.224 INFO:tasks.workunit.client.1.smithi181.stdout:1/459: chown d10/d15/d17/d23/d27/f3a 23385 1 2024-04-03T08:39:23.226 INFO:tasks.workunit.client.1.smithi181.stdout:1/460: fdatasync d10/d15/d17/d23/d27/f87 0 2024-04-03T08:39:23.228 INFO:tasks.workunit.client.0.smithi157.stdout:0/611: link d2/d9/dc/df/d6f/dad/dbb/fb8 d2/d9/dc/df/d6f/d9d/fe0 0 2024-04-03T08:39:23.228 INFO:tasks.workunit.client.1.smithi181.stdout:1/461: chown d10/d15/d17/d19/d33/d70/f81 363803 1 2024-04-03T08:39:23.233 INFO:tasks.workunit.client.1.smithi181.stdout:2/515: creat d13/d1c/d4a/d7f/db3/d81/fbe x:0 0 0 2024-04-03T08:39:23.234 INFO:tasks.workunit.client.1.smithi181.stdout:6/477: symlink d6/d31/d36/d73/l93 0 2024-04-03T08:39:23.235 INFO:tasks.workunit.client.0.smithi157.stdout:3/582: symlink d8/d13/d1b/d83/ld0 0 2024-04-03T08:39:23.235 INFO:tasks.workunit.client.0.smithi157.stdout:8/644: sync 2024-04-03T08:39:23.236 INFO:tasks.workunit.client.1.smithi181.stdout:6/478: fsync d6/d31/d36/f4c 0 2024-04-03T08:39:23.238 INFO:tasks.workunit.client.1.smithi181.stdout:5/470: mkdir d4/d22/d53/d98 0 2024-04-03T08:39:23.239 INFO:tasks.workunit.client.0.smithi157.stdout:9/582: fsync d1/d15/d27/f32 0 2024-04-03T08:39:23.239 INFO:tasks.workunit.client.1.smithi181.stdout:6/479: write d6/d31/f6b [764239,80764] 0 2024-04-03T08:39:23.241 INFO:tasks.workunit.client.1.smithi181.stdout:6/480: readlink d6/d3e/d5e/d7c/d9/l2e 0 2024-04-03T08:39:23.241 INFO:tasks.workunit.client.0.smithi157.stdout:2/610: link d3/d12/d43/d4b/d55/f95 d3/d12/d43/d4b/d55/fde 0 2024-04-03T08:39:23.243 INFO:tasks.workunit.client.1.smithi181.stdout:8/404: mknod d4/d45/db/c8a 0 2024-04-03T08:39:23.245 INFO:tasks.workunit.client.0.smithi157.stdout:7/665: dread d0/d11/d15/d1b/f59 [0,4194304] 0 2024-04-03T08:39:23.245 INFO:tasks.workunit.client.1.smithi181.stdout:3/482: mknod d0/d17/d36/d1e/ca0 0 2024-04-03T08:39:23.249 INFO:tasks.workunit.client.1.smithi181.stdout:9/523: creat d1/da/d13/d22/d23/d36/d9c/fa7 x:0 0 0 2024-04-03T08:39:23.250 INFO:tasks.workunit.client.1.smithi181.stdout:9/524: write d1/da/d13/d22/f3b [49282,5541] 0 2024-04-03T08:39:23.250 INFO:tasks.workunit.client.1.smithi181.stdout:4/528: symlink d1/d16/d24/d5e/d31/d39/d5d/d9a/lae 0 2024-04-03T08:39:23.257 INFO:tasks.workunit.client.0.smithi157.stdout:8/645: unlink d2/d6f/d70/d89/ccb 0 2024-04-03T08:39:23.259 INFO:tasks.workunit.client.0.smithi157.stdout:3/583: read - d8/d13/d1b/d5b/d7f/f9f zero size 2024-04-03T08:39:23.261 INFO:tasks.workunit.client.0.smithi157.stdout:5/661: dwrite dc/f12 [0,4194304] 0 2024-04-03T08:39:23.264 INFO:tasks.workunit.client.1.smithi181.stdout:2/516: mkdir d13/d1c/d4a/d7f/db3/dbf 0 2024-04-03T08:39:23.267 INFO:tasks.workunit.client.1.smithi181.stdout:5/471: mknod d4/d22/d78/c99 0 2024-04-03T08:39:23.267 INFO:tasks.workunit.client.0.smithi157.stdout:2/611: write d3/da6/fb9 [1858269,13474] 0 2024-04-03T08:39:23.267 INFO:tasks.workunit.client.1.smithi181.stdout:5/472: stat d4/d22 0 2024-04-03T08:39:23.270 INFO:tasks.workunit.client.0.smithi157.stdout:0/612: mkdir d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/de1 0 2024-04-03T08:39:23.271 INFO:tasks.workunit.client.0.smithi157.stdout:6/656: dwrite d1/d5/d17/d2a/d30/d95/f2e [0,4194304] 0 2024-04-03T08:39:23.279 INFO:tasks.workunit.client.1.smithi181.stdout:3/483: creat d0/d17/d63/d81/fa1 x:0 0 0 2024-04-03T08:39:23.280 INFO:tasks.workunit.client.0.smithi157.stdout:3/584: dread - d8/d1e/f58 zero size 2024-04-03T08:39:23.281 INFO:tasks.workunit.client.1.smithi181.stdout:4/529: dread - d1/d16/d24/d5e/d2b/d56/f7e zero size 2024-04-03T08:39:23.283 INFO:tasks.workunit.client.0.smithi157.stdout:4/605: getdents da/d7e 0 2024-04-03T08:39:23.285 INFO:tasks.workunit.client.0.smithi157.stdout:7/666: creat d0/d11/d15/d17/d52/db6/dda/de6/ff1 x:0 0 0 2024-04-03T08:39:23.285 INFO:tasks.workunit.client.1.smithi181.stdout:7/421: link d0/d1/d6/de/lf d0/d1/d6/de/d17/d27/l97 0 2024-04-03T08:39:23.288 INFO:tasks.workunit.client.1.smithi181.stdout:7/422: write d0/d1/d6/de/d57/f7a [1006178,48314] 0 2024-04-03T08:39:23.289 INFO:tasks.workunit.client.1.smithi181.stdout:7/423: stat d0/f54 0 2024-04-03T08:39:23.298 INFO:tasks.workunit.client.0.smithi157.stdout:2/612: rename d3/db/l2d to d3/d2e/d32/ldf 0 2024-04-03T08:39:23.299 INFO:tasks.workunit.client.1.smithi181.stdout:2/517: creat d13/da7/d27/d2f/d5d/fc0 x:0 0 0 2024-04-03T08:39:23.302 INFO:tasks.workunit.client.0.smithi157.stdout:6/657: unlink d1/d5/d17/f1d 0 2024-04-03T08:39:23.305 INFO:tasks.workunit.client.1.smithi181.stdout:5/473: creat d4/d22/d53/f9a x:0 0 0 2024-04-03T08:39:23.308 INFO:tasks.workunit.client.0.smithi157.stdout:1/568: sync 2024-04-03T08:39:23.309 INFO:tasks.workunit.client.0.smithi157.stdout:9/583: creat d1/d15/fc9 x:0 0 0 2024-04-03T08:39:23.313 INFO:tasks.workunit.client.0.smithi157.stdout:9/584: fdatasync d1/d94/f73 0 2024-04-03T08:39:23.317 INFO:tasks.workunit.client.1.smithi181.stdout:5/474: dwrite d4/d18/d25/f1c [0,4194304] 0 2024-04-03T08:39:23.317 INFO:tasks.workunit.client.0.smithi157.stdout:8/646: dread d2/d11/d10/f48 [0,4194304] 0 2024-04-03T08:39:23.317 INFO:tasks.workunit.client.0.smithi157.stdout:5/662: dwrite dc/d29/d56/d18/f3a [0,4194304] 0 2024-04-03T08:39:23.319 INFO:tasks.workunit.client.1.smithi181.stdout:8/405: creat d4/d45/db/d14/d31/d1c/d51/f8b x:0 0 0 2024-04-03T08:39:23.320 INFO:tasks.workunit.client.0.smithi157.stdout:4/606: rmdir da/df/d2f/d64/d8f 39 2024-04-03T08:39:23.320 INFO:tasks.workunit.client.0.smithi157.stdout:5/663: stat dc/d29/d56/d87/ldd 0 2024-04-03T08:39:23.321 INFO:tasks.workunit.client.1.smithi181.stdout:8/406: stat d4/d45/db/d14/d31/f3c 0 2024-04-03T08:39:23.326 INFO:tasks.workunit.client.0.smithi157.stdout:7/667: truncate d0/d11/d15/d17/d52/f5a 4015984 0 2024-04-03T08:39:23.326 INFO:tasks.workunit.client.0.smithi157.stdout:4/607: write da/df/d6b/fb1 [691211,1915] 0 2024-04-03T08:39:23.328 INFO:tasks.workunit.client.1.smithi181.stdout:4/530: truncate d1/d16/f13 1048598 0 2024-04-03T08:39:23.329 INFO:tasks.workunit.client.0.smithi157.stdout:8/647: fdatasync d2/d11/d10/d24/d5b/d2e/d75/d81/f96 0 2024-04-03T08:39:23.329 INFO:tasks.workunit.client.0.smithi157.stdout:7/668: chown d0/d4/l64 59867764 1 2024-04-03T08:39:23.332 INFO:tasks.workunit.client.0.smithi157.stdout:2/613: symlink d3/d2e/d32/le0 0 2024-04-03T08:39:23.334 INFO:tasks.workunit.client.1.smithi181.stdout:1/462: link d10/d15/d17/d23/l32 d10/d15/d4b/d6c/l8a 0 2024-04-03T08:39:23.338 INFO:tasks.workunit.client.0.smithi157.stdout:6/658: rmdir d1/d5/d17/d29/d62/d7f 39 2024-04-03T08:39:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:22 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1252402613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:39:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:22 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:22 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:22 smithi181 ceph-mon[44183]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 111 MiB/s wr, 220 op/s 2024-04-03T08:39:23.349 INFO:tasks.workunit.client.1.smithi181.stdout:6/481: write d6/d31/f89 [159395,87295] 0 2024-04-03T08:39:23.352 INFO:tasks.workunit.client.1.smithi181.stdout:2/518: truncate d13/da7/d27/f62 2265415 0 2024-04-03T08:39:23.361 INFO:tasks.workunit.client.0.smithi157.stdout:8/648: creat d2/d6f/d70/fd9 x:0 0 0 2024-04-03T08:39:23.364 INFO:tasks.workunit.client.0.smithi157.stdout:4/608: rename da/df/f2a to da/df/d2f/d54/fd3 0 2024-04-03T08:39:23.366 INFO:tasks.workunit.client.0.smithi157.stdout:3/585: dread d8/d1e/d2d/d39/d51/d4c/d32/f42 [0,4194304] 0 2024-04-03T08:39:23.367 INFO:tasks.workunit.client.0.smithi157.stdout:7/669: mknod d0/d4/daf/cf2 0 2024-04-03T08:39:23.370 INFO:tasks.workunit.client.0.smithi157.stdout:2/614: symlink d3/db/d44/le1 0 2024-04-03T08:39:23.373 INFO:tasks.workunit.client.0.smithi157.stdout:6/659: mknod d1/d5/d17/d29/da7/db9/ce2 0 2024-04-03T08:39:23.373 INFO:tasks.workunit.client.1.smithi181.stdout:0/470: link d5/dc/d14/d29/d46/f63 d5/dc/d10/f8f 0 2024-04-03T08:39:23.376 INFO:tasks.workunit.client.0.smithi157.stdout:9/585: mkdir d1/d15/dca 0 2024-04-03T08:39:23.377 INFO:tasks.workunit.client.0.smithi157.stdout:8/649: fsync d2/d6f/d70/fd9 0 2024-04-03T08:39:23.379 INFO:tasks.workunit.client.0.smithi157.stdout:8/650: write d2/d11/f3e [463038,19684] 0 2024-04-03T08:39:23.383 INFO:tasks.workunit.client.1.smithi181.stdout:6/482: creat d6/d53/f94 x:0 0 0 2024-04-03T08:39:23.384 INFO:tasks.workunit.client.1.smithi181.stdout:2/519: fsync fa 0 2024-04-03T08:39:23.385 INFO:tasks.workunit.client.1.smithi181.stdout:5/475: link d4/f13 d4/d18/d25/d68/d77/f9b 0 2024-04-03T08:39:23.386 INFO:tasks.workunit.client.1.smithi181.stdout:2/520: dread - d13/da7/d27/d2f/f9e zero size 2024-04-03T08:39:23.388 INFO:tasks.workunit.client.1.smithi181.stdout:3/484: creat d0/d5/fa2 x:0 0 0 2024-04-03T08:39:23.388 INFO:tasks.workunit.client.1.smithi181.stdout:3/485: stat d0/d57/c96 0 2024-04-03T08:39:23.390 INFO:tasks.workunit.client.1.smithi181.stdout:3/486: dread - d0/d17/d36/d1e/f80 zero size 2024-04-03T08:39:23.390 INFO:tasks.workunit.client.0.smithi157.stdout:3/586: unlink d8/d13/d1b/d4e/l80 0 2024-04-03T08:39:23.393 INFO:tasks.workunit.client.0.smithi157.stdout:7/670: creat d0/d16/ff3 x:0 0 0 2024-04-03T08:39:23.394 INFO:tasks.workunit.client.1.smithi181.stdout:9/525: getdents d1/da/d1a 0 2024-04-03T08:39:23.394 INFO:tasks.workunit.client.0.smithi157.stdout:1/569: truncate d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 1695136 0 2024-04-03T08:39:23.395 INFO:tasks.workunit.client.0.smithi157.stdout:7/671: write d0/d11/d15/d17/d43/fb7 [1184769,88489] 0 2024-04-03T08:39:23.397 INFO:tasks.workunit.client.1.smithi181.stdout:4/531: mkdir d1/d16/daf 0 2024-04-03T08:39:23.398 INFO:tasks.workunit.client.1.smithi181.stdout:9/526: write d1/da/d13/d41/f1b [738558,67541] 0 2024-04-03T08:39:23.400 INFO:tasks.workunit.client.1.smithi181.stdout:6/483: dwrite d6/d53/d80/f86 [0,4194304] 0 2024-04-03T08:39:23.401 INFO:tasks.workunit.client.0.smithi157.stdout:6/660: unlink d1/d5/d1b/f41 0 2024-04-03T08:39:23.402 INFO:tasks.workunit.client.1.smithi181.stdout:4/532: truncate d1/d1e/f5b 1580677 0 2024-04-03T08:39:23.402 INFO:tasks.workunit.client.1.smithi181.stdout:9/527: dread - d1/da/d13/d41/d65/fa6 zero size 2024-04-03T08:39:23.405 INFO:tasks.workunit.client.1.smithi181.stdout:7/424: dwrite d0/d1/f66 [0,4194304] 0 2024-04-03T08:39:23.405 INFO:tasks.workunit.client.1.smithi181.stdout:9/528: chown d1/da/f12 11322 1 2024-04-03T08:39:23.406 INFO:tasks.workunit.client.1.smithi181.stdout:6/484: stat d6/d3e/d5e/d7c/d9/d22/d4f/f55 0 2024-04-03T08:39:23.406 INFO:tasks.workunit.client.1.smithi181.stdout:0/471: mkdir d5/dc/d10/d30/d68/d90 0 2024-04-03T08:39:23.411 INFO:tasks.workunit.client.0.smithi157.stdout:9/586: mknod d1/d4a/d4d/da4/ccb 0 2024-04-03T08:39:23.415 INFO:tasks.workunit.client.0.smithi157.stdout:9/587: fsync d1/d15/d27/d5c/d79/f7c 0 2024-04-03T08:39:23.424 INFO:tasks.workunit.client.1.smithi181.stdout:6/485: dwrite d6/d3e/f46 [0,4194304] 0 2024-04-03T08:39:23.429 INFO:tasks.workunit.client.0.smithi157.stdout:4/609: mknod da/df/d2f/d64/d8f/dbd/cd4 0 2024-04-03T08:39:23.431 INFO:tasks.workunit.client.0.smithi157.stdout:6/661: dread d1/d5/f1a [0,4194304] 0 2024-04-03T08:39:23.435 INFO:tasks.workunit.client.0.smithi157.stdout:2/615: dwrite d3/db/d44/d4c/d5a/fd4 [0,4194304] 0 2024-04-03T08:39:23.441 INFO:tasks.workunit.client.1.smithi181.stdout:8/407: creat d4/d45/db/f8c x:0 0 0 2024-04-03T08:39:23.447 INFO:tasks.workunit.client.0.smithi157.stdout:7/672: mkdir d0/d4/d8e/d96/df4 0 2024-04-03T08:39:23.448 INFO:tasks.workunit.client.1.smithi181.stdout:7/425: dread d0/d1/d6/de/f52 [0,4194304] 0 2024-04-03T08:39:23.449 INFO:tasks.workunit.client.0.smithi157.stdout:9/588: dwrite d1/d15/d27/f55 [0,4194304] 0 2024-04-03T08:39:23.453 INFO:tasks.workunit.client.1.smithi181.stdout:2/521: write d13/da7/d40/f75 [838521,38190] 0 2024-04-03T08:39:23.454 INFO:tasks.workunit.client.1.smithi181.stdout:7/426: dread - d0/d1/d6/de/d17/d64/f7c zero size 2024-04-03T08:39:23.454 INFO:tasks.workunit.client.0.smithi157.stdout:1/570: unlink d2/d11/d24/d39/d3b/d2e/d48/d58/f72 0 2024-04-03T08:39:23.454 INFO:tasks.workunit.client.1.smithi181.stdout:1/463: rename d10/d15/d17/d19/d4c/d66 to d10/d15/d17/d23/d8b 0 2024-04-03T08:39:23.456 INFO:tasks.workunit.client.1.smithi181.stdout:1/464: fsync d10/d15/d17/d30/f82 0 2024-04-03T08:39:23.461 INFO:tasks.workunit.client.1.smithi181.stdout:1/465: fsync d10/d15/d17/d19/d33/f64 0 2024-04-03T08:39:23.465 INFO:tasks.workunit.client.0.smithi157.stdout:5/664: link dc/d29/d56/d2e/l32 dc/d29/d43/da1/le0 0 2024-04-03T08:39:23.471 INFO:tasks.workunit.client.1.smithi181.stdout:5/476: fsync d4/d18/d25/f52 0 2024-04-03T08:39:23.472 INFO:tasks.workunit.client.1.smithi181.stdout:6/486: truncate d6/d3e/d5e/d7c/d50/d5b/f6a 1345856 0 2024-04-03T08:39:23.473 INFO:tasks.workunit.client.0.smithi157.stdout:6/662: read - d1/d4b/d61/f91 zero size 2024-04-03T08:39:23.475 INFO:tasks.workunit.client.0.smithi157.stdout:3/587: mknod d8/d1e/d2d/d3f/d4d/cd1 0 2024-04-03T08:39:23.475 INFO:tasks.workunit.client.0.smithi157.stdout:7/673: dwrite d0/d11/d15/d17/d1c/f4b [0,4194304] 0 2024-04-03T08:39:23.477 INFO:tasks.workunit.client.0.smithi157.stdout:2/616: truncate d3/db/d44/f64 3822766 0 2024-04-03T08:39:23.483 INFO:tasks.workunit.client.0.smithi157.stdout:4/610: dread da/df/d24/d35/d6a/d78/f93 [0,4194304] 0 2024-04-03T08:39:23.485 INFO:tasks.workunit.client.0.smithi157.stdout:4/611: chown da/df/d2f/f38 1362 1 2024-04-03T08:39:23.488 INFO:tasks.workunit.client.1.smithi181.stdout:4/533: write d1/d16/d24/d5e/d3f/f40 [1228461,69643] 0 2024-04-03T08:39:23.492 INFO:tasks.workunit.client.0.smithi157.stdout:9/589: mkdir d1/d4a/d4d/da4/dcc 0 2024-04-03T08:39:23.494 INFO:tasks.workunit.client.0.smithi157.stdout:9/590: fsync d1/d15/d27/f32 0 2024-04-03T08:39:23.494 INFO:tasks.workunit.client.1.smithi181.stdout:2/522: creat d13/fc1 x:0 0 0 2024-04-03T08:39:23.496 INFO:tasks.workunit.client.0.smithi157.stdout:8/651: unlink d2/d20/c57 0 2024-04-03T08:39:23.497 INFO:tasks.workunit.client.1.smithi181.stdout:0/472: fsync d5/fb 0 2024-04-03T08:39:23.497 INFO:tasks.workunit.client.1.smithi181.stdout:7/427: dread d0/f3b [0,4194304] 0 2024-04-03T08:39:23.497 INFO:tasks.workunit.client.0.smithi157.stdout:5/665: creat dc/d29/d43/da1/fe1 x:0 0 0 2024-04-03T08:39:23.499 INFO:tasks.workunit.client.1.smithi181.stdout:9/529: symlink d1/da/d13/d22/d23/la8 0 2024-04-03T08:39:23.500 INFO:tasks.workunit.client.1.smithi181.stdout:9/530: stat d1/da/d28/d80 0 2024-04-03T08:39:23.501 INFO:tasks.workunit.client.1.smithi181.stdout:1/466: mkdir d10/d15/d41/d8c 0 2024-04-03T08:39:23.504 INFO:tasks.workunit.client.1.smithi181.stdout:1/467: read d10/d15/f34 [6413136,19308] 0 2024-04-03T08:39:23.506 INFO:tasks.workunit.client.0.smithi157.stdout:7/674: mkdir d0/d11/d15/d17/d1c/df5 0 2024-04-03T08:39:23.506 INFO:tasks.workunit.client.0.smithi157.stdout:4/612: chown da/df/d24/c47 0 1 2024-04-03T08:39:23.508 INFO:tasks.workunit.client.1.smithi181.stdout:3/487: truncate d0/d17/f2e 618942 0 2024-04-03T08:39:23.515 INFO:tasks.workunit.client.0.smithi157.stdout:6/663: link d1/f48 d1/d5/d17/d2a/d37/dca/fe3 0 2024-04-03T08:39:23.518 INFO:tasks.workunit.client.0.smithi157.stdout:5/666: mkdir dc/d29/d56/d9e/dc3/de2 0 2024-04-03T08:39:23.521 INFO:tasks.workunit.client.0.smithi157.stdout:7/675: mkdir d0/d11/d15/d1b/df6 0 2024-04-03T08:39:23.521 INFO:tasks.workunit.client.1.smithi181.stdout:1/468: dwrite d10/d15/d17/d23/f78 [0,4194304] 0 2024-04-03T08:39:23.521 INFO:tasks.workunit.client.1.smithi181.stdout:3/488: dwrite d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:23.530 INFO:tasks.workunit.client.0.smithi157.stdout:4/613: rename da/df/d24/la5 to da/df/d24/d35/d6a/ld5 0 2024-04-03T08:39:23.538 INFO:tasks.workunit.client.0.smithi157.stdout:3/588: dwrite d8/d13/d1b/f1d [4194304,4194304] 0 2024-04-03T08:39:23.541 INFO:tasks.workunit.client.0.smithi157.stdout:6/664: creat d1/d4b/d61/d92/fe4 x:0 0 0 2024-04-03T08:39:23.544 INFO:tasks.workunit.client.0.smithi157.stdout:5/667: dwrite dc/f59 [0,4194304] 0 2024-04-03T08:39:23.549 INFO:tasks.workunit.client.1.smithi181.stdout:1/469: dwrite d10/d15/d17/d23/d27/f87 [0,4194304] 0 2024-04-03T08:39:23.557 INFO:tasks.workunit.client.0.smithi157.stdout:8/652: creat d2/d11/d10/d24/d5b/fda x:0 0 0 2024-04-03T08:39:23.562 INFO:tasks.workunit.client.0.smithi157.stdout:9/591: write d1/d15/d27/f39 [166224,46715] 0 2024-04-03T08:39:23.571 INFO:tasks.workunit.client.0.smithi157.stdout:7/676: mknod d0/d11/d15/d17/d43/d8a/d8f/dee/cf7 0 2024-04-03T08:39:23.576 INFO:tasks.workunit.client.0.smithi157.stdout:4/614: fdatasync da/df/d2f/d54/f5a 0 2024-04-03T08:39:23.578 INFO:tasks.workunit.client.0.smithi157.stdout:3/589: dread d8/d1e/d2d/d3b/f6e [0,4194304] 0 2024-04-03T08:39:23.578 INFO:tasks.workunit.client.0.smithi157.stdout:6/665: symlink d1/d4b/d61/d92/dd6/le5 0 2024-04-03T08:39:23.585 INFO:tasks.workunit.client.0.smithi157.stdout:7/677: read d0/d11/d15/d17/d52/f5a [1647162,124067] 0 2024-04-03T08:39:23.585 INFO:tasks.workunit.client.0.smithi157.stdout:7/678: fdatasync d0/d11/fed 0 2024-04-03T08:39:23.586 INFO:tasks.workunit.client.0.smithi157.stdout:7/679: chown d0/d11/d15/d17/d43 1618818 1 2024-04-03T08:39:23.590 INFO:tasks.workunit.client.0.smithi157.stdout:4/615: mkdir da/df/d2f/d97/dd6 0 2024-04-03T08:39:23.592 INFO:tasks.workunit.client.0.smithi157.stdout:5/668: write dc/f13 [7157383,38347] 0 2024-04-03T08:39:23.593 INFO:tasks.workunit.client.0.smithi157.stdout:8/653: mkdir d2/d11/d10/d24/d5b/d2e/d94/ddb 0 2024-04-03T08:39:23.595 INFO:tasks.workunit.client.0.smithi157.stdout:6/666: rmdir d1/d5 39 2024-04-03T08:39:23.602 INFO:tasks.workunit.client.0.smithi157.stdout:3/590: creat d8/d1e/d2d/d3b/d9e/fd2 x:0 0 0 2024-04-03T08:39:23.602 INFO:tasks.workunit.client.0.smithi157.stdout:9/592: creat d1/fcd x:0 0 0 2024-04-03T08:39:23.603 INFO:tasks.workunit.client.1.smithi181.stdout:5/477: rmdir d4/d22/d53 39 2024-04-03T08:39:23.604 INFO:tasks.workunit.client.1.smithi181.stdout:6/487: mkdir d6/d3e/d5e/d7c/d9/d7f/d95 0 2024-04-03T08:39:23.605 INFO:tasks.workunit.client.0.smithi157.stdout:7/680: read d0/d4/da5/fb2 [569671,82732] 0 2024-04-03T08:39:23.606 INFO:tasks.workunit.client.0.smithi157.stdout:5/669: creat dc/dbb/fe3 x:0 0 0 2024-04-03T08:39:23.608 INFO:tasks.workunit.client.0.smithi157.stdout:4/616: truncate da/df/d6b/f94 593123 0 2024-04-03T08:39:23.613 INFO:tasks.workunit.client.0.smithi157.stdout:8/654: truncate d2/d11/d10/d24/d5b/d2e/f38 3527870 0 2024-04-03T08:39:23.614 INFO:tasks.workunit.client.1.smithi181.stdout:2/523: chown d13/d1c/c80 236457978 1 2024-04-03T08:39:23.621 INFO:tasks.workunit.client.1.smithi181.stdout:0/473: creat d5/dc/d75/f91 x:0 0 0 2024-04-03T08:39:23.621 INFO:tasks.workunit.client.0.smithi157.stdout:0/613: sync 2024-04-03T08:39:23.622 INFO:tasks.workunit.client.0.smithi157.stdout:6/667: mknod d1/d4b/da5/dc7/ce6 0 2024-04-03T08:39:23.625 INFO:tasks.workunit.client.0.smithi157.stdout:4/617: rmdir da/d26 39 2024-04-03T08:39:23.628 INFO:tasks.workunit.client.0.smithi157.stdout:7/681: rmdir d0/d11/d15/d17/d1c/d4f/d5f 39 2024-04-03T08:39:23.632 INFO:tasks.workunit.client.0.smithi157.stdout:3/591: getdents d8/d1e/d2d/d3b/d9e/dcd 0 2024-04-03T08:39:23.634 INFO:tasks.workunit.client.0.smithi157.stdout:9/593: write d1/d4a/d4d/f95 [4055249,53623] 0 2024-04-03T08:39:23.636 INFO:tasks.workunit.client.0.smithi157.stdout:5/670: dwrite dc/d29/d56/d52/d9d/da5/daa/fd0 [0,4194304] 0 2024-04-03T08:39:23.638 INFO:tasks.workunit.client.0.smithi157.stdout:8/655: creat d2/d20/db1/fdc x:0 0 0 2024-04-03T08:39:23.642 INFO:tasks.workunit.client.0.smithi157.stdout:6/668: creat d1/d4b/d61/d92/fe7 x:0 0 0 2024-04-03T08:39:23.651 INFO:tasks.workunit.client.1.smithi181.stdout:7/428: dwrite d0/f50 [0,4194304] 0 2024-04-03T08:39:23.652 INFO:tasks.workunit.client.1.smithi181.stdout:2/524: dread d13/d1c/d4a/d68/f86 [0,4194304] 0 2024-04-03T08:39:23.653 INFO:tasks.workunit.client.0.smithi157.stdout:7/682: mknod d0/d11/d15/d1b/cf8 0 2024-04-03T08:39:23.659 INFO:tasks.workunit.client.0.smithi157.stdout:3/592: mknod d8/d1e/d2d/d3f/d4d/d8f/cd3 0 2024-04-03T08:39:23.659 INFO:tasks.workunit.client.1.smithi181.stdout:5/478: write d4/d18/d55/d5a/f89 [515264,25563] 0 2024-04-03T08:39:23.659 INFO:tasks.workunit.client.1.smithi181.stdout:6/488: creat d6/d31/d36/f96 x:0 0 0 2024-04-03T08:39:23.659 INFO:tasks.workunit.client.1.smithi181.stdout:8/408: creat d4/d44/f8d x:0 0 0 2024-04-03T08:39:23.668 INFO:tasks.workunit.client.1.smithi181.stdout:0/474: unlink d5/dc/d10/f38 0 2024-04-03T08:39:23.669 INFO:tasks.workunit.client.1.smithi181.stdout:0/475: stat d5/dc/d10/f27 0 2024-04-03T08:39:23.670 INFO:tasks.workunit.client.1.smithi181.stdout:0/476: readlink d5/dc/d14/d29/l7d 0 2024-04-03T08:39:23.674 INFO:tasks.workunit.client.0.smithi157.stdout:7/683: unlink d0/d11/d6f/c99 0 2024-04-03T08:39:23.677 INFO:tasks.workunit.client.0.smithi157.stdout:8/656: mkdir d2/ddd 0 2024-04-03T08:39:23.677 INFO:tasks.workunit.client.0.smithi157.stdout:6/669: truncate d1/d5/d17/d2a/d37/dca/fe3 9578990 0 2024-04-03T08:39:23.680 INFO:tasks.workunit.client.1.smithi181.stdout:1/470: mkdir d10/d15/d41/d8c/d8d 0 2024-04-03T08:39:23.681 INFO:tasks.workunit.client.1.smithi181.stdout:2/525: symlink d13/d1c/d73/lc2 0 2024-04-03T08:39:23.684 INFO:tasks.workunit.client.1.smithi181.stdout:6/489: mkdir d6/d53/d8d/d97 0 2024-04-03T08:39:23.684 INFO:tasks.workunit.client.1.smithi181.stdout:8/409: mkdir d4/d45/db/d14/d31/d1c/d8e 0 2024-04-03T08:39:23.686 INFO:tasks.workunit.client.1.smithi181.stdout:4/534: rmdir d1/d16/daf 0 2024-04-03T08:39:23.686 INFO:tasks.workunit.client.1.smithi181.stdout:8/410: chown d4/f88 29845 1 2024-04-03T08:39:23.689 INFO:tasks.workunit.client.0.smithi157.stdout:8/657: chown d2/d11/d10/d24/d5b/f1c 3 1 2024-04-03T08:39:23.690 INFO:tasks.workunit.client.0.smithi157.stdout:0/614: dread d2/d9/dc/df/d1b/d35/f66 [0,4194304] 0 2024-04-03T08:39:23.694 INFO:tasks.workunit.client.0.smithi157.stdout:9/594: dwrite d1/f1b [0,4194304] 0 2024-04-03T08:39:23.700 INFO:tasks.workunit.client.1.smithi181.stdout:3/489: write d0/d5/fa [950617,80269] 0 2024-04-03T08:39:23.703 INFO:tasks.workunit.client.0.smithi157.stdout:4/618: dwrite da/f1e [0,4194304] 0 2024-04-03T08:39:23.704 INFO:tasks.workunit.client.0.smithi157.stdout:9/595: stat d1/d15/d27/d5c/faa 0 2024-04-03T08:39:23.704 INFO:tasks.workunit.client.1.smithi181.stdout:1/471: fdatasync d10/d15/d17/d30/f55 0 2024-04-03T08:39:23.706 INFO:tasks.workunit.client.0.smithi157.stdout:5/671: truncate dc/d29/d56/d52/d9d/da5/daa/fd0 2947189 0 2024-04-03T08:39:23.708 INFO:tasks.workunit.client.1.smithi181.stdout:1/472: truncate d10/d15/d4a/d6f/f7a 803402 0 2024-04-03T08:39:23.709 INFO:tasks.workunit.client.0.smithi157.stdout:3/593: write d8/d13/f15 [724732,1888] 0 2024-04-03T08:39:23.710 INFO:tasks.workunit.client.1.smithi181.stdout:6/490: creat d6/d7b/f98 x:0 0 0 2024-04-03T08:39:23.711 INFO:tasks.workunit.client.1.smithi181.stdout:1/473: dread - d10/d15/d17/d30/f55 zero size 2024-04-03T08:39:23.711 INFO:tasks.workunit.client.1.smithi181.stdout:7/429: rmdir d0/d86 0 2024-04-03T08:39:23.712 INFO:tasks.workunit.client.1.smithi181.stdout:4/535: chown d1/d16/d37/d34/d69/c96 15051 1 2024-04-03T08:39:23.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/491: truncate d6/d7b/f98 25583 0 2024-04-03T08:39:23.725 INFO:tasks.workunit.client.0.smithi157.stdout:8/658: mknod d2/d6f/d70/d89/d59/cde 0 2024-04-03T08:39:23.726 INFO:tasks.workunit.client.1.smithi181.stdout:0/477: dwrite f2 [0,4194304] 0 2024-04-03T08:39:23.730 INFO:tasks.workunit.client.0.smithi157.stdout:6/670: write d1/d4b/da5/fa9 [9180894,112607] 0 2024-04-03T08:39:23.730 INFO:tasks.workunit.client.1.smithi181.stdout:4/536: symlink d1/d16/d55/lb0 0 2024-04-03T08:39:23.735 INFO:tasks.workunit.client.1.smithi181.stdout:1/474: rename d10/d15/f80 to d10/d15/d4a/d6f/f8e 0 2024-04-03T08:39:23.737 INFO:tasks.workunit.client.0.smithi157.stdout:8/659: dread - d2/d11/d10/d24/d5b/d2e/d75/d81/f96 zero size 2024-04-03T08:39:23.738 INFO:tasks.workunit.client.1.smithi181.stdout:2/526: write fa [1215465,44765] 0 2024-04-03T08:39:23.744 INFO:tasks.workunit.client.1.smithi181.stdout:7/430: creat d0/d1/d6/de/d17/d64/d85/f98 x:0 0 0 2024-04-03T08:39:23.746 INFO:tasks.workunit.client.1.smithi181.stdout:3/490: mknod d0/d5/d6/dd/d5f/d95/ca3 0 2024-04-03T08:39:23.746 INFO:tasks.workunit.client.0.smithi157.stdout:6/671: write d1/d5/d17/d2a/d37/f8e [565500,49997] 0 2024-04-03T08:39:23.747 INFO:tasks.workunit.client.1.smithi181.stdout:3/491: stat d0/d17 0 2024-04-03T08:39:23.747 INFO:tasks.workunit.client.1.smithi181.stdout:7/431: rename d0/d1/d6/de/d17/d27 to d0/d1/d6/de/d17/d27/d99 22 2024-04-03T08:39:23.748 INFO:tasks.workunit.client.1.smithi181.stdout:3/492: chown d0/d5/d6/l58 61793660 1 2024-04-03T08:39:23.749 INFO:tasks.workunit.client.0.smithi157.stdout:7/684: dwrite d0/d11/d6f/d89/d8c/dc6/fe8 [0,4194304] 0 2024-04-03T08:39:23.749 INFO:tasks.workunit.client.1.smithi181.stdout:3/493: dread - d0/d17/d63/d81/fa1 zero size 2024-04-03T08:39:23.751 INFO:tasks.workunit.client.1.smithi181.stdout:6/492: creat d6/d3e/d5e/d7c/d9/d7f/f99 x:0 0 0 2024-04-03T08:39:23.752 INFO:tasks.workunit.client.0.smithi157.stdout:6/672: readlink d1/d4b/d61/d92/dd6/le5 0 2024-04-03T08:39:23.753 INFO:tasks.workunit.client.0.smithi157.stdout:0/615: dwrite d2/f50 [0,4194304] 0 2024-04-03T08:39:23.755 INFO:tasks.workunit.client.1.smithi181.stdout:6/493: read d6/d3e/d5e/d7c/d9/d22/d4f/f55 [383002,58893] 0 2024-04-03T08:39:23.755 INFO:tasks.workunit.client.1.smithi181.stdout:5/479: link d4/l1f d4/d18/d2c/l9c 0 2024-04-03T08:39:23.755 INFO:tasks.workunit.client.0.smithi157.stdout:6/673: readlink d1/d4b/d38/l5f 0 2024-04-03T08:39:23.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/480: dread - d4/d44/f92 zero size 2024-04-03T08:39:23.762 INFO:tasks.workunit.client.0.smithi157.stdout:0/616: readlink d2/d9/dc/df/d1b/d4a/d31/lcb 0 2024-04-03T08:39:23.763 INFO:tasks.workunit.client.1.smithi181.stdout:7/432: dwrite d0/d1/d6/de/d57/f7a [0,4194304] 0 2024-04-03T08:39:23.764 INFO:tasks.workunit.client.0.smithi157.stdout:9/596: dwrite d1/d15/d27/d5c/d79/f99 [0,4194304] 0 2024-04-03T08:39:23.766 INFO:tasks.workunit.client.1.smithi181.stdout:7/433: stat d0/c75 0 2024-04-03T08:39:23.766 INFO:tasks.workunit.client.1.smithi181.stdout:1/475: symlink d10/d15/d17/d30/l8f 0 2024-04-03T08:39:23.767 INFO:tasks.workunit.client.1.smithi181.stdout:4/537: write d1/d1e/d78/f97 [623360,103918] 0 2024-04-03T08:39:23.768 INFO:tasks.workunit.client.0.smithi157.stdout:3/594: dread d8/d13/d1b/d4e/da6/f89 [0,4194304] 0 2024-04-03T08:39:23.769 INFO:tasks.workunit.client.1.smithi181.stdout:7/434: chown d0/d1/d6/de/d6d/d96 4026 1 2024-04-03T08:39:23.770 INFO:tasks.workunit.client.1.smithi181.stdout:3/494: dwrite d0/d5/d77/f8f [0,4194304] 0 2024-04-03T08:39:23.773 INFO:tasks.workunit.client.1.smithi181.stdout:2/527: mknod d13/da7/d40/cc3 0 2024-04-03T08:39:23.774 INFO:tasks.workunit.client.1.smithi181.stdout:4/538: write d1/d16/d37/d34/f35 [2536776,123559] 0 2024-04-03T08:39:23.775 INFO:tasks.workunit.client.1.smithi181.stdout:7/435: fsync d0/d1/d6/f80 0 2024-04-03T08:39:23.775 INFO:tasks.workunit.client.1.smithi181.stdout:6/494: symlink d6/d31/d36/d73/l9a 0 2024-04-03T08:39:23.776 INFO:tasks.workunit.client.1.smithi181.stdout:0/478: mkdir d5/d9/d2e/d92 0 2024-04-03T08:39:23.776 INFO:tasks.workunit.client.1.smithi181.stdout:3/495: fsync d0/d17/d36/d3b/d5a/f97 0 2024-04-03T08:39:23.779 INFO:tasks.workunit.client.1.smithi181.stdout:5/481: truncate d4/d18/f83 2131366 0 2024-04-03T08:39:23.780 INFO:tasks.workunit.client.1.smithi181.stdout:6/495: chown d6/d53/d80/f68 1464611 1 2024-04-03T08:39:23.783 INFO:tasks.workunit.client.1.smithi181.stdout:4/539: readlink d1/d16/d24/d5e/d3f/d41/la6 0 2024-04-03T08:39:23.784 INFO:tasks.workunit.client.1.smithi181.stdout:9/531: sync 2024-04-03T08:39:23.788 INFO:tasks.workunit.client.1.smithi181.stdout:0/479: mknod d5/d9/d2a/c93 0 2024-04-03T08:39:23.795 INFO:tasks.workunit.client.1.smithi181.stdout:1/476: creat d10/d15/d17/d23/f90 x:0 0 0 2024-04-03T08:39:23.798 INFO:tasks.workunit.client.1.smithi181.stdout:2/528: creat d13/da7/fc4 x:0 0 0 2024-04-03T08:39:23.802 INFO:tasks.workunit.client.1.smithi181.stdout:3/496: rename d0/d17/d36/c8d to d0/d17/d36/d3b/d5a/d93/ca4 0 2024-04-03T08:39:23.803 INFO:tasks.workunit.client.0.smithi157.stdout:5/672: fsync dc/f9c 0 2024-04-03T08:39:23.804 INFO:tasks.workunit.client.1.smithi181.stdout:9/532: creat d1/da/d13/d41/fa9 x:0 0 0 2024-04-03T08:39:23.805 INFO:tasks.workunit.client.1.smithi181.stdout:7/436: dwrite d0/d1/f74 [0,4194304] 0 2024-04-03T08:39:23.806 INFO:tasks.workunit.client.1.smithi181.stdout:3/497: stat d0/d17/d63/f76 0 2024-04-03T08:39:23.808 INFO:tasks.workunit.client.1.smithi181.stdout:9/533: readlink d1/da/d13/l25 0 2024-04-03T08:39:23.810 INFO:tasks.workunit.client.1.smithi181.stdout:1/477: fdatasync d10/d15/f34 0 2024-04-03T08:39:23.811 INFO:tasks.workunit.client.0.smithi157.stdout:9/597: mknod d1/d15/d27/daf/cce 0 2024-04-03T08:39:23.813 INFO:tasks.workunit.client.1.smithi181.stdout:2/529: creat d13/d1c/d73/fc5 x:0 0 0 2024-04-03T08:39:23.816 INFO:tasks.workunit.client.0.smithi157.stdout:0/617: rename d2/d9/dc/df/d1b/d35/d3d/lb7 to d2/d9/dc/df/d1b/d4a/le2 0 2024-04-03T08:39:23.817 INFO:tasks.workunit.client.1.smithi181.stdout:2/530: dread - d13/da7/d27/d2f/d5d/fc0 zero size 2024-04-03T08:39:23.818 INFO:tasks.workunit.client.1.smithi181.stdout:9/534: truncate d1/da/d28/d80/fa1 334733 0 2024-04-03T08:39:23.825 INFO:tasks.workunit.client.1.smithi181.stdout:7/437: mkdir d0/d1/d6/de/d17/d64/d85/d9a 0 2024-04-03T08:39:23.826 INFO:tasks.workunit.client.1.smithi181.stdout:3/498: dwrite d0/d5/d77/f8f [0,4194304] 0 2024-04-03T08:39:23.827 INFO:tasks.workunit.client.1.smithi181.stdout:3/499: chown d0/d5/d6/c8e 27 1 2024-04-03T08:39:23.829 INFO:tasks.workunit.client.0.smithi157.stdout:8/660: creat d2/ddd/fdf x:0 0 0 2024-04-03T08:39:23.832 INFO:tasks.workunit.client.1.smithi181.stdout:1/478: mkdir d10/d15/d17/d23/d27/d91 0 2024-04-03T08:39:23.833 INFO:tasks.workunit.client.1.smithi181.stdout:2/531: mknod d13/d1c/da5/cc6 0 2024-04-03T08:39:23.834 INFO:tasks.workunit.client.0.smithi157.stdout:2/617: sync 2024-04-03T08:39:23.836 INFO:tasks.workunit.client.1.smithi181.stdout:9/535: mkdir d1/da/d13/d22/d23/d36/d91/d9d/daa 0 2024-04-03T08:39:23.838 INFO:tasks.workunit.client.0.smithi157.stdout:0/618: mkdir d2/d9/dc/df/d6f/de3 0 2024-04-03T08:39:23.839 INFO:tasks.workunit.client.1.smithi181.stdout:0/480: link d5/dc/d10/d58/d6c/f5d d5/dc/d10/d30/f94 0 2024-04-03T08:39:23.843 INFO:tasks.workunit.client.1.smithi181.stdout:7/438: readlink d0/d1/d6/de/lf 0 2024-04-03T08:39:23.844 INFO:tasks.workunit.client.0.smithi157.stdout:5/673: mkdir dc/d29/d56/d9e/dc3/dde/de4 0 2024-04-03T08:39:23.845 INFO:tasks.workunit.client.1.smithi181.stdout:3/500: chown d0/d5/d6/d3f/l5c 0 1 2024-04-03T08:39:23.848 INFO:tasks.workunit.client.1.smithi181.stdout:5/482: dread d4/d22/d4a/f5b [0,4194304] 0 2024-04-03T08:39:23.849 INFO:tasks.workunit.client.1.smithi181.stdout:1/479: creat d10/d15/d17/d23/d27/f92 x:0 0 0 2024-04-03T08:39:23.849 INFO:tasks.workunit.client.1.smithi181.stdout:2/532: truncate d13/d1c/d4a/f57 1151889 0 2024-04-03T08:39:23.853 INFO:tasks.workunit.client.1.smithi181.stdout:9/536: truncate d1/da/d13/d41/d32/f51 1369029 0 2024-04-03T08:39:23.855 INFO:tasks.workunit.client.0.smithi157.stdout:0/619: rename d2/d9/dc/df/d9b to d2/d9/dc/df/d1b/d4a/de4 0 2024-04-03T08:39:23.858 INFO:tasks.workunit.client.0.smithi157.stdout:8/661: symlink d2/d11/d10/d24/d5b/le0 0 2024-04-03T08:39:23.860 INFO:tasks.workunit.client.1.smithi181.stdout:3/501: symlink d0/d5/d6/d3f/la5 0 2024-04-03T08:39:23.862 INFO:tasks.workunit.client.0.smithi157.stdout:5/674: truncate dc/d29/f38 2972627 0 2024-04-03T08:39:23.867 INFO:tasks.workunit.client.1.smithi181.stdout:5/483: symlink d4/d80/l9d 0 2024-04-03T08:39:23.867 INFO:tasks.workunit.client.1.smithi181.stdout:5/484: dread - d4/d18/d55/d5a/f8f zero size 2024-04-03T08:39:23.867 INFO:tasks.workunit.client.1.smithi181.stdout:6/496: write d6/d3e/d5e/d7c/d50/f54 [1630670,9160] 0 2024-04-03T08:39:23.868 INFO:tasks.workunit.client.0.smithi157.stdout:9/598: link d1/d15/d27/daf/da7/fbb d1/d15/d27/d5c/fcf 0 2024-04-03T08:39:23.868 INFO:tasks.workunit.client.0.smithi157.stdout:5/675: write dc/d29/d56/d9e/fb8 [160783,130526] 0 2024-04-03T08:39:23.871 INFO:tasks.workunit.client.0.smithi157.stdout:2/618: mknod d3/d12/ce2 0 2024-04-03T08:39:23.871 INFO:tasks.workunit.client.1.smithi181.stdout:2/533: mknod d13/da7/d27/cc7 0 2024-04-03T08:39:23.872 INFO:tasks.workunit.client.0.smithi157.stdout:9/599: read d1/d15/d16/f65 [4185869,86243] 0 2024-04-03T08:39:23.875 INFO:tasks.workunit.client.0.smithi157.stdout:0/620: rmdir d2/d9/d36/d38 39 2024-04-03T08:39:23.876 INFO:tasks.workunit.client.0.smithi157.stdout:9/600: write d1/d15/d27/f49 [3616798,127745] 0 2024-04-03T08:39:23.879 INFO:tasks.workunit.client.1.smithi181.stdout:4/540: dwrite d1/d16/d24/d5e/d31/f75 [0,4194304] 0 2024-04-03T08:39:23.880 INFO:tasks.workunit.client.1.smithi181.stdout:3/502: symlink d0/d17/d36/d3b/d5a/la6 0 2024-04-03T08:39:23.881 INFO:tasks.workunit.client.1.smithi181.stdout:8/411: sync 2024-04-03T08:39:23.884 INFO:tasks.workunit.client.0.smithi157.stdout:5/676: mknod dc/d29/d43/da1/ce5 0 2024-04-03T08:39:23.886 INFO:tasks.workunit.client.0.smithi157.stdout:7/685: write d0/d11/d15/d17/f7c [260191,39823] 0 2024-04-03T08:39:23.886 INFO:tasks.workunit.client.1.smithi181.stdout:6/497: rmdir d6/d3e/d5e/d7c/d50/d5b 39 2024-04-03T08:39:23.886 INFO:tasks.workunit.client.1.smithi181.stdout:6/498: chown d6/d31 66501240 1 2024-04-03T08:39:23.887 INFO:tasks.workunit.client.0.smithi157.stdout:2/619: mkdir d3/d2e/d32/de3 0 2024-04-03T08:39:23.890 INFO:tasks.workunit.client.0.smithi157.stdout:2/620: readlink d3/d2e/d32/d9f/dbd/lc5 0 2024-04-03T08:39:23.890 INFO:tasks.workunit.client.0.smithi157.stdout:7/686: truncate d0/d4/da5/fdc 666368 0 2024-04-03T08:39:23.893 INFO:tasks.workunit.client.1.smithi181.stdout:0/481: rename d5/d9/d2a/f83 to d5/d9/f95 0 2024-04-03T08:39:23.896 INFO:tasks.workunit.client.0.smithi157.stdout:0/621: read d2/d9/dc/df/d1b/d4a/d31/faa [607782,34443] 0 2024-04-03T08:39:23.898 INFO:tasks.workunit.client.0.smithi157.stdout:0/622: chown d2/d9/dc/df/l11 237 1 2024-04-03T08:39:23.899 INFO:tasks.workunit.client.0.smithi157.stdout:9/601: rename d1/d4a/d4d/lb9 to d1/d15/d27/d34/dc7/ld0 0 2024-04-03T08:39:23.901 INFO:tasks.workunit.client.1.smithi181.stdout:5/485: symlink d4/d18/l9e 0 2024-04-03T08:39:23.905 INFO:tasks.workunit.client.0.smithi157.stdout:5/677: creat dc/d29/d56/d9e/db5/fe6 x:0 0 0 2024-04-03T08:39:23.906 INFO:tasks.workunit.client.1.smithi181.stdout:4/541: mkdir d1/d16/d24/d5e/d31/d39/db1 0 2024-04-03T08:39:23.907 INFO:tasks.workunit.client.1.smithi181.stdout:4/542: fsync d1/d16/d24/d5e/f45 0 2024-04-03T08:39:23.907 INFO:tasks.workunit.client.0.smithi157.stdout:2/621: symlink d3/da6/le4 0 2024-04-03T08:39:23.908 INFO:tasks.workunit.client.1.smithi181.stdout:1/480: creat d10/d15/d17/f93 x:0 0 0 2024-04-03T08:39:23.912 INFO:tasks.workunit.client.1.smithi181.stdout:2/534: fsync d13/d1c/d4a/d68/fb1 0 2024-04-03T08:39:23.915 INFO:tasks.workunit.client.0.smithi157.stdout:0/623: creat d2/d9/dc/df/d6f/d9d/d6a/fe5 x:0 0 0 2024-04-03T08:39:23.916 INFO:tasks.workunit.client.1.smithi181.stdout:7/439: rename d0/d1/d6/f80 to d0/d1/d6/de/d6d/d96/f9b 0 2024-04-03T08:39:23.918 INFO:tasks.workunit.client.1.smithi181.stdout:7/440: write d0/f54 [931306,39898] 0 2024-04-03T08:39:23.921 INFO:tasks.workunit.client.1.smithi181.stdout:7/441: read d0/d1/d6/de/d17/f38 [523502,124266] 0 2024-04-03T08:39:23.922 INFO:tasks.workunit.client.1.smithi181.stdout:1/481: dwrite d10/d15/d17/d19/d33/d70/f81 [0,4194304] 0 2024-04-03T08:39:23.923 INFO:tasks.workunit.client.1.smithi181.stdout:0/482: unlink d5/dc/d10/d58/d6c/f53 0 2024-04-03T08:39:23.924 INFO:tasks.workunit.client.1.smithi181.stdout:1/482: chown d10/d15/d17/d23/d27 247 1 2024-04-03T08:39:23.924 INFO:tasks.workunit.client.0.smithi157.stdout:3/595: dwrite d8/d1e/d2d/d3b/d8c/f9c [0,4194304] 0 2024-04-03T08:39:23.925 INFO:tasks.workunit.client.1.smithi181.stdout:0/483: chown d5/d9/f3e 130779 1 2024-04-03T08:39:23.926 INFO:tasks.workunit.client.1.smithi181.stdout:1/483: write d10/d15/d17/d23/f90 [15071,81819] 0 2024-04-03T08:39:23.927 INFO:tasks.workunit.client.0.smithi157.stdout:9/602: dwrite d1/d15/d16/f3a [4194304,4194304] 0 2024-04-03T08:39:23.931 INFO:tasks.workunit.client.1.smithi181.stdout:5/486: creat d4/d18/d25/d59/d81/f9f x:0 0 0 2024-04-03T08:39:23.945 INFO:tasks.workunit.client.1.smithi181.stdout:4/543: unlink d1/fa4 0 2024-04-03T08:39:23.954 INFO:tasks.workunit.client.1.smithi181.stdout:8/412: symlink d4/d45/db/d14/d31/d1c/d51/d87/l8f 0 2024-04-03T08:39:23.955 INFO:tasks.workunit.client.0.smithi157.stdout:8/662: link d2/d7b/ccc d2/d11/d10/d24/d5b/d2e/d75/ce1 0 2024-04-03T08:39:23.958 INFO:tasks.workunit.client.0.smithi157.stdout:1/571: sync 2024-04-03T08:39:23.960 INFO:tasks.workunit.client.1.smithi181.stdout:2/535: readlink d13/d1c/d73/d8b/la9 0 2024-04-03T08:39:23.962 INFO:tasks.workunit.client.0.smithi157.stdout:1/572: dread - d2/d11/d24/d39/d3b/d1b/d7f/fb1 zero size 2024-04-03T08:39:23.962 INFO:tasks.workunit.client.0.smithi157.stdout:5/678: fsync dc/d29/f46 0 2024-04-03T08:39:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:8/663: dread d2/d6f/f71 [0,4194304] 0 2024-04-03T08:39:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:7/687: write d0/d11/d15/d17/d1c/d88/fc5 [687221,37784] 0 2024-04-03T08:39:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:2/622: truncate d3/d12/f68 1207628 0 2024-04-03T08:39:23.973 INFO:tasks.workunit.client.0.smithi157.stdout:7/688: chown d0/d11/d15/d17/d43/d8a/d8f 4085494 1 2024-04-03T08:39:23.973 INFO:tasks.workunit.client.0.smithi157.stdout:2/623: write d3/db/d44/d4c/d5a/d88/f8c [3929439,91416] 0 2024-04-03T08:39:23.975 INFO:tasks.workunit.client.0.smithi157.stdout:7/689: fsync d0/d11/d15/f2e 0 2024-04-03T08:39:23.977 INFO:tasks.workunit.client.0.smithi157.stdout:2/624: fdatasync d3/d2e/d32/d9f/fcc 0 2024-04-03T08:39:23.980 INFO:tasks.workunit.client.0.smithi157.stdout:3/596: rename d8/d1e/d2d/d3f/f44 to d8/d13/d1b/d83/fd4 0 2024-04-03T08:39:23.981 INFO:tasks.workunit.client.1.smithi181.stdout:7/442: creat d0/d1/d6/de/d6d/d96/f9c x:0 0 0 2024-04-03T08:39:23.984 INFO:tasks.workunit.client.0.smithi157.stdout:9/603: symlink d1/d15/dca/ld1 0 2024-04-03T08:39:23.986 INFO:tasks.workunit.client.0.smithi157.stdout:9/604: chown d1/d36/d46 3 1 2024-04-03T08:39:23.986 INFO:tasks.workunit.client.1.smithi181.stdout:0/484: fdatasync d5/d9/f28 0 2024-04-03T08:39:23.988 INFO:tasks.workunit.client.0.smithi157.stdout:9/605: write d1/d15/fc9 [26807,21143] 0 2024-04-03T08:39:23.989 INFO:tasks.workunit.client.1.smithi181.stdout:5/487: chown d4/ce 4013 1 2024-04-03T08:39:23.991 INFO:tasks.workunit.client.1.smithi181.stdout:3/503: creat d0/d17/fa7 x:0 0 0 2024-04-03T08:39:23.991 INFO:tasks.workunit.client.0.smithi157.stdout:8/664: dread - d2/d20/db1/fd7 zero size 2024-04-03T08:39:23.992 INFO:tasks.workunit.client.1.smithi181.stdout:3/504: read d0/d5/f38 [1425436,78193] 0 2024-04-03T08:39:23.995 INFO:tasks.workunit.client.0.smithi157.stdout:2/625: dread d3/d2e/d65/dae/fdb [0,4194304] 0 2024-04-03T08:39:23.995 INFO:tasks.workunit.client.1.smithi181.stdout:4/544: mkdir d1/d16/d37/d34/db2 0 2024-04-03T08:39:23.996 INFO:tasks.workunit.client.0.smithi157.stdout:7/690: mknod d0/d75/cf9 0 2024-04-03T08:39:24.000 INFO:tasks.workunit.client.0.smithi157.stdout:7/691: read d0/d11/d15/d17/d1c/d88/fc5 [228135,61460] 0 2024-04-03T08:39:24.001 INFO:tasks.workunit.client.1.smithi181.stdout:2/536: creat d13/d1c/d4a/d68/d72/fc8 x:0 0 0 2024-04-03T08:39:24.005 INFO:tasks.workunit.client.0.smithi157.stdout:1/573: mkdir d2/d11/d24/d39/d3b/d2e/d48/d5d/db4/dbc 0 2024-04-03T08:39:24.008 INFO:tasks.workunit.client.0.smithi157.stdout:0/624: getdents d2/d9/dc/df/d1b/d4a/d31 0 2024-04-03T08:39:24.010 INFO:tasks.workunit.client.1.smithi181.stdout:7/443: mknod d0/d1/d6/de/d17/d64/d85/c9d 0 2024-04-03T08:39:24.011 INFO:tasks.workunit.client.0.smithi157.stdout:9/606: fdatasync d1/d36/d69/f6e 0 2024-04-03T08:39:24.012 INFO:tasks.workunit.client.1.smithi181.stdout:7/444: write d0/d1/d6/de/d57/f7a [104339,75917] 0 2024-04-03T08:39:24.014 INFO:tasks.workunit.client.0.smithi157.stdout:8/665: fdatasync d2/d6f/d70/f7e 0 2024-04-03T08:39:24.014 INFO:tasks.workunit.client.1.smithi181.stdout:7/445: chown d0/d1/d6/de/d6d/f6e 9619471 1 2024-04-03T08:39:24.016 INFO:tasks.workunit.client.1.smithi181.stdout:5/488: creat d4/d18/d25/d59/d81/fa0 x:0 0 0 2024-04-03T08:39:24.018 INFO:tasks.workunit.client.1.smithi181.stdout:5/489: write d4/d18/d55/d5a/f89 [1397382,12587] 0 2024-04-03T08:39:24.018 INFO:tasks.workunit.client.0.smithi157.stdout:2/626: symlink d3/db/d44/d4c/d5a/le5 0 2024-04-03T08:39:24.022 INFO:tasks.workunit.client.1.smithi181.stdout:8/413: symlink d4/d2a/d37/d67/l90 0 2024-04-03T08:39:24.024 INFO:tasks.workunit.client.1.smithi181.stdout:8/414: read - d4/d45/db/f58 zero size 2024-04-03T08:39:24.025 INFO:tasks.workunit.client.1.smithi181.stdout:8/415: dread - d4/d44/f82 zero size 2024-04-03T08:39:24.026 INFO:tasks.workunit.client.0.smithi157.stdout:7/692: write d0/d11/d15/d1b/db8/fce [1539482,21952] 0 2024-04-03T08:39:24.027 INFO:tasks.workunit.client.1.smithi181.stdout:8/416: write d4/d44/d59/d5f/f75 [1031126,3140] 0 2024-04-03T08:39:24.028 INFO:tasks.workunit.client.1.smithi181.stdout:8/417: fdatasync d4/d44/f77 0 2024-04-03T08:39:24.030 INFO:tasks.workunit.client.1.smithi181.stdout:9/537: rename d1/da/d13/d22/f6c to d1/da/fab 0 2024-04-03T08:39:24.031 INFO:tasks.workunit.client.0.smithi157.stdout:2/627: read d3/d12/d43/d4b/d55/f95 [1338663,22893] 0 2024-04-03T08:39:24.036 INFO:tasks.workunit.client.0.smithi157.stdout:7/693: chown d0/d11/d15/d1b/f59 462922 1 2024-04-03T08:39:24.037 INFO:tasks.workunit.client.0.smithi157.stdout:0/625: dwrite d2/d9/d36/fce [0,4194304] 0 2024-04-03T08:39:24.038 INFO:tasks.workunit.client.1.smithi181.stdout:1/484: creat d10/d15/d17/f94 x:0 0 0 2024-04-03T08:39:24.040 INFO:tasks.workunit.client.0.smithi157.stdout:3/597: dwrite d8/f2c [0,4194304] 0 2024-04-03T08:39:24.042 INFO:tasks.workunit.client.1.smithi181.stdout:3/505: dread d0/d17/f54 [0,4194304] 0 2024-04-03T08:39:24.044 INFO:tasks.workunit.client.1.smithi181.stdout:8/418: dwrite d4/d45/db/d14/d31/d1c/f2c [0,4194304] 0 2024-04-03T08:39:24.045 INFO:tasks.workunit.client.1.smithi181.stdout:7/446: rmdir d0/d1/d6/de 39 2024-04-03T08:39:24.046 INFO:tasks.workunit.client.1.smithi181.stdout:3/506: write d0/d5/d77/f8f [1454318,29556] 0 2024-04-03T08:39:24.050 INFO:tasks.workunit.client.1.smithi181.stdout:5/490: symlink d4/d18/d25/d59/d81/d90/la1 0 2024-04-03T08:39:24.051 INFO:tasks.workunit.client.0.smithi157.stdout:8/666: read - d2/fad zero size 2024-04-03T08:39:24.059 INFO:tasks.workunit.client.1.smithi181.stdout:3/507: dread d0/d17/d36/d1e/f7e [0,4194304] 0 2024-04-03T08:39:24.063 INFO:tasks.workunit.client.1.smithi181.stdout:1/485: creat d10/d15/d17/d23/d27/f95 x:0 0 0 2024-04-03T08:39:24.065 INFO:tasks.workunit.client.0.smithi157.stdout:2/628: creat d3/d12/d43/d4b/fe6 x:0 0 0 2024-04-03T08:39:24.067 INFO:tasks.workunit.client.1.smithi181.stdout:1/486: read d10/f11 [2737999,14832] 0 2024-04-03T08:39:24.067 INFO:tasks.workunit.client.0.smithi157.stdout:2/629: fsync d3/d12/d43/f78 0 2024-04-03T08:39:24.068 INFO:tasks.workunit.client.1.smithi181.stdout:8/419: rmdir d4/d2a/d37 39 2024-04-03T08:39:24.070 INFO:tasks.workunit.client.0.smithi157.stdout:0/626: mkdir d2/d9/dc/df/d1b/d35/dc0/de6 0 2024-04-03T08:39:24.073 INFO:tasks.workunit.client.0.smithi157.stdout:7/694: fsync d0/d11/d15/d17/d52/f82 0 2024-04-03T08:39:24.074 INFO:tasks.workunit.client.0.smithi157.stdout:1/574: write d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 [2265635,46015] 0 2024-04-03T08:39:24.077 INFO:tasks.workunit.client.1.smithi181.stdout:4/545: creat d1/d16/d24/d5e/d3f/fb3 x:0 0 0 2024-04-03T08:39:24.079 INFO:tasks.workunit.client.0.smithi157.stdout:9/607: symlink d1/d15/d27/ld2 0 2024-04-03T08:39:24.080 INFO:tasks.workunit.client.1.smithi181.stdout:9/538: fsync d1/da/d13/d73/f7d 0 2024-04-03T08:39:24.081 INFO:tasks.workunit.client.0.smithi157.stdout:9/608: chown d1/d15/d27/d5c/d79 68441982 1 2024-04-03T08:39:24.082 INFO:tasks.workunit.client.0.smithi157.stdout:2/630: fsync d3/d12/d43/d4b/d55/f59 0 2024-04-03T08:39:24.083 INFO:tasks.workunit.client.1.smithi181.stdout:1/487: symlink d10/d15/d17/d19/d33/d70/l96 0 2024-04-03T08:39:24.083 INFO:tasks.workunit.client.0.smithi157.stdout:4/619: sync 2024-04-03T08:39:24.084 INFO:tasks.workunit.client.0.smithi157.stdout:6/674: sync 2024-04-03T08:39:24.090 INFO:tasks.workunit.client.1.smithi181.stdout:6/499: rename d6/d53/d8d/c8f to d6/d3e/d5e/d7c/d9/d22/c9b 0 2024-04-03T08:39:24.090 INFO:tasks.workunit.client.0.smithi157.stdout:8/667: mkdir d2/d20/db1/dbc/de2 0 2024-04-03T08:39:24.093 INFO:tasks.workunit.client.0.smithi157.stdout:9/609: dread d1/fe [0,4194304] 0 2024-04-03T08:39:24.094 INFO:tasks.workunit.client.0.smithi157.stdout:1/575: chown d2/d11/d24/l6b 212992337 1 2024-04-03T08:39:24.095 INFO:tasks.workunit.client.1.smithi181.stdout:4/546: dwrite d1/d16/d24/d5e/d31/f65 [4194304,4194304] 0 2024-04-03T08:39:24.097 INFO:tasks.workunit.client.1.smithi181.stdout:9/539: fdatasync d1/da/d13/d73/f7f 0 2024-04-03T08:39:24.102 INFO:tasks.workunit.client.0.smithi157.stdout:6/675: write d1/d5/fc2 [564647,51119] 0 2024-04-03T08:39:24.103 INFO:tasks.workunit.client.1.smithi181.stdout:8/420: mkdir d4/d2a/d37/d67/d91 0 2024-04-03T08:39:24.104 INFO:tasks.workunit.client.0.smithi157.stdout:6/676: dread - d1/fcb zero size 2024-04-03T08:39:24.105 INFO:tasks.workunit.client.0.smithi157.stdout:2/631: fsync d3/db/d44/d4c/d5a/d88/fb0 0 2024-04-03T08:39:24.107 INFO:tasks.workunit.client.1.smithi181.stdout:0/485: rename d5/dc/d14/l5f to d5/d9/d2e/l96 0 2024-04-03T08:39:24.108 INFO:tasks.workunit.client.0.smithi157.stdout:9/610: dread d1/d94/f73 [0,4194304] 0 2024-04-03T08:39:24.109 INFO:tasks.workunit.client.0.smithi157.stdout:3/598: rmdir d8/d1e/d2d/d39/d51/d48/da3 0 2024-04-03T08:39:24.111 INFO:tasks.workunit.client.0.smithi157.stdout:9/611: chown d1/l11 34069 1 2024-04-03T08:39:24.113 INFO:tasks.workunit.client.0.smithi157.stdout:3/599: chown d8/d13/d1b/d4e/d50/fc9 1 1 2024-04-03T08:39:24.115 INFO:tasks.workunit.client.0.smithi157.stdout:9/612: chown d1/d15/d27/d5c/d79/f9d 74231 1 2024-04-03T08:39:24.115 INFO:tasks.workunit.client.0.smithi157.stdout:3/600: chown d8/d1e/d2d/d3b/d9e 375949539 1 2024-04-03T08:39:24.116 INFO:tasks.workunit.client.0.smithi157.stdout:1/576: mknod d2/cbd 0 2024-04-03T08:39:24.117 INFO:tasks.workunit.client.0.smithi157.stdout:3/601: fdatasync d8/d13/fc3 0 2024-04-03T08:39:24.117 INFO:tasks.workunit.client.0.smithi157.stdout:1/577: chown d2/f49 1026763175 1 2024-04-03T08:39:24.118 INFO:tasks.workunit.client.1.smithi181.stdout:3/508: truncate d0/d5/d6/dd/f21 17780 0 2024-04-03T08:39:24.118 INFO:tasks.workunit.client.1.smithi181.stdout:5/491: dwrite d4/f3d [0,4194304] 0 2024-04-03T08:39:24.120 INFO:tasks.workunit.client.0.smithi157.stdout:0/627: link d2/f2c d2/d9/d51/d63/d71/fe7 0 2024-04-03T08:39:24.127 INFO:tasks.workunit.client.0.smithi157.stdout:2/632: mknod d3/d2e/d32/d9f/ce7 0 2024-04-03T08:39:24.129 INFO:tasks.workunit.client.1.smithi181.stdout:2/537: rename d13/da7/d27/c3c to d13/d1c/d73/cc9 0 2024-04-03T08:39:24.129 INFO:tasks.workunit.client.1.smithi181.stdout:1/488: dread d10/d15/d17/f21 [0,4194304] 0 2024-04-03T08:39:24.131 INFO:tasks.workunit.client.0.smithi157.stdout:2/633: fsync d3/db/d44/d4c/d5a/d88/d97/fce 0 2024-04-03T08:39:24.134 INFO:tasks.workunit.client.0.smithi157.stdout:4/620: link da/df/d2f/d97/f9a da/df/d2f/d54/d5f/fd7 0 2024-04-03T08:39:24.139 INFO:tasks.workunit.client.0.smithi157.stdout:6/677: truncate d1/f3 1566639 0 2024-04-03T08:39:24.139 INFO:tasks.workunit.client.1.smithi181.stdout:9/540: dwrite d1/da/d13/d73/f7f [0,4194304] 0 2024-04-03T08:39:24.141 INFO:tasks.workunit.client.0.smithi157.stdout:8/668: truncate d2/d11/d10/d24/d5b/d2e/f38 4248731 0 2024-04-03T08:39:24.142 INFO:tasks.workunit.client.1.smithi181.stdout:5/492: dwrite d4/d18/f83 [0,4194304] 0 2024-04-03T08:39:24.144 INFO:tasks.workunit.client.0.smithi157.stdout:9/613: readlink d1/d15/d27/d34/dc7/ld0 0 2024-04-03T08:39:24.151 INFO:tasks.workunit.client.1.smithi181.stdout:9/541: read d1/f5 [2403040,20804] 0 2024-04-03T08:39:24.152 INFO:tasks.workunit.client.0.smithi157.stdout:3/602: creat d8/d1e/d2d/d3f/d4d/d8f/fd5 x:0 0 0 2024-04-03T08:39:24.153 INFO:tasks.workunit.client.1.smithi181.stdout:0/486: chown d5/d9/d2e/l96 84294874 1 2024-04-03T08:39:24.155 INFO:tasks.workunit.client.1.smithi181.stdout:9/542: stat d1/da/d13/d41/c17 0 2024-04-03T08:39:24.155 INFO:tasks.workunit.client.0.smithi157.stdout:1/578: dread d2/d11/d23/f79 [4194304,4194304] 0 2024-04-03T08:39:24.158 INFO:tasks.workunit.client.1.smithi181.stdout:0/487: readlink d5/d9/l3f 0 2024-04-03T08:39:24.159 INFO:tasks.workunit.client.1.smithi181.stdout:4/547: rename d1/d1e/d2c/d67/f72 to d1/d16/d24/d5e/d3f/d6c/fb4 0 2024-04-03T08:39:24.162 INFO:tasks.workunit.client.1.smithi181.stdout:1/489: dwrite d10/d15/d41/f44 [0,4194304] 0 2024-04-03T08:39:24.162 INFO:tasks.workunit.client.1.smithi181.stdout:8/421: dwrite d4/d45/db/d14/f50 [0,4194304] 0 2024-04-03T08:39:24.164 INFO:tasks.workunit.client.0.smithi157.stdout:1/579: truncate d2/d11/d24/d39/d3b/d1b/d7f/faa 375237 0 2024-04-03T08:39:24.165 INFO:tasks.workunit.client.1.smithi181.stdout:1/490: readlink d10/d15/d17/d19/d33/d70/l88 0 2024-04-03T08:39:24.166 INFO:tasks.workunit.client.1.smithi181.stdout:8/422: truncate d4/d2a/d37/f3f 4934080 0 2024-04-03T08:39:24.169 INFO:tasks.workunit.client.1.smithi181.stdout:2/538: truncate d13/da7/d27/d2f/f5c 1145297 0 2024-04-03T08:39:24.170 INFO:tasks.workunit.client.0.smithi157.stdout:9/614: creat d1/d15/d27/daf/da7/fd3 x:0 0 0 2024-04-03T08:39:24.177 INFO:tasks.workunit.client.0.smithi157.stdout:2/634: rename d3/l17 to d3/d2e/d32/de3/le8 0 2024-04-03T08:39:24.178 INFO:tasks.workunit.client.1.smithi181.stdout:5/493: truncate d4/d18/f35 4618793 0 2024-04-03T08:39:24.186 INFO:tasks.workunit.client.1.smithi181.stdout:1/491: dwrite d10/d15/d17/d23/d27/f92 [0,4194304] 0 2024-04-03T08:39:24.190 INFO:tasks.workunit.client.0.smithi157.stdout:0/628: dwrite d2/d9/f57 [0,4194304] 0 2024-04-03T08:39:24.212 INFO:tasks.workunit.client.1.smithi181.stdout:1/492: dwrite d10/d15/d17/d23/f90 [0,4194304] 0 2024-04-03T08:39:24.264 INFO:tasks.workunit.client.1.smithi181.stdout:6/500: write d6/d3e/d5e/d7c/d50/d5b/f6a [2206698,47712] 0 2024-04-03T08:39:24.265 INFO:tasks.workunit.client.0.smithi157.stdout:6/678: truncate d1/d5/f1a 3799676 0 2024-04-03T08:39:24.267 INFO:tasks.workunit.client.1.smithi181.stdout:6/501: write d6/d31/d36/f33 [3038206,84212] 0 2024-04-03T08:39:24.270 INFO:tasks.workunit.client.1.smithi181.stdout:4/548: mkdir d1/d16/d24/db5 0 2024-04-03T08:39:24.276 INFO:tasks.workunit.client.1.smithi181.stdout:7/447: sync 2024-04-03T08:39:24.276 INFO:tasks.workunit.client.1.smithi181.stdout:8/423: sync 2024-04-03T08:39:24.282 INFO:tasks.workunit.client.1.smithi181.stdout:3/509: link d0/d17/d40/c64 d0/d5/d6/dd/ca8 0 2024-04-03T08:39:24.288 INFO:tasks.workunit.client.0.smithi157.stdout:6/679: rmdir d1/d5/d17/d29/da3/da8 39 2024-04-03T08:39:24.291 INFO:tasks.workunit.client.0.smithi157.stdout:9/615: mknod d1/d94/cd4 0 2024-04-03T08:39:24.297 INFO:tasks.workunit.client.0.smithi157.stdout:0/629: symlink d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/de1/le8 0 2024-04-03T08:39:24.303 INFO:tasks.workunit.client.0.smithi157.stdout:0/630: chown d2/d9/dc/l28 9496883 1 2024-04-03T08:39:24.305 INFO:tasks.workunit.client.0.smithi157.stdout:0/631: write d2/d9/dc/df/d1b/d4a/de4/f6e [7115798,46959] 0 2024-04-03T08:39:24.319 INFO:tasks.workunit.client.0.smithi157.stdout:0/632: dwrite d2/d9/dc/df/d1b/d35/f9e [0,4194304] 0 2024-04-03T08:39:24.346 INFO:tasks.workunit.client.1.smithi181.stdout:7/448: chown d0/d1/d6/de/d17/d64/d85 350 1 2024-04-03T08:39:24.352 INFO:tasks.workunit.client.1.smithi181.stdout:3/510: creat d0/d5/d6/dd/fa9 x:0 0 0 2024-04-03T08:39:24.355 INFO:tasks.workunit.client.1.smithi181.stdout:3/511: write d0/d5/d6/f11 [1227993,112699] 0 2024-04-03T08:39:24.359 INFO:tasks.workunit.client.1.smithi181.stdout:9/543: chown d1/da/d13/d22/d23/f94 656954012 1 2024-04-03T08:39:24.359 INFO:tasks.workunit.client.1.smithi181.stdout:3/512: fdatasync d0/d17/d63/d81/fa1 0 2024-04-03T08:39:24.364 INFO:tasks.workunit.client.1.smithi181.stdout:4/549: fdatasync d1/d16/f13 0 2024-04-03T08:39:24.367 INFO:tasks.workunit.client.1.smithi181.stdout:9/544: truncate d1/da/d13/d22/d23/f94 511484 0 2024-04-03T08:39:24.369 INFO:tasks.workunit.client.1.smithi181.stdout:7/449: truncate d0/d1/d6/de/d17/f1b 1810669 0 2024-04-03T08:39:24.380 INFO:tasks.workunit.client.0.smithi157.stdout:1/580: dwrite d2/d11/d24/d67/f70 [0,4194304] 0 2024-04-03T08:39:24.383 INFO:tasks.workunit.client.0.smithi157.stdout:1/581: rmdir d2/d11/d24/d39 39 2024-04-03T08:39:24.388 INFO:tasks.workunit.client.1.smithi181.stdout:3/513: dread d0/d5/d6/f11 [0,4194304] 0 2024-04-03T08:39:24.388 INFO:tasks.workunit.client.1.smithi181.stdout:0/488: link d5/dc/d10/f36 d5/d9/f97 0 2024-04-03T08:39:24.391 INFO:tasks.workunit.client.0.smithi157.stdout:1/582: write d2/d11/d24/d39/d3b/d1b/d7f/fa7 [191994,97284] 0 2024-04-03T08:39:24.403 INFO:tasks.workunit.client.1.smithi181.stdout:0/489: mknod d5/dc/d10/c98 0 2024-04-03T08:39:24.408 INFO:tasks.workunit.client.0.smithi157.stdout:1/583: dwrite d2/d11/d24/d39/d3b/d1b/d7f/faa [0,4194304] 0 2024-04-03T08:39:24.410 INFO:tasks.workunit.client.1.smithi181.stdout:0/490: symlink d5/dc/d10/d30/d68/d90/l99 0 2024-04-03T08:39:24.416 INFO:tasks.workunit.client.1.smithi181.stdout:0/491: write d5/dc/d14/f77 [962319,78880] 0 2024-04-03T08:39:24.417 INFO:tasks.workunit.client.1.smithi181.stdout:0/492: chown d5/dc 18107 1 2024-04-03T08:39:24.418 INFO:tasks.workunit.client.0.smithi157.stdout:8/669: truncate d2/d11/d10/d24/d5b/d2e/d75/d81/fd0 604359 0 2024-04-03T08:39:24.419 INFO:tasks.workunit.client.0.smithi157.stdout:5/679: sync 2024-04-03T08:39:24.421 INFO:tasks.workunit.client.0.smithi157.stdout:1/584: creat d2/d11/d24/d39/d3b/d2e/d48/d86/fbe x:0 0 0 2024-04-03T08:39:24.422 INFO:tasks.workunit.client.0.smithi157.stdout:8/670: fsync d2/d11/d10/d24/d5b/d2e/d75/f85 0 2024-04-03T08:39:24.430 INFO:tasks.workunit.client.1.smithi181.stdout:9/545: dread d1/da/d13/d22/d23/d36/d91/d9d/f37 [0,4194304] 0 2024-04-03T08:39:24.430 INFO:tasks.workunit.client.0.smithi157.stdout:2/635: write d3/d2e/d32/f94 [517818,33807] 0 2024-04-03T08:39:24.430 INFO:tasks.workunit.client.1.smithi181.stdout:9/546: readlink d1/da/lf 0 2024-04-03T08:39:24.433 INFO:tasks.workunit.client.1.smithi181.stdout:9/547: chown d1/da/d13/d73/d7e 38 1 2024-04-03T08:39:24.433 INFO:tasks.workunit.client.0.smithi157.stdout:5/680: getdents dc/d29/d56/d49 0 2024-04-03T08:39:24.437 INFO:tasks.workunit.client.1.smithi181.stdout:9/548: unlink d1/f2f 0 2024-04-03T08:39:24.445 INFO:tasks.workunit.client.0.smithi157.stdout:1/585: dread d2/d11/f92 [0,4194304] 0 2024-04-03T08:39:24.448 INFO:tasks.workunit.client.0.smithi157.stdout:5/681: dread dc/f62 [0,4194304] 0 2024-04-03T08:39:24.450 INFO:tasks.workunit.client.1.smithi181.stdout:8/424: write d4/d45/db/d14/d31/d1c/f2b [1809843,70587] 0 2024-04-03T08:39:24.452 INFO:tasks.workunit.client.0.smithi157.stdout:5/682: symlink dc/d29/d56/d49/d53/le7 0 2024-04-03T08:39:24.453 INFO:tasks.workunit.client.1.smithi181.stdout:9/549: dread d1/da/d28/d30/d3e/d4e/f68 [0,4194304] 0 2024-04-03T08:39:24.458 INFO:tasks.workunit.client.0.smithi157.stdout:5/683: dread dc/f85 [0,4194304] 0 2024-04-03T08:39:24.460 INFO:tasks.workunit.client.0.smithi157.stdout:0/633: rename d2/d9/dc/df/d6f/d9d/d6a/d91/lc5 to d2/d9/le9 0 2024-04-03T08:39:24.463 INFO:tasks.workunit.client.1.smithi181.stdout:0/493: dread d5/d9/f97 [0,4194304] 0 2024-04-03T08:39:24.463 INFO:tasks.workunit.client.1.smithi181.stdout:8/425: getdents d4/d44/d59/d5f 0 2024-04-03T08:39:24.465 INFO:tasks.workunit.client.1.smithi181.stdout:5/494: dwrite d4/d18/f5c [0,4194304] 0 2024-04-03T08:39:24.465 INFO:tasks.workunit.client.0.smithi157.stdout:2/636: rename d3/d2e/d65/l76 to d3/dab/le9 0 2024-04-03T08:39:24.470 INFO:tasks.workunit.client.0.smithi157.stdout:2/637: creat d3/d2e/d32/d9f/fea x:0 0 0 2024-04-03T08:39:24.477 INFO:tasks.workunit.client.1.smithi181.stdout:8/426: symlink d4/d45/db/d14/d31/d1c/l92 0 2024-04-03T08:39:24.484 INFO:tasks.workunit.client.1.smithi181.stdout:9/550: dread d1/da/f12 [0,4194304] 0 2024-04-03T08:39:24.486 INFO:tasks.workunit.client.0.smithi157.stdout:7/695: sync 2024-04-03T08:39:24.486 INFO:tasks.workunit.client.0.smithi157.stdout:3/603: sync 2024-04-03T08:39:24.490 INFO:tasks.workunit.client.0.smithi157.stdout:4/621: mkdir da/df/d2f/dd8 0 2024-04-03T08:39:24.491 INFO:tasks.workunit.client.1.smithi181.stdout:3/514: dwrite d0/d5/d6/f5e [0,4194304] 0 2024-04-03T08:39:24.492 INFO:tasks.workunit.client.1.smithi181.stdout:4/550: sync 2024-04-03T08:39:24.493 INFO:tasks.workunit.client.0.smithi157.stdout:2/638: dread d3/db/d44/f64 [0,4194304] 0 2024-04-03T08:39:24.494 INFO:tasks.workunit.client.0.smithi157.stdout:7/696: symlink d0/d11/d15/d17/d43/d8a/d8f/dee/lfa 0 2024-04-03T08:39:24.495 INFO:tasks.workunit.client.0.smithi157.stdout:2/639: stat d3/d12/l9b 0 2024-04-03T08:39:24.500 INFO:tasks.workunit.client.1.smithi181.stdout:1/493: mknod d10/d15/c97 0 2024-04-03T08:39:24.501 INFO:tasks.workunit.client.1.smithi181.stdout:1/494: chown d10/c5e 15216 1 2024-04-03T08:39:24.503 INFO:tasks.workunit.client.0.smithi157.stdout:3/604: mkdir d8/d1e/d2d/d39/d51/d4c/dd6 0 2024-04-03T08:39:24.504 INFO:tasks.workunit.client.1.smithi181.stdout:2/539: rename d13/da7/d27/f62 to d13/d1c/d4a/d7f/db3/dbf/fca 0 2024-04-03T08:39:24.504 INFO:tasks.workunit.client.1.smithi181.stdout:1/495: write d10/d15/d17/d19/d33/d70/f81 [3639700,101089] 0 2024-04-03T08:39:24.506 INFO:tasks.workunit.client.0.smithi157.stdout:2/640: read - d3/fad zero size 2024-04-03T08:39:24.511 INFO:tasks.workunit.client.0.smithi157.stdout:7/697: write d0/d11/d6f/d76/da7/f62 [2726795,46526] 0 2024-04-03T08:39:24.514 INFO:tasks.workunit.client.0.smithi157.stdout:3/605: symlink d8/d13/d1b/d4e/d50/d7c/ld7 0 2024-04-03T08:39:24.516 INFO:tasks.workunit.client.0.smithi157.stdout:2/641: symlink d3/d2e/leb 0 2024-04-03T08:39:24.518 INFO:tasks.workunit.client.1.smithi181.stdout:0/494: unlink d5/dc/d10/d58/d6c/f26 0 2024-04-03T08:39:24.519 INFO:tasks.workunit.client.0.smithi157.stdout:6/680: dwrite d1/d5/f1a [0,4194304] 0 2024-04-03T08:39:24.520 INFO:tasks.workunit.client.0.smithi157.stdout:8/671: truncate d2/d11/d10/f16 322931 0 2024-04-03T08:39:24.522 INFO:tasks.workunit.client.0.smithi157.stdout:3/606: fsync d8/d1e/d2d/d39/d51/d4c/d32/f42 0 2024-04-03T08:39:24.527 INFO:tasks.workunit.client.0.smithi157.stdout:9/616: sync 2024-04-03T08:39:24.529 INFO:tasks.workunit.client.0.smithi157.stdout:2/642: unlink d3/d2e/d32/d3c/fa3 0 2024-04-03T08:39:24.529 INFO:tasks.workunit.client.0.smithi157.stdout:1/586: write d2/d11/d23/f81 [43255,29082] 0 2024-04-03T08:39:24.532 INFO:tasks.workunit.client.0.smithi157.stdout:7/698: dread d0/d11/d15/d17/f7d [0,4194304] 0 2024-04-03T08:39:24.533 INFO:tasks.workunit.client.0.smithi157.stdout:1/587: chown d2/d11/d23/f81 2035241 1 2024-04-03T08:39:24.535 INFO:tasks.workunit.client.1.smithi181.stdout:3/515: truncate d0/d5/f38 786461 0 2024-04-03T08:39:24.536 INFO:tasks.workunit.client.1.smithi181.stdout:3/516: readlink d0/d5/d6/d32/d43/d6b/l79 0 2024-04-03T08:39:24.538 INFO:tasks.workunit.client.0.smithi157.stdout:3/607: mkdir d8/d13/d1b/d4e/d50/d7c/dd8 0 2024-04-03T08:39:24.540 INFO:tasks.workunit.client.1.smithi181.stdout:6/502: link d6/d3e/f46 d6/d31/d36/f9c 0 2024-04-03T08:39:24.541 INFO:tasks.workunit.client.0.smithi157.stdout:5/684: write dc/d29/d56/d49/d53/f79 [4568989,129440] 0 2024-04-03T08:39:24.542 INFO:tasks.workunit.client.1.smithi181.stdout:6/503: dread - d6/d3e/d5e/d7c/d9/d22/d4f/f7d zero size 2024-04-03T08:39:24.543 INFO:tasks.workunit.client.0.smithi157.stdout:0/634: write d2/d9/dc/df/d1b/d4a/fbd [1365698,59541] 0 2024-04-03T08:39:24.544 INFO:tasks.workunit.client.0.smithi157.stdout:9/617: stat d1/l7 0 2024-04-03T08:39:24.545 INFO:tasks.workunit.client.1.smithi181.stdout:5/495: write d4/d18/d25/f52 [647188,23189] 0 2024-04-03T08:39:24.550 INFO:tasks.workunit.client.0.smithi157.stdout:2/643: unlink d3/db/d44/d4c/d5a/f5f 0 2024-04-03T08:39:24.557 INFO:tasks.workunit.client.1.smithi181.stdout:7/450: sync 2024-04-03T08:39:24.560 INFO:tasks.workunit.client.0.smithi157.stdout:1/588: truncate d2/d11/d24/d39/d3b/d2e/d48/f9e 304717 0 2024-04-03T08:39:24.564 INFO:tasks.workunit.client.0.smithi157.stdout:3/608: fdatasync d8/d13/d1b/d5b/d7f/f9f 0 2024-04-03T08:39:24.567 INFO:tasks.workunit.client.0.smithi157.stdout:1/589: fdatasync d2/d11/d24/d39/d3b/d1b/d7f/faa 0 2024-04-03T08:39:24.568 INFO:tasks.workunit.client.0.smithi157.stdout:9/618: mkdir d1/d4a/d4d/d86/dd5 0 2024-04-03T08:39:24.569 INFO:tasks.workunit.client.0.smithi157.stdout:5/685: dwrite dc/d29/d56/d18/d21/fc5 [0,4194304] 0 2024-04-03T08:39:24.574 INFO:tasks.workunit.client.0.smithi157.stdout:2/644: dwrite d3/db/d44/d4c/d5a/d88/dc6/fd2 [0,4194304] 0 2024-04-03T08:39:24.575 INFO:tasks.workunit.client.0.smithi157.stdout:5/686: chown dc/d29/d56/d49/d53/fd6 3239 1 2024-04-03T08:39:24.576 INFO:tasks.workunit.client.1.smithi181.stdout:1/496: link d10/d15/d17/f94 d10/d15/d4b/f98 0 2024-04-03T08:39:24.585 INFO:tasks.workunit.client.0.smithi157.stdout:4/622: dwrite da/df/d2f/d97/f9a [0,4194304] 0 2024-04-03T08:39:24.592 INFO:tasks.workunit.client.1.smithi181.stdout:4/551: link d1/d16/d55/lb0 d1/d16/d24/d5e/d31/d39/d5d/lb6 0 2024-04-03T08:39:24.594 INFO:tasks.workunit.client.0.smithi157.stdout:6/681: getdents d1/d5/d1b/d97 0 2024-04-03T08:39:24.596 INFO:tasks.workunit.client.0.smithi157.stdout:6/682: fsync d1/d4b/d38/d59/fd5 0 2024-04-03T08:39:24.597 INFO:tasks.workunit.client.1.smithi181.stdout:4/552: write d1/d16/d24/d5e/d31/d39/f80 [584462,6156] 0 2024-04-03T08:39:24.601 INFO:tasks.workunit.client.0.smithi157.stdout:6/683: dread - d1/d4b/d61/d92/fe7 zero size 2024-04-03T08:39:24.613 INFO:tasks.workunit.client.1.smithi181.stdout:9/551: write d1/f35 [34005,79161] 0 2024-04-03T08:39:24.616 INFO:tasks.workunit.client.0.smithi157.stdout:9/619: mkdir d1/d4a/d4d/dd6 0 2024-04-03T08:39:24.618 INFO:tasks.workunit.client.1.smithi181.stdout:2/540: truncate d13/d1c/d4a/d7f/db3/dbf/fca 2325774 0 2024-04-03T08:39:24.620 INFO:tasks.workunit.client.0.smithi157.stdout:1/590: truncate d2/f53 19665 0 2024-04-03T08:39:24.626 INFO:tasks.workunit.client.0.smithi157.stdout:5/687: dread dc/d35/f97 [0,4194304] 0 2024-04-03T08:39:24.633 INFO:tasks.workunit.client.0.smithi157.stdout:8/672: rename d2/f63 to d2/d11/d10/fe3 0 2024-04-03T08:39:24.635 INFO:tasks.workunit.client.0.smithi157.stdout:3/609: dread d8/d1e/d2d/f54 [0,4194304] 0 2024-04-03T08:39:24.636 INFO:tasks.workunit.client.0.smithi157.stdout:3/610: chown d8/d13/d1b/d83/fb2 0 1 2024-04-03T08:39:24.639 INFO:tasks.workunit.client.1.smithi181.stdout:1/497: link d10/d15/d17/d30/f65 d10/d15/d17/d30/f99 0 2024-04-03T08:39:24.643 INFO:tasks.workunit.client.1.smithi181.stdout:3/517: write d0/d17/d36/d1e/f7e [858450,80757] 0 2024-04-03T08:39:24.644 INFO:tasks.workunit.client.1.smithi181.stdout:8/427: dwrite d4/d45/db/f3a [0,4194304] 0 2024-04-03T08:39:24.647 INFO:tasks.workunit.client.1.smithi181.stdout:3/518: write d0/d17/d36/d1e/f31 [2994535,26239] 0 2024-04-03T08:39:24.649 INFO:tasks.workunit.client.1.smithi181.stdout:3/519: fdatasync d0/d17/d63/d81/fa1 0 2024-04-03T08:39:24.650 INFO:tasks.workunit.client.1.smithi181.stdout:4/553: symlink d1/d16/d24/db5/lb7 0 2024-04-03T08:39:24.651 INFO:tasks.workunit.client.0.smithi157.stdout:0/635: link d2/d9/dc/df/d1b/ca2 d2/d9/dc/df/d6f/dad/dbb/cea 0 2024-04-03T08:39:24.657 INFO:tasks.workunit.client.1.smithi181.stdout:8/428: truncate d4/d45/db/d14/d31/d1c/f2b 4535156 0 2024-04-03T08:39:24.657 INFO:tasks.workunit.client.1.smithi181.stdout:3/520: truncate d0/d5/d6/d32/f7b 527828 0 2024-04-03T08:39:24.657 INFO:tasks.workunit.client.1.smithi181.stdout:6/504: getdents d6/d31 0 2024-04-03T08:39:24.658 INFO:tasks.workunit.client.0.smithi157.stdout:5/688: creat dc/d29/d56/d9e/fe8 x:0 0 0 2024-04-03T08:39:24.659 INFO:tasks.workunit.client.0.smithi157.stdout:7/699: write d0/d11/d15/d17/d43/d8a/d8f/fc1 [717413,35242] 0 2024-04-03T08:39:24.661 INFO:tasks.workunit.client.1.smithi181.stdout:5/496: dwrite d4/f5 [0,4194304] 0 2024-04-03T08:39:24.661 INFO:tasks.workunit.client.0.smithi157.stdout:3/611: dread d8/f62 [0,4194304] 0 2024-04-03T08:39:24.661 INFO:tasks.workunit.client.1.smithi181.stdout:0/495: write d5/fe [8206174,39968] 0 2024-04-03T08:39:24.663 INFO:tasks.workunit.client.0.smithi157.stdout:7/700: chown d0/d11/d6f/d76 3038635 1 2024-04-03T08:39:24.664 INFO:tasks.workunit.client.0.smithi157.stdout:5/689: readlink dc/d29/d56/d18/d21/l86 0 2024-04-03T08:39:24.665 INFO:tasks.workunit.client.0.smithi157.stdout:3/612: readlink d8/d1e/d2d/d39/d51/d4c/l73 0 2024-04-03T08:39:24.666 INFO:tasks.workunit.client.1.smithi181.stdout:2/541: unlink d13/d1c/d4a/d68/f76 0 2024-04-03T08:39:24.667 INFO:tasks.workunit.client.0.smithi157.stdout:7/701: write d0/d11/d15/d17/d43/d8a/fe0 [3855058,61764] 0 2024-04-03T08:39:24.668 INFO:tasks.workunit.client.0.smithi157.stdout:8/673: chown d2/d11/c86 15 1 2024-04-03T08:39:24.671 INFO:tasks.workunit.client.0.smithi157.stdout:6/684: mknod d1/d5/d17/d29/ce8 0 2024-04-03T08:39:24.671 INFO:tasks.workunit.client.0.smithi157.stdout:8/674: write d2/d20/f60 [1942549,94573] 0 2024-04-03T08:39:24.671 INFO:tasks.workunit.client.1.smithi181.stdout:7/451: getdents d0/d1/d6/de/d57 0 2024-04-03T08:39:24.673 INFO:tasks.workunit.client.0.smithi157.stdout:0/636: fsync d2/d9/fe 0 2024-04-03T08:39:24.674 INFO:tasks.workunit.client.1.smithi181.stdout:5/497: write d4/d18/d25/d59/d81/fa0 [227442,15980] 0 2024-04-03T08:39:24.674 INFO:tasks.workunit.client.0.smithi157.stdout:3/613: dread - d8/d1e/d2d/d3f/d4d/d8f/fd5 zero size 2024-04-03T08:39:24.677 INFO:tasks.workunit.client.1.smithi181.stdout:8/429: truncate d4/d45/db/d5c/d5e/f7a 375391 0 2024-04-03T08:39:24.680 INFO:tasks.workunit.client.0.smithi157.stdout:5/690: rmdir dc/d29/d56/d52/d9d/da5 39 2024-04-03T08:39:24.681 INFO:tasks.workunit.client.1.smithi181.stdout:3/521: mkdir d0/d5/d6/d32/daa 0 2024-04-03T08:39:24.682 INFO:tasks.workunit.client.1.smithi181.stdout:2/542: mkdir d13/d1c/d4a/d7f/dcb 0 2024-04-03T08:39:24.684 INFO:tasks.workunit.client.1.smithi181.stdout:4/554: dwrite d1/d16/d24/d5e/d3f/f40 [0,4194304] 0 2024-04-03T08:39:24.689 INFO:tasks.workunit.client.0.smithi157.stdout:7/702: unlink d0/d11/d15/ca0 0 2024-04-03T08:39:24.690 INFO:tasks.workunit.client.1.smithi181.stdout:3/522: chown d0/d17/l35 1592 1 2024-04-03T08:39:24.690 INFO:tasks.workunit.client.1.smithi181.stdout:2/543: read - d13/da7/fb2 zero size 2024-04-03T08:39:24.691 INFO:tasks.workunit.client.0.smithi157.stdout:2/645: dwrite d3/d2e/f90 [0,4194304] 0 2024-04-03T08:39:24.695 INFO:tasks.workunit.client.1.smithi181.stdout:1/498: dread d10/d15/d17/d23/d27/f3a [0,4194304] 0 2024-04-03T08:39:24.698 INFO:tasks.workunit.client.0.smithi157.stdout:3/614: rmdir d8/d1e/d2d/d3b/d8c 39 2024-04-03T08:39:24.700 INFO:tasks.workunit.client.0.smithi157.stdout:9/620: dwrite d1/f26 [0,4194304] 0 2024-04-03T08:39:24.702 INFO:tasks.workunit.client.0.smithi157.stdout:3/615: dread d8/d1e/d2d/d3b/f6e [0,4194304] 0 2024-04-03T08:39:24.703 INFO:tasks.workunit.client.0.smithi157.stdout:0/637: creat d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/feb x:0 0 0 2024-04-03T08:39:24.704 INFO:tasks.workunit.client.1.smithi181.stdout:5/498: mknod d4/d18/d25/d59/d81/d96/ca2 0 2024-04-03T08:39:24.707 INFO:tasks.workunit.client.0.smithi157.stdout:3/616: chown d8/d13/d1b/d4e/da6/f95 42208 1 2024-04-03T08:39:24.710 INFO:tasks.workunit.client.1.smithi181.stdout:2/544: write d13/d1c/f99 [149751,63895] 0 2024-04-03T08:39:24.711 INFO:tasks.workunit.client.1.smithi181.stdout:3/523: mknod d0/d5/d6/dd/d25/d50/cab 0 2024-04-03T08:39:24.719 INFO:tasks.workunit.client.1.smithi181.stdout:0/496: dwrite d5/dc/d14/d29/f78 [0,4194304] 0 2024-04-03T08:39:24.719 INFO:tasks.workunit.client.1.smithi181.stdout:4/555: creat d1/d16/d24/d5e/d31/d39/da1/fb8 x:0 0 0 2024-04-03T08:39:24.721 INFO:tasks.workunit.client.1.smithi181.stdout:3/524: mknod d0/cac 0 2024-04-03T08:39:24.723 INFO:tasks.workunit.client.0.smithi157.stdout:8/675: creat d2/d11/d10/d24/d5b/fe4 x:0 0 0 2024-04-03T08:39:24.724 INFO:tasks.workunit.client.1.smithi181.stdout:7/452: dwrite d0/d1/d6/de/d17/d27/f49 [0,4194304] 0 2024-04-03T08:39:24.729 INFO:tasks.workunit.client.0.smithi157.stdout:5/691: rmdir dc/d29/d56/d52/d9d/da5/daa 39 2024-04-03T08:39:24.734 INFO:tasks.workunit.client.1.smithi181.stdout:6/505: dread d6/d3e/d5e/d7c/f6d [0,4194304] 0 2024-04-03T08:39:24.736 INFO:tasks.workunit.client.1.smithi181.stdout:5/499: dwrite d4/f3d [0,4194304] 0 2024-04-03T08:39:24.738 INFO:tasks.workunit.client.0.smithi157.stdout:3/617: creat d8/d13/d1b/d4e/fd9 x:0 0 0 2024-04-03T08:39:24.741 INFO:tasks.workunit.client.1.smithi181.stdout:0/497: fdatasync d5/d9/f28 0 2024-04-03T08:39:24.741 INFO:tasks.workunit.client.0.smithi157.stdout:7/703: write d0/d11/d15/d17/d1c/da1/fa4 [567183,50292] 0 2024-04-03T08:39:24.741 INFO:tasks.workunit.client.0.smithi157.stdout:6/685: truncate d1/d5/d17/f64 199440 0 2024-04-03T08:39:24.744 INFO:tasks.workunit.client.0.smithi157.stdout:9/621: link d1/f19 d1/d15/d16/d9f/fd7 0 2024-04-03T08:39:24.745 INFO:tasks.workunit.client.1.smithi181.stdout:5/500: readlink d4/l1f 0 2024-04-03T08:39:24.750 INFO:tasks.workunit.client.1.smithi181.stdout:2/545: dwrite d13/da7/d27/d2f/f5e [4194304,4194304] 0 2024-04-03T08:39:24.752 INFO:tasks.workunit.client.1.smithi181.stdout:8/430: dread d4/d44/f6f [0,4194304] 0 2024-04-03T08:39:24.753 INFO:tasks.workunit.client.1.smithi181.stdout:6/506: rename d6/d31/f4d to d6/d3e/d5e/d7c/d50/d5b/f9d 0 2024-04-03T08:39:24.758 INFO:tasks.workunit.client.1.smithi181.stdout:4/556: mkdir d1/d16/d24/d5e/d2b/db9 0 2024-04-03T08:39:24.761 INFO:tasks.workunit.client.0.smithi157.stdout:5/692: dwrite dc/d29/d56/d9e/fb8 [0,4194304] 0 2024-04-03T08:39:24.765 INFO:tasks.workunit.client.1.smithi181.stdout:5/501: mknod d4/d18/d25/d68/ca3 0 2024-04-03T08:39:24.765 INFO:tasks.workunit.client.0.smithi157.stdout:5/693: dread - dc/d29/d56/d87/fd3 zero size 2024-04-03T08:39:24.772 INFO:tasks.workunit.client.1.smithi181.stdout:8/431: symlink d4/d44/d59/d5f/l93 0 2024-04-03T08:39:24.779 INFO:tasks.workunit.client.1.smithi181.stdout:3/525: dread d0/d17/d36/d1e/f31 [0,4194304] 0 2024-04-03T08:39:24.788 INFO:tasks.workunit.client.1.smithi181.stdout:5/502: creat d4/d80/fa4 x:0 0 0 2024-04-03T08:39:24.791 INFO:tasks.workunit.client.0.smithi157.stdout:0/638: dread d2/d9/d5f/d85/f86 [0,4194304] 0 2024-04-03T08:39:24.793 INFO:tasks.workunit.client.1.smithi181.stdout:3/526: dread d0/d17/d36/d1e/f7e [0,4194304] 0 2024-04-03T08:39:24.794 INFO:tasks.workunit.client.1.smithi181.stdout:6/507: mkdir d6/d9e 0 2024-04-03T08:39:24.796 INFO:tasks.workunit.client.0.smithi157.stdout:7/704: dread d0/d11/d15/d1b/f73 [0,4194304] 0 2024-04-03T08:39:24.804 INFO:tasks.workunit.client.1.smithi181.stdout:0/498: dwrite d5/dc/d10/f8f [0,4194304] 0 2024-04-03T08:39:24.807 INFO:tasks.workunit.client.1.smithi181.stdout:2/546: getdents d13/d1c/d4a/d68/d72/da1 0 2024-04-03T08:39:24.814 INFO:tasks.workunit.client.1.smithi181.stdout:8/432: rmdir d4/d45/db/d14/d31/d1c/d8e 0 2024-04-03T08:39:24.816 INFO:tasks.workunit.client.1.smithi181.stdout:3/527: mknod d0/d17/d56/cad 0 2024-04-03T08:39:24.816 INFO:tasks.workunit.client.1.smithi181.stdout:8/433: write d4/d45/db/d5c/f7d [1351322,75727] 0 2024-04-03T08:39:24.818 INFO:tasks.workunit.client.1.smithi181.stdout:5/503: dread d4/d22/f38 [0,4194304] 0 2024-04-03T08:39:24.819 INFO:tasks.workunit.client.1.smithi181.stdout:6/508: symlink d6/d3e/d5e/d7c/d9/d22/d4f/d77/d8b/l9f 0 2024-04-03T08:39:24.821 INFO:tasks.workunit.client.1.smithi181.stdout:4/557: truncate d1/d16/d24/d5e/d3f/d41/f42 139945 0 2024-04-03T08:39:24.822 INFO:tasks.workunit.client.1.smithi181.stdout:4/558: dread - d1/f92 zero size 2024-04-03T08:39:24.824 INFO:tasks.workunit.client.1.smithi181.stdout:2/547: creat d13/d1c/d4a/d68/fcc x:0 0 0 2024-04-03T08:39:24.827 INFO:tasks.workunit.client.0.smithi157.stdout:3/618: symlink d8/d1e/d2d/d39/lda 0 2024-04-03T08:39:24.828 INFO:tasks.workunit.client.1.smithi181.stdout:3/528: stat d0/d5/fa 0 2024-04-03T08:39:24.832 INFO:tasks.workunit.client.1.smithi181.stdout:6/509: mknod d6/d31/ca0 0 2024-04-03T08:39:24.834 INFO:tasks.workunit.client.1.smithi181.stdout:6/510: chown d6/d31/d36/l41 78 1 2024-04-03T08:39:24.835 INFO:tasks.workunit.client.1.smithi181.stdout:5/504: rename d4/d18/d25/f52 to d4/d56/fa5 0 2024-04-03T08:39:24.836 INFO:tasks.workunit.client.1.smithi181.stdout:6/511: chown d6/d53/d80/l78 2042419 1 2024-04-03T08:39:24.836 INFO:tasks.workunit.client.1.smithi181.stdout:4/559: mkdir d1/d16/d24/d5e/d31/dba 0 2024-04-03T08:39:24.838 INFO:tasks.workunit.client.1.smithi181.stdout:2/548: creat d13/d1c/da5/fcd x:0 0 0 2024-04-03T08:39:24.841 INFO:tasks.workunit.client.1.smithi181.stdout:6/512: dread d6/d31/f6b [0,4194304] 0 2024-04-03T08:39:24.841 INFO:tasks.workunit.client.0.smithi157.stdout:2/646: getdents d3/d12/d43/d4b/d55 0 2024-04-03T08:39:24.842 INFO:tasks.workunit.client.0.smithi157.stdout:3/619: truncate d8/d13/d1b/d5b/f8a 1593248 0 2024-04-03T08:39:24.846 INFO:tasks.workunit.client.0.smithi157.stdout:9/622: link d1/d15/d16/f98 d1/d4a/dc4/fd8 0 2024-04-03T08:39:24.847 INFO:tasks.workunit.client.0.smithi157.stdout:9/623: stat d1/d4a/f4c 0 2024-04-03T08:39:24.847 INFO:tasks.workunit.client.1.smithi181.stdout:5/505: write d4/d44/f5f [1654963,110966] 0 2024-04-03T08:39:24.849 INFO:tasks.workunit.client.0.smithi157.stdout:6/686: truncate d1/d5/d17/d2a/f82 10811 0 2024-04-03T08:39:24.851 INFO:tasks.workunit.client.1.smithi181.stdout:5/506: write d4/f5 [3396753,9088] 0 2024-04-03T08:39:24.855 INFO:tasks.workunit.client.1.smithi181.stdout:4/560: rename d1/d1e/f52 to d1/d16/d24/d5e/d31/d39/fbb 0 2024-04-03T08:39:24.857 INFO:tasks.workunit.client.0.smithi157.stdout:7/705: creat d0/d4/d8e/d96/df4/ffb x:0 0 0 2024-04-03T08:39:24.858 INFO:tasks.workunit.client.1.smithi181.stdout:4/561: truncate d1/d16/d24/d5e/d3f/d6c/fb4 784848 0 2024-04-03T08:39:24.858 INFO:tasks.workunit.client.1.smithi181.stdout:3/529: creat d0/d5/d6/d32/daa/fae x:0 0 0 2024-04-03T08:39:24.868 INFO:tasks.workunit.client.1.smithi181.stdout:6/513: creat d6/d3e/d5e/d7c/d9/d22/d4f/fa1 x:0 0 0 2024-04-03T08:39:24.869 INFO:tasks.workunit.client.0.smithi157.stdout:9/624: rmdir d1/d36/d46 39 2024-04-03T08:39:24.871 INFO:tasks.workunit.client.0.smithi157.stdout:6/687: dread d1/d4b/d61/f68 [0,4194304] 0 2024-04-03T08:39:24.872 INFO:tasks.workunit.client.0.smithi157.stdout:5/694: dwrite dc/fa3 [0,4194304] 0 2024-04-03T08:39:24.872 INFO:tasks.workunit.client.0.smithi157.stdout:9/625: chown d1/d15/d27/d5c/d79/f7c 96 1 2024-04-03T08:39:24.878 INFO:tasks.workunit.client.1.smithi181.stdout:3/530: rmdir d0/d57 39 2024-04-03T08:39:24.878 INFO:tasks.workunit.client.0.smithi157.stdout:5/695: chown dc/d29/d56/d2e/l32 1 1 2024-04-03T08:39:24.882 INFO:tasks.workunit.client.1.smithi181.stdout:2/549: creat d13/da7/d85/dbd/fce x:0 0 0 2024-04-03T08:39:24.882 INFO:tasks.workunit.client.0.smithi157.stdout:0/639: link d2/d9/dc/df/d1b/l47 d2/d9/dc/df/d1b/d4a/d31/lec 0 2024-04-03T08:39:24.883 INFO:tasks.workunit.client.1.smithi181.stdout:2/550: chown d13/da7/fb2 262749 1 2024-04-03T08:39:24.886 INFO:tasks.workunit.client.1.smithi181.stdout:8/434: link d4/d45/d9/f25 d4/d45/db/f94 0 2024-04-03T08:39:24.894 INFO:tasks.workunit.client.1.smithi181.stdout:6/514: unlink d6/d3e/d5e/d7c/d9/d7f/f99 0 2024-04-03T08:39:24.896 INFO:tasks.workunit.client.1.smithi181.stdout:1/499: sync 2024-04-03T08:39:24.896 INFO:tasks.workunit.client.1.smithi181.stdout:9/552: sync 2024-04-03T08:39:24.898 INFO:tasks.workunit.client.0.smithi157.stdout:9/626: dread d1/d15/d16/f98 [0,4194304] 0 2024-04-03T08:39:24.902 INFO:tasks.workunit.client.0.smithi157.stdout:6/688: mknod d1/d5/d17/d29/da7/ce9 0 2024-04-03T08:39:24.904 INFO:tasks.workunit.client.0.smithi157.stdout:5/696: mknod dc/d29/d43/da1/ce9 0 2024-04-03T08:39:24.905 INFO:tasks.workunit.client.0.smithi157.stdout:7/706: write d0/d11/d15/d1b/f57 [69168,21520] 0 2024-04-03T08:39:24.908 INFO:tasks.workunit.client.0.smithi157.stdout:9/627: dread d1/d15/f43 [0,4194304] 0 2024-04-03T08:39:24.908 INFO:tasks.workunit.client.1.smithi181.stdout:1/500: dread d10/d15/d17/d19/d33/d70/f81 [0,4194304] 0 2024-04-03T08:39:24.910 INFO:tasks.workunit.client.0.smithi157.stdout:3/620: truncate d8/d13/d1b/f1d 1295576 0 2024-04-03T08:39:24.911 INFO:tasks.workunit.client.0.smithi157.stdout:3/621: chown d8/d1e/d2d/d39/d51/d48/dce 0 1 2024-04-03T08:39:24.913 INFO:tasks.workunit.client.0.smithi157.stdout:0/640: rename d2/d9/dc/df/d1b/d4a/d31/faa to d2/d9/dc/df/d6f/fed 0 2024-04-03T08:39:24.915 INFO:tasks.workunit.client.1.smithi181.stdout:9/553: symlink d1/da/d13/d41/d65/lac 0 2024-04-03T08:39:24.915 INFO:tasks.workunit.client.0.smithi157.stdout:2/647: link d3/d2e/d32/ca8 d3/d2e/d65/dae/cec 0 2024-04-03T08:39:24.918 INFO:tasks.workunit.client.1.smithi181.stdout:2/551: link d13/da7/d27/d2f/d5d/fc0 d13/d1c/da5/fcf 0 2024-04-03T08:39:24.919 INFO:tasks.workunit.client.1.smithi181.stdout:6/515: mknod d6/d3e/d5e/d7c/d9/d22/ca2 0 2024-04-03T08:39:24.920 INFO:tasks.workunit.client.0.smithi157.stdout:6/689: fdatasync d1/f42 0 2024-04-03T08:39:24.921 INFO:tasks.workunit.client.1.smithi181.stdout:1/501: symlink d10/d15/d4a/d6f/l9a 0 2024-04-03T08:39:24.924 INFO:tasks.workunit.client.1.smithi181.stdout:8/435: link d4/d45/db/d14/l41 d4/d2a/d37/d67/l95 0 2024-04-03T08:39:24.925 INFO:tasks.workunit.client.1.smithi181.stdout:3/531: dwrite d0/d17/d63/f76 [0,4194304] 0 2024-04-03T08:39:24.927 INFO:tasks.workunit.client.1.smithi181.stdout:8/436: fsync d4/d45/db/d14/d31/d1c/f85 0 2024-04-03T08:39:24.935 INFO:tasks.workunit.client.0.smithi157.stdout:5/697: rename dc/d29/d56/d49/d53/f79 to dc/d29/d56/d18/d21/fea 0 2024-04-03T08:39:24.936 INFO:tasks.workunit.client.0.smithi157.stdout:5/698: stat dc/d29/d51/fc0 0 2024-04-03T08:39:24.938 INFO:tasks.workunit.client.0.smithi157.stdout:0/641: stat d2/d9/dc/df/d6f/d9d/d6a/d91/fbf 0 2024-04-03T08:39:24.939 INFO:tasks.workunit.client.1.smithi181.stdout:9/554: creat d1/da/d28/d30/d3e/d4e/da3/fad x:0 0 0 2024-04-03T08:39:24.940 INFO:tasks.workunit.client.0.smithi157.stdout:0/642: write d2/d9/dc/df/d1b/d35/f9e [4400598,84962] 0 2024-04-03T08:39:24.941 INFO:tasks.workunit.client.0.smithi157.stdout:2/648: rmdir d3/d12/d43 39 2024-04-03T08:39:24.944 INFO:tasks.workunit.client.0.smithi157.stdout:6/690: mknod d1/d4b/d61/cea 0 2024-04-03T08:39:24.945 INFO:tasks.workunit.client.1.smithi181.stdout:3/532: symlink d0/d17/d36/d3b/d5a/d85/laf 0 2024-04-03T08:39:24.950 INFO:tasks.workunit.client.1.smithi181.stdout:1/502: creat d10/d15/d41/d8c/d8d/f9b x:0 0 0 2024-04-03T08:39:24.951 INFO:tasks.workunit.client.0.smithi157.stdout:9/628: rename d1/l62 to d1/d36/d46/ld9 0 2024-04-03T08:39:24.953 INFO:tasks.workunit.client.1.smithi181.stdout:8/437: mkdir d4/d45/d96 0 2024-04-03T08:39:24.956 INFO:tasks.workunit.client.1.smithi181.stdout:8/438: fdatasync d4/d44/d59/d5f/d6c/f81 0 2024-04-03T08:39:24.958 INFO:tasks.workunit.client.1.smithi181.stdout:1/503: dread - d10/d15/d17/d30/f55 zero size 2024-04-03T08:39:24.962 INFO:tasks.workunit.client.0.smithi157.stdout:6/691: creat d1/d4b/d61/d92/dd6/feb x:0 0 0 2024-04-03T08:39:24.963 INFO:tasks.workunit.client.1.smithi181.stdout:6/516: dread d6/d31/d36/f33 [0,4194304] 0 2024-04-03T08:39:24.964 INFO:tasks.workunit.client.0.smithi157.stdout:6/692: readlink d1/l9 0 2024-04-03T08:39:24.965 INFO:tasks.workunit.client.1.smithi181.stdout:9/555: dread d1/f6 [0,4194304] 0 2024-04-03T08:39:24.966 INFO:tasks.workunit.client.0.smithi157.stdout:3/622: truncate d8/d13/f56 258237 0 2024-04-03T08:39:24.970 INFO:tasks.workunit.client.1.smithi181.stdout:8/439: chown d4/d44/l7f 0 1 2024-04-03T08:39:24.972 INFO:tasks.workunit.client.1.smithi181.stdout:8/440: fsync d4/d45/db/d14/d31/f43 0 2024-04-03T08:39:24.973 INFO:tasks.workunit.client.1.smithi181.stdout:2/552: dwrite d13/d1c/d4a/d7f/db3/f61 [0,4194304] 0 2024-04-03T08:39:24.974 INFO:tasks.workunit.client.0.smithi157.stdout:2/649: dwrite d3/d2e/d32/fb7 [0,4194304] 0 2024-04-03T08:39:24.975 INFO:tasks.workunit.client.0.smithi157.stdout:7/707: dwrite d0/d11/d6f/fe9 [0,4194304] 0 2024-04-03T08:39:24.977 INFO:tasks.workunit.client.1.smithi181.stdout:1/504: rename d10/d15/d4a/f63 to d10/d15/d4a/d6f/f9c 0 2024-04-03T08:39:24.978 INFO:tasks.workunit.client.1.smithi181.stdout:6/517: creat d6/d3e/d40/fa3 x:0 0 0 2024-04-03T08:39:24.978 INFO:tasks.workunit.client.1.smithi181.stdout:3/533: write d0/d17/d36/d1e/f31 [3382390,109622] 0 2024-04-03T08:39:24.982 INFO:tasks.workunit.client.1.smithi181.stdout:1/505: dread - d10/d15/d17/f94 zero size 2024-04-03T08:39:24.982 INFO:tasks.workunit.client.0.smithi157.stdout:9/629: symlink d1/d4a/d4d/da4/db8/lda 0 2024-04-03T08:39:24.982 INFO:tasks.workunit.client.1.smithi181.stdout:6/518: dread - d6/d3e/d5e/d7c/d50/d64/f84 zero size 2024-04-03T08:39:24.984 INFO:tasks.workunit.client.1.smithi181.stdout:1/506: readlink d10/d15/d17/d30/l8f 0 2024-04-03T08:39:24.988 INFO:tasks.workunit.client.0.smithi157.stdout:0/643: creat d2/d9/d36/fee x:0 0 0 2024-04-03T08:39:24.991 INFO:tasks.workunit.client.0.smithi157.stdout:5/699: getdents dc/dbb 0 2024-04-03T08:39:24.994 INFO:tasks.workunit.client.0.smithi157.stdout:0/644: write d2/d9/dc/df/d1b/d4a/de4/f6e [918044,101042] 0 2024-04-03T08:39:24.994 INFO:tasks.workunit.client.0.smithi157.stdout:3/623: symlink d8/d1e/d2d/d39/d51/d4c/ldb 0 2024-04-03T08:39:24.998 INFO:tasks.workunit.client.1.smithi181.stdout:6/519: dread - d6/d3e/d5e/d7c/f3f zero size 2024-04-03T08:39:25.000 INFO:tasks.workunit.client.1.smithi181.stdout:2/553: rename d13/d1c/d4a/d7f/db3/dbf/fca to d13/d1c/d4a/d68/fd0 0 2024-04-03T08:39:25.001 INFO:tasks.workunit.client.0.smithi157.stdout:0/645: chown d2/d9/d51/f52 506389501 1 2024-04-03T08:39:25.001 INFO:tasks.workunit.client.0.smithi157.stdout:9/630: symlink d1/d4a/d4d/dd6/ldb 0 2024-04-03T08:39:25.002 INFO:tasks.workunit.client.1.smithi181.stdout:3/534: dwrite d0/d17/d36/d1e/f80 [0,4194304] 0 2024-04-03T08:39:25.004 INFO:tasks.workunit.client.0.smithi157.stdout:9/631: dread - d1/d15/d27/d5c/fcf zero size 2024-04-03T08:39:25.005 INFO:tasks.workunit.client.0.smithi157.stdout:7/708: read d0/d11/d15/d17/f77 [344605,117893] 0 2024-04-03T08:39:25.007 INFO:tasks.workunit.client.1.smithi181.stdout:6/520: truncate d6/d3e/d5e/d7c/d9/d22/d4f/f7d 409945 0 2024-04-03T08:39:25.007 INFO:tasks.workunit.client.0.smithi157.stdout:7/709: chown d0/d75/ld2 3343 1 2024-04-03T08:39:25.009 INFO:tasks.workunit.client.0.smithi157.stdout:6/693: rename d1/d4b/d61 to d1/d5/d17/d2a/d40/dec 0 2024-04-03T08:39:25.013 INFO:tasks.workunit.client.1.smithi181.stdout:8/441: link d4/d44/f64 d4/d44/f97 0 2024-04-03T08:39:25.013 INFO:tasks.workunit.client.0.smithi157.stdout:6/694: fsync d1/d5/fc2 0 2024-04-03T08:39:25.017 INFO:tasks.workunit.client.1.smithi181.stdout:1/507: getdents d10/d15/d41/d8c 0 2024-04-03T08:39:25.017 INFO:tasks.workunit.client.0.smithi157.stdout:6/695: chown d1/d5/d17/d2a/d73/lda 0 1 2024-04-03T08:39:25.023 INFO:tasks.workunit.client.0.smithi157.stdout:6/696: dread - d1/d5/d17/d2a/d40/dec/d92/fe4 zero size 2024-04-03T08:39:25.024 INFO:tasks.workunit.client.1.smithi181.stdout:2/554: unlink d13/d1c/d6c/d7a/lb8 0 2024-04-03T08:39:25.025 INFO:tasks.workunit.client.1.smithi181.stdout:2/555: chown d13/d1c/f54 3487 1 2024-04-03T08:39:25.026 INFO:tasks.workunit.client.0.smithi157.stdout:5/700: rename dc/l2f to dc/d29/d51/leb 0 2024-04-03T08:39:25.029 INFO:tasks.workunit.client.1.smithi181.stdout:9/556: dwrite d1/da/d13/d22/d23/d36/d91/d9d/d39/f59 [0,4194304] 0 2024-04-03T08:39:25.036 INFO:tasks.workunit.client.0.smithi157.stdout:9/632: truncate d1/d15/d27/f32 3958968 0 2024-04-03T08:39:25.042 INFO:tasks.workunit.client.1.smithi181.stdout:8/442: dread d4/f27 [4194304,4194304] 0 2024-04-03T08:39:25.043 INFO:tasks.workunit.client.0.smithi157.stdout:7/710: rename d0/d75/ld2 to d0/d4/d8e/d96/df4/lfc 0 2024-04-03T08:39:25.044 INFO:tasks.workunit.client.1.smithi181.stdout:3/535: dwrite d0/d5/d6/d32/d43/f9b [0,4194304] 0 2024-04-03T08:39:25.044 INFO:tasks.workunit.client.0.smithi157.stdout:2/650: dread d3/f9 [0,4194304] 0 2024-04-03T08:39:25.049 INFO:tasks.workunit.client.1.smithi181.stdout:2/556: symlink d13/d1c/ld1 0 2024-04-03T08:39:25.050 INFO:tasks.workunit.client.0.smithi157.stdout:0/646: dread d2/d9/d51/d63/d71/f81 [0,4194304] 0 2024-04-03T08:39:25.050 INFO:tasks.workunit.client.1.smithi181.stdout:2/557: chown d13/da7/d40 0 1 2024-04-03T08:39:25.054 INFO:tasks.workunit.client.0.smithi157.stdout:3/624: dwrite d8/fc [0,4194304] 0 2024-04-03T08:39:25.056 INFO:tasks.workunit.client.0.smithi157.stdout:5/701: dread dc/d29/d56/d18/f3e [0,4194304] 0 2024-04-03T08:39:25.057 INFO:tasks.workunit.client.1.smithi181.stdout:7/453: sync 2024-04-03T08:39:25.058 INFO:tasks.workunit.client.1.smithi181.stdout:3/536: symlink d0/d17/d36/d8c/lb0 0 2024-04-03T08:39:25.061 INFO:tasks.workunit.client.1.smithi181.stdout:2/558: mknod d13/d1c/d4a/d7f/db3/d8f/cd2 0 2024-04-03T08:39:25.062 INFO:tasks.workunit.client.0.smithi157.stdout:5/702: chown dc/d29/d56/d2e/fd5 2772442 1 2024-04-03T08:39:25.062 INFO:tasks.workunit.client.1.smithi181.stdout:1/508: truncate d10/d15/d17/d19/d33/f6a 1880284 0 2024-04-03T08:39:25.064 INFO:tasks.workunit.client.0.smithi157.stdout:6/697: dwrite d1/d4b/d38/d59/f93 [0,4194304] 0 2024-04-03T08:39:25.064 INFO:tasks.workunit.client.1.smithi181.stdout:6/521: dread d6/d3e/d5e/d7c/d9/f1a [0,4194304] 0 2024-04-03T08:39:25.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:24 smithi157 ceph-mon[35083]: pgmap v9: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 167 MiB/s wr, 338 op/s 2024-04-03T08:39:25.078 INFO:tasks.workunit.client.0.smithi157.stdout:9/633: dwrite d1/d4a/dc4/fd8 [4194304,4194304] 0 2024-04-03T08:39:25.081 INFO:tasks.workunit.client.0.smithi157.stdout:3/625: rmdir d8/d1e 39 2024-04-03T08:39:25.083 INFO:tasks.workunit.client.0.smithi157.stdout:2/651: dread d3/d2e/d32/d3c/f3f [0,4194304] 0 2024-04-03T08:39:25.085 INFO:tasks.workunit.client.1.smithi181.stdout:9/557: dwrite d1/da/d28/d30/f47 [0,4194304] 0 2024-04-03T08:39:25.086 INFO:tasks.workunit.client.1.smithi181.stdout:8/443: dwrite d4/d45/d9/f25 [0,4194304] 0 2024-04-03T08:39:25.087 INFO:tasks.workunit.client.0.smithi157.stdout:2/652: readlink d3/d2e/leb 0 2024-04-03T08:39:25.090 INFO:tasks.workunit.client.0.smithi157.stdout:6/698: creat d1/d4b/da5/dc7/fed x:0 0 0 2024-04-03T08:39:25.093 INFO:tasks.workunit.client.0.smithi157.stdout:1/591: sync 2024-04-03T08:39:25.093 INFO:tasks.workunit.client.0.smithi157.stdout:4/623: sync 2024-04-03T08:39:25.097 INFO:tasks.workunit.client.1.smithi181.stdout:7/454: symlink d0/d1/d6/l9e 0 2024-04-03T08:39:25.097 INFO:tasks.workunit.client.1.smithi181.stdout:1/509: creat d10/d15/d4a/f9d x:0 0 0 2024-04-03T08:39:25.099 INFO:tasks.workunit.client.1.smithi181.stdout:1/510: write d10/f16 [6791355,79019] 0 2024-04-03T08:39:25.099 INFO:tasks.workunit.client.0.smithi157.stdout:0/647: write d2/d9/dc/d54/f8c [172827,6583] 0 2024-04-03T08:39:25.100 INFO:tasks.workunit.client.1.smithi181.stdout:7/455: write d0/d1/d6/de/d17/d64/f7c [871544,50873] 0 2024-04-03T08:39:25.102 INFO:tasks.workunit.client.0.smithi157.stdout:3/626: mkdir d8/d13/d1b/d4e/d50/d7c/ddc 0 2024-04-03T08:39:25.107 INFO:tasks.workunit.client.1.smithi181.stdout:8/444: mknod d4/d45/db/d5c/c98 0 2024-04-03T08:39:25.107 INFO:tasks.workunit.client.1.smithi181.stdout:9/558: chown d1/cc 204950355 1 2024-04-03T08:39:25.107 INFO:tasks.workunit.client.1.smithi181.stdout:7/456: rmdir d0 39 2024-04-03T08:39:25.110 INFO:tasks.workunit.client.1.smithi181.stdout:8/445: write d4/d45/db/d14/d31/d1c/f85 [237192,102994] 0 2024-04-03T08:39:25.114 INFO:tasks.workunit.client.0.smithi157.stdout:5/703: dwrite dc/d29/d56/d52/d9d/da5/daa/fcf [0,4194304] 0 2024-04-03T08:39:25.116 INFO:tasks.workunit.client.0.smithi157.stdout:5/704: chown dc/dbb 731 1 2024-04-03T08:39:25.118 INFO:tasks.workunit.client.1.smithi181.stdout:1/511: mknod d10/d15/d4b/d6c/c9e 0 2024-04-03T08:39:25.118 INFO:tasks.workunit.client.1.smithi181.stdout:7/457: write d0/d1/f74 [5169030,24765] 0 2024-04-03T08:39:25.119 INFO:tasks.workunit.client.0.smithi157.stdout:1/592: dwrite d2/d11/d24/d39/d3b/d1b/d7f/fa7 [0,4194304] 0 2024-04-03T08:39:25.120 INFO:tasks.workunit.client.1.smithi181.stdout:2/559: dread d13/d1c/d4a/d68/fd0 [0,4194304] 0 2024-04-03T08:39:25.123 INFO:tasks.workunit.client.1.smithi181.stdout:2/560: write d13/d1c/d4a/d68/fcc [160682,101189] 0 2024-04-03T08:39:25.125 INFO:tasks.workunit.client.1.smithi181.stdout:8/446: unlink d4/d45/db/d5c/f7d 0 2024-04-03T08:39:25.128 INFO:tasks.workunit.client.1.smithi181.stdout:2/561: truncate d13/da7/d40/f75 923878 0 2024-04-03T08:39:25.129 INFO:tasks.workunit.client.0.smithi157.stdout:3/627: read d8/d13/d1b/f6b [3673008,129452] 0 2024-04-03T08:39:25.129 INFO:tasks.workunit.client.0.smithi157.stdout:9/634: truncate d1/d94/f73 105963 0 2024-04-03T08:39:25.135 INFO:tasks.workunit.client.0.smithi157.stdout:1/593: dread d2/d11/d24/d39/d3b/d1b/d7f/fa7 [0,4194304] 0 2024-04-03T08:39:25.136 INFO:tasks.workunit.client.1.smithi181.stdout:1/512: readlink d10/d15/d17/l5f 0 2024-04-03T08:39:25.139 INFO:tasks.workunit.client.0.smithi157.stdout:4/624: symlink da/ld9 0 2024-04-03T08:39:25.140 INFO:tasks.workunit.client.1.smithi181.stdout:8/447: rmdir d4/d45/db/d14/d31/d1c/d51 39 2024-04-03T08:39:25.141 INFO:tasks.workunit.client.0.smithi157.stdout:4/625: chown da/df/d2f/d54/fb4 1061007 1 2024-04-03T08:39:25.143 INFO:tasks.workunit.client.1.smithi181.stdout:5/507: sync 2024-04-03T08:39:25.143 INFO:tasks.workunit.client.1.smithi181.stdout:0/499: sync 2024-04-03T08:39:25.146 INFO:tasks.workunit.client.0.smithi157.stdout:5/705: mknod dc/d29/d56/d9e/dc3/cec 0 2024-04-03T08:39:25.146 INFO:tasks.workunit.client.0.smithi157.stdout:6/699: creat d1/d5/d17/d29/d62/d7f/d89/da4/fee x:0 0 0 2024-04-03T08:39:25.147 INFO:tasks.workunit.client.1.smithi181.stdout:2/562: rename d13/da7/d40/f75 to d13/d1c/d4a/d68/dba/fd3 0 2024-04-03T08:39:25.147 INFO:tasks.workunit.client.0.smithi157.stdout:8/676: sync 2024-04-03T08:39:25.149 INFO:tasks.workunit.client.0.smithi157.stdout:1/594: dread d2/d11/d23/f81 [0,4194304] 0 2024-04-03T08:39:25.151 INFO:tasks.workunit.client.0.smithi157.stdout:8/677: readlink d2/d6f/d70/d89/d59/l66 0 2024-04-03T08:39:25.151 INFO:tasks.workunit.client.1.smithi181.stdout:7/458: creat d0/f9f x:0 0 0 2024-04-03T08:39:25.153 INFO:tasks.workunit.client.0.smithi157.stdout:6/700: truncate d1/d5/d17/d2a/fd4 920973 0 2024-04-03T08:39:25.153 INFO:tasks.workunit.client.0.smithi157.stdout:0/648: truncate d2/d9/d51/f7f 1398538 0 2024-04-03T08:39:25.156 INFO:tasks.workunit.client.0.smithi157.stdout:8/678: dread - d2/d11/d10/d24/d5b/fda zero size 2024-04-03T08:39:25.161 INFO:tasks.workunit.client.0.smithi157.stdout:8/679: fdatasync d2/d11/d10/d24/d5b/d53/faf 0 2024-04-03T08:39:25.161 INFO:tasks.workunit.client.1.smithi181.stdout:7/459: symlink d0/d1/d6/de/d17/d64/la0 0 2024-04-03T08:39:25.162 INFO:tasks.workunit.client.1.smithi181.stdout:2/563: creat d13/fd4 x:0 0 0 2024-04-03T08:39:25.163 INFO:tasks.workunit.client.0.smithi157.stdout:9/635: dread d1/d15/d27/f45 [4194304,4194304] 0 2024-04-03T08:39:25.163 INFO:tasks.workunit.client.0.smithi157.stdout:0/649: fsync d2/d9/d36/f80 0 2024-04-03T08:39:25.164 INFO:tasks.workunit.client.1.smithi181.stdout:8/448: dwrite d4/d45/db/f8c [0,4194304] 0 2024-04-03T08:39:25.165 INFO:tasks.workunit.client.0.smithi157.stdout:3/628: mknod d8/d1e/d2d/d39/d51/d7e/db1/cdd 0 2024-04-03T08:39:25.167 INFO:tasks.workunit.client.0.smithi157.stdout:9/636: chown d1/d15/d27/d34/lba 8013760 1 2024-04-03T08:39:25.167 INFO:tasks.workunit.client.1.smithi181.stdout:5/508: dwrite d4/d18/d55/d5a/f8f [0,4194304] 0 2024-04-03T08:39:25.169 INFO:tasks.workunit.client.1.smithi181.stdout:8/449: write d4/d45/db/d14/f62 [4407805,20161] 0 2024-04-03T08:39:25.170 INFO:tasks.workunit.client.0.smithi157.stdout:4/626: mknod da/d26/cda 0 2024-04-03T08:39:25.171 INFO:tasks.workunit.client.1.smithi181.stdout:3/537: write d0/d17/f54 [440593,120810] 0 2024-04-03T08:39:25.171 INFO:tasks.workunit.client.0.smithi157.stdout:8/680: fdatasync d2/f39 0 2024-04-03T08:39:25.177 INFO:tasks.workunit.client.1.smithi181.stdout:5/509: read d4/f5e [502501,38936] 0 2024-04-03T08:39:25.178 INFO:tasks.workunit.client.0.smithi157.stdout:3/629: read d8/d13/f1a [5383115,62562] 0 2024-04-03T08:39:25.179 INFO:tasks.workunit.client.0.smithi157.stdout:9/637: unlink d1/d94/d75/c84 0 2024-04-03T08:39:25.181 INFO:tasks.workunit.client.0.smithi157.stdout:4/627: mkdir da/df/d99/ddb 0 2024-04-03T08:39:25.182 INFO:tasks.workunit.client.0.smithi157.stdout:7/711: dread d0/d11/d15/d17/d43/d8a/fc2 [4194304,4194304] 0 2024-04-03T08:39:25.182 INFO:tasks.workunit.client.0.smithi157.stdout:3/630: fdatasync d8/d13/d1b/d4e/f99 0 2024-04-03T08:39:25.187 INFO:tasks.workunit.client.1.smithi181.stdout:8/450: read d4/d45/db/f33 [2854155,97156] 0 2024-04-03T08:39:25.188 INFO:tasks.workunit.client.0.smithi157.stdout:3/631: fdatasync d8/fc2 0 2024-04-03T08:39:25.189 INFO:tasks.workunit.client.0.smithi157.stdout:0/650: unlink d2/d9/dc/l64 0 2024-04-03T08:39:25.190 INFO:tasks.workunit.client.1.smithi181.stdout:2/564: dwrite d13/f23 [4194304,4194304] 0 2024-04-03T08:39:25.191 INFO:tasks.workunit.client.1.smithi181.stdout:2/565: chown d13/fc1 1888 1 2024-04-03T08:39:25.192 INFO:tasks.workunit.client.1.smithi181.stdout:2/566: chown d13/da7/f84 0 1 2024-04-03T08:39:25.196 INFO:tasks.workunit.client.0.smithi157.stdout:7/712: write d0/d11/d15/d17/d43/fb7 [2039930,55459] 0 2024-04-03T08:39:25.200 INFO:tasks.workunit.client.1.smithi181.stdout:2/567: creat d13/d1c/d4a/d7f/db3/d81/fd5 x:0 0 0 2024-04-03T08:39:25.201 INFO:tasks.workunit.client.0.smithi157.stdout:0/651: creat d2/fef x:0 0 0 2024-04-03T08:39:25.201 INFO:tasks.workunit.client.0.smithi157.stdout:4/628: creat da/df/d99/ddb/fdc x:0 0 0 2024-04-03T08:39:25.202 INFO:tasks.workunit.client.1.smithi181.stdout:2/568: dread - d13/d1c/d4a/d68/d72/fc8 zero size 2024-04-03T08:39:25.204 INFO:tasks.workunit.client.1.smithi181.stdout:2/569: read - d13/fc1 zero size 2024-04-03T08:39:25.205 INFO:tasks.workunit.client.1.smithi181.stdout:9/559: truncate d1/f6 2089048 0 2024-04-03T08:39:25.206 INFO:tasks.workunit.client.1.smithi181.stdout:2/570: chown d13/da7/d40 2 1 2024-04-03T08:39:25.206 INFO:tasks.workunit.client.0.smithi157.stdout:3/632: symlink d8/d1e/d2d/d39/d51/d7e/lde 0 2024-04-03T08:39:25.206 INFO:tasks.workunit.client.0.smithi157.stdout:4/629: chown da/df/lb5 4 1 2024-04-03T08:39:25.209 INFO:tasks.workunit.client.1.smithi181.stdout:9/560: write d1/da/d13/d22/d23/d36/d91/d9d/d39/f59 [1576630,51879] 0 2024-04-03T08:39:25.214 INFO:tasks.workunit.client.0.smithi157.stdout:9/638: getdents d1/d4a/d4d/da4/db8 0 2024-04-03T08:39:25.216 INFO:tasks.workunit.client.1.smithi181.stdout:1/513: write d10/d15/d17/d23/d27/f3a [2258678,86817] 0 2024-04-03T08:39:25.218 INFO:tasks.workunit.client.0.smithi157.stdout:0/652: mkdir d2/d9/dc/d54/df0 0 2024-04-03T08:39:25.219 INFO:tasks.workunit.client.1.smithi181.stdout:1/514: write d10/d15/d17/d23/d27/f87 [4258086,14368] 0 2024-04-03T08:39:25.225 INFO:tasks.workunit.client.1.smithi181.stdout:2/571: dwrite d13/da7/d27/d2f/f5e [8388608,4194304] 0 2024-04-03T08:39:25.227 INFO:tasks.workunit.client.1.smithi181.stdout:2/572: write d13/fc1 [748785,27243] 0 2024-04-03T08:39:25.228 INFO:tasks.workunit.client.1.smithi181.stdout:2/573: read - d13/da7/fb2 zero size 2024-04-03T08:39:25.230 INFO:tasks.workunit.client.0.smithi157.stdout:5/706: dread dc/d29/d43/f69 [0,4194304] 0 2024-04-03T08:39:25.232 INFO:tasks.workunit.client.1.smithi181.stdout:2/574: chown d13/d1c/d4a/d68/fb1 102893361 1 2024-04-03T08:39:25.236 INFO:tasks.workunit.client.1.smithi181.stdout:2/575: chown d13/d1c/d4a/d7f/f89 77083618 1 2024-04-03T08:39:25.237 INFO:tasks.workunit.client.1.smithi181.stdout:7/460: dread d0/d1/d6/de/d17/f4c [0,4194304] 0 2024-04-03T08:39:25.238 INFO:tasks.workunit.client.1.smithi181.stdout:0/500: dwrite d5/dc/d14/f22 [0,4194304] 0 2024-04-03T08:39:25.238 INFO:tasks.workunit.client.0.smithi157.stdout:7/713: dwrite d0/d11/d15/d17/d1c/d4f/d5f/fe4 [0,4194304] 0 2024-04-03T08:39:25.238 INFO:tasks.workunit.client.1.smithi181.stdout:2/576: dread - d13/da7/d40/fbb zero size 2024-04-03T08:39:25.246 INFO:tasks.workunit.client.0.smithi157.stdout:2/653: dwrite d3/d12/f63 [0,4194304] 0 2024-04-03T08:39:25.249 INFO:tasks.workunit.client.1.smithi181.stdout:7/461: symlink d0/d1/d6/de/d6d/la1 0 2024-04-03T08:39:25.253 INFO:tasks.workunit.client.0.smithi157.stdout:8/681: dread d2/d11/f1d [0,4194304] 0 2024-04-03T08:39:25.258 INFO:tasks.workunit.client.0.smithi157.stdout:6/701: dwrite d1/d4b/d38/da6/fb3 [0,4194304] 0 2024-04-03T08:39:25.267 INFO:tasks.workunit.client.1.smithi181.stdout:8/451: dwrite d4/d45/db/d14/d31/f30 [4194304,4194304] 0 2024-04-03T08:39:25.272 INFO:tasks.workunit.client.1.smithi181.stdout:4/562: sync 2024-04-03T08:39:25.274 INFO:tasks.workunit.client.1.smithi181.stdout:9/561: creat d1/da/fae x:0 0 0 2024-04-03T08:39:25.275 INFO:tasks.workunit.client.0.smithi157.stdout:0/653: mkdir d2/d9/dc/df/d1b/d4a/de4/df1 0 2024-04-03T08:39:25.275 INFO:tasks.workunit.client.1.smithi181.stdout:7/462: creat d0/d1/d6/de/d6d/fa2 x:0 0 0 2024-04-03T08:39:25.277 INFO:tasks.workunit.client.0.smithi157.stdout:5/707: creat dc/d29/d56/d49/d53/d6c/fed x:0 0 0 2024-04-03T08:39:25.280 INFO:tasks.workunit.client.1.smithi181.stdout:0/501: creat d5/dc/d14/d8d/f9a x:0 0 0 2024-04-03T08:39:25.283 INFO:tasks.workunit.client.0.smithi157.stdout:2/654: mknod d3/d2e/d32/d9f/ced 0 2024-04-03T08:39:25.283 INFO:tasks.workunit.client.0.smithi157.stdout:0/654: write d2/f2c [1898767,108941] 0 2024-04-03T08:39:25.287 INFO:tasks.workunit.client.0.smithi157.stdout:7/714: fdatasync d0/d11/d15/f1f 0 2024-04-03T08:39:25.287 INFO:tasks.workunit.client.1.smithi181.stdout:8/452: symlink d4/d44/d59/d5f/d6c/l99 0 2024-04-03T08:39:25.288 INFO:tasks.workunit.client.0.smithi157.stdout:9/639: mknod d1/d94/cdc 0 2024-04-03T08:39:25.295 INFO:tasks.workunit.client.0.smithi157.stdout:6/702: write d1/d5/d17/d29/da7/fd0 [7975,103812] 0 2024-04-03T08:39:25.296 INFO:tasks.workunit.client.0.smithi157.stdout:4/630: creat da/fdd x:0 0 0 2024-04-03T08:39:25.297 INFO:tasks.workunit.client.1.smithi181.stdout:2/577: dread d13/d1c/d4a/d68/f94 [0,4194304] 0 2024-04-03T08:39:25.303 INFO:tasks.workunit.client.1.smithi181.stdout:1/515: getdents d10/d15/d17/d19/d4c 0 2024-04-03T08:39:25.303 INFO:tasks.workunit.client.0.smithi157.stdout:3/633: dread d8/d1e/d2d/f79 [0,4194304] 0 2024-04-03T08:39:25.304 INFO:tasks.workunit.client.0.smithi157.stdout:5/708: symlink dc/d29/d56/d52/lee 0 2024-04-03T08:39:25.306 INFO:tasks.workunit.client.1.smithi181.stdout:4/563: mkdir d1/d16/dbc 0 2024-04-03T08:39:25.307 INFO:tasks.workunit.client.0.smithi157.stdout:3/634: truncate d8/d1e/d2d/d3b/d9e/fd2 553965 0 2024-04-03T08:39:25.311 INFO:tasks.workunit.client.1.smithi181.stdout:4/564: dread d1/d1e/d78/f97 [0,4194304] 0 2024-04-03T08:39:25.313 INFO:tasks.workunit.client.0.smithi157.stdout:0/655: creat d2/d9/d5f/d85/ff2 x:0 0 0 2024-04-03T08:39:25.314 INFO:tasks.workunit.client.1.smithi181.stdout:0/502: symlink d5/dc/d8e/l9b 0 2024-04-03T08:39:25.320 INFO:tasks.workunit.client.0.smithi157.stdout:3/635: dread d8/f57 [0,4194304] 0 2024-04-03T08:39:25.320 INFO:tasks.workunit.client.0.smithi157.stdout:7/715: mknod d0/d11/d6f/cfd 0 2024-04-03T08:39:25.320 INFO:tasks.workunit.client.1.smithi181.stdout:1/516: rename d10/f22 to d10/d15/d4b/d6c/f9f 0 2024-04-03T08:39:25.324 INFO:tasks.workunit.client.0.smithi157.stdout:9/640: symlink d1/d15/d27/d34/ldd 0 2024-04-03T08:39:25.327 INFO:tasks.workunit.client.0.smithi157.stdout:6/703: mknod d1/d4b/d38/da6/cef 0 2024-04-03T08:39:25.328 INFO:tasks.workunit.client.1.smithi181.stdout:0/503: fdatasync d5/dc/d14/f5c 0 2024-04-03T08:39:25.330 INFO:tasks.workunit.client.0.smithi157.stdout:5/709: mkdir dc/d29/d56/d9e/dc3/dde/def 0 2024-04-03T08:39:25.331 INFO:tasks.workunit.client.1.smithi181.stdout:0/504: fsync d5/dc/d14/d29/f78 0 2024-04-03T08:39:25.332 INFO:tasks.workunit.client.1.smithi181.stdout:9/562: dwrite d1/da/d13/d22/f31 [0,4194304] 0 2024-04-03T08:39:25.332 INFO:tasks.workunit.client.0.smithi157.stdout:7/716: dread d0/d11/d15/d17/d1c/d4f/d5f/fe4 [0,4194304] 0 2024-04-03T08:39:25.336 INFO:tasks.workunit.client.0.smithi157.stdout:5/710: truncate dc/d29/d56/d18/fd9 1022654 0 2024-04-03T08:39:25.339 INFO:tasks.workunit.client.1.smithi181.stdout:4/565: mkdir d1/d16/d24/d5e/d31/d39/db1/dbd 0 2024-04-03T08:39:25.340 INFO:tasks.workunit.client.1.smithi181.stdout:0/505: truncate d5/dc/d14/d29/f78 5107273 0 2024-04-03T08:39:25.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:24 smithi181 ceph-mon[44183]: pgmap v9: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 167 MiB/s wr, 338 op/s 2024-04-03T08:39:25.347 INFO:tasks.workunit.client.0.smithi157.stdout:8/682: creat d2/fe5 x:0 0 0 2024-04-03T08:39:25.354 INFO:tasks.workunit.client.1.smithi181.stdout:9/563: mkdir d1/da/d13/d41/daf 0 2024-04-03T08:39:25.357 INFO:tasks.workunit.client.0.smithi157.stdout:7/717: dwrite d0/d11/d15/d17/d52/db6/dda/de6/ff1 [0,4194304] 0 2024-04-03T08:39:25.358 INFO:tasks.workunit.client.0.smithi157.stdout:6/704: rename d1/d5/d17/d29/da3 to d1/d5/d17/d29/da7/db9/df0 0 2024-04-03T08:39:25.365 INFO:tasks.workunit.client.0.smithi157.stdout:2/655: unlink d3/d12/d43/d4b/d55/c49 0 2024-04-03T08:39:25.370 INFO:tasks.workunit.client.1.smithi181.stdout:2/578: getdents d13/d1c/d4a/d68/dba 0 2024-04-03T08:39:25.371 INFO:tasks.workunit.client.1.smithi181.stdout:2/579: fsync d13/d1c/d4a/f4d 0 2024-04-03T08:39:25.377 INFO:tasks.workunit.client.1.smithi181.stdout:4/566: truncate d1/d16/d24/d5e/d31/d39/fbb 3319461 0 2024-04-03T08:39:25.378 INFO:tasks.workunit.client.1.smithi181.stdout:9/564: stat d1/f6 0 2024-04-03T08:39:25.378 INFO:tasks.workunit.client.1.smithi181.stdout:1/517: creat d10/d15/d17/d19/d33/fa0 x:0 0 0 2024-04-03T08:39:25.379 INFO:tasks.workunit.client.1.smithi181.stdout:1/518: fdatasync d10/d15/d17/f93 0 2024-04-03T08:39:25.379 INFO:tasks.workunit.client.0.smithi157.stdout:8/683: mknod d2/d6f/db5/ce6 0 2024-04-03T08:39:25.384 INFO:tasks.workunit.client.0.smithi157.stdout:2/656: symlink d3/db/d44/d4c/lee 0 2024-04-03T08:39:25.385 INFO:tasks.workunit.client.1.smithi181.stdout:2/580: fsync d13/d1c/d4a/d68/dba/fd3 0 2024-04-03T08:39:25.385 INFO:tasks.workunit.client.1.smithi181.stdout:0/506: creat d5/dc/d14/f9c x:0 0 0 2024-04-03T08:39:25.387 INFO:tasks.workunit.client.0.smithi157.stdout:0/656: link d2/d9/d36/f3f d2/d9/dc/d54/ff3 0 2024-04-03T08:39:25.390 INFO:tasks.workunit.client.1.smithi181.stdout:6/522: sync 2024-04-03T08:39:25.391 INFO:tasks.workunit.client.0.smithi157.stdout:3/636: creat d8/fdf x:0 0 0 2024-04-03T08:39:25.393 INFO:tasks.workunit.client.1.smithi181.stdout:4/567: mknod d1/d16/d24/db5/cbe 0 2024-04-03T08:39:25.393 INFO:tasks.workunit.client.0.smithi157.stdout:5/711: write dc/d29/d56/d18/f37 [353314,60188] 0 2024-04-03T08:39:25.395 INFO:tasks.workunit.client.1.smithi181.stdout:4/568: dread - d1/d16/d24/d5e/d3f/d81/f99 zero size 2024-04-03T08:39:25.398 INFO:tasks.workunit.client.0.smithi157.stdout:6/705: dread d1/d5/d17/d29/d80/fdf [0,4194304] 0 2024-04-03T08:39:25.400 INFO:tasks.workunit.client.1.smithi181.stdout:2/581: mknod d13/d1c/d4a/d68/cd6 0 2024-04-03T08:39:25.401 INFO:tasks.workunit.client.0.smithi157.stdout:6/706: dread - d1/d5/d17/d29/da7/db9/fd3 zero size 2024-04-03T08:39:25.403 INFO:tasks.workunit.client.1.smithi181.stdout:0/507: creat d5/dc/d75/f9d x:0 0 0 2024-04-03T08:39:25.409 INFO:tasks.workunit.client.0.smithi157.stdout:2/657: creat d3/d2e/d65/fef x:0 0 0 2024-04-03T08:39:25.409 INFO:tasks.workunit.client.0.smithi157.stdout:9/641: dwrite d1/f19 [0,4194304] 0 2024-04-03T08:39:25.412 INFO:tasks.workunit.client.1.smithi181.stdout:4/569: mknod d1/d16/d24/cbf 0 2024-04-03T08:39:25.413 INFO:tasks.workunit.client.1.smithi181.stdout:4/570: fdatasync d1/d16/d24/d5e/f45 0 2024-04-03T08:39:25.414 INFO:tasks.workunit.client.1.smithi181.stdout:9/565: write d1/da/d13/d22/f8d [1779565,50668] 0 2024-04-03T08:39:25.417 INFO:tasks.workunit.client.1.smithi181.stdout:1/519: mkdir d10/da1 0 2024-04-03T08:39:25.417 INFO:tasks.workunit.client.1.smithi181.stdout:9/566: fdatasync d1/da/d13/d41/d65/fa6 0 2024-04-03T08:39:25.421 INFO:tasks.workunit.client.1.smithi181.stdout:9/567: read d1/da/d13/d22/d23/d36/d91/d9d/f37 [583198,112497] 0 2024-04-03T08:39:25.422 INFO:tasks.workunit.client.0.smithi157.stdout:3/637: dread - d8/d1e/d2d/d39/f76 zero size 2024-04-03T08:39:25.425 INFO:tasks.workunit.client.1.smithi181.stdout:0/508: unlink d5/dc/l70 0 2024-04-03T08:39:25.427 INFO:tasks.workunit.client.0.smithi157.stdout:7/718: rmdir d0/d11/d15/d1b/dde 0 2024-04-03T08:39:25.427 INFO:tasks.workunit.client.1.smithi181.stdout:6/523: symlink d6/d3e/d5e/d7c/d9/d7f/d95/la4 0 2024-04-03T08:39:25.428 INFO:tasks.workunit.client.1.smithi181.stdout:6/524: read - d6/d3e/f7e zero size 2024-04-03T08:39:25.428 INFO:tasks.workunit.client.0.smithi157.stdout:5/712: creat dc/d29/d56/d9e/dc3/ff0 x:0 0 0 2024-04-03T08:39:25.433 INFO:tasks.workunit.client.0.smithi157.stdout:5/713: fdatasync dc/d29/d56/d52/d9d/da5/daa/fcf 0 2024-04-03T08:39:25.436 INFO:tasks.workunit.client.0.smithi157.stdout:8/684: rename d2/fb8 to d2/d20/db1/dbc/de2/fe7 0 2024-04-03T08:39:25.436 INFO:tasks.workunit.client.1.smithi181.stdout:2/582: write d13/da7/d27/f8a [35372,107635] 0 2024-04-03T08:39:25.440 INFO:tasks.workunit.client.1.smithi181.stdout:4/571: rename d1/d1e/fa2 to d1/d16/d24/d5e/d31/d39/da1/fc0 0 2024-04-03T08:39:25.443 INFO:tasks.workunit.client.0.smithi157.stdout:9/642: symlink d1/d4a/d4d/lde 0 2024-04-03T08:39:25.445 INFO:tasks.workunit.client.1.smithi181.stdout:1/520: write d10/d15/d17/d19/d33/f64 [277816,8842] 0 2024-04-03T08:39:25.446 INFO:tasks.workunit.client.0.smithi157.stdout:2/658: truncate d3/d12/d43/d4b/f79 681048 0 2024-04-03T08:39:25.449 INFO:tasks.workunit.client.1.smithi181.stdout:6/525: dread d6/f3a [0,4194304] 0 2024-04-03T08:39:25.449 INFO:tasks.workunit.client.1.smithi181.stdout:9/568: read d1/da/d13/d22/f3b [236291,109493] 0 2024-04-03T08:39:25.450 INFO:tasks.workunit.client.0.smithi157.stdout:6/707: write d1/d5/d17/d2a/d30/d95/f26 [850831,103057] 0 2024-04-03T08:39:25.451 INFO:tasks.workunit.client.1.smithi181.stdout:6/526: dread - d6/d3e/d5e/d7c/d9/d22/f88 zero size 2024-04-03T08:39:25.452 INFO:tasks.workunit.client.1.smithi181.stdout:9/569: read d1/da/f21 [103022,61470] 0 2024-04-03T08:39:25.453 INFO:tasks.workunit.client.1.smithi181.stdout:6/527: write d6/d3e/d40/fa3 [318439,81075] 0 2024-04-03T08:39:25.459 INFO:tasks.workunit.client.0.smithi157.stdout:5/714: fsync dc/f1f 0 2024-04-03T08:39:25.460 INFO:tasks.workunit.client.1.smithi181.stdout:1/521: symlink d10/d15/d17/d37/la2 0 2024-04-03T08:39:25.466 INFO:tasks.workunit.client.0.smithi157.stdout:9/643: creat d1/d94/d75/fdf x:0 0 0 2024-04-03T08:39:25.469 INFO:tasks.workunit.client.0.smithi157.stdout:7/719: write d0/d11/d15/d17/d1c/d88/fc5 [404603,11847] 0 2024-04-03T08:39:25.469 INFO:tasks.workunit.client.1.smithi181.stdout:3/538: sync 2024-04-03T08:39:25.471 INFO:tasks.workunit.client.0.smithi157.stdout:3/638: mkdir d8/d1e/d2d/d39/d51/d4c/dd6/de0 0 2024-04-03T08:39:25.473 INFO:tasks.workunit.client.1.smithi181.stdout:6/528: rmdir d6/d3e/d5e/d7c/d50 39 2024-04-03T08:39:25.474 INFO:tasks.workunit.client.1.smithi181.stdout:6/529: fdatasync d6/d31/d36/f96 0 2024-04-03T08:39:25.475 INFO:tasks.workunit.client.0.smithi157.stdout:8/685: mkdir d2/d11/d10/d24/d5b/d2e/dcf/dd2/de8 0 2024-04-03T08:39:25.476 INFO:tasks.workunit.client.0.smithi157.stdout:7/720: fsync d0/d11/d15/d17/d1c/da1/fa4 0 2024-04-03T08:39:25.478 INFO:tasks.workunit.client.0.smithi157.stdout:0/657: dread d2/d9/d36/d38/f83 [8388608,4194304] 0 2024-04-03T08:39:25.479 INFO:tasks.workunit.client.1.smithi181.stdout:2/583: symlink d13/da7/ld7 0 2024-04-03T08:39:25.479 INFO:tasks.workunit.client.1.smithi181.stdout:4/572: creat d1/d16/dbc/fc1 x:0 0 0 2024-04-03T08:39:25.482 INFO:tasks.workunit.client.1.smithi181.stdout:1/522: creat d10/d15/d41/fa3 x:0 0 0 2024-04-03T08:39:25.482 INFO:tasks.workunit.client.1.smithi181.stdout:9/570: write d1/da/d13/d41/f2a [4998612,97082] 0 2024-04-03T08:39:25.483 INFO:tasks.workunit.client.0.smithi157.stdout:2/659: chown d3/d2e/fb5 30 1 2024-04-03T08:39:25.485 INFO:tasks.workunit.client.1.smithi181.stdout:0/509: creat d5/d9/f9e x:0 0 0 2024-04-03T08:39:25.487 INFO:tasks.workunit.client.0.smithi157.stdout:3/639: symlink d8/d13/d1b/d37/le1 0 2024-04-03T08:39:25.497 INFO:tasks.workunit.client.0.smithi157.stdout:7/721: dread d0/d11/d15/f87 [0,4194304] 0 2024-04-03T08:39:25.500 INFO:tasks.workunit.client.0.smithi157.stdout:3/640: mknod d8/d1e/d2d/d3f/d4d/d8f/ce2 0 2024-04-03T08:39:25.501 INFO:tasks.workunit.client.0.smithi157.stdout:9/644: dread d1/d15/d27/d34/f6d [0,4194304] 0 2024-04-03T08:39:25.506 INFO:tasks.workunit.client.0.smithi157.stdout:8/686: creat d2/d11/d10/fe9 x:0 0 0 2024-04-03T08:39:25.516 INFO:tasks.workunit.client.0.smithi157.stdout:2/660: creat d3/d12/ff0 x:0 0 0 2024-04-03T08:39:25.520 INFO:tasks.workunit.client.0.smithi157.stdout:3/641: truncate d8/d1e/d2d/d3b/d8c/db4/fbd 650491 0 2024-04-03T08:39:25.521 INFO:tasks.workunit.client.0.smithi157.stdout:0/658: dwrite d2/d9/dc/df/d1b/f6d [0,4194304] 0 2024-04-03T08:39:25.521 INFO:tasks.workunit.client.0.smithi157.stdout:5/715: dwrite dc/d29/d43/fb7 [0,4194304] 0 2024-04-03T08:39:25.525 INFO:tasks.workunit.client.0.smithi157.stdout:5/716: chown dc/d29/d56/d52/f58 31 1 2024-04-03T08:39:25.527 INFO:tasks.workunit.client.0.smithi157.stdout:7/722: write d0/d11/d15/d17/d1c/f47 [4632166,117856] 0 2024-04-03T08:39:25.530 INFO:tasks.workunit.client.0.smithi157.stdout:5/717: write dc/dbb/fe3 [554887,66884] 0 2024-04-03T08:39:25.535 INFO:tasks.workunit.client.0.smithi157.stdout:9/645: creat d1/d4a/dc4/fe0 x:0 0 0 2024-04-03T08:39:25.541 INFO:tasks.workunit.client.0.smithi157.stdout:0/659: creat d2/d9/dc/df/d1b/ff4 x:0 0 0 2024-04-03T08:39:25.545 INFO:tasks.workunit.client.1.smithi181.stdout:7/463: sync 2024-04-03T08:39:25.545 INFO:tasks.workunit.client.1.smithi181.stdout:5/510: sync 2024-04-03T08:39:25.545 INFO:tasks.workunit.client.1.smithi181.stdout:8/453: sync 2024-04-03T08:39:25.550 INFO:tasks.workunit.client.0.smithi157.stdout:5/718: rmdir dc/d29/d56 39 2024-04-03T08:39:25.552 INFO:tasks.workunit.client.0.smithi157.stdout:3/642: truncate d8/d1e/d2d/d39/d51/d4c/d32/f42 1946163 0 2024-04-03T08:39:25.556 INFO:tasks.workunit.client.1.smithi181.stdout:2/584: mkdir d13/d1c/d4a/d7f/db3/dbf/dd8 0 2024-04-03T08:39:25.557 INFO:tasks.workunit.client.1.smithi181.stdout:2/585: fdatasync d13/fd4 0 2024-04-03T08:39:25.559 INFO:tasks.workunit.client.0.smithi157.stdout:2/661: dwrite d3/d2e/d32/f94 [0,4194304] 0 2024-04-03T08:39:25.562 INFO:tasks.workunit.client.1.smithi181.stdout:9/571: readlink d1/da/d13/d22/d23/l72 0 2024-04-03T08:39:25.574 INFO:tasks.workunit.client.0.smithi157.stdout:3/643: mknod d8/d1e/d2d/d3b/d8c/db4/ce3 0 2024-04-03T08:39:25.575 INFO:tasks.workunit.client.1.smithi181.stdout:6/530: mknod d6/d53/d8d/d97/ca5 0 2024-04-03T08:39:25.576 INFO:tasks.workunit.client.0.smithi157.stdout:8/687: link d2/d6f/d70/l78 d2/d20/d77/lea 0 2024-04-03T08:39:25.577 INFO:tasks.workunit.client.0.smithi157.stdout:4/631: sync 2024-04-03T08:39:25.577 INFO:tasks.workunit.client.0.smithi157.stdout:1/595: sync 2024-04-03T08:39:25.577 INFO:tasks.workunit.client.1.smithi181.stdout:6/531: write d6/d53/f94 [943607,114890] 0 2024-04-03T08:39:25.580 INFO:tasks.workunit.client.0.smithi157.stdout:7/723: dread d0/d11/d6f/d89/d8c/dc6/fe8 [0,4194304] 0 2024-04-03T08:39:25.585 INFO:tasks.workunit.client.0.smithi157.stdout:7/724: read d0/d11/d15/d17/f7d [58527,52529] 0 2024-04-03T08:39:25.585 INFO:tasks.workunit.client.1.smithi181.stdout:8/454: dread - d4/d44/f5a zero size 2024-04-03T08:39:25.588 INFO:tasks.workunit.client.1.smithi181.stdout:8/455: write d4/d45/db/d5c/d5e/f7a [1208650,83013] 0 2024-04-03T08:39:25.589 INFO:tasks.workunit.client.0.smithi157.stdout:2/662: rename d3/d2e/d65/dae to d3/db/d44/d4c/df1 0 2024-04-03T08:39:25.593 INFO:tasks.workunit.client.0.smithi157.stdout:0/660: creat d2/d9/dc/ff5 x:0 0 0 2024-04-03T08:39:25.594 INFO:tasks.workunit.client.1.smithi181.stdout:0/510: dwrite d5/d9/f28 [0,4194304] 0 2024-04-03T08:39:25.597 INFO:tasks.workunit.client.1.smithi181.stdout:3/539: rename d0/d17/d36/l42 to d0/d5/lb1 0 2024-04-03T08:39:25.598 INFO:tasks.workunit.client.1.smithi181.stdout:3/540: fsync d0/d5/fa 0 2024-04-03T08:39:25.603 INFO:tasks.workunit.client.1.smithi181.stdout:1/523: sync 2024-04-03T08:39:25.605 INFO:tasks.workunit.client.0.smithi157.stdout:5/719: link dc/d29/d51/c55 dc/dce/cf1 0 2024-04-03T08:39:25.608 INFO:tasks.workunit.client.0.smithi157.stdout:4/632: dwrite da/df/d2f/f40 [0,4194304] 0 2024-04-03T08:39:25.608 INFO:tasks.workunit.client.1.smithi181.stdout:2/586: symlink d13/d1c/d4a/ld9 0 2024-04-03T08:39:25.611 INFO:tasks.workunit.client.1.smithi181.stdout:8/456: truncate d4/d45/db/d5c/f72 114224 0 2024-04-03T08:39:25.611 INFO:tasks.workunit.client.1.smithi181.stdout:2/587: chown d13/d1c/d4a/d7f/db3/d8f/f93 26 1 2024-04-03T08:39:25.612 INFO:tasks.workunit.client.0.smithi157.stdout:7/725: mknod d0/d11/d15/d1b/cfe 0 2024-04-03T08:39:25.614 INFO:tasks.workunit.client.1.smithi181.stdout:2/588: chown d13/d1c/d4a/ld9 900579 1 2024-04-03T08:39:25.616 INFO:tasks.workunit.client.1.smithi181.stdout:9/572: rename d1/da/d28/d30/l3c to d1/da/d28/lb0 0 2024-04-03T08:39:25.618 INFO:tasks.workunit.client.0.smithi157.stdout:1/596: symlink d2/d11/d24/d39/d3b/d2e/d48/d5d/d9a/lbf 0 2024-04-03T08:39:25.618 INFO:tasks.workunit.client.0.smithi157.stdout:8/688: dread d2/d6f/d70/f97 [0,4194304] 0 2024-04-03T08:39:25.620 INFO:tasks.workunit.client.0.smithi157.stdout:0/661: truncate d2/d9/d36/d38/faf 530393 0 2024-04-03T08:39:25.621 INFO:tasks.workunit.client.1.smithi181.stdout:2/589: truncate d13/da7/d85/dbd/fce 965413 0 2024-04-03T08:39:25.621 INFO:tasks.workunit.client.1.smithi181.stdout:4/573: dwrite d1/d16/d24/d5e/d3f/d41/f42 [0,4194304] 0 2024-04-03T08:39:25.623 INFO:tasks.workunit.client.0.smithi157.stdout:4/633: symlink da/df/d2f/d64/d8f/dbd/d68/lde 0 2024-04-03T08:39:25.624 INFO:tasks.workunit.client.1.smithi181.stdout:3/541: symlink d0/d5/d6/d32/daa/lb2 0 2024-04-03T08:39:25.624 INFO:tasks.workunit.client.0.smithi157.stdout:7/726: dread - d0/d11/d15/d1b/db8/fba zero size 2024-04-03T08:39:25.625 INFO:tasks.workunit.client.1.smithi181.stdout:2/590: chown d13/da7/d27/d2f/l33 3981711 1 2024-04-03T08:39:25.626 INFO:tasks.workunit.client.1.smithi181.stdout:2/591: chown d13/d7b/f7e 0 1 2024-04-03T08:39:25.629 INFO:tasks.workunit.client.0.smithi157.stdout:1/597: symlink d2/d11/d24/d39/d3b/d2e/lc0 0 2024-04-03T08:39:25.632 INFO:tasks.workunit.client.0.smithi157.stdout:8/689: symlink d2/d11/d10/d24/d5b/d53/leb 0 2024-04-03T08:39:25.636 INFO:tasks.workunit.client.1.smithi181.stdout:0/511: fsync d5/d9/d2e/f43 0 2024-04-03T08:39:25.640 INFO:tasks.workunit.client.0.smithi157.stdout:4/634: mknod da/d26/cdf 0 2024-04-03T08:39:25.643 INFO:tasks.workunit.client.1.smithi181.stdout:6/532: rename d6/d3e/d5e/d7c/d9/d22 to d6/d3e/d5e/d7c/d9/d7f/da6 0 2024-04-03T08:39:25.644 INFO:tasks.workunit.client.1.smithi181.stdout:5/511: dread d4/d22/d53/f6d [0,4194304] 0 2024-04-03T08:39:25.644 INFO:tasks.workunit.client.1.smithi181.stdout:9/573: symlink d1/da/d1a/lb1 0 2024-04-03T08:39:25.646 INFO:tasks.workunit.client.0.smithi157.stdout:7/727: dread d0/d11/d15/d17/f77 [0,4194304] 0 2024-04-03T08:39:25.647 INFO:tasks.workunit.client.0.smithi157.stdout:8/690: creat d2/d20/d23/fec x:0 0 0 2024-04-03T08:39:25.649 INFO:tasks.workunit.client.1.smithi181.stdout:7/464: sync 2024-04-03T08:39:25.650 INFO:tasks.workunit.client.0.smithi157.stdout:3/644: dread d8/d13/d1b/d4e/da6/f89 [0,4194304] 0 2024-04-03T08:39:25.651 INFO:tasks.workunit.client.1.smithi181.stdout:3/542: creat d0/d5/d6/d3f/fb3 x:0 0 0 2024-04-03T08:39:25.651 INFO:tasks.workunit.client.1.smithi181.stdout:9/574: dread d1/da/d28/f9a [0,4194304] 0 2024-04-03T08:39:25.653 INFO:tasks.workunit.client.0.smithi157.stdout:7/728: fsync d0/d11/d6f/d76/da7/f62 0 2024-04-03T08:39:25.653 INFO:tasks.workunit.client.0.smithi157.stdout:3/645: chown f4 108 1 2024-04-03T08:39:25.653 INFO:tasks.workunit.client.1.smithi181.stdout:2/592: creat d13/d1c/d6c/fda x:0 0 0 2024-04-03T08:39:25.656 INFO:tasks.workunit.client.0.smithi157.stdout:0/662: dread d2/d9/d36/d38/faf [0,4194304] 0 2024-04-03T08:39:25.658 INFO:tasks.workunit.client.0.smithi157.stdout:3/646: chown d8/d13/d1b/d4e/d50/fc9 62155 1 2024-04-03T08:39:25.660 INFO:tasks.workunit.client.0.smithi157.stdout:2/663: dwrite d3/d2e/d32/d3c/f3f [0,4194304] 0 2024-04-03T08:39:25.662 INFO:tasks.workunit.client.0.smithi157.stdout:0/663: chown d2/d9/dc/df/d1b/d35 1193 1 2024-04-03T08:39:25.663 INFO:tasks.workunit.client.1.smithi181.stdout:6/533: creat d6/d31/d36/fa7 x:0 0 0 2024-04-03T08:39:25.666 INFO:tasks.workunit.client.0.smithi157.stdout:3/647: chown d8/d1e/d2d/d3f/d4d/d8f/ce2 13 1 2024-04-03T08:39:25.667 INFO:tasks.workunit.client.0.smithi157.stdout:0/664: write d2/f3 [625785,101714] 0 2024-04-03T08:39:25.671 INFO:tasks.workunit.client.0.smithi157.stdout:3/648: chown d8/d1e/d2d/d39/d51/d4c/c75 382 1 2024-04-03T08:39:25.674 INFO:tasks.workunit.client.0.smithi157.stdout:3/649: stat d8/d1e/d2d/d39/d51/d4c/d32/c6f 0 2024-04-03T08:39:25.674 INFO:tasks.workunit.client.1.smithi181.stdout:8/457: dwrite d4/f19 [0,4194304] 0 2024-04-03T08:39:25.675 INFO:tasks.workunit.client.1.smithi181.stdout:1/524: rmdir d10/d15/d17/d23/d8b 0 2024-04-03T08:39:25.681 INFO:tasks.workunit.client.1.smithi181.stdout:2/593: dread f12 [0,4194304] 0 2024-04-03T08:39:25.681 INFO:tasks.workunit.client.0.smithi157.stdout:4/635: mkdir da/de0 0 2024-04-03T08:39:25.681 INFO:tasks.workunit.client.0.smithi157.stdout:8/691: dread d2/d20/f60 [0,4194304] 0 2024-04-03T08:39:25.682 INFO:tasks.workunit.client.0.smithi157.stdout:7/729: dwrite d0/d11/d15/d17/f7c [0,4194304] 0 2024-04-03T08:39:25.688 INFO:tasks.workunit.client.1.smithi181.stdout:4/574: dwrite d1/d16/d24/d5e/d31/d39/d5d/f88 [0,4194304] 0 2024-04-03T08:39:25.692 INFO:tasks.workunit.client.0.smithi157.stdout:7/730: read d0/d11/d15/d17/d43/f45 [869539,131030] 0 2024-04-03T08:39:25.694 INFO:tasks.workunit.client.0.smithi157.stdout:2/664: symlink d3/d12/d43/d4b/d55/lf2 0 2024-04-03T08:39:25.695 INFO:tasks.workunit.client.0.smithi157.stdout:1/598: truncate d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/fb7 2194638 0 2024-04-03T08:39:25.698 INFO:tasks.workunit.client.1.smithi181.stdout:9/575: mkdir d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/db2 0 2024-04-03T08:39:25.706 INFO:tasks.workunit.client.1.smithi181.stdout:6/534: creat d6/d31/d36/d73/fa8 x:0 0 0 2024-04-03T08:39:25.707 INFO:tasks.workunit.client.1.smithi181.stdout:5/512: dwrite d4/f3f [0,4194304] 0 2024-04-03T08:39:25.709 INFO:tasks.workunit.client.1.smithi181.stdout:8/458: stat d4/d45/db/d5c/d5e/l6a 0 2024-04-03T08:39:25.714 INFO:tasks.workunit.client.1.smithi181.stdout:2/594: fdatasync ff 0 2024-04-03T08:39:25.715 INFO:tasks.workunit.client.1.smithi181.stdout:7/465: mkdir d0/d1/d6/de/da3 0 2024-04-03T08:39:25.717 INFO:tasks.workunit.client.0.smithi157.stdout:0/665: mkdir d2/d9/dc/df/d1b/d4a/de4/df1/df6 0 2024-04-03T08:39:25.723 INFO:tasks.workunit.client.0.smithi157.stdout:4/636: fdatasync da/df/d2f/d54/fd3 0 2024-04-03T08:39:25.728 INFO:tasks.workunit.client.0.smithi157.stdout:2/665: dread d3/db/d44/d4c/d5a/fd4 [0,4194304] 0 2024-04-03T08:39:25.729 INFO:tasks.workunit.client.0.smithi157.stdout:0/666: truncate d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/feb 504528 0 2024-04-03T08:39:25.736 INFO:tasks.workunit.client.0.smithi157.stdout:8/692: truncate d2/d11/d10/d24/d5b/d2e/f3f 1013095 0 2024-04-03T08:39:25.737 INFO:tasks.workunit.client.1.smithi181.stdout:1/525: dwrite d10/d15/d17/d19/f2f [4194304,4194304] 0 2024-04-03T08:39:25.738 INFO:tasks.workunit.client.0.smithi157.stdout:0/667: fsync d2/d9/d51/d63/d71/fe7 0 2024-04-03T08:39:25.740 INFO:tasks.workunit.client.0.smithi157.stdout:7/731: unlink d0/d4/d8e/d96/df4/lfc 0 2024-04-03T08:39:25.742 INFO:tasks.workunit.client.0.smithi157.stdout:8/693: dread - d2/d11/d10/d24/d5b/fda zero size 2024-04-03T08:39:25.743 INFO:tasks.workunit.client.0.smithi157.stdout:4/637: dread da/df/d11/f66 [0,4194304] 0 2024-04-03T08:39:25.743 INFO:tasks.workunit.client.1.smithi181.stdout:6/535: unlink d6/d31/d36/f33 0 2024-04-03T08:39:25.746 INFO:tasks.workunit.client.0.smithi157.stdout:3/650: rename d8/d13/l5e to d8/le4 0 2024-04-03T08:39:25.748 INFO:tasks.workunit.client.1.smithi181.stdout:5/513: truncate d4/f39 2699289 0 2024-04-03T08:39:25.750 INFO:tasks.workunit.client.1.smithi181.stdout:5/514: stat d4/d18/d2c/c66 0 2024-04-03T08:39:25.755 INFO:tasks.workunit.client.1.smithi181.stdout:3/543: link d0/d17/d36/c3c d0/d17/d36/d3b/d5a/d85/cb4 0 2024-04-03T08:39:25.756 INFO:tasks.workunit.client.1.smithi181.stdout:9/576: creat d1/da/d1a/d92/fb3 x:0 0 0 2024-04-03T08:39:25.757 INFO:tasks.workunit.client.1.smithi181.stdout:0/512: rename d5/dc/d14/d29/c8a to d5/d9/d60/c9f 0 2024-04-03T08:39:25.758 INFO:tasks.workunit.client.1.smithi181.stdout:0/513: stat d5/d9/d2e/l96 0 2024-04-03T08:39:25.760 INFO:tasks.workunit.client.1.smithi181.stdout:1/526: creat d10/d15/d17/d19/d33/fa4 x:0 0 0 2024-04-03T08:39:25.762 INFO:tasks.workunit.client.1.smithi181.stdout:1/527: chown d10/d15/d17/d19/f2f 1 1 2024-04-03T08:39:25.764 INFO:tasks.workunit.client.1.smithi181.stdout:6/536: read d6/d3e/d5e/d7c/d50/f61 [19168,111400] 0 2024-04-03T08:39:25.766 INFO:tasks.workunit.client.0.smithi157.stdout:1/599: truncate d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 177525 0 2024-04-03T08:39:25.768 INFO:tasks.workunit.client.1.smithi181.stdout:6/537: read d6/d3e/d5e/d7c/d9/d7f/da6/d4f/f7a [1545535,129559] 0 2024-04-03T08:39:25.769 INFO:tasks.workunit.client.0.smithi157.stdout:1/600: readlink d2/d11/d24/d39/d3b/d2e/d48/d5d/d9a/lbf 0 2024-04-03T08:39:25.770 INFO:tasks.workunit.client.1.smithi181.stdout:6/538: readlink d6/d31/d36/d73/l93 0 2024-04-03T08:39:25.773 INFO:tasks.workunit.client.1.smithi181.stdout:3/544: mkdir d0/d17/d36/d1e/db5 0 2024-04-03T08:39:25.774 INFO:tasks.workunit.client.1.smithi181.stdout:2/595: dwrite d13/d1c/d73/fa4 [4194304,4194304] 0 2024-04-03T08:39:25.775 INFO:tasks.workunit.client.1.smithi181.stdout:6/539: write d6/d3e/d5e/d7c/d9/d7f/da6/d4f/fa1 [687882,84719] 0 2024-04-03T08:39:25.780 INFO:tasks.workunit.client.1.smithi181.stdout:9/577: rmdir d1 39 2024-04-03T08:39:25.783 INFO:tasks.workunit.client.1.smithi181.stdout:6/540: read d6/d53/f79 [997663,49111] 0 2024-04-03T08:39:25.785 INFO:tasks.workunit.client.1.smithi181.stdout:8/459: rename d4/d45/db/d14/d31/d1c/f2c to d4/d44/d59/d5f/f9a 0 2024-04-03T08:39:25.788 INFO:tasks.workunit.client.1.smithi181.stdout:8/460: stat d4/d2a/d37/d67/l90 0 2024-04-03T08:39:25.790 INFO:tasks.workunit.client.1.smithi181.stdout:8/461: chown d4/d45/db/d14/f62 356 1 2024-04-03T08:39:25.792 INFO:tasks.workunit.client.1.smithi181.stdout:1/528: read d10/d15/d17/d19/d33/f6a [1553437,87902] 0 2024-04-03T08:39:25.796 INFO:tasks.workunit.client.1.smithi181.stdout:4/575: getdents d1/d1e/d2c/d67 0 2024-04-03T08:39:25.799 INFO:tasks.workunit.client.1.smithi181.stdout:4/576: write d1/d1e/d2c/f77 [5139892,124395] 0 2024-04-03T08:39:25.811 INFO:tasks.workunit.client.1.smithi181.stdout:7/466: rename d0/d1/d6/de/d57 to d0/d1/d6/de/d17/d64/d85/d9a/da4 0 2024-04-03T08:39:25.813 INFO:tasks.workunit.client.1.smithi181.stdout:8/462: dread d4/d45/db/d14/f50 [0,4194304] 0 2024-04-03T08:39:25.817 INFO:tasks.workunit.client.1.smithi181.stdout:8/463: write d4/d44/f77 [87313,90802] 0 2024-04-03T08:39:25.818 INFO:tasks.workunit.client.0.smithi157.stdout:6/708: sync 2024-04-03T08:39:25.823 INFO:tasks.workunit.client.1.smithi181.stdout:3/545: dwrite d0/d5/d6f/f75 [0,4194304] 0 2024-04-03T08:39:25.829 INFO:tasks.workunit.client.1.smithi181.stdout:5/515: rename d4/d22/d4a/f60 to d4/d18/d3e/fa6 0 2024-04-03T08:39:25.829 INFO:tasks.workunit.client.1.smithi181.stdout:1/529: rename d10/d15/d4a to d10/d15/d4a/da5 22 2024-04-03T08:39:25.832 INFO:tasks.workunit.client.1.smithi181.stdout:0/514: creat d5/fa0 x:0 0 0 2024-04-03T08:39:25.837 INFO:tasks.workunit.client.1.smithi181.stdout:7/467: creat d0/d1/d6/de/d17/d64/fa5 x:0 0 0 2024-04-03T08:39:25.839 INFO:tasks.workunit.client.1.smithi181.stdout:2/596: creat d13/d1c/d4a/fdb x:0 0 0 2024-04-03T08:39:25.841 INFO:tasks.workunit.client.1.smithi181.stdout:3/546: dwrite d0/d5/d6/d32/d43/f48 [0,4194304] 0 2024-04-03T08:39:25.844 INFO:tasks.workunit.client.1.smithi181.stdout:6/541: write d6/d3e/d5e/d7c/d9/d7f/da6/d4f/f66 [73466,35691] 0 2024-04-03T08:39:25.847 INFO:tasks.workunit.client.0.smithi157.stdout:3/651: truncate d8/d13/f1a 6380759 0 2024-04-03T08:39:25.851 INFO:tasks.workunit.client.1.smithi181.stdout:4/577: dwrite d1/d16/d24/d5e/f50 [0,4194304] 0 2024-04-03T08:39:25.853 INFO:tasks.workunit.client.1.smithi181.stdout:1/530: creat d10/d15/d4b/d6c/fa6 x:0 0 0 2024-04-03T08:39:25.856 INFO:tasks.workunit.client.1.smithi181.stdout:5/516: rename d4/d18/d25/f1c to d4/d44/d71/fa7 0 2024-04-03T08:39:25.857 INFO:tasks.workunit.client.0.smithi157.stdout:1/601: creat d2/d11/d23/fc1 x:0 0 0 2024-04-03T08:39:25.858 INFO:tasks.workunit.client.1.smithi181.stdout:3/547: dread d0/d17/d36/d1e/f28 [4194304,4194304] 0 2024-04-03T08:39:25.863 INFO:tasks.workunit.client.0.smithi157.stdout:6/709: mknod d1/d5/d17/d29/d80/cf1 0 2024-04-03T08:39:25.870 INFO:tasks.workunit.client.1.smithi181.stdout:0/515: dread d5/dc/d14/d29/d46/f63 [0,4194304] 0 2024-04-03T08:39:25.872 INFO:tasks.workunit.client.1.smithi181.stdout:2/597: mkdir d13/d7b/ddc 0 2024-04-03T08:39:25.872 INFO:tasks.workunit.client.1.smithi181.stdout:4/578: dread d1/fb [0,4194304] 0 2024-04-03T08:39:25.873 INFO:tasks.workunit.client.1.smithi181.stdout:2/598: readlink d13/d1c/d4a/ld9 0 2024-04-03T08:39:25.879 INFO:tasks.workunit.client.1.smithi181.stdout:9/578: rmdir d1/da/d28/d9e 0 2024-04-03T08:39:25.880 INFO:tasks.workunit.client.0.smithi157.stdout:7/732: dread d0/d11/d15/d17/d52/f54 [0,4194304] 0 2024-04-03T08:39:25.881 INFO:tasks.workunit.client.0.smithi157.stdout:4/638: creat da/df/d2f/dd8/fe1 x:0 0 0 2024-04-03T08:39:25.886 INFO:tasks.workunit.client.0.smithi157.stdout:6/710: dread d1/d5/d17/d2a/d37/dca/fe3 [0,4194304] 0 2024-04-03T08:39:25.886 INFO:tasks.workunit.client.0.smithi157.stdout:2/666: truncate d3/db/f31 1666811 0 2024-04-03T08:39:25.887 INFO:tasks.workunit.client.0.smithi157.stdout:3/652: creat d8/d13/d1b/d4e/da6/fe5 x:0 0 0 2024-04-03T08:39:25.889 INFO:tasks.workunit.client.0.smithi157.stdout:6/711: chown d1/d5/d17/d29/ca1 0 1 2024-04-03T08:39:25.889 INFO:tasks.workunit.client.0.smithi157.stdout:1/602: creat d2/d11/d23/d73/fc2 x:0 0 0 2024-04-03T08:39:25.891 INFO:tasks.workunit.client.0.smithi157.stdout:0/668: link d2/d9/dc/df/d1b/d4a/l3a d2/d9/d51/d63/d71/lf7 0 2024-04-03T08:39:25.895 INFO:tasks.workunit.client.0.smithi157.stdout:1/603: chown d2/d11/d24/d39/d3b/d2e/d48/d5d/db4 4 1 2024-04-03T08:39:25.896 INFO:tasks.workunit.client.0.smithi157.stdout:7/733: mknod d0/d11/d15/d1b/db8/cff 0 2024-04-03T08:39:25.899 INFO:tasks.workunit.client.1.smithi181.stdout:7/468: symlink d0/d1/d6/de/la6 0 2024-04-03T08:39:25.899 INFO:tasks.workunit.client.1.smithi181.stdout:6/542: write d6/d3e/d5e/d7c/f20 [1593600,37554] 0 2024-04-03T08:39:25.902 INFO:tasks.workunit.client.0.smithi157.stdout:3/653: dread d8/d1e/d2d/f34 [0,4194304] 0 2024-04-03T08:39:25.905 INFO:tasks.workunit.client.0.smithi157.stdout:8/694: link d2/cb4 d2/d6f/d70/d89/d59/d9e/ced 0 2024-04-03T08:39:25.907 INFO:tasks.workunit.client.1.smithi181.stdout:8/464: creat d4/d45/f9b x:0 0 0 2024-04-03T08:39:25.907 INFO:tasks.workunit.client.1.smithi181.stdout:5/517: write d4/d22/d4a/f5d [707161,27890] 0 2024-04-03T08:39:25.907 INFO:tasks.workunit.client.0.smithi157.stdout:8/695: stat d2/ddd 0 2024-04-03T08:39:25.908 INFO:tasks.workunit.client.1.smithi181.stdout:9/579: dread d1/da/d28/d80/f97 [4194304,4194304] 0 2024-04-03T08:39:25.909 INFO:tasks.workunit.client.0.smithi157.stdout:0/669: mknod d2/d9/dc/df/d1b/d4a/d31/cf8 0 2024-04-03T08:39:25.910 INFO:tasks.workunit.client.1.smithi181.stdout:8/465: read - d4/d45/d9/f89 zero size 2024-04-03T08:39:25.911 INFO:tasks.workunit.client.0.smithi157.stdout:4/639: mknod da/df/d2f/d64/ce2 0 2024-04-03T08:39:25.911 INFO:tasks.workunit.client.1.smithi181.stdout:9/580: stat d1/da/d13/d22/f3b 0 2024-04-03T08:39:25.911 INFO:tasks.workunit.client.1.smithi181.stdout:5/518: rename d4/d18 to d4/d18/d55/da8 22 2024-04-03T08:39:25.914 INFO:tasks.workunit.client.1.smithi181.stdout:9/581: write d1/da/d13/d22/f8d [3585266,106619] 0 2024-04-03T08:39:25.916 INFO:tasks.workunit.client.1.smithi181.stdout:3/548: mknod d0/d5/d6/cb6 0 2024-04-03T08:39:25.916 INFO:tasks.workunit.client.1.smithi181.stdout:8/466: write d4/d45/db/d14/f2d [4462751,28298] 0 2024-04-03T08:39:25.917 INFO:tasks.workunit.client.1.smithi181.stdout:1/531: dread d10/d15/d4b/d6c/f9f [0,4194304] 0 2024-04-03T08:39:25.918 INFO:tasks.workunit.client.0.smithi157.stdout:2/667: rename d3/d2e/d32/de3/le8 to d3/dab/lf3 0 2024-04-03T08:39:25.918 INFO:tasks.workunit.client.0.smithi157.stdout:8/696: rmdir d2/d6f 39 2024-04-03T08:39:25.922 INFO:tasks.workunit.client.1.smithi181.stdout:0/516: mkdir d5/d9/d2a/da1 0 2024-04-03T08:39:25.923 INFO:tasks.workunit.client.0.smithi157.stdout:0/670: rmdir d2/d9/dc/df/d1b/d35/dc0 39 2024-04-03T08:39:25.924 INFO:tasks.workunit.client.0.smithi157.stdout:9/646: sync 2024-04-03T08:39:25.925 INFO:tasks.workunit.client.0.smithi157.stdout:6/712: dwrite d1/d5/d17/d29/d62/f6b [0,4194304] 0 2024-04-03T08:39:25.926 INFO:tasks.workunit.client.0.smithi157.stdout:1/604: mknod d2/d11/d24/d39/d3b/cc3 0 2024-04-03T08:39:25.927 INFO:tasks.workunit.client.1.smithi181.stdout:9/582: readlink d1/da/d13/d22/l2b 0 2024-04-03T08:39:25.928 INFO:tasks.workunit.client.1.smithi181.stdout:3/549: mkdir d0/d17/d63/db7 0 2024-04-03T08:39:25.930 INFO:tasks.workunit.client.0.smithi157.stdout:3/654: dwrite d8/d1e/d2d/d39/d51/d48/fc1 [0,4194304] 0 2024-04-03T08:39:25.930 INFO:tasks.workunit.client.0.smithi157.stdout:7/734: getdents d0/d11/d15/d1b/df6 0 2024-04-03T08:39:25.935 INFO:tasks.workunit.client.1.smithi181.stdout:2/599: link d13/d1c/f9d d13/fdd 0 2024-04-03T08:39:25.936 INFO:tasks.workunit.client.1.smithi181.stdout:6/543: dwrite d6/d3e/d5e/d7c/d9/d7f/f8e [0,4194304] 0 2024-04-03T08:39:25.937 INFO:tasks.workunit.client.0.smithi157.stdout:2/668: symlink d3/d2e/d32/d9f/dbd/lf4 0 2024-04-03T08:39:25.939 INFO:tasks.workunit.client.0.smithi157.stdout:3/655: chown d8/d1e/d2d/d39/d51/d4c/dd6/de0 6561941 1 2024-04-03T08:39:25.941 INFO:tasks.workunit.client.0.smithi157.stdout:3/656: fsync d8/fc2 0 2024-04-03T08:39:25.943 INFO:tasks.workunit.client.0.smithi157.stdout:0/671: readlink d2/d9/dc/df/d1b/d4a/l3a 0 2024-04-03T08:39:25.944 INFO:tasks.workunit.client.1.smithi181.stdout:3/550: unlink d0/d5/d6/d32/c7f 0 2024-04-03T08:39:25.944 INFO:tasks.workunit.client.0.smithi157.stdout:1/605: dread - d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/f75 zero size 2024-04-03T08:39:25.944 INFO:tasks.workunit.client.0.smithi157.stdout:7/735: fsync d0/d11/d15/d1b/db8/f95 0 2024-04-03T08:39:25.946 INFO:tasks.workunit.client.0.smithi157.stdout:6/713: rename d1/d5/d17/d2a/d37/f51 to d1/d5/d17/d29/d62/d7f/d89/da4/ff2 0 2024-04-03T08:39:25.948 INFO:tasks.workunit.client.0.smithi157.stdout:9/647: dread d1/d15/d27/f32 [0,4194304] 0 2024-04-03T08:39:25.948 INFO:tasks.workunit.client.0.smithi157.stdout:1/606: chown d2/d11/d23/f8c 12142 1 2024-04-03T08:39:25.950 INFO:tasks.workunit.client.1.smithi181.stdout:4/579: dwrite d1/f32 [0,4194304] 0 2024-04-03T08:39:25.951 INFO:tasks.workunit.client.0.smithi157.stdout:9/648: write d1/d36/f81 [3377845,68521] 0 2024-04-03T08:39:25.953 INFO:tasks.workunit.client.1.smithi181.stdout:1/532: creat d10/da1/fa7 x:0 0 0 2024-04-03T08:39:25.954 INFO:tasks.workunit.client.1.smithi181.stdout:8/467: getdents d4/d2a/d37/d67/d91 0 2024-04-03T08:39:25.955 INFO:tasks.workunit.client.0.smithi157.stdout:8/697: mknod d2/d11/d10/d24/d5b/d2e/d94/ddb/cee 0 2024-04-03T08:39:25.956 INFO:tasks.workunit.client.1.smithi181.stdout:2/600: dread d13/fc1 [0,4194304] 0 2024-04-03T08:39:25.957 INFO:tasks.workunit.client.1.smithi181.stdout:9/583: symlink d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/lb4 0 2024-04-03T08:39:25.958 INFO:tasks.workunit.client.1.smithi181.stdout:7/469: dwrite d0/d1/d6/de/d6d/f7d [0,4194304] 0 2024-04-03T08:39:25.958 INFO:tasks.workunit.client.0.smithi157.stdout:2/669: creat d3/d2e/d32/d9f/da7/ff5 x:0 0 0 2024-04-03T08:39:25.959 INFO:tasks.workunit.client.0.smithi157.stdout:8/698: write d2/d11/d10/d24/d5b/d2e/f58 [1256352,59350] 0 2024-04-03T08:39:25.960 INFO:tasks.workunit.client.0.smithi157.stdout:3/657: unlink d8/d13/d1b/d4e/d50/d7c/ld7 0 2024-04-03T08:39:25.965 INFO:tasks.workunit.client.0.smithi157.stdout:0/672: symlink d2/d9/d5f/d8d/lf9 0 2024-04-03T08:39:25.965 INFO:tasks.workunit.client.1.smithi181.stdout:7/470: fdatasync d0/d1/d6/de/d17/d64/f7c 0 2024-04-03T08:39:25.967 INFO:tasks.workunit.client.1.smithi181.stdout:7/471: readlink d0/d1/d6/de/la6 0 2024-04-03T08:39:25.971 INFO:tasks.workunit.client.1.smithi181.stdout:7/472: truncate d0/d1/f74 5365960 0 2024-04-03T08:39:25.971 INFO:tasks.workunit.client.1.smithi181.stdout:0/517: dread d5/d9/f3e [0,4194304] 0 2024-04-03T08:39:25.976 INFO:tasks.workunit.client.0.smithi157.stdout:6/714: dread d1/d5/d17/d2a/f82 [0,4194304] 0 2024-04-03T08:39:25.976 INFO:tasks.workunit.client.0.smithi157.stdout:2/670: dread d3/db/d44/d4c/d5a/fd4 [0,4194304] 0 2024-04-03T08:39:25.978 INFO:tasks.workunit.client.0.smithi157.stdout:4/640: getdents da/df/d24/d35/d53/d69 0 2024-04-03T08:39:25.979 INFO:tasks.workunit.client.1.smithi181.stdout:4/580: symlink d1/d16/d37/d34/d86/d9e/lc2 0 2024-04-03T08:39:25.982 INFO:tasks.workunit.client.0.smithi157.stdout:7/736: rename d0/d11/d15/d17/d1c/da1/fd3 to d0/d4/d8e/d96/f100 0 2024-04-03T08:39:25.984 INFO:tasks.workunit.client.0.smithi157.stdout:1/607: fsync d2/d11/d24/d39/d3b/d2e/d48/d58/d94/da3/fa8 0 2024-04-03T08:39:25.985 INFO:tasks.workunit.client.1.smithi181.stdout:5/519: getdents d4/d80 0 2024-04-03T08:39:25.986 INFO:tasks.workunit.client.0.smithi157.stdout:9/649: creat d1/d15/d27/d34/dc7/fe1 x:0 0 0 2024-04-03T08:39:25.987 INFO:tasks.workunit.client.1.smithi181.stdout:1/533: creat d10/d15/d4a/d6f/fa8 x:0 0 0 2024-04-03T08:39:25.992 INFO:tasks.workunit.client.0.smithi157.stdout:0/673: rmdir d2/d9/dc/dbe 39 2024-04-03T08:39:25.996 INFO:tasks.workunit.client.0.smithi157.stdout:2/671: fsync d3/db/f7b 0 2024-04-03T08:39:25.999 INFO:tasks.workunit.client.0.smithi157.stdout:2/672: chown d3/d2e/d32/le0 0 1 2024-04-03T08:39:26.000 INFO:tasks.workunit.client.1.smithi181.stdout:0/518: fsync d5/dc/d14/d29/f47 0 2024-04-03T08:39:26.002 INFO:tasks.workunit.client.0.smithi157.stdout:1/608: dwrite d2/d11/d23/d73/fc2 [0,4194304] 0 2024-04-03T08:39:26.005 INFO:tasks.workunit.client.1.smithi181.stdout:0/519: chown d5/dc/d14/d29/d46/c51 181 1 2024-04-03T08:39:26.011 INFO:tasks.workunit.client.1.smithi181.stdout:8/468: mknod d4/d44/c9c 0 2024-04-03T08:39:26.012 INFO:tasks.workunit.client.1.smithi181.stdout:4/581: dread d1/d1e/d78/f97 [0,4194304] 0 2024-04-03T08:39:26.015 INFO:tasks.workunit.client.1.smithi181.stdout:6/544: write d6/d3e/d5e/d7c/d50/d5b/f9d [551061,71210] 0 2024-04-03T08:39:26.021 INFO:tasks.workunit.client.0.smithi157.stdout:7/737: write d0/d4/da5/fb2 [1266763,97093] 0 2024-04-03T08:39:26.022 INFO:tasks.workunit.client.1.smithi181.stdout:1/534: write d10/d15/d4a/d6f/f9c [8257,12906] 0 2024-04-03T08:39:26.024 INFO:tasks.workunit.client.0.smithi157.stdout:4/641: mkdir da/df/d24/d35/d53/de3 0 2024-04-03T08:39:26.030 INFO:tasks.workunit.client.1.smithi181.stdout:4/582: mknod d1/d1e/d2c/d67/d93/cc3 0 2024-04-03T08:39:26.033 INFO:tasks.workunit.client.1.smithi181.stdout:7/473: dwrite d0/d1/d6/de/d6d/f77 [0,4194304] 0 2024-04-03T08:39:26.035 INFO:tasks.workunit.client.0.smithi157.stdout:8/699: write d2/d20/db1/dbc/de2/fe7 [1963811,4237] 0 2024-04-03T08:39:26.035 INFO:tasks.workunit.client.1.smithi181.stdout:8/469: dread d4/d45/db/f94 [0,4194304] 0 2024-04-03T08:39:26.036 INFO:tasks.workunit.client.1.smithi181.stdout:6/545: creat d6/d3e/d5e/d7c/d9/d7f/da6/d4f/fa9 x:0 0 0 2024-04-03T08:39:26.037 INFO:tasks.workunit.client.1.smithi181.stdout:5/520: write d4/d18/f61 [633690,129983] 0 2024-04-03T08:39:26.038 INFO:tasks.workunit.client.0.smithi157.stdout:9/650: dwrite d1/d36/d46/f7a [0,4194304] 0 2024-04-03T08:39:26.041 INFO:tasks.workunit.client.0.smithi157.stdout:4/642: symlink da/df/d6b/db9/le4 0 2024-04-03T08:39:26.042 INFO:tasks.workunit.client.0.smithi157.stdout:1/609: truncate d2/d11/d24/f1f 7645216 0 2024-04-03T08:39:26.042 INFO:tasks.workunit.client.1.smithi181.stdout:2/601: link d13/d1c/c80 d13/da7/d27/d2f/d5d/cde 0 2024-04-03T08:39:26.043 INFO:tasks.workunit.client.1.smithi181.stdout:5/521: chown d4/d18/d55/f70 721 1 2024-04-03T08:39:26.044 INFO:tasks.workunit.client.0.smithi157.stdout:0/674: write d2/d9/dc/d54/ff3 [5003938,85453] 0 2024-04-03T08:39:26.045 INFO:tasks.workunit.client.1.smithi181.stdout:6/546: truncate d6/d31/d36/f5d 4210312 0 2024-04-03T08:39:26.047 INFO:tasks.workunit.client.1.smithi181.stdout:5/522: chown d4/d22/l3b 14098 1 2024-04-03T08:39:26.048 INFO:tasks.workunit.client.1.smithi181.stdout:3/551: getdents d0/d5/d6f 0 2024-04-03T08:39:26.048 INFO:tasks.workunit.client.0.smithi157.stdout:7/738: write d0/d11/d15/d17/d43/d8a/fc2 [1414779,101446] 0 2024-04-03T08:39:26.048 INFO:tasks.workunit.client.1.smithi181.stdout:5/523: dread - d4/d22/d78/f7f zero size 2024-04-03T08:39:26.049 INFO:tasks.workunit.client.0.smithi157.stdout:6/715: getdents d1/d5/d17/d29 0 2024-04-03T08:39:26.050 INFO:tasks.workunit.client.1.smithi181.stdout:1/535: creat d10/d15/d4a/fa9 x:0 0 0 2024-04-03T08:39:26.055 INFO:tasks.workunit.client.0.smithi157.stdout:8/700: mkdir d2/d11/d10/d24/d5b/d2e/d75/def 0 2024-04-03T08:39:26.057 INFO:tasks.workunit.client.0.smithi157.stdout:9/651: rmdir d1/d15/d27/daf/da7 39 2024-04-03T08:39:26.057 INFO:tasks.workunit.client.1.smithi181.stdout:7/474: chown d0/d1/c13 16227 1 2024-04-03T08:39:26.061 INFO:tasks.workunit.client.1.smithi181.stdout:9/584: getdents d1/da/d28/d80 0 2024-04-03T08:39:26.064 INFO:tasks.workunit.client.1.smithi181.stdout:6/547: dwrite d6/d3e/d5e/d7c/f85 [0,4194304] 0 2024-04-03T08:39:26.065 INFO:tasks.workunit.client.1.smithi181.stdout:9/585: chown d1/da/d13/d22/d23/d36/d91/d9d/d39/f59 178374 1 2024-04-03T08:39:26.069 INFO:tasks.workunit.client.0.smithi157.stdout:6/716: symlink d1/d5/d17/d2a/d73/lf3 0 2024-04-03T08:39:26.071 INFO:tasks.workunit.client.1.smithi181.stdout:0/520: rename d5/d9/l2b to d5/dc/d10/d58/d6c/la2 0 2024-04-03T08:39:26.072 INFO:tasks.workunit.client.0.smithi157.stdout:2/673: dwrite d3/d2e/d65/fac [0,4194304] 0 2024-04-03T08:39:26.076 INFO:tasks.workunit.client.1.smithi181.stdout:5/524: creat d4/d18/d25/d59/d81/d8a/fa9 x:0 0 0 2024-04-03T08:39:26.082 INFO:tasks.workunit.client.1.smithi181.stdout:7/475: fsync d0/f2f 0 2024-04-03T08:39:26.082 INFO:tasks.workunit.client.0.smithi157.stdout:9/652: mkdir d1/d4a/d4d/dd6/de2 0 2024-04-03T08:39:26.084 INFO:tasks.workunit.client.0.smithi157.stdout:7/739: dwrite d0/d11/d15/d17/d1c/f47 [0,4194304] 0 2024-04-03T08:39:26.084 INFO:tasks.workunit.client.1.smithi181.stdout:2/602: dread ff [0,4194304] 0 2024-04-03T08:39:26.087 INFO:tasks.workunit.client.1.smithi181.stdout:8/470: link d4/d45/db/d14/d31/f43 d4/d45/db/d5c/f9d 0 2024-04-03T08:39:26.090 INFO:tasks.workunit.client.1.smithi181.stdout:7/476: fsync d0/d1/d6/de/d17/d64/d85/d9a/da4/f7a 0 2024-04-03T08:39:26.091 INFO:tasks.workunit.client.0.smithi157.stdout:0/675: creat d2/d9/dc/df/d1b/d35/dc0/ffa x:0 0 0 2024-04-03T08:39:26.093 INFO:tasks.workunit.client.0.smithi157.stdout:6/717: dread - d1/d5/d17/d2a/d30/d77/fdb zero size 2024-04-03T08:39:26.102 INFO:tasks.workunit.client.1.smithi181.stdout:6/548: unlink d6/d3e/d5e/d7c/d9/d7f/d95/la4 0 2024-04-03T08:39:26.106 INFO:tasks.workunit.client.0.smithi157.stdout:2/674: mkdir d3/db/d44/d4c/d5a/d88/df6 0 2024-04-03T08:39:26.110 INFO:tasks.workunit.client.1.smithi181.stdout:6/549: dread d6/d31/f89 [0,4194304] 0 2024-04-03T08:39:26.111 INFO:tasks.workunit.client.0.smithi157.stdout:2/675: read d3/db/d44/d4c/d5a/fbb [234130,119455] 0 2024-04-03T08:39:26.112 INFO:tasks.workunit.client.1.smithi181.stdout:6/550: chown d6/d3e/d5e/d7c/f39 859379 1 2024-04-03T08:39:26.115 INFO:tasks.workunit.client.1.smithi181.stdout:0/521: fsync d5/dc/f1e 0 2024-04-03T08:39:26.116 INFO:tasks.workunit.client.0.smithi157.stdout:4/643: dread da/df/d24/d35/d6a/d78/f7a [0,4194304] 0 2024-04-03T08:39:26.119 INFO:tasks.workunit.client.0.smithi157.stdout:0/676: write d2/f5b [840716,86072] 0 2024-04-03T08:39:26.120 INFO:tasks.workunit.client.1.smithi181.stdout:1/536: mkdir d10/d15/d17/d23/daa 0 2024-04-03T08:39:26.120 INFO:tasks.workunit.client.0.smithi157.stdout:1/610: dread d2/d11/d24/d39/d3b/d2e/d48/d64/f85 [4194304,4194304] 0 2024-04-03T08:39:26.123 INFO:tasks.workunit.client.1.smithi181.stdout:1/537: read d10/d15/d41/f44 [1315993,42922] 0 2024-04-03T08:39:26.123 INFO:tasks.workunit.client.0.smithi157.stdout:6/718: rename d1/d5/d17/d2a/d30/d77/ccf to d1/d4b/da5/dc7/cf4 0 2024-04-03T08:39:26.124 INFO:tasks.workunit.client.1.smithi181.stdout:2/603: dread d13/da7/d27/f2c [0,4194304] 0 2024-04-03T08:39:26.125 INFO:tasks.workunit.client.1.smithi181.stdout:5/525: creat d4/d22/d78/faa x:0 0 0 2024-04-03T08:39:26.127 INFO:tasks.workunit.client.0.smithi157.stdout:6/719: write d1/d5/d17/d2a/fd4 [1304396,58587] 0 2024-04-03T08:39:26.132 INFO:tasks.workunit.client.0.smithi157.stdout:5/720: sync 2024-04-03T08:39:26.135 INFO:tasks.workunit.client.1.smithi181.stdout:9/586: dwrite d1/f20 [0,4194304] 0 2024-04-03T08:39:26.135 INFO:tasks.workunit.client.0.smithi157.stdout:4/644: chown da/df/d2f/d64/d8f/fd1 0 1 2024-04-03T08:39:26.139 INFO:tasks.workunit.client.0.smithi157.stdout:7/740: rename d0/d4/d8e/d96/cd9 to d0/d11/d6f/d89/d8c/c101 0 2024-04-03T08:39:26.141 INFO:tasks.workunit.client.1.smithi181.stdout:8/471: fsync d4/d45/db/d14/f62 0 2024-04-03T08:39:26.145 INFO:tasks.workunit.client.1.smithi181.stdout:1/538: dwrite d10/d15/d17/d30/f7e [0,4194304] 0 2024-04-03T08:39:26.146 INFO:tasks.workunit.client.0.smithi157.stdout:1/611: dwrite d2/d11/d24/d39/d3b/d1b/d7f/fb1 [0,4194304] 0 2024-04-03T08:39:26.148 INFO:tasks.workunit.client.1.smithi181.stdout:7/477: mknod d0/d1/d6/de/d17/d64/d85/ca7 0 2024-04-03T08:39:26.149 INFO:tasks.workunit.client.1.smithi181.stdout:8/472: read d4/d44/d59/d5f/d6c/f81 [4126098,97375] 0 2024-04-03T08:39:26.152 INFO:tasks.workunit.client.1.smithi181.stdout:7/478: stat d0/d1/d6/de/d17/d27/c43 0 2024-04-03T08:39:26.154 INFO:tasks.workunit.client.1.smithi181.stdout:6/551: symlink d6/d3e/d5e/d7c/d9/d7f/laa 0 2024-04-03T08:39:26.159 INFO:tasks.workunit.client.0.smithi157.stdout:4/645: creat da/df/d2f/dbc/dbe/fe5 x:0 0 0 2024-04-03T08:39:26.160 INFO:tasks.workunit.client.0.smithi157.stdout:6/720: chown d1/d5/d17/d2a/d37/f25 40859 1 2024-04-03T08:39:26.162 INFO:tasks.workunit.client.0.smithi157.stdout:2/676: rename d3/db/fd9 to d3/d2e/d32/d9f/ff7 0 2024-04-03T08:39:26.164 INFO:tasks.workunit.client.1.smithi181.stdout:2/604: unlink fa 0 2024-04-03T08:39:26.166 INFO:tasks.workunit.client.0.smithi157.stdout:7/741: symlink d0/d11/d6f/d89/d8c/dc6/l102 0 2024-04-03T08:39:26.166 INFO:tasks.workunit.client.0.smithi157.stdout:6/721: dread - d1/d5/d17/d2a/d37/f7b zero size 2024-04-03T08:39:26.168 INFO:tasks.workunit.client.0.smithi157.stdout:9/653: dwrite d1/d15/f31 [0,4194304] 0 2024-04-03T08:39:26.171 INFO:tasks.workunit.client.0.smithi157.stdout:6/722: stat d1/d5/d17/d29/f5a 0 2024-04-03T08:39:26.173 INFO:tasks.workunit.client.0.smithi157.stdout:6/723: stat d1/d5/d17/d2a/d40/f7e 0 2024-04-03T08:39:26.176 INFO:tasks.workunit.client.0.smithi157.stdout:5/721: dread - dc/d29/d56/d49/d7f/faf zero size 2024-04-03T08:39:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:9/654: fdatasync d1/d15/d27/d5c/d79/f9d 0 2024-04-03T08:39:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:9/655: chown d1/d15/d16/fc6 2 1 2024-04-03T08:39:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:7/742: rename d0/d4 to d0/d11/d6f/d89/d8c/d103 0 2024-04-03T08:39:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:9/656: stat d1/c89 0 2024-04-03T08:39:26.186 INFO:tasks.workunit.client.0.smithi157.stdout:1/612: dread d2/d11/d24/f2f [0,4194304] 0 2024-04-03T08:39:26.188 INFO:tasks.workunit.client.1.smithi181.stdout:9/587: dread d1/da/d13/d22/d23/d54/f98 [0,4194304] 0 2024-04-03T08:39:26.191 INFO:tasks.workunit.client.0.smithi157.stdout:4/646: rmdir da/df/d2f/dbc/dbe 39 2024-04-03T08:39:26.192 INFO:tasks.workunit.client.0.smithi157.stdout:2/677: fsync d3/d12/f7c 0 2024-04-03T08:39:26.198 INFO:tasks.workunit.client.0.smithi157.stdout:6/724: mknod d1/d5/d17/d29/cf5 0 2024-04-03T08:39:26.199 INFO:tasks.workunit.client.0.smithi157.stdout:6/725: dread - d1/fcb zero size 2024-04-03T08:39:26.200 INFO:tasks.workunit.client.1.smithi181.stdout:3/552: rename d0/d5/d6/dd/d5f/f98 to d0/d17/d36/fb8 0 2024-04-03T08:39:26.201 INFO:tasks.workunit.client.0.smithi157.stdout:0/677: write d2/d9/dc/df/d6f/dad/dbb/fb8 [534878,54081] 0 2024-04-03T08:39:26.203 INFO:tasks.workunit.client.0.smithi157.stdout:1/613: creat d2/d11/d23/fc4 x:0 0 0 2024-04-03T08:39:26.203 INFO:tasks.workunit.client.0.smithi157.stdout:4/647: fdatasync da/df/d24/d35/d3c/fa7 0 2024-04-03T08:39:26.205 INFO:tasks.workunit.client.0.smithi157.stdout:1/614: chown d2/d11/c78 1 1 2024-04-03T08:39:26.207 INFO:tasks.workunit.client.0.smithi157.stdout:5/722: write dc/d29/d56/fb4 [2257246,21635] 0 2024-04-03T08:39:26.211 INFO:tasks.workunit.client.1.smithi181.stdout:9/588: dread d1/da/d13/d22/f8d [0,4194304] 0 2024-04-03T08:39:26.212 INFO:tasks.workunit.client.0.smithi157.stdout:9/657: symlink d1/d15/d27/le3 0 2024-04-03T08:39:26.212 INFO:tasks.workunit.client.0.smithi157.stdout:5/723: write dc/f12 [4926076,105881] 0 2024-04-03T08:39:26.213 INFO:tasks.workunit.client.1.smithi181.stdout:5/526: mkdir d4/d18/d25/d68/d77/dab 0 2024-04-03T08:39:26.220 INFO:tasks.workunit.client.1.smithi181.stdout:1/539: mknod d10/d15/cab 0 2024-04-03T08:39:26.222 INFO:tasks.workunit.client.1.smithi181.stdout:1/540: read d10/d15/d17/d23/d27/f92 [1273988,4967] 0 2024-04-03T08:39:26.224 INFO:tasks.workunit.client.1.smithi181.stdout:8/473: mknod d4/d45/db/d14/d31/d1c/d51/c9e 0 2024-04-03T08:39:26.227 INFO:tasks.workunit.client.1.smithi181.stdout:8/474: truncate d4/d45/d9/f86 729407 0 2024-04-03T08:39:26.227 INFO:tasks.workunit.client.1.smithi181.stdout:1/541: truncate d10/d15/d17/d30/f65 27958 0 2024-04-03T08:39:26.229 INFO:tasks.workunit.client.0.smithi157.stdout:2/678: dwrite d3/d12/d43/d4b/f73 [0,4194304] 0 2024-04-03T08:39:26.229 INFO:tasks.workunit.client.0.smithi157.stdout:5/724: creat dc/d29/d56/d9e/dc3/ff2 x:0 0 0 2024-04-03T08:39:26.230 INFO:tasks.workunit.client.1.smithi181.stdout:1/542: chown d10/d15/d17/d19/d33/d70/l88 2837 1 2024-04-03T08:39:26.230 INFO:tasks.workunit.client.0.smithi157.stdout:1/615: dwrite d2/d11/f98 [0,4194304] 0 2024-04-03T08:39:26.231 INFO:tasks.workunit.client.0.smithi157.stdout:0/678: fdatasync d2/d9/d51/fdb 0 2024-04-03T08:39:26.232 INFO:tasks.workunit.client.1.smithi181.stdout:4/583: sync 2024-04-03T08:39:26.234 INFO:tasks.workunit.client.1.smithi181.stdout:4/584: chown d1/d16/d55/c8c 502 1 2024-04-03T08:39:26.235 INFO:tasks.workunit.client.0.smithi157.stdout:1/616: read - d2/d11/d24/fb8 zero size 2024-04-03T08:39:26.238 INFO:tasks.workunit.client.1.smithi181.stdout:0/522: creat d5/fa3 x:0 0 0 2024-04-03T08:39:26.238 INFO:tasks.workunit.client.0.smithi157.stdout:9/658: write d1/d4a/d4d/f80 [1132367,58509] 0 2024-04-03T08:39:26.240 INFO:tasks.workunit.client.0.smithi157.stdout:6/726: truncate d1/d5/d17/d29/f5a 4672315 0 2024-04-03T08:39:26.306 INFO:tasks.workunit.client.0.smithi157.stdout:4/648: dread da/df/f14 [0,4194304] 0 2024-04-03T08:39:26.306 INFO:tasks.workunit.client.0.smithi157.stdout:2/679: write d3/d12/d43/f86 [8250969,58415] 0 2024-04-03T08:39:26.306 INFO:tasks.workunit.client.0.smithi157.stdout:9/659: creat d1/d15/dca/fe4 x:0 0 0 2024-04-03T08:39:26.306 INFO:tasks.workunit.client.0.smithi157.stdout:5/725: creat dc/d29/d56/d9e/dc3/dde/def/ff3 x:0 0 0 2024-04-03T08:39:26.306 INFO:tasks.workunit.client.0.smithi157.stdout:9/660: rmdir d1/d15/d27/d5c/d79 39 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:0/679: dwrite d2/d9/d51/fca [0,4194304] 0 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:9/661: chown d1/d4a/f52 36199 1 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:9/662: truncate d1/d15/d27/d5c/faa 488100 0 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:5/726: unlink dc/d29/d56/d9e/dc3/cec 0 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:2/680: dread d3/d12/f7c [0,4194304] 0 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:2/681: write d3/d2e/f90 [545179,84211] 0 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:4/649: rename da/d7e/cbb to da/df/d24/d35/d53/ce6 0 2024-04-03T08:39:26.307 INFO:tasks.workunit.client.0.smithi157.stdout:1/617: link d2/d11/d24/d39/f61 d2/d11/d24/d39/d3b/fc5 0 2024-04-03T08:39:26.308 INFO:tasks.workunit.client.1.smithi181.stdout:0/523: stat d5/d9/d2a/f64 0 2024-04-03T08:39:26.308 INFO:tasks.workunit.client.1.smithi181.stdout:9/589: symlink d1/da/d13/d22/d23/d36/d91/d9d/lb5 0 2024-04-03T08:39:26.308 INFO:tasks.workunit.client.1.smithi181.stdout:9/590: chown d1/da/d13/l1d 54239 1 2024-04-03T08:39:26.308 INFO:tasks.workunit.client.1.smithi181.stdout:8/475: rename d4/d45/db/d14/l84 to d4/d45/db/d14/d31/d1c/d51/d87/l9f 0 2024-04-03T08:39:26.308 INFO:tasks.workunit.client.1.smithi181.stdout:6/552: link d6/d3e/d5e/d7c/d50/d5b/l71 d6/d31/lab 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:4/585: symlink d1/d16/d37/lc4 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:2/605: creat d13/d1c/fdf x:0 0 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:5/527: fsync d4/d18/f28 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:9/591: creat d1/da/d13/d41/d32/fb6 x:0 0 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:7/479: link d0/d1/l1d d0/d1/d6/de/d17/d64/la8 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:3/553: creat d0/d17/d36/fb9 x:0 0 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:6/553: unlink d6/d3e/d5e/d7c/d9/d7f/da6/f3c 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:4/586: rmdir d1/d16/d24/d5e/d3f/d81 39 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:1/543: dread d10/d15/d17/d19/f45 [0,4194304] 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:5/528: mkdir d4/d18/d25/dac 0 2024-04-03T08:39:26.309 INFO:tasks.workunit.client.1.smithi181.stdout:1/544: chown d10/d15/d17/d23/f90 1756 1 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:5/529: truncate d4/d22/d78/faa 457351 0 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:8/476: mknod d4/d2a/d37/ca0 0 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:7/480: rename d0/d1/d6/de/d17/d27/c43 to d0/d1/d6/de/d17/d64/ca9 0 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:2/606: unlink d13/d1c/d4a/f57 0 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:6/554: dread d6/f60 [4194304,4194304] 0 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:6/555: read - d6/d3e/d5e/d7c/f3f zero size 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:4/587: symlink d1/d16/d24/d5e/d2b/d56/lc5 0 2024-04-03T08:39:26.310 INFO:tasks.workunit.client.1.smithi181.stdout:6/556: chown d6/d3e/d5e/d7c/d9/d7f/da6/l62 29918021 1 2024-04-03T08:39:26.311 INFO:tasks.workunit.client.0.smithi157.stdout:6/727: getdents d1/d5/d17/d2a/d37 0 2024-04-03T08:39:26.313 INFO:tasks.workunit.client.1.smithi181.stdout:1/545: dread f2 [0,4194304] 0 2024-04-03T08:39:26.314 INFO:tasks.workunit.client.1.smithi181.stdout:8/477: dwrite d4/d45/db/d14/d31/d1c/f85 [0,4194304] 0 2024-04-03T08:39:26.315 INFO:tasks.workunit.client.0.smithi157.stdout:2/682: creat d3/db/d44/d4c/ff8 x:0 0 0 2024-04-03T08:39:26.317 INFO:tasks.workunit.client.1.smithi181.stdout:3/554: symlink d0/d17/lba 0 2024-04-03T08:39:26.322 INFO:tasks.workunit.client.0.smithi157.stdout:2/683: write d3/d12/d43/d4b/f73 [4161331,21498] 0 2024-04-03T08:39:26.322 INFO:tasks.workunit.client.0.smithi157.stdout:0/680: dwrite d2/d9/d51/f52 [0,4194304] 0 2024-04-03T08:39:26.323 INFO:tasks.workunit.client.0.smithi157.stdout:2/684: chown d3/d12/d43/d4b/lca 828031 1 2024-04-03T08:39:26.325 INFO:tasks.workunit.client.0.smithi157.stdout:2/685: write d3/d12/ff0 [525891,100880] 0 2024-04-03T08:39:26.326 INFO:tasks.workunit.client.1.smithi181.stdout:7/481: symlink d0/d1/d6/de/d17/d64/d85/laa 0 2024-04-03T08:39:26.330 INFO:tasks.workunit.client.0.smithi157.stdout:2/686: fdatasync d3/d12/d43/f86 0 2024-04-03T08:39:26.334 INFO:tasks.workunit.client.0.smithi157.stdout:9/663: rename d1/d15/d27/daf/cbc to d1/d15/d27/d5c/dbd/ce5 0 2024-04-03T08:39:26.339 INFO:tasks.workunit.client.0.smithi157.stdout:9/664: chown d1/d4a/d4d/da4/db8/lda 2077284 1 2024-04-03T08:39:26.341 INFO:tasks.workunit.client.0.smithi157.stdout:6/728: fsync d1/d5/d17/d29/d62/d7f/d89/da4/fe1 0 2024-04-03T08:39:26.342 INFO:tasks.workunit.client.0.smithi157.stdout:5/727: dwrite dc/d29/d43/f69 [0,4194304] 0 2024-04-03T08:39:26.346 INFO:tasks.workunit.client.1.smithi181.stdout:6/557: dread - d6/d3e/d5e/d7c/f39 zero size 2024-04-03T08:39:26.347 INFO:tasks.workunit.client.1.smithi181.stdout:1/546: creat d10/d15/d41/d8c/fac x:0 0 0 2024-04-03T08:39:26.349 INFO:tasks.workunit.client.1.smithi181.stdout:8/478: creat d4/d45/db/d5c/fa1 x:0 0 0 2024-04-03T08:39:26.356 INFO:tasks.workunit.client.1.smithi181.stdout:2/607: write d13/d1c/da5/fcf [971086,32041] 0 2024-04-03T08:39:26.356 INFO:tasks.workunit.client.0.smithi157.stdout:4/650: dwrite da/d26/fd2 [0,4194304] 0 2024-04-03T08:39:26.360 INFO:tasks.workunit.client.1.smithi181.stdout:9/592: creat d1/da/d13/d73/fb7 x:0 0 0 2024-04-03T08:39:26.364 INFO:tasks.workunit.client.0.smithi157.stdout:6/729: read d1/d5/d17/fba [525010,73689] 0 2024-04-03T08:39:26.368 INFO:tasks.workunit.client.1.smithi181.stdout:3/555: symlink d0/d17/d36/d3b/d5a/d93/d9c/lbb 0 2024-04-03T08:39:26.370 INFO:tasks.workunit.client.0.smithi157.stdout:0/681: rename d2/d9/dc/df/d6f/dad to d2/d9/dc/dbe/dfb 0 2024-04-03T08:39:26.372 INFO:tasks.workunit.client.0.smithi157.stdout:1/618: dwrite d2/d11/d23/f57 [0,4194304] 0 2024-04-03T08:39:26.372 INFO:tasks.workunit.client.1.smithi181.stdout:5/530: dwrite d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:26.373 INFO:tasks.workunit.client.1.smithi181.stdout:3/556: chown d0/d5/d6/d3f/la5 189023 1 2024-04-03T08:39:26.374 INFO:tasks.workunit.client.0.smithi157.stdout:2/687: link d3/f4e d3/db/d44/d4c/df1/ff9 0 2024-04-03T08:39:26.377 INFO:tasks.workunit.client.0.smithi157.stdout:2/688: fdatasync d3/db/d44/d4c/d5a/d88/f8c 0 2024-04-03T08:39:26.378 INFO:tasks.workunit.client.0.smithi157.stdout:4/651: unlink da/df/d2f/lb6 0 2024-04-03T08:39:26.379 INFO:tasks.workunit.client.1.smithi181.stdout:7/482: link d0/f50 d0/d1/d6/de/d17/d64/d85/d9a/da4/fab 0 2024-04-03T08:39:26.380 INFO:tasks.workunit.client.1.smithi181.stdout:9/593: dwrite d1/da/d28/d30/f6a [0,4194304] 0 2024-04-03T08:39:26.380 INFO:tasks.workunit.client.1.smithi181.stdout:2/608: truncate d13/d1c/d4a/d68/f86 790653 0 2024-04-03T08:39:26.384 INFO:tasks.workunit.client.1.smithi181.stdout:1/547: write d10/d15/d17/d23/f90 [4954528,31763] 0 2024-04-03T08:39:26.387 INFO:tasks.workunit.client.1.smithi181.stdout:6/558: mknod d6/d3e/d5e/cac 0 2024-04-03T08:39:26.387 INFO:tasks.workunit.client.1.smithi181.stdout:1/548: chown d10/d15/d17/d30/l8f 13449328 1 2024-04-03T08:39:26.388 INFO:tasks.workunit.client.1.smithi181.stdout:3/557: unlink d0/cac 0 2024-04-03T08:39:26.391 INFO:tasks.workunit.client.1.smithi181.stdout:8/479: symlink d4/d45/d9/la2 0 2024-04-03T08:39:26.392 INFO:tasks.workunit.client.0.smithi157.stdout:0/682: rmdir d2/d9/dc/df/d1b/d4a/de4/df1 39 2024-04-03T08:39:26.395 INFO:tasks.workunit.client.0.smithi157.stdout:9/665: dwrite d1/d15/f43 [0,4194304] 0 2024-04-03T08:39:26.396 INFO:tasks.workunit.client.1.smithi181.stdout:2/609: mknod d13/d1c/d6c/ce0 0 2024-04-03T08:39:26.401 INFO:tasks.workunit.client.0.smithi157.stdout:4/652: creat da/df/d2f/d54/fe7 x:0 0 0 2024-04-03T08:39:26.404 INFO:tasks.workunit.client.0.smithi157.stdout:6/730: unlink d1/d5/d17/d2a/d30/cae 0 2024-04-03T08:39:26.405 INFO:tasks.workunit.client.0.smithi157.stdout:5/728: dread dc/d29/fa7 [0,4194304] 0 2024-04-03T08:39:26.411 INFO:tasks.workunit.client.1.smithi181.stdout:8/480: dread d4/d45/d9/f25 [0,4194304] 0 2024-04-03T08:39:26.411 INFO:tasks.workunit.client.0.smithi157.stdout:1/619: mkdir d2/d11/d24/d39/dc6 0 2024-04-03T08:39:26.412 INFO:tasks.workunit.client.1.smithi181.stdout:1/549: fsync d10/d15/d17/d23/f90 0 2024-04-03T08:39:26.418 INFO:tasks.workunit.client.0.smithi157.stdout:1/620: readlink d2/d11/d24/d39/d3b/d2e/l5e 0 2024-04-03T08:39:26.422 INFO:tasks.workunit.client.0.smithi157.stdout:1/621: stat d2/d11/d24/d39/d3b/d2e/c36 0 2024-04-03T08:39:26.424 INFO:tasks.workunit.client.1.smithi181.stdout:7/483: symlink d0/d1/d6/de/da3/lac 0 2024-04-03T08:39:26.425 INFO:tasks.workunit.client.1.smithi181.stdout:6/559: dread d6/d31/d36/f5d [0,4194304] 0 2024-04-03T08:39:26.426 INFO:tasks.workunit.client.1.smithi181.stdout:7/484: chown d0/d1/d6/de/l16 21542905 1 2024-04-03T08:39:26.428 INFO:tasks.workunit.client.0.smithi157.stdout:4/653: dwrite da/fad [0,4194304] 0 2024-04-03T08:39:26.432 INFO:tasks.workunit.client.1.smithi181.stdout:5/531: write d4/d18/d3e/f6f [76396,88727] 0 2024-04-03T08:39:26.434 INFO:tasks.workunit.client.0.smithi157.stdout:2/689: write d3/db/fa1 [464186,75066] 0 2024-04-03T08:39:26.434 INFO:tasks.workunit.client.1.smithi181.stdout:5/532: stat d4/d18/d25/d59/d81/d96/ca2 0 2024-04-03T08:39:26.435 INFO:tasks.workunit.client.0.smithi157.stdout:6/731: fsync d1/d4b/da5/fab 0 2024-04-03T08:39:26.437 INFO:tasks.workunit.client.1.smithi181.stdout:3/558: mkdir d0/dbc 0 2024-04-03T08:39:26.439 INFO:tasks.workunit.client.0.smithi157.stdout:2/690: write d3/d2e/d65/fac [3992763,43120] 0 2024-04-03T08:39:26.439 INFO:tasks.workunit.client.0.smithi157.stdout:5/729: fsync dc/d29/f91 0 2024-04-03T08:39:26.440 INFO:tasks.workunit.client.1.smithi181.stdout:3/559: write d0/d17/f54 [1701981,49345] 0 2024-04-03T08:39:26.443 INFO:tasks.workunit.client.0.smithi157.stdout:5/730: dread - dc/d29/d43/f66 zero size 2024-04-03T08:39:26.443 INFO:tasks.workunit.client.1.smithi181.stdout:8/481: creat d4/d44/d59/d5f/d6c/fa3 x:0 0 0 2024-04-03T08:39:26.451 INFO:tasks.workunit.client.1.smithi181.stdout:9/594: link d1/da/d13/d22/d23/d36/d91/d9d/d39/f59 d1/da/d13/d22/d23/d36/d91/fb8 0 2024-04-03T08:39:26.454 INFO:tasks.workunit.client.0.smithi157.stdout:4/654: dwrite da/fdd [0,4194304] 0 2024-04-03T08:39:26.459 INFO:tasks.workunit.client.1.smithi181.stdout:1/550: rename f4 to d10/d15/d41/fad 0 2024-04-03T08:39:26.460 INFO:tasks.workunit.client.1.smithi181.stdout:2/610: write d13/da7/d40/f48 [1095313,50802] 0 2024-04-03T08:39:26.461 INFO:tasks.workunit.client.0.smithi157.stdout:4/655: fsync da/df/d2f/d64/d8f/dbd/d68/fc7 0 2024-04-03T08:39:26.461 INFO:tasks.workunit.client.1.smithi181.stdout:1/551: read d10/d15/d17/f21 [2437166,90209] 0 2024-04-03T08:39:26.462 INFO:tasks.workunit.client.1.smithi181.stdout:6/560: unlink d6/d53/d80/f68 0 2024-04-03T08:39:26.462 INFO:tasks.workunit.client.1.smithi181.stdout:2/611: write d13/da7/d85/dbd/fce [1751684,65977] 0 2024-04-03T08:39:26.463 INFO:tasks.workunit.client.0.smithi157.stdout:6/732: dwrite d1/d5/d17/d29/d62/d7f/d89/da4/fee [0,4194304] 0 2024-04-03T08:39:26.465 INFO:tasks.workunit.client.1.smithi181.stdout:7/485: read d0/d1/d6/de/f42 [255259,24416] 0 2024-04-03T08:39:26.469 INFO:tasks.workunit.client.0.smithi157.stdout:0/683: dwrite d2/f21 [0,4194304] 0 2024-04-03T08:39:26.473 INFO:tasks.workunit.client.1.smithi181.stdout:5/533: write d4/d18/f73 [2503301,47209] 0 2024-04-03T08:39:26.480 INFO:tasks.workunit.client.0.smithi157.stdout:1/622: dwrite d2/d11/d24/d39/d3b/d1b/f4e [0,4194304] 0 2024-04-03T08:39:26.483 INFO:tasks.workunit.client.1.smithi181.stdout:4/588: sync 2024-04-03T08:39:26.484 INFO:tasks.workunit.client.1.smithi181.stdout:0/524: sync 2024-04-03T08:39:26.490 INFO:tasks.workunit.client.1.smithi181.stdout:9/595: unlink d1/da/d28/d30/d3e/c5f 0 2024-04-03T08:39:26.492 INFO:tasks.workunit.client.1.smithi181.stdout:4/589: chown d1/d16/d24/c26 34 1 2024-04-03T08:39:26.495 INFO:tasks.workunit.client.1.smithi181.stdout:6/561: unlink d6/d53/f79 0 2024-04-03T08:39:26.496 INFO:tasks.workunit.client.0.smithi157.stdout:0/684: unlink d2/d9/d5f/d85/f86 0 2024-04-03T08:39:26.499 INFO:tasks.workunit.client.1.smithi181.stdout:1/552: mkdir d10/d15/d17/d19/d4c/dae 0 2024-04-03T08:39:26.500 INFO:tasks.workunit.client.0.smithi157.stdout:0/685: chown d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/de1/le8 0 1 2024-04-03T08:39:26.501 INFO:tasks.workunit.client.0.smithi157.stdout:2/691: dwrite d3/db/f1f [0,4194304] 0 2024-04-03T08:39:26.501 INFO:tasks.workunit.client.1.smithi181.stdout:1/553: chown d10/c84 5367504 1 2024-04-03T08:39:26.503 INFO:tasks.workunit.client.0.smithi157.stdout:4/656: unlink da/df/d2f/d64/d8f/dbd/d68/f8c 0 2024-04-03T08:39:26.504 INFO:tasks.workunit.client.1.smithi181.stdout:2/612: symlink d13/da7/d27/d2f/dae/le1 0 2024-04-03T08:39:26.504 INFO:tasks.workunit.client.1.smithi181.stdout:1/554: dread - d10/d15/d4a/f9d zero size 2024-04-03T08:39:26.504 INFO:tasks.workunit.client.1.smithi181.stdout:3/560: dwrite d0/d17/d63/d81/f88 [0,4194304] 0 2024-04-03T08:39:26.504 INFO:tasks.workunit.client.0.smithi157.stdout:5/731: getdents dc/dbb 0 2024-04-03T08:39:26.506 INFO:tasks.workunit.client.1.smithi181.stdout:2/613: dread - d13/d1c/d73/fc5 zero size 2024-04-03T08:39:26.506 INFO:tasks.workunit.client.1.smithi181.stdout:7/486: unlink d0/l71 0 2024-04-03T08:39:26.512 INFO:tasks.workunit.client.0.smithi157.stdout:0/686: mknod d2/d9/d51/d63/d71/cfc 0 2024-04-03T08:39:26.517 INFO:tasks.workunit.client.0.smithi157.stdout:1/623: symlink d2/d11/d24/d39/d3b/d2e/d48/d58/lc7 0 2024-04-03T08:39:26.522 INFO:tasks.workunit.client.1.smithi181.stdout:3/561: dread d0/d5/d6/d32/d43/f48 [0,4194304] 0 2024-04-03T08:39:26.522 INFO:tasks.workunit.client.0.smithi157.stdout:9/666: link d1/d15/c5a d1/d15/d27/daf/ce6 0 2024-04-03T08:39:26.537 INFO:tasks.workunit.client.0.smithi157.stdout:9/667: truncate d1/fe 817710 0 2024-04-03T08:39:26.538 INFO:tasks.workunit.client.1.smithi181.stdout:9/596: dread d1/da/d28/d30/d3e/d4e/f68 [0,4194304] 0 2024-04-03T08:39:26.545 INFO:tasks.workunit.client.1.smithi181.stdout:3/562: dread d0/d5/d6/f5e [0,4194304] 0 2024-04-03T08:39:26.546 INFO:tasks.workunit.client.0.smithi157.stdout:1/624: write d2/f88 [4965064,13544] 0 2024-04-03T08:39:26.549 INFO:tasks.workunit.client.0.smithi157.stdout:9/668: creat d1/d15/d27/d34/dc7/fe7 x:0 0 0 2024-04-03T08:39:26.550 INFO:tasks.workunit.client.0.smithi157.stdout:4/657: link da/df/c6c da/df/d6b/db9/ce8 0 2024-04-03T08:39:26.553 INFO:tasks.workunit.client.0.smithi157.stdout:2/692: dwrite d3/db/d44/d4c/d5a/d88/fb0 [0,4194304] 0 2024-04-03T08:39:26.555 INFO:tasks.workunit.client.0.smithi157.stdout:5/732: dread fa [0,4194304] 0 2024-04-03T08:39:26.555 INFO:tasks.workunit.client.0.smithi157.stdout:1/625: write d2/d11/d24/d39/d3b/d1b/d7f/faa [2588406,82543] 0 2024-04-03T08:39:26.557 INFO:tasks.workunit.client.0.smithi157.stdout:0/687: truncate d2/d9/dc/df/d6f/d9d/d6a/f96 691318 0 2024-04-03T08:39:26.560 INFO:tasks.workunit.client.0.smithi157.stdout:4/658: creat da/df/d99/da8/fe9 x:0 0 0 2024-04-03T08:39:26.562 INFO:tasks.workunit.client.0.smithi157.stdout:3/658: sync 2024-04-03T08:39:26.562 INFO:tasks.workunit.client.0.smithi157.stdout:8/701: sync 2024-04-03T08:39:26.570 INFO:tasks.workunit.client.0.smithi157.stdout:9/669: symlink d1/d15/d27/le8 0 2024-04-03T08:39:26.574 INFO:tasks.workunit.client.0.smithi157.stdout:0/688: dwrite d2/d9/dc/f3c [0,4194304] 0 2024-04-03T08:39:26.575 INFO:tasks.workunit.client.1.smithi181.stdout:0/525: rename d5/dc/d14/d29/f7e to d5/dc/d14/d8d/fa4 0 2024-04-03T08:39:26.579 INFO:tasks.workunit.client.1.smithi181.stdout:4/590: creat d1/d16/d37/d34/d86/fc6 x:0 0 0 2024-04-03T08:39:26.582 INFO:tasks.workunit.client.0.smithi157.stdout:1/626: write d2/d11/d23/f4f [5110170,110998] 0 2024-04-03T08:39:26.583 INFO:tasks.workunit.client.1.smithi181.stdout:6/562: symlink d6/d3e/d5e/d7c/d9/d7f/da6/d4f/lad 0 2024-04-03T08:39:26.585 INFO:tasks.workunit.client.1.smithi181.stdout:1/555: creat d10/d15/d4a/d6f/faf x:0 0 0 2024-04-03T08:39:26.588 INFO:tasks.workunit.client.0.smithi157.stdout:9/670: creat d1/d94/dbe/fe9 x:0 0 0 2024-04-03T08:39:26.589 INFO:tasks.workunit.client.0.smithi157.stdout:9/671: readlink d1/l6a 0 2024-04-03T08:39:26.590 INFO:tasks.workunit.client.0.smithi157.stdout:9/672: chown d1/d15/d16/l1c 130 1 2024-04-03T08:39:26.593 INFO:tasks.workunit.client.0.smithi157.stdout:3/659: symlink d8/le6 0 2024-04-03T08:39:26.593 INFO:tasks.workunit.client.1.smithi181.stdout:2/614: symlink d13/d1c/d73/d8b/le2 0 2024-04-03T08:39:26.597 INFO:tasks.workunit.client.0.smithi157.stdout:8/702: write d2/d20/d23/f41 [1492427,47464] 0 2024-04-03T08:39:26.601 INFO:tasks.workunit.client.0.smithi157.stdout:5/733: rmdir dc/d29/d43/d9f 0 2024-04-03T08:39:26.603 INFO:tasks.workunit.client.1.smithi181.stdout:8/482: creat d4/d45/d9/fa4 x:0 0 0 2024-04-03T08:39:26.604 INFO:tasks.workunit.client.0.smithi157.stdout:2/693: dread d3/d12/f23 [0,4194304] 0 2024-04-03T08:39:26.604 INFO:tasks.workunit.client.1.smithi181.stdout:8/483: stat d4/d2a/d37/ca0 0 2024-04-03T08:39:26.605 INFO:tasks.workunit.client.1.smithi181.stdout:8/484: fdatasync d4/d45/db/f8c 0 2024-04-03T08:39:26.607 INFO:tasks.workunit.client.1.smithi181.stdout:8/485: chown d4/d44/d59/d5f/f9a 119782 1 2024-04-03T08:39:26.608 INFO:tasks.workunit.client.0.smithi157.stdout:4/659: dwrite da/d7e/fb7 [0,4194304] 0 2024-04-03T08:39:26.608 INFO:tasks.workunit.client.1.smithi181.stdout:7/487: rename d0/d1/d6/de/d17/d27/f49 to d0/d1/d6/de/d6d/fad 0 2024-04-03T08:39:26.611 INFO:tasks.workunit.client.1.smithi181.stdout:0/526: dread - d5/d9/f7f zero size 2024-04-03T08:39:26.612 INFO:tasks.workunit.client.1.smithi181.stdout:5/534: truncate d4/d18/f23 3121839 0 2024-04-03T08:39:26.613 INFO:tasks.workunit.client.0.smithi157.stdout:9/673: rmdir d1/d4a 39 2024-04-03T08:39:26.615 INFO:tasks.workunit.client.1.smithi181.stdout:4/591: rmdir d1/d16/d24/d5e/d31/d39/db1 39 2024-04-03T08:39:26.619 INFO:tasks.workunit.client.1.smithi181.stdout:6/563: creat d6/d3e/d5e/d7c/d9/d7f/fae x:0 0 0 2024-04-03T08:39:26.620 INFO:tasks.workunit.client.0.smithi157.stdout:0/689: dread d2/d9/dc/df/d6f/d9d/d6a/d91/dae/fb6 [0,4194304] 0 2024-04-03T08:39:26.622 INFO:tasks.workunit.client.1.smithi181.stdout:1/556: truncate d10/d15/d17/d23/d27/f43 125817 0 2024-04-03T08:39:26.624 INFO:tasks.workunit.client.0.smithi157.stdout:0/690: chown d2/d9/dc/df/d6f/d9d 1 1 2024-04-03T08:39:26.625 INFO:tasks.workunit.client.1.smithi181.stdout:0/527: dread d5/dc/d14/f22 [0,4194304] 0 2024-04-03T08:39:26.626 INFO:tasks.workunit.client.1.smithi181.stdout:7/488: dwrite d0/d1/d6/de/d17/d27/f28 [0,4194304] 0 2024-04-03T08:39:26.630 INFO:tasks.workunit.client.0.smithi157.stdout:1/627: dwrite d2/d11/f92 [0,4194304] 0 2024-04-03T08:39:26.632 INFO:tasks.workunit.client.0.smithi157.stdout:2/694: rename d3/db/d44/d4c/d5a/d88/dc6/lcd to d3/db/d44/d4c/d5a/d88/d97/lfa 0 2024-04-03T08:39:26.637 INFO:tasks.workunit.client.1.smithi181.stdout:5/535: truncate d4/ff 150457 0 2024-04-03T08:39:26.642 INFO:tasks.workunit.client.1.smithi181.stdout:4/592: creat d1/d16/d37/d34/d69/fc7 x:0 0 0 2024-04-03T08:39:26.645 INFO:tasks.workunit.client.1.smithi181.stdout:4/593: fsync d1/d16/d37/d34/f35 0 2024-04-03T08:39:26.647 INFO:tasks.workunit.client.1.smithi181.stdout:6/564: rmdir d6/d3e/d5e/d7c/d9/d7f/da6 39 2024-04-03T08:39:26.650 INFO:tasks.workunit.client.0.smithi157.stdout:2/695: rmdir d3/d2e/d32/d9f/da7 39 2024-04-03T08:39:26.653 INFO:tasks.workunit.client.0.smithi157.stdout:4/660: link da/df/d24/d35/d6a/f77 da/df/d2f/d64/d8f/dbd/d68/dce/fea 0 2024-04-03T08:39:26.653 INFO:tasks.workunit.client.0.smithi157.stdout:8/703: dread d2/d6f/d70/d89/f5e [0,4194304] 0 2024-04-03T08:39:26.657 INFO:tasks.workunit.client.0.smithi157.stdout:9/674: link d1/f3f d1/d15/d27/d5c/d79/fea 0 2024-04-03T08:39:26.657 INFO:tasks.workunit.client.0.smithi157.stdout:1/628: fsync d2/d11/f92 0 2024-04-03T08:39:26.657 INFO:tasks.workunit.client.1.smithi181.stdout:9/597: sync 2024-04-03T08:39:26.658 INFO:tasks.workunit.client.0.smithi157.stdout:1/629: chown d2/c2b 347 1 2024-04-03T08:39:26.659 INFO:tasks.workunit.client.1.smithi181.stdout:2/615: dwrite ff [0,4194304] 0 2024-04-03T08:39:26.659 INFO:tasks.workunit.client.0.smithi157.stdout:0/691: mkdir d2/dd8/dfd 0 2024-04-03T08:39:26.660 INFO:tasks.workunit.client.0.smithi157.stdout:5/734: getdents dc/d29/d56/d9e/dc3/dde/def 0 2024-04-03T08:39:26.662 INFO:tasks.workunit.client.0.smithi157.stdout:0/692: chown d2/d9/dc/df/d1b/c1c 11721 1 2024-04-03T08:39:26.664 INFO:tasks.workunit.client.0.smithi157.stdout:0/693: dread - d2/d9/dc/d54/fac zero size 2024-04-03T08:39:26.666 INFO:tasks.workunit.client.0.smithi157.stdout:2/696: unlink d3/db/l8f 0 2024-04-03T08:39:26.668 INFO:tasks.workunit.client.1.smithi181.stdout:5/536: mkdir d4/d22/d4a/dad 0 2024-04-03T08:39:26.669 INFO:tasks.workunit.client.1.smithi181.stdout:7/489: write d0/d1/d6/de/f2a [267566,82344] 0 2024-04-03T08:39:26.671 INFO:tasks.workunit.client.1.smithi181.stdout:8/486: write d4/d45/db/d14/f49 [4442893,127916] 0 2024-04-03T08:39:26.673 INFO:tasks.workunit.client.0.smithi157.stdout:8/704: unlink d2/d6f/fb6 0 2024-04-03T08:39:26.673 INFO:tasks.workunit.client.0.smithi157.stdout:5/735: dread dc/fd [0,4194304] 0 2024-04-03T08:39:26.674 INFO:tasks.workunit.client.1.smithi181.stdout:8/487: write d4/d45/db/f8c [3357466,119238] 0 2024-04-03T08:39:26.675 INFO:tasks.workunit.client.1.smithi181.stdout:9/598: dwrite d1/f35 [0,4194304] 0 2024-04-03T08:39:26.679 INFO:tasks.workunit.client.1.smithi181.stdout:4/594: write d1/d16/d24/d5e/d3f/d6c/fb4 [240529,113382] 0 2024-04-03T08:39:26.683 INFO:tasks.workunit.client.0.smithi157.stdout:0/694: mknod d2/d9/d36/d38/cfe 0 2024-04-03T08:39:26.685 INFO:tasks.workunit.client.0.smithi157.stdout:4/661: creat da/df/d2f/d97/dd6/feb x:0 0 0 2024-04-03T08:39:26.686 INFO:tasks.workunit.client.0.smithi157.stdout:5/736: mknod dc/d29/d56/d87/cf4 0 2024-04-03T08:39:26.686 INFO:tasks.workunit.client.1.smithi181.stdout:5/537: dwrite d4/f32 [0,4194304] 0 2024-04-03T08:39:26.688 INFO:tasks.workunit.client.1.smithi181.stdout:5/538: chown d4/d22/d4a/f5b 2544648 1 2024-04-03T08:39:26.689 INFO:tasks.workunit.client.0.smithi157.stdout:8/705: mkdir d2/d11/d10/d24/d5b/d2e/d75/d81/df0 0 2024-04-03T08:39:26.690 INFO:tasks.workunit.client.1.smithi181.stdout:3/563: sync 2024-04-03T08:39:26.691 INFO:tasks.workunit.client.0.smithi157.stdout:8/706: dread - d2/d20/d23/fec zero size 2024-04-03T08:39:26.694 INFO:tasks.workunit.client.1.smithi181.stdout:3/564: readlink d0/d5/d6/dd/d5f/l84 0 2024-04-03T08:39:26.695 INFO:tasks.workunit.client.1.smithi181.stdout:2/616: mkdir d13/d1c/d4a/d7f/db3/de3 0 2024-04-03T08:39:26.702 INFO:tasks.workunit.client.1.smithi181.stdout:9/599: mknod d1/da/d13/d22/d23/d36/d91/d9d/d39/cb9 0 2024-04-03T08:39:26.708 INFO:tasks.workunit.client.1.smithi181.stdout:6/565: symlink d6/d3e/d5e/d7c/d9/d7f/da6/d4f/d77/laf 0 2024-04-03T08:39:26.711 INFO:tasks.workunit.client.0.smithi157.stdout:0/695: creat d2/d9/dc/df/d6f/de3/fff x:0 0 0 2024-04-03T08:39:26.716 INFO:tasks.workunit.client.0.smithi157.stdout:1/630: dread d2/d11/d24/d39/d3b/d2e/d48/d86/fa0 [0,4194304] 0 2024-04-03T08:39:26.716 INFO:tasks.workunit.client.0.smithi157.stdout:8/707: mknod d2/d6f/d70/d89/d59/d9e/cf1 0 2024-04-03T08:39:26.717 INFO:tasks.workunit.client.1.smithi181.stdout:5/539: dread d4/d22/d78/f85 [0,4194304] 0 2024-04-03T08:39:26.720 INFO:tasks.workunit.client.1.smithi181.stdout:1/557: rename d10/d15/d41/d8c to d10/d15/d17/d23/db0 0 2024-04-03T08:39:26.720 INFO:tasks.workunit.client.1.smithi181.stdout:5/540: read d4/d18/d25/f3c [3632386,33550] 0 2024-04-03T08:39:26.721 INFO:tasks.workunit.client.0.smithi157.stdout:7/743: sync 2024-04-03T08:39:26.721 INFO:tasks.workunit.client.0.smithi157.stdout:9/675: rmdir d1/d4a/d4d/dd6/de2 0 2024-04-03T08:39:26.722 INFO:tasks.workunit.client.1.smithi181.stdout:1/558: fdatasync d10/d15/d17/d19/f40 0 2024-04-03T08:39:26.722 INFO:tasks.workunit.client.1.smithi181.stdout:0/528: link d5/dc/d10/d30/l33 d5/dc/d10/d58/la5 0 2024-04-03T08:39:26.723 INFO:tasks.workunit.client.1.smithi181.stdout:1/559: chown d10/d15/d4a/d6f/l9a 4 1 2024-04-03T08:39:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:2/697: getdents d3/db/d44/d4c/d5a/d88 0 2024-04-03T08:39:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:9/676: read d1/d15/d27/f45 [4394091,120920] 0 2024-04-03T08:39:26.725 INFO:tasks.workunit.client.1.smithi181.stdout:3/565: symlink d0/d5/d6/dd/d25/d50/lbd 0 2024-04-03T08:39:26.725 INFO:tasks.workunit.client.0.smithi157.stdout:9/677: chown d1/d36/d46 289027601 1 2024-04-03T08:39:26.730 INFO:tasks.workunit.client.0.smithi157.stdout:1/631: symlink d2/d11/d24/d39/d3b/d1b/lc8 0 2024-04-03T08:39:26.734 INFO:tasks.workunit.client.1.smithi181.stdout:9/600: fsync d1/da/d28/d30/d3e/d4e/f68 0 2024-04-03T08:39:26.734 INFO:tasks.workunit.client.0.smithi157.stdout:8/708: mknod d2/d11/d10/d24/d5b/d53/cf2 0 2024-04-03T08:39:26.735 INFO:tasks.workunit.client.1.smithi181.stdout:6/566: mkdir d6/d53/d8d/d97/db0 0 2024-04-03T08:39:26.746 INFO:tasks.workunit.client.1.smithi181.stdout:5/541: dwrite d4/d18/f83 [0,4194304] 0 2024-04-03T08:39:26.749 INFO:tasks.workunit.client.1.smithi181.stdout:1/560: dwrite d10/d15/d17/f7f [0,4194304] 0 2024-04-03T08:39:26.750 INFO:tasks.workunit.client.0.smithi157.stdout:0/696: write d2/d9/dc/df/d1b/d35/d3d/f58 [216030,84740] 0 2024-04-03T08:39:26.750 INFO:tasks.workunit.client.0.smithi157.stdout:5/737: dwrite dc/d29/d56/d49/d7f/f82 [0,4194304] 0 2024-04-03T08:39:26.752 INFO:tasks.workunit.client.1.smithi181.stdout:3/566: dwrite d0/d5/fa2 [0,4194304] 0 2024-04-03T08:39:26.754 INFO:tasks.workunit.client.1.smithi181.stdout:5/542: stat d4/d18/d2c/c66 0 2024-04-03T08:39:26.756 INFO:tasks.workunit.client.0.smithi157.stdout:9/678: dwrite d1/d15/d16/f98 [0,4194304] 0 2024-04-03T08:39:26.757 INFO:tasks.workunit.client.0.smithi157.stdout:2/698: dread d3/d12/f68 [0,4194304] 0 2024-04-03T08:39:26.760 INFO:tasks.workunit.client.1.smithi181.stdout:6/567: mkdir d6/d3e/db1 0 2024-04-03T08:39:26.760 INFO:tasks.workunit.client.0.smithi157.stdout:5/738: fdatasync dc/d29/d56/d9e/db5/fe6 0 2024-04-03T08:39:26.761 INFO:tasks.workunit.client.0.smithi157.stdout:7/744: write d0/d11/d6f/d89/d8c/d103/daf/fbe [351586,110384] 0 2024-04-03T08:39:26.765 INFO:tasks.workunit.client.0.smithi157.stdout:5/739: stat dc/d29/d56/d9e 0 2024-04-03T08:39:26.766 INFO:tasks.workunit.client.1.smithi181.stdout:9/601: dwrite d1/da/d13/d41/d32/fb6 [0,4194304] 0 2024-04-03T08:39:26.767 INFO:tasks.workunit.client.1.smithi181.stdout:8/488: dwrite d4/d44/f97 [0,4194304] 0 2024-04-03T08:39:26.768 INFO:tasks.workunit.client.1.smithi181.stdout:7/490: rename d0/d1/d6/de/d17/d64/ca9 to d0/d1/d6/de/d17/d64/d85/d87/cae 0 2024-04-03T08:39:26.769 INFO:tasks.workunit.client.0.smithi157.stdout:9/679: write d1/d15/d27/f39 [2180566,19118] 0 2024-04-03T08:39:26.771 INFO:tasks.workunit.client.1.smithi181.stdout:3/567: creat d0/d17/d56/fbe x:0 0 0 2024-04-03T08:39:26.779 INFO:tasks.workunit.client.1.smithi181.stdout:0/529: write d5/dc/d14/d29/f45 [318758,4393] 0 2024-04-03T08:39:26.786 INFO:tasks.workunit.client.1.smithi181.stdout:4/595: rename d1/d16/d24/d5e to d1/d16/d24/d5e/d3f/dc8 22 2024-04-03T08:39:26.789 INFO:tasks.workunit.client.1.smithi181.stdout:8/489: creat d4/d44/d59/d5f/fa5 x:0 0 0 2024-04-03T08:39:26.790 INFO:tasks.workunit.client.1.smithi181.stdout:1/561: dwrite d10/d15/d17/d23/db0/d8d/f9b [0,4194304] 0 2024-04-03T08:39:26.797 INFO:tasks.workunit.client.1.smithi181.stdout:1/562: dread - d10/d15/d4b/f98 zero size 2024-04-03T08:39:26.799 INFO:tasks.workunit.client.1.smithi181.stdout:7/491: mknod d0/d1/d6/de/d17/d64/d85/caf 0 2024-04-03T08:39:26.808 INFO:tasks.workunit.client.1.smithi181.stdout:4/596: read d1/d16/f5a [1689740,90797] 0 2024-04-03T08:39:26.809 INFO:tasks.workunit.client.1.smithi181.stdout:5/543: write d4/d56/f75 [383342,12639] 0 2024-04-03T08:39:26.810 INFO:tasks.workunit.client.1.smithi181.stdout:3/568: creat d0/dbc/fbf x:0 0 0 2024-04-03T08:39:26.811 INFO:tasks.workunit.client.1.smithi181.stdout:6/568: creat d6/fb2 x:0 0 0 2024-04-03T08:39:26.811 INFO:tasks.workunit.client.1.smithi181.stdout:5/544: chown d4/f3d 51 1 2024-04-03T08:39:26.812 INFO:tasks.workunit.client.1.smithi181.stdout:1/563: creat d10/da1/fb1 x:0 0 0 2024-04-03T08:39:26.813 INFO:tasks.workunit.client.1.smithi181.stdout:8/490: truncate d4/d45/f8 1340427 0 2024-04-03T08:39:26.814 INFO:tasks.workunit.client.1.smithi181.stdout:1/564: fdatasync d10/d15/d17/d23/f90 0 2024-04-03T08:39:26.815 INFO:tasks.workunit.client.1.smithi181.stdout:5/545: truncate d4/d18/d55/f70 694924 0 2024-04-03T08:39:26.817 INFO:tasks.workunit.client.1.smithi181.stdout:3/569: creat d0/d5/d77/fc0 x:0 0 0 2024-04-03T08:39:26.818 INFO:tasks.workunit.client.1.smithi181.stdout:7/492: mkdir d0/d1/d6/db0 0 2024-04-03T08:39:26.818 INFO:tasks.workunit.client.0.smithi157.stdout:0/697: symlink d2/d9/d36/d82/l100 0 2024-04-03T08:39:26.818 INFO:tasks.workunit.client.1.smithi181.stdout:6/569: creat d6/d3e/d40/fb3 x:0 0 0 2024-04-03T08:39:26.820 INFO:tasks.workunit.client.1.smithi181.stdout:8/491: creat d4/d45/db/d14/fa6 x:0 0 0 2024-04-03T08:39:26.822 INFO:tasks.workunit.client.1.smithi181.stdout:5/546: unlink d4/d22/d78/c99 0 2024-04-03T08:39:26.823 INFO:tasks.workunit.client.0.smithi157.stdout:5/740: creat dc/d29/d43/ff5 x:0 0 0 2024-04-03T08:39:26.825 INFO:tasks.workunit.client.0.smithi157.stdout:2/699: fdatasync d3/d12/d43/d4b/f98 0 2024-04-03T08:39:26.826 INFO:tasks.workunit.client.1.smithi181.stdout:1/565: creat d10/d15/d17/d19/d33/fb2 x:0 0 0 2024-04-03T08:39:26.828 INFO:tasks.workunit.client.0.smithi157.stdout:9/680: symlink d1/d4a/d4d/leb 0 2024-04-03T08:39:26.829 INFO:tasks.workunit.client.0.smithi157.stdout:2/700: read - d3/d2e/d32/d9f/fea zero size 2024-04-03T08:39:26.831 INFO:tasks.workunit.client.1.smithi181.stdout:7/493: symlink d0/d1/d6/de/d17/d64/d85/d9a/lb1 0 2024-04-03T08:39:26.834 INFO:tasks.workunit.client.1.smithi181.stdout:8/492: rename d4/d44/f64 to d4/d44/d59/d5f/d6c/fa7 0 2024-04-03T08:39:26.834 INFO:tasks.workunit.client.1.smithi181.stdout:9/602: dwrite d1/da/f5a [0,4194304] 0 2024-04-03T08:39:26.836 INFO:tasks.workunit.client.1.smithi181.stdout:8/493: write d4/d45/db/f58 [758299,60265] 0 2024-04-03T08:39:26.838 INFO:tasks.workunit.client.1.smithi181.stdout:1/566: fsync d10/d15/f34 0 2024-04-03T08:39:26.842 INFO:tasks.workunit.client.1.smithi181.stdout:2/617: sync 2024-04-03T08:39:26.842 INFO:tasks.workunit.client.0.smithi157.stdout:0/698: dread d2/d9/d36/d38/f83 [4194304,4194304] 0 2024-04-03T08:39:26.844 INFO:tasks.workunit.client.1.smithi181.stdout:3/570: unlink d0/d5/d6/d32/d43/c5d 0 2024-04-03T08:39:26.845 INFO:tasks.workunit.client.0.smithi157.stdout:9/681: rmdir d1/d4a/dc4 39 2024-04-03T08:39:26.847 INFO:tasks.workunit.client.1.smithi181.stdout:6/570: mknod d6/d3e/db1/cb4 0 2024-04-03T08:39:26.851 INFO:tasks.workunit.client.0.smithi157.stdout:9/682: dread d1/d15/d16/f67 [0,4194304] 0 2024-04-03T08:39:26.852 INFO:tasks.workunit.client.0.smithi157.stdout:9/683: readlink d1/d15/d27/le8 0 2024-04-03T08:39:26.853 INFO:tasks.workunit.client.0.smithi157.stdout:7/745: creat d0/d11/d15/d17/d1c/d4f/f104 x:0 0 0 2024-04-03T08:39:26.854 INFO:tasks.workunit.client.1.smithi181.stdout:0/530: dwrite d5/d9/d2c/f7a [0,4194304] 0 2024-04-03T08:39:26.855 INFO:tasks.workunit.client.0.smithi157.stdout:7/746: stat d0/d11/d6f/d89 0 2024-04-03T08:39:26.855 INFO:tasks.workunit.client.1.smithi181.stdout:7/494: rename d0/d1/d6/c4f to d0/d1/d6/de/d17/d27/cb2 0 2024-04-03T08:39:26.856 INFO:tasks.workunit.client.1.smithi181.stdout:1/567: dwrite d10/d15/d17/d19/d33/fa0 [0,4194304] 0 2024-04-03T08:39:26.860 INFO:tasks.workunit.client.0.smithi157.stdout:8/709: getdents d2/d6f/d70/d89/d59/d9e 0 2024-04-03T08:39:26.862 INFO:tasks.workunit.client.1.smithi181.stdout:1/568: write d10/d15/d17/d19/d33/fb2 [189489,26774] 0 2024-04-03T08:39:26.863 INFO:tasks.workunit.client.1.smithi181.stdout:9/603: write d1/da/d13/d22/f42 [179513,121553] 0 2024-04-03T08:39:26.866 INFO:tasks.workunit.client.1.smithi181.stdout:4/597: write d1/d1e/d2c/f59 [255535,94646] 0 2024-04-03T08:39:26.868 INFO:tasks.workunit.client.0.smithi157.stdout:9/684: write d1/d15/d27/f32 [2038125,5377] 0 2024-04-03T08:39:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:1/632: write d2/d11/d24/d39/d3b/d2e/d48/d58/d62/d74/fb7 [774269,105721] 0 2024-04-03T08:39:26.872 INFO:tasks.workunit.client.0.smithi157.stdout:7/747: unlink d0/d11/d6f/d89/d8c/ldd 0 2024-04-03T08:39:26.874 INFO:tasks.workunit.client.1.smithi181.stdout:2/618: mkdir d13/da7/d85/de4 0 2024-04-03T08:39:26.875 INFO:tasks.workunit.client.1.smithi181.stdout:3/571: mkdir d0/d5/d6/d32/dc1 0 2024-04-03T08:39:26.878 INFO:tasks.workunit.client.1.smithi181.stdout:3/572: dread - d0/d5/d6/d3f/fb3 zero size 2024-04-03T08:39:26.880 INFO:tasks.workunit.client.0.smithi157.stdout:8/710: unlink d2/d11/d10/d24/d5b/d53/l9f 0 2024-04-03T08:39:26.886 INFO:tasks.workunit.client.0.smithi157.stdout:6/733: sync 2024-04-03T08:39:26.886 INFO:tasks.workunit.client.0.smithi157.stdout:7/748: creat d0/d11/d15/d17/d1c/da1/f105 x:0 0 0 2024-04-03T08:39:26.886 INFO:tasks.workunit.client.0.smithi157.stdout:3/660: sync 2024-04-03T08:39:26.887 INFO:tasks.workunit.client.1.smithi181.stdout:1/569: fsync d10/d15/d17/d19/d33/fb2 0 2024-04-03T08:39:26.889 INFO:tasks.workunit.client.0.smithi157.stdout:1/633: fsync d2/d11/d24/f2f 0 2024-04-03T08:39:26.891 INFO:tasks.workunit.client.1.smithi181.stdout:7/495: dwrite d0/d1/d6/de/d17/d64/d85/d9a/da4/f79 [0,4194304] 0 2024-04-03T08:39:26.894 INFO:tasks.workunit.client.0.smithi157.stdout:6/734: unlink d1/fc 0 2024-04-03T08:39:26.895 INFO:tasks.workunit.client.1.smithi181.stdout:8/494: mknod d4/d44/ca8 0 2024-04-03T08:39:26.900 INFO:tasks.workunit.client.1.smithi181.stdout:9/604: dwrite d1/da/d13/d22/d23/d54/f71 [0,4194304] 0 2024-04-03T08:39:26.901 INFO:tasks.workunit.client.1.smithi181.stdout:4/598: dwrite d1/d16/d24/d5e/d31/fa5 [4194304,4194304] 0 2024-04-03T08:39:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:2/701: write d3/db/d44/f92 [4299566,103425] 0 2024-04-03T08:39:26.906 INFO:tasks.workunit.client.0.smithi157.stdout:7/749: mknod d0/d11/d6f/d89/d8c/dc6/c106 0 2024-04-03T08:39:26.908 INFO:tasks.workunit.client.0.smithi157.stdout:0/699: write d2/d9/dc/d54/fac [958569,101940] 0 2024-04-03T08:39:26.909 INFO:tasks.workunit.client.1.smithi181.stdout:2/619: creat d13/da7/d85/fe5 x:0 0 0 2024-04-03T08:39:26.912 INFO:tasks.workunit.client.1.smithi181.stdout:5/547: write d4/ff [226661,126816] 0 2024-04-03T08:39:26.913 INFO:tasks.workunit.client.0.smithi157.stdout:5/741: dwrite dc/d29/d56/d18/f99 [0,4194304] 0 2024-04-03T08:39:26.916 INFO:tasks.workunit.client.0.smithi157.stdout:8/711: truncate d2/d6f/fd1 2434106 0 2024-04-03T08:39:26.921 INFO:tasks.workunit.client.1.smithi181.stdout:3/573: creat d0/d17/d36/d3b/d5a/d93/d9c/fc2 x:0 0 0 2024-04-03T08:39:26.923 INFO:tasks.workunit.client.1.smithi181.stdout:7/496: dwrite d0/d1/d6/de/d17/d64/d85/d9a/da4/f6f [0,4194304] 0 2024-04-03T08:39:26.929 INFO:tasks.workunit.client.1.smithi181.stdout:7/497: chown d0/d1/d6/de/c8d 234385716 1 2024-04-03T08:39:26.929 INFO:tasks.workunit.client.1.smithi181.stdout:3/574: truncate d0/d17/d36/d3b/d5a/f97 48496 0 2024-04-03T08:39:26.937 INFO:tasks.workunit.client.0.smithi157.stdout:2/702: dwrite d3/d12/f7c [0,4194304] 0 2024-04-03T08:39:26.938 INFO:tasks.workunit.client.1.smithi181.stdout:3/575: truncate d0/d5/d6/d32/f7b 948191 0 2024-04-03T08:39:26.938 INFO:tasks.workunit.client.1.smithi181.stdout:8/495: chown d4/d45/db/d14/d31/c3e 78411 1 2024-04-03T08:39:26.939 INFO:tasks.workunit.client.0.smithi157.stdout:4/662: sync 2024-04-03T08:39:26.939 INFO:tasks.workunit.client.0.smithi157.stdout:7/750: fsync d0/d11/d15/d17/d1c/d4f/d5f/fc3 0 2024-04-03T08:39:26.942 INFO:tasks.workunit.client.1.smithi181.stdout:3/576: dread - d0/d17/f26 zero size 2024-04-03T08:39:26.945 INFO:tasks.workunit.client.0.smithi157.stdout:9/685: dwrite d1/d15/d27/d34/f6d [0,4194304] 0 2024-04-03T08:39:26.946 INFO:tasks.workunit.client.1.smithi181.stdout:8/496: write d4/fc [4061887,8243] 0 2024-04-03T08:39:26.948 INFO:tasks.workunit.client.1.smithi181.stdout:6/571: dwrite d6/d31/d36/f9c [0,4194304] 0 2024-04-03T08:39:26.948 INFO:tasks.workunit.client.0.smithi157.stdout:5/742: unlink dc/d29/d56/d49/f5e 0 2024-04-03T08:39:26.949 INFO:tasks.workunit.client.0.smithi157.stdout:0/700: mknod d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/de1/c101 0 2024-04-03T08:39:26.951 INFO:tasks.workunit.client.1.smithi181.stdout:2/620: creat d13/d1c/d4a/d68/fe6 x:0 0 0 2024-04-03T08:39:26.953 INFO:tasks.workunit.client.1.smithi181.stdout:7/498: mkdir d0/d1/d6/de/d17/d64/d85/d9a/da4/db3 0 2024-04-03T08:39:26.954 INFO:tasks.workunit.client.0.smithi157.stdout:5/743: chown dc/d29/d56/d52/d9d/da5/daa/fcf 9 1 2024-04-03T08:39:26.955 INFO:tasks.workunit.client.1.smithi181.stdout:2/621: fdatasync d13/d1c/f99 0 2024-04-03T08:39:26.955 INFO:tasks.workunit.client.0.smithi157.stdout:4/663: unlink da/df/d2f/d64/ce2 0 2024-04-03T08:39:26.959 INFO:tasks.workunit.client.1.smithi181.stdout:4/599: link d1/d16/d24/d5e/d31/d39/f80 d1/d16/d37/d34/d85/fc9 0 2024-04-03T08:39:26.962 INFO:tasks.workunit.client.1.smithi181.stdout:3/577: mknod d0/dbc/cc3 0 2024-04-03T08:39:26.963 INFO:tasks.workunit.client.1.smithi181.stdout:4/600: dread - d1/d16/d37/d34/d69/fc7 zero size 2024-04-03T08:39:26.970 INFO:tasks.workunit.client.1.smithi181.stdout:6/572: unlink d6/d3e/d5e/cac 0 2024-04-03T08:39:26.972 INFO:tasks.workunit.client.0.smithi157.stdout:6/735: creat d1/d5/d17/d29/d62/ff6 x:0 0 0 2024-04-03T08:39:26.974 INFO:tasks.workunit.client.1.smithi181.stdout:1/570: rename d10/l46 to d10/d15/d17/lb3 0 2024-04-03T08:39:26.976 INFO:tasks.workunit.client.0.smithi157.stdout:3/661: getdents d8/d1e/d2d/d3b/d8c/db4 0 2024-04-03T08:39:26.978 INFO:tasks.workunit.client.0.smithi157.stdout:1/634: write d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fac [349834,89169] 0 2024-04-03T08:39:26.984 INFO:tasks.workunit.client.0.smithi157.stdout:3/662: dread - d8/d1e/d2d/d39/d51/d48/dce/fcf zero size 2024-04-03T08:39:26.986 INFO:tasks.workunit.client.0.smithi157.stdout:4/664: fsync da/df/d24/d35/d3c/f4d 0 2024-04-03T08:39:26.987 INFO:tasks.workunit.client.1.smithi181.stdout:6/573: dwrite d6/d7b/f98 [0,4194304] 0 2024-04-03T08:39:26.990 INFO:tasks.workunit.client.0.smithi157.stdout:8/712: dread d2/d11/d10/d24/d5b/d2e/d75/f85 [0,4194304] 0 2024-04-03T08:39:26.996 INFO:tasks.workunit.client.0.smithi157.stdout:7/751: link d0/d11/d15/d17/d1c/f47 d0/d11/d6f/d89/d8c/d103/dd4/f107 0 2024-04-03T08:39:26.997 INFO:tasks.workunit.client.1.smithi181.stdout:8/497: creat d4/d45/d96/fa9 x:0 0 0 2024-04-03T08:39:26.998 INFO:tasks.workunit.client.1.smithi181.stdout:9/605: dwrite d1/da/d13/d22/f2e [0,4194304] 0 2024-04-03T08:39:27.000 INFO:tasks.workunit.client.1.smithi181.stdout:9/606: write d1/da/f21 [5021634,38159] 0 2024-04-03T08:39:27.001 INFO:tasks.workunit.client.0.smithi157.stdout:0/701: creat d2/d9/dc/df/d1b/d4a/de4/df1/f102 x:0 0 0 2024-04-03T08:39:27.002 INFO:tasks.workunit.client.0.smithi157.stdout:7/752: truncate d0/d11/d6f/d89/d8c/d103/da5/fe5 240137 0 2024-04-03T08:39:27.004 INFO:tasks.workunit.client.1.smithi181.stdout:4/601: unlink d1/d16/d24/db5/lb7 0 2024-04-03T08:39:27.011 INFO:tasks.workunit.client.0.smithi157.stdout:2/703: rename d3/d2e/d32/d9f/ced to d3/cfb 0 2024-04-03T08:39:27.011 INFO:tasks.workunit.client.0.smithi157.stdout:9/686: dwrite d1/d94/dbe/dbf/fc2 [0,4194304] 0 2024-04-03T08:39:27.013 INFO:tasks.workunit.client.0.smithi157.stdout:2/704: chown d3/db/d44/d4c/df1/cec 359 1 2024-04-03T08:39:27.015 INFO:tasks.workunit.client.0.smithi157.stdout:2/705: fdatasync d3/db/d44/d4c/d5a/d88/f8c 0 2024-04-03T08:39:27.018 INFO:tasks.workunit.client.0.smithi157.stdout:1/635: rmdir d2/d11/d24/d39/d3b/d1b 39 2024-04-03T08:39:27.020 INFO:tasks.workunit.client.1.smithi181.stdout:1/571: write d10/d15/d41/f44 [2616072,93237] 0 2024-04-03T08:39:27.022 INFO:tasks.workunit.client.1.smithi181.stdout:1/572: readlink d10/d15/d4b/d6c/l8a 0 2024-04-03T08:39:27.022 INFO:tasks.workunit.client.1.smithi181.stdout:7/499: mkdir d0/db4 0 2024-04-03T08:39:27.024 INFO:tasks.workunit.client.0.smithi157.stdout:3/663: unlink d8/d13/d1b/d4e/d50/lad 0 2024-04-03T08:39:27.026 INFO:tasks.workunit.client.0.smithi157.stdout:4/665: dread - da/df/d2f/d64/f96 zero size 2024-04-03T08:39:27.026 INFO:tasks.workunit.client.1.smithi181.stdout:2/622: write d13/da7/d27/f4b [4961841,65522] 0 2024-04-03T08:39:27.027 INFO:tasks.workunit.client.0.smithi157.stdout:4/666: stat da/de0 0 2024-04-03T08:39:27.028 INFO:tasks.workunit.client.1.smithi181.stdout:2/623: fsync d13/d1c/da5/fcd 0 2024-04-03T08:39:27.030 INFO:tasks.workunit.client.1.smithi181.stdout:3/578: mknod d0/d5/cc4 0 2024-04-03T08:39:27.031 INFO:tasks.workunit.client.0.smithi157.stdout:4/667: chown da/df/d2f/d64/d8f/dbd 159 1 2024-04-03T08:39:27.036 INFO:tasks.workunit.client.1.smithi181.stdout:8/498: creat d4/d44/d59/d5f/faa x:0 0 0 2024-04-03T08:39:27.039 INFO:tasks.workunit.client.0.smithi157.stdout:9/687: rename d1/d4a/d4d/f9b to d1/d4a/d4d/fec 0 2024-04-03T08:39:27.041 INFO:tasks.workunit.client.0.smithi157.stdout:9/688: dread - d1/d15/d27/d34/dc7/fe1 zero size 2024-04-03T08:39:27.042 INFO:tasks.workunit.client.1.smithi181.stdout:4/602: mknod d1/d16/d37/d34/d86/cca 0 2024-04-03T08:39:27.043 INFO:tasks.workunit.client.0.smithi157.stdout:6/736: dread - d1/d5/d17/d2a/d37/f7b zero size 2024-04-03T08:39:27.044 INFO:tasks.workunit.client.1.smithi181.stdout:2/624: fdatasync d13/d1c/f51 0 2024-04-03T08:39:27.047 INFO:tasks.workunit.client.1.smithi181.stdout:2/625: write f12 [2917735,44793] 0 2024-04-03T08:39:27.047 INFO:tasks.workunit.client.0.smithi157.stdout:3/664: mkdir d8/d1e/d2d/d39/d51/d7e/db1/de7 0 2024-04-03T08:39:27.053 INFO:tasks.workunit.client.1.smithi181.stdout:6/574: truncate d6/d3e/f46 621631 0 2024-04-03T08:39:27.054 INFO:tasks.workunit.client.1.smithi181.stdout:4/603: chown d1/d16/d24/d5e/d31/d39/d5d/lb6 77123 1 2024-04-03T08:39:27.056 INFO:tasks.workunit.client.0.smithi157.stdout:8/713: rename d2/d6f/d70/d89/d59/d9e/ced to d2/d6f/d70/cf3 0 2024-04-03T08:39:27.059 INFO:tasks.workunit.client.1.smithi181.stdout:3/579: creat d0/d57/fc5 x:0 0 0 2024-04-03T08:39:27.060 INFO:tasks.workunit.client.0.smithi157.stdout:9/689: dwrite d1/d15/d27/d34/f6d [0,4194304] 0 2024-04-03T08:39:27.063 INFO:tasks.workunit.client.1.smithi181.stdout:9/607: rename d1/da/d13/d41/d32/fb6 to d1/da/d13/d22/d23/fba 0 2024-04-03T08:39:27.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:26 smithi157 ceph-mon[35083]: pgmap v10: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 152 MiB/s wr, 309 op/s 2024-04-03T08:39:27.066 INFO:tasks.workunit.client.1.smithi181.stdout:9/608: readlink d1/da/d13/d22/d23/d36/l4f 0 2024-04-03T08:39:27.066 INFO:tasks.workunit.client.0.smithi157.stdout:0/702: rmdir d2/d9/dc/df/d1b/d35/dc0/de6 0 2024-04-03T08:39:27.066 INFO:tasks.workunit.client.0.smithi157.stdout:7/753: creat d0/d11/d15/f108 x:0 0 0 2024-04-03T08:39:27.068 INFO:tasks.workunit.client.1.smithi181.stdout:6/575: unlink d6/d3e/d40/f5f 0 2024-04-03T08:39:27.069 INFO:tasks.workunit.client.1.smithi181.stdout:6/576: readlink d6/d3e/d5e/d7c/d9/d7f/da6/l8a 0 2024-04-03T08:39:27.072 INFO:tasks.workunit.client.1.smithi181.stdout:6/577: truncate d6/d3e/d40/fb3 54517 0 2024-04-03T08:39:27.075 INFO:tasks.workunit.client.0.smithi157.stdout:1/636: rename d2/d11/d24/d39/d3b/d2e/d48 to d2/d11/d23/dc9 0 2024-04-03T08:39:27.077 INFO:tasks.workunit.client.0.smithi157.stdout:8/714: mknod d2/d6f/d70/d89/d59/cf4 0 2024-04-03T08:39:27.079 INFO:tasks.workunit.client.1.smithi181.stdout:9/609: dwrite d1/da/d28/d30/f87 [0,4194304] 0 2024-04-03T08:39:27.079 INFO:tasks.workunit.client.1.smithi181.stdout:2/626: write d13/da7/d85/fa8 [993957,83838] 0 2024-04-03T08:39:27.085 INFO:tasks.workunit.client.1.smithi181.stdout:8/499: creat d4/fab x:0 0 0 2024-04-03T08:39:27.089 INFO:tasks.workunit.client.0.smithi157.stdout:3/665: dwrite d8/d13/d1b/d4e/da6/f9d [0,4194304] 0 2024-04-03T08:39:27.089 INFO:tasks.workunit.client.0.smithi157.stdout:9/690: creat d1/d36/d46/fed x:0 0 0 2024-04-03T08:39:27.092 INFO:tasks.workunit.client.0.smithi157.stdout:9/691: fdatasync d1/d15/d27/d34/dc7/fe7 0 2024-04-03T08:39:27.095 INFO:tasks.workunit.client.0.smithi157.stdout:4/668: creat da/df/d2f/dbc/fec x:0 0 0 2024-04-03T08:39:27.095 INFO:tasks.workunit.client.1.smithi181.stdout:3/580: creat d0/d5/d6/d32/daa/fc6 x:0 0 0 2024-04-03T08:39:27.104 INFO:tasks.workunit.client.1.smithi181.stdout:1/573: rename d10/d15/d17/d19/f45 to d10/d15/d17/d23/db0/d8d/fb4 0 2024-04-03T08:39:27.104 INFO:tasks.workunit.client.0.smithi157.stdout:6/737: write d1/d5/d1b/faa [709141,16559] 0 2024-04-03T08:39:27.104 INFO:tasks.workunit.client.0.smithi157.stdout:0/703: read d2/d9/dc/df/d6f/d9d/d6a/f96 [207139,33531] 0 2024-04-03T08:39:27.105 INFO:tasks.workunit.client.1.smithi181.stdout:1/574: chown d10/c84 23 1 2024-04-03T08:39:27.106 INFO:tasks.workunit.client.1.smithi181.stdout:1/575: dread - d10/d15/d4a/d6f/faf zero size 2024-04-03T08:39:27.110 INFO:tasks.workunit.client.0.smithi157.stdout:8/715: dwrite d2/ddd/fdf [0,4194304] 0 2024-04-03T08:39:27.116 INFO:tasks.workunit.client.0.smithi157.stdout:8/716: chown d2/d6f/d70/d89/d59/d9e/la5 442658829 1 2024-04-03T08:39:27.118 INFO:tasks.workunit.client.0.smithi157.stdout:1/637: creat d2/d11/d23/dc9/d86/fca x:0 0 0 2024-04-03T08:39:27.119 INFO:tasks.workunit.client.0.smithi157.stdout:8/717: chown d2/d6f/lbf 27 1 2024-04-03T08:39:27.120 INFO:tasks.workunit.client.1.smithi181.stdout:9/610: unlink d1/da/d13/d22/f42 0 2024-04-03T08:39:27.122 INFO:tasks.workunit.client.0.smithi157.stdout:7/754: write d0/d11/d15/d17/f7d [368613,54770] 0 2024-04-03T08:39:27.123 INFO:tasks.workunit.client.1.smithi181.stdout:2/627: creat d13/d1c/d4a/d68/d72/da1/fe7 x:0 0 0 2024-04-03T08:39:27.123 INFO:tasks.workunit.client.1.smithi181.stdout:9/611: read d1/da/d13/d41/f2a [4853395,12710] 0 2024-04-03T08:39:27.125 INFO:tasks.workunit.client.0.smithi157.stdout:9/692: dwrite d1/d15/d27/d34/dc7/fe7 [0,4194304] 0 2024-04-03T08:39:27.125 INFO:tasks.workunit.client.0.smithi157.stdout:0/704: creat d2/f103 x:0 0 0 2024-04-03T08:39:27.128 INFO:tasks.workunit.client.1.smithi181.stdout:4/604: truncate d1/d16/d24/d5e/d31/f65 6797636 0 2024-04-03T08:39:27.130 INFO:tasks.workunit.client.1.smithi181.stdout:3/581: creat d0/d17/d63/d81/fc7 x:0 0 0 2024-04-03T08:39:27.132 INFO:tasks.workunit.client.0.smithi157.stdout:8/718: mkdir d2/d6f/d70/df5 0 2024-04-03T08:39:27.135 INFO:tasks.workunit.client.1.smithi181.stdout:7/500: rename d0/d1/d6/de/d17/c7f to d0/d1/d6/de/d17/d27/d72/cb5 0 2024-04-03T08:39:27.142 INFO:tasks.workunit.client.0.smithi157.stdout:6/738: mkdir d1/d5/d17/d2a/df7 0 2024-04-03T08:39:27.142 INFO:tasks.workunit.client.1.smithi181.stdout:1/576: write d10/d69/f77 [247373,51724] 0 2024-04-03T08:39:27.145 INFO:tasks.workunit.client.1.smithi181.stdout:2/628: mknod d13/da7/d85/dbd/ce8 0 2024-04-03T08:39:27.147 INFO:tasks.workunit.client.1.smithi181.stdout:8/500: write d4/d44/d59/f78 [941764,80954] 0 2024-04-03T08:39:27.148 INFO:tasks.workunit.client.1.smithi181.stdout:0/531: sync 2024-04-03T08:39:27.150 INFO:tasks.workunit.client.1.smithi181.stdout:5/548: sync 2024-04-03T08:39:27.152 INFO:tasks.workunit.client.1.smithi181.stdout:0/532: read - d5/dc/d10/f86 zero size 2024-04-03T08:39:27.154 INFO:tasks.workunit.client.1.smithi181.stdout:4/605: creat d1/d16/d37/d34/d85/fcb x:0 0 0 2024-04-03T08:39:27.155 INFO:tasks.workunit.client.1.smithi181.stdout:6/578: write d6/d31/d36/f34 [1150088,94030] 0 2024-04-03T08:39:27.157 INFO:tasks.workunit.client.1.smithi181.stdout:5/549: readlink d4/d18/d3e/l62 0 2024-04-03T08:39:27.158 INFO:tasks.workunit.client.0.smithi157.stdout:8/719: mkdir d2/d6f/d70/d89/d59/df6 0 2024-04-03T08:39:27.159 INFO:tasks.workunit.client.0.smithi157.stdout:3/666: truncate d8/d1e/d2d/d3b/d9e/fd2 31514 0 2024-04-03T08:39:27.160 INFO:tasks.workunit.client.0.smithi157.stdout:3/667: readlink d8/lf 0 2024-04-03T08:39:27.161 INFO:tasks.workunit.client.0.smithi157.stdout:4/669: link da/df/f18 da/de0/fed 0 2024-04-03T08:39:27.162 INFO:tasks.workunit.client.1.smithi181.stdout:6/579: readlink d6/d31/l6f 0 2024-04-03T08:39:27.162 INFO:tasks.workunit.client.0.smithi157.stdout:8/720: write d2/d11/d10/d24/d5b/f1c [1738343,123375] 0 2024-04-03T08:39:27.163 INFO:tasks.workunit.client.0.smithi157.stdout:4/670: readlink da/ld9 0 2024-04-03T08:39:27.165 INFO:tasks.workunit.client.0.smithi157.stdout:4/671: chown da/df/l22 9131082 1 2024-04-03T08:39:27.167 INFO:tasks.workunit.client.0.smithi157.stdout:1/638: rename d2/d11/d24/d39/d3b/fe to d2/d11/d24/d39/d3b/d1b/d90/fcb 0 2024-04-03T08:39:27.168 INFO:tasks.workunit.client.1.smithi181.stdout:1/577: unlink d10/d69/c6b 0 2024-04-03T08:39:27.170 INFO:tasks.workunit.client.0.smithi157.stdout:9/693: write d1/f5 [994304,120306] 0 2024-04-03T08:39:27.171 INFO:tasks.workunit.client.1.smithi181.stdout:3/582: dwrite d0/d17/d36/d3b/d5a/d93/d9c/fc2 [0,4194304] 0 2024-04-03T08:39:27.171 INFO:tasks.workunit.client.0.smithi157.stdout:9/694: dread - d1/fcd zero size 2024-04-03T08:39:27.172 INFO:tasks.workunit.client.0.smithi157.stdout:9/695: readlink d1/d15/l9e 0 2024-04-03T08:39:27.178 INFO:tasks.workunit.client.0.smithi157.stdout:1/639: symlink d2/d11/d23/dc9/d64/lcc 0 2024-04-03T08:39:27.180 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:26 smithi181 ceph-mon[44183]: pgmap v10: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 152 MiB/s wr, 309 op/s 2024-04-03T08:39:27.181 INFO:tasks.workunit.client.1.smithi181.stdout:3/583: write d0/d5/fa2 [1107914,63973] 0 2024-04-03T08:39:27.181 INFO:tasks.workunit.client.1.smithi181.stdout:0/533: unlink d5/dc/d10/f27 0 2024-04-03T08:39:27.181 INFO:tasks.workunit.client.0.smithi157.stdout:8/721: mkdir d2/d20/df7 0 2024-04-03T08:39:27.184 INFO:tasks.workunit.client.1.smithi181.stdout:8/501: dwrite d4/d45/d9/f1b [0,4194304] 0 2024-04-03T08:39:27.184 INFO:tasks.workunit.client.1.smithi181.stdout:2/629: dwrite d13/da7/d27/d2f/f70 [0,4194304] 0 2024-04-03T08:39:27.191 INFO:tasks.workunit.client.0.smithi157.stdout:1/640: rename d2/d11/d24/d39/d3b/f5c to d2/d11/d24/d39/d3b/d1b/fcd 0 2024-04-03T08:39:27.191 INFO:tasks.workunit.client.0.smithi157.stdout:3/668: link d8/d1e/d2d/d3b/d8c/db4/ce3 d8/d13/d1b/d4e/d50/d7c/ddc/ce8 0 2024-04-03T08:39:27.192 INFO:tasks.workunit.client.1.smithi181.stdout:5/550: dwrite d4/d18/f83 [0,4194304] 0 2024-04-03T08:39:27.194 INFO:tasks.workunit.client.0.smithi157.stdout:6/739: dread d1/d4b/d38/d59/f9b [0,4194304] 0 2024-04-03T08:39:27.195 INFO:tasks.workunit.client.1.smithi181.stdout:7/501: write d0/d1/d6/de/d17/f62 [598754,53105] 0 2024-04-03T08:39:27.198 INFO:tasks.workunit.client.0.smithi157.stdout:6/740: write d1/d4b/d38/da6/fb3 [669864,104556] 0 2024-04-03T08:39:27.203 INFO:tasks.workunit.client.0.smithi157.stdout:9/696: creat d1/d36/fee x:0 0 0 2024-04-03T08:39:27.204 INFO:tasks.workunit.client.0.smithi157.stdout:0/705: write d2/d9/dc/df/fdc [12049,22329] 0 2024-04-03T08:39:27.204 INFO:tasks.workunit.client.1.smithi181.stdout:6/580: mkdir d6/d53/d8d/d97/db0/db5 0 2024-04-03T08:39:27.206 INFO:tasks.workunit.client.1.smithi181.stdout:5/551: chown d4/f5 109443 1 2024-04-03T08:39:27.207 INFO:tasks.workunit.client.1.smithi181.stdout:9/612: write d1/da/d28/d30/f87 [1180925,28271] 0 2024-04-03T08:39:27.209 INFO:tasks.workunit.client.1.smithi181.stdout:1/578: mknod d10/d15/d4a/d86/cb5 0 2024-04-03T08:39:27.209 INFO:tasks.workunit.client.0.smithi157.stdout:3/669: chown d8/d13/d1b/d37/f85 31165 1 2024-04-03T08:39:27.209 INFO:tasks.workunit.client.0.smithi157.stdout:7/755: truncate d0/d11/d6f/d89/d8c/dc6/fe8 971904 0 2024-04-03T08:39:27.212 INFO:tasks.workunit.client.0.smithi157.stdout:1/641: creat d2/d11/d24/d39/d3b/d2e/d66/fce x:0 0 0 2024-04-03T08:39:27.213 INFO:tasks.workunit.client.1.smithi181.stdout:1/579: chown d10/d15/c7b 0 1 2024-04-03T08:39:27.215 INFO:tasks.workunit.client.1.smithi181.stdout:5/552: dread d4/d22/d78/faa [0,4194304] 0 2024-04-03T08:39:27.228 INFO:tasks.workunit.client.1.smithi181.stdout:4/606: dwrite d1/d1e/f2e [0,4194304] 0 2024-04-03T08:39:27.229 INFO:tasks.workunit.client.0.smithi157.stdout:4/672: dread da/f1e [0,4194304] 0 2024-04-03T08:39:27.236 INFO:tasks.workunit.client.1.smithi181.stdout:1/580: dwrite d10/d15/d17/d23/db0/d8d/f9b [0,4194304] 0 2024-04-03T08:39:27.237 INFO:tasks.workunit.client.0.smithi157.stdout:9/697: unlink d1/d94/c68 0 2024-04-03T08:39:27.241 INFO:tasks.workunit.client.1.smithi181.stdout:7/502: dread d0/d1/d6/de/f42 [0,4194304] 0 2024-04-03T08:39:27.242 INFO:tasks.workunit.client.1.smithi181.stdout:9/613: mkdir d1/da/d13/d41/d65/dbb 0 2024-04-03T08:39:27.243 INFO:tasks.workunit.client.1.smithi181.stdout:3/584: write d0/d17/f5b [221719,129523] 0 2024-04-03T08:39:27.244 INFO:tasks.workunit.client.0.smithi157.stdout:8/722: truncate d2/d11/d10/d24/d5b/f1c 1777340 0 2024-04-03T08:39:27.247 INFO:tasks.workunit.client.1.smithi181.stdout:6/581: creat d6/d3e/d5e/d7c/d9/d7f/da6/d4f/d77/d8b/fb6 x:0 0 0 2024-04-03T08:39:27.250 INFO:tasks.workunit.client.1.smithi181.stdout:5/553: stat d4/d18/l3a 0 2024-04-03T08:39:27.254 INFO:tasks.workunit.client.0.smithi157.stdout:0/706: dread d2/d9/d36/d38/fa7 [0,4194304] 0 2024-04-03T08:39:27.254 INFO:tasks.workunit.client.0.smithi157.stdout:6/741: dwrite d1/d5/d17/d2a/d40/f7e [0,4194304] 0 2024-04-03T08:39:27.257 INFO:tasks.workunit.client.0.smithi157.stdout:9/698: mkdir d1/d15/d27/d34/da6/def 0 2024-04-03T08:39:27.260 INFO:tasks.workunit.client.1.smithi181.stdout:9/614: rename d1/l15 to d1/da/d1a/lbc 0 2024-04-03T08:39:27.262 INFO:tasks.workunit.client.0.smithi157.stdout:3/670: truncate d8/f2f 388374 0 2024-04-03T08:39:27.263 INFO:tasks.workunit.client.0.smithi157.stdout:6/742: stat d1/d5/d17/d2a/f82 0 2024-04-03T08:39:27.263 INFO:tasks.workunit.client.1.smithi181.stdout:7/503: read - d0/d1/f7e zero size 2024-04-03T08:39:27.266 INFO:tasks.workunit.client.1.smithi181.stdout:3/585: creat d0/d5/d77/fc8 x:0 0 0 2024-04-03T08:39:27.267 INFO:tasks.workunit.client.0.smithi157.stdout:8/723: symlink d2/d6f/d70/df5/lf8 0 2024-04-03T08:39:27.271 INFO:tasks.workunit.client.0.smithi157.stdout:4/673: symlink da/df/d11/lee 0 2024-04-03T08:39:27.272 INFO:tasks.workunit.client.1.smithi181.stdout:8/502: creat d4/d2a/d37/fac x:0 0 0 2024-04-03T08:39:27.273 INFO:tasks.workunit.client.1.smithi181.stdout:7/504: chown d0/d1/d6/de/d17/f31 0 1 2024-04-03T08:39:27.274 INFO:tasks.workunit.client.1.smithi181.stdout:5/554: mkdir d4/d18/d55/dae 0 2024-04-03T08:39:27.276 INFO:tasks.workunit.client.1.smithi181.stdout:2/630: link d13/d1c/d4a/d68/c90 d13/ce9 0 2024-04-03T08:39:27.280 INFO:tasks.workunit.client.1.smithi181.stdout:6/582: getdents d6/d53/d8d/d97/db0/db5 0 2024-04-03T08:39:27.280 INFO:tasks.workunit.client.0.smithi157.stdout:1/642: link d2/d11/d23/dc9/d58/l3d d2/d11/d24/d39/d3b/d1b/d90/lcf 0 2024-04-03T08:39:27.282 INFO:tasks.workunit.client.0.smithi157.stdout:8/724: symlink d2/d6f/db5/lf9 0 2024-04-03T08:39:27.284 INFO:tasks.workunit.client.1.smithi181.stdout:0/534: creat d5/d9/d60/fa6 x:0 0 0 2024-04-03T08:39:27.285 INFO:tasks.workunit.client.1.smithi181.stdout:6/583: write d6/d3e/d5e/d7c/d9/d7f/f8e [2071545,12081] 0 2024-04-03T08:39:27.287 INFO:tasks.workunit.client.1.smithi181.stdout:7/505: fdatasync d0/d1/f51 0 2024-04-03T08:39:27.287 INFO:tasks.workunit.client.0.smithi157.stdout:9/699: symlink d1/d15/lf0 0 2024-04-03T08:39:27.288 INFO:tasks.workunit.client.0.smithi157.stdout:7/756: truncate d0/d11/d15/d17/d1c/d88/fc5 680434 0 2024-04-03T08:39:27.290 INFO:tasks.workunit.client.0.smithi157.stdout:7/757: stat d0/d11/d6f/d76/da7/f62 0 2024-04-03T08:39:27.294 INFO:tasks.workunit.client.0.smithi157.stdout:5/744: sync 2024-04-03T08:39:27.295 INFO:tasks.workunit.client.1.smithi181.stdout:5/555: rename d4/d18/d2c/l9c to d4/d18/d3e/laf 0 2024-04-03T08:39:27.295 INFO:tasks.workunit.client.1.smithi181.stdout:1/581: dread d10/d15/d17/d19/f2f [0,4194304] 0 2024-04-03T08:39:27.295 INFO:tasks.workunit.client.1.smithi181.stdout:3/586: dwrite d0/d17/d36/d1e/f80 [0,4194304] 0 2024-04-03T08:39:27.296 INFO:tasks.workunit.client.0.smithi157.stdout:5/745: fdatasync dc/dbb/fe3 0 2024-04-03T08:39:27.297 INFO:tasks.workunit.client.1.smithi181.stdout:2/631: creat d13/d1c/d4a/d68/dba/fea x:0 0 0 2024-04-03T08:39:27.298 INFO:tasks.workunit.client.1.smithi181.stdout:1/582: readlink d10/d15/d17/d19/d33/d70/l88 0 2024-04-03T08:39:27.299 INFO:tasks.workunit.client.0.smithi157.stdout:5/746: write dc/fa3 [1197539,5118] 0 2024-04-03T08:39:27.301 INFO:tasks.workunit.client.0.smithi157.stdout:1/643: truncate d2/d11/d23/dc9/d5d/f60 2422778 0 2024-04-03T08:39:27.301 INFO:tasks.workunit.client.1.smithi181.stdout:5/556: truncate d4/d18/f83 4256882 0 2024-04-03T08:39:27.305 INFO:tasks.workunit.client.0.smithi157.stdout:4/674: rename da/f3e to da/df/d6b/d95/fef 0 2024-04-03T08:39:27.309 INFO:tasks.workunit.client.0.smithi157.stdout:9/700: symlink d1/d36/d46/lf1 0 2024-04-03T08:39:27.313 INFO:tasks.workunit.client.0.smithi157.stdout:7/758: readlink d0/d11/d6f/d76/da7/l3c 0 2024-04-03T08:39:27.314 INFO:tasks.workunit.client.0.smithi157.stdout:9/701: write d1/d15/d27/d5c/d79/f9d [421276,103426] 0 2024-04-03T08:39:27.325 INFO:tasks.workunit.client.1.smithi181.stdout:8/503: write d4/d45/db/d14/d31/f3c [653636,90203] 0 2024-04-03T08:39:27.327 INFO:tasks.workunit.client.0.smithi157.stdout:1/644: dread d2/d11/d24/d39/d3b/d1b/d7f/faa [0,4194304] 0 2024-04-03T08:39:27.330 INFO:tasks.workunit.client.0.smithi157.stdout:3/671: creat d8/d1e/d2d/d3f/fe9 x:0 0 0 2024-04-03T08:39:27.331 INFO:tasks.workunit.client.1.smithi181.stdout:3/587: fdatasync d0/d17/d36/d1e/f7e 0 2024-04-03T08:39:27.334 INFO:tasks.workunit.client.1.smithi181.stdout:9/615: write d1/da/d13/d22/d23/f5e [3608320,63864] 0 2024-04-03T08:39:27.335 INFO:tasks.workunit.client.1.smithi181.stdout:2/632: read d13/d1c/d4a/d68/f86 [221540,79161] 0 2024-04-03T08:39:27.340 INFO:tasks.workunit.client.0.smithi157.stdout:7/759: dwrite d0/d11/d6f/d76/da7/f92 [4194304,4194304] 0 2024-04-03T08:39:27.340 INFO:tasks.workunit.client.0.smithi157.stdout:6/743: dwrite d1/f3 [0,4194304] 0 2024-04-03T08:39:27.354 INFO:tasks.workunit.client.0.smithi157.stdout:5/747: symlink dc/d35/lf6 0 2024-04-03T08:39:27.355 INFO:tasks.workunit.client.1.smithi181.stdout:6/584: write d6/d3e/d5e/d7c/d9/d7f/da6/d4f/f55 [1272287,102034] 0 2024-04-03T08:39:27.365 INFO:tasks.workunit.client.0.smithi157.stdout:8/725: rename d2/d20/d23/f6c to d2/d6f/db5/ffa 0 2024-04-03T08:39:27.368 INFO:tasks.workunit.client.0.smithi157.stdout:2/706: sync 2024-04-03T08:39:27.370 INFO:tasks.workunit.client.1.smithi181.stdout:2/633: symlink d13/d1c/d6c/leb 0 2024-04-03T08:39:27.372 INFO:tasks.workunit.client.0.smithi157.stdout:7/760: dwrite d0/d11/d15/d17/d52/db6/dda/de6/ff1 [0,4194304] 0 2024-04-03T08:39:27.375 INFO:tasks.workunit.client.0.smithi157.stdout:1/645: creat d2/d11/d23/dc9/d5d/db4/fd0 x:0 0 0 2024-04-03T08:39:27.376 INFO:tasks.workunit.client.1.smithi181.stdout:5/557: dread d4/d18/d25/f3c [0,4194304] 0 2024-04-03T08:39:27.376 INFO:tasks.workunit.client.1.smithi181.stdout:1/583: rename d10/d15/d17/d37/c58 to d10/d15/d17/d23/d27/cb6 0 2024-04-03T08:39:27.376 INFO:tasks.workunit.client.1.smithi181.stdout:5/558: stat d4/d56/f75 0 2024-04-03T08:39:27.377 INFO:tasks.workunit.client.1.smithi181.stdout:1/584: dread - d10/da1/fb1 zero size 2024-04-03T08:39:27.377 INFO:tasks.workunit.client.0.smithi157.stdout:3/672: creat d8/d13/d1b/d83/fea x:0 0 0 2024-04-03T08:39:27.378 INFO:tasks.workunit.client.1.smithi181.stdout:1/585: chown d10/d15/f34 3969760 1 2024-04-03T08:39:27.379 INFO:tasks.workunit.client.1.smithi181.stdout:5/559: dread - d4/d18/d25/d59/d81/d90/f94 zero size 2024-04-03T08:39:27.383 INFO:tasks.workunit.client.0.smithi157.stdout:5/748: dwrite fa [4194304,4194304] 0 2024-04-03T08:39:27.386 INFO:tasks.workunit.client.1.smithi181.stdout:5/560: dread d4/ff [0,4194304] 0 2024-04-03T08:39:27.387 INFO:tasks.workunit.client.0.smithi157.stdout:5/749: fdatasync dc/f13 0 2024-04-03T08:39:27.387 INFO:tasks.workunit.client.1.smithi181.stdout:5/561: dread - d4/d80/fa4 zero size 2024-04-03T08:39:27.388 INFO:tasks.workunit.client.0.smithi157.stdout:5/750: write fa [1719794,121425] 0 2024-04-03T08:39:27.390 INFO:tasks.workunit.client.0.smithi157.stdout:0/707: link d2/d9/dc/df/d6f/d9d/d6a/d91/dae/fb6 d2/d9/d51/d63/f104 0 2024-04-03T08:39:27.392 INFO:tasks.workunit.client.0.smithi157.stdout:4/675: write da/df/f14 [1477606,17350] 0 2024-04-03T08:39:27.396 INFO:tasks.workunit.client.0.smithi157.stdout:6/744: symlink d1/d5/d17/d2a/d37/lf8 0 2024-04-03T08:39:27.405 INFO:tasks.workunit.client.1.smithi181.stdout:4/607: sync 2024-04-03T08:39:27.406 INFO:tasks.workunit.client.1.smithi181.stdout:7/506: getdents d0/d1/d6/de/da3 0 2024-04-03T08:39:27.406 INFO:tasks.workunit.client.1.smithi181.stdout:4/608: stat d1/d16/d24/d5e/d3f/d41 0 2024-04-03T08:39:27.407 INFO:tasks.workunit.client.0.smithi157.stdout:8/726: creat d2/d11/d10/d24/d5b/d53/ffb x:0 0 0 2024-04-03T08:39:27.409 INFO:tasks.workunit.client.0.smithi157.stdout:2/707: symlink d3/db/d44/lfc 0 2024-04-03T08:39:27.413 INFO:tasks.workunit.client.1.smithi181.stdout:0/535: getdents d5/dc/d10/d30/d68/d90 0 2024-04-03T08:39:27.413 INFO:tasks.workunit.client.0.smithi157.stdout:9/702: rename d1/d15/d16/f23 to d1/d15/d27/daf/da7/ff2 0 2024-04-03T08:39:27.414 INFO:tasks.workunit.client.0.smithi157.stdout:7/761: truncate d0/d11/d6f/d89/fd6 550295 0 2024-04-03T08:39:27.414 INFO:tasks.workunit.client.0.smithi157.stdout:9/703: fsync d1/d15/f1a 0 2024-04-03T08:39:27.415 INFO:tasks.workunit.client.1.smithi181.stdout:5/562: fsync d4/d18/d55/d5a/f76 0 2024-04-03T08:39:27.418 INFO:tasks.workunit.client.1.smithi181.stdout:3/588: link d0/d5/d6/cb6 d0/d17/d36/d3b/d5a/d93/cc9 0 2024-04-03T08:39:27.420 INFO:tasks.workunit.client.1.smithi181.stdout:2/634: creat d13/da7/d85/de4/fec x:0 0 0 2024-04-03T08:39:27.421 INFO:tasks.workunit.client.1.smithi181.stdout:2/635: stat d13/da7/l74 0 2024-04-03T08:39:27.422 INFO:tasks.workunit.client.0.smithi157.stdout:5/751: mknod dc/d29/d56/d9e/dc3/dde/cf7 0 2024-04-03T08:39:27.423 INFO:tasks.workunit.client.1.smithi181.stdout:2/636: chown d13/da7/d27/d2f/f9e 4 1 2024-04-03T08:39:27.424 INFO:tasks.workunit.client.1.smithi181.stdout:2/637: fdatasync d13/da7/fc4 0 2024-04-03T08:39:27.425 INFO:tasks.workunit.client.1.smithi181.stdout:8/504: rename d4/d45/le to d4/d45/db/d14/d31/d1c/d51/lad 0 2024-04-03T08:39:27.428 INFO:tasks.workunit.client.1.smithi181.stdout:7/507: chown d0/d1/l53 0 1 2024-04-03T08:39:27.431 INFO:tasks.workunit.client.1.smithi181.stdout:1/586: fdatasync d10/d15/d4b/f50 0 2024-04-03T08:39:27.434 INFO:tasks.workunit.client.1.smithi181.stdout:3/589: dwrite d0/d5/fa2 [0,4194304] 0 2024-04-03T08:39:27.435 INFO:tasks.workunit.client.0.smithi157.stdout:8/727: truncate d2/d11/d10/d24/d5b/f4b 1962161 0 2024-04-03T08:39:27.437 INFO:tasks.workunit.client.0.smithi157.stdout:1/646: write d2/d11/d24/d39/f6f [5207832,118500] 0 2024-04-03T08:39:27.440 INFO:tasks.workunit.client.0.smithi157.stdout:2/708: creat d3/db/d44/d4c/d5a/d88/ffd x:0 0 0 2024-04-03T08:39:27.451 INFO:tasks.workunit.client.0.smithi157.stdout:7/762: mkdir d0/d11/d15/d17/d1c/d4f/d5f/d109 0 2024-04-03T08:39:27.453 INFO:tasks.workunit.client.0.smithi157.stdout:4/676: write da/de0/fed [3229005,82622] 0 2024-04-03T08:39:27.455 INFO:tasks.workunit.client.0.smithi157.stdout:4/677: chown da/df/d24 198255 1 2024-04-03T08:39:27.457 INFO:tasks.workunit.client.1.smithi181.stdout:9/616: link d1/da/d28/d30/f47 d1/da/d13/d22/d23/d36/d9c/fbd 0 2024-04-03T08:39:27.457 INFO:tasks.workunit.client.1.smithi181.stdout:0/536: write d5/d9/d2a/f67 [736852,27673] 0 2024-04-03T08:39:27.459 INFO:tasks.workunit.client.0.smithi157.stdout:5/752: mknod dc/d29/d56/d2e/cf8 0 2024-04-03T08:39:27.463 INFO:tasks.workunit.client.0.smithi157.stdout:0/708: dwrite d2/d9/d36/f80 [0,4194304] 0 2024-04-03T08:39:27.464 INFO:tasks.workunit.client.1.smithi181.stdout:4/609: mknod d1/d16/ccc 0 2024-04-03T08:39:27.465 INFO:tasks.workunit.client.1.smithi181.stdout:7/508: mkdir d0/d1/d6/de/d17/d27/d72/db6 0 2024-04-03T08:39:27.466 INFO:tasks.workunit.client.1.smithi181.stdout:8/505: dread d4/d45/db/f13 [0,4194304] 0 2024-04-03T08:39:27.466 INFO:tasks.workunit.client.1.smithi181.stdout:7/509: dread - d0/d1/f51 zero size 2024-04-03T08:39:27.468 INFO:tasks.workunit.client.1.smithi181.stdout:1/587: creat d10/d15/d17/d37/fb7 x:0 0 0 2024-04-03T08:39:27.468 INFO:tasks.workunit.client.1.smithi181.stdout:8/506: readlink d4/d45/d9/la2 0 2024-04-03T08:39:27.468 INFO:tasks.workunit.client.0.smithi157.stdout:1/647: creat d2/d11/d23/d73/fd1 x:0 0 0 2024-04-03T08:39:27.470 INFO:tasks.workunit.client.0.smithi157.stdout:2/709: symlink d3/db/d44/d4c/d5a/d88/d97/lfe 0 2024-04-03T08:39:27.471 INFO:tasks.workunit.client.1.smithi181.stdout:3/590: read d0/d17/d36/d1e/f31 [7769239,113025] 0 2024-04-03T08:39:27.472 INFO:tasks.workunit.client.0.smithi157.stdout:9/704: symlink d1/d4a/dc4/lf3 0 2024-04-03T08:39:27.473 INFO:tasks.workunit.client.0.smithi157.stdout:2/710: chown d3/d12/d43/d4b/lca 257250 1 2024-04-03T08:39:27.475 INFO:tasks.workunit.client.1.smithi181.stdout:6/585: getdents d6/d3e/d5e/d7c/d9/d7f/da6 0 2024-04-03T08:39:27.476 INFO:tasks.workunit.client.0.smithi157.stdout:2/711: readlink d3/db/d44/le1 0 2024-04-03T08:39:27.479 INFO:tasks.workunit.client.0.smithi157.stdout:2/712: chown d3/db/d44/d4c/d5a/d88/dc6/fd2 20284007 1 2024-04-03T08:39:27.482 INFO:tasks.workunit.client.1.smithi181.stdout:0/537: dread d5/dc/d10/d30/f94 [0,4194304] 0 2024-04-03T08:39:27.483 INFO:tasks.workunit.client.0.smithi157.stdout:0/709: write d2/d9/dc/df/d1b/d35/d3d/fc1 [1241300,75428] 0 2024-04-03T08:39:27.484 INFO:tasks.workunit.client.0.smithi157.stdout:8/728: truncate d2/f99 940023 0 2024-04-03T08:39:27.488 INFO:tasks.workunit.client.0.smithi157.stdout:1/648: unlink d2/d11/d23/f4f 0 2024-04-03T08:39:27.492 INFO:tasks.workunit.client.1.smithi181.stdout:4/610: truncate d1/d16/d55/f62 1515005 0 2024-04-03T08:39:27.493 INFO:tasks.workunit.client.0.smithi157.stdout:4/678: fsync da/df/d6b/d95/fef 0 2024-04-03T08:39:27.494 INFO:tasks.workunit.client.0.smithi157.stdout:6/745: mkdir d1/d4b/da5/dd9/df9 0 2024-04-03T08:39:27.495 INFO:tasks.workunit.client.1.smithi181.stdout:1/588: symlink d10/d15/d17/d23/db0/lb8 0 2024-04-03T08:39:27.497 INFO:tasks.workunit.client.1.smithi181.stdout:7/510: rmdir d0/d1/d6/de/d17/d64/d85/d9a/da4 39 2024-04-03T08:39:27.499 INFO:tasks.workunit.client.1.smithi181.stdout:3/591: truncate d0/d17/d36/d1e/f28 2268208 0 2024-04-03T08:39:27.502 INFO:tasks.workunit.client.1.smithi181.stdout:3/592: write d0/d5/d6/d32/daa/fae [272409,120768] 0 2024-04-03T08:39:27.505 INFO:tasks.workunit.client.1.smithi181.stdout:3/593: read d0/d5/d6/f11 [3855550,56872] 0 2024-04-03T08:39:27.506 INFO:tasks.workunit.client.1.smithi181.stdout:9/617: symlink d1/da/d28/d30/d3e/d4e/lbe 0 2024-04-03T08:39:27.508 INFO:tasks.workunit.client.0.smithi157.stdout:5/753: dread dc/d29/d43/da1/fa8 [0,4194304] 0 2024-04-03T08:39:27.508 INFO:tasks.workunit.client.0.smithi157.stdout:1/649: creat d2/d11/d24/d39/d3b/d2e/d66/fd2 x:0 0 0 2024-04-03T08:39:27.509 INFO:tasks.workunit.client.1.smithi181.stdout:2/638: creat d13/d1c/d4a/fed x:0 0 0 2024-04-03T08:39:27.509 INFO:tasks.workunit.client.0.smithi157.stdout:0/710: write d2/d9/d36/d38/f83 [11461515,97849] 0 2024-04-03T08:39:27.514 INFO:tasks.workunit.client.1.smithi181.stdout:0/538: creat d5/dc/d10/d30/fa7 x:0 0 0 2024-04-03T08:39:27.516 INFO:tasks.workunit.client.1.smithi181.stdout:0/539: write d5/dc/d14/f9c [278353,118370] 0 2024-04-03T08:39:27.519 INFO:tasks.workunit.client.0.smithi157.stdout:4/679: read da/df/d11/f27 [2728705,67516] 0 2024-04-03T08:39:27.521 INFO:tasks.workunit.client.0.smithi157.stdout:8/729: dwrite d2/d11/d10/fe3 [8388608,4194304] 0 2024-04-03T08:39:27.522 INFO:tasks.workunit.client.1.smithi181.stdout:0/540: write d5/d9/f9e [807024,115348] 0 2024-04-03T08:39:27.523 INFO:tasks.workunit.client.1.smithi181.stdout:6/586: dwrite d6/d3e/d5e/d7c/f49 [0,4194304] 0 2024-04-03T08:39:27.525 INFO:tasks.workunit.client.0.smithi157.stdout:5/754: mknod dc/d29/d56/d9e/db5/cf9 0 2024-04-03T08:39:27.531 INFO:tasks.workunit.client.0.smithi157.stdout:2/713: dread d3/db/d44/d4c/d5a/d88/f96 [0,4194304] 0 2024-04-03T08:39:27.531 INFO:tasks.workunit.client.0.smithi157.stdout:6/746: rename d1/d5/d17/d29/f7d to d1/d5/d17/d29/d62/d7f/d89/ffa 0 2024-04-03T08:39:27.533 INFO:tasks.workunit.client.0.smithi157.stdout:9/705: getdents d1/d94 0 2024-04-03T08:39:27.535 INFO:tasks.workunit.client.0.smithi157.stdout:9/706: readlink d1/d15/d27/d34/dc7/ld0 0 2024-04-03T08:39:27.535 INFO:tasks.workunit.client.0.smithi157.stdout:8/730: rmdir d2/d20/db1 39 2024-04-03T08:39:27.542 INFO:tasks.workunit.client.0.smithi157.stdout:0/711: truncate d2/d9/dc/f5d 3964160 0 2024-04-03T08:39:27.554 INFO:tasks.workunit.client.0.smithi157.stdout:9/707: dread d1/d94/dbe/dbf/fc2 [0,4194304] 0 2024-04-03T08:39:27.558 INFO:tasks.workunit.client.0.smithi157.stdout:0/712: dread - d2/d9/dc/df/d1b/d35/d3d/fa5 zero size 2024-04-03T08:39:27.561 INFO:tasks.workunit.client.0.smithi157.stdout:0/713: write d2/f5b [3732297,106641] 0 2024-04-03T08:39:27.565 INFO:tasks.workunit.client.0.smithi157.stdout:1/650: dread d2/d11/f26 [0,4194304] 0 2024-04-03T08:39:27.565 INFO:tasks.workunit.client.0.smithi157.stdout:8/731: mknod d2/d20/db1/dbc/cfc 0 2024-04-03T08:39:27.567 INFO:tasks.workunit.client.0.smithi157.stdout:4/680: getdents da/df/d24/d35/d6a/d78 0 2024-04-03T08:39:27.574 INFO:tasks.workunit.client.0.smithi157.stdout:0/714: mkdir d2/d9/d5f/d105 0 2024-04-03T08:39:27.575 INFO:tasks.workunit.client.1.smithi181.stdout:8/507: mkdir d4/d45/dae 0 2024-04-03T08:39:27.579 INFO:tasks.workunit.client.1.smithi181.stdout:1/589: dread - d10/d15/d41/f83 zero size 2024-04-03T08:39:27.581 INFO:tasks.workunit.client.1.smithi181.stdout:5/563: getdents d4/d18/d25/d59 0 2024-04-03T08:39:27.584 INFO:tasks.workunit.client.0.smithi157.stdout:8/732: unlink d2/d11/fca 0 2024-04-03T08:39:27.584 INFO:tasks.workunit.client.0.smithi157.stdout:2/714: dwrite d3/d12/d43/d4b/f79 [0,4194304] 0 2024-04-03T08:39:27.586 INFO:tasks.workunit.client.0.smithi157.stdout:9/708: dread d1/d36/f3b [0,4194304] 0 2024-04-03T08:39:27.589 INFO:tasks.workunit.client.0.smithi157.stdout:2/715: write d3/db/d44/d4c/d5a/d88/d97/faa [2503727,28090] 0 2024-04-03T08:39:27.592 INFO:tasks.workunit.client.1.smithi181.stdout:2/639: unlink d13/ce9 0 2024-04-03T08:39:27.594 INFO:tasks.workunit.client.0.smithi157.stdout:1/651: dread d2/f88 [0,4194304] 0 2024-04-03T08:39:27.599 INFO:tasks.workunit.client.1.smithi181.stdout:4/611: write d1/d16/d24/d5e/d2b/d56/f64 [6189346,117593] 0 2024-04-03T08:39:27.600 INFO:tasks.workunit.client.1.smithi181.stdout:5/564: dwrite d4/d22/d78/f7f [0,4194304] 0 2024-04-03T08:39:27.602 INFO:tasks.workunit.client.0.smithi157.stdout:2/716: stat d3/db/l41 0 2024-04-03T08:39:27.605 INFO:tasks.workunit.client.0.smithi157.stdout:0/715: write d2/d9/dc/df/d1b/d4a/fc4 [589114,127531] 0 2024-04-03T08:39:27.606 INFO:tasks.workunit.client.0.smithi157.stdout:9/709: mknod d1/d4a/d4d/da4/dcc/cf4 0 2024-04-03T08:39:27.607 INFO:tasks.workunit.client.1.smithi181.stdout:7/511: mknod d0/d1/cb7 0 2024-04-03T08:39:27.610 INFO:tasks.workunit.client.0.smithi157.stdout:1/652: unlink d2/d11/d23/dc9/d64/lcc 0 2024-04-03T08:39:27.612 INFO:tasks.workunit.client.0.smithi157.stdout:2/717: symlink d3/dab/lff 0 2024-04-03T08:39:27.613 INFO:tasks.workunit.client.0.smithi157.stdout:4/681: dwrite da/df/d24/d35/d3c/f71 [0,4194304] 0 2024-04-03T08:39:27.622 INFO:tasks.workunit.client.0.smithi157.stdout:8/733: rename d2/d11/d10/d24/d5b/f4b to d2/ffd 0 2024-04-03T08:39:27.623 INFO:tasks.workunit.client.1.smithi181.stdout:0/541: mkdir d5/d9/d2a/da1/da8 0 2024-04-03T08:39:27.623 INFO:tasks.workunit.client.1.smithi181.stdout:4/612: dwrite d1/d16/d24/d5e/d3f/f6b [0,4194304] 0 2024-04-03T08:39:27.623 INFO:tasks.workunit.client.1.smithi181.stdout:6/587: symlink d6/d53/d8d/d97/db0/db5/lb7 0 2024-04-03T08:39:27.625 INFO:tasks.workunit.client.1.smithi181.stdout:8/508: symlink d4/d45/db/d14/d31/d1c/laf 0 2024-04-03T08:39:27.626 INFO:tasks.workunit.client.0.smithi157.stdout:1/653: symlink d2/d11/d23/dc9/d5d/d9a/ld3 0 2024-04-03T08:39:27.627 INFO:tasks.workunit.client.1.smithi181.stdout:8/509: chown d4/d45/f2e 15040 1 2024-04-03T08:39:27.627 INFO:tasks.workunit.client.1.smithi181.stdout:1/590: dwrite d10/d15/d17/d19/f2f [4194304,4194304] 0 2024-04-03T08:39:27.629 INFO:tasks.workunit.client.0.smithi157.stdout:9/710: dwrite d1/d15/d27/f32 [0,4194304] 0 2024-04-03T08:39:27.630 INFO:tasks.workunit.client.1.smithi181.stdout:5/565: rename d4/d18/d55/d5a/d91 to d4/d18/d25/db0 0 2024-04-03T08:39:27.631 INFO:tasks.workunit.client.1.smithi181.stdout:8/510: chown d4/d45/db/d14/d31/c3e 2621545 1 2024-04-03T08:39:27.632 INFO:tasks.workunit.client.0.smithi157.stdout:9/711: chown d1/d15/dca/ld1 0 1 2024-04-03T08:39:27.640 INFO:tasks.workunit.client.0.smithi157.stdout:8/734: creat d2/d6f/d70/d89/d59/ffe x:0 0 0 2024-04-03T08:39:27.640 INFO:tasks.workunit.client.1.smithi181.stdout:2/640: creat d13/d1c/d4a/d7f/db3/de3/fee x:0 0 0 2024-04-03T08:39:27.644 INFO:tasks.workunit.client.1.smithi181.stdout:0/542: unlink d5/dc/d14/f3a 0 2024-04-03T08:39:27.645 INFO:tasks.workunit.client.1.smithi181.stdout:4/613: fsync d1/d16/d55/f6e 0 2024-04-03T08:39:27.646 INFO:tasks.workunit.client.0.smithi157.stdout:0/716: getdents d2/d9/dc/df/d1b/d4a/de4 0 2024-04-03T08:39:27.647 INFO:tasks.workunit.client.1.smithi181.stdout:6/588: unlink d6/d3e/d5e/d7c/d9/d7f/da6/d4f/f7d 0 2024-04-03T08:39:27.649 INFO:tasks.workunit.client.1.smithi181.stdout:5/566: creat d4/d18/d25/d59/d81/d96/fb1 x:0 0 0 2024-04-03T08:39:27.653 INFO:tasks.workunit.client.0.smithi157.stdout:8/735: rmdir d2/d20/d23 39 2024-04-03T08:39:27.657 INFO:tasks.workunit.client.1.smithi181.stdout:3/594: dwrite d0/d5/d6/dd/d25/f4d [0,4194304] 0 2024-04-03T08:39:27.660 INFO:tasks.workunit.client.0.smithi157.stdout:0/717: rename d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/de1 to d2/d9/d5f/d85/d106 0 2024-04-03T08:39:27.663 INFO:tasks.workunit.client.0.smithi157.stdout:2/718: write d3/d12/f56 [1790073,131056] 0 2024-04-03T08:39:27.663 INFO:tasks.workunit.client.1.smithi181.stdout:9/618: truncate d1/da/d28/d30/f87 2943988 0 2024-04-03T08:39:27.666 INFO:tasks.workunit.client.0.smithi157.stdout:9/712: dread d1/d15/d16/f1e [0,4194304] 0 2024-04-03T08:39:27.667 INFO:tasks.workunit.client.1.smithi181.stdout:1/591: dwrite d10/d15/d4a/d6f/fa8 [0,4194304] 0 2024-04-03T08:39:27.667 INFO:tasks.workunit.client.0.smithi157.stdout:0/718: symlink d2/d9/d36/d38/l107 0 2024-04-03T08:39:27.668 INFO:tasks.workunit.client.1.smithi181.stdout:8/511: dwrite d4/d45/db/d14/fa6 [0,4194304] 0 2024-04-03T08:39:27.669 INFO:tasks.workunit.client.0.smithi157.stdout:0/719: fdatasync d2/d9/dc/df/d1b/d4a/fc4 0 2024-04-03T08:39:27.670 INFO:tasks.workunit.client.0.smithi157.stdout:8/736: mkdir d2/d11/d10/d24/dff 0 2024-04-03T08:39:27.670 INFO:tasks.workunit.client.1.smithi181.stdout:2/641: fdatasync d13/d1c/d4a/d7f/db3/f53 0 2024-04-03T08:39:27.670 INFO:tasks.workunit.client.1.smithi181.stdout:6/589: fsync d6/d31/f89 0 2024-04-03T08:39:27.673 INFO:tasks.workunit.client.1.smithi181.stdout:8/512: chown d4/d45/db/d5c/c98 147553742 1 2024-04-03T08:39:27.674 INFO:tasks.workunit.client.1.smithi181.stdout:5/567: unlink d4/d18/d55/d5a/f8f 0 2024-04-03T08:39:27.674 INFO:tasks.workunit.client.1.smithi181.stdout:2/642: readlink ld 0 2024-04-03T08:39:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:4/682: dwrite da/df/d24/d35/d6a/f77 [0,4194304] 0 2024-04-03T08:39:27.677 INFO:tasks.workunit.client.1.smithi181.stdout:9/619: dread - d1/da/d13/d22/d23/d36/d9c/fa7 zero size 2024-04-03T08:39:27.678 INFO:tasks.workunit.client.1.smithi181.stdout:0/543: mknod d5/dc/d14/ca9 0 2024-04-03T08:39:27.679 INFO:tasks.workunit.client.1.smithi181.stdout:8/513: write d4/fc [656986,78199] 0 2024-04-03T08:39:27.682 INFO:tasks.workunit.client.0.smithi157.stdout:1/654: dwrite d2/d11/d24/d39/d3b/d1b/fcd [0,4194304] 0 2024-04-03T08:39:27.686 INFO:tasks.workunit.client.1.smithi181.stdout:3/595: fdatasync d0/d5/d6/dd/d25/f44 0 2024-04-03T08:39:27.687 INFO:tasks.workunit.client.0.smithi157.stdout:1/655: chown d2/d11/d23/dc9/d58/lc7 88 1 2024-04-03T08:39:27.694 INFO:tasks.workunit.client.1.smithi181.stdout:4/614: rename d1/d16/d37/d34/db2 to d1/d16/d24/d5e/d3f/d6c/dcd 0 2024-04-03T08:39:27.700 INFO:tasks.workunit.client.0.smithi157.stdout:0/720: mknod d2/d9/d36/d38/d67/c108 0 2024-04-03T08:39:27.701 INFO:tasks.workunit.client.1.smithi181.stdout:2/643: mkdir d13/d1c/d4a/d68/dba/def 0 2024-04-03T08:39:27.702 INFO:tasks.workunit.client.0.smithi157.stdout:4/683: rmdir da/df/d24/d35/d6a/d76 39 2024-04-03T08:39:27.704 INFO:tasks.workunit.client.1.smithi181.stdout:5/568: symlink d4/d18/d25/d59/lb2 0 2024-04-03T08:39:27.707 INFO:tasks.workunit.client.1.smithi181.stdout:2/644: truncate d13/da7/d85/de4/fec 288757 0 2024-04-03T08:39:27.708 INFO:tasks.workunit.client.1.smithi181.stdout:0/544: mkdir d5/dc/d75/daa 0 2024-04-03T08:39:27.710 INFO:tasks.workunit.client.0.smithi157.stdout:2/719: write d3/f4e [1941885,23282] 0 2024-04-03T08:39:27.711 INFO:tasks.workunit.client.1.smithi181.stdout:9/620: fsync d1/da/d28/f64 0 2024-04-03T08:39:27.714 INFO:tasks.workunit.client.1.smithi181.stdout:3/596: stat d0/d5/f38 0 2024-04-03T08:39:27.715 INFO:tasks.workunit.client.1.smithi181.stdout:3/597: chown d0/d17/l3a 6802 1 2024-04-03T08:39:27.717 INFO:tasks.workunit.client.1.smithi181.stdout:1/592: rename d10/d15/c25 to d10/d15/d17/d19/d33/d70/cb9 0 2024-04-03T08:39:27.718 INFO:tasks.workunit.client.0.smithi157.stdout:4/684: dread da/f8b [0,4194304] 0 2024-04-03T08:39:27.721 INFO:tasks.workunit.client.1.smithi181.stdout:2/645: creat d13/d1c/da5/dac/ff0 x:0 0 0 2024-04-03T08:39:27.722 INFO:tasks.workunit.client.1.smithi181.stdout:3/598: truncate d0/d17/d63/d81/fc7 184525 0 2024-04-03T08:39:27.724 INFO:tasks.workunit.client.1.smithi181.stdout:0/545: mkdir d5/dc/d10/d30/dab 0 2024-04-03T08:39:27.724 INFO:tasks.workunit.client.0.smithi157.stdout:8/737: write d2/d6f/d70/fc0 [762998,99137] 0 2024-04-03T08:39:27.726 INFO:tasks.workunit.client.1.smithi181.stdout:1/593: chown d10/d15/d41/fad 1716518 1 2024-04-03T08:39:27.727 INFO:tasks.workunit.client.0.smithi157.stdout:4/685: link da/df/d99/ddb/fdc da/d26/ff0 0 2024-04-03T08:39:27.727 INFO:tasks.workunit.client.1.smithi181.stdout:1/594: stat fc 0 2024-04-03T08:39:27.728 INFO:tasks.workunit.client.1.smithi181.stdout:3/599: chown d0/d5/d6/dd/d25/c2b 24 1 2024-04-03T08:39:27.729 INFO:tasks.workunit.client.1.smithi181.stdout:9/621: rename d1/f35 to d1/da/d13/d41/daf/fbf 0 2024-04-03T08:39:27.729 INFO:tasks.workunit.client.0.smithi157.stdout:9/713: write d1/fe [1343566,28919] 0 2024-04-03T08:39:27.730 INFO:tasks.workunit.client.1.smithi181.stdout:5/569: dwrite d4/d18/d25/d59/d81/fa0 [0,4194304] 0 2024-04-03T08:39:27.733 INFO:tasks.workunit.client.0.smithi157.stdout:9/714: write d1/d4a/dc4/fd8 [7001469,68317] 0 2024-04-03T08:39:27.733 INFO:tasks.workunit.client.1.smithi181.stdout:3/600: write d0/d17/d36/d3b/d5a/f97 [61166,75685] 0 2024-04-03T08:39:27.734 INFO:tasks.workunit.client.0.smithi157.stdout:0/721: dread d2/d9/d51/d63/d71/fbc [0,4194304] 0 2024-04-03T08:39:27.735 INFO:tasks.workunit.client.0.smithi157.stdout:4/686: chown da/df/l85 52440 1 2024-04-03T08:39:27.739 INFO:tasks.workunit.client.1.smithi181.stdout:8/514: write d4/d45/db/f66 [584737,54874] 0 2024-04-03T08:39:27.748 INFO:tasks.workunit.client.1.smithi181.stdout:2/646: rename d13/d1c/d4a/d7f/f89 to d13/da7/d85/de4/ff1 0 2024-04-03T08:39:27.749 INFO:tasks.workunit.client.1.smithi181.stdout:2/647: truncate d13/d1c/fdf 452926 0 2024-04-03T08:39:27.750 INFO:tasks.workunit.client.0.smithi157.stdout:1/656: write d2/d11/d24/d39/d3b/d2e/f3e [616515,17431] 0 2024-04-03T08:39:27.751 INFO:tasks.workunit.client.1.smithi181.stdout:1/595: creat d10/d15/d17/d23/db0/d8d/fba x:0 0 0 2024-04-03T08:39:27.751 INFO:tasks.workunit.client.1.smithi181.stdout:4/615: write d1/d16/d24/d5e/d2b/d56/f71 [2071085,112476] 0 2024-04-03T08:39:27.752 INFO:tasks.workunit.client.0.smithi157.stdout:9/715: write d1/d15/d27/f45 [6097567,63256] 0 2024-04-03T08:39:27.752 INFO:tasks.workunit.client.1.smithi181.stdout:2/648: write d13/d1c/fdf [507523,20534] 0 2024-04-03T08:39:27.754 INFO:tasks.workunit.client.1.smithi181.stdout:2/649: chown d13/fc1 0 1 2024-04-03T08:39:27.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/570: rmdir d4/d18/d2c 39 2024-04-03T08:39:27.758 INFO:tasks.workunit.client.0.smithi157.stdout:1/657: truncate d2/d11/d23/d73/fd1 945009 0 2024-04-03T08:39:27.761 INFO:tasks.workunit.client.0.smithi157.stdout:2/720: dwrite d3/db/d44/d4c/d5a/d88/f96 [0,4194304] 0 2024-04-03T08:39:27.768 INFO:tasks.workunit.client.0.smithi157.stdout:4/687: dread da/fdd [0,4194304] 0 2024-04-03T08:39:27.771 INFO:tasks.workunit.client.1.smithi181.stdout:5/571: dwrite d4/d80/fa4 [0,4194304] 0 2024-04-03T08:39:27.773 INFO:tasks.workunit.client.0.smithi157.stdout:8/738: dwrite d2/d6f/d70/f7e [0,4194304] 0 2024-04-03T08:39:27.774 INFO:tasks.workunit.client.1.smithi181.stdout:2/650: creat d13/da7/d85/ff2 x:0 0 0 2024-04-03T08:39:27.776 INFO:tasks.workunit.client.1.smithi181.stdout:3/601: mknod d0/d17/d63/db7/cca 0 2024-04-03T08:39:27.780 INFO:tasks.workunit.client.1.smithi181.stdout:0/546: dwrite d5/dc/ff [0,4194304] 0 2024-04-03T08:39:27.781 INFO:tasks.workunit.client.1.smithi181.stdout:4/616: mkdir d1/dce 0 2024-04-03T08:39:27.784 INFO:tasks.workunit.client.1.smithi181.stdout:3/602: readlink d0/d17/d36/d3b/d5a/d85/laf 0 2024-04-03T08:39:27.785 INFO:tasks.workunit.client.1.smithi181.stdout:1/596: mknod d10/d15/d17/cbb 0 2024-04-03T08:39:27.789 INFO:tasks.workunit.client.1.smithi181.stdout:0/547: read d5/d9/d2c/f7a [1352246,86422] 0 2024-04-03T08:39:27.790 INFO:tasks.workunit.client.1.smithi181.stdout:5/572: mkdir d4/d18/d25/d59/db3 0 2024-04-03T08:39:27.790 INFO:tasks.workunit.client.1.smithi181.stdout:9/622: link d1/da/d13/l25 d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/lc0 0 2024-04-03T08:39:27.790 INFO:tasks.workunit.client.1.smithi181.stdout:0/548: fdatasync d5/fa3 0 2024-04-03T08:39:27.792 INFO:tasks.workunit.client.1.smithi181.stdout:5/573: stat d4/d22/f38 0 2024-04-03T08:39:27.795 INFO:tasks.workunit.client.1.smithi181.stdout:8/515: getdents d4/d2a/d37 0 2024-04-03T08:39:27.799 INFO:tasks.workunit.client.1.smithi181.stdout:5/574: dread - d4/d22/d53/f9a zero size 2024-04-03T08:39:27.799 INFO:tasks.workunit.client.1.smithi181.stdout:0/549: mknod d5/dc/d10/d30/d68/cac 0 2024-04-03T08:39:27.799 INFO:tasks.workunit.client.0.smithi157.stdout:2/721: mknod d3/da6/c100 0 2024-04-03T08:39:27.801 INFO:tasks.workunit.client.1.smithi181.stdout:9/623: mknod d1/da/d28/d30/d3e/d77/cc1 0 2024-04-03T08:39:27.804 INFO:tasks.workunit.client.0.smithi157.stdout:8/739: truncate d2/d20/f29 4589775 0 2024-04-03T08:39:27.804 INFO:tasks.workunit.client.1.smithi181.stdout:4/617: symlink d1/d16/d37/d34/d85/lcf 0 2024-04-03T08:39:27.804 INFO:tasks.workunit.client.0.smithi157.stdout:2/722: dread d3/d12/f24 [0,4194304] 0 2024-04-03T08:39:27.804 INFO:tasks.workunit.client.0.smithi157.stdout:0/722: rename d2/d9/d36/d38/d67 to d2/d9/d51/d63/d109 0 2024-04-03T08:39:27.805 INFO:tasks.workunit.client.1.smithi181.stdout:3/603: truncate d0/d5/d6/dd/f21 132461 0 2024-04-03T08:39:27.807 INFO:tasks.workunit.client.0.smithi157.stdout:0/723: chown d2/d9/f57 31016543 1 2024-04-03T08:39:27.808 INFO:tasks.workunit.client.0.smithi157.stdout:4/688: unlink da/df/d11/lc5 0 2024-04-03T08:39:27.811 INFO:tasks.workunit.client.1.smithi181.stdout:8/516: mknod d4/d45/dae/cb0 0 2024-04-03T08:39:27.811 INFO:tasks.workunit.client.0.smithi157.stdout:0/724: creat d2/d9/d5f/d105/f10a x:0 0 0 2024-04-03T08:39:27.814 INFO:tasks.workunit.client.0.smithi157.stdout:9/716: dread d1/d15/d27/f45 [0,4194304] 0 2024-04-03T08:39:27.816 INFO:tasks.workunit.client.1.smithi181.stdout:9/624: rename d1/da/d28/d30/d3e/d77/l8c to d1/da/d13/d22/d23/d36/d91/lc2 0 2024-04-03T08:39:27.818 INFO:tasks.workunit.client.0.smithi157.stdout:0/725: mkdir d2/d9/dc/df/d6f/d9d/d6a/d91/d10b 0 2024-04-03T08:39:27.819 INFO:tasks.workunit.client.1.smithi181.stdout:8/517: mkdir d4/d45/db/d14/d31/d1c/d51/d87/db1 0 2024-04-03T08:39:27.821 INFO:tasks.workunit.client.0.smithi157.stdout:0/726: dread - d2/d9/d5f/d105/f10a zero size 2024-04-03T08:39:27.822 INFO:tasks.workunit.client.1.smithi181.stdout:3/604: unlink d0/d5/d6/d32/d43/d6b/l83 0 2024-04-03T08:39:27.822 INFO:tasks.workunit.client.1.smithi181.stdout:8/518: fdatasync d4/d45/db/d14/d31/d1c/f85 0 2024-04-03T08:39:27.823 INFO:tasks.workunit.client.1.smithi181.stdout:4/618: dwrite d1/d16/dbc/fc1 [0,4194304] 0 2024-04-03T08:39:27.824 INFO:tasks.workunit.client.1.smithi181.stdout:8/519: dread - d4/d44/f8d zero size 2024-04-03T08:39:27.825 INFO:tasks.workunit.client.0.smithi157.stdout:9/717: creat d1/d15/d16/d9f/ff5 x:0 0 0 2024-04-03T08:39:27.828 INFO:tasks.workunit.client.0.smithi157.stdout:0/727: unlink d2/d9/dc/df/d1b/c1c 0 2024-04-03T08:39:27.829 INFO:tasks.workunit.client.1.smithi181.stdout:8/520: read d4/f27 [2356468,85728] 0 2024-04-03T08:39:27.829 INFO:tasks.workunit.client.0.smithi157.stdout:0/728: chown d2/d9 568 1 2024-04-03T08:39:27.832 INFO:tasks.workunit.client.1.smithi181.stdout:8/521: chown d4/d45/db/f3a 483419 1 2024-04-03T08:39:27.833 INFO:tasks.workunit.client.1.smithi181.stdout:3/605: truncate d0/d5/d6/f39 469137 0 2024-04-03T08:39:27.834 INFO:tasks.workunit.client.1.smithi181.stdout:9/625: mknod d1/da/d13/d41/d65/dbb/cc3 0 2024-04-03T08:39:27.834 INFO:tasks.workunit.client.1.smithi181.stdout:5/575: dread d4/d18/f28 [0,4194304] 0 2024-04-03T08:39:27.835 INFO:tasks.workunit.client.0.smithi157.stdout:0/729: chown d2/d9/d51/c7d 27998056 1 2024-04-03T08:39:27.836 INFO:tasks.workunit.client.1.smithi181.stdout:3/606: chown d0/d5/d6/l2d 246858532 1 2024-04-03T08:39:27.837 INFO:tasks.workunit.client.0.smithi157.stdout:0/730: chown d2/d9/dc/df/d1b/c74 70119 1 2024-04-03T08:39:27.837 INFO:tasks.workunit.client.1.smithi181.stdout:8/522: write d4/d44/d59/d5f/d6c/fa3 [710477,101328] 0 2024-04-03T08:39:27.838 INFO:tasks.workunit.client.0.smithi157.stdout:9/718: creat d1/d15/d27/ff6 x:0 0 0 2024-04-03T08:39:27.839 INFO:tasks.workunit.client.1.smithi181.stdout:3/607: truncate d0/d5/d6/f11 4746043 0 2024-04-03T08:39:27.841 INFO:tasks.workunit.client.1.smithi181.stdout:8/523: creat d4/d44/d59/fb2 x:0 0 0 2024-04-03T08:39:27.844 INFO:tasks.workunit.client.1.smithi181.stdout:5/576: rename d4/d18/d25/d59/d81 to d4/d18/d55/db4 0 2024-04-03T08:39:27.845 INFO:tasks.workunit.client.1.smithi181.stdout:8/524: chown d4/d45/db/d14/d31/d1c/d51/c7c 0 1 2024-04-03T08:39:27.846 INFO:tasks.workunit.client.0.smithi157.stdout:9/719: symlink d1/d36/lf7 0 2024-04-03T08:39:27.847 INFO:tasks.workunit.client.0.smithi157.stdout:0/731: symlink d2/d9/dc/df/d1b/d4a/de4/df1/df6/l10c 0 2024-04-03T08:39:27.848 INFO:tasks.workunit.client.0.smithi157.stdout:0/732: fdatasync d2/f2c 0 2024-04-03T08:39:27.855 INFO:tasks.workunit.client.0.smithi157.stdout:1/658: write d2/d11/d24/d39/f54 [3293697,39997] 0 2024-04-03T08:39:27.856 INFO:tasks.workunit.client.1.smithi181.stdout:1/597: write d10/d15/d17/d19/d33/f73 [201264,111709] 0 2024-04-03T08:39:27.856 INFO:tasks.workunit.client.1.smithi181.stdout:8/525: creat d4/d44/fb3 x:0 0 0 2024-04-03T08:39:27.857 INFO:tasks.workunit.client.0.smithi157.stdout:2/723: rmdir d3/da6 39 2024-04-03T08:39:27.858 INFO:tasks.workunit.client.1.smithi181.stdout:2/651: dwrite d13/d1c/f38 [0,4194304] 0 2024-04-03T08:39:27.859 INFO:tasks.workunit.client.0.smithi157.stdout:9/720: dread d1/d15/d16/f3a [0,4194304] 0 2024-04-03T08:39:27.861 INFO:tasks.workunit.client.0.smithi157.stdout:9/721: write d1/d15/d27/f32 [452854,37665] 0 2024-04-03T08:39:27.861 INFO:tasks.workunit.client.0.smithi157.stdout:2/724: mkdir d3/db/d44/d4c/df1/d101 0 2024-04-03T08:39:27.864 INFO:tasks.workunit.client.1.smithi181.stdout:9/626: dwrite d1/da/d28/d30/d3e/fa5 [0,4194304] 0 2024-04-03T08:39:27.865 INFO:tasks.workunit.client.1.smithi181.stdout:0/550: write d5/dc/d10/d58/d6c/f5d [185525,15914] 0 2024-04-03T08:39:27.866 INFO:tasks.workunit.client.0.smithi157.stdout:2/725: write d3/db/d44/d4c/d5a/d88/ffd [504944,20400] 0 2024-04-03T08:39:27.867 INFO:tasks.workunit.client.1.smithi181.stdout:1/598: readlink d10/d15/d17/lb3 0 2024-04-03T08:39:27.867 INFO:tasks.workunit.client.1.smithi181.stdout:5/577: dwrite d4/d56/fa5 [0,4194304] 0 2024-04-03T08:39:27.867 INFO:tasks.workunit.client.1.smithi181.stdout:2/652: stat d13/d1c/d4a/fdb 0 2024-04-03T08:39:27.867 INFO:tasks.workunit.client.0.smithi157.stdout:9/722: truncate d1/d4a/d4d/f80 2042492 0 2024-04-03T08:39:27.869 INFO:tasks.workunit.client.0.smithi157.stdout:9/723: dread - d1/d36/fee zero size 2024-04-03T08:39:27.869 INFO:tasks.workunit.client.1.smithi181.stdout:8/526: symlink d4/d45/db/d14/lb4 0 2024-04-03T08:39:27.872 INFO:tasks.workunit.client.1.smithi181.stdout:0/551: chown d5/dc/d14/d29/d46/f63 2987287 1 2024-04-03T08:39:27.876 INFO:tasks.workunit.client.1.smithi181.stdout:1/599: symlink d10/d15/d4b/lbc 0 2024-04-03T08:39:27.878 INFO:tasks.workunit.client.0.smithi157.stdout:4/689: dwrite da/df/d2f/d64/d8f/fd1 [0,4194304] 0 2024-04-03T08:39:27.883 INFO:tasks.workunit.client.0.smithi157.stdout:2/726: creat d3/f102 x:0 0 0 2024-04-03T08:39:27.884 INFO:tasks.workunit.client.1.smithi181.stdout:2/653: read - d13/d1c/d4a/d7f/db3/d8f/f93 zero size 2024-04-03T08:39:27.886 INFO:tasks.workunit.client.0.smithi157.stdout:9/724: creat d1/d15/d27/d34/da6/def/ff8 x:0 0 0 2024-04-03T08:39:27.889 INFO:tasks.workunit.client.1.smithi181.stdout:0/552: readlink d5/l6 0 2024-04-03T08:39:27.890 INFO:tasks.workunit.client.1.smithi181.stdout:4/619: write d1/d16/d37/d34/d85/fc9 [2709074,85389] 0 2024-04-03T08:39:27.892 INFO:tasks.workunit.client.0.smithi157.stdout:2/727: mkdir d3/d2e/d32/de3/d103 0 2024-04-03T08:39:27.894 INFO:tasks.workunit.client.0.smithi157.stdout:0/733: rmdir d2/d9/dc/df/d1b 39 2024-04-03T08:39:27.894 INFO:tasks.workunit.client.1.smithi181.stdout:2/654: chown d13/d1c/d4a/d7f/db3/d81/l92 25 1 2024-04-03T08:39:27.895 INFO:tasks.workunit.client.0.smithi157.stdout:0/734: read - d2/fef zero size 2024-04-03T08:39:27.897 INFO:tasks.workunit.client.1.smithi181.stdout:3/608: write d0/d17/d36/d1e/f31 [1895329,76969] 0 2024-04-03T08:39:27.902 INFO:tasks.workunit.client.1.smithi181.stdout:1/600: dwrite d10/d15/d17/d23/d27/f87 [0,4194304] 0 2024-04-03T08:39:27.903 INFO:tasks.workunit.client.0.smithi157.stdout:1/659: write d2/d11/d24/d39/d3b/d1b/d90/f93 [672195,96329] 0 2024-04-03T08:39:27.906 INFO:tasks.workunit.client.1.smithi181.stdout:2/655: dread - d13/d1c/f36 zero size 2024-04-03T08:39:27.910 INFO:tasks.workunit.client.1.smithi181.stdout:5/578: link d4/d18/d55/l67 d4/d22/lb5 0 2024-04-03T08:39:27.912 INFO:tasks.workunit.client.1.smithi181.stdout:5/579: chown d4/d56/fa5 34760215 1 2024-04-03T08:39:27.914 INFO:tasks.workunit.client.0.smithi157.stdout:0/735: creat d2/d9/dc/f10d x:0 0 0 2024-04-03T08:39:27.914 INFO:tasks.workunit.client.0.smithi157.stdout:0/736: readlink d2/lde 0 2024-04-03T08:39:27.917 INFO:tasks.workunit.client.1.smithi181.stdout:2/656: truncate d13/f19 1759379 0 2024-04-03T08:39:27.923 INFO:tasks.workunit.client.1.smithi181.stdout:5/580: mkdir d4/d22/d4a/dad/db6 0 2024-04-03T08:39:27.923 INFO:tasks.workunit.client.1.smithi181.stdout:2/657: write d13/da7/d85/fa8 [717752,116432] 0 2024-04-03T08:39:27.924 INFO:tasks.workunit.client.1.smithi181.stdout:6/590: sync 2024-04-03T08:39:27.924 INFO:tasks.workunit.client.1.smithi181.stdout:7/512: sync 2024-04-03T08:39:27.926 INFO:tasks.workunit.client.1.smithi181.stdout:3/609: getdents d0/d17/d63/db7 0 2024-04-03T08:39:27.930 INFO:tasks.workunit.client.1.smithi181.stdout:9/627: dread d1/da/d13/d41/d32/f3f [0,4194304] 0 2024-04-03T08:39:27.930 INFO:tasks.workunit.client.1.smithi181.stdout:7/513: stat d0/d1/d6/de/d17/c3f 0 2024-04-03T08:39:27.931 INFO:tasks.workunit.client.1.smithi181.stdout:0/553: dwrite d5/d9/d2a/f64 [0,4194304] 0 2024-04-03T08:39:27.936 INFO:tasks.workunit.client.1.smithi181.stdout:4/620: dwrite d1/d16/d24/d5e/d2b/d56/f71 [0,4194304] 0 2024-04-03T08:39:27.936 INFO:tasks.workunit.client.1.smithi181.stdout:5/581: link d4/d56/fa5 d4/fb7 0 2024-04-03T08:39:27.937 INFO:tasks.workunit.client.1.smithi181.stdout:2/658: rename d13/d1c/d4a/d68/d72/fc8 to d13/d1c/da5/dac/ff3 0 2024-04-03T08:39:27.938 INFO:tasks.workunit.client.1.smithi181.stdout:6/591: mknod d6/d3e/d5e/d7c/d50/cb8 0 2024-04-03T08:39:27.941 INFO:tasks.workunit.client.1.smithi181.stdout:0/554: chown d5/dc/d10/f8f 192 1 2024-04-03T08:39:27.945 INFO:tasks.workunit.client.1.smithi181.stdout:2/659: chown d13/da7/d27/d2f/d5d/cad 383981205 1 2024-04-03T08:39:27.948 INFO:tasks.workunit.client.1.smithi181.stdout:3/610: rename d0/d5/d6/d32/f7c to d0/d5/d6/dd/d25/d50/fcb 0 2024-04-03T08:39:27.953 INFO:tasks.workunit.client.1.smithi181.stdout:0/555: link d5/dc/d10/d58/d6c/f5d d5/d9/d2c/fad 0 2024-04-03T08:39:27.953 INFO:tasks.workunit.client.1.smithi181.stdout:6/592: creat d6/d31/fb9 x:0 0 0 2024-04-03T08:39:27.954 INFO:tasks.workunit.client.1.smithi181.stdout:3/611: symlink d0/d5/d6/dd/lcc 0 2024-04-03T08:39:27.955 INFO:tasks.workunit.client.1.smithi181.stdout:2/660: creat d13/da7/d85/ff4 x:0 0 0 2024-04-03T08:39:27.955 INFO:tasks.workunit.client.0.smithi157.stdout:9/725: getdents d1/d15/d27/d34/da6/def 0 2024-04-03T08:39:27.957 INFO:tasks.workunit.client.0.smithi157.stdout:2/728: write d3/db/d44/f61 [1832687,90507] 0 2024-04-03T08:39:27.958 INFO:tasks.workunit.client.0.smithi157.stdout:9/726: symlink d1/d15/d27/d5c/d79/lf9 0 2024-04-03T08:39:27.961 INFO:tasks.workunit.client.0.smithi157.stdout:9/727: unlink d1/l6a 0 2024-04-03T08:39:27.962 INFO:tasks.workunit.client.1.smithi181.stdout:0/556: symlink d5/d9/d2e/lae 0 2024-04-03T08:39:27.962 INFO:tasks.workunit.client.0.smithi157.stdout:2/729: fsync d3/db/d44/d4c/d5a/fd4 0 2024-04-03T08:39:27.966 INFO:tasks.workunit.client.0.smithi157.stdout:9/728: truncate d1/f33 2732993 0 2024-04-03T08:39:27.966 INFO:tasks.workunit.client.0.smithi157.stdout:1/660: truncate d2/d11/d23/dc9/d64/f85 7745969 0 2024-04-03T08:39:27.967 INFO:tasks.workunit.client.1.smithi181.stdout:4/621: truncate d1/d16/d24/d5e/f53 817674 0 2024-04-03T08:39:27.969 INFO:tasks.workunit.client.0.smithi157.stdout:9/729: write d1/d15/d27/d5c/d79/f7c [3559779,124279] 0 2024-04-03T08:39:27.970 INFO:tasks.workunit.client.1.smithi181.stdout:8/527: dwrite d4/d45/f71 [0,4194304] 0 2024-04-03T08:39:27.972 INFO:tasks.workunit.client.1.smithi181.stdout:3/612: read d0/d5/d77/f8f [3057510,74775] 0 2024-04-03T08:39:27.972 INFO:tasks.workunit.client.0.smithi157.stdout:4/690: dread da/df/d24/f59 [0,4194304] 0 2024-04-03T08:39:27.975 INFO:tasks.workunit.client.1.smithi181.stdout:6/593: rename d6/d3e/d5e/d7c/d9/d7f to d6/d31/d36/dba 0 2024-04-03T08:39:27.975 INFO:tasks.workunit.client.0.smithi157.stdout:1/661: creat d2/d11/d23/dc9/d58/d62/fd4 x:0 0 0 2024-04-03T08:39:27.977 INFO:tasks.workunit.client.1.smithi181.stdout:2/661: mkdir d13/da7/d40/df5 0 2024-04-03T08:39:27.978 INFO:tasks.workunit.client.0.smithi157.stdout:1/662: stat d2/d11/d23/dc9/da1 0 2024-04-03T08:39:27.979 INFO:tasks.workunit.client.0.smithi157.stdout:0/737: dwrite d2/d9/d51/d63/d71/fbc [0,4194304] 0 2024-04-03T08:39:27.981 INFO:tasks.workunit.client.0.smithi157.stdout:4/691: rmdir da/d7e 39 2024-04-03T08:39:27.982 INFO:tasks.workunit.client.1.smithi181.stdout:9/628: write d1/da/d1a/f27 [1947888,7241] 0 2024-04-03T08:39:27.983 INFO:tasks.workunit.client.0.smithi157.stdout:9/730: fdatasync d1/d15/f63 0 2024-04-03T08:39:27.983 INFO:tasks.workunit.client.1.smithi181.stdout:0/557: unlink d5/dc/c3b 0 2024-04-03T08:39:27.984 INFO:tasks.workunit.client.0.smithi157.stdout:9/731: stat d1/d15/d16/l2c 0 2024-04-03T08:39:27.985 INFO:tasks.workunit.client.0.smithi157.stdout:9/732: readlink d1/l3d 0 2024-04-03T08:39:27.985 INFO:tasks.workunit.client.1.smithi181.stdout:5/582: write d4/ff [321947,8989] 0 2024-04-03T08:39:27.986 INFO:tasks.workunit.client.0.smithi157.stdout:9/733: chown d1/d36/d46/lf1 5 1 2024-04-03T08:39:27.986 INFO:tasks.workunit.client.0.smithi157.stdout:9/734: dread - d1/fa5 zero size 2024-04-03T08:39:27.998 INFO:tasks.workunit.client.1.smithi181.stdout:0/558: fsync d5/dc/d75/f91 0 2024-04-03T08:39:28.000 INFO:tasks.workunit.client.1.smithi181.stdout:1/601: dread d10/d15/d41/f44 [0,4194304] 0 2024-04-03T08:39:28.003 INFO:tasks.workunit.client.1.smithi181.stdout:7/514: dwrite d0/d1/d6/de/d17/f55 [0,4194304] 0 2024-04-03T08:39:28.006 INFO:tasks.workunit.client.1.smithi181.stdout:1/602: readlink d10/d15/d17/d30/l8f 0 2024-04-03T08:39:28.012 INFO:tasks.workunit.client.1.smithi181.stdout:9/629: dwrite d1/f20 [0,4194304] 0 2024-04-03T08:39:28.015 INFO:tasks.workunit.client.1.smithi181.stdout:6/594: dwrite d6/d3e/d5e/d7c/d50/d5b/f9d [0,4194304] 0 2024-04-03T08:39:28.016 INFO:tasks.workunit.client.1.smithi181.stdout:9/630: chown d1/da/d13/d22/f2e 157806 1 2024-04-03T08:39:28.030 INFO:tasks.workunit.client.0.smithi157.stdout:7/763: sync 2024-04-03T08:39:28.031 INFO:tasks.workunit.client.0.smithi157.stdout:3/673: sync 2024-04-03T08:39:28.035 INFO:tasks.workunit.client.1.smithi181.stdout:3/613: mknod d0/d17/d36/d3b/d5a/d85/ccd 0 2024-04-03T08:39:28.036 INFO:tasks.workunit.client.0.smithi157.stdout:0/738: readlink d2/d9/dc/l24 0 2024-04-03T08:39:28.040 INFO:tasks.workunit.client.1.smithi181.stdout:8/528: rename d4/d45/db/d14/f2d to d4/d45/db/d14/fb5 0 2024-04-03T08:39:28.041 INFO:tasks.workunit.client.0.smithi157.stdout:4/692: symlink da/df/d2f/d54/lf1 0 2024-04-03T08:39:28.047 INFO:tasks.workunit.client.0.smithi157.stdout:1/663: mkdir d2/d11/d24/dd5 0 2024-04-03T08:39:28.051 INFO:tasks.workunit.client.1.smithi181.stdout:2/662: rename d13/d1c/c80 to d13/d1c/d4a/d7f/cf6 0 2024-04-03T08:39:28.053 INFO:tasks.workunit.client.0.smithi157.stdout:7/764: creat d0/d11/d15/d17/d52/f10a x:0 0 0 2024-04-03T08:39:28.054 INFO:tasks.workunit.client.0.smithi157.stdout:3/674: symlink d8/d1e/d2d/d3b/d8c/db4/leb 0 2024-04-03T08:39:28.057 INFO:tasks.workunit.client.0.smithi157.stdout:0/739: chown d2/d9/dc/df/d1b/d35/d3d/f99 89 1 2024-04-03T08:39:28.058 INFO:tasks.workunit.client.1.smithi181.stdout:0/559: fdatasync d5/d9/f97 0 2024-04-03T08:39:28.059 INFO:tasks.workunit.client.0.smithi157.stdout:9/735: mkdir d1/dab/dad/dfa 0 2024-04-03T08:39:28.060 INFO:tasks.workunit.client.0.smithi157.stdout:9/736: fsync d1/f5 0 2024-04-03T08:39:28.061 INFO:tasks.workunit.client.1.smithi181.stdout:7/515: write d0/d1/d6/de/f52 [5163669,12293] 0 2024-04-03T08:39:28.062 INFO:tasks.workunit.client.1.smithi181.stdout:1/603: rmdir d10/d15/d17/d23/db0 39 2024-04-03T08:39:28.063 INFO:tasks.workunit.client.0.smithi157.stdout:1/664: rename d2/d11/d23/dc9/l7b to d2/d11/d23/ld6 0 2024-04-03T08:39:28.066 INFO:tasks.workunit.client.0.smithi157.stdout:7/765: rmdir d0/d11/d15/d17/d1c/d4f/d5f 39 2024-04-03T08:39:28.067 INFO:tasks.workunit.client.1.smithi181.stdout:6/595: creat d6/d31/d36/dba/da6/fbb x:0 0 0 2024-04-03T08:39:28.067 INFO:tasks.workunit.client.1.smithi181.stdout:6/596: fsync d6/d53/f94 0 2024-04-03T08:39:28.067 INFO:tasks.workunit.client.1.smithi181.stdout:9/631: symlink d1/da/d13/d22/d23/d36/d91/lc4 0 2024-04-03T08:39:28.069 INFO:tasks.workunit.client.1.smithi181.stdout:6/597: chown d6/d31/d36/dba/fae 1013 1 2024-04-03T08:39:28.073 INFO:tasks.workunit.client.0.smithi157.stdout:9/737: fdatasync d1/f93 0 2024-04-03T08:39:28.078 INFO:tasks.workunit.client.1.smithi181.stdout:5/583: creat d4/d18/d25/d59/db3/fb8 x:0 0 0 2024-04-03T08:39:28.080 INFO:tasks.workunit.client.0.smithi157.stdout:0/740: rename d2/d9/d51/fca to d2/d9/dc/df/d1b/d4a/de4/df1/f10e 0 2024-04-03T08:39:28.081 INFO:tasks.workunit.client.0.smithi157.stdout:0/741: stat d2/d9/dc/df/d6f/ccf 0 2024-04-03T08:39:28.084 INFO:tasks.workunit.client.1.smithi181.stdout:7/516: dread d0/d1/d6/de/d17/f4c [0,4194304] 0 2024-04-03T08:39:28.088 INFO:tasks.workunit.client.1.smithi181.stdout:0/560: write d5/dc/d10/f8f [1525268,8936] 0 2024-04-03T08:39:28.091 INFO:tasks.workunit.client.0.smithi157.stdout:7/766: dread d0/d11/d15/d17/d1c/f28 [0,4194304] 0 2024-04-03T08:39:28.094 INFO:tasks.workunit.client.1.smithi181.stdout:6/598: unlink d6/d3e/d5e/d7c/d50/f54 0 2024-04-03T08:39:28.095 INFO:tasks.workunit.client.1.smithi181.stdout:3/614: write d0/d17/d36/d1e/f49 [2908552,88607] 0 2024-04-03T08:39:28.096 INFO:tasks.workunit.client.0.smithi157.stdout:4/693: truncate da/df/d24/d35/d6a/d78/f93 855992 0 2024-04-03T08:39:28.099 INFO:tasks.workunit.client.1.smithi181.stdout:4/622: dwrite d1/d16/d24/d5e/d31/d39/fbb [0,4194304] 0 2024-04-03T08:39:28.101 INFO:tasks.workunit.client.1.smithi181.stdout:2/663: write d13/da7/d40/f6a [1011645,61515] 0 2024-04-03T08:39:28.103 INFO:tasks.workunit.client.0.smithi157.stdout:0/742: fsync d2/d9/dc/d54/f75 0 2024-04-03T08:39:28.103 INFO:tasks.workunit.client.0.smithi157.stdout:3/675: truncate d8/f2c 1362761 0 2024-04-03T08:39:28.105 INFO:tasks.workunit.client.1.smithi181.stdout:1/604: write d10/d15/d17/d19/d33/f72 [309581,96439] 0 2024-04-03T08:39:28.108 INFO:tasks.workunit.client.0.smithi157.stdout:9/738: dwrite d1/d94/dbe/dbf/fc2 [4194304,4194304] 0 2024-04-03T08:39:28.108 INFO:tasks.workunit.client.1.smithi181.stdout:0/561: read d5/dc/f71 [538389,37644] 0 2024-04-03T08:39:28.110 INFO:tasks.workunit.client.1.smithi181.stdout:0/562: stat d5/dc/d14/d29/l7d 0 2024-04-03T08:39:28.113 INFO:tasks.workunit.client.0.smithi157.stdout:1/665: link d2/d11/d23/dc9/d58/d62/d74/cab d2/d11/d23/dc9/d58/cd7 0 2024-04-03T08:39:28.113 INFO:tasks.workunit.client.0.smithi157.stdout:7/767: dwrite d0/d11/d15/d17/d43/fb7 [0,4194304] 0 2024-04-03T08:39:28.116 INFO:tasks.workunit.client.1.smithi181.stdout:3/615: rmdir d0/d57 39 2024-04-03T08:39:28.126 INFO:tasks.workunit.client.0.smithi157.stdout:0/743: creat d2/d9/dc/df/d6f/d9d/d6a/d91/dae/f10f x:0 0 0 2024-04-03T08:39:28.126 INFO:tasks.workunit.client.0.smithi157.stdout:3/676: fdatasync d8/f2c 0 2024-04-03T08:39:28.130 INFO:tasks.workunit.client.0.smithi157.stdout:1/666: dread - d2/d11/d24/fb2 zero size 2024-04-03T08:39:28.131 INFO:tasks.workunit.client.1.smithi181.stdout:2/664: dread - d13/da7/f7d zero size 2024-04-03T08:39:28.131 INFO:tasks.workunit.client.0.smithi157.stdout:7/768: creat d0/d11/d15/d17/d1c/f10b x:0 0 0 2024-04-03T08:39:28.134 INFO:tasks.workunit.client.0.smithi157.stdout:0/744: readlink d2/d9/dc/df/d1b/d4a/d31/lcb 0 2024-04-03T08:39:28.135 INFO:tasks.workunit.client.1.smithi181.stdout:1/605: symlink d10/d15/d17/d19/d33/lbd 0 2024-04-03T08:39:28.135 INFO:tasks.workunit.client.0.smithi157.stdout:4/694: dwrite da/f1e [0,4194304] 0 2024-04-03T08:39:28.136 INFO:tasks.workunit.client.0.smithi157.stdout:9/739: dread d1/d15/d27/f45 [0,4194304] 0 2024-04-03T08:39:28.138 INFO:tasks.workunit.client.1.smithi181.stdout:1/606: write d10/d15/d17/d19/d33/fb2 [1079386,92085] 0 2024-04-03T08:39:28.140 INFO:tasks.workunit.client.1.smithi181.stdout:8/529: rename d4/d45/db/d14/d31/d1c/d51/d87/l9f to d4/d45/lb6 0 2024-04-03T08:39:28.141 INFO:tasks.workunit.client.0.smithi157.stdout:9/740: stat d1/d4a/d4d/d86/dd5 0 2024-04-03T08:39:28.142 INFO:tasks.workunit.client.1.smithi181.stdout:4/623: link d1/f92 d1/d16/d37/d34/d69/fd0 0 2024-04-03T08:39:28.143 INFO:tasks.workunit.client.0.smithi157.stdout:7/769: fdatasync d0/d11/d15/d17/d43/f45 0 2024-04-03T08:39:28.145 INFO:tasks.workunit.client.1.smithi181.stdout:9/632: getdents d1/da/d13/d22/d23/d54 0 2024-04-03T08:39:28.145 INFO:tasks.workunit.client.1.smithi181.stdout:6/599: dread - d6/d31/d36/dba/da6/f88 zero size 2024-04-03T08:39:28.145 INFO:tasks.workunit.client.0.smithi157.stdout:1/667: creat d2/d11/d24/d39/d3b/d2e/d66/fd8 x:0 0 0 2024-04-03T08:39:28.146 INFO:tasks.workunit.client.1.smithi181.stdout:0/563: symlink d5/dc/d10/d30/dab/laf 0 2024-04-03T08:39:28.148 INFO:tasks.workunit.client.1.smithi181.stdout:4/624: chown d1/d16/d24/d5e/d31/d39/da1 54803 1 2024-04-03T08:39:28.151 INFO:tasks.workunit.client.1.smithi181.stdout:7/517: rename d0/c75 to d0/d1/d6/de/d17/d64/d85/d87/cb8 0 2024-04-03T08:39:28.153 INFO:tasks.workunit.client.0.smithi157.stdout:3/677: truncate d8/d1e/d2d/d30/fba 283477 0 2024-04-03T08:39:28.154 INFO:tasks.workunit.client.1.smithi181.stdout:1/607: symlink d10/d15/d17/d19/d4c/lbe 0 2024-04-03T08:39:28.155 INFO:tasks.workunit.client.0.smithi157.stdout:9/741: rmdir d1/d4a 39 2024-04-03T08:39:28.159 INFO:tasks.workunit.client.1.smithi181.stdout:3/616: creat d0/d5/d6/fce x:0 0 0 2024-04-03T08:39:28.162 INFO:tasks.workunit.client.1.smithi181.stdout:9/633: write d1/da/d1a/f4c [2230772,17833] 0 2024-04-03T08:39:28.162 INFO:tasks.workunit.client.1.smithi181.stdout:5/584: dwrite d4/d18/f65 [0,4194304] 0 2024-04-03T08:39:28.164 INFO:tasks.workunit.client.0.smithi157.stdout:1/668: symlink d2/d11/d24/d39/d3b/d1b/d7f/ld9 0 2024-04-03T08:39:28.165 INFO:tasks.workunit.client.1.smithi181.stdout:6/600: dwrite d6/d31/d36/f4c [4194304,4194304] 0 2024-04-03T08:39:28.166 INFO:tasks.workunit.client.0.smithi157.stdout:3/678: dread - d8/d1e/d2d/d3f/d4d/f9a zero size 2024-04-03T08:39:28.166 INFO:tasks.workunit.client.1.smithi181.stdout:4/625: creat d1/d1e/d78/fd1 x:0 0 0 2024-04-03T08:39:28.167 INFO:tasks.workunit.client.1.smithi181.stdout:0/564: mkdir d5/dc/d10/d58/db0 0 2024-04-03T08:39:28.169 INFO:tasks.workunit.client.1.smithi181.stdout:2/665: rename d13/da7/d85/dbd/ce8 to d13/d1c/d4a/d68/d72/da1/cf7 0 2024-04-03T08:39:28.175 INFO:tasks.workunit.client.0.smithi157.stdout:7/770: creat d0/d11/d6f/d89/d8c/deb/f10c x:0 0 0 2024-04-03T08:39:28.175 INFO:tasks.workunit.client.0.smithi157.stdout:4/695: dwrite da/df/d2f/d54/f5a [0,4194304] 0 2024-04-03T08:39:28.177 INFO:tasks.workunit.client.1.smithi181.stdout:1/608: fsync d10/d15/d17/d37/f54 0 2024-04-03T08:39:28.178 INFO:tasks.workunit.client.0.smithi157.stdout:0/745: write d2/d9/dc/df/d1b/d35/f56 [3225791,109122] 0 2024-04-03T08:39:28.183 INFO:tasks.workunit.client.0.smithi157.stdout:0/746: chown d2/d9/dc/df 8 1 2024-04-03T08:39:28.184 INFO:tasks.workunit.client.0.smithi157.stdout:3/679: mkdir d8/d13/d1b/dc4/dec 0 2024-04-03T08:39:28.184 INFO:tasks.workunit.client.0.smithi157.stdout:0/747: stat d2/c10 0 2024-04-03T08:39:28.187 INFO:tasks.workunit.client.1.smithi181.stdout:9/634: mknod d1/da/d28/d30/d3e/cc5 0 2024-04-03T08:39:28.190 INFO:tasks.workunit.client.1.smithi181.stdout:9/635: dread - d1/da/d13/d41/d65/fa6 zero size 2024-04-03T08:39:28.191 INFO:tasks.workunit.client.1.smithi181.stdout:4/626: mkdir d1/d1e/d2c/dd2 0 2024-04-03T08:39:28.192 INFO:tasks.workunit.client.1.smithi181.stdout:0/565: fdatasync d5/dc/d14/f3c 0 2024-04-03T08:39:28.193 INFO:tasks.workunit.client.1.smithi181.stdout:6/601: readlink d6/d31/d36/dba/da6/d4f/lad 0 2024-04-03T08:39:28.196 INFO:tasks.workunit.client.1.smithi181.stdout:7/518: fsync d0/d1/d6/de/d17/d64/d85/d9a/da4/fab 0 2024-04-03T08:39:28.199 INFO:tasks.workunit.client.0.smithi157.stdout:5/755: sync 2024-04-03T08:39:28.199 INFO:tasks.workunit.client.0.smithi157.stdout:6/747: sync 2024-04-03T08:39:28.199 INFO:tasks.workunit.client.0.smithi157.stdout:8/740: sync 2024-04-03T08:39:28.200 INFO:tasks.workunit.client.1.smithi181.stdout:2/666: creat d13/d1c/d73/d8b/ff8 x:0 0 0 2024-04-03T08:39:28.205 INFO:tasks.workunit.client.0.smithi157.stdout:7/771: mknod d0/d11/d6f/d89/c10d 0 2024-04-03T08:39:28.207 INFO:tasks.workunit.client.1.smithi181.stdout:7/519: dread d0/d1/d6/de/d17/f4c [0,4194304] 0 2024-04-03T08:39:28.209 INFO:tasks.workunit.client.0.smithi157.stdout:9/742: dwrite d1/d36/f71 [0,4194304] 0 2024-04-03T08:39:28.209 INFO:tasks.workunit.client.1.smithi181.stdout:9/636: read d1/da/d28/d30/f6a [3506278,80384] 0 2024-04-03T08:39:28.213 INFO:tasks.workunit.client.0.smithi157.stdout:8/741: chown d2/f99 502435 1 2024-04-03T08:39:28.213 INFO:tasks.workunit.client.1.smithi181.stdout:9/637: stat d1/da/d28/d30/d3e/d4e/da3 0 2024-04-03T08:39:28.214 INFO:tasks.workunit.client.1.smithi181.stdout:6/602: read d6/d31/f6b [104889,29868] 0 2024-04-03T08:39:28.215 INFO:tasks.workunit.client.0.smithi157.stdout:5/756: unlink dc/f62 0 2024-04-03T08:39:28.216 INFO:tasks.workunit.client.0.smithi157.stdout:1/669: dwrite d2/f96 [0,4194304] 0 2024-04-03T08:39:28.218 INFO:tasks.workunit.client.0.smithi157.stdout:5/757: chown dc/d29/d56/fb4 8337 1 2024-04-03T08:39:28.220 INFO:tasks.workunit.client.0.smithi157.stdout:1/670: dread - d2/d11/d24/d39/d3b/d2e/d66/fce zero size 2024-04-03T08:39:28.220 INFO:tasks.workunit.client.0.smithi157.stdout:0/748: creat d2/d9/f110 x:0 0 0 2024-04-03T08:39:28.221 INFO:tasks.workunit.client.1.smithi181.stdout:8/530: getdents d4/d45/db/d14/d31 0 2024-04-03T08:39:28.222 INFO:tasks.workunit.client.0.smithi157.stdout:3/680: creat d8/d1e/d2d/d39/d51/fed x:0 0 0 2024-04-03T08:39:28.224 INFO:tasks.workunit.client.0.smithi157.stdout:7/772: dread - d0/d11/d15/d17/dca/fd8 zero size 2024-04-03T08:39:28.224 INFO:tasks.workunit.client.1.smithi181.stdout:3/617: creat d0/d17/fcf x:0 0 0 2024-04-03T08:39:28.225 INFO:tasks.workunit.client.1.smithi181.stdout:4/627: dread d1/d16/d37/d34/d85/fc9 [0,4194304] 0 2024-04-03T08:39:28.229 INFO:tasks.workunit.client.1.smithi181.stdout:5/585: creat d4/d18/fb9 x:0 0 0 2024-04-03T08:39:28.231 INFO:tasks.workunit.client.0.smithi157.stdout:5/758: rmdir dc/d29/d56/d2e 39 2024-04-03T08:39:28.231 INFO:tasks.workunit.client.1.smithi181.stdout:0/566: dwrite d5/d9/f32 [0,4194304] 0 2024-04-03T08:39:28.233 INFO:tasks.workunit.client.0.smithi157.stdout:5/759: chown dc/d29/f91 26643 1 2024-04-03T08:39:28.234 INFO:tasks.workunit.client.0.smithi157.stdout:9/743: creat d1/d4a/d4d/da4/ffb x:0 0 0 2024-04-03T08:39:28.245 INFO:tasks.workunit.client.0.smithi157.stdout:6/748: mkdir d1/d5/d17/d29/da7/db9/dfb 0 2024-04-03T08:39:28.249 INFO:tasks.workunit.client.1.smithi181.stdout:7/520: mkdir d0/d1/d6/db9 0 2024-04-03T08:39:28.249 INFO:tasks.workunit.client.0.smithi157.stdout:4/696: getdents da/df/d24/d35/d6a/d76 0 2024-04-03T08:39:28.252 INFO:tasks.workunit.client.1.smithi181.stdout:9/638: write d1/da/d13/d22/d23/d36/d9c/fbd [3180423,16729] 0 2024-04-03T08:39:28.253 INFO:tasks.workunit.client.1.smithi181.stdout:9/639: chown d1/da/fae 5519869 1 2024-04-03T08:39:28.259 INFO:tasks.workunit.client.1.smithi181.stdout:5/586: rename d4/d18/d25/d59/lb2 to d4/d22/d4a/lba 0 2024-04-03T08:39:28.264 INFO:tasks.workunit.client.1.smithi181.stdout:2/667: dwrite d13/f19 [0,4194304] 0 2024-04-03T08:39:28.267 INFO:tasks.workunit.client.0.smithi157.stdout:5/760: dwrite dc/d29/d56/d18/f3a [4194304,4194304] 0 2024-04-03T08:39:28.268 INFO:tasks.workunit.client.0.smithi157.stdout:6/749: unlink d1/d5/d17/d2a/f82 0 2024-04-03T08:39:28.273 INFO:tasks.workunit.client.0.smithi157.stdout:0/749: dwrite d2/d9/dc/df/f8a [0,4194304] 0 2024-04-03T08:39:28.275 INFO:tasks.workunit.client.0.smithi157.stdout:9/744: dwrite d1/d15/d27/d5c/faa [0,4194304] 0 2024-04-03T08:39:28.276 INFO:tasks.workunit.client.0.smithi157.stdout:4/697: rename da/df/d11/c1c to da/df/d2f/d97/dd6/cf2 0 2024-04-03T08:39:28.281 INFO:tasks.workunit.client.0.smithi157.stdout:0/750: readlink d2/d9/dc/df/l11 0 2024-04-03T08:39:28.281 INFO:tasks.workunit.client.0.smithi157.stdout:8/742: link d2/d11/d10/d24/c40 d2/d6f/d70/d89/c100 0 2024-04-03T08:39:28.282 INFO:tasks.workunit.client.0.smithi157.stdout:7/773: dwrite d0/d11/d6f/d76/da7/f3a [4194304,4194304] 0 2024-04-03T08:39:28.283 INFO:tasks.workunit.client.1.smithi181.stdout:4/628: getdents d1/d16/d24/d5e/d31/dba 0 2024-04-03T08:39:28.283 INFO:tasks.workunit.client.0.smithi157.stdout:1/671: getdents d2/d11/d23/dc9/d5d/d9a 0 2024-04-03T08:39:28.284 INFO:tasks.workunit.client.0.smithi157.stdout:3/681: dread d8/d1e/d2d/d39/d51/d48/f63 [0,4194304] 0 2024-04-03T08:39:28.285 INFO:tasks.workunit.client.1.smithi181.stdout:9/640: mkdir d1/da/d28/d80/dc6 0 2024-04-03T08:39:28.290 INFO:tasks.workunit.client.0.smithi157.stdout:9/745: unlink d1/d36/d69/f7f 0 2024-04-03T08:39:28.291 INFO:tasks.workunit.client.1.smithi181.stdout:9/641: write d1/da/d13/d22/f31 [5063277,109948] 0 2024-04-03T08:39:28.292 INFO:tasks.workunit.client.1.smithi181.stdout:2/668: mkdir d13/d1c/d4a/d68/d72/da1/df9 0 2024-04-03T08:39:28.293 INFO:tasks.workunit.client.1.smithi181.stdout:6/603: dwrite d6/d3e/d40/f4e [0,4194304] 0 2024-04-03T08:39:28.295 INFO:tasks.workunit.client.1.smithi181.stdout:7/521: mknod d0/d1/d6/db9/cba 0 2024-04-03T08:39:28.296 INFO:tasks.workunit.client.0.smithi157.stdout:8/743: mknod d2/d6f/c101 0 2024-04-03T08:39:28.296 INFO:tasks.workunit.client.0.smithi157.stdout:2/730: sync 2024-04-03T08:39:28.298 INFO:tasks.workunit.client.1.smithi181.stdout:0/567: link d5/d9/d60/fa6 d5/dc/d10/d30/fb1 0 2024-04-03T08:39:28.299 INFO:tasks.workunit.client.0.smithi157.stdout:0/751: rmdir d2/d9/dc/df 39 2024-04-03T08:39:28.299 INFO:tasks.workunit.client.0.smithi157.stdout:7/774: truncate d0/d11/d15/f87 28510 0 2024-04-03T08:39:28.302 INFO:tasks.workunit.client.1.smithi181.stdout:0/568: read - d5/dc/d10/f86 zero size 2024-04-03T08:39:28.302 INFO:tasks.workunit.client.0.smithi157.stdout:9/746: creat d1/d15/dca/ffc x:0 0 0 2024-04-03T08:39:28.306 INFO:tasks.workunit.client.0.smithi157.stdout:4/698: creat da/df/d24/d35/d53/ff3 x:0 0 0 2024-04-03T08:39:28.308 INFO:tasks.workunit.client.1.smithi181.stdout:8/531: getdents d4/d45/db/d14 0 2024-04-03T08:39:28.308 INFO:tasks.workunit.client.1.smithi181.stdout:3/618: getdents d0/d5/d6/dd/d5f 0 2024-04-03T08:39:28.312 INFO:tasks.workunit.client.0.smithi157.stdout:2/731: stat d3/d12/fe 0 2024-04-03T08:39:28.315 INFO:tasks.workunit.client.0.smithi157.stdout:9/747: read d1/d15/d16/f98 [4425631,47427] 0 2024-04-03T08:39:28.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:27 smithi157 ceph-mon[35083]: Standby manager daemon smithi157.qfvynr started 2024-04-03T08:39:28.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/crt"}]: dispatch 2024-04-03T08:39:28.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:39:28.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/key"}]: dispatch 2024-04-03T08:39:28.316 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:39:28.317 INFO:tasks.workunit.client.0.smithi157.stdout:1/672: creat d2/d11/d23/dc9/d58/d94/da3/fda x:0 0 0 2024-04-03T08:39:28.318 INFO:tasks.workunit.client.0.smithi157.stdout:9/748: write d1/d15/d27/f32 [4913702,92963] 0 2024-04-03T08:39:28.319 INFO:tasks.workunit.client.1.smithi181.stdout:6/604: dwrite d6/f58 [0,4194304] 0 2024-04-03T08:39:28.321 INFO:tasks.workunit.client.1.smithi181.stdout:6/605: fsync d6/d3e/d5e/d7c/d50/d5b/f9d 0 2024-04-03T08:39:28.324 INFO:tasks.workunit.client.1.smithi181.stdout:6/606: stat d6/d3e/d5e/d7c/d50/d5b/f6a 0 2024-04-03T08:39:28.326 INFO:tasks.workunit.client.1.smithi181.stdout:3/619: stat d0/d17/d36/d3b/d5a/d93/cc9 0 2024-04-03T08:39:28.328 INFO:tasks.workunit.client.0.smithi157.stdout:0/752: truncate d2/d9/dc/df/d1b/d35/d3d/f58 943659 0 2024-04-03T08:39:28.329 INFO:tasks.workunit.client.1.smithi181.stdout:3/620: dread - d0/d17/d36/d3b/d5a/d85/f90 zero size 2024-04-03T08:39:28.329 INFO:tasks.workunit.client.1.smithi181.stdout:2/669: rename d13/d1c/d4a/d68/d72/da1 to d13/d1c/d4a/d68/dfa 0 2024-04-03T08:39:28.331 INFO:tasks.workunit.client.0.smithi157.stdout:4/699: mkdir da/d26/df4 0 2024-04-03T08:39:28.332 INFO:tasks.workunit.client.1.smithi181.stdout:4/629: creat d1/fd3 x:0 0 0 2024-04-03T08:39:28.340 INFO:tasks.workunit.client.0.smithi157.stdout:4/700: readlink da/df/d2f/d64/d8f/dbd/la1 0 2024-04-03T08:39:28.341 INFO:tasks.workunit.client.1.smithi181.stdout:0/569: mknod d5/dc/d14/cb2 0 2024-04-03T08:39:28.345 INFO:tasks.workunit.client.0.smithi157.stdout:9/749: dwrite d1/d15/d16/d9f/ff5 [0,4194304] 0 2024-04-03T08:39:28.345 INFO:tasks.workunit.client.0.smithi157.stdout:1/673: fsync d2/d11/d23/dc9/d86/f8b 0 2024-04-03T08:39:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:27 smithi181 ceph-mon[44183]: Standby manager daemon smithi157.qfvynr started 2024-04-03T08:39:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/crt"}]: dispatch 2024-04-03T08:39:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:39:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/key"}]: dispatch 2024-04-03T08:39:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/3566075331' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:39:28.348 INFO:tasks.workunit.client.0.smithi157.stdout:9/750: read d1/d15/d16/f67 [157959,71798] 0 2024-04-03T08:39:28.348 INFO:tasks.workunit.client.1.smithi181.stdout:5/587: truncate d4/f3d 1286639 0 2024-04-03T08:39:28.350 INFO:tasks.workunit.client.0.smithi157.stdout:6/750: link d1/d5/d17/d2a/d37/cc9 d1/d4b/da5/dd9/df9/cfc 0 2024-04-03T08:39:28.351 INFO:tasks.workunit.client.1.smithi181.stdout:3/621: dwrite d0/d17/d36/d1e/f80 [0,4194304] 0 2024-04-03T08:39:28.354 INFO:tasks.workunit.client.1.smithi181.stdout:7/522: rename d0/d1/l1d to d0/d1/d6/db0/lbb 0 2024-04-03T08:39:28.355 INFO:tasks.workunit.client.1.smithi181.stdout:9/642: write d1/da/d13/d22/f8d [964455,114479] 0 2024-04-03T08:39:28.358 INFO:tasks.workunit.client.0.smithi157.stdout:5/761: dread dc/d29/d56/d49/d53/fd6 [4194304,4194304] 0 2024-04-03T08:39:28.362 INFO:tasks.workunit.client.0.smithi157.stdout:3/682: getdents d8/d13/d1b/d4e/d50/d7c 0 2024-04-03T08:39:28.363 INFO:tasks.workunit.client.0.smithi157.stdout:0/753: truncate d2/d9/dc/df/d1b/f34 4667263 0 2024-04-03T08:39:28.364 INFO:tasks.workunit.client.0.smithi157.stdout:5/762: chown dc/d29/d56/d9e/dc3/ff0 0 1 2024-04-03T08:39:28.365 INFO:tasks.workunit.client.0.smithi157.stdout:7/775: dread d0/d11/f21 [0,4194304] 0 2024-04-03T08:39:28.370 INFO:tasks.workunit.client.0.smithi157.stdout:7/776: read - d0/d11/d15/d1b/db8/fba zero size 2024-04-03T08:39:28.372 INFO:tasks.workunit.client.0.smithi157.stdout:6/751: rmdir d1/d5/d1b/d97 39 2024-04-03T08:39:28.374 INFO:tasks.workunit.client.0.smithi157.stdout:5/763: readlink l1 0 2024-04-03T08:39:28.375 INFO:tasks.workunit.client.0.smithi157.stdout:2/732: creat d3/d2e/d32/d9f/f104 x:0 0 0 2024-04-03T08:39:28.382 INFO:tasks.workunit.client.0.smithi157.stdout:1/674: mknod d2/d11/cdb 0 2024-04-03T08:39:28.385 INFO:tasks.workunit.client.0.smithi157.stdout:7/777: dread - d0/d11/d15/d17/d1c/d4f/d5f/fc3 zero size 2024-04-03T08:39:28.389 INFO:tasks.workunit.client.0.smithi157.stdout:9/751: dread d1/d15/d16/f3a [0,4194304] 0 2024-04-03T08:39:28.389 INFO:tasks.workunit.client.0.smithi157.stdout:7/778: write d0/d11/d15/f108 [17870,82183] 0 2024-04-03T08:39:28.392 INFO:tasks.workunit.client.0.smithi157.stdout:3/683: getdents d8/d13/d1b 0 2024-04-03T08:39:28.396 INFO:tasks.workunit.client.0.smithi157.stdout:5/764: dread dc/d29/d56/fb0 [0,4194304] 0 2024-04-03T08:39:28.399 INFO:tasks.workunit.client.0.smithi157.stdout:7/779: stat d0/d11/d15/d17/d1c/d4f/d5f/fc3 0 2024-04-03T08:39:28.403 INFO:tasks.workunit.client.0.smithi157.stdout:9/752: mkdir d1/d15/d27/d5c/dbd/dfd 0 2024-04-03T08:39:28.407 INFO:tasks.workunit.client.0.smithi157.stdout:5/765: read dc/d29/d56/d49/d53/fd6 [6279514,20590] 0 2024-04-03T08:39:28.411 INFO:tasks.workunit.client.0.smithi157.stdout:7/780: creat d0/d11/d15/d17/d52/f10e x:0 0 0 2024-04-03T08:39:28.414 INFO:tasks.workunit.client.0.smithi157.stdout:1/675: dread d2/d11/d24/d39/d3b/d2e/f7d [0,4194304] 0 2024-04-03T08:39:28.415 INFO:tasks.workunit.client.0.smithi157.stdout:0/754: dread d2/f5b [0,4194304] 0 2024-04-03T08:39:28.418 INFO:tasks.workunit.client.0.smithi157.stdout:5/766: mkdir dc/d29/d56/d9e/dc3/dde/def/dfa 0 2024-04-03T08:39:28.419 INFO:tasks.workunit.client.0.smithi157.stdout:6/752: dwrite d1/d5/d17/d2a/d30/d95/f26 [0,4194304] 0 2024-04-03T08:39:28.421 INFO:tasks.workunit.client.0.smithi157.stdout:4/701: dwrite da/df/d24/f75 [0,4194304] 0 2024-04-03T08:39:28.428 INFO:tasks.workunit.client.0.smithi157.stdout:2/733: dwrite d3/db/d44/f92 [0,4194304] 0 2024-04-03T08:39:28.434 INFO:tasks.workunit.client.0.smithi157.stdout:1/676: readlink d2/d11/d24/d39/d3b/d1b/d90/lcf 0 2024-04-03T08:39:28.434 INFO:tasks.workunit.client.0.smithi157.stdout:2/734: write d3/f9 [2914184,34651] 0 2024-04-03T08:39:28.434 INFO:tasks.workunit.client.0.smithi157.stdout:0/755: mknod d2/d9/dc/df/c111 0 2024-04-03T08:39:28.437 INFO:tasks.workunit.client.1.smithi181.stdout:2/670: mknod d13/da7/d85/dbd/cfb 0 2024-04-03T08:39:28.442 INFO:tasks.workunit.client.1.smithi181.stdout:6/607: write d6/d31/d36/f87 [37590,68349] 0 2024-04-03T08:39:28.447 INFO:tasks.workunit.client.1.smithi181.stdout:8/532: dread d4/f46 [0,4194304] 0 2024-04-03T08:39:28.449 INFO:tasks.workunit.client.0.smithi157.stdout:1/677: stat d2/d11/l29 0 2024-04-03T08:39:28.449 INFO:tasks.workunit.client.0.smithi157.stdout:0/756: mknod d2/d9/dc/df/d6f/d9d/c112 0 2024-04-03T08:39:28.449 INFO:tasks.workunit.client.0.smithi157.stdout:2/735: truncate d3/db/d44/d4c/d5a/d88/d97/fce 445054 0 2024-04-03T08:39:28.450 INFO:tasks.workunit.client.0.smithi157.stdout:3/684: dwrite d8/d1e/d2d/d3b/d8c/f9c [0,4194304] 0 2024-04-03T08:39:28.450 INFO:tasks.workunit.client.0.smithi157.stdout:6/753: mkdir d1/d5/d1b/d97/dfd 0 2024-04-03T08:39:28.450 INFO:tasks.workunit.client.0.smithi157.stdout:1/678: chown d2/d11/d24/d39/l52 903 1 2024-04-03T08:39:28.451 INFO:tasks.workunit.client.1.smithi181.stdout:0/570: rmdir d5/d9/d2e/d92 0 2024-04-03T08:39:28.452 INFO:tasks.workunit.client.1.smithi181.stdout:5/588: dwrite d4/d80/fa4 [0,4194304] 0 2024-04-03T08:39:28.452 INFO:tasks.workunit.client.1.smithi181.stdout:8/533: write d4/d44/fb3 [1001384,112124] 0 2024-04-03T08:39:28.454 INFO:tasks.workunit.client.1.smithi181.stdout:6/608: mkdir d6/d3e/d40/dbc 0 2024-04-03T08:39:28.456 INFO:tasks.workunit.client.1.smithi181.stdout:9/643: truncate d1/da/d13/d41/f1b 4823956 0 2024-04-03T08:39:28.458 INFO:tasks.workunit.client.0.smithi157.stdout:5/767: creat dc/d29/d56/d2e/ffb x:0 0 0 2024-04-03T08:39:28.458 INFO:tasks.workunit.client.0.smithi157.stdout:9/753: dread d1/d15/d27/f55 [0,4194304] 0 2024-04-03T08:39:28.458 INFO:tasks.workunit.client.1.smithi181.stdout:3/622: symlink d0/d17/d40/ld0 0 2024-04-03T08:39:28.460 INFO:tasks.workunit.client.1.smithi181.stdout:7/523: link d0/d1/d6/f26 d0/d1/d6/de/d17/d64/fbc 0 2024-04-03T08:39:28.462 INFO:tasks.workunit.client.0.smithi157.stdout:1/679: rmdir d2/d11/d23/dc9/d5d/db4 39 2024-04-03T08:39:28.465 INFO:tasks.workunit.client.1.smithi181.stdout:0/571: mknod d5/dc/d10/d58/d6c/cb3 0 2024-04-03T08:39:28.467 INFO:tasks.workunit.client.0.smithi157.stdout:5/768: fdatasync dc/d29/d51/f64 0 2024-04-03T08:39:28.468 INFO:tasks.workunit.client.1.smithi181.stdout:6/609: creat d6/d31/d36/dba/da6/d4f/d77/d8b/fbd x:0 0 0 2024-04-03T08:39:28.468 INFO:tasks.workunit.client.0.smithi157.stdout:6/754: creat d1/d5/d17/d29/da7/db9/ffe x:0 0 0 2024-04-03T08:39:28.469 INFO:tasks.workunit.client.1.smithi181.stdout:8/534: creat d4/d45/db/d14/d31/d1c/d51/d87/db1/fb7 x:0 0 0 2024-04-03T08:39:28.475 INFO:tasks.workunit.client.1.smithi181.stdout:3/623: creat d0/d17/d36/d3b/d5a/fd1 x:0 0 0 2024-04-03T08:39:28.476 INFO:tasks.workunit.client.1.smithi181.stdout:0/572: creat d5/dc/d14/d8d/fb4 x:0 0 0 2024-04-03T08:39:28.477 INFO:tasks.workunit.client.0.smithi157.stdout:3/685: mkdir d8/d1e/d2d/d39/d51/d48/dab/dee 0 2024-04-03T08:39:28.478 INFO:tasks.workunit.client.0.smithi157.stdout:7/781: dwrite d0/d11/d15/d17/d1c/d88/fc5 [0,4194304] 0 2024-04-03T08:39:28.478 INFO:tasks.workunit.client.0.smithi157.stdout:9/754: chown d1/d94/d75/cb0 49 1 2024-04-03T08:39:28.479 INFO:tasks.workunit.client.1.smithi181.stdout:0/573: read d5/dc/d10/f36 [2047341,29733] 0 2024-04-03T08:39:28.481 INFO:tasks.workunit.client.1.smithi181.stdout:9/644: unlink d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/lc0 0 2024-04-03T08:39:28.483 INFO:tasks.workunit.client.0.smithi157.stdout:9/755: fdatasync d1/fe 0 2024-04-03T08:39:28.484 INFO:tasks.workunit.client.0.smithi157.stdout:0/757: dwrite d2/d9/dc/df/d6f/d9d/fe0 [0,4194304] 0 2024-04-03T08:39:28.484 INFO:tasks.workunit.client.0.smithi157.stdout:3/686: chown d8/d1e/d2d/d30 354 1 2024-04-03T08:39:28.486 INFO:tasks.workunit.client.1.smithi181.stdout:7/524: rename d0/d1/d6/de/d17/d64/l6b to d0/d1/d6/de/d17/d64/lbd 0 2024-04-03T08:39:28.487 INFO:tasks.workunit.client.0.smithi157.stdout:0/758: stat d2/d9/dc/dbe/ccd 0 2024-04-03T08:39:28.489 INFO:tasks.workunit.client.1.smithi181.stdout:2/671: write d13/d1c/d4a/d7f/db3/d8f/f93 [370699,46167] 0 2024-04-03T08:39:28.490 INFO:tasks.workunit.client.0.smithi157.stdout:1/680: mknod d2/d11/d24/dd5/cdc 0 2024-04-03T08:39:28.490 INFO:tasks.workunit.client.1.smithi181.stdout:3/624: symlink d0/d17/d63/db7/ld2 0 2024-04-03T08:39:28.497 INFO:tasks.workunit.client.0.smithi157.stdout:5/769: dread - dc/d29/d56/d9e/dc3/fcd zero size 2024-04-03T08:39:28.501 INFO:tasks.workunit.client.0.smithi157.stdout:4/702: dread da/df/f57 [0,4194304] 0 2024-04-03T08:39:28.501 INFO:tasks.workunit.client.0.smithi157.stdout:6/755: dwrite d1/d5/d17/d29/da7/fd0 [0,4194304] 0 2024-04-03T08:39:28.504 INFO:tasks.workunit.client.0.smithi157.stdout:2/736: write d3/f6c [1042127,13331] 0 2024-04-03T08:39:28.507 INFO:tasks.workunit.client.0.smithi157.stdout:7/782: creat d0/d11/d6f/f10f x:0 0 0 2024-04-03T08:39:28.509 INFO:tasks.workunit.client.0.smithi157.stdout:0/759: symlink d2/d9/dc/df/d1b/d35/d3d/l113 0 2024-04-03T08:39:28.513 INFO:tasks.workunit.client.0.smithi157.stdout:7/783: chown d0/d11/d6f/d89/d8c/deb/f10c 50 1 2024-04-03T08:39:28.517 INFO:tasks.workunit.client.0.smithi157.stdout:6/756: unlink d1/d5/d17/d2a/d73/lf3 0 2024-04-03T08:39:28.521 INFO:tasks.workunit.client.0.smithi157.stdout:4/703: mkdir da/df/d24/d35/d6a/d78/df5 0 2024-04-03T08:39:28.524 INFO:tasks.workunit.client.0.smithi157.stdout:5/770: dwrite dc/f13 [4194304,4194304] 0 2024-04-03T08:39:28.526 INFO:tasks.workunit.client.0.smithi157.stdout:5/771: fdatasync dc/d29/d56/d9e/dc3/ff0 0 2024-04-03T08:39:28.528 INFO:tasks.workunit.client.0.smithi157.stdout:3/687: rename d8/d1e/d2d/d3f/l5d to d8/d13/d1b/d4e/d50/d7c/lef 0 2024-04-03T08:39:28.533 INFO:tasks.workunit.client.0.smithi157.stdout:0/760: fdatasync d2/d9/dc/df/d1b/d4a/f20 0 2024-04-03T08:39:28.534 INFO:tasks.workunit.client.0.smithi157.stdout:1/681: write d2/d11/d24/f2f [1067881,77839] 0 2024-04-03T08:39:28.536 INFO:tasks.workunit.client.0.smithi157.stdout:0/761: readlink d2/d9/dc/df/d1b/d4a/l70 0 2024-04-03T08:39:28.536 INFO:tasks.workunit.client.0.smithi157.stdout:7/784: mkdir d0/d11/d6f/d89/d8c/d103/d8e/d96/df4/d110 0 2024-04-03T08:39:28.544 INFO:tasks.workunit.client.1.smithi181.stdout:7/525: mknod d0/d1/d6/de/d17/d27/cbe 0 2024-04-03T08:39:28.545 INFO:tasks.workunit.client.0.smithi157.stdout:5/772: unlink dc/c2c 0 2024-04-03T08:39:28.545 INFO:tasks.workunit.client.1.smithi181.stdout:2/672: dread - d13/d1c/d4a/d68/fa3 zero size 2024-04-03T08:39:28.546 INFO:tasks.workunit.client.0.smithi157.stdout:9/756: truncate d1/d15/d16/f3a 6690628 0 2024-04-03T08:39:28.548 INFO:tasks.workunit.client.0.smithi157.stdout:3/688: mkdir d8/d1e/d2d/d30/df0 0 2024-04-03T08:39:28.554 INFO:tasks.workunit.client.0.smithi157.stdout:6/757: write d1/d4b/fce [118572,52968] 0 2024-04-03T08:39:28.554 INFO:tasks.workunit.client.0.smithi157.stdout:0/762: mknod d2/d9/d36/d38/c114 0 2024-04-03T08:39:28.555 INFO:tasks.workunit.client.1.smithi181.stdout:3/625: dwrite d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:28.555 INFO:tasks.workunit.client.1.smithi181.stdout:6/610: dwrite d6/d3e/d5e/d7c/f3f [0,4194304] 0 2024-04-03T08:39:28.556 INFO:tasks.workunit.client.0.smithi157.stdout:7/785: mknod d0/d11/d15/d17/d1c/d4f/dcd/c111 0 2024-04-03T08:39:28.558 INFO:tasks.workunit.client.0.smithi157.stdout:4/704: rmdir da/d7e 39 2024-04-03T08:39:28.562 INFO:tasks.workunit.client.0.smithi157.stdout:9/757: rmdir d1/d94/dbe/dbf 39 2024-04-03T08:39:28.568 INFO:tasks.workunit.client.0.smithi157.stdout:3/689: mkdir d8/d1e/d2d/d3b/d8c/df1 0 2024-04-03T08:39:28.568 INFO:tasks.workunit.client.0.smithi157.stdout:4/705: write da/df/d24/f75 [1102770,120805] 0 2024-04-03T08:39:28.570 INFO:tasks.workunit.client.0.smithi157.stdout:6/758: mkdir d1/d5/d17/d2a/d30/d95/dff 0 2024-04-03T08:39:28.573 INFO:tasks.workunit.client.0.smithi157.stdout:0/763: dread d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/feb [0,4194304] 0 2024-04-03T08:39:28.574 INFO:tasks.workunit.client.0.smithi157.stdout:2/737: getdents d3/dab 0 2024-04-03T08:39:28.576 INFO:tasks.workunit.client.1.smithi181.stdout:6/611: dread d6/d3e/d5e/d7c/d50/d5b/f9d [0,4194304] 0 2024-04-03T08:39:28.577 INFO:tasks.workunit.client.0.smithi157.stdout:2/738: write d3/d12/ff0 [943423,84807] 0 2024-04-03T08:39:28.577 INFO:tasks.workunit.client.0.smithi157.stdout:7/786: symlink d0/d11/d15/d17/l112 0 2024-04-03T08:39:28.579 INFO:tasks.workunit.client.1.smithi181.stdout:6/612: chown d6/d31/d36/d73/fa8 6 1 2024-04-03T08:39:28.582 INFO:tasks.workunit.client.0.smithi157.stdout:1/682: dread d2/d11/d24/d67/f70 [0,4194304] 0 2024-04-03T08:39:28.584 INFO:tasks.workunit.client.1.smithi181.stdout:9/645: creat d1/da/d28/d80/dc6/fc7 x:0 0 0 2024-04-03T08:39:28.586 INFO:tasks.workunit.client.0.smithi157.stdout:5/773: dread dc/d29/fa7 [0,4194304] 0 2024-04-03T08:39:28.587 INFO:tasks.workunit.client.0.smithi157.stdout:9/758: rename d1/d15/d27/d5c/fcf to d1/d4a/d4d/dd6/ffe 0 2024-04-03T08:39:28.588 INFO:tasks.workunit.client.1.smithi181.stdout:7/526: mkdir d0/d1/d6/de/d6d/d96/dbf 0 2024-04-03T08:39:28.592 INFO:tasks.workunit.client.1.smithi181.stdout:2/673: creat d13/d1c/d4a/d68/ffc x:0 0 0 2024-04-03T08:39:28.595 INFO:tasks.workunit.client.1.smithi181.stdout:3/626: symlink d0/d5/d6/dd/ld3 0 2024-04-03T08:39:28.596 INFO:tasks.workunit.client.1.smithi181.stdout:6/613: dwrite d6/d3e/f7e [0,4194304] 0 2024-04-03T08:39:28.598 INFO:tasks.workunit.client.1.smithi181.stdout:3/627: write d0/d5/d6/dd/fa9 [625439,42339] 0 2024-04-03T08:39:28.601 INFO:tasks.workunit.client.1.smithi181.stdout:1/609: sync 2024-04-03T08:39:28.604 INFO:tasks.workunit.client.1.smithi181.stdout:7/527: rmdir d0/d1/d6 39 2024-04-03T08:39:28.605 INFO:tasks.workunit.client.0.smithi157.stdout:2/739: truncate d3/d2e/d32/d9f/fcb 1444554 0 2024-04-03T08:39:28.605 INFO:tasks.workunit.client.1.smithi181.stdout:9/646: dread d1/da/d13/d22/d23/f5e [4194304,4194304] 0 2024-04-03T08:39:28.605 INFO:tasks.workunit.client.1.smithi181.stdout:3/628: dread - d0/d17/d36/d3b/d5a/d85/f90 zero size 2024-04-03T08:39:28.606 INFO:tasks.workunit.client.1.smithi181.stdout:1/610: write d10/d15/d17/d19/d33/fa4 [222048,76058] 0 2024-04-03T08:39:28.609 INFO:tasks.workunit.client.1.smithi181.stdout:0/574: getdents d5/dc/d10/d30/d68 0 2024-04-03T08:39:28.610 INFO:tasks.workunit.client.0.smithi157.stdout:1/683: fdatasync d2/d11/d23/dc9/d58/d62/d74/f75 0 2024-04-03T08:39:28.614 INFO:tasks.workunit.client.1.smithi181.stdout:6/614: mkdir d6/d31/dbe 0 2024-04-03T08:39:28.616 INFO:tasks.workunit.client.0.smithi157.stdout:9/759: mknod d1/d4a/d4d/da4/cff 0 2024-04-03T08:39:28.616 INFO:tasks.workunit.client.0.smithi157.stdout:8/744: sync 2024-04-03T08:39:28.618 INFO:tasks.workunit.client.0.smithi157.stdout:6/759: mknod d1/d5/c100 0 2024-04-03T08:39:28.622 INFO:tasks.workunit.client.0.smithi157.stdout:0/764: mknod d2/d9/c115 0 2024-04-03T08:39:28.622 INFO:tasks.workunit.client.0.smithi157.stdout:4/706: dwrite da/df/d2f/d54/fd3 [0,4194304] 0 2024-04-03T08:39:28.624 INFO:tasks.workunit.client.0.smithi157.stdout:3/690: creat d8/d13/d1b/d4e/d50/d7c/dd8/ff2 x:0 0 0 2024-04-03T08:39:28.625 INFO:tasks.workunit.client.0.smithi157.stdout:0/765: truncate d2/d9/f110 63236 0 2024-04-03T08:39:28.627 INFO:tasks.workunit.client.0.smithi157.stdout:0/766: chown d2/d9/c115 301 1 2024-04-03T08:39:28.627 INFO:tasks.workunit.client.1.smithi181.stdout:3/629: symlink d0/d5/d6/d32/daa/ld4 0 2024-04-03T08:39:28.629 INFO:tasks.workunit.client.0.smithi157.stdout:0/767: write d2/fef [933730,62018] 0 2024-04-03T08:39:28.631 INFO:tasks.workunit.client.1.smithi181.stdout:7/528: dread - d0/d1/d6/de/d17/d27/f56 zero size 2024-04-03T08:39:28.631 INFO:tasks.workunit.client.0.smithi157.stdout:0/768: chown d2/f3 116 1 2024-04-03T08:39:28.633 INFO:tasks.workunit.client.0.smithi157.stdout:0/769: stat d2/d9/dc/f3c 0 2024-04-03T08:39:28.634 INFO:tasks.workunit.client.1.smithi181.stdout:6/615: truncate d6/d3e/d5e/d7c/d9/f1a 4120033 0 2024-04-03T08:39:28.635 INFO:tasks.workunit.client.1.smithi181.stdout:2/674: write f3 [657541,99271] 0 2024-04-03T08:39:28.637 INFO:tasks.workunit.client.0.smithi157.stdout:7/787: dwrite d0/d11/f71 [0,4194304] 0 2024-04-03T08:39:28.637 INFO:tasks.workunit.client.0.smithi157.stdout:1/684: mknod d2/d11/d23/dc9/d64/cdd 0 2024-04-03T08:39:28.638 INFO:tasks.workunit.client.1.smithi181.stdout:0/575: symlink d5/d9/d60/lb5 0 2024-04-03T08:39:28.639 INFO:tasks.workunit.client.0.smithi157.stdout:1/685: chown d2/d11/d24/d39/dc6 267559631 1 2024-04-03T08:39:28.640 INFO:tasks.workunit.client.0.smithi157.stdout:9/760: mkdir d1/dab/dad/d100 0 2024-04-03T08:39:28.642 INFO:tasks.workunit.client.1.smithi181.stdout:3/630: creat d0/d5/d6/d32/daa/fd5 x:0 0 0 2024-04-03T08:39:28.645 INFO:tasks.workunit.client.1.smithi181.stdout:7/529: mknod d0/d1/d6/de/d17/d64/cc0 0 2024-04-03T08:39:28.647 INFO:tasks.workunit.client.1.smithi181.stdout:1/611: link d10/f16 d10/da1/fbf 0 2024-04-03T08:39:28.648 INFO:tasks.workunit.client.0.smithi157.stdout:4/707: fsync da/df/d2f/f38 0 2024-04-03T08:39:28.650 INFO:tasks.workunit.client.1.smithi181.stdout:6/616: creat d6/d31/d36/dba/da6/d4f/d77/fbf x:0 0 0 2024-04-03T08:39:28.651 INFO:tasks.workunit.client.0.smithi157.stdout:4/708: fsync da/df/d2f/d97/dd6/feb 0 2024-04-03T08:39:28.656 INFO:tasks.workunit.client.1.smithi181.stdout:0/576: unlink d5/dc/d10/d30/d68/cac 0 2024-04-03T08:39:28.657 INFO:tasks.workunit.client.0.smithi157.stdout:3/691: mknod d8/d1e/d2d/d3b/d9e/cf3 0 2024-04-03T08:39:28.658 INFO:tasks.workunit.client.1.smithi181.stdout:3/631: read - d0/d5/f9d zero size 2024-04-03T08:39:28.661 INFO:tasks.workunit.client.1.smithi181.stdout:7/530: rename d0/d1/d6/de/d6d/la1 to d0/d1/d6/db9/lc1 0 2024-04-03T08:39:28.666 INFO:tasks.workunit.client.1.smithi181.stdout:0/577: symlink d5/dc/d10/d58/lb6 0 2024-04-03T08:39:28.671 INFO:tasks.workunit.client.1.smithi181.stdout:6/617: mkdir d6/dc0 0 2024-04-03T08:39:28.672 INFO:tasks.workunit.client.1.smithi181.stdout:3/632: dread d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:28.672 INFO:tasks.workunit.client.0.smithi157.stdout:9/761: truncate d1/d94/fc3 524219 0 2024-04-03T08:39:28.673 INFO:tasks.workunit.client.1.smithi181.stdout:1/612: creat d10/d15/d17/d23/d27/d91/fc0 x:0 0 0 2024-04-03T08:39:28.674 INFO:tasks.workunit.client.1.smithi181.stdout:2/675: dread d13/da7/d85/de4/ff1 [0,4194304] 0 2024-04-03T08:39:28.675 INFO:tasks.workunit.client.1.smithi181.stdout:7/531: truncate d0/d1/d6/de/d17/d27/f5d 2874402 0 2024-04-03T08:39:28.676 INFO:tasks.workunit.client.0.smithi157.stdout:2/740: write d3/f34 [667827,36641] 0 2024-04-03T08:39:28.678 INFO:tasks.workunit.client.0.smithi157.stdout:5/774: mknod dc/d29/d56/d49/d7f/cfc 0 2024-04-03T08:39:28.682 INFO:tasks.workunit.client.1.smithi181.stdout:6/618: creat d6/d3e/d5e/d7c/d50/d5b/fc1 x:0 0 0 2024-04-03T08:39:28.684 INFO:tasks.workunit.client.1.smithi181.stdout:7/532: truncate d0/f5b 416421 0 2024-04-03T08:39:28.685 INFO:tasks.workunit.client.0.smithi157.stdout:9/762: creat d1/dab/dad/f101 x:0 0 0 2024-04-03T08:39:28.687 INFO:tasks.workunit.client.0.smithi157.stdout:0/770: dwrite d2/d9/dc/df/d1b/d4a/f20 [0,4194304] 0 2024-04-03T08:39:28.689 INFO:tasks.workunit.client.0.smithi157.stdout:2/741: dread d3/db/d44/d4c/d5a/d88/ffd [0,4194304] 0 2024-04-03T08:39:28.690 INFO:tasks.workunit.client.1.smithi181.stdout:3/633: dwrite d0/d17/d56/fbe [0,4194304] 0 2024-04-03T08:39:28.692 INFO:tasks.workunit.client.0.smithi157.stdout:7/788: dread d0/d11/d15/d17/f19 [0,4194304] 0 2024-04-03T08:39:28.693 INFO:tasks.workunit.client.1.smithi181.stdout:0/578: creat d5/dc/d10/d58/d6c/fb7 x:0 0 0 2024-04-03T08:39:28.693 INFO:tasks.workunit.client.1.smithi181.stdout:1/613: dwrite d10/d15/d4a/d6f/f7a [0,4194304] 0 2024-04-03T08:39:28.697 INFO:tasks.workunit.client.1.smithi181.stdout:0/579: readlink d5/d9/d60/lb5 0 2024-04-03T08:39:28.698 INFO:tasks.workunit.client.0.smithi157.stdout:3/692: rename d8/d1e/d2d/d3b/d8c/db4/ce3 to d8/d1e/d2d/d39/d51/d7e/db1/de7/cf4 0 2024-04-03T08:39:28.698 INFO:tasks.workunit.client.0.smithi157.stdout:3/693: chown d8/d1e/d2d/d39/lda 7 1 2024-04-03T08:39:28.699 INFO:tasks.workunit.client.1.smithi181.stdout:1/614: dread - d10/d15/d41/f83 zero size 2024-04-03T08:39:28.702 INFO:tasks.workunit.client.1.smithi181.stdout:2/676: truncate d13/d1c/d4a/f4d 1718748 0 2024-04-03T08:39:28.702 INFO:tasks.workunit.client.1.smithi181.stdout:6/619: write d6/d3e/d5e/d7c/d50/d5b/f6a [230281,96137] 0 2024-04-03T08:39:28.703 INFO:tasks.workunit.client.0.smithi157.stdout:1/686: creat d2/d11/d23/dc9/d5d/fde x:0 0 0 2024-04-03T08:39:28.703 INFO:tasks.workunit.client.1.smithi181.stdout:1/615: stat d10/d15/d4b/d6c/f9f 0 2024-04-03T08:39:28.704 INFO:tasks.workunit.client.1.smithi181.stdout:7/533: rmdir d0/d1/d6/de/d17/d27 39 2024-04-03T08:39:28.707 INFO:tasks.workunit.client.1.smithi181.stdout:5/589: sync 2024-04-03T08:39:28.708 INFO:tasks.workunit.client.1.smithi181.stdout:4/630: sync 2024-04-03T08:39:28.709 INFO:tasks.workunit.client.1.smithi181.stdout:5/590: fdatasync d4/d18/f28 0 2024-04-03T08:39:28.710 INFO:tasks.workunit.client.0.smithi157.stdout:0/771: dwrite d2/d9/dc/df/d1b/d4a/fbd [0,4194304] 0 2024-04-03T08:39:28.711 INFO:tasks.workunit.client.1.smithi181.stdout:4/631: fdatasync d1/d16/d37/d34/d86/fc6 0 2024-04-03T08:39:28.714 INFO:tasks.workunit.client.1.smithi181.stdout:3/634: mkdir d0/d17/d63/dd6 0 2024-04-03T08:39:28.715 INFO:tasks.workunit.client.1.smithi181.stdout:5/591: read d4/d18/d3e/f6f [156448,89217] 0 2024-04-03T08:39:28.717 INFO:tasks.workunit.client.0.smithi157.stdout:6/760: getdents d1/d5/d17/d29/da7/db9 0 2024-04-03T08:39:28.718 INFO:tasks.workunit.client.1.smithi181.stdout:5/592: chown d4/d22/d78/faa 59398863 1 2024-04-03T08:39:28.720 INFO:tasks.workunit.client.0.smithi157.stdout:9/763: unlink d1/d36/d46/f56 0 2024-04-03T08:39:28.723 INFO:tasks.workunit.client.1.smithi181.stdout:3/635: truncate d0/d5/d6/d32/daa/fc6 518457 0 2024-04-03T08:39:28.729 INFO:tasks.workunit.client.1.smithi181.stdout:1/616: mknod d10/d15/d41/cc1 0 2024-04-03T08:39:28.729 INFO:tasks.workunit.client.1.smithi181.stdout:6/620: dwrite d6/d31/d36/dba/da6/f88 [0,4194304] 0 2024-04-03T08:39:28.730 INFO:tasks.workunit.client.0.smithi157.stdout:7/789: rename d0/d11/l4c to d0/d11/d6f/d89/d8c/d103/daf/l113 0 2024-04-03T08:39:28.731 INFO:tasks.workunit.client.1.smithi181.stdout:3/636: write d0/d5/d6/d32/daa/fc6 [1108728,98649] 0 2024-04-03T08:39:28.734 INFO:tasks.workunit.client.1.smithi181.stdout:7/534: creat d0/d1/d6/de/d17/d64/d85/d9a/da4/fc2 x:0 0 0 2024-04-03T08:39:28.735 INFO:tasks.workunit.client.0.smithi157.stdout:7/790: rename d0/d11 to d0/d11/d6f/d89/d8c/d103/dd4/d114 22 2024-04-03T08:39:28.739 INFO:tasks.workunit.client.1.smithi181.stdout:6/621: dread d6/d3e/d40/fa3 [0,4194304] 0 2024-04-03T08:39:28.740 INFO:tasks.workunit.client.0.smithi157.stdout:3/694: mkdir d8/d1e/d2d/d39/d51/d7e/db1/df5 0 2024-04-03T08:39:28.741 INFO:tasks.workunit.client.1.smithi181.stdout:8/535: sync 2024-04-03T08:39:28.742 INFO:tasks.workunit.client.1.smithi181.stdout:9/647: sync 2024-04-03T08:39:28.743 INFO:tasks.workunit.client.1.smithi181.stdout:8/536: readlink d4/d45/db/l47 0 2024-04-03T08:39:28.746 INFO:tasks.workunit.client.0.smithi157.stdout:5/775: getdents dc/d29/d56/d9e/dc3/dde/def/dfa 0 2024-04-03T08:39:28.746 INFO:tasks.workunit.client.0.smithi157.stdout:2/742: write d3/d12/d43/d4b/f7a [9144,110567] 0 2024-04-03T08:39:28.747 INFO:tasks.workunit.client.1.smithi181.stdout:0/580: mkdir d5/dc/d10/d58/db0/db8 0 2024-04-03T08:39:28.748 INFO:tasks.workunit.client.0.smithi157.stdout:2/743: chown d3/f6c 156361 1 2024-04-03T08:39:28.756 INFO:tasks.workunit.client.0.smithi157.stdout:0/772: unlink d2/d9/d51/lda 0 2024-04-03T08:39:28.757 INFO:tasks.workunit.client.0.smithi157.stdout:9/764: mknod d1/d15/dca/c102 0 2024-04-03T08:39:28.757 INFO:tasks.workunit.client.0.smithi157.stdout:6/761: creat d1/d5/d17/d2a/d30/d95/f101 x:0 0 0 2024-04-03T08:39:28.757 INFO:tasks.workunit.client.0.smithi157.stdout:4/709: link da/l1a da/d26/lf6 0 2024-04-03T08:39:28.762 INFO:tasks.workunit.client.1.smithi181.stdout:7/535: mknod d0/d1/d6/de/d17/d64/d85/d87/cc3 0 2024-04-03T08:39:28.763 INFO:tasks.workunit.client.0.smithi157.stdout:7/791: creat d0/d11/d15/d17/d43/d8a/f115 x:0 0 0 2024-04-03T08:39:28.771 INFO:tasks.workunit.client.1.smithi181.stdout:5/593: dread d4/d18/f35 [0,4194304] 0 2024-04-03T08:39:28.771 INFO:tasks.workunit.client.1.smithi181.stdout:6/622: symlink d6/d7b/lc2 0 2024-04-03T08:39:28.773 INFO:tasks.workunit.client.0.smithi157.stdout:2/744: creat d3/dab/f105 x:0 0 0 2024-04-03T08:39:28.778 INFO:tasks.workunit.client.1.smithi181.stdout:4/632: dwrite d1/d1e/f5b [0,4194304] 0 2024-04-03T08:39:28.778 INFO:tasks.workunit.client.0.smithi157.stdout:9/765: dwrite d1/d15/d27/f32 [0,4194304] 0 2024-04-03T08:39:28.778 INFO:tasks.workunit.client.1.smithi181.stdout:9/648: mknod d1/da/d28/d30/d3e/d4e/d62/cc8 0 2024-04-03T08:39:28.779 INFO:tasks.workunit.client.1.smithi181.stdout:4/633: truncate d1/fd3 799612 0 2024-04-03T08:39:28.779 INFO:tasks.workunit.client.1.smithi181.stdout:1/617: write d10/d15/d17/d30/f38 [3379376,109051] 0 2024-04-03T08:39:28.783 INFO:tasks.workunit.client.1.smithi181.stdout:2/677: dwrite d13/da7/d27/d2f/f5c [0,4194304] 0 2024-04-03T08:39:28.783 INFO:tasks.workunit.client.1.smithi181.stdout:0/581: rename d5/d9/d2a/f67 to d5/dc/d75/fb9 0 2024-04-03T08:39:28.784 INFO:tasks.workunit.client.1.smithi181.stdout:3/637: write d0/d17/d36/d1e/f7e [3530946,33592] 0 2024-04-03T08:39:28.785 INFO:tasks.workunit.client.0.smithi157.stdout:0/773: dread d2/d9/dc/df/d1b/d4a/de4/df1/f10e [0,4194304] 0 2024-04-03T08:39:28.791 INFO:tasks.workunit.client.0.smithi157.stdout:0/774: write d2/d9/dc/ff5 [718887,29189] 0 2024-04-03T08:39:28.794 INFO:tasks.workunit.client.0.smithi157.stdout:2/745: dread d3/db/d44/f61 [0,4194304] 0 2024-04-03T08:39:28.798 INFO:tasks.workunit.client.0.smithi157.stdout:9/766: dread d1/d15/d16/d9f/ff5 [0,4194304] 0 2024-04-03T08:39:28.799 INFO:tasks.workunit.client.1.smithi181.stdout:5/594: creat d4/d18/d25/db0/fbb x:0 0 0 2024-04-03T08:39:28.801 INFO:tasks.workunit.client.0.smithi157.stdout:9/767: readlink d1/d15/l9e 0 2024-04-03T08:39:28.802 INFO:tasks.workunit.client.1.smithi181.stdout:4/634: symlink d1/d1e/ld4 0 2024-04-03T08:39:28.804 INFO:tasks.workunit.client.1.smithi181.stdout:4/635: stat d1/d16/d24/d5e/d31/d39/da1 0 2024-04-03T08:39:28.804 INFO:tasks.workunit.client.1.smithi181.stdout:9/649: rename d1/da/d28/d80/fa1 to d1/da/d13/d41/d32/fc9 0 2024-04-03T08:39:28.804 INFO:tasks.workunit.client.0.smithi157.stdout:1/687: dwrite d2/d11/d24/f1f [4194304,4194304] 0 2024-04-03T08:39:28.805 INFO:tasks.workunit.client.0.smithi157.stdout:3/695: dwrite d8/d13/d1b/d4e/d50/fc9 [0,4194304] 0 2024-04-03T08:39:28.807 INFO:tasks.workunit.client.1.smithi181.stdout:3/638: rmdir d0/d17/d63/d81 39 2024-04-03T08:39:28.810 INFO:tasks.workunit.client.1.smithi181.stdout:2/678: mknod d13/d1c/d4a/d68/cfd 0 2024-04-03T08:39:28.811 INFO:tasks.workunit.client.1.smithi181.stdout:7/536: mkdir d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4 0 2024-04-03T08:39:28.811 INFO:tasks.workunit.client.0.smithi157.stdout:1/688: stat d2/d11/d23/dc9/d64/c77 0 2024-04-03T08:39:28.815 INFO:tasks.workunit.client.0.smithi157.stdout:1/689: write d2/d11/d23/fc1 [648941,18176] 0 2024-04-03T08:39:28.818 INFO:tasks.workunit.client.1.smithi181.stdout:6/623: link d6/d3e/d5e/d7c/f20 d6/d31/d36/dba/d81/fc3 0 2024-04-03T08:39:28.818 INFO:tasks.workunit.client.0.smithi157.stdout:1/690: write d2/d11/d23/d73/fc2 [3020470,118254] 0 2024-04-03T08:39:28.821 INFO:tasks.workunit.client.1.smithi181.stdout:0/582: rename d5/dc/d10/d30/d68 to d5/dc/d10/d58/dba 0 2024-04-03T08:39:28.825 INFO:tasks.workunit.client.0.smithi157.stdout:7/792: rmdir d0/d11/d15/d17 39 2024-04-03T08:39:28.827 INFO:tasks.workunit.client.1.smithi181.stdout:7/537: mknod d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/cc5 0 2024-04-03T08:39:28.828 INFO:tasks.workunit.client.0.smithi157.stdout:5/776: mkdir dc/d29/d56/d52/d9d/da5/dfd 0 2024-04-03T08:39:28.829 INFO:tasks.workunit.client.0.smithi157.stdout:9/768: dwrite d1/d15/d16/d9f/ff5 [0,4194304] 0 2024-04-03T08:39:28.832 INFO:tasks.workunit.client.1.smithi181.stdout:0/583: dread - d5/f8c zero size 2024-04-03T08:39:28.832 INFO:tasks.workunit.client.1.smithi181.stdout:3/639: write d0/d5/d6/f1d [2982192,102835] 0 2024-04-03T08:39:28.836 INFO:tasks.workunit.client.1.smithi181.stdout:6/624: chown d6/d31/d36/dba/da6/l8a 28 1 2024-04-03T08:39:28.837 INFO:tasks.workunit.client.1.smithi181.stdout:9/650: creat d1/da/d13/d22/fca x:0 0 0 2024-04-03T08:39:28.839 INFO:tasks.workunit.client.1.smithi181.stdout:9/651: stat d1/da/d13/d41/daf 0 2024-04-03T08:39:28.842 INFO:tasks.workunit.client.1.smithi181.stdout:6/625: write d6/d3e/d5e/d7c/f3f [2541862,39661] 0 2024-04-03T08:39:28.842 INFO:tasks.workunit.client.1.smithi181.stdout:4/636: rename d1/d16/d24/d5e/d3f/f6b to d1/d16/d24/d5e/d2b/db9/fd5 0 2024-04-03T08:39:28.845 INFO:tasks.workunit.client.1.smithi181.stdout:6/626: stat d6/d31/d36/f34 0 2024-04-03T08:39:28.848 INFO:tasks.workunit.client.1.smithi181.stdout:2/679: dwrite d13/da7/d85/de4/fec [0,4194304] 0 2024-04-03T08:39:28.848 INFO:tasks.workunit.client.0.smithi157.stdout:4/710: mkdir da/df/d2f/d64/d8f/dbd/d68/dce/df7 0 2024-04-03T08:39:28.852 INFO:tasks.workunit.client.0.smithi157.stdout:7/793: mkdir d0/d11/d6f/d89/d8c/dc6/d116 0 2024-04-03T08:39:28.853 INFO:tasks.workunit.client.0.smithi157.stdout:5/777: readlink l9 0 2024-04-03T08:39:28.854 INFO:tasks.workunit.client.1.smithi181.stdout:8/537: write d4/d44/d59/d5f/d6c/f81 [2363918,22599] 0 2024-04-03T08:39:28.854 INFO:tasks.workunit.client.1.smithi181.stdout:6/627: read - d6/d31/d36/dba/da6/d4f/fa9 zero size 2024-04-03T08:39:28.856 INFO:tasks.workunit.client.1.smithi181.stdout:7/538: symlink d0/d1/d6/de/d17/lc6 0 2024-04-03T08:39:28.857 INFO:tasks.workunit.client.0.smithi157.stdout:9/769: unlink d1/d36/d46/f92 0 2024-04-03T08:39:28.858 INFO:tasks.workunit.client.1.smithi181.stdout:6/628: fdatasync d6/d3e/d40/fb3 0 2024-04-03T08:39:28.859 INFO:tasks.workunit.client.0.smithi157.stdout:9/770: write d1/d15/f1a [970141,99273] 0 2024-04-03T08:39:28.867 INFO:tasks.workunit.client.0.smithi157.stdout:3/696: symlink d8/d1e/d2d/d39/d51/d4c/dd6/de0/lf6 0 2024-04-03T08:39:28.871 INFO:tasks.workunit.client.1.smithi181.stdout:2/680: rename d13/d1c/f36 to d13/d1c/d6c/d7a/ffe 0 2024-04-03T08:39:28.874 INFO:tasks.workunit.client.0.smithi157.stdout:8/745: sync 2024-04-03T08:39:28.876 INFO:tasks.workunit.client.0.smithi157.stdout:4/711: rename da/d26/c2b to da/df/d99/ddb/cf8 0 2024-04-03T08:39:28.879 INFO:tasks.workunit.client.1.smithi181.stdout:4/637: mknod d1/d16/d24/d5e/d3f/cd6 0 2024-04-03T08:39:28.880 INFO:tasks.workunit.client.0.smithi157.stdout:5/778: chown dc/d29/d56/d49/d7f/l8a 24 1 2024-04-03T08:39:28.884 INFO:tasks.workunit.client.1.smithi181.stdout:1/618: truncate d10/d15/d17/d19/d33/fa0 3503041 0 2024-04-03T08:39:28.888 INFO:tasks.workunit.client.1.smithi181.stdout:7/539: dread d0/f2f [4194304,4194304] 0 2024-04-03T08:39:28.891 INFO:tasks.workunit.client.1.smithi181.stdout:0/584: getdents d5/d9 0 2024-04-03T08:39:28.891 INFO:tasks.workunit.client.1.smithi181.stdout:7/540: chown d0/d1/d6/de/d17/f62 21 1 2024-04-03T08:39:28.892 INFO:tasks.workunit.client.1.smithi181.stdout:5/595: sync 2024-04-03T08:39:28.893 INFO:tasks.workunit.client.0.smithi157.stdout:1/691: creat d2/d11/d24/d39/d3b/fdf x:0 0 0 2024-04-03T08:39:28.896 INFO:tasks.workunit.client.0.smithi157.stdout:6/762: link d1/d5/d17/d29/d80/fc6 d1/d5/d17/d29/da7/db9/f102 0 2024-04-03T08:39:28.899 INFO:tasks.workunit.client.0.smithi157.stdout:5/779: dread fa [0,4194304] 0 2024-04-03T08:39:28.901 INFO:tasks.workunit.client.0.smithi157.stdout:4/712: read da/df/d24/f5c [1773264,46359] 0 2024-04-03T08:39:28.903 INFO:tasks.workunit.client.1.smithi181.stdout:3/640: getdents d0/d5/d6/dd/d5f/d95 0 2024-04-03T08:39:28.909 INFO:tasks.workunit.client.0.smithi157.stdout:0/775: getdents d2/d9/dc/dbe/dfb 0 2024-04-03T08:39:28.911 INFO:tasks.workunit.client.1.smithi181.stdout:5/596: unlink d4/f32 0 2024-04-03T08:39:28.914 INFO:tasks.workunit.client.1.smithi181.stdout:8/538: write d4/d2a/f6d [82011,54875] 0 2024-04-03T08:39:28.914 INFO:tasks.workunit.client.0.smithi157.stdout:2/746: dwrite d3/d2e/f3b [0,4194304] 0 2024-04-03T08:39:28.917 INFO:tasks.workunit.client.0.smithi157.stdout:1/692: truncate d2/d11/d23/dc9/d58/d62/f95 273731 0 2024-04-03T08:39:28.917 INFO:tasks.workunit.client.0.smithi157.stdout:2/747: dread - d3/d12/d43/d4b/fe6 zero size 2024-04-03T08:39:28.917 INFO:tasks.workunit.client.1.smithi181.stdout:6/629: write d6/d53/d80/f86 [1664522,798] 0 2024-04-03T08:39:28.918 INFO:tasks.workunit.client.1.smithi181.stdout:4/638: mknod d1/d16/cd7 0 2024-04-03T08:39:28.920 INFO:tasks.workunit.client.0.smithi157.stdout:2/748: chown d3/d2e/d32/de3/d103 35064814 1 2024-04-03T08:39:28.921 INFO:tasks.workunit.client.1.smithi181.stdout:1/619: rmdir d10/d15/d17/d19/d33 39 2024-04-03T08:39:28.922 INFO:tasks.workunit.client.1.smithi181.stdout:4/639: read d1/d16/d24/d5e/d31/f75 [49729,46734] 0 2024-04-03T08:39:28.923 INFO:tasks.workunit.client.1.smithi181.stdout:9/652: truncate d1/da/d1a/f4c 3689928 0 2024-04-03T08:39:28.924 INFO:tasks.workunit.client.1.smithi181.stdout:0/585: symlink d5/d9/d2a/da1/da8/lbb 0 2024-04-03T08:39:28.924 INFO:tasks.workunit.client.0.smithi157.stdout:3/697: write d8/f11 [4309938,43526] 0 2024-04-03T08:39:28.930 INFO:tasks.workunit.client.0.smithi157.stdout:7/794: unlink d0/d11/d15/d17/d1c/l58 0 2024-04-03T08:39:28.932 INFO:tasks.workunit.client.0.smithi157.stdout:8/746: write d2/d11/f93 [109386,39694] 0 2024-04-03T08:39:28.936 INFO:tasks.workunit.client.1.smithi181.stdout:5/597: chown d4/d44/c47 3 1 2024-04-03T08:39:28.937 INFO:tasks.workunit.client.1.smithi181.stdout:8/539: dread d4/d44/fb3 [0,4194304] 0 2024-04-03T08:39:28.937 INFO:tasks.workunit.client.1.smithi181.stdout:2/681: link d13/d1c/l45 d13/d1c/d4a/d68/dba/lff 0 2024-04-03T08:39:28.939 INFO:tasks.workunit.client.1.smithi181.stdout:8/540: read d4/d45/db/d14/fa6 [1221165,6927] 0 2024-04-03T08:39:28.941 INFO:tasks.workunit.client.1.smithi181.stdout:8/541: chown d4/d45/db/d14/d31/f30 1223119 1 2024-04-03T08:39:28.945 INFO:tasks.workunit.client.0.smithi157.stdout:0/776: dread d2/f3 [0,4194304] 0 2024-04-03T08:39:28.946 INFO:tasks.workunit.client.0.smithi157.stdout:2/749: dread d3/d2e/d32/fb7 [0,4194304] 0 2024-04-03T08:39:28.947 INFO:tasks.workunit.client.0.smithi157.stdout:5/780: write dc/f59 [1035095,61311] 0 2024-04-03T08:39:28.950 INFO:tasks.workunit.client.1.smithi181.stdout:1/620: creat d10/d15/d4a/fc2 x:0 0 0 2024-04-03T08:39:28.954 INFO:tasks.workunit.client.1.smithi181.stdout:4/640: rename d1/c2 to d1/d16/d24/d5e/d31/d39/da1/cd8 0 2024-04-03T08:39:28.956 INFO:tasks.workunit.client.0.smithi157.stdout:4/713: mkdir da/df/d11/df9 0 2024-04-03T08:39:28.957 INFO:tasks.workunit.client.1.smithi181.stdout:0/586: dread d5/d9/d2c/f69 [0,4194304] 0 2024-04-03T08:39:28.958 INFO:tasks.workunit.client.1.smithi181.stdout:5/598: mknod d4/d18/d25/d59/cbc 0 2024-04-03T08:39:28.962 INFO:tasks.workunit.client.0.smithi157.stdout:3/698: write d8/d1e/d2d/d39/d51/d4c/f40 [4902184,130643] 0 2024-04-03T08:39:28.967 INFO:tasks.workunit.client.0.smithi157.stdout:0/777: rmdir d2/d9/d5f/d105 39 2024-04-03T08:39:28.970 INFO:tasks.workunit.client.1.smithi181.stdout:6/630: dwrite d6/d3e/d5e/d7c/f6d [0,4194304] 0 2024-04-03T08:39:28.972 INFO:tasks.workunit.client.0.smithi157.stdout:6/763: rename d1/d5/d1b/f1c to d1/d5/d17/d29/f103 0 2024-04-03T08:39:28.973 INFO:tasks.workunit.client.1.smithi181.stdout:7/541: link d0/d1/d6/de/c8d d0/d1/d6/de/cc7 0 2024-04-03T08:39:28.973 INFO:tasks.workunit.client.0.smithi157.stdout:7/795: dwrite d0/d11/f1d [0,4194304] 0 2024-04-03T08:39:28.975 INFO:tasks.workunit.client.1.smithi181.stdout:8/542: dread d4/d45/db/f8c [0,4194304] 0 2024-04-03T08:39:28.977 INFO:tasks.workunit.client.0.smithi157.stdout:5/781: fdatasync dc/d29/d56/d18/d21/f5d 0 2024-04-03T08:39:28.977 INFO:tasks.workunit.client.0.smithi157.stdout:2/750: mknod d3/db/d44/d4c/d5a/d88/d97/c106 0 2024-04-03T08:39:28.978 INFO:tasks.workunit.client.1.smithi181.stdout:7/542: chown d0/d1/d6/de/d17/d64/d85/d9a/da4/f89 97480 1 2024-04-03T08:39:28.978 INFO:tasks.workunit.client.1.smithi181.stdout:9/653: write d1/da/d28/d30/f6a [1927262,61551] 0 2024-04-03T08:39:28.979 INFO:tasks.workunit.client.0.smithi157.stdout:4/714: rmdir da/df/d2f/dbc 39 2024-04-03T08:39:28.979 INFO:tasks.workunit.client.1.smithi181.stdout:4/641: chown d1/d16/d24/d5e/d2b/d56/c9b 136696563 1 2024-04-03T08:39:28.981 INFO:tasks.workunit.client.1.smithi181.stdout:4/642: stat d1/d1e/f5b 0 2024-04-03T08:39:28.988 INFO:tasks.workunit.client.0.smithi157.stdout:9/771: dwrite d1/d94/dbe/dbf/fc2 [0,4194304] 0 2024-04-03T08:39:28.993 INFO:tasks.workunit.client.1.smithi181.stdout:7/543: dread d0/d1/d6/de/f42 [0,4194304] 0 2024-04-03T08:39:28.997 INFO:tasks.workunit.client.0.smithi157.stdout:3/699: symlink d8/d1e/d2d/d39/d51/d4c/dd6/de0/lf7 0 2024-04-03T08:39:28.999 INFO:tasks.workunit.client.0.smithi157.stdout:0/778: symlink d2/d9/dc/df/d6f/d9d/d6a/l116 0 2024-04-03T08:39:29.000 INFO:tasks.workunit.client.1.smithi181.stdout:1/621: mkdir d10/d15/d17/d19/dc3 0 2024-04-03T08:39:29.002 INFO:tasks.workunit.client.0.smithi157.stdout:3/700: truncate d8/d13/d1b/d83/fea 382950 0 2024-04-03T08:39:29.003 INFO:tasks.workunit.client.1.smithi181.stdout:4/643: creat d1/d16/d24/db5/fd9 x:0 0 0 2024-04-03T08:39:29.005 INFO:tasks.workunit.client.1.smithi181.stdout:8/543: rename d4/d45/db/d14/d31/d1c/f85 to d4/d45/db/d5c/fb8 0 2024-04-03T08:39:29.006 INFO:tasks.workunit.client.1.smithi181.stdout:0/587: symlink d5/dc/lbc 0 2024-04-03T08:39:29.008 INFO:tasks.workunit.client.1.smithi181.stdout:0/588: write d5/dc/d14/d8d/f9a [392840,113742] 0 2024-04-03T08:39:29.010 INFO:tasks.workunit.client.0.smithi157.stdout:9/772: mkdir d1/dab/d103 0 2024-04-03T08:39:29.011 INFO:tasks.workunit.client.1.smithi181.stdout:7/544: read - d0/d1/d6/de/d17/d27/f56 zero size 2024-04-03T08:39:29.012 INFO:tasks.workunit.client.0.smithi157.stdout:8/747: link d2/d11/d10/d24/d5b/d2e/d75/faa d2/d6f/d70/d89/d59/df6/f102 0 2024-04-03T08:39:29.013 INFO:tasks.workunit.client.1.smithi181.stdout:1/622: symlink d10/d15/d41/lc4 0 2024-04-03T08:39:29.013 INFO:tasks.workunit.client.0.smithi157.stdout:1/693: getdents d2/d11/d23/dc9 0 2024-04-03T08:39:29.014 INFO:tasks.workunit.client.1.smithi181.stdout:0/589: write d5/dc/d14/d29/f4d [4346846,44372] 0 2024-04-03T08:39:29.015 INFO:tasks.workunit.client.1.smithi181.stdout:1/623: readlink d10/d15/d17/d30/l8f 0 2024-04-03T08:39:29.020 INFO:tasks.workunit.client.0.smithi157.stdout:5/782: mknod dc/cfe 0 2024-04-03T08:39:29.028 INFO:tasks.workunit.client.1.smithi181.stdout:8/544: rename d4/d45/db/d14/l41 to d4/d44/d59/lb9 0 2024-04-03T08:39:29.030 INFO:tasks.workunit.client.0.smithi157.stdout:8/748: mkdir d2/d11/d10/d24/d5b/d2e/d94/ddb/d103 0 2024-04-03T08:39:29.031 INFO:tasks.workunit.client.1.smithi181.stdout:8/545: readlink d4/d45/db/d14/d31/d1c/laf 0 2024-04-03T08:39:29.031 INFO:tasks.workunit.client.1.smithi181.stdout:0/590: symlink d5/d9/d2a/da1/da8/lbd 0 2024-04-03T08:39:29.034 INFO:tasks.workunit.client.1.smithi181.stdout:6/631: write d6/d31/d36/f9c [863432,83958] 0 2024-04-03T08:39:29.035 INFO:tasks.workunit.client.1.smithi181.stdout:9/654: getdents d1/da/d28/d30/d3e 0 2024-04-03T08:39:29.039 INFO:tasks.workunit.client.1.smithi181.stdout:6/632: read d6/d3e/d40/fb3 [11376,61355] 0 2024-04-03T08:39:29.042 INFO:tasks.workunit.client.0.smithi157.stdout:3/701: write d8/d1e/d2d/f54 [2470364,32276] 0 2024-04-03T08:39:29.043 INFO:tasks.workunit.client.0.smithi157.stdout:2/751: rename d3/d2e/d65/lbf to d3/d2e/l107 0 2024-04-03T08:39:29.044 INFO:tasks.workunit.client.0.smithi157.stdout:9/773: write d1/d15/d16/f67 [1788856,95412] 0 2024-04-03T08:39:29.045 INFO:tasks.workunit.client.0.smithi157.stdout:5/783: mkdir dc/d29/d56/d18/d21/dff 0 2024-04-03T08:39:29.045 INFO:tasks.workunit.client.1.smithi181.stdout:7/545: write d0/d1/d6/de/f69 [1312951,79518] 0 2024-04-03T08:39:29.047 INFO:tasks.workunit.client.1.smithi181.stdout:3/641: sync 2024-04-03T08:39:29.047 INFO:tasks.workunit.client.0.smithi157.stdout:7/796: write d0/d11/d15/d17/d52/f5a [4124890,82425] 0 2024-04-03T08:39:29.050 INFO:tasks.workunit.client.1.smithi181.stdout:1/624: dread d10/d15/d17/d30/f38 [0,4194304] 0 2024-04-03T08:39:29.050 INFO:tasks.workunit.client.0.smithi157.stdout:9/774: write d1/d15/fc9 [814245,111896] 0 2024-04-03T08:39:29.050 INFO:tasks.workunit.client.0.smithi157.stdout:4/715: dread da/d26/f3d [0,4194304] 0 2024-04-03T08:39:29.051 INFO:tasks.workunit.client.1.smithi181.stdout:3/642: read d0/d17/f54 [1286268,22081] 0 2024-04-03T08:39:29.051 INFO:tasks.workunit.client.1.smithi181.stdout:0/591: creat d5/d9/d2a/fbe x:0 0 0 2024-04-03T08:39:29.053 INFO:tasks.workunit.client.1.smithi181.stdout:9/655: rmdir d1/da/d13/d41/d65 39 2024-04-03T08:39:29.053 INFO:tasks.workunit.client.1.smithi181.stdout:4/644: dwrite d1/d16/f23 [0,4194304] 0 2024-04-03T08:39:29.055 INFO:tasks.workunit.client.0.smithi157.stdout:1/694: symlink d2/d11/d23/dc9/d5d/le0 0 2024-04-03T08:39:29.055 INFO:tasks.workunit.client.1.smithi181.stdout:0/592: chown d5/dc/d14/f55 3180 1 2024-04-03T08:39:29.056 INFO:tasks.workunit.client.0.smithi157.stdout:8/749: creat d2/d11/d10/d24/d5b/d2e/d75/d81/f104 x:0 0 0 2024-04-03T08:39:29.057 INFO:tasks.workunit.client.1.smithi181.stdout:6/633: fsync d6/d3e/d5e/f90 0 2024-04-03T08:39:29.058 INFO:tasks.workunit.client.1.smithi181.stdout:8/546: stat d4/d2a/d37/d67/l95 0 2024-04-03T08:39:29.058 INFO:tasks.workunit.client.1.smithi181.stdout:3/643: truncate d0/d5/d6/d32/daa/fd5 905675 0 2024-04-03T08:39:29.059 INFO:tasks.workunit.client.0.smithi157.stdout:6/764: link d1/d5/d17/d2a/d40/dec/f91 d1/d5/f104 0 2024-04-03T08:39:29.064 INFO:tasks.workunit.client.0.smithi157.stdout:0/779: rename d2/fef to d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/f117 0 2024-04-03T08:39:29.066 INFO:tasks.workunit.client.1.smithi181.stdout:3/644: dread d0/d5/d6/d32/daa/fc6 [0,4194304] 0 2024-04-03T08:39:29.068 INFO:tasks.workunit.client.0.smithi157.stdout:2/752: truncate d3/db/f7e 615322 0 2024-04-03T08:39:29.069 INFO:tasks.workunit.client.1.smithi181.stdout:7/546: mknod d0/d1/d6/de/d6d/cc8 0 2024-04-03T08:39:29.072 INFO:tasks.workunit.client.1.smithi181.stdout:1/625: fsync d10/d15/d17/d19/d33/f73 0 2024-04-03T08:39:29.077 INFO:tasks.workunit.client.0.smithi157.stdout:9/775: unlink d1/d94/cb1 0 2024-04-03T08:39:29.085 INFO:tasks.workunit.client.0.smithi157.stdout:8/750: dread - d2/d20/d77/f7f zero size 2024-04-03T08:39:29.086 INFO:tasks.workunit.client.1.smithi181.stdout:8/547: readlink d4/d45/lb6 0 2024-04-03T08:39:29.087 INFO:tasks.workunit.client.0.smithi157.stdout:4/716: mknod da/df/d99/cfa 0 2024-04-03T08:39:29.088 INFO:tasks.workunit.client.1.smithi181.stdout:4/645: write d1/d16/f13 [1828070,89376] 0 2024-04-03T08:39:29.089 INFO:tasks.workunit.client.1.smithi181.stdout:6/634: mkdir d6/d3e/db1/dc4 0 2024-04-03T08:39:29.091 INFO:tasks.workunit.client.0.smithi157.stdout:7/797: readlink d0/d11/d6f/d89/d8c/d103/daf/l113 0 2024-04-03T08:39:29.096 INFO:tasks.workunit.client.0.smithi157.stdout:6/765: read d1/d5/d17/d2a/f4d [313305,54523] 0 2024-04-03T08:39:29.096 INFO:tasks.workunit.client.0.smithi157.stdout:0/780: symlink d2/d9/dc/df/d1b/d4a/de4/df1/l118 0 2024-04-03T08:39:29.100 INFO:tasks.workunit.client.0.smithi157.stdout:5/784: rename dc/d29/d43/da1/fa8 to dc/d29/d56/d49/d53/d6c/ddb/f100 0 2024-04-03T08:39:29.102 INFO:tasks.workunit.client.0.smithi157.stdout:3/702: write d8/d13/f1a [3436686,98999] 0 2024-04-03T08:39:29.103 INFO:tasks.workunit.client.0.smithi157.stdout:5/785: dread - dc/d29/d56/d49/d53/d6c/f8e zero size 2024-04-03T08:39:29.108 INFO:tasks.workunit.client.0.smithi157.stdout:4/717: mknod da/df/d2f/d54/d5f/cfb 0 2024-04-03T08:39:29.108 INFO:tasks.workunit.client.0.smithi157.stdout:8/751: readlink d2/d20/d77/lea 0 2024-04-03T08:39:29.109 INFO:tasks.workunit.client.1.smithi181.stdout:0/593: dwrite d5/d9/d2c/f7a [4194304,4194304] 0 2024-04-03T08:39:29.114 INFO:tasks.workunit.client.1.smithi181.stdout:8/548: dwrite d4/d2a/d37/fac [0,4194304] 0 2024-04-03T08:39:29.115 INFO:tasks.workunit.client.1.smithi181.stdout:7/547: symlink d0/d1/lc9 0 2024-04-03T08:39:29.117 INFO:tasks.workunit.client.1.smithi181.stdout:8/549: dread - d4/d44/f82 zero size 2024-04-03T08:39:29.118 INFO:tasks.workunit.client.0.smithi157.stdout:0/781: creat d2/d9/d51/d63/d71/f119 x:0 0 0 2024-04-03T08:39:29.122 INFO:tasks.workunit.client.1.smithi181.stdout:6/635: link d6/d3e/d5e/d7c/f3f d6/dc0/fc5 0 2024-04-03T08:39:29.123 INFO:tasks.workunit.client.1.smithi181.stdout:1/626: write d10/d15/d17/d19/d33/f7d [198850,107838] 0 2024-04-03T08:39:29.125 INFO:tasks.workunit.client.0.smithi157.stdout:3/703: fsync f4 0 2024-04-03T08:39:29.125 INFO:tasks.workunit.client.0.smithi157.stdout:9/776: mknod d1/dab/dad/d100/c104 0 2024-04-03T08:39:29.127 INFO:tasks.workunit.client.1.smithi181.stdout:6/636: chown d6/d31/d36/dba/da6/l8a 1343 1 2024-04-03T08:39:29.131 INFO:tasks.workunit.client.1.smithi181.stdout:0/594: mkdir d5/dc/d10/d30/dbf 0 2024-04-03T08:39:29.131 INFO:tasks.workunit.client.1.smithi181.stdout:9/656: getdents d1/da/d13/d22/d23/d36/d91/d9d/d39 0 2024-04-03T08:39:29.131 INFO:tasks.workunit.client.1.smithi181.stdout:2/682: sync 2024-04-03T08:39:29.132 INFO:tasks.workunit.client.1.smithi181.stdout:3/645: creat d0/d17/d40/fd7 x:0 0 0 2024-04-03T08:39:29.133 INFO:tasks.workunit.client.0.smithi157.stdout:8/752: read d2/d11/f95 [2691516,105230] 0 2024-04-03T08:39:29.134 INFO:tasks.workunit.client.1.smithi181.stdout:8/550: mknod d4/d2a/cba 0 2024-04-03T08:39:29.135 INFO:tasks.workunit.client.1.smithi181.stdout:9/657: truncate d1/da/d13/d22/fca 329860 0 2024-04-03T08:39:29.135 INFO:tasks.workunit.client.0.smithi157.stdout:0/782: readlink d2/d9/dc/l46 0 2024-04-03T08:39:29.136 INFO:tasks.workunit.client.1.smithi181.stdout:1/627: fdatasync d10/d15/d4b/d6c/f9f 0 2024-04-03T08:39:29.136 INFO:tasks.workunit.client.0.smithi157.stdout:1/695: dwrite d2/f45 [0,4194304] 0 2024-04-03T08:39:29.139 INFO:tasks.workunit.client.0.smithi157.stdout:6/766: mkdir d1/d5/d17/d29/da7/db9/df0/d105 0 2024-04-03T08:39:29.141 INFO:tasks.workunit.client.0.smithi157.stdout:3/704: rmdir d8/d1e/d2d/d3b/d8c/db4 39 2024-04-03T08:39:29.144 INFO:tasks.workunit.client.0.smithi157.stdout:4/718: symlink da/d7e/lfc 0 2024-04-03T08:39:29.149 INFO:tasks.workunit.client.1.smithi181.stdout:6/637: symlink d6/lc6 0 2024-04-03T08:39:29.149 INFO:tasks.workunit.client.0.smithi157.stdout:8/753: mknod d2/d11/d10/d24/d5b/d2e/dcf/dd2/c105 0 2024-04-03T08:39:29.151 INFO:tasks.workunit.client.0.smithi157.stdout:1/696: mkdir d2/d11/d23/de1 0 2024-04-03T08:39:29.152 INFO:tasks.workunit.client.1.smithi181.stdout:1/628: readlink d10/d15/d17/d23/d27/l75 0 2024-04-03T08:39:29.153 INFO:tasks.workunit.client.1.smithi181.stdout:4/646: dwrite d1/d16/d24/d5e/d3f/d41/f87 [0,4194304] 0 2024-04-03T08:39:29.154 INFO:tasks.workunit.client.0.smithi157.stdout:8/754: truncate d2/d11/d10/fe9 674953 0 2024-04-03T08:39:29.157 INFO:tasks.workunit.client.1.smithi181.stdout:3/646: rename d0/d5/d6/l3d to d0/d5/d77/ld8 0 2024-04-03T08:39:29.161 INFO:tasks.workunit.client.1.smithi181.stdout:8/551: mkdir d4/d44/dbb 0 2024-04-03T08:39:29.161 INFO:tasks.workunit.client.0.smithi157.stdout:5/786: getdents dc/d29/d56/d49/d53 0 2024-04-03T08:39:29.162 INFO:tasks.workunit.client.1.smithi181.stdout:4/647: fsync d1/d1e/f2e 0 2024-04-03T08:39:29.163 INFO:tasks.workunit.client.0.smithi157.stdout:1/697: creat d2/d11/d24/d39/d3b/d1b/d84/fe2 x:0 0 0 2024-04-03T08:39:29.165 INFO:tasks.workunit.client.0.smithi157.stdout:4/719: dread da/d26/f3d [0,4194304] 0 2024-04-03T08:39:29.165 INFO:tasks.workunit.client.0.smithi157.stdout:5/787: readlink dc/d29/d56/d52/lee 0 2024-04-03T08:39:29.165 INFO:tasks.workunit.client.0.smithi157.stdout:8/755: stat d2/d20/f29 0 2024-04-03T08:39:29.166 INFO:tasks.workunit.client.1.smithi181.stdout:2/683: symlink d13/d7b/ddc/l100 0 2024-04-03T08:39:29.166 INFO:tasks.workunit.client.1.smithi181.stdout:9/658: mkdir d1/dcb 0 2024-04-03T08:39:29.167 INFO:tasks.workunit.client.1.smithi181.stdout:1/629: symlink d10/d15/d17/d19/d33/d70/lc5 0 2024-04-03T08:39:29.168 INFO:tasks.workunit.client.1.smithi181.stdout:4/648: rmdir d1/d16/d24/d5e/d31/d39/d5d/d9a 39 2024-04-03T08:39:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:1/698: chown d2/d11/d23/dc9/d64/c77 6790811 1 2024-04-03T08:39:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:4/720: rename da/df/d2f to da/df/d2f/d64/d8f/dbd/dfd 22 2024-04-03T08:39:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:8/756: stat d2/d6f/d70/la4 0 2024-04-03T08:39:29.173 INFO:tasks.workunit.client.1.smithi181.stdout:3/647: chown d0/d5/d6/dd/d25/d50/fcb 387008825 1 2024-04-03T08:39:29.178 INFO:tasks.workunit.client.1.smithi181.stdout:4/649: fdatasync d1/d16/d24/d5e/f4f 0 2024-04-03T08:39:29.179 INFO:tasks.workunit.client.0.smithi157.stdout:5/788: dread dc/d29/d56/d18/f37 [0,4194304] 0 2024-04-03T08:39:29.180 INFO:tasks.workunit.client.0.smithi157.stdout:2/753: truncate d3/d12/d43/d4b/f73 2674806 0 2024-04-03T08:39:29.189 INFO:tasks.workunit.client.0.smithi157.stdout:8/757: dwrite d2/f39 [0,4194304] 0 2024-04-03T08:39:29.190 INFO:tasks.workunit.client.1.smithi181.stdout:6/638: dwrite d6/d31/d36/dba/da6/d4f/f66 [0,4194304] 0 2024-04-03T08:39:29.201 INFO:tasks.workunit.client.0.smithi157.stdout:1/699: dread d2/d11/d23/fc1 [0,4194304] 0 2024-04-03T08:39:29.215 INFO:tasks.workunit.client.1.smithi181.stdout:9/659: dread d1/da/d28/f9a [0,4194304] 0 2024-04-03T08:39:29.216 INFO:tasks.workunit.client.1.smithi181.stdout:2/684: dwrite d13/d1c/da5/dac/ff3 [0,4194304] 0 2024-04-03T08:39:29.218 INFO:tasks.workunit.client.1.smithi181.stdout:3/648: dwrite d0/d5/d77/f8f [0,4194304] 0 2024-04-03T08:39:29.218 INFO:tasks.workunit.client.1.smithi181.stdout:5/599: sync 2024-04-03T08:39:29.219 INFO:tasks.workunit.client.1.smithi181.stdout:7/548: dread d0/d1/f4a [0,4194304] 0 2024-04-03T08:39:29.223 INFO:tasks.workunit.client.1.smithi181.stdout:3/649: truncate d0/d5/fa 1533687 0 2024-04-03T08:39:29.224 INFO:tasks.workunit.client.1.smithi181.stdout:2/685: chown d13/d1c/d4a/d68/dba/def 1714 1 2024-04-03T08:39:29.228 INFO:tasks.workunit.client.1.smithi181.stdout:8/552: dread d4/d45/db/d14/f20 [0,4194304] 0 2024-04-03T08:39:29.228 INFO:tasks.workunit.client.1.smithi181.stdout:3/650: write d0/d5/d6/fce [182200,18444] 0 2024-04-03T08:39:29.228 INFO:tasks.workunit.client.1.smithi181.stdout:5/600: truncate d4/d18/d25/d59/db3/fb8 1041240 0 2024-04-03T08:39:29.232 INFO:tasks.workunit.client.1.smithi181.stdout:8/553: stat d4/d2a/d37/ca0 0 2024-04-03T08:39:29.232 INFO:tasks.workunit.client.1.smithi181.stdout:5/601: chown d4/d18/l9e 7028813 1 2024-04-03T08:39:29.275 INFO:tasks.workunit.client.1.smithi181.stdout:4/650: dread - d1/d1e/d2c/f60 zero size 2024-04-03T08:39:29.284 INFO:tasks.workunit.client.0.smithi157.stdout:7/798: write d0/d11/d15/d1b/db8/f95 [166111,73925] 0 2024-04-03T08:39:29.289 INFO:tasks.workunit.client.0.smithi157.stdout:1/700: symlink d2/d11/d23/dc9/d5d/d9a/le3 0 2024-04-03T08:39:29.293 INFO:tasks.workunit.client.1.smithi181.stdout:7/549: rmdir d0/d1/d6/de 39 2024-04-03T08:39:29.298 INFO:tasks.workunit.client.1.smithi181.stdout:3/651: creat d0/d5/d6/d32/d43/d6b/fd9 x:0 0 0 2024-04-03T08:39:29.302 INFO:tasks.workunit.client.0.smithi157.stdout:7/799: creat d0/d11/d15/d17/d1c/df5/f117 x:0 0 0 2024-04-03T08:39:29.304 INFO:tasks.workunit.client.1.smithi181.stdout:5/602: mknod d4/d22/d53/cbd 0 2024-04-03T08:39:29.308 INFO:tasks.workunit.client.0.smithi157.stdout:6/767: write d1/d5/d17/f67 [4205096,49035] 0 2024-04-03T08:39:29.311 INFO:tasks.workunit.client.1.smithi181.stdout:0/595: dwrite d5/d9/d60/f82 [0,4194304] 0 2024-04-03T08:39:29.313 INFO:tasks.workunit.client.0.smithi157.stdout:0/783: dwrite d2/d9/d51/fdb [0,4194304] 0 2024-04-03T08:39:29.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:28 smithi157 ceph-mon[35083]: mgrmap e25: smithi181.mfhidq(active, since 15s), standbys: smithi157.qfvynr 2024-04-03T08:39:29.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:28 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:39:29.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:28 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:29.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:28 smithi157 ceph-mon[35083]: pgmap v11: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 152 MiB/s wr, 309 op/s 2024-04-03T08:39:29.315 INFO:tasks.workunit.client.1.smithi181.stdout:0/596: fsync d5/d9/f9e 0 2024-04-03T08:39:29.323 INFO:tasks.workunit.client.1.smithi181.stdout:7/550: fdatasync d0/d1/d6/de/d17/f55 0 2024-04-03T08:39:29.327 INFO:tasks.workunit.client.0.smithi157.stdout:4/721: write da/df/f57 [4039845,13959] 0 2024-04-03T08:39:29.329 INFO:tasks.workunit.client.1.smithi181.stdout:3/652: creat d0/d17/d36/d1e/fda x:0 0 0 2024-04-03T08:39:29.329 INFO:tasks.workunit.client.1.smithi181.stdout:5/603: dread - d4/f86 zero size 2024-04-03T08:39:29.330 INFO:tasks.workunit.client.1.smithi181.stdout:5/604: chown d4/f86 94 1 2024-04-03T08:39:29.331 INFO:tasks.workunit.client.1.smithi181.stdout:3/653: dread - d0/d17/d36/fb9 zero size 2024-04-03T08:39:29.342 INFO:tasks.workunit.client.0.smithi157.stdout:3/705: dwrite d8/d13/d1b/d37/f97 [0,4194304] 0 2024-04-03T08:39:29.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:28 smithi181 ceph-mon[44183]: mgrmap e25: smithi181.mfhidq(active, since 15s), standbys: smithi157.qfvynr 2024-04-03T08:39:29.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:28 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:39:29.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:28 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:28 smithi181 ceph-mon[44183]: pgmap v11: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 152 MiB/s wr, 309 op/s 2024-04-03T08:39:29.349 INFO:tasks.workunit.client.0.smithi157.stdout:6/768: link d1/d5/d17/d29/d62/d7f/f90 d1/d5/d17/d2a/d30/d77/f106 0 2024-04-03T08:39:29.351 INFO:tasks.workunit.client.1.smithi181.stdout:9/660: truncate d1/da/d13/d73/f7d 1826833 0 2024-04-03T08:39:29.357 INFO:tasks.workunit.client.0.smithi157.stdout:3/706: rename d8/d1e/d2d/d39/d51/d7e/lde to d8/d1e/d2d/d3b/d9e/lf8 0 2024-04-03T08:39:29.360 INFO:tasks.workunit.client.1.smithi181.stdout:2/686: rmdir d13/da7/d40/df5 0 2024-04-03T08:39:29.367 INFO:tasks.workunit.client.0.smithi157.stdout:3/707: truncate d8/d13/d1b/fa1 577867 0 2024-04-03T08:39:29.369 INFO:tasks.workunit.client.0.smithi157.stdout:3/708: readlink d8/d13/d1b/d37/le1 0 2024-04-03T08:39:29.370 INFO:tasks.workunit.client.1.smithi181.stdout:4/651: creat d1/d16/d24/d5e/d2b/fda x:0 0 0 2024-04-03T08:39:29.376 INFO:tasks.workunit.client.1.smithi181.stdout:6/639: getdents d6/d31/d36/dba/da6/d4f/d77 0 2024-04-03T08:39:29.380 INFO:tasks.workunit.client.0.smithi157.stdout:6/769: rmdir d1/d5/d1b/d97/dfd 0 2024-04-03T08:39:29.387 INFO:tasks.workunit.client.1.smithi181.stdout:9/661: rmdir d1/da/d1a/d92 39 2024-04-03T08:39:29.387 INFO:tasks.workunit.client.1.smithi181.stdout:2/687: symlink d13/da7/d27/l101 0 2024-04-03T08:39:29.388 INFO:tasks.workunit.client.0.smithi157.stdout:3/709: dread d8/d1e/d2d/d3b/d8c/f9c [0,4194304] 0 2024-04-03T08:39:29.389 INFO:tasks.workunit.client.1.smithi181.stdout:2/688: chown d13/fc1 12709713 1 2024-04-03T08:39:29.390 INFO:tasks.workunit.client.1.smithi181.stdout:7/551: mkdir d0/d1/d6/dca 0 2024-04-03T08:39:29.391 INFO:tasks.workunit.client.0.smithi157.stdout:6/770: mkdir d1/d5/d17/d2a/d37/dca/d107 0 2024-04-03T08:39:29.393 INFO:tasks.workunit.client.1.smithi181.stdout:4/652: truncate d1/d1e/d78/f97 1086654 0 2024-04-03T08:39:29.398 INFO:tasks.workunit.client.0.smithi157.stdout:3/710: rename d8/d13/d1b/d37 to d8/d1e/d2d/d3b/d9e/df9 0 2024-04-03T08:39:29.400 INFO:tasks.workunit.client.1.smithi181.stdout:2/689: symlink d13/da7/d85/l102 0 2024-04-03T08:39:29.405 INFO:tasks.workunit.client.1.smithi181.stdout:3/654: link d0/d5/d6/d32/d43/c47 d0/d17/d36/d8c/cdb 0 2024-04-03T08:39:29.415 INFO:tasks.workunit.client.1.smithi181.stdout:3/655: stat d0/d5/d6/f39 0 2024-04-03T08:39:29.415 INFO:tasks.workunit.client.1.smithi181.stdout:4/653: dwrite d1/d16/d37/d34/d69/fc7 [0,4194304] 0 2024-04-03T08:39:29.415 INFO:tasks.workunit.client.1.smithi181.stdout:7/552: creat d0/d1/d6/de/d17/d64/d85/fcb x:0 0 0 2024-04-03T08:39:29.416 INFO:tasks.workunit.client.0.smithi157.stdout:4/722: creat da/df/d2f/d64/d8f/ffe x:0 0 0 2024-04-03T08:39:29.417 INFO:tasks.workunit.client.0.smithi157.stdout:6/771: dwrite d1/d4b/da5/fa9 [4194304,4194304] 0 2024-04-03T08:39:29.418 INFO:tasks.workunit.client.1.smithi181.stdout:4/654: chown d1/d16 392 1 2024-04-03T08:39:29.421 INFO:tasks.workunit.client.0.smithi157.stdout:4/723: mknod da/df/d99/ddb/cff 0 2024-04-03T08:39:29.427 INFO:tasks.workunit.client.0.smithi157.stdout:4/724: mknod da/df/d2f/c100 0 2024-04-03T08:39:29.431 INFO:tasks.workunit.client.0.smithi157.stdout:4/725: mknod da/df/d11/df9/c101 0 2024-04-03T08:39:29.433 INFO:tasks.workunit.client.1.smithi181.stdout:2/690: dwrite d13/da7/d27/f8a [0,4194304] 0 2024-04-03T08:39:29.441 INFO:tasks.workunit.client.0.smithi157.stdout:6/772: dwrite d1/d5/d17/d29/d80/fdf [4194304,4194304] 0 2024-04-03T08:39:29.442 INFO:tasks.workunit.client.1.smithi181.stdout:2/691: mknod d13/d7b/c103 0 2024-04-03T08:39:29.454 INFO:tasks.workunit.client.1.smithi181.stdout:7/553: dwrite d0/d1/d6/de/d17/d27/f2e [0,4194304] 0 2024-04-03T08:39:29.455 INFO:tasks.workunit.client.1.smithi181.stdout:4/655: dwrite d1/d1e/d2c/f59 [0,4194304] 0 2024-04-03T08:39:29.472 INFO:tasks.workunit.client.1.smithi181.stdout:7/554: mknod d0/d1/d6/de/d6d/d96/dbf/ccc 0 2024-04-03T08:39:29.477 INFO:tasks.workunit.client.1.smithi181.stdout:7/555: readlink d0/d1/d6/de/d17/d64/la0 0 2024-04-03T08:39:29.488 INFO:tasks.workunit.client.1.smithi181.stdout:7/556: creat d0/d1/d6/de/d17/d64/d85/d9a/fcd x:0 0 0 2024-04-03T08:39:29.492 INFO:tasks.workunit.client.1.smithi181.stdout:4/656: dread d1/d16/d55/f62 [0,4194304] 0 2024-04-03T08:39:29.493 INFO:tasks.workunit.client.1.smithi181.stdout:7/557: fdatasync d0/d1/d6/de/f42 0 2024-04-03T08:39:29.495 INFO:tasks.workunit.client.0.smithi157.stdout:5/789: dwrite dc/d29/d56/d49/d53/d6c/f8e [0,4194304] 0 2024-04-03T08:39:29.498 INFO:tasks.workunit.client.0.smithi157.stdout:8/758: dwrite d2/d6f/db5/ffa [0,4194304] 0 2024-04-03T08:39:29.498 INFO:tasks.workunit.client.0.smithi157.stdout:5/790: stat dc/d29/d56/f26 0 2024-04-03T08:39:29.509 INFO:tasks.workunit.client.0.smithi157.stdout:7/800: dwrite d0/f20 [0,4194304] 0 2024-04-03T08:39:29.517 INFO:tasks.workunit.client.0.smithi157.stdout:8/759: stat d2/l32 0 2024-04-03T08:39:29.517 INFO:tasks.workunit.client.0.smithi157.stdout:5/791: creat dc/d29/d56/d9e/db5/dc9/f101 x:0 0 0 2024-04-03T08:39:29.531 INFO:tasks.workunit.client.0.smithi157.stdout:8/760: unlink d2/d6f/d70/la4 0 2024-04-03T08:39:29.533 INFO:tasks.workunit.client.0.smithi157.stdout:5/792: creat dc/d29/d56/d52/d9d/da5/daa/f102 x:0 0 0 2024-04-03T08:39:29.536 INFO:tasks.workunit.client.1.smithi181.stdout:0/597: dwrite d5/dc/d10/d58/d6c/f15 [0,4194304] 0 2024-04-03T08:39:29.544 INFO:tasks.workunit.client.0.smithi157.stdout:5/793: mknod dc/d29/d56/d52/d9d/da5/dfd/c103 0 2024-04-03T08:39:29.550 INFO:tasks.workunit.client.0.smithi157.stdout:9/777: sync 2024-04-03T08:39:29.551 INFO:tasks.workunit.client.1.smithi181.stdout:7/558: rmdir d0/d1/d6/de/d17/d27/d72/db6 0 2024-04-03T08:39:29.554 INFO:tasks.workunit.client.0.smithi157.stdout:9/778: truncate d1/d15/dca/ffc 145554 0 2024-04-03T08:39:29.558 INFO:tasks.workunit.client.1.smithi181.stdout:7/559: stat d0/d1/d6/de/d17/d27/cbe 0 2024-04-03T08:39:29.560 INFO:tasks.workunit.client.0.smithi157.stdout:8/761: creat d2/d20/f106 x:0 0 0 2024-04-03T08:39:29.564 INFO:tasks.workunit.client.1.smithi181.stdout:7/560: symlink d0/d1/d6/de/d17/d64/d85/d87/lce 0 2024-04-03T08:39:29.565 INFO:tasks.workunit.client.0.smithi157.stdout:5/794: dwrite dc/d29/d56/d9e/db5/fd2 [0,4194304] 0 2024-04-03T08:39:29.566 INFO:tasks.workunit.client.0.smithi157.stdout:8/762: truncate d2/d20/f3c 1249028 0 2024-04-03T08:39:29.566 INFO:tasks.workunit.client.1.smithi181.stdout:0/598: dread d5/d9/f97 [0,4194304] 0 2024-04-03T08:39:29.567 INFO:tasks.workunit.client.1.smithi181.stdout:7/561: write d0/d1/d6/de/f2a [778213,41324] 0 2024-04-03T08:39:29.568 INFO:tasks.workunit.client.0.smithi157.stdout:5/795: creat dc/d29/d43/f104 x:0 0 0 2024-04-03T08:39:29.571 INFO:tasks.workunit.client.1.smithi181.stdout:6/640: truncate d6/d3e/d5e/d7c/f6d 1886881 0 2024-04-03T08:39:29.571 INFO:tasks.workunit.client.1.smithi181.stdout:0/599: truncate d5/dc/d75/fb9 1514807 0 2024-04-03T08:39:29.573 INFO:tasks.workunit.client.1.smithi181.stdout:9/662: truncate d1/da/d28/d80/f97 2111596 0 2024-04-03T08:39:29.578 INFO:tasks.workunit.client.1.smithi181.stdout:6/641: symlink d6/d53/d8d/d97/db0/lc7 0 2024-04-03T08:39:29.578 INFO:tasks.workunit.client.0.smithi157.stdout:3/711: dwrite d8/d1e/d2d/d39/f5f [4194304,4194304] 0 2024-04-03T08:39:29.579 INFO:tasks.workunit.client.0.smithi157.stdout:5/796: creat dc/d29/d56/d49/f105 x:0 0 0 2024-04-03T08:39:29.582 INFO:tasks.workunit.client.1.smithi181.stdout:9/663: mkdir d1/da/d13/d22/d23/d36/d91/d9d/d39/dcc 0 2024-04-03T08:39:29.584 INFO:tasks.workunit.client.1.smithi181.stdout:7/562: dread d0/d1/d6/de/f2a [0,4194304] 0 2024-04-03T08:39:29.593 INFO:tasks.workunit.client.1.smithi181.stdout:9/664: write d1/da/d13/d22/d23/fba [4767069,21263] 0 2024-04-03T08:39:29.594 INFO:tasks.workunit.client.1.smithi181.stdout:7/563: symlink d0/d1/d6/de/d6d/d96/dbf/lcf 0 2024-04-03T08:39:29.595 INFO:tasks.workunit.client.0.smithi157.stdout:3/712: rmdir d8/d13/d1b/d4e/da6 39 2024-04-03T08:39:29.599 INFO:tasks.workunit.client.1.smithi181.stdout:0/600: symlink d5/lc0 0 2024-04-03T08:39:29.600 INFO:tasks.workunit.client.0.smithi157.stdout:5/797: getdents dc/d29 0 2024-04-03T08:39:29.605 INFO:tasks.workunit.client.0.smithi157.stdout:9/779: symlink d1/d15/l105 0 2024-04-03T08:39:29.607 INFO:tasks.workunit.client.0.smithi157.stdout:5/798: unlink dc/d29/d43/f69 0 2024-04-03T08:39:29.608 INFO:tasks.workunit.client.1.smithi181.stdout:0/601: symlink d5/dc/d75/daa/lc1 0 2024-04-03T08:39:29.610 INFO:tasks.workunit.client.1.smithi181.stdout:3/656: sync 2024-04-03T08:39:29.613 INFO:tasks.workunit.client.0.smithi157.stdout:4/726: dwrite da/df/d2f/d64/f7b [0,4194304] 0 2024-04-03T08:39:29.616 INFO:tasks.workunit.client.1.smithi181.stdout:0/602: chown d5/d9/d60/c87 7909438 1 2024-04-03T08:39:29.618 INFO:tasks.workunit.client.0.smithi157.stdout:4/727: fsync da/df/d24/d35/d53/d69/fca 0 2024-04-03T08:39:29.619 INFO:tasks.workunit.client.1.smithi181.stdout:2/692: write d13/d1c/d4a/f4d [2615299,94174] 0 2024-04-03T08:39:29.620 INFO:tasks.workunit.client.1.smithi181.stdout:0/603: chown d5/dc/d10/d58/lb6 29913140 1 2024-04-03T08:39:29.621 INFO:tasks.workunit.client.1.smithi181.stdout:1/630: creat d10/d15/d17/d19/fc6 x:0 0 0 2024-04-03T08:39:29.621 INFO:tasks.workunit.client.0.smithi157.stdout:3/713: dread d8/d13/d1b/d4e/da6/f9d [0,4194304] 0 2024-04-03T08:39:29.621 INFO:tasks.workunit.client.1.smithi181.stdout:9/665: dread d1/da/d13/d22/d23/d54/f98 [0,4194304] 0 2024-04-03T08:39:29.624 INFO:tasks.workunit.client.1.smithi181.stdout:6/642: dread d6/d3e/d5e/d7c/f85 [0,4194304] 0 2024-04-03T08:39:29.625 INFO:tasks.workunit.client.1.smithi181.stdout:3/657: creat d0/d5/d6/d32/fdc x:0 0 0 2024-04-03T08:39:29.625 INFO:tasks.workunit.client.0.smithi157.stdout:4/728: rmdir da/df/d24/d35/d53/d69 39 2024-04-03T08:39:29.626 INFO:tasks.workunit.client.1.smithi181.stdout:0/604: fdatasync d5/fb 0 2024-04-03T08:39:29.629 INFO:tasks.workunit.client.1.smithi181.stdout:9/666: creat d1/da/d13/d41/d32/fcd x:0 0 0 2024-04-03T08:39:29.629 INFO:tasks.workunit.client.1.smithi181.stdout:3/658: readlink d0/d5/d6/dd/d25/d50/lbd 0 2024-04-03T08:39:29.630 INFO:tasks.workunit.client.1.smithi181.stdout:1/631: truncate d10/d15/d17/d19/d33/f73 471514 0 2024-04-03T08:39:29.630 INFO:tasks.workunit.client.1.smithi181.stdout:2/693: creat d13/d1c/d4a/d7f/db3/de3/f104 x:0 0 0 2024-04-03T08:39:29.632 INFO:tasks.workunit.client.1.smithi181.stdout:6/643: chown d6/d31/f6b 16507 1 2024-04-03T08:39:29.634 INFO:tasks.workunit.client.1.smithi181.stdout:0/605: truncate d5/dc/ff 4981427 0 2024-04-03T08:39:29.634 INFO:tasks.workunit.client.0.smithi157.stdout:6/773: dwrite d1/d5/d17/d2a/d37/f8e [0,4194304] 0 2024-04-03T08:39:29.635 INFO:tasks.workunit.client.0.smithi157.stdout:9/780: dwrite d1/d15/d27/daf/da7/ff2 [4194304,4194304] 0 2024-04-03T08:39:29.635 INFO:tasks.workunit.client.1.smithi181.stdout:9/667: unlink d1/da/lf 0 2024-04-03T08:39:29.636 INFO:tasks.workunit.client.1.smithi181.stdout:3/659: write d0/d17/d36/d1e/f28 [2207615,66087] 0 2024-04-03T08:39:29.636 INFO:tasks.workunit.client.0.smithi157.stdout:5/799: dwrite dc/d29/d43/f104 [0,4194304] 0 2024-04-03T08:39:29.636 INFO:tasks.workunit.client.0.smithi157.stdout:4/729: symlink da/df/d11/d5d/l102 0 2024-04-03T08:39:29.636 INFO:tasks.workunit.client.1.smithi181.stdout:2/694: dread - d13/d1c/d4a/d68/ffc zero size 2024-04-03T08:39:29.646 INFO:tasks.workunit.client.1.smithi181.stdout:2/695: truncate d13/d1c/d4a/d68/fcc 1179586 0 2024-04-03T08:39:29.648 INFO:tasks.workunit.client.1.smithi181.stdout:1/632: symlink d10/d15/d17/d19/lc7 0 2024-04-03T08:39:29.649 INFO:tasks.workunit.client.1.smithi181.stdout:8/554: unlink d4/d2a/f6d 0 2024-04-03T08:39:29.650 INFO:tasks.workunit.client.0.smithi157.stdout:4/730: write da/df/d2f/d54/fd3 [5144723,18502] 0 2024-04-03T08:39:29.651 INFO:tasks.workunit.client.1.smithi181.stdout:2/696: readlink d13/d1c/d6c/leb 0 2024-04-03T08:39:29.651 INFO:tasks.workunit.client.1.smithi181.stdout:1/633: chown d10/d15/d17/d19/d4c 2693414 1 2024-04-03T08:39:29.654 INFO:tasks.workunit.client.1.smithi181.stdout:2/697: fsync d13/d1c/d4a/d68/dba/fea 0 2024-04-03T08:39:29.654 INFO:tasks.workunit.client.0.smithi157.stdout:5/800: mknod dc/d29/d43/da1/c106 0 2024-04-03T08:39:29.655 INFO:tasks.workunit.client.0.smithi157.stdout:6/774: creat d1/d5/d17/d2a/d30/d95/dff/f108 x:0 0 0 2024-04-03T08:39:29.660 INFO:tasks.workunit.client.1.smithi181.stdout:8/555: creat d4/d45/d9/d70/fbc x:0 0 0 2024-04-03T08:39:29.661 INFO:tasks.workunit.client.0.smithi157.stdout:4/731: symlink da/df/d11/d5d/l103 0 2024-04-03T08:39:29.663 INFO:tasks.workunit.client.1.smithi181.stdout:6/644: dwrite d6/f60 [4194304,4194304] 0 2024-04-03T08:39:29.665 INFO:tasks.workunit.client.0.smithi157.stdout:9/781: getdents d1/d15/d27/d34/da6/def 0 2024-04-03T08:39:29.665 INFO:tasks.workunit.client.1.smithi181.stdout:2/698: symlink d13/d1c/d4a/d7f/db3/l105 0 2024-04-03T08:39:29.666 INFO:tasks.workunit.client.0.smithi157.stdout:9/782: dread - d1/d4a/dc4/fe0 zero size 2024-04-03T08:39:29.667 INFO:tasks.workunit.client.1.smithi181.stdout:6/645: readlink d6/d53/d8d/d97/db0/lc7 0 2024-04-03T08:39:29.668 INFO:tasks.workunit.client.1.smithi181.stdout:2/699: write f12 [8563870,77087] 0 2024-04-03T08:39:29.670 INFO:tasks.workunit.client.1.smithi181.stdout:2/700: readlink d13/l20 0 2024-04-03T08:39:29.673 INFO:tasks.workunit.client.1.smithi181.stdout:1/634: getdents d10/da1 0 2024-04-03T08:39:29.674 INFO:tasks.workunit.client.1.smithi181.stdout:1/635: fsync d10/d15/d4a/d6f/faf 0 2024-04-03T08:39:29.675 INFO:tasks.workunit.client.0.smithi157.stdout:9/783: rename d1/d15/dca/ffc to d1/d4a/d4d/da4/dcc/f106 0 2024-04-03T08:39:29.679 INFO:tasks.workunit.client.1.smithi181.stdout:2/701: creat d13/da7/d85/de4/f106 x:0 0 0 2024-04-03T08:39:29.682 INFO:tasks.workunit.client.1.smithi181.stdout:6/646: truncate d6/dc0/fc5 1540706 0 2024-04-03T08:39:29.683 INFO:tasks.workunit.client.0.smithi157.stdout:9/784: dread d1/d15/fc9 [0,4194304] 0 2024-04-03T08:39:29.685 INFO:tasks.workunit.client.1.smithi181.stdout:8/556: link d4/d45/db/d5c/d5e/f7a d4/d45/db/d5c/d5e/fbd 0 2024-04-03T08:39:29.687 INFO:tasks.workunit.client.0.smithi157.stdout:5/801: link dc/d29/d56/d2e/l39 dc/d29/d56/d49/l107 0 2024-04-03T08:39:29.687 INFO:tasks.workunit.client.1.smithi181.stdout:2/702: dread d13/da7/d40/f6a [0,4194304] 0 2024-04-03T08:39:29.688 INFO:tasks.workunit.client.0.smithi157.stdout:3/714: dread d8/f28 [0,4194304] 0 2024-04-03T08:39:29.689 INFO:tasks.workunit.client.1.smithi181.stdout:5/605: rename d4/ce to d4/d56/cbe 0 2024-04-03T08:39:29.690 INFO:tasks.workunit.client.1.smithi181.stdout:5/606: dread - d4/d18/fb9 zero size 2024-04-03T08:39:29.691 INFO:tasks.workunit.client.1.smithi181.stdout:5/607: chown d4/f86 5753513 1 2024-04-03T08:39:29.693 INFO:tasks.workunit.client.0.smithi157.stdout:5/802: write dc/d29/f57 [4714469,76886] 0 2024-04-03T08:39:29.695 INFO:tasks.workunit.client.0.smithi157.stdout:7/801: truncate d0/d11/f71 1611499 0 2024-04-03T08:39:29.696 INFO:tasks.workunit.client.1.smithi181.stdout:2/703: truncate d13/da7/d27/f4f 568422 0 2024-04-03T08:39:29.696 INFO:tasks.workunit.client.0.smithi157.stdout:5/803: chown dc/d29/d56/d87/cf4 19715 1 2024-04-03T08:39:29.698 INFO:tasks.workunit.client.1.smithi181.stdout:5/608: creat d4/d18/d55/d5a/fbf x:0 0 0 2024-04-03T08:39:29.698 INFO:tasks.workunit.client.0.smithi157.stdout:3/715: mknod d8/d1e/d2d/d39/d51/cfa 0 2024-04-03T08:39:29.701 INFO:tasks.workunit.client.1.smithi181.stdout:7/564: rename d0/d1/d6/de/d17/d64/la8 to d0/d1/d6/de/d17/d27/ld0 0 2024-04-03T08:39:29.703 INFO:tasks.workunit.client.0.smithi157.stdout:9/785: creat d1/d15/f107 x:0 0 0 2024-04-03T08:39:29.704 INFO:tasks.workunit.client.0.smithi157.stdout:9/786: stat d1/d15/f43 0 2024-04-03T08:39:29.706 INFO:tasks.workunit.client.0.smithi157.stdout:5/804: creat dc/d29/d56/d52/d9d/da5/dfd/f108 x:0 0 0 2024-04-03T08:39:29.707 INFO:tasks.workunit.client.1.smithi181.stdout:2/704: truncate d13/d1c/d73/fb0 844201 0 2024-04-03T08:39:29.707 INFO:tasks.workunit.client.0.smithi157.stdout:5/805: fsync dc/d29/d56/d9e/db5/fe6 0 2024-04-03T08:39:29.708 INFO:tasks.workunit.client.1.smithi181.stdout:2/705: chown d13/d7b/ddc/l100 29172 1 2024-04-03T08:39:29.712 INFO:tasks.workunit.client.0.smithi157.stdout:9/787: mkdir d1/dab/dad/d108 0 2024-04-03T08:39:29.712 INFO:tasks.workunit.client.0.smithi157.stdout:1/701: creat d2/d11/d23/dc9/fe4 x:0 0 0 2024-04-03T08:39:29.714 INFO:tasks.workunit.client.1.smithi181.stdout:3/660: rename d0/d5/d6/dd/c3e to d0/d5/d6/d3f/cdd 0 2024-04-03T08:39:29.715 INFO:tasks.workunit.client.0.smithi157.stdout:3/716: symlink d8/d1e/d2d/d3b/lfb 0 2024-04-03T08:39:29.717 INFO:tasks.workunit.client.1.smithi181.stdout:6/647: getdents d6/d3e/d5e/d7c/d50/d5b 0 2024-04-03T08:39:29.718 INFO:tasks.workunit.client.0.smithi157.stdout:1/702: write d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fac [868204,11768] 0 2024-04-03T08:39:29.719 INFO:tasks.workunit.client.0.smithi157.stdout:5/806: symlink dc/d29/d43/da1/l109 0 2024-04-03T08:39:29.719 INFO:tasks.workunit.client.0.smithi157.stdout:5/807: chown dc/d29 1941607826 1 2024-04-03T08:39:29.720 INFO:tasks.workunit.client.1.smithi181.stdout:5/609: mknod d4/d22/d53/d98/cc0 0 2024-04-03T08:39:29.721 INFO:tasks.workunit.client.1.smithi181.stdout:6/648: truncate d6/d31/d36/d73/fa8 950632 0 2024-04-03T08:39:29.723 INFO:tasks.workunit.client.1.smithi181.stdout:2/706: truncate d13/d1c/f63 2780783 0 2024-04-03T08:39:29.724 INFO:tasks.workunit.client.1.smithi181.stdout:5/610: truncate d4/d18/f65 4551069 0 2024-04-03T08:39:29.724 INFO:tasks.workunit.client.1.smithi181.stdout:4/657: mknod d1/d16/d24/d5e/d31/cdb 0 2024-04-03T08:39:29.725 INFO:tasks.workunit.client.1.smithi181.stdout:3/661: symlink d0/d5/d6/dd/d25/lde 0 2024-04-03T08:39:29.725 INFO:tasks.workunit.client.1.smithi181.stdout:5/611: chown d4/d18 171544756 1 2024-04-03T08:39:29.726 INFO:tasks.workunit.client.0.smithi157.stdout:9/788: symlink d1/d94/l109 0 2024-04-03T08:39:29.729 INFO:tasks.workunit.client.1.smithi181.stdout:6/649: fdatasync d6/d3e/d5e/d7c/f85 0 2024-04-03T08:39:29.733 INFO:tasks.workunit.client.1.smithi181.stdout:3/662: write d0/d17/d36/d3b/d5a/f97 [734597,117576] 0 2024-04-03T08:39:29.734 INFO:tasks.workunit.client.0.smithi157.stdout:3/717: creat d8/d1e/d2d/d39/d51/d48/dab/ffc x:0 0 0 2024-04-03T08:39:29.736 INFO:tasks.workunit.client.0.smithi157.stdout:5/808: mknod dc/d35/c10a 0 2024-04-03T08:39:29.737 INFO:tasks.workunit.client.0.smithi157.stdout:3/718: write d8/d13/d1b/d4e/da6/fe5 [1005030,47890] 0 2024-04-03T08:39:29.737 INFO:tasks.workunit.client.0.smithi157.stdout:5/809: readlink dc/d35/l80 0 2024-04-03T08:39:29.737 INFO:tasks.workunit.client.0.smithi157.stdout:7/802: link d0/d11/d15/d17/d1c/d4f/dcd/cd7 d0/d11/d6f/d89/d8c/d103/c118 0 2024-04-03T08:39:29.739 INFO:tasks.workunit.client.1.smithi181.stdout:7/565: dread d0/f3e [4194304,4194304] 0 2024-04-03T08:39:29.741 INFO:tasks.workunit.client.0.smithi157.stdout:9/789: mknod d1/d94/d75/c10a 0 2024-04-03T08:39:29.742 INFO:tasks.workunit.client.1.smithi181.stdout:6/650: mknod d6/d31/d36/d73/cc8 0 2024-04-03T08:39:29.743 INFO:tasks.workunit.client.1.smithi181.stdout:6/651: chown d6/d3e/d40/dbc 13 1 2024-04-03T08:39:29.744 INFO:tasks.workunit.client.1.smithi181.stdout:6/652: chown d6/d53/f91 88945872 1 2024-04-03T08:39:29.757 INFO:tasks.workunit.client.0.smithi157.stdout:0/784: sync 2024-04-03T08:39:29.757 INFO:tasks.workunit.client.0.smithi157.stdout:2/754: sync 2024-04-03T08:39:29.758 INFO:tasks.workunit.client.1.smithi181.stdout:4/658: rename d1/d16/d55/c57 to d1/d1e/d78/cdc 0 2024-04-03T08:39:29.761 INFO:tasks.workunit.client.0.smithi157.stdout:7/803: mknod d0/d11/d6f/d89/d8c/deb/c119 0 2024-04-03T08:39:29.763 INFO:tasks.workunit.client.0.smithi157.stdout:7/804: chown d0/d11/f21 31536 1 2024-04-03T08:39:29.767 INFO:tasks.workunit.client.1.smithi181.stdout:3/663: rename d0/d5/d6/l2d to d0/d5/d6/d32/dc1/ldf 0 2024-04-03T08:39:29.768 INFO:tasks.workunit.client.1.smithi181.stdout:9/668: sync 2024-04-03T08:39:29.769 INFO:tasks.workunit.client.1.smithi181.stdout:2/707: link d13/d1c/d4a/d68/c43 d13/da7/d85/dbd/c107 0 2024-04-03T08:39:29.769 INFO:tasks.workunit.client.0.smithi157.stdout:0/785: dread d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/f117 [0,4194304] 0 2024-04-03T08:39:29.771 INFO:tasks.workunit.client.1.smithi181.stdout:3/664: write d0/d17/d36/d1e/f28 [2403480,75298] 0 2024-04-03T08:39:29.772 INFO:tasks.workunit.client.1.smithi181.stdout:7/566: mknod d0/d1/d6/de/d17/d64/d85/d9a/cd1 0 2024-04-03T08:39:29.774 INFO:tasks.workunit.client.1.smithi181.stdout:4/659: dwrite d1/d16/d37/d34/d86/fc6 [0,4194304] 0 2024-04-03T08:39:29.775 INFO:tasks.workunit.client.1.smithi181.stdout:6/653: mkdir d6/d3e/db1/dc4/dc9 0 2024-04-03T08:39:29.775 INFO:tasks.workunit.client.1.smithi181.stdout:0/606: write d5/dc/f1e [331504,32055] 0 2024-04-03T08:39:29.778 INFO:tasks.workunit.client.1.smithi181.stdout:4/660: write d1/f32 [104266,24588] 0 2024-04-03T08:39:29.780 INFO:tasks.workunit.client.1.smithi181.stdout:6/654: read d6/d31/d36/f87 [44165,120442] 0 2024-04-03T08:39:29.781 INFO:tasks.workunit.client.1.smithi181.stdout:4/661: stat d1/d1e/d2c/d67/d9d 0 2024-04-03T08:39:29.784 INFO:tasks.workunit.client.1.smithi181.stdout:4/662: chown d1/d16/d24/d5e/d31/d39/l70 7198 1 2024-04-03T08:39:29.786 INFO:tasks.workunit.client.1.smithi181.stdout:9/669: dread d1/da/d28/d80/f93 [0,4194304] 0 2024-04-03T08:39:29.787 INFO:tasks.workunit.client.0.smithi157.stdout:4/732: write da/df/d99/fab [1021578,108995] 0 2024-04-03T08:39:29.789 INFO:tasks.workunit.client.0.smithi157.stdout:4/733: chown da/df/d24/d35/f87 5065494 1 2024-04-03T08:39:29.790 INFO:tasks.workunit.client.0.smithi157.stdout:4/734: chown da/df/d99 35067910 1 2024-04-03T08:39:29.791 INFO:tasks.workunit.client.1.smithi181.stdout:3/665: fdatasync d0/d17/d36/fb8 0 2024-04-03T08:39:29.797 INFO:tasks.workunit.client.0.smithi157.stdout:6/775: dwrite d1/f6d [0,4194304] 0 2024-04-03T08:39:29.802 INFO:tasks.workunit.client.1.smithi181.stdout:2/708: dwrite d13/d1c/d4a/d68/f94 [0,4194304] 0 2024-04-03T08:39:29.807 INFO:tasks.workunit.client.1.smithi181.stdout:9/670: symlink d1/da/d13/d22/d23/d36/d91/d9d/lce 0 2024-04-03T08:39:29.810 INFO:tasks.workunit.client.1.smithi181.stdout:7/567: mknod d0/d1/d6/de/d17/cd2 0 2024-04-03T08:39:29.811 INFO:tasks.workunit.client.1.smithi181.stdout:7/568: stat d0/db4 0 2024-04-03T08:39:29.812 INFO:tasks.workunit.client.1.smithi181.stdout:3/666: rename d0/d5/cc4 to d0/d5/d77/ce0 0 2024-04-03T08:39:29.814 INFO:tasks.workunit.client.1.smithi181.stdout:3/667: write d0/d5/d6/d32/fdc [694386,44149] 0 2024-04-03T08:39:29.820 INFO:tasks.workunit.client.1.smithi181.stdout:2/709: creat d13/f108 x:0 0 0 2024-04-03T08:39:29.821 INFO:tasks.workunit.client.1.smithi181.stdout:6/655: truncate d6/d3e/d5e/d7c/d9/fa 1608813 0 2024-04-03T08:39:29.823 INFO:tasks.workunit.client.1.smithi181.stdout:4/663: mkdir d1/d16/d24/d5e/d31/dba/ddd 0 2024-04-03T08:39:29.824 INFO:tasks.workunit.client.1.smithi181.stdout:6/656: truncate d6/d31/d36/dba/fae 722504 0 2024-04-03T08:39:29.827 INFO:tasks.workunit.client.1.smithi181.stdout:1/636: sync 2024-04-03T08:39:29.830 INFO:tasks.workunit.client.1.smithi181.stdout:7/569: creat d0/d1/d6/de/d17/d64/d85/d87/fd3 x:0 0 0 2024-04-03T08:39:29.831 INFO:tasks.workunit.client.1.smithi181.stdout:5/612: write d4/d18/d55/f69 [235129,58037] 0 2024-04-03T08:39:29.833 INFO:tasks.workunit.client.1.smithi181.stdout:3/668: mknod d0/d5/d6/d32/d43/d6b/ce1 0 2024-04-03T08:39:29.835 INFO:tasks.workunit.client.1.smithi181.stdout:0/607: link d5/dc/d75/fb9 d5/dc/d14/d29/fc2 0 2024-04-03T08:39:29.837 INFO:tasks.workunit.client.0.smithi157.stdout:5/810: write dc/d29/d56/d18/fab [346410,91422] 0 2024-04-03T08:39:29.838 INFO:tasks.workunit.client.0.smithi157.stdout:2/755: symlink d3/db/d44/d4c/l108 0 2024-04-03T08:39:29.839 INFO:tasks.workunit.client.1.smithi181.stdout:1/637: dread d10/d15/d17/d19/f3e [0,4194304] 0 2024-04-03T08:39:29.840 INFO:tasks.workunit.client.0.smithi157.stdout:3/719: truncate d8/d13/d1b/d5b/f8a 1478001 0 2024-04-03T08:39:29.841 INFO:tasks.workunit.client.0.smithi157.stdout:2/756: stat d3/db/d44/d4c/df1/ff9 0 2024-04-03T08:39:29.841 INFO:tasks.workunit.client.1.smithi181.stdout:1/638: chown d10/d15/d17/d19/l1c 529135 1 2024-04-03T08:39:29.842 INFO:tasks.workunit.client.1.smithi181.stdout:6/657: symlink d6/d3e/d40/lca 0 2024-04-03T08:39:29.843 INFO:tasks.workunit.client.0.smithi157.stdout:7/805: mknod d0/d11/d6f/d89/d8c/d103/da5/c11a 0 2024-04-03T08:39:29.852 INFO:tasks.workunit.client.0.smithi157.stdout:6/776: mknod d1/d4b/d38/d59/c109 0 2024-04-03T08:39:29.854 INFO:tasks.workunit.client.0.smithi157.stdout:5/811: dwrite dc/d29/f57 [4194304,4194304] 0 2024-04-03T08:39:29.860 INFO:tasks.workunit.client.0.smithi157.stdout:5/812: read dc/d29/d56/d49/d53/d6c/f6f [3723360,51337] 0 2024-04-03T08:39:29.863 INFO:tasks.workunit.client.0.smithi157.stdout:7/806: dwrite d0/d11/d6f/d89/d8c/d103/d8e/d96/df4/ffb [0,4194304] 0 2024-04-03T08:39:29.864 INFO:tasks.workunit.client.0.smithi157.stdout:9/790: rename d1/d15/d27/d34/dc7/fe7 to d1/d4a/f10b 0 2024-04-03T08:39:29.874 INFO:tasks.workunit.client.1.smithi181.stdout:9/671: creat d1/da/d13/d22/d23/fcf x:0 0 0 2024-04-03T08:39:29.876 INFO:tasks.workunit.client.0.smithi157.stdout:2/757: unlink d3/db/d44/lfc 0 2024-04-03T08:39:29.876 INFO:tasks.workunit.client.0.smithi157.stdout:8/763: sync 2024-04-03T08:39:29.879 INFO:tasks.workunit.client.0.smithi157.stdout:8/764: fdatasync d2/d11/f93 0 2024-04-03T08:39:29.883 INFO:tasks.workunit.client.0.smithi157.stdout:6/777: symlink d1/d4b/d38/da6/l10a 0 2024-04-03T08:39:29.886 INFO:tasks.workunit.client.0.smithi157.stdout:1/703: creat d2/d11/d23/dc9/d58/d94/fe5 x:0 0 0 2024-04-03T08:39:29.887 INFO:tasks.workunit.client.0.smithi157.stdout:7/807: dread d0/d11/f21 [4194304,4194304] 0 2024-04-03T08:39:29.888 INFO:tasks.workunit.client.1.smithi181.stdout:6/658: mknod d6/d3e/d5e/d7c/d50/ccb 0 2024-04-03T08:39:29.895 INFO:tasks.workunit.client.0.smithi157.stdout:9/791: symlink d1/d4a/dc4/l10c 0 2024-04-03T08:39:29.896 INFO:tasks.workunit.client.0.smithi157.stdout:5/813: dread dc/d29/d56/fb4 [0,4194304] 0 2024-04-03T08:39:29.900 INFO:tasks.workunit.client.1.smithi181.stdout:4/664: getdents d1/d16/d37/d34/d85 0 2024-04-03T08:39:29.901 INFO:tasks.workunit.client.0.smithi157.stdout:0/786: link d2/d9/l1a d2/d9/dc/df/d1b/d4a/d31/l11a 0 2024-04-03T08:39:29.902 INFO:tasks.workunit.client.0.smithi157.stdout:3/720: dread d8/d1e/f7a [0,4194304] 0 2024-04-03T08:39:29.903 INFO:tasks.workunit.client.0.smithi157.stdout:2/758: dread d3/d2e/d32/d3c/f52 [0,4194304] 0 2024-04-03T08:39:29.904 INFO:tasks.workunit.client.0.smithi157.stdout:0/787: write d2/d9/d36/fee [709052,68148] 0 2024-04-03T08:39:29.905 INFO:tasks.workunit.client.0.smithi157.stdout:8/765: creat d2/d6f/f107 x:0 0 0 2024-04-03T08:39:29.907 INFO:tasks.workunit.client.0.smithi157.stdout:3/721: chown d8/d1e/d2d/d3f/d4d/d8f/ce2 780561 1 2024-04-03T08:39:29.908 INFO:tasks.workunit.client.0.smithi157.stdout:3/722: chown d8/d1e/lcb 15244 1 2024-04-03T08:39:29.908 INFO:tasks.workunit.client.1.smithi181.stdout:7/570: rename d0/d1/d6/db9/lc1 to d0/ld4 0 2024-04-03T08:39:29.911 INFO:tasks.workunit.client.0.smithi157.stdout:3/723: truncate d8/f57 5083907 0 2024-04-03T08:39:29.912 INFO:tasks.workunit.client.1.smithi181.stdout:8/557: sync 2024-04-03T08:39:29.915 INFO:tasks.workunit.client.0.smithi157.stdout:1/704: unlink d2/d11/d23/dc9/d58/d62/d74/lae 0 2024-04-03T08:39:29.919 INFO:tasks.workunit.client.1.smithi181.stdout:9/672: creat d1/da/d1a/fd0 x:0 0 0 2024-04-03T08:39:29.921 INFO:tasks.workunit.client.1.smithi181.stdout:6/659: dread d6/d31/d36/f44 [0,4194304] 0 2024-04-03T08:39:29.922 INFO:tasks.workunit.client.0.smithi157.stdout:9/792: chown d1/d36/d46/ld9 15189353 1 2024-04-03T08:39:29.923 INFO:tasks.workunit.client.1.smithi181.stdout:1/639: rename d10/d15/d17/d37/f54 to d10/d15/d17/d19/d33/d70/fc8 0 2024-04-03T08:39:29.925 INFO:tasks.workunit.client.1.smithi181.stdout:5/613: link d4/d22/f26 d4/d18/d2c/fc1 0 2024-04-03T08:39:29.926 INFO:tasks.workunit.client.0.smithi157.stdout:8/766: dwrite d2/d11/d10/d24/d5b/fda [0,4194304] 0 2024-04-03T08:39:29.926 INFO:tasks.workunit.client.0.smithi157.stdout:5/814: chown dc/d29/d51/leb 6 1 2024-04-03T08:39:29.927 INFO:tasks.workunit.client.1.smithi181.stdout:8/558: creat d4/d45/db/d14/d31/d1c/d51/d87/db1/fbe x:0 0 0 2024-04-03T08:39:29.929 INFO:tasks.workunit.client.0.smithi157.stdout:2/759: write d3/d2e/d32/d9f/ff7 [1024833,28444] 0 2024-04-03T08:39:29.929 INFO:tasks.workunit.client.0.smithi157.stdout:5/815: readlink dc/d29/d56/d52/lee 0 2024-04-03T08:39:29.932 INFO:tasks.workunit.client.0.smithi157.stdout:0/788: mknod d2/d9/dc/dbe/dfb/c11b 0 2024-04-03T08:39:29.932 INFO:tasks.workunit.client.0.smithi157.stdout:5/816: fdatasync f7 0 2024-04-03T08:39:29.936 INFO:tasks.workunit.client.1.smithi181.stdout:6/660: mkdir d6/d53/d8d/d97/dcc 0 2024-04-03T08:39:29.941 INFO:tasks.workunit.client.0.smithi157.stdout:4/735: dwrite da/f6f [0,4194304] 0 2024-04-03T08:39:29.944 INFO:tasks.workunit.client.1.smithi181.stdout:3/669: dwrite d0/d5/f33 [4194304,4194304] 0 2024-04-03T08:39:29.945 INFO:tasks.workunit.client.0.smithi157.stdout:7/808: dread d0/d11/d6f/d89/d8c/d103/d8e/d96/f100 [0,4194304] 0 2024-04-03T08:39:29.949 INFO:tasks.workunit.client.1.smithi181.stdout:2/710: dwrite d13/fdd [0,4194304] 0 2024-04-03T08:39:29.952 INFO:tasks.workunit.client.0.smithi157.stdout:9/793: rename d1/d4a/d4d/leb to d1/d4a/d4d/d86/dd5/l10d 0 2024-04-03T08:39:29.953 INFO:tasks.workunit.client.1.smithi181.stdout:9/673: symlink d1/da/d13/d41/d65/dbb/ld1 0 2024-04-03T08:39:29.964 INFO:tasks.workunit.client.1.smithi181.stdout:8/559: dwrite d4/d45/db/f3a [0,4194304] 0 2024-04-03T08:39:29.973 INFO:tasks.workunit.client.0.smithi157.stdout:1/705: rmdir d2/d11/d23/dc9/da1 39 2024-04-03T08:39:29.975 INFO:tasks.workunit.client.0.smithi157.stdout:9/794: dread d1/d15/d27/d5c/d79/fea [0,4194304] 0 2024-04-03T08:39:29.976 INFO:tasks.workunit.client.1.smithi181.stdout:1/640: link d10/d15/d4b/d6c/l8a d10/d15/d17/d19/d4c/dae/lc9 0 2024-04-03T08:39:29.978 INFO:tasks.workunit.client.1.smithi181.stdout:8/560: stat d4/d44/f82 0 2024-04-03T08:39:29.980 INFO:tasks.workunit.client.1.smithi181.stdout:4/665: truncate d1/d16/d37/d34/d85/fc9 2168661 0 2024-04-03T08:39:29.983 INFO:tasks.workunit.client.0.smithi157.stdout:3/724: write d8/d13/d1b/d4e/da6/f95 [691643,42742] 0 2024-04-03T08:39:29.985 INFO:tasks.workunit.client.1.smithi181.stdout:6/661: dwrite d6/d3e/d5e/d7c/f49 [4194304,4194304] 0 2024-04-03T08:39:29.985 INFO:tasks.workunit.client.0.smithi157.stdout:3/725: chown d8/d1e/d2d/d39/d51/cb6 6 1 2024-04-03T08:39:29.986 INFO:tasks.workunit.client.1.smithi181.stdout:4/666: stat d1/d16/d24/d5e/d31/d39/da1/fb8 0 2024-04-03T08:39:29.987 INFO:tasks.workunit.client.0.smithi157.stdout:3/726: readlink d8/d13/l53 0 2024-04-03T08:39:29.987 INFO:tasks.workunit.client.1.smithi181.stdout:1/641: fdatasync d10/d15/d17/d19/d33/fa4 0 2024-04-03T08:39:29.988 INFO:tasks.workunit.client.0.smithi157.stdout:6/778: link d1/d5/d17/d2a/l3d d1/d5/d17/d29/da7/db9/dfb/l10b 0 2024-04-03T08:39:29.988 INFO:tasks.workunit.client.0.smithi157.stdout:8/767: write d2/d6f/f71 [1058483,115015] 0 2024-04-03T08:39:29.989 INFO:tasks.workunit.client.0.smithi157.stdout:8/768: fdatasync d2/f39 0 2024-04-03T08:39:29.991 INFO:tasks.workunit.client.1.smithi181.stdout:3/670: mknod d0/d17/d40/ce2 0 2024-04-03T08:39:29.992 INFO:tasks.workunit.client.0.smithi157.stdout:0/789: mknod d2/dd8/dfd/c11c 0 2024-04-03T08:39:29.994 INFO:tasks.workunit.client.1.smithi181.stdout:9/674: rmdir d1/da/d13/d22/d23/d36/d91/d9d/d39/dcc 0 2024-04-03T08:39:29.994 INFO:tasks.workunit.client.0.smithi157.stdout:2/760: write d3/d12/d43/fb1 [752644,61251] 0 2024-04-03T08:39:29.998 INFO:tasks.workunit.client.0.smithi157.stdout:7/809: write d0/d11/d15/d17/d52/db6/fc7 [730572,77839] 0 2024-04-03T08:39:30.003 INFO:tasks.workunit.client.1.smithi181.stdout:0/608: sync 2024-04-03T08:39:30.004 INFO:tasks.workunit.client.1.smithi181.stdout:8/561: symlink d4/lbf 0 2024-04-03T08:39:30.007 INFO:tasks.workunit.client.1.smithi181.stdout:8/562: chown d4 0 1 2024-04-03T08:39:30.009 INFO:tasks.workunit.client.1.smithi181.stdout:3/671: rmdir d0/d17/d40 39 2024-04-03T08:39:30.011 INFO:tasks.workunit.client.1.smithi181.stdout:8/563: read - d4/d44/f8d zero size 2024-04-03T08:39:30.011 INFO:tasks.workunit.client.0.smithi157.stdout:5/817: truncate dc/d29/d56/d18/f3a 8149645 0 2024-04-03T08:39:30.012 INFO:tasks.workunit.client.1.smithi181.stdout:2/711: dwrite d13/d1c/d4a/d7f/db3/f53 [0,4194304] 0 2024-04-03T08:39:30.014 INFO:tasks.workunit.client.1.smithi181.stdout:8/564: stat d4/d45/db/f56 0 2024-04-03T08:39:30.015 INFO:tasks.workunit.client.1.smithi181.stdout:9/675: rename d1/da/d28/d30/d3e/d4e/lbe to d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/ld2 0 2024-04-03T08:39:30.017 INFO:tasks.workunit.client.1.smithi181.stdout:8/565: write d4/d44/d59/d5f/faa [81483,104249] 0 2024-04-03T08:39:30.017 INFO:tasks.workunit.client.0.smithi157.stdout:7/810: dwrite d0/d11/d15/d17/d1c/da1/f105 [0,4194304] 0 2024-04-03T08:39:30.019 INFO:tasks.workunit.client.1.smithi181.stdout:4/667: write d1/d16/d24/f47 [1391038,112944] 0 2024-04-03T08:39:30.020 INFO:tasks.workunit.client.1.smithi181.stdout:9/676: write d1/da/d1a/f27 [1949350,23743] 0 2024-04-03T08:39:30.027 INFO:tasks.workunit.client.1.smithi181.stdout:0/609: symlink d5/d9/d2c/lc3 0 2024-04-03T08:39:30.027 INFO:tasks.workunit.client.0.smithi157.stdout:0/790: creat d2/d9/dc/df/d6f/d9d/d6a/f11d x:0 0 0 2024-04-03T08:39:30.028 INFO:tasks.workunit.client.0.smithi157.stdout:9/795: write d1/d36/f3b [4822184,39752] 0 2024-04-03T08:39:30.030 INFO:tasks.workunit.client.0.smithi157.stdout:9/796: readlink d1/d15/l105 0 2024-04-03T08:39:30.032 INFO:tasks.workunit.client.0.smithi157.stdout:0/791: fdatasync d2/d9/dc/f10d 0 2024-04-03T08:39:30.034 INFO:tasks.workunit.client.1.smithi181.stdout:3/672: dwrite d0/d17/d63/f76 [0,4194304] 0 2024-04-03T08:39:30.035 INFO:tasks.workunit.client.1.smithi181.stdout:0/610: write d5/dc/d14/d29/f78 [4468329,111823] 0 2024-04-03T08:39:30.037 INFO:tasks.workunit.client.0.smithi157.stdout:4/736: rename da/df/d24/d35/d6a/f79 to da/df/f104 0 2024-04-03T08:39:30.037 INFO:tasks.workunit.client.1.smithi181.stdout:3/673: chown d0/d5/d6/f4c 25 1 2024-04-03T08:39:30.039 INFO:tasks.workunit.client.0.smithi157.stdout:5/818: dread - dc/d29/d43/da1/fe1 zero size 2024-04-03T08:39:30.042 INFO:tasks.workunit.client.0.smithi157.stdout:7/811: creat d0/d11/d15/d1b/f11b x:0 0 0 2024-04-03T08:39:30.046 INFO:tasks.workunit.client.0.smithi157.stdout:6/779: dwrite d1/d5/d17/d2a/d73/f5c [0,4194304] 0 2024-04-03T08:39:30.046 INFO:tasks.workunit.client.0.smithi157.stdout:8/769: dwrite d2/d20/db1/fd7 [0,4194304] 0 2024-04-03T08:39:30.046 INFO:tasks.workunit.client.0.smithi157.stdout:1/706: rmdir d2/d11/d23/dc9/d5d/d9a 39 2024-04-03T08:39:30.050 INFO:tasks.workunit.client.0.smithi157.stdout:2/761: write d3/d12/d43/d4b/f98 [1402939,4767] 0 2024-04-03T08:39:30.051 INFO:tasks.workunit.client.1.smithi181.stdout:2/712: dread - d13/d1c/d4a/d7f/db3/f88 zero size 2024-04-03T08:39:30.055 INFO:tasks.workunit.client.1.smithi181.stdout:9/677: truncate d1/da/d28/f9a 576697 0 2024-04-03T08:39:30.057 INFO:tasks.workunit.client.0.smithi157.stdout:0/792: unlink d2/d9/d36/fce 0 2024-04-03T08:39:30.063 INFO:tasks.workunit.client.0.smithi157.stdout:4/737: chown da/df/d24/d35/d53/ce6 673742340 1 2024-04-03T08:39:30.064 INFO:tasks.workunit.client.1.smithi181.stdout:3/674: dwrite d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:30.065 INFO:tasks.workunit.client.1.smithi181.stdout:7/571: sync 2024-04-03T08:39:30.067 INFO:tasks.workunit.client.0.smithi157.stdout:4/738: chown da/df/d2f/d64/d8f/dbd/d68 350531 1 2024-04-03T08:39:30.068 INFO:tasks.workunit.client.1.smithi181.stdout:2/713: mkdir d13/da7/d40/d109 0 2024-04-03T08:39:30.071 INFO:tasks.workunit.client.1.smithi181.stdout:9/678: mkdir d1/da/d28/d80/dd3 0 2024-04-03T08:39:30.073 INFO:tasks.workunit.client.0.smithi157.stdout:0/793: rmdir d2/d9/d5f/d85/d106 39 2024-04-03T08:39:30.074 INFO:tasks.workunit.client.0.smithi157.stdout:3/727: rename d8/d1e/f65 to d8/d1e/d2d/d39/d51/d7e/db1/ffd 0 2024-04-03T08:39:30.076 INFO:tasks.workunit.client.0.smithi157.stdout:6/780: unlink d1/d5/d17/d2a/l3d 0 2024-04-03T08:39:30.077 INFO:tasks.workunit.client.0.smithi157.stdout:4/739: symlink da/df/d2f/d54/l105 0 2024-04-03T08:39:30.077 INFO:tasks.workunit.client.1.smithi181.stdout:0/611: creat d5/dc/d14/d29/d46/fc4 x:0 0 0 2024-04-03T08:39:30.078 INFO:tasks.workunit.client.1.smithi181.stdout:1/642: dwrite d10/d15/d17/d19/d33/fa0 [0,4194304] 0 2024-04-03T08:39:30.082 INFO:tasks.workunit.client.0.smithi157.stdout:8/770: creat d2/d11/d10/d24/d5b/d2e/d75/d81/df0/f108 x:0 0 0 2024-04-03T08:39:30.086 INFO:tasks.workunit.client.0.smithi157.stdout:1/707: symlink d2/d11/d23/dc9/da1/le6 0 2024-04-03T08:39:30.096 INFO:tasks.workunit.client.0.smithi157.stdout:9/797: write d1/d15/d27/d5c/d79/f99 [3112955,104833] 0 2024-04-03T08:39:30.098 INFO:tasks.workunit.client.0.smithi157.stdout:7/812: rename d0/d11/d6f/f10f to d0/d11/d6f/d89/d8c/dc6/d116/f11c 0 2024-04-03T08:39:30.103 INFO:tasks.workunit.client.1.smithi181.stdout:2/714: truncate d13/d1c/d73/d8b/ff8 529054 0 2024-04-03T08:39:30.105 INFO:tasks.workunit.client.0.smithi157.stdout:4/740: unlink da/d26/fd2 0 2024-04-03T08:39:30.106 INFO:tasks.workunit.client.1.smithi181.stdout:6/662: dwrite d6/d3e/d5e/d7c/d9/fa [0,4194304] 0 2024-04-03T08:39:30.107 INFO:tasks.workunit.client.0.smithi157.stdout:9/798: readlink d1/d15/dca/ld1 0 2024-04-03T08:39:30.107 INFO:tasks.workunit.client.0.smithi157.stdout:6/781: dread - d1/d4b/da5/dc7/fed zero size 2024-04-03T08:39:30.109 INFO:tasks.workunit.client.1.smithi181.stdout:0/612: dread d5/dc/d14/f9c [0,4194304] 0 2024-04-03T08:39:30.112 INFO:tasks.workunit.client.0.smithi157.stdout:3/728: mknod d8/d1e/d2d/d3f/cfe 0 2024-04-03T08:39:30.113 INFO:tasks.workunit.client.1.smithi181.stdout:3/675: write d0/d17/f82 [835582,10249] 0 2024-04-03T08:39:30.116 INFO:tasks.workunit.client.0.smithi157.stdout:2/762: rename d3/d12/d43/d4b/d55/f62 to d3/db/d44/d4c/d5a/d88/dc6/f109 0 2024-04-03T08:39:30.117 INFO:tasks.workunit.client.1.smithi181.stdout:5/614: sync 2024-04-03T08:39:30.119 INFO:tasks.workunit.client.1.smithi181.stdout:2/715: write d13/f23 [5258562,99831] 0 2024-04-03T08:39:30.119 INFO:tasks.workunit.client.1.smithi181.stdout:7/572: dread d0/d1/f21 [0,4194304] 0 2024-04-03T08:39:30.123 INFO:tasks.workunit.client.1.smithi181.stdout:9/679: dwrite d1/da/d1a/d92/fb3 [0,4194304] 0 2024-04-03T08:39:30.124 INFO:tasks.workunit.client.1.smithi181.stdout:8/566: dread d4/f27 [0,4194304] 0 2024-04-03T08:39:30.126 INFO:tasks.workunit.client.1.smithi181.stdout:6/663: write d6/d31/d36/f9c [1336814,105438] 0 2024-04-03T08:39:30.127 INFO:tasks.workunit.client.1.smithi181.stdout:5/615: stat d4/d22/d4a 0 2024-04-03T08:39:30.129 INFO:tasks.workunit.client.1.smithi181.stdout:4/668: dwrite d1/d16/d24/d5e/d3f/fb3 [0,4194304] 0 2024-04-03T08:39:30.129 INFO:tasks.workunit.client.0.smithi157.stdout:7/813: mknod d0/d11/d6f/d89/d8c/d103/daf/c11d 0 2024-04-03T08:39:30.129 INFO:tasks.workunit.client.0.smithi157.stdout:1/708: rmdir d2/d11/d23/dc9/d58/d94/da3 39 2024-04-03T08:39:30.131 INFO:tasks.workunit.client.1.smithi181.stdout:5/616: chown d4/d18/d2c 2 1 2024-04-03T08:39:30.132 INFO:tasks.workunit.client.0.smithi157.stdout:8/771: mkdir d2/d11/d10/d24/d5b/d109 0 2024-04-03T08:39:30.135 INFO:tasks.workunit.client.1.smithi181.stdout:9/680: stat d1/da/d28/d30/d3e/d4e/d62/l96 0 2024-04-03T08:39:30.137 INFO:tasks.workunit.client.0.smithi157.stdout:6/782: symlink d1/d4b/d38/l10c 0 2024-04-03T08:39:30.138 INFO:tasks.workunit.client.1.smithi181.stdout:9/681: write d1/da/d13/d22/f2e [2320833,115857] 0 2024-04-03T08:39:30.139 INFO:tasks.workunit.client.0.smithi157.stdout:5/819: dwrite dc/d29/d56/d18/d21/fc5 [0,4194304] 0 2024-04-03T08:39:30.140 INFO:tasks.workunit.client.0.smithi157.stdout:1/709: chown d2/d11/d24/f2f 467976 1 2024-04-03T08:39:30.143 INFO:tasks.workunit.client.1.smithi181.stdout:1/643: write d10/f11 [1138261,87760] 0 2024-04-03T08:39:30.143 INFO:tasks.workunit.client.1.smithi181.stdout:3/676: creat d0/d5/d6f/fe3 x:0 0 0 2024-04-03T08:39:30.145 INFO:tasks.workunit.client.1.smithi181.stdout:2/716: symlink d13/d1c/da5/l10a 0 2024-04-03T08:39:30.147 INFO:tasks.workunit.client.0.smithi157.stdout:7/814: chown d0/d11/d6f/d76/da7/l3c 10874920 1 2024-04-03T08:39:30.149 INFO:tasks.workunit.client.1.smithi181.stdout:8/567: dread d4/d2a/d37/fac [0,4194304] 0 2024-04-03T08:39:30.150 INFO:tasks.workunit.client.0.smithi157.stdout:0/794: dwrite d2/d9/d5f/d105/f10a [0,4194304] 0 2024-04-03T08:39:30.150 INFO:tasks.workunit.client.1.smithi181.stdout:6/664: symlink d6/d3e/db1/dc4/lcd 0 2024-04-03T08:39:30.154 INFO:tasks.workunit.client.1.smithi181.stdout:4/669: rmdir d1/d16/d24/d5e/d31 39 2024-04-03T08:39:30.155 INFO:tasks.workunit.client.1.smithi181.stdout:5/617: mkdir d4/d22/d53/d98/dc2 0 2024-04-03T08:39:30.157 INFO:tasks.workunit.client.1.smithi181.stdout:5/618: chown d4/d18/d55/db4/d90/la1 5968819 1 2024-04-03T08:39:30.158 INFO:tasks.workunit.client.1.smithi181.stdout:3/677: fdatasync d0/d5/d6/f11 0 2024-04-03T08:39:30.165 INFO:tasks.workunit.client.1.smithi181.stdout:7/573: creat d0/fd5 x:0 0 0 2024-04-03T08:39:30.170 INFO:tasks.workunit.client.1.smithi181.stdout:3/678: unlink d0/d5/d6/d32/f7b 0 2024-04-03T08:39:30.172 INFO:tasks.workunit.client.1.smithi181.stdout:1/644: dwrite d10/d15/d41/f44 [0,4194304] 0 2024-04-03T08:39:30.174 INFO:tasks.workunit.client.0.smithi157.stdout:7/815: symlink d0/d11/d6f/d89/d8c/d103/l11e 0 2024-04-03T08:39:30.174 INFO:tasks.workunit.client.0.smithi157.stdout:9/799: dwrite d1/d15/d27/ff6 [0,4194304] 0 2024-04-03T08:39:30.175 INFO:tasks.workunit.client.1.smithi181.stdout:0/613: rename d5/dc/d10/d30/dbf to d5/dc/dc5 0 2024-04-03T08:39:30.177 INFO:tasks.workunit.client.1.smithi181.stdout:0/614: chown d5/dc/d14/d29/f78 76702195 1 2024-04-03T08:39:30.178 INFO:tasks.workunit.client.1.smithi181.stdout:8/568: link d4/d45/db/f3a d4/d45/db/d5c/d5e/fc0 0 2024-04-03T08:39:30.179 INFO:tasks.workunit.client.0.smithi157.stdout:1/710: mknod d2/d11/d24/d39/dc6/ce7 0 2024-04-03T08:39:30.180 INFO:tasks.workunit.client.1.smithi181.stdout:6/665: mkdir d6/d3e/d40/dbc/dce 0 2024-04-03T08:39:30.185 INFO:tasks.workunit.client.1.smithi181.stdout:5/619: mkdir d4/dc3 0 2024-04-03T08:39:30.185 INFO:tasks.workunit.client.0.smithi157.stdout:0/795: dread - d2/d9/dc/df/d6f/d9d/d6a/f76 zero size 2024-04-03T08:39:30.186 INFO:tasks.workunit.client.0.smithi157.stdout:9/800: symlink d1/d15/d27/daf/da7/l10e 0 2024-04-03T08:39:30.188 INFO:tasks.workunit.client.0.smithi157.stdout:5/820: creat dc/d29/d56/d9e/dc3/dde/def/dfa/f10b x:0 0 0 2024-04-03T08:39:30.188 INFO:tasks.workunit.client.0.smithi157.stdout:4/741: dread da/df/f74 [0,4194304] 0 2024-04-03T08:39:30.199 INFO:tasks.workunit.client.1.smithi181.stdout:3/679: dread d0/d5/d6/d32/daa/fc6 [0,4194304] 0 2024-04-03T08:39:30.200 INFO:tasks.workunit.client.1.smithi181.stdout:1/645: dread - d10/d15/d41/f61 zero size 2024-04-03T08:39:30.200 INFO:tasks.workunit.client.0.smithi157.stdout:4/742: write da/f1e [1149556,34677] 0 2024-04-03T08:39:30.202 INFO:tasks.workunit.client.0.smithi157.stdout:4/743: stat da/df/d2f/f38 0 2024-04-03T08:39:30.203 INFO:tasks.workunit.client.0.smithi157.stdout:1/711: rename d2/l68 to d2/d11/d23/dc9/d5d/db4/dbc/le8 0 2024-04-03T08:39:30.204 INFO:tasks.workunit.client.0.smithi157.stdout:5/821: chown dc/d29/d56/d9e/dc3/dde/def/dfa/f10b 181276868 1 2024-04-03T08:39:30.206 INFO:tasks.workunit.client.1.smithi181.stdout:0/615: creat d5/d9/d2a/da1/fc6 x:0 0 0 2024-04-03T08:39:30.208 INFO:tasks.workunit.client.1.smithi181.stdout:8/569: dread - d4/d45/db/d14/d31/d1c/f53 zero size 2024-04-03T08:39:30.209 INFO:tasks.workunit.client.1.smithi181.stdout:0/616: write d5/dc/d14/d29/f4d [2174283,107279] 0 2024-04-03T08:39:30.210 INFO:tasks.workunit.client.0.smithi157.stdout:4/744: fsync da/df/d2f/d97/dd6/feb 0 2024-04-03T08:39:30.212 INFO:tasks.workunit.client.0.smithi157.stdout:1/712: mkdir d2/d11/d24/d39/d3b/d1b/d7f/de9 0 2024-04-03T08:39:30.215 INFO:tasks.workunit.client.1.smithi181.stdout:7/574: symlink d0/d1/d6/de/ld6 0 2024-04-03T08:39:30.215 INFO:tasks.workunit.client.1.smithi181.stdout:6/666: creat d6/d31/d36/fcf x:0 0 0 2024-04-03T08:39:30.215 INFO:tasks.workunit.client.1.smithi181.stdout:4/670: truncate d1/d16/d24/d5e/f3c 1764968 0 2024-04-03T08:39:30.216 INFO:tasks.workunit.client.0.smithi157.stdout:5/822: stat dc/d29/d56/d49/c89 0 2024-04-03T08:39:30.216 INFO:tasks.workunit.client.0.smithi157.stdout:4/745: dread - da/df/d2f/d54/fe7 zero size 2024-04-03T08:39:30.219 INFO:tasks.workunit.client.1.smithi181.stdout:2/717: getdents d13/d1c/d4a/d68 0 2024-04-03T08:39:30.223 INFO:tasks.workunit.client.1.smithi181.stdout:5/620: dread d4/f5 [0,4194304] 0 2024-04-03T08:39:30.223 INFO:tasks.workunit.client.0.smithi157.stdout:5/823: dread - dc/d29/d56/d9e/dc3/dde/def/ff3 zero size 2024-04-03T08:39:30.223 INFO:tasks.workunit.client.1.smithi181.stdout:9/682: rename d1/da/d13/d41/d32/f51 to d1/da/d28/d80/dd3/fd4 0 2024-04-03T08:39:30.224 INFO:tasks.workunit.client.0.smithi157.stdout:7/816: dwrite d0/d11/d15/d17/d1c/d4f/d5f/fe4 [0,4194304] 0 2024-04-03T08:39:30.224 INFO:tasks.workunit.client.1.smithi181.stdout:2/718: read d13/da7/d27/d2f/d5d/f8c [2887385,61765] 0 2024-04-03T08:39:30.224 INFO:tasks.workunit.client.1.smithi181.stdout:3/680: unlink d0/d17/d36/d3b/d5a/d93/cc9 0 2024-04-03T08:39:30.230 INFO:tasks.workunit.client.1.smithi181.stdout:3/681: write d0/d17/d36/fb9 [501512,92463] 0 2024-04-03T08:39:30.231 INFO:tasks.workunit.client.1.smithi181.stdout:8/570: fdatasync d4/f27 0 2024-04-03T08:39:30.231 INFO:tasks.workunit.client.0.smithi157.stdout:6/783: write d1/d5/d17/d2a/d37/f60 [5482371,12166] 0 2024-04-03T08:39:30.232 INFO:tasks.workunit.client.0.smithi157.stdout:1/713: creat d2/d11/d24/d39/d3b/d1b/fea x:0 0 0 2024-04-03T08:39:30.233 INFO:tasks.workunit.client.0.smithi157.stdout:0/796: getdents d2/d9/d5f/d85/d106 0 2024-04-03T08:39:30.234 INFO:tasks.workunit.client.0.smithi157.stdout:4/746: mknod da/df/d2f/d64/d8f/dbd/d68/dce/c106 0 2024-04-03T08:39:30.237 INFO:tasks.workunit.client.0.smithi157.stdout:1/714: chown d2/d11/d23/d73/f8e 45763446 1 2024-04-03T08:39:30.238 INFO:tasks.workunit.client.1.smithi181.stdout:7/575: fdatasync d0/f2f 0 2024-04-03T08:39:30.239 INFO:tasks.workunit.client.0.smithi157.stdout:7/817: unlink d0/d11/d15/d17/d9f/cab 0 2024-04-03T08:39:30.239 INFO:tasks.workunit.client.1.smithi181.stdout:3/682: truncate d0/d5/d77/f8f 5170263 0 2024-04-03T08:39:30.240 INFO:tasks.workunit.client.0.smithi157.stdout:3/729: dwrite d8/d1e/d2d/d39/d51/d4c/d32/f42 [0,4194304] 0 2024-04-03T08:39:30.242 INFO:tasks.workunit.client.0.smithi157.stdout:5/824: rename dc/d29/d56/d9e/fe8 to dc/d29/f10c 0 2024-04-03T08:39:30.243 INFO:tasks.workunit.client.1.smithi181.stdout:6/667: dwrite d6/f58 [0,4194304] 0 2024-04-03T08:39:30.246 INFO:tasks.workunit.client.0.smithi157.stdout:2/763: write d3/d2e/d32/d9f/fcb [423140,115621] 0 2024-04-03T08:39:30.251 INFO:tasks.workunit.client.0.smithi157.stdout:8/772: truncate d2/ddd/fdf 659123 0 2024-04-03T08:39:30.255 INFO:tasks.workunit.client.1.smithi181.stdout:9/683: dwrite d1/da/fae [0,4194304] 0 2024-04-03T08:39:30.259 INFO:tasks.workunit.client.1.smithi181.stdout:5/621: symlink d4/d22/d78/lc4 0 2024-04-03T08:39:30.268 INFO:tasks.workunit.client.1.smithi181.stdout:1/646: rename d10/d15/d4b/c7c to d10/d15/d17/d23/d27/cca 0 2024-04-03T08:39:30.271 INFO:tasks.workunit.client.0.smithi157.stdout:1/715: dwrite d2/d11/d24/d39/d3b/d1b/fcd [4194304,4194304] 0 2024-04-03T08:39:30.290 INFO:tasks.workunit.client.1.smithi181.stdout:8/571: creat d4/d45/db/d14/d31/fc1 x:0 0 0 2024-04-03T08:39:30.295 INFO:tasks.workunit.client.0.smithi157.stdout:3/730: chown d8/d1e/d2d/d3f/dc8/lca 15 1 2024-04-03T08:39:30.299 INFO:tasks.workunit.client.0.smithi157.stdout:3/731: chown d8/fdf 1 1 2024-04-03T08:39:30.299 INFO:tasks.workunit.client.1.smithi181.stdout:4/671: dread d1/d16/d24/d5e/f4f [0,4194304] 0 2024-04-03T08:39:30.300 INFO:tasks.workunit.client.0.smithi157.stdout:2/764: dread d3/db/f38 [0,4194304] 0 2024-04-03T08:39:30.305 INFO:tasks.workunit.client.1.smithi181.stdout:6/668: write d6/d3e/d5e/d7c/f49 [1083144,72007] 0 2024-04-03T08:39:30.306 INFO:tasks.workunit.client.1.smithi181.stdout:6/669: dread - d6/d31/d36/dba/da6/d4f/fa9 zero size 2024-04-03T08:39:30.311 INFO:tasks.workunit.client.0.smithi157.stdout:1/716: creat d2/d11/d23/dc9/da1/feb x:0 0 0 2024-04-03T08:39:30.315 INFO:tasks.workunit.client.0.smithi157.stdout:6/784: rename d1/d5/d17/d29/d62/d7f/f90 to d1/d4b/f10d 0 2024-04-03T08:39:30.317 INFO:tasks.workunit.client.0.smithi157.stdout:3/732: chown d8/d1e/d2d/d39/d51/d4c/dd6/de0/lf7 0 1 2024-04-03T08:39:30.317 INFO:tasks.workunit.client.1.smithi181.stdout:5/622: rename d4/f86 to d4/d18/d55/db4/d96/fc5 0 2024-04-03T08:39:30.322 INFO:tasks.workunit.client.1.smithi181.stdout:0/617: sync 2024-04-03T08:39:30.323 INFO:tasks.workunit.client.0.smithi157.stdout:2/765: stat d3/d2e/f83 0 2024-04-03T08:39:30.324 INFO:tasks.workunit.client.1.smithi181.stdout:0/618: readlink d5/dc/d10/d58/dba/d90/l99 0 2024-04-03T08:39:30.325 INFO:tasks.workunit.client.0.smithi157.stdout:9/801: dwrite d1/d15/d27/f49 [4194304,4194304] 0 2024-04-03T08:39:30.326 INFO:tasks.workunit.client.1.smithi181.stdout:0/619: write d5/dc/d75/f91 [184195,17054] 0 2024-04-03T08:39:30.326 INFO:tasks.workunit.client.1.smithi181.stdout:8/572: symlink d4/d2a/d37/lc2 0 2024-04-03T08:39:30.328 INFO:tasks.workunit.client.0.smithi157.stdout:0/797: dread d2/f1d [0,4194304] 0 2024-04-03T08:39:30.329 INFO:tasks.workunit.client.1.smithi181.stdout:3/683: mknod d0/d5/d6/ce4 0 2024-04-03T08:39:30.329 INFO:tasks.workunit.client.0.smithi157.stdout:6/785: chown d1/d4b/da5/dc7/cf4 0 1 2024-04-03T08:39:30.330 INFO:tasks.workunit.client.0.smithi157.stdout:3/733: creat d8/d1e/d2d/d3f/d4d/d8f/fff x:0 0 0 2024-04-03T08:39:30.338 INFO:tasks.workunit.client.0.smithi157.stdout:1/717: symlink d2/d11/d24/d39/lec 0 2024-04-03T08:39:30.340 INFO:tasks.workunit.client.0.smithi157.stdout:6/786: fsync d1/d5/d17/d2a/d37/dca/fe3 0 2024-04-03T08:39:30.340 INFO:tasks.workunit.client.1.smithi181.stdout:2/719: write d13/da7/d27/f3a [61997,53479] 0 2024-04-03T08:39:30.343 INFO:tasks.workunit.client.0.smithi157.stdout:0/798: readlink d2/d9/dc/df/d6f/d9d/d6a/l7a 0 2024-04-03T08:39:30.344 INFO:tasks.workunit.client.0.smithi157.stdout:8/773: dread d2/f5a [0,4194304] 0 2024-04-03T08:39:30.346 INFO:tasks.workunit.client.0.smithi157.stdout:2/766: mknod d3/d12/c10a 0 2024-04-03T08:39:30.346 INFO:tasks.workunit.client.1.smithi181.stdout:1/647: mknod d10/d15/d17/d23/db0/d8d/ccb 0 2024-04-03T08:39:30.349 INFO:tasks.workunit.client.1.smithi181.stdout:0/620: mknod d5/dc/d10/d30/dab/cc7 0 2024-04-03T08:39:30.350 INFO:tasks.workunit.client.0.smithi157.stdout:3/734: creat d8/d1e/d2d/d39/d51/d7e/db1/f100 x:0 0 0 2024-04-03T08:39:30.352 INFO:tasks.workunit.client.1.smithi181.stdout:0/621: truncate d5/dc/f1e 1551570 0 2024-04-03T08:39:30.353 INFO:tasks.workunit.client.1.smithi181.stdout:8/573: creat d4/d45/db/d14/fc3 x:0 0 0 2024-04-03T08:39:30.354 INFO:tasks.workunit.client.0.smithi157.stdout:7/818: write d0/d11/d6f/d89/d8c/dc6/fe8 [99680,130582] 0 2024-04-03T08:39:30.354 INFO:tasks.workunit.client.0.smithi157.stdout:8/774: read d2/d6f/f71 [926984,34811] 0 2024-04-03T08:39:30.356 INFO:tasks.workunit.client.1.smithi181.stdout:3/684: truncate d0/d17/f91 154203 0 2024-04-03T08:39:30.357 INFO:tasks.workunit.client.1.smithi181.stdout:3/685: readlink d0/d5/d6/l58 0 2024-04-03T08:39:30.358 INFO:tasks.workunit.client.1.smithi181.stdout:7/576: creat d0/d1/d6/de/d17/d64/d85/d9a/fd7 x:0 0 0 2024-04-03T08:39:30.358 INFO:tasks.workunit.client.0.smithi157.stdout:8/775: fdatasync d2/d11/d10/fe9 0 2024-04-03T08:39:30.361 INFO:tasks.workunit.client.1.smithi181.stdout:3/686: write d0/d17/d36/d1e/f49 [17668,82837] 0 2024-04-03T08:39:30.363 INFO:tasks.workunit.client.1.smithi181.stdout:4/672: rename d1/d16/d24/d5e/d2b/fda to d1/d1e/d82/fde 0 2024-04-03T08:39:30.363 INFO:tasks.workunit.client.1.smithi181.stdout:6/670: dread d6/f13 [0,4194304] 0 2024-04-03T08:39:30.366 INFO:tasks.workunit.client.0.smithi157.stdout:1/718: dwrite d2/d11/d24/d39/f6f [0,4194304] 0 2024-04-03T08:39:30.366 INFO:tasks.workunit.client.0.smithi157.stdout:0/799: fsync d2/d9/dc/df/d1b/d35/f66 0 2024-04-03T08:39:30.367 INFO:tasks.workunit.client.1.smithi181.stdout:1/648: dwrite d10/d15/d17/d19/d33/f72 [0,4194304] 0 2024-04-03T08:39:30.370 INFO:tasks.workunit.client.1.smithi181.stdout:5/623: mkdir d4/d22/d53/d98/dc2/dc6 0 2024-04-03T08:39:30.372 INFO:tasks.workunit.client.0.smithi157.stdout:0/800: stat d2/d9/dc/df/d1b/d35/d3d/c8f 0 2024-04-03T08:39:30.373 INFO:tasks.workunit.client.0.smithi157.stdout:5/825: rename dc/d29/d56/d18/fd9 to dc/d29/d56/d9e/dc3/de2/f10d 0 2024-04-03T08:39:30.375 INFO:tasks.workunit.client.1.smithi181.stdout:0/622: fdatasync d5/dc/d14/d29/fc2 0 2024-04-03T08:39:30.375 INFO:tasks.workunit.client.1.smithi181.stdout:5/624: chown d4/d18/d25/c82 20886330 1 2024-04-03T08:39:30.375 INFO:tasks.workunit.client.0.smithi157.stdout:5/826: chown dc/d29/d56/d9e/db5/dc9 1 1 2024-04-03T08:39:30.377 INFO:tasks.workunit.client.1.smithi181.stdout:9/684: dwrite d1/da/d13/d22/d23/f94 [0,4194304] 0 2024-04-03T08:39:30.381 INFO:tasks.workunit.client.0.smithi157.stdout:7/819: unlink d0/d11/d6f/d89/d8c/d103/d8e/d96/f100 0 2024-04-03T08:39:30.388 INFO:tasks.workunit.client.1.smithi181.stdout:7/577: mkdir d0/d1/d6/de/d17/d64/d85/dd8 0 2024-04-03T08:39:30.388 INFO:tasks.workunit.client.1.smithi181.stdout:9/685: write d1/f20 [459836,117436] 0 2024-04-03T08:39:30.388 INFO:tasks.workunit.client.0.smithi157.stdout:7/820: truncate d0/d11/d15/d17/d52/f5a 4487627 0 2024-04-03T08:39:30.389 INFO:tasks.workunit.client.0.smithi157.stdout:8/776: chown d2/d11/d10/d24/l33 521 1 2024-04-03T08:39:30.391 INFO:tasks.workunit.client.1.smithi181.stdout:9/686: dread - d1/da/d13/d73/fb7 zero size 2024-04-03T08:39:30.392 INFO:tasks.workunit.client.0.smithi157.stdout:8/777: readlink d2/d6f/d70/d89/d59/lc4 0 2024-04-03T08:39:30.394 INFO:tasks.workunit.client.1.smithi181.stdout:3/687: rmdir d0/d5/d6/dd/d25/d50 39 2024-04-03T08:39:30.394 INFO:tasks.workunit.client.0.smithi157.stdout:8/778: write d2/d11/f93 [219589,108626] 0 2024-04-03T08:39:30.401 INFO:tasks.workunit.client.0.smithi157.stdout:6/787: creat d1/d5/d17/d29/da7/db9/df0/d105/f10e x:0 0 0 2024-04-03T08:39:30.403 INFO:tasks.workunit.client.0.smithi157.stdout:1/719: mkdir d2/d11/d23/dc9/da1/ded 0 2024-04-03T08:39:30.405 INFO:tasks.workunit.client.0.smithi157.stdout:1/720: write d2/d11/d23/dc9/fe4 [176363,39356] 0 2024-04-03T08:39:30.410 INFO:tasks.workunit.client.0.smithi157.stdout:3/735: mknod d8/d13/d1b/d4e/da6/da8/c101 0 2024-04-03T08:39:30.413 INFO:tasks.workunit.client.1.smithi181.stdout:0/623: mkdir d5/d9/dc8 0 2024-04-03T08:39:30.413 INFO:tasks.workunit.client.1.smithi181.stdout:5/625: dread d4/d18/f73 [0,4194304] 0 2024-04-03T08:39:30.414 INFO:tasks.workunit.client.1.smithi181.stdout:5/626: stat d4/d22/l42 0 2024-04-03T08:39:30.414 INFO:tasks.workunit.client.0.smithi157.stdout:3/736: write d8/d1e/d2d/d39/d51/fed [434552,94290] 0 2024-04-03T08:39:30.414 INFO:tasks.workunit.client.0.smithi157.stdout:9/802: getdents d1/d4a/d4d/da4 0 2024-04-03T08:39:30.416 INFO:tasks.workunit.client.0.smithi157.stdout:7/821: rmdir d0/d11/d6f/d89/d8c 39 2024-04-03T08:39:30.417 INFO:tasks.workunit.client.1.smithi181.stdout:2/720: dwrite d13/da7/f7c [0,4194304] 0 2024-04-03T08:39:30.419 INFO:tasks.workunit.client.0.smithi157.stdout:8/779: dread - d2/d6f/d70/fab zero size 2024-04-03T08:39:30.421 INFO:tasks.workunit.client.1.smithi181.stdout:9/687: creat d1/da/d28/d30/d3e/fd5 x:0 0 0 2024-04-03T08:39:30.422 INFO:tasks.workunit.client.1.smithi181.stdout:3/688: symlink d0/d5/d6f/le5 0 2024-04-03T08:39:30.424 INFO:tasks.workunit.client.0.smithi157.stdout:6/788: symlink d1/d4b/d38/da6/l10f 0 2024-04-03T08:39:30.426 INFO:tasks.workunit.client.0.smithi157.stdout:1/721: symlink d2/d11/d23/dc9/d5d/db4/lee 0 2024-04-03T08:39:30.428 INFO:tasks.workunit.client.0.smithi157.stdout:5/827: symlink dc/d29/d43/l10e 0 2024-04-03T08:39:30.430 INFO:tasks.workunit.client.1.smithi181.stdout:1/649: rename d10/d15/d17/d23/db0/d8d/fb4 to d10/d15/d17/d23/db0/fcc 0 2024-04-03T08:39:30.431 INFO:tasks.workunit.client.0.smithi157.stdout:3/737: symlink d8/d13/d1b/d4e/d50/l102 0 2024-04-03T08:39:30.432 INFO:tasks.workunit.client.1.smithi181.stdout:1/650: chown d10/d15/d17/d30/f38 14076504 1 2024-04-03T08:39:30.434 INFO:tasks.workunit.client.1.smithi181.stdout:1/651: readlink d10/d15/d17/d19/d33/d70/l96 0 2024-04-03T08:39:30.435 INFO:tasks.workunit.client.0.smithi157.stdout:2/767: getdents d3/d12 0 2024-04-03T08:39:30.436 INFO:tasks.workunit.client.1.smithi181.stdout:6/671: write d6/d3e/d5e/d7c/f3f [1362983,88018] 0 2024-04-03T08:39:30.437 INFO:tasks.workunit.client.0.smithi157.stdout:8/780: truncate d2/d6f/d70/fbb 2914310 0 2024-04-03T08:39:30.438 INFO:tasks.workunit.client.1.smithi181.stdout:8/574: link d4/d2a/f83 d4/d2a/fc4 0 2024-04-03T08:39:30.440 INFO:tasks.workunit.client.0.smithi157.stdout:1/722: read d2/d11/d23/dc9/d5d/f60 [2142301,47408] 0 2024-04-03T08:39:30.441 INFO:tasks.workunit.client.1.smithi181.stdout:0/624: symlink d5/dc/d10/d30/lc9 0 2024-04-03T08:39:30.443 INFO:tasks.workunit.client.1.smithi181.stdout:7/578: symlink d0/d1/d6/ld9 0 2024-04-03T08:39:30.444 INFO:tasks.workunit.client.0.smithi157.stdout:6/789: truncate d1/d5/d17/d2a/d30/d95/f2e 35125 0 2024-04-03T08:39:30.448 INFO:tasks.workunit.client.1.smithi181.stdout:2/721: symlink d13/d1c/d4a/d7f/db3/d81/l10b 0 2024-04-03T08:39:30.448 INFO:tasks.workunit.client.0.smithi157.stdout:0/801: link d2/d9/dc/df/d6f/l79 d2/d9/dc/d54/df0/l11e 0 2024-04-03T08:39:30.449 INFO:tasks.workunit.client.1.smithi181.stdout:9/688: mkdir d1/da/d28/d30/d3e/dd6 0 2024-04-03T08:39:30.450 INFO:tasks.workunit.client.1.smithi181.stdout:2/722: dread - d13/d1c/d4a/d7f/db3/f88 zero size 2024-04-03T08:39:30.451 INFO:tasks.workunit.client.0.smithi157.stdout:8/781: mknod d2/d20/db1/c10a 0 2024-04-03T08:39:30.451 INFO:tasks.workunit.client.0.smithi157.stdout:8/782: fdatasync d2/f39 0 2024-04-03T08:39:30.452 INFO:tasks.workunit.client.0.smithi157.stdout:5/828: dread - dc/d29/d51/fcc zero size 2024-04-03T08:39:30.453 INFO:tasks.workunit.client.1.smithi181.stdout:8/575: symlink d4/d45/db/d14/d31/d1c/d51/lc5 0 2024-04-03T08:39:30.454 INFO:tasks.workunit.client.0.smithi157.stdout:1/723: mkdir d2/d11/d23/dc9/d5d/db4/dbc/def 0 2024-04-03T08:39:30.455 INFO:tasks.workunit.client.1.smithi181.stdout:3/689: dread d0/d17/f2e [0,4194304] 0 2024-04-03T08:39:30.457 INFO:tasks.workunit.client.1.smithi181.stdout:7/579: mknod d0/d1/d6/de/d17/d64/d82/cda 0 2024-04-03T08:39:30.459 INFO:tasks.workunit.client.0.smithi157.stdout:3/738: creat d8/d1e/d2d/d30/df0/f103 x:0 0 0 2024-04-03T08:39:30.460 INFO:tasks.workunit.client.1.smithi181.stdout:4/673: link d1/d1e/d2c/f73 d1/d1e/d82/fdf 0 2024-04-03T08:39:30.461 INFO:tasks.workunit.client.1.smithi181.stdout:7/580: fdatasync d0/d1/d6/de/f69 0 2024-04-03T08:39:30.466 INFO:tasks.workunit.client.1.smithi181.stdout:1/652: symlink d10/d15/d17/lcd 0 2024-04-03T08:39:30.466 INFO:tasks.workunit.client.0.smithi157.stdout:2/768: symlink d3/l10b 0 2024-04-03T08:39:30.470 INFO:tasks.workunit.client.1.smithi181.stdout:9/689: dwrite d1/da/d13/d41/d65/fa6 [0,4194304] 0 2024-04-03T08:39:30.473 INFO:tasks.workunit.client.1.smithi181.stdout:5/627: rename d4/d22/d4a/lba to d4/d56/lc7 0 2024-04-03T08:39:30.474 INFO:tasks.workunit.client.1.smithi181.stdout:8/576: truncate d4/d45/db/d14/d31/d1c/f2f 1892887 0 2024-04-03T08:39:30.476 INFO:tasks.workunit.client.1.smithi181.stdout:5/628: readlink d4/d18/d25/d68/l8d 0 2024-04-03T08:39:30.477 INFO:tasks.workunit.client.0.smithi157.stdout:0/802: dwrite d2/f5b [0,4194304] 0 2024-04-03T08:39:30.478 INFO:tasks.workunit.client.1.smithi181.stdout:3/690: dread d0/d5/d6/f5e [0,4194304] 0 2024-04-03T08:39:30.479 INFO:tasks.workunit.client.0.smithi157.stdout:3/739: creat d8/d1e/d2d/d3b/d9e/df9/f104 x:0 0 0 2024-04-03T08:39:30.483 INFO:tasks.workunit.client.0.smithi157.stdout:2/769: mkdir d3/d12/d43/d4b/d55/d10c 0 2024-04-03T08:39:30.484 INFO:tasks.workunit.client.1.smithi181.stdout:7/581: mknod d0/d1/d6/db9/cdb 0 2024-04-03T08:39:30.487 INFO:tasks.workunit.client.0.smithi157.stdout:2/770: write d3/d12/f63 [2786730,52206] 0 2024-04-03T08:39:30.488 INFO:tasks.workunit.client.0.smithi157.stdout:5/829: rename dc/d29/d56/d49/l72 to dc/d29/d56/d9e/dc3/dde/def/l10f 0 2024-04-03T08:39:30.489 INFO:tasks.workunit.client.1.smithi181.stdout:4/674: truncate d1/d1e/d2c/f60 111896 0 2024-04-03T08:39:30.491 INFO:tasks.workunit.client.0.smithi157.stdout:1/724: mknod d2/d11/d23/dc9/cf0 0 2024-04-03T08:39:30.491 INFO:tasks.workunit.client.0.smithi157.stdout:6/790: dwrite d1/d5/d17/d2a/d37/f7b [0,4194304] 0 2024-04-03T08:39:30.494 INFO:tasks.workunit.client.0.smithi157.stdout:8/783: write d2/d11/d10/d24/d5b/d53/f79 [506081,27649] 0 2024-04-03T08:39:30.496 INFO:tasks.workunit.client.1.smithi181.stdout:0/625: dwrite f2 [4194304,4194304] 0 2024-04-03T08:39:30.496 INFO:tasks.workunit.client.0.smithi157.stdout:0/803: creat d2/d9/dc/dbe/dfb/f11f x:0 0 0 2024-04-03T08:39:30.498 INFO:tasks.workunit.client.0.smithi157.stdout:3/740: dread - d8/d1e/d2d/d3f/d4d/d8f/fd5 zero size 2024-04-03T08:39:30.500 INFO:tasks.workunit.client.1.smithi181.stdout:6/672: rename d6/d3e/d5e/d7c/lc to d6/d3e/ld0 0 2024-04-03T08:39:30.510 INFO:tasks.workunit.client.0.smithi157.stdout:2/771: mknod d3/db/d44/d4c/c10d 0 2024-04-03T08:39:30.518 INFO:tasks.workunit.client.0.smithi157.stdout:6/791: truncate d1/d4b/d38/d59/fd5 558481 0 2024-04-03T08:39:30.522 INFO:tasks.workunit.client.0.smithi157.stdout:0/804: creat d2/d9/dc/df/d6f/d9d/d6a/d91/f120 x:0 0 0 2024-04-03T08:39:30.523 INFO:tasks.workunit.client.1.smithi181.stdout:5/629: write d4/d18/d3e/f6f [599535,49899] 0 2024-04-03T08:39:30.524 INFO:tasks.workunit.client.0.smithi157.stdout:0/805: fsync d2/d9/d5f/d85/ff2 0 2024-04-03T08:39:30.526 INFO:tasks.workunit.client.1.smithi181.stdout:2/723: dwrite d13/da7/d27/d2f/f9e [0,4194304] 0 2024-04-03T08:39:30.527 INFO:tasks.workunit.client.0.smithi157.stdout:2/772: symlink d3/d12/d43/d4b/l10e 0 2024-04-03T08:39:30.527 INFO:tasks.workunit.client.1.smithi181.stdout:3/691: dwrite d0/d17/d36/d1e/f28 [0,4194304] 0 2024-04-03T08:39:30.529 INFO:tasks.workunit.client.0.smithi157.stdout:5/830: getdents dc/dbb 0 2024-04-03T08:39:30.531 INFO:tasks.workunit.client.1.smithi181.stdout:1/653: truncate d10/d15/d17/d30/f7e 3340021 0 2024-04-03T08:39:30.533 INFO:tasks.workunit.client.1.smithi181.stdout:4/675: dwrite d1/d1e/d2c/f77 [4194304,4194304] 0 2024-04-03T08:39:30.535 INFO:tasks.workunit.client.0.smithi157.stdout:1/725: mkdir d2/d11/d23/dc9/d58/d94/da3/df1 0 2024-04-03T08:39:30.536 INFO:tasks.workunit.client.0.smithi157.stdout:8/784: creat d2/d6f/d70/d89/d59/dc1/f10b x:0 0 0 2024-04-03T08:39:30.537 INFO:tasks.workunit.client.1.smithi181.stdout:9/690: dwrite d1/da/f12 [0,4194304] 0 2024-04-03T08:39:30.542 INFO:tasks.workunit.client.1.smithi181.stdout:9/691: write d1/da/d13/d22/d23/d36/d9c/fbd [1272174,86920] 0 2024-04-03T08:39:30.542 INFO:tasks.workunit.client.0.smithi157.stdout:8/785: chown d2/d11/d10/d24/d5b/d2e/l4f 445833780 1 2024-04-03T08:39:30.547 INFO:tasks.workunit.client.0.smithi157.stdout:5/831: mknod dc/d29/d56/d9e/c110 0 2024-04-03T08:39:30.550 INFO:tasks.workunit.client.0.smithi157.stdout:0/806: creat d2/d9/dc/df/d6f/d9d/d6a/d91/d10b/f121 x:0 0 0 2024-04-03T08:39:30.552 INFO:tasks.workunit.client.0.smithi157.stdout:3/741: link d8/d1e/d2d/d39/d51/d4c/c2a d8/d1e/d2d/d39/c105 0 2024-04-03T08:39:30.552 INFO:tasks.workunit.client.0.smithi157.stdout:5/832: fsync dc/d29/d56/d49/d53/d6c/fed 0 2024-04-03T08:39:30.562 INFO:tasks.workunit.client.0.smithi157.stdout:1/726: symlink d2/d11/d23/dc9/da1/ded/lf2 0 2024-04-03T08:39:30.563 INFO:tasks.workunit.client.0.smithi157.stdout:8/786: link d2/d11/f93 d2/d20/d77/f10c 0 2024-04-03T08:39:30.571 INFO:tasks.workunit.client.0.smithi157.stdout:8/787: creat d2/d6f/f10d x:0 0 0 2024-04-03T08:39:30.573 INFO:tasks.workunit.client.0.smithi157.stdout:1/727: rmdir d2/d11/d24/d39/d3b/d2e/d66/d91/d97 39 2024-04-03T08:39:30.576 INFO:tasks.workunit.client.0.smithi157.stdout:0/807: dwrite d2/d9/dc/df/d6f/d9d/d6a/f11d [0,4194304] 0 2024-04-03T08:39:30.579 INFO:tasks.workunit.client.1.smithi181.stdout:7/582: mknod d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/cdc 0 2024-04-03T08:39:30.585 INFO:tasks.workunit.client.0.smithi157.stdout:8/788: dread d2/f5a [0,4194304] 0 2024-04-03T08:39:30.587 INFO:tasks.workunit.client.1.smithi181.stdout:6/673: rename d6/d3e/d5e/d7c to d6/d31/d36/dba/da6/d4f/dd1 0 2024-04-03T08:39:30.589 INFO:tasks.workunit.client.1.smithi181.stdout:8/577: sync 2024-04-03T08:39:30.591 INFO:tasks.workunit.client.1.smithi181.stdout:6/674: fdatasync d6/d31/d36/dba/da6/d4f/dd1/d9/f15 0 2024-04-03T08:39:30.593 INFO:tasks.workunit.client.0.smithi157.stdout:3/742: link d8/d1e/d2d/d39/d51/d7e/db1/ffd d8/d1e/d2d/d3b/d9e/dcd/f106 0 2024-04-03T08:39:30.595 INFO:tasks.workunit.client.1.smithi181.stdout:6/675: write d6/d31/d36/dba/da6/d4f/d77/fbf [786241,126287] 0 2024-04-03T08:39:30.596 INFO:tasks.workunit.client.1.smithi181.stdout:6/676: readlink d6/d7b/lc2 0 2024-04-03T08:39:30.597 INFO:tasks.workunit.client.1.smithi181.stdout:5/630: creat d4/d18/d25/d59/fc8 x:0 0 0 2024-04-03T08:39:30.601 INFO:tasks.workunit.client.1.smithi181.stdout:5/631: write d4/d80/fa4 [3770030,77818] 0 2024-04-03T08:39:30.603 INFO:tasks.workunit.client.0.smithi157.stdout:3/743: rename d8/d1e/fb9 to d8/d1e/d2d/d3b/d8c/df1/f107 0 2024-04-03T08:39:30.606 INFO:tasks.workunit.client.1.smithi181.stdout:4/676: read d1/d16/f54 [1990516,96383] 0 2024-04-03T08:39:30.606 INFO:tasks.workunit.client.1.smithi181.stdout:1/654: truncate d10/d15/d4b/f98 1045720 0 2024-04-03T08:39:30.606 INFO:tasks.workunit.client.0.smithi157.stdout:2/773: dwrite d3/db/d44/d4c/df1/faf [0,4194304] 0 2024-04-03T08:39:30.609 INFO:tasks.workunit.client.1.smithi181.stdout:8/578: dwrite d4/d45/db/f58 [0,4194304] 0 2024-04-03T08:39:30.617 INFO:tasks.workunit.client.0.smithi157.stdout:1/728: getdents d2/d11/d24/d39 0 2024-04-03T08:39:30.621 INFO:tasks.workunit.client.0.smithi157.stdout:2/774: rmdir d3/d2e 39 2024-04-03T08:39:30.621 INFO:tasks.workunit.client.1.smithi181.stdout:8/579: dread d4/d45/db/d5c/d5e/fbd [0,4194304] 0 2024-04-03T08:39:30.622 INFO:tasks.workunit.client.1.smithi181.stdout:8/580: chown d4/d44/d59/d5f 10 1 2024-04-03T08:39:30.624 INFO:tasks.workunit.client.1.smithi181.stdout:8/581: write d4/fc [3085713,25968] 0 2024-04-03T08:39:30.625 INFO:tasks.workunit.client.1.smithi181.stdout:2/724: mknod d13/d1c/d4a/d7f/dcb/c10c 0 2024-04-03T08:39:30.625 INFO:tasks.workunit.client.1.smithi181.stdout:1/655: dread d10/d15/d41/f44 [0,4194304] 0 2024-04-03T08:39:30.625 INFO:tasks.workunit.client.0.smithi157.stdout:3/744: symlink d8/d1e/d2d/d39/d51/d4c/l108 0 2024-04-03T08:39:30.627 INFO:tasks.workunit.client.1.smithi181.stdout:5/632: rmdir d4/d18/d55/db4/d8a 39 2024-04-03T08:39:30.627 INFO:tasks.workunit.client.1.smithi181.stdout:6/677: dread d6/d31/d36/f4c [0,4194304] 0 2024-04-03T08:39:30.632 INFO:tasks.workunit.client.0.smithi157.stdout:5/833: dwrite dc/d29/d56/d52/fca [0,4194304] 0 2024-04-03T08:39:30.641 INFO:tasks.workunit.client.1.smithi181.stdout:9/692: truncate d1/da/d13/d73/f7d 1796654 0 2024-04-03T08:39:30.647 INFO:tasks.workunit.client.0.smithi157.stdout:3/745: truncate d8/f2f 1157433 0 2024-04-03T08:39:30.648 INFO:tasks.workunit.client.1.smithi181.stdout:5/633: dwrite d4/d18/d55/db4/fa0 [0,4194304] 0 2024-04-03T08:39:30.648 INFO:tasks.workunit.client.0.smithi157.stdout:8/789: write d2/ddd/fdf [183689,128090] 0 2024-04-03T08:39:30.649 INFO:tasks.workunit.client.1.smithi181.stdout:2/725: dwrite d13/d1c/d73/fc5 [0,4194304] 0 2024-04-03T08:39:30.651 INFO:tasks.workunit.client.0.smithi157.stdout:3/746: chown d8/d1e/d2d/d3b/d8c/c98 6 1 2024-04-03T08:39:30.652 INFO:tasks.workunit.client.1.smithi181.stdout:5/634: chown d4/d44 426582 1 2024-04-03T08:39:30.652 INFO:tasks.workunit.client.1.smithi181.stdout:2/726: chown d13/da7/d85/fe5 59 1 2024-04-03T08:39:30.653 INFO:tasks.workunit.client.0.smithi157.stdout:1/729: dread d2/d11/f92 [0,4194304] 0 2024-04-03T08:39:30.654 INFO:tasks.workunit.client.1.smithi181.stdout:2/727: fsync d13/da7/d85/ff4 0 2024-04-03T08:39:30.657 INFO:tasks.workunit.client.0.smithi157.stdout:0/808: dwrite d2/d9/dc/df/d1b/fb2 [4194304,4194304] 0 2024-04-03T08:39:30.662 INFO:tasks.workunit.client.0.smithi157.stdout:0/809: fdatasync d2/d9/dc/df/d1b/d35/d3d/fc1 0 2024-04-03T08:39:30.666 INFO:tasks.workunit.client.1.smithi181.stdout:9/693: dwrite d1/da/d13/d22/d23/d36/d9c/fbd [0,4194304] 0 2024-04-03T08:39:30.667 INFO:tasks.workunit.client.1.smithi181.stdout:7/583: dwrite d0/d1/d6/de/d6d/d96/f9c [0,4194304] 0 2024-04-03T08:39:30.669 INFO:tasks.workunit.client.0.smithi157.stdout:3/747: dread - d8/d1e/d2d/fc6 zero size 2024-04-03T08:39:30.675 INFO:tasks.workunit.client.0.smithi157.stdout:2/775: rmdir d3/d2e/d32/de3/d103 0 2024-04-03T08:39:30.679 INFO:tasks.workunit.client.0.smithi157.stdout:5/834: creat dc/d29/d56/d52/d9d/f111 x:0 0 0 2024-04-03T08:39:30.680 INFO:tasks.workunit.client.0.smithi157.stdout:5/835: readlink dc/d35/lf6 0 2024-04-03T08:39:30.685 INFO:tasks.workunit.client.1.smithi181.stdout:3/692: truncate d0/d17/d63/d81/f88 1979837 0 2024-04-03T08:39:30.690 INFO:tasks.workunit.client.1.smithi181.stdout:4/677: fdatasync d1/d16/d24/d5e/f3c 0 2024-04-03T08:39:30.692 INFO:tasks.workunit.client.1.smithi181.stdout:4/678: dread - d1/d1e/d78/fd1 zero size 2024-04-03T08:39:30.693 INFO:tasks.workunit.client.1.smithi181.stdout:6/678: dread d6/f60 [0,4194304] 0 2024-04-03T08:39:30.696 INFO:tasks.workunit.client.0.smithi157.stdout:2/776: creat d3/dab/f10f x:0 0 0 2024-04-03T08:39:30.700 INFO:tasks.workunit.client.1.smithi181.stdout:2/728: creat d13/d7b/f10d x:0 0 0 2024-04-03T08:39:30.702 INFO:tasks.workunit.client.1.smithi181.stdout:2/729: dread - d13/da7/d85/ff2 zero size 2024-04-03T08:39:30.704 INFO:tasks.workunit.client.1.smithi181.stdout:2/730: write d13/da7/f84 [307600,97486] 0 2024-04-03T08:39:30.705 INFO:tasks.workunit.client.0.smithi157.stdout:8/790: creat d2/d11/d10/d24/f10e x:0 0 0 2024-04-03T08:39:30.706 INFO:tasks.workunit.client.1.smithi181.stdout:2/731: chown d13/da7/d85/de4/ff1 130107 1 2024-04-03T08:39:30.707 INFO:tasks.workunit.client.1.smithi181.stdout:9/694: mkdir d1/da/d13/d22/d23/d36/d91/d9d/dd7 0 2024-04-03T08:39:30.709 INFO:tasks.workunit.client.0.smithi157.stdout:0/810: write d2/d9/dc/df/d1b/d35/d3d/f99 [1055638,94974] 0 2024-04-03T08:39:30.713 INFO:tasks.workunit.client.1.smithi181.stdout:1/656: mkdir d10/d15/dce 0 2024-04-03T08:39:30.713 INFO:tasks.workunit.client.0.smithi157.stdout:0/811: chown d2/d9/dc/dbe/dfb/dbb/fb8 3928 1 2024-04-03T08:39:30.715 INFO:tasks.workunit.client.0.smithi157.stdout:5/836: mkdir dc/dce/d112 0 2024-04-03T08:39:30.717 INFO:tasks.workunit.client.0.smithi157.stdout:3/748: symlink d8/d13/d1b/dc4/dec/l109 0 2024-04-03T08:39:30.718 INFO:tasks.workunit.client.1.smithi181.stdout:5/635: write d4/d22/d53/f6d [4428064,27846] 0 2024-04-03T08:39:30.718 INFO:tasks.workunit.client.0.smithi157.stdout:1/730: truncate d2/d11/d24/d39/d3b/d1b/fcd 6670778 0 2024-04-03T08:39:30.727 INFO:tasks.workunit.client.1.smithi181.stdout:0/626: link d5/d9/d60/f61 d5/dc/d75/daa/fca 0 2024-04-03T08:39:30.727 INFO:tasks.workunit.client.1.smithi181.stdout:9/695: dwrite d1/da/d13/d22/d23/d36/d9c/fa7 [0,4194304] 0 2024-04-03T08:39:30.730 INFO:tasks.workunit.client.0.smithi157.stdout:3/749: truncate d8/d1e/d2d/d3b/d8c/f96 481217 0 2024-04-03T08:39:30.730 INFO:tasks.workunit.client.1.smithi181.stdout:7/584: dread d0/f50 [0,4194304] 0 2024-04-03T08:39:30.734 INFO:tasks.workunit.client.1.smithi181.stdout:2/732: mkdir d13/da7/d40/d10e 0 2024-04-03T08:39:30.737 INFO:tasks.workunit.client.1.smithi181.stdout:8/582: creat d4/d45/fc6 x:0 0 0 2024-04-03T08:39:30.739 INFO:tasks.workunit.client.0.smithi157.stdout:3/750: mkdir d8/d13/d1b/d4e/d50/d10a 0 2024-04-03T08:39:30.739 INFO:tasks.workunit.client.0.smithi157.stdout:8/791: write d2/d6f/d70/d89/f5e [4437770,97188] 0 2024-04-03T08:39:30.742 INFO:tasks.workunit.client.0.smithi157.stdout:2/777: dwrite d3/db/f2a [0,4194304] 0 2024-04-03T08:39:30.742 INFO:tasks.workunit.client.0.smithi157.stdout:5/837: dread dc/d29/d56/d9e/fb8 [0,4194304] 0 2024-04-03T08:39:30.743 INFO:tasks.workunit.client.1.smithi181.stdout:1/657: creat d10/d15/d4a/d86/fcf x:0 0 0 2024-04-03T08:39:30.747 INFO:tasks.workunit.client.1.smithi181.stdout:5/636: chown d4/d18/f23 546 1 2024-04-03T08:39:30.749 INFO:tasks.workunit.client.1.smithi181.stdout:5/637: read d4/d22/d53/f6d [3479697,97682] 0 2024-04-03T08:39:30.749 INFO:tasks.workunit.client.0.smithi157.stdout:0/812: truncate d2/d9/d51/d63/d71/fbc 2871198 0 2024-04-03T08:39:30.750 INFO:tasks.workunit.client.0.smithi157.stdout:3/751: write d8/d1e/d2d/d3b/d8c/f9c [3284037,53709] 0 2024-04-03T08:39:30.753 INFO:tasks.workunit.client.1.smithi181.stdout:6/679: mkdir d6/dc0/dd2 0 2024-04-03T08:39:30.756 INFO:tasks.workunit.client.0.smithi157.stdout:2/778: chown d3/db/d44/d4c/d5a/d88/la4 779 1 2024-04-03T08:39:30.761 INFO:tasks.workunit.client.0.smithi157.stdout:5/838: dread dc/d29/d56/f28 [4194304,4194304] 0 2024-04-03T08:39:30.763 INFO:tasks.workunit.client.1.smithi181.stdout:8/583: creat d4/d45/db/d5c/fc7 x:0 0 0 2024-04-03T08:39:30.764 INFO:tasks.workunit.client.1.smithi181.stdout:3/693: creat d0/d5/fe6 x:0 0 0 2024-04-03T08:39:30.767 INFO:tasks.workunit.client.1.smithi181.stdout:3/694: chown d0/d17/d36/d1e/f49 23 1 2024-04-03T08:39:30.768 INFO:tasks.workunit.client.0.smithi157.stdout:8/792: symlink d2/d6f/d70/d89/d59/df6/l10f 0 2024-04-03T08:39:30.769 INFO:tasks.workunit.client.0.smithi157.stdout:2/779: mknod d3/d2e/d32/d3c/c110 0 2024-04-03T08:39:30.770 INFO:tasks.workunit.client.1.smithi181.stdout:0/627: dwrite d5/d9/d2a/f64 [0,4194304] 0 2024-04-03T08:39:30.770 INFO:tasks.workunit.client.0.smithi157.stdout:3/752: write f4 [8622991,32077] 0 2024-04-03T08:39:30.772 INFO:tasks.workunit.client.1.smithi181.stdout:5/638: creat d4/d18/d25/d68/d77/fc9 x:0 0 0 2024-04-03T08:39:30.774 INFO:tasks.workunit.client.1.smithi181.stdout:7/585: write d0/d1/d6/de/f44 [646716,30573] 0 2024-04-03T08:39:30.774 INFO:tasks.workunit.client.1.smithi181.stdout:4/679: mkdir d1/d16/d24/d5e/d31/dba/ddd/de0 0 2024-04-03T08:39:30.782 INFO:tasks.workunit.client.1.smithi181.stdout:9/696: mkdir d1/da/d28/d30/dd8 0 2024-04-03T08:39:30.784 INFO:tasks.workunit.client.1.smithi181.stdout:2/733: fdatasync d13/da7/d27/f4f 0 2024-04-03T08:39:30.785 INFO:tasks.workunit.client.1.smithi181.stdout:8/584: mkdir d4/d45/db/d14/d31/d1c/d51/d87/dc8 0 2024-04-03T08:39:30.790 INFO:tasks.workunit.client.1.smithi181.stdout:3/695: creat d0/d17/d36/d8c/fe7 x:0 0 0 2024-04-03T08:39:30.791 INFO:tasks.workunit.client.1.smithi181.stdout:5/639: creat d4/d22/d4a/fca x:0 0 0 2024-04-03T08:39:30.792 INFO:tasks.workunit.client.1.smithi181.stdout:3/696: chown d0/d5/fa 74 1 2024-04-03T08:39:30.792 INFO:tasks.workunit.client.1.smithi181.stdout:6/680: creat d6/d9e/fd3 x:0 0 0 2024-04-03T08:39:30.794 INFO:tasks.workunit.client.1.smithi181.stdout:4/680: mkdir d1/d16/dbc/de1 0 2024-04-03T08:39:30.795 INFO:tasks.workunit.client.1.smithi181.stdout:4/681: stat d1/d16/d37/d34/d86/fc6 0 2024-04-03T08:39:30.796 INFO:tasks.workunit.client.1.smithi181.stdout:1/658: dread d10/d15/d17/d19/d33/d70/fc8 [0,4194304] 0 2024-04-03T08:39:30.796 INFO:tasks.workunit.client.1.smithi181.stdout:7/586: mknod d0/d1/d6/de/d6d/d96/cdd 0 2024-04-03T08:39:30.800 INFO:tasks.workunit.client.1.smithi181.stdout:2/734: mkdir d13/da7/d40/d10f 0 2024-04-03T08:39:30.801 INFO:tasks.workunit.client.1.smithi181.stdout:8/585: fsync d4/d44/d59/d5f/d6c/f81 0 2024-04-03T08:39:30.803 INFO:tasks.workunit.client.1.smithi181.stdout:6/681: chown d6/d3e/d40/l45 1109135 1 2024-04-03T08:39:30.804 INFO:tasks.workunit.client.1.smithi181.stdout:3/697: symlink d0/dbc/le8 0 2024-04-03T08:39:30.808 INFO:tasks.workunit.client.1.smithi181.stdout:4/682: creat d1/d16/d24/d61/fe2 x:0 0 0 2024-04-03T08:39:30.809 INFO:tasks.workunit.client.1.smithi181.stdout:1/659: symlink d10/d69/ld0 0 2024-04-03T08:39:30.811 INFO:tasks.workunit.client.1.smithi181.stdout:7/587: dwrite d0/d1/d6/de/d17/d64/fa5 [0,4194304] 0 2024-04-03T08:39:30.827 INFO:tasks.workunit.client.0.smithi157.stdout:0/813: mknod d2/d9/dc/dbe/dfb/dbb/dd1/c122 0 2024-04-03T08:39:30.828 INFO:tasks.workunit.client.0.smithi157.stdout:8/793: read - d2/d20/d23/fec zero size 2024-04-03T08:39:30.829 INFO:tasks.workunit.client.0.smithi157.stdout:5/839: mkdir dc/d29/d56/d9e/db5/d113 0 2024-04-03T08:39:30.830 INFO:tasks.workunit.client.0.smithi157.stdout:3/753: chown d8/d13/d1b/fa1 4523 1 2024-04-03T08:39:30.835 INFO:tasks.workunit.client.0.smithi157.stdout:5/840: creat dc/d29/d56/f114 x:0 0 0 2024-04-03T08:39:30.836 INFO:tasks.workunit.client.0.smithi157.stdout:3/754: fsync d8/d1e/d2d/d39/d51/d48/f63 0 2024-04-03T08:39:30.837 INFO:tasks.workunit.client.0.smithi157.stdout:0/814: getdents d2/d9/dc/d54/df0 0 2024-04-03T08:39:30.837 INFO:tasks.workunit.client.0.smithi157.stdout:5/841: stat dc/d29/d56/d49 0 2024-04-03T08:39:30.840 INFO:tasks.workunit.client.0.smithi157.stdout:8/794: rename d2/cb4 to d2/d11/d10/d24/d5b/d2e/d94/ddb/c110 0 2024-04-03T08:39:30.840 INFO:tasks.workunit.client.0.smithi157.stdout:3/755: chown d8/d1e/d2d/d3f/d4d/c4f 77407044 1 2024-04-03T08:39:30.841 INFO:tasks.workunit.client.0.smithi157.stdout:5/842: write dc/d29/d56/d49/d7f/f82 [4147140,70600] 0 2024-04-03T08:39:30.843 INFO:tasks.workunit.client.0.smithi157.stdout:0/815: creat d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/f123 x:0 0 0 2024-04-03T08:39:30.845 INFO:tasks.workunit.client.0.smithi157.stdout:8/795: fdatasync d2/d11/d10/d24/f54 0 2024-04-03T08:39:30.847 INFO:tasks.workunit.client.0.smithi157.stdout:3/756: chown d8/d13/d1b/d4e/da6/f9d 6268 1 2024-04-03T08:39:30.847 INFO:tasks.workunit.client.0.smithi157.stdout:5/843: write dc/d29/d56/d52/d9d/f111 [719044,50044] 0 2024-04-03T08:39:30.852 INFO:tasks.workunit.client.0.smithi157.stdout:0/816: write d2/d9/dc/df/d1b/ff4 [996901,15009] 0 2024-04-03T08:39:30.854 INFO:tasks.workunit.client.0.smithi157.stdout:5/844: creat dc/d29/d56/d52/f115 x:0 0 0 2024-04-03T08:39:30.858 INFO:tasks.workunit.client.0.smithi157.stdout:0/817: mknod d2/d9/d51/d63/c124 0 2024-04-03T08:39:30.862 INFO:tasks.workunit.client.1.smithi181.stdout:5/640: rename d4/d56/cbe to d4/d18/d55/db4/d96/ccb 0 2024-04-03T08:39:30.863 INFO:tasks.workunit.client.0.smithi157.stdout:3/757: getdents d8/d1e/d2d/d39/d51/d4c/dd6/de0 0 2024-04-03T08:39:30.864 INFO:tasks.workunit.client.1.smithi181.stdout:9/697: creat d1/da/d1a/fd9 x:0 0 0 2024-04-03T08:39:30.865 INFO:tasks.workunit.client.0.smithi157.stdout:0/818: mknod d2/d9/d51/d63/d109/c125 0 2024-04-03T08:39:30.865 INFO:tasks.workunit.client.1.smithi181.stdout:7/588: chown d0/d1/d6/de/d17/lc6 237090301 1 2024-04-03T08:39:30.867 INFO:tasks.workunit.client.1.smithi181.stdout:1/660: mkdir d10/d69/dd1 0 2024-04-03T08:39:30.867 INFO:tasks.workunit.client.0.smithi157.stdout:0/819: chown d2/d9/d36/d38/faf 12 1 2024-04-03T08:39:30.867 INFO:tasks.workunit.client.1.smithi181.stdout:8/586: mknod d4/d45/d9/cc9 0 2024-04-03T08:39:30.870 INFO:tasks.workunit.client.1.smithi181.stdout:1/661: stat d10/d15/d41/fa3 0 2024-04-03T08:39:30.874 INFO:tasks.workunit.client.1.smithi181.stdout:2/735: getdents d13/d1c/d73 0 2024-04-03T08:39:30.875 INFO:tasks.workunit.client.1.smithi181.stdout:7/589: chown d0/d1/d6/de/d17/f55 48 1 2024-04-03T08:39:30.875 INFO:tasks.workunit.client.1.smithi181.stdout:6/682: dwrite d6/d9e/fd3 [0,4194304] 0 2024-04-03T08:39:30.877 INFO:tasks.workunit.client.0.smithi157.stdout:3/758: dread d8/d13/d1b/d4e/f99 [0,4194304] 0 2024-04-03T08:39:30.879 INFO:tasks.workunit.client.0.smithi157.stdout:8/796: dread d2/d20/d23/f41 [0,4194304] 0 2024-04-03T08:39:30.879 INFO:tasks.workunit.client.0.smithi157.stdout:0/820: mkdir d2/d9/dc/df/d6f/d126 0 2024-04-03T08:39:30.880 INFO:tasks.workunit.client.1.smithi181.stdout:6/683: fsync d6/d31/d36/dba/da6/f88 0 2024-04-03T08:39:30.881 INFO:tasks.workunit.client.1.smithi181.stdout:8/587: dread d4/d45/db/f13 [0,4194304] 0 2024-04-03T08:39:30.881 INFO:tasks.workunit.client.1.smithi181.stdout:2/736: write d13/fc1 [83879,9485] 0 2024-04-03T08:39:30.884 INFO:tasks.workunit.client.1.smithi181.stdout:1/662: mknod d10/d15/d17/d23/d27/d91/cd2 0 2024-04-03T08:39:30.884 INFO:tasks.workunit.client.0.smithi157.stdout:0/821: chown d2/d9/dc/df/d1b/d4a/de4/df1 481229 1 2024-04-03T08:39:30.886 INFO:tasks.workunit.client.0.smithi157.stdout:3/759: symlink d8/d1e/d2d/d3b/d9e/df9/l10b 0 2024-04-03T08:39:30.889 INFO:tasks.workunit.client.1.smithi181.stdout:7/590: fdatasync d0/d1/d6/de/d17/f38 0 2024-04-03T08:39:30.890 INFO:tasks.workunit.client.1.smithi181.stdout:1/663: truncate d10/d15/d4a/d86/fcf 511350 0 2024-04-03T08:39:30.891 INFO:tasks.workunit.client.1.smithi181.stdout:4/683: dread d1/d1e/d2c/f59 [0,4194304] 0 2024-04-03T08:39:30.894 INFO:tasks.workunit.client.1.smithi181.stdout:1/664: truncate d10/d15/d4a/f9d 925109 0 2024-04-03T08:39:30.894 INFO:tasks.workunit.client.1.smithi181.stdout:5/641: dread d4/d18/d25/f3c [0,4194304] 0 2024-04-03T08:39:30.895 INFO:tasks.workunit.client.1.smithi181.stdout:7/591: write d0/d1/d6/de/d17/d64/d85/d9a/da4/f79 [386713,9933] 0 2024-04-03T08:39:30.895 INFO:tasks.workunit.client.0.smithi157.stdout:0/822: chown d2/d9/dc/df/d1b/d35/d3d/c8e 82 1 2024-04-03T08:39:30.896 INFO:tasks.workunit.client.1.smithi181.stdout:1/665: readlink d10/d15/d17/d30/l8f 0 2024-04-03T08:39:30.896 INFO:tasks.workunit.client.0.smithi157.stdout:2/780: dwrite d3/db/f31 [0,4194304] 0 2024-04-03T08:39:30.897 INFO:tasks.workunit.client.0.smithi157.stdout:0/823: readlink d2/l55 0 2024-04-03T08:39:30.900 INFO:tasks.workunit.client.1.smithi181.stdout:1/666: truncate d10/d15/d4a/d6f/faf 358165 0 2024-04-03T08:39:30.901 INFO:tasks.workunit.client.0.smithi157.stdout:0/824: write d2/d9/d36/f3f [4033778,52181] 0 2024-04-03T08:39:30.903 INFO:tasks.workunit.client.0.smithi157.stdout:5/845: dwrite dc/d29/d56/d9e/dc3/fcb [0,4194304] 0 2024-04-03T08:39:30.905 INFO:tasks.workunit.client.1.smithi181.stdout:6/684: creat d6/d31/d36/dba/d81/fd4 x:0 0 0 2024-04-03T08:39:30.907 INFO:tasks.workunit.client.1.smithi181.stdout:0/628: sync 2024-04-03T08:39:30.908 INFO:tasks.workunit.client.1.smithi181.stdout:9/698: dread d1/da/d28/d30/d3e/fa5 [0,4194304] 0 2024-04-03T08:39:30.909 INFO:tasks.workunit.client.0.smithi157.stdout:2/781: mknod d3/db/d44/d4c/c111 0 2024-04-03T08:39:30.911 INFO:tasks.workunit.client.1.smithi181.stdout:2/737: creat d13/d1c/d4a/d68/dfa/df9/f110 x:0 0 0 2024-04-03T08:39:30.913 INFO:tasks.workunit.client.1.smithi181.stdout:2/738: write d13/f23 [4637761,50096] 0 2024-04-03T08:39:30.914 INFO:tasks.workunit.client.0.smithi157.stdout:2/782: chown d3/db/d44/d4c/d5a/d88/d97/c106 64971 1 2024-04-03T08:39:30.917 INFO:tasks.workunit.client.1.smithi181.stdout:9/699: write d1/da/d13/d22/d23/d36/d9c/fbd [560086,70132] 0 2024-04-03T08:39:30.917 INFO:tasks.workunit.client.1.smithi181.stdout:7/592: rename d0/d1/d6/de/d6d/d96/dbf/lcf to d0/d1/d6/dca/lde 0 2024-04-03T08:39:30.918 INFO:tasks.workunit.client.0.smithi157.stdout:5/846: rename dc/d29/d56/d49/d7f/faf to dc/d29/d56/d52/d9d/da5/daa/f116 0 2024-04-03T08:39:30.919 INFO:tasks.workunit.client.0.smithi157.stdout:8/797: write d2/d20/f3c [636392,34388] 0 2024-04-03T08:39:30.921 INFO:tasks.workunit.client.1.smithi181.stdout:8/588: write d4/d45/f2e [1455206,125101] 0 2024-04-03T08:39:30.923 INFO:tasks.workunit.client.1.smithi181.stdout:4/684: fdatasync d1/d16/d24/d5e/d3f/f40 0 2024-04-03T08:39:30.925 INFO:tasks.workunit.client.0.smithi157.stdout:0/825: mknod d2/d9/d5f/d85/c127 0 2024-04-03T08:39:30.925 INFO:tasks.workunit.client.0.smithi157.stdout:3/760: write d8/d1e/d2d/f79 [1310690,21690] 0 2024-04-03T08:39:30.927 INFO:tasks.workunit.client.0.smithi157.stdout:2/783: dread - d3/d2e/d32/d9f/da7/ff5 zero size 2024-04-03T08:39:30.933 INFO:tasks.workunit.client.0.smithi157.stdout:5/847: rename dc/d29/d56/d9e/db5/dc9/f101 to dc/d29/d51/f117 0 2024-04-03T08:39:30.935 INFO:tasks.workunit.client.1.smithi181.stdout:2/739: dwrite d13/da7/d85/fe5 [0,4194304] 0 2024-04-03T08:39:30.936 INFO:tasks.workunit.client.0.smithi157.stdout:3/761: creat d8/d13/d1b/d4e/d50/f10c x:0 0 0 2024-04-03T08:39:30.941 INFO:tasks.workunit.client.1.smithi181.stdout:9/700: dread d1/da/d13/d22/f8d [0,4194304] 0 2024-04-03T08:39:30.947 INFO:tasks.workunit.client.1.smithi181.stdout:7/593: truncate d0/d1/d6/de/d17/f38 421497 0 2024-04-03T08:39:30.949 INFO:tasks.workunit.client.1.smithi181.stdout:8/589: symlink d4/d45/db/d14/lca 0 2024-04-03T08:39:30.952 INFO:tasks.workunit.client.0.smithi157.stdout:3/762: mkdir d8/d13/d1b/d4e/d50/d7c/dd8/d10d 0 2024-04-03T08:39:30.952 INFO:tasks.workunit.client.1.smithi181.stdout:0/629: fdatasync d5/d9/f3e 0 2024-04-03T08:39:30.954 INFO:tasks.workunit.client.1.smithi181.stdout:1/667: dwrite d10/d15/d4b/d6c/f9f [4194304,4194304] 0 2024-04-03T08:39:30.955 INFO:tasks.workunit.client.1.smithi181.stdout:8/590: write d4/d45/d9/f1b [2742745,24156] 0 2024-04-03T08:39:30.956 INFO:tasks.workunit.client.1.smithi181.stdout:7/594: fdatasync d0/d1/d6/de/d17/d64/d85/d9a/da4/fc2 0 2024-04-03T08:39:30.956 INFO:tasks.workunit.client.0.smithi157.stdout:5/848: mknod dc/c118 0 2024-04-03T08:39:30.957 INFO:tasks.workunit.client.0.smithi157.stdout:5/849: readlink dc/l4c 0 2024-04-03T08:39:30.958 INFO:tasks.workunit.client.0.smithi157.stdout:3/763: chown d8/d1e/d2d/d39/d51/d48/dab/dee 5004 1 2024-04-03T08:39:30.959 INFO:tasks.workunit.client.0.smithi157.stdout:8/798: dwrite d2/d11/d10/d24/d5b/d53/faf [0,4194304] 0 2024-04-03T08:39:30.959 INFO:tasks.workunit.client.0.smithi157.stdout:0/826: dread d2/d9/dc/dbe/dfb/dbb/fb8 [0,4194304] 0 2024-04-03T08:39:30.960 INFO:tasks.workunit.client.1.smithi181.stdout:2/740: read d13/d1c/f3b [1957971,40051] 0 2024-04-03T08:39:30.961 INFO:tasks.workunit.client.1.smithi181.stdout:1/668: truncate d10/d15/d17/d19/fc6 822037 0 2024-04-03T08:39:30.962 INFO:tasks.workunit.client.0.smithi157.stdout:2/784: write d3/d2e/d32/d3c/f52 [446422,101539] 0 2024-04-03T08:39:30.963 INFO:tasks.workunit.client.1.smithi181.stdout:2/741: dread - d13/da7/d85/de4/f106 zero size 2024-04-03T08:39:30.964 INFO:tasks.workunit.client.0.smithi157.stdout:8/799: mkdir d2/d20/db1/d111 0 2024-04-03T08:39:30.964 INFO:tasks.workunit.client.0.smithi157.stdout:2/785: readlink d3/d2e/d32/l91 0 2024-04-03T08:39:30.968 INFO:tasks.workunit.client.1.smithi181.stdout:9/701: mkdir d1/da/d1a/d92/dda 0 2024-04-03T08:39:30.970 INFO:tasks.workunit.client.0.smithi157.stdout:5/850: symlink dc/d29/d56/d9e/dc3/de2/l119 0 2024-04-03T08:39:30.974 INFO:tasks.workunit.client.1.smithi181.stdout:8/591: creat d4/d44/d59/fcb x:0 0 0 2024-04-03T08:39:30.977 INFO:tasks.workunit.client.1.smithi181.stdout:0/630: rename d5/dc/d10/d58/dba/f72 to d5/d9/dc8/fcb 0 2024-04-03T08:39:30.978 INFO:tasks.workunit.client.0.smithi157.stdout:8/800: fdatasync d2/d11/d10/d24/d5b/fe4 0 2024-04-03T08:39:30.983 INFO:tasks.workunit.client.1.smithi181.stdout:7/595: unlink d0/d1/d6/de/d17/d64/d85/d9a/da4/f79 0 2024-04-03T08:39:30.985 INFO:tasks.workunit.client.1.smithi181.stdout:7/596: dread - d0/d1/d6/de/d17/d64/d85/d9a/da4/f89 zero size 2024-04-03T08:39:30.985 INFO:tasks.workunit.client.0.smithi157.stdout:3/764: getdents d8/d1e/d2d/d3f/dc8 0 2024-04-03T08:39:30.989 INFO:tasks.workunit.client.0.smithi157.stdout:3/765: chown d8/d1e/d2d/d39/d51/d48/fc1 1289673 1 2024-04-03T08:39:30.989 INFO:tasks.workunit.client.0.smithi157.stdout:0/827: link d2/f21 d2/d9/dc/df/d1b/d4a/de4/f128 0 2024-04-03T08:39:30.994 INFO:tasks.workunit.client.1.smithi181.stdout:9/702: rename d1/l1c to d1/da/d28/d80/ldb 0 2024-04-03T08:39:30.994 INFO:tasks.workunit.client.1.smithi181.stdout:1/669: write d10/d15/d41/f61 [467573,27222] 0 2024-04-03T08:39:30.997 INFO:tasks.workunit.client.1.smithi181.stdout:3/698: sync 2024-04-03T08:39:30.998 INFO:tasks.workunit.client.1.smithi181.stdout:4/685: getdents d1/d16/d24/d5e/d2b/d56 0 2024-04-03T08:39:31.003 INFO:tasks.workunit.client.0.smithi157.stdout:2/786: truncate d3/d2e/f90 3653881 0 2024-04-03T08:39:31.004 INFO:tasks.workunit.client.1.smithi181.stdout:2/742: dwrite d13/d1c/d4a/d68/f9a [0,4194304] 0 2024-04-03T08:39:31.005 INFO:tasks.workunit.client.0.smithi157.stdout:8/801: write d2/d6f/f71 [842991,15932] 0 2024-04-03T08:39:31.006 INFO:tasks.workunit.client.0.smithi157.stdout:5/851: creat dc/f11a x:0 0 0 2024-04-03T08:39:31.008 INFO:tasks.workunit.client.1.smithi181.stdout:0/631: mkdir d5/d9/d2c/dcc 0 2024-04-03T08:39:31.014 INFO:tasks.workunit.client.0.smithi157.stdout:3/766: dread d8/d1e/d2d/d3b/d8c/db4/fbd [0,4194304] 0 2024-04-03T08:39:31.014 INFO:tasks.workunit.client.1.smithi181.stdout:9/703: unlink d1/da/d1a/fd0 0 2024-04-03T08:39:31.017 INFO:tasks.workunit.client.0.smithi157.stdout:0/828: link d2/d9/d36/d82/l100 d2/d9/d36/d82/l129 0 2024-04-03T08:39:31.017 INFO:tasks.workunit.client.0.smithi157.stdout:8/802: truncate d2/d11/d10/d24/d5b/d2e/d75/faa 916925 0 2024-04-03T08:39:31.020 INFO:tasks.workunit.client.1.smithi181.stdout:3/699: mkdir d0/d5/d6/dd/d5f/d95/de9 0 2024-04-03T08:39:31.020 INFO:tasks.workunit.client.0.smithi157.stdout:3/767: write d8/d1e/d2d/d39/d51/d48/dab/ffc [569645,60270] 0 2024-04-03T08:39:31.021 INFO:tasks.workunit.client.1.smithi181.stdout:2/743: mkdir d13/d1c/d6c/d111 0 2024-04-03T08:39:31.021 INFO:tasks.workunit.client.1.smithi181.stdout:7/597: dwrite d0/d1/d6/de/d17/f2c [0,4194304] 0 2024-04-03T08:39:31.030 INFO:tasks.workunit.client.0.smithi157.stdout:8/803: creat d2/d11/d10/d24/d5b/d53/f112 x:0 0 0 2024-04-03T08:39:31.030 INFO:tasks.workunit.client.1.smithi181.stdout:7/598: chown d0/d1/d6/de/la6 21111 1 2024-04-03T08:39:31.030 INFO:tasks.workunit.client.1.smithi181.stdout:0/632: dwrite d5/dc/d75/f91 [0,4194304] 0 2024-04-03T08:39:31.031 INFO:tasks.workunit.client.0.smithi157.stdout:3/768: dread d8/fc2 [0,4194304] 0 2024-04-03T08:39:31.032 INFO:tasks.workunit.client.1.smithi181.stdout:0/633: write d5/d9/d60/f82 [2043395,46550] 0 2024-04-03T08:39:31.035 INFO:tasks.workunit.client.1.smithi181.stdout:0/634: stat d5/dc/d10 0 2024-04-03T08:39:31.035 INFO:tasks.workunit.client.1.smithi181.stdout:3/700: read - d0/d5/d6/f89 zero size 2024-04-03T08:39:31.040 INFO:tasks.workunit.client.0.smithi157.stdout:5/852: dread dc/f1d [0,4194304] 0 2024-04-03T08:39:31.040 INFO:tasks.workunit.client.1.smithi181.stdout:3/701: write d0/d17/d36/d3b/d5a/fd1 [370724,33479] 0 2024-04-03T08:39:31.043 INFO:tasks.workunit.client.1.smithi181.stdout:3/702: dread - d0/d17/f26 zero size 2024-04-03T08:39:31.043 INFO:tasks.workunit.client.0.smithi157.stdout:8/804: symlink d2/d20/l113 0 2024-04-03T08:39:31.045 INFO:tasks.workunit.client.1.smithi181.stdout:4/686: dwrite d1/d16/f5a [0,4194304] 0 2024-04-03T08:39:31.048 INFO:tasks.workunit.client.1.smithi181.stdout:8/592: rename d4/d45/f8 to d4/d45/db/d14/d31/d1c/fcc 0 2024-04-03T08:39:31.049 INFO:tasks.workunit.client.0.smithi157.stdout:0/829: truncate d2/d9/d5f/d105/f10a 615230 0 2024-04-03T08:39:31.050 INFO:tasks.workunit.client.1.smithi181.stdout:2/744: write d13/d1c/d4a/d7f/db3/f61 [4620912,99030] 0 2024-04-03T08:39:31.050 INFO:tasks.workunit.client.1.smithi181.stdout:0/635: fdatasync d5/dc/d14/d29/f47 0 2024-04-03T08:39:31.053 INFO:tasks.workunit.client.0.smithi157.stdout:8/805: write d2/d20/d23/f41 [3095218,81809] 0 2024-04-03T08:39:31.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:30 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:31.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:30 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:31.069 INFO:tasks.workunit.client.1.smithi181.stdout:4/687: dread d1/d16/d24/d5e/d3f/d41/f87 [0,4194304] 0 2024-04-03T08:39:31.072 INFO:tasks.workunit.client.1.smithi181.stdout:4/688: chown d1/d16/d24/d5e/d2b/db9/fd5 184468 1 2024-04-03T08:39:31.083 INFO:tasks.workunit.client.1.smithi181.stdout:7/599: mkdir d0/d1/d6/ddf 0 2024-04-03T08:39:31.093 INFO:tasks.workunit.client.1.smithi181.stdout:0/636: chown d5/d9/f7f 338044451 1 2024-04-03T08:39:31.094 INFO:tasks.workunit.client.0.smithi157.stdout:5/853: write dc/d29/f10c [897427,1405] 0 2024-04-03T08:39:31.094 INFO:tasks.workunit.client.0.smithi157.stdout:3/769: creat d8/f10e x:0 0 0 2024-04-03T08:39:31.095 INFO:tasks.workunit.client.1.smithi181.stdout:2/745: creat d13/da7/d85/f112 x:0 0 0 2024-04-03T08:39:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:30 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:31.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:30 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:31.097 INFO:tasks.workunit.client.1.smithi181.stdout:2/746: stat d13/da7/d27/d2f/d5d 0 2024-04-03T08:39:31.097 INFO:tasks.workunit.client.0.smithi157.stdout:0/830: write d2/d9/dc/df/d6f/d9d/d6a/fe5 [143256,3357] 0 2024-04-03T08:39:31.098 INFO:tasks.workunit.client.1.smithi181.stdout:2/747: readlink d13/d1c/l83 0 2024-04-03T08:39:31.100 INFO:tasks.workunit.client.1.smithi181.stdout:2/748: chown d13/d1c/da5/dac 13 1 2024-04-03T08:39:31.102 INFO:tasks.workunit.client.0.smithi157.stdout:3/770: mknod d8/d13/d1b/d4e/da6/c10f 0 2024-04-03T08:39:31.104 INFO:tasks.workunit.client.0.smithi157.stdout:5/854: symlink dc/d29/d56/d9e/db5/l11b 0 2024-04-03T08:39:31.104 INFO:tasks.workunit.client.1.smithi181.stdout:0/637: rmdir d5/dc/d14 39 2024-04-03T08:39:31.107 INFO:tasks.workunit.client.1.smithi181.stdout:4/689: mknod d1/d16/d24/d5e/d31/d39/d5d/d9a/ce3 0 2024-04-03T08:39:31.108 INFO:tasks.workunit.client.0.smithi157.stdout:3/771: unlink d8/d13/f15 0 2024-04-03T08:39:31.109 INFO:tasks.workunit.client.1.smithi181.stdout:7/600: truncate d0/d1/d6/de/d17/d64/fbc 211481 0 2024-04-03T08:39:31.110 INFO:tasks.workunit.client.0.smithi157.stdout:5/855: creat dc/d29/d56/d52/d9d/da5/daa/f11c x:0 0 0 2024-04-03T08:39:31.111 INFO:tasks.workunit.client.1.smithi181.stdout:2/749: symlink d13/d1c/d4a/d68/d72/l113 0 2024-04-03T08:39:31.112 INFO:tasks.workunit.client.0.smithi157.stdout:0/831: creat d2/d9/d36/f12a x:0 0 0 2024-04-03T08:39:31.112 INFO:tasks.workunit.client.1.smithi181.stdout:2/750: write d13/f19 [4075826,103035] 0 2024-04-03T08:39:31.112 INFO:tasks.workunit.client.0.smithi157.stdout:3/772: chown d8/d1e/d2d/d3f/d4d/d8f/cc0 631083 1 2024-04-03T08:39:31.113 INFO:tasks.workunit.client.1.smithi181.stdout:0/638: creat d5/d9/d2a/da1/da8/fcd x:0 0 0 2024-04-03T08:39:31.114 INFO:tasks.workunit.client.1.smithi181.stdout:4/690: mkdir d1/d1e/d2c/de4 0 2024-04-03T08:39:31.116 INFO:tasks.workunit.client.0.smithi157.stdout:8/806: dwrite d2/d6f/d70/d89/d59/df6/f102 [0,4194304] 0 2024-04-03T08:39:31.117 INFO:tasks.workunit.client.1.smithi181.stdout:7/601: mknod d0/d1/d6/de/d17/d64/d82/ce0 0 2024-04-03T08:39:31.117 INFO:tasks.workunit.client.0.smithi157.stdout:0/832: dread d2/d9/f110 [0,4194304] 0 2024-04-03T08:39:31.120 INFO:tasks.workunit.client.1.smithi181.stdout:5/642: sync 2024-04-03T08:39:31.121 INFO:tasks.workunit.client.1.smithi181.stdout:6/685: sync 2024-04-03T08:39:31.121 INFO:tasks.workunit.client.1.smithi181.stdout:2/751: rmdir d13/da7/d85/dbd 39 2024-04-03T08:39:31.123 INFO:tasks.workunit.client.0.smithi157.stdout:3/773: symlink d8/d1e/d2d/d3f/d4d/l110 0 2024-04-03T08:39:31.123 INFO:tasks.workunit.client.1.smithi181.stdout:2/752: fdatasync d13/d1c/d4a/d7f/db3/f53 0 2024-04-03T08:39:31.125 INFO:tasks.workunit.client.1.smithi181.stdout:6/686: write d6/d31/d36/dba/da6/d4f/dd1/d9/f15 [5088114,62768] 0 2024-04-03T08:39:31.129 INFO:tasks.workunit.client.1.smithi181.stdout:3/703: rename d0/d5/d6/dd/d25/d50/f66 to d0/d17/d40/fea 0 2024-04-03T08:39:31.130 INFO:tasks.workunit.client.1.smithi181.stdout:6/687: chown d6/d31/d36/f5d 90 1 2024-04-03T08:39:31.131 INFO:tasks.workunit.client.0.smithi157.stdout:0/833: rename d2/f21 to d2/d9/d51/f12b 0 2024-04-03T08:39:31.135 INFO:tasks.workunit.client.1.smithi181.stdout:7/602: symlink d0/d1/d6/de/d17/d64/le1 0 2024-04-03T08:39:31.136 INFO:tasks.workunit.client.1.smithi181.stdout:4/691: read d1/d16/d24/d5e/d31/f65 [885112,4586] 0 2024-04-03T08:39:31.137 INFO:tasks.workunit.client.0.smithi157.stdout:3/774: dread d8/f2c [0,4194304] 0 2024-04-03T08:39:31.137 INFO:tasks.workunit.client.0.smithi157.stdout:8/807: mknod d2/d11/d10/d24/d5b/d2e/d75/def/c114 0 2024-04-03T08:39:31.141 INFO:tasks.workunit.client.0.smithi157.stdout:0/834: symlink d2/d9/dc/df/d6f/d9d/d6a/d91/l12c 0 2024-04-03T08:39:31.142 INFO:tasks.workunit.client.1.smithi181.stdout:0/639: dwrite d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:31.142 INFO:tasks.workunit.client.0.smithi157.stdout:3/775: fdatasync d8/d1e/f7a 0 2024-04-03T08:39:31.143 INFO:tasks.workunit.client.1.smithi181.stdout:0/640: readlink d5/dc/d10/d30/l3d 0 2024-04-03T08:39:31.144 INFO:tasks.workunit.client.0.smithi157.stdout:5/856: write dc/d29/d56/d9e/dc3/fdf [649558,26831] 0 2024-04-03T08:39:31.144 INFO:tasks.workunit.client.0.smithi157.stdout:0/835: chown d2/d9/dc/df/d6f/d9d/d6a/d91/l12c 447 1 2024-04-03T08:39:31.145 INFO:tasks.workunit.client.1.smithi181.stdout:0/641: readlink d5/dc/lbc 0 2024-04-03T08:39:31.151 INFO:tasks.workunit.client.1.smithi181.stdout:5/643: write d4/d18/d55/d5a/f76 [2881791,71725] 0 2024-04-03T08:39:31.152 INFO:tasks.workunit.client.1.smithi181.stdout:7/603: write d0/d1/d6/de/d17/f4c [1475561,73359] 0 2024-04-03T08:39:31.154 INFO:tasks.workunit.client.1.smithi181.stdout:7/604: chown d0/d1/d6/de/d17/d64/d85/d9a/da4 5011 1 2024-04-03T08:39:31.158 INFO:tasks.workunit.client.1.smithi181.stdout:3/704: symlink d0/d17/leb 0 2024-04-03T08:39:31.159 INFO:tasks.workunit.client.1.smithi181.stdout:7/605: read d0/f3e [4552514,72410] 0 2024-04-03T08:39:31.160 INFO:tasks.workunit.client.1.smithi181.stdout:3/705: chown d0/d5/d6/f39 3722 1 2024-04-03T08:39:31.160 INFO:tasks.workunit.client.0.smithi157.stdout:0/836: dread d2/d9/dc/df/d6f/fed [0,4194304] 0 2024-04-03T08:39:31.161 INFO:tasks.workunit.client.0.smithi157.stdout:5/857: creat dc/d29/d56/d9e/db5/f11d x:0 0 0 2024-04-03T08:39:31.166 INFO:tasks.workunit.client.0.smithi157.stdout:0/837: mknod d2/d9/dc/d54/c12d 0 2024-04-03T08:39:31.168 INFO:tasks.workunit.client.0.smithi157.stdout:5/858: rmdir dc/d29/d56/d52/d9d/da5 39 2024-04-03T08:39:31.169 INFO:tasks.workunit.client.1.smithi181.stdout:4/692: symlink d1/d16/d24/d5e/d31/d39/d5d/d94/le5 0 2024-04-03T08:39:31.170 INFO:tasks.workunit.client.0.smithi157.stdout:3/776: creat d8/d13/d1b/d4e/d50/d7c/dd8/d10d/f111 x:0 0 0 2024-04-03T08:39:31.172 INFO:tasks.workunit.client.1.smithi181.stdout:7/606: truncate d0/d1/d6/f68 96362 0 2024-04-03T08:39:31.174 INFO:tasks.workunit.client.0.smithi157.stdout:3/777: chown d8/d1e/d2d/d3f/d4d/d8f/cd3 12237220 1 2024-04-03T08:39:31.175 INFO:tasks.workunit.client.0.smithi157.stdout:8/808: dwrite d2/d11/d10/d24/d5b/d2e/f38 [0,4194304] 0 2024-04-03T08:39:31.175 INFO:tasks.workunit.client.1.smithi181.stdout:3/706: creat d0/d17/d36/d3b/d5a/fec x:0 0 0 2024-04-03T08:39:31.176 INFO:tasks.workunit.client.1.smithi181.stdout:2/753: link d13/d1c/d4a/d68/fb1 d13/da7/d27/f114 0 2024-04-03T08:39:31.178 INFO:tasks.workunit.client.1.smithi181.stdout:6/688: creat d6/d31/d36/dba/da6/fd5 x:0 0 0 2024-04-03T08:39:31.182 INFO:tasks.workunit.client.1.smithi181.stdout:3/707: fsync d0/d5/d6/d32/d43/f60 0 2024-04-03T08:39:31.188 INFO:tasks.workunit.client.0.smithi157.stdout:0/838: dwrite d2/d9/dc/df/d1b/f59 [0,4194304] 0 2024-04-03T08:39:31.190 INFO:tasks.workunit.client.1.smithi181.stdout:5/644: write d4/d18/d55/db4/f9f [1046579,47546] 0 2024-04-03T08:39:31.191 INFO:tasks.workunit.client.0.smithi157.stdout:8/809: symlink d2/d11/d10/l115 0 2024-04-03T08:39:31.194 INFO:tasks.workunit.client.1.smithi181.stdout:3/708: symlink d0/d17/d36/d3b/d5a/d93/led 0 2024-04-03T08:39:31.198 INFO:tasks.workunit.client.1.smithi181.stdout:4/693: link d1/d16/d37/f7d d1/d1e/d82/d84/fe6 0 2024-04-03T08:39:31.201 INFO:tasks.workunit.client.1.smithi181.stdout:0/642: getdents d5/dc/d14/d29 0 2024-04-03T08:39:31.201 INFO:tasks.workunit.client.0.smithi157.stdout:8/810: dread - d2/d11/d10/d24/d5b/d2e/d75/d81/fd6 zero size 2024-04-03T08:39:31.202 INFO:tasks.workunit.client.0.smithi157.stdout:3/778: link d8/d13/c3e d8/d1e/d2d/d39/d51/d4c/c112 0 2024-04-03T08:39:31.204 INFO:tasks.workunit.client.1.smithi181.stdout:5/645: mknod d4/d18/d55/db4/d90/ccc 0 2024-04-03T08:39:31.204 INFO:tasks.workunit.client.1.smithi181.stdout:7/607: dwrite d0/d1/d6/de/d17/d64/d85/d9a/da4/fab [0,4194304] 0 2024-04-03T08:39:31.206 INFO:tasks.workunit.client.1.smithi181.stdout:5/646: chown d4/d56 231064761 1 2024-04-03T08:39:31.207 INFO:tasks.workunit.client.0.smithi157.stdout:0/839: getdents d2/dd8/dfd 0 2024-04-03T08:39:31.207 INFO:tasks.workunit.client.0.smithi157.stdout:3/779: fsync d8/d1e/d2d/d3b/d9e/df9/f104 0 2024-04-03T08:39:31.207 INFO:tasks.workunit.client.0.smithi157.stdout:5/859: dwrite dc/d29/d56/d18/d21/f94 [0,4194304] 0 2024-04-03T08:39:31.208 INFO:tasks.workunit.client.0.smithi157.stdout:8/811: symlink d2/d11/d10/d24/d5b/d2e/d75/l116 0 2024-04-03T08:39:31.209 INFO:tasks.workunit.client.1.smithi181.stdout:2/754: dread d13/f19 [0,4194304] 0 2024-04-03T08:39:31.210 INFO:tasks.workunit.client.0.smithi157.stdout:0/840: fdatasync d2/d9/dc/dbe/dfb/f11f 0 2024-04-03T08:39:31.213 INFO:tasks.workunit.client.0.smithi157.stdout:0/841: readlink d2/ld 0 2024-04-03T08:39:31.214 INFO:tasks.workunit.client.0.smithi157.stdout:3/780: chown d8/d13/d1b/d4e/da6/da8 1097244020 1 2024-04-03T08:39:31.217 INFO:tasks.workunit.client.1.smithi181.stdout:7/608: dread - d0/d1/d6/de/f5e zero size 2024-04-03T08:39:31.218 INFO:tasks.workunit.client.0.smithi157.stdout:8/812: mkdir d2/d11/d10/d24/d5b/d53/d117 0 2024-04-03T08:39:31.219 INFO:tasks.workunit.client.1.smithi181.stdout:7/609: chown d0/d1/f66 4039358 1 2024-04-03T08:39:31.219 INFO:tasks.workunit.client.1.smithi181.stdout:2/755: truncate d13/d1c/d4a/d68/f86 422873 0 2024-04-03T08:39:31.220 INFO:tasks.workunit.client.0.smithi157.stdout:0/842: mknod d2/d9/dc/df/d1b/d35/d3d/c12e 0 2024-04-03T08:39:31.222 INFO:tasks.workunit.client.1.smithi181.stdout:3/709: dwrite d0/d5/d6/d32/d43/d6b/fd9 [0,4194304] 0 2024-04-03T08:39:31.225 INFO:tasks.workunit.client.0.smithi157.stdout:0/843: fdatasync d2/d9/dc/df/d1b/d4a/f20 0 2024-04-03T08:39:31.227 INFO:tasks.workunit.client.1.smithi181.stdout:6/689: truncate d6/d31/d36/f34 289017 0 2024-04-03T08:39:31.230 INFO:tasks.workunit.client.0.smithi157.stdout:8/813: symlink d2/d20/db1/l118 0 2024-04-03T08:39:31.230 INFO:tasks.workunit.client.1.smithi181.stdout:3/710: mknod d0/d17/d36/d3b/d5a/d93/d9c/cee 0 2024-04-03T08:39:31.234 INFO:tasks.workunit.client.0.smithi157.stdout:8/814: stat d2/d11/c6b 0 2024-04-03T08:39:31.235 INFO:tasks.workunit.client.0.smithi157.stdout:0/844: write d2/f3 [4023225,126117] 0 2024-04-03T08:39:31.235 INFO:tasks.workunit.client.1.smithi181.stdout:2/756: creat d13/d1c/d6c/d111/f115 x:0 0 0 2024-04-03T08:39:31.235 INFO:tasks.workunit.client.1.smithi181.stdout:6/690: creat d6/d7b/fd6 x:0 0 0 2024-04-03T08:39:31.235 INFO:tasks.workunit.client.1.smithi181.stdout:7/610: rename d0/d1/d6/de/d17/d64/d85/d87/cb8 to d0/d1/d6/db9/ce2 0 2024-04-03T08:39:31.235 INFO:tasks.workunit.client.0.smithi157.stdout:0/845: stat d2/f50 0 2024-04-03T08:39:31.236 INFO:tasks.workunit.client.1.smithi181.stdout:3/711: symlink d0/d17/d63/dd6/lef 0 2024-04-03T08:39:31.237 INFO:tasks.workunit.client.1.smithi181.stdout:2/757: chown d13/d1c/d4a/d68/l24 1 1 2024-04-03T08:39:31.240 INFO:tasks.workunit.client.1.smithi181.stdout:3/712: stat d0/d17/d36/d3b/d5a/d85/laf 0 2024-04-03T08:39:31.241 INFO:tasks.workunit.client.0.smithi157.stdout:0/846: write d2/d9/dc/df/d6f/de3/fff [639495,83217] 0 2024-04-03T08:39:31.241 INFO:tasks.workunit.client.1.smithi181.stdout:1/670: sync 2024-04-03T08:39:31.241 INFO:tasks.workunit.client.1.smithi181.stdout:9/704: sync 2024-04-03T08:39:31.241 INFO:tasks.workunit.client.1.smithi181.stdout:8/593: sync 2024-04-03T08:39:31.242 INFO:tasks.workunit.client.1.smithi181.stdout:0/643: dwrite d5/dc/d10/d30/f94 [0,4194304] 0 2024-04-03T08:39:31.242 INFO:tasks.workunit.client.1.smithi181.stdout:2/758: mkdir d13/d1c/d4a/d68/d72/d116 0 2024-04-03T08:39:31.242 INFO:tasks.workunit.client.0.smithi157.stdout:4/747: sync 2024-04-03T08:39:31.244 INFO:tasks.workunit.client.1.smithi181.stdout:3/713: dread - d0/d17/f26 zero size 2024-04-03T08:39:31.247 INFO:tasks.workunit.client.0.smithi157.stdout:3/781: dwrite d8/d1e/d2d/d39/d51/d7e/db1/f100 [0,4194304] 0 2024-04-03T08:39:31.248 INFO:tasks.workunit.client.1.smithi181.stdout:4/694: write d1/d16/d37/f7d [184802,55031] 0 2024-04-03T08:39:31.252 INFO:tasks.workunit.client.1.smithi181.stdout:7/611: fdatasync d0/d1/d6/de/d17/d27/f28 0 2024-04-03T08:39:31.253 INFO:tasks.workunit.client.1.smithi181.stdout:8/594: fdatasync d4/d45/db/d14/d31/d1c/d51/d87/db1/fb7 0 2024-04-03T08:39:31.260 INFO:tasks.workunit.client.1.smithi181.stdout:9/705: dread - d1/da/d13/d41/d32/fcd zero size 2024-04-03T08:39:31.269 INFO:tasks.workunit.client.0.smithi157.stdout:4/748: mkdir da/df/d99/d107 0 2024-04-03T08:39:31.274 INFO:tasks.workunit.client.1.smithi181.stdout:6/691: rename d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/l71 to d6/d3e/db1/dc4/ld7 0 2024-04-03T08:39:31.276 INFO:tasks.workunit.client.1.smithi181.stdout:4/695: dread d1/d1e/d82/d84/fe6 [0,4194304] 0 2024-04-03T08:39:31.276 INFO:tasks.workunit.client.0.smithi157.stdout:0/847: dread d2/d9/fe [0,4194304] 0 2024-04-03T08:39:31.280 INFO:tasks.workunit.client.1.smithi181.stdout:9/706: dwrite d1/da/d13/d22/fca [0,4194304] 0 2024-04-03T08:39:31.283 INFO:tasks.workunit.client.0.smithi157.stdout:5/860: dwrite dc/d29/d51/fc0 [0,4194304] 0 2024-04-03T08:39:31.285 INFO:tasks.workunit.client.1.smithi181.stdout:8/595: dread d4/fc [0,4194304] 0 2024-04-03T08:39:31.287 INFO:tasks.workunit.client.0.smithi157.stdout:4/749: fdatasync da/df/f104 0 2024-04-03T08:39:31.287 INFO:tasks.workunit.client.1.smithi181.stdout:8/596: write d4/fc [4530704,107017] 0 2024-04-03T08:39:31.292 INFO:tasks.workunit.client.1.smithi181.stdout:5/647: dwrite d4/d18/d2c/fc1 [4194304,4194304] 0 2024-04-03T08:39:31.293 INFO:tasks.workunit.client.0.smithi157.stdout:0/848: fdatasync d2/d9/d51/f61 0 2024-04-03T08:39:31.297 INFO:tasks.workunit.client.0.smithi157.stdout:5/861: mknod dc/d29/d56/d9e/dc3/de2/c11e 0 2024-04-03T08:39:31.304 INFO:tasks.workunit.client.1.smithi181.stdout:9/707: read d1/f6 [1909357,2933] 0 2024-04-03T08:39:31.305 INFO:tasks.workunit.client.1.smithi181.stdout:0/644: rename d5/d9/d2e/l96 to d5/d9/dc8/lce 0 2024-04-03T08:39:31.306 INFO:tasks.workunit.client.1.smithi181.stdout:9/708: stat d1/da/d13/d22/d23/d36/d91/d9d/f83 0 2024-04-03T08:39:31.308 INFO:tasks.workunit.client.1.smithi181.stdout:9/709: readlink d1/da/d28/d30/d3e/d4e/d62/l96 0 2024-04-03T08:39:31.309 INFO:tasks.workunit.client.1.smithi181.stdout:6/692: symlink d6/d3e/db1/ld8 0 2024-04-03T08:39:31.311 INFO:tasks.workunit.client.1.smithi181.stdout:6/693: chown d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/fc1 3788 1 2024-04-03T08:39:31.313 INFO:tasks.workunit.client.1.smithi181.stdout:6/694: write d6/d31/d36/dba/fae [1447416,39916] 0 2024-04-03T08:39:31.314 INFO:tasks.workunit.client.1.smithi181.stdout:4/696: creat d1/d16/d24/d5e/d2b/db9/fe7 x:0 0 0 2024-04-03T08:39:31.316 INFO:tasks.workunit.client.1.smithi181.stdout:2/759: creat d13/d1c/d4a/d7f/db3/dbf/dd8/f117 x:0 0 0 2024-04-03T08:39:31.317 INFO:tasks.workunit.client.0.smithi157.stdout:0/849: creat d2/d9/dc/df/d6f/de3/f12f x:0 0 0 2024-04-03T08:39:31.318 INFO:tasks.workunit.client.1.smithi181.stdout:2/760: write d13/da7/d27/f4b [4090632,12137] 0 2024-04-03T08:39:31.320 INFO:tasks.workunit.client.0.smithi157.stdout:5/862: rename dc/d29/d56/d18/d21/l86 to dc/d29/d56/d9e/dc3/de2/l11f 0 2024-04-03T08:39:31.325 INFO:tasks.workunit.client.0.smithi157.stdout:0/850: symlink d2/d9/dc/d54/l130 0 2024-04-03T08:39:31.329 INFO:tasks.workunit.client.0.smithi157.stdout:4/750: link da/df/d24/d35/d53/ff3 da/df/d24/d35/d53/f108 0 2024-04-03T08:39:31.331 INFO:tasks.workunit.client.0.smithi157.stdout:4/751: readlink da/df/l72 0 2024-04-03T08:39:31.332 INFO:tasks.workunit.client.1.smithi181.stdout:5/648: mkdir d4/d18/d55/d5a/dcd 0 2024-04-03T08:39:31.336 INFO:tasks.workunit.client.0.smithi157.stdout:3/782: truncate d8/d1e/d2d/d39/f5f 2932641 0 2024-04-03T08:39:31.338 INFO:tasks.workunit.client.1.smithi181.stdout:3/714: rename d0/d5/d6/d32/d43/f8a to d0/d17/d36/d1e/ff0 0 2024-04-03T08:39:31.340 INFO:tasks.workunit.client.1.smithi181.stdout:1/671: write d10/d15/d17/d23/db0/fcc [2147907,60969] 0 2024-04-03T08:39:31.340 INFO:tasks.workunit.client.0.smithi157.stdout:3/783: fdatasync d8/d1e/d2d/d39/d51/d48/dce/fcf 0 2024-04-03T08:39:31.342 INFO:tasks.workunit.client.1.smithi181.stdout:0/645: creat d5/dc/d10/d58/dba/fcf x:0 0 0 2024-04-03T08:39:31.346 INFO:tasks.workunit.client.0.smithi157.stdout:4/752: getdents da/df/d24/d35/d6a/d76 0 2024-04-03T08:39:31.346 INFO:tasks.workunit.client.1.smithi181.stdout:0/646: write d5/dc/d10/f8f [2621283,116765] 0 2024-04-03T08:39:31.348 INFO:tasks.workunit.client.1.smithi181.stdout:0/647: write d5/dc/d10/f8f [4579677,71834] 0 2024-04-03T08:39:31.356 INFO:tasks.workunit.client.1.smithi181.stdout:4/697: mknod d1/d1e/d78/ce8 0 2024-04-03T08:39:31.360 INFO:tasks.workunit.client.0.smithi157.stdout:0/851: dread d2/d9/d36/f80 [0,4194304] 0 2024-04-03T08:39:31.361 INFO:tasks.workunit.client.0.smithi157.stdout:5/863: dread dc/d29/d56/d52/d9d/da5/daa/fd0 [0,4194304] 0 2024-04-03T08:39:31.362 INFO:tasks.workunit.client.1.smithi181.stdout:7/612: write d0/d1/d6/de/d17/d27/f5d [1507094,60710] 0 2024-04-03T08:39:31.362 INFO:tasks.workunit.client.1.smithi181.stdout:8/597: unlink d4/d45/db/d5c/f72 0 2024-04-03T08:39:31.366 INFO:tasks.workunit.client.1.smithi181.stdout:8/598: readlink d4/d45/db/d14/lb4 0 2024-04-03T08:39:31.367 INFO:tasks.workunit.client.1.smithi181.stdout:1/672: rename d10/d15/d17/d19/d33/d70/l88 to d10/d15/d17/d23/d27/d91/ld3 0 2024-04-03T08:39:31.368 INFO:tasks.workunit.client.1.smithi181.stdout:9/710: dwrite d1/da/fab [0,4194304] 0 2024-04-03T08:39:31.370 INFO:tasks.workunit.client.1.smithi181.stdout:1/673: dread - d10/da1/fa7 zero size 2024-04-03T08:39:31.373 INFO:tasks.workunit.client.1.smithi181.stdout:3/715: dread d0/d5/d6f/f75 [0,4194304] 0 2024-04-03T08:39:31.374 INFO:tasks.workunit.client.1.smithi181.stdout:0/648: mknod d5/d9/d2a/cd0 0 2024-04-03T08:39:31.377 INFO:tasks.workunit.client.0.smithi157.stdout:3/784: truncate d8/d1e/d2d/f79 314014 0 2024-04-03T08:39:31.381 INFO:tasks.workunit.client.1.smithi181.stdout:5/649: symlink d4/d18/d55/dae/lce 0 2024-04-03T08:39:31.381 INFO:tasks.workunit.client.1.smithi181.stdout:6/695: mkdir d6/d31/d36/dba/da6/d4f/dd1/d9/dd9 0 2024-04-03T08:39:31.382 INFO:tasks.workunit.client.0.smithi157.stdout:3/785: dread - d8/d13/fb0 zero size 2024-04-03T08:39:31.384 INFO:tasks.workunit.client.1.smithi181.stdout:6/696: dread - d6/d31/d36/fcf zero size 2024-04-03T08:39:31.386 INFO:tasks.workunit.client.0.smithi157.stdout:0/852: link d2/d9/d51/d63/fd9 d2/d9/dc/df/d1b/d4a/de4/df1/df6/f131 0 2024-04-03T08:39:31.387 INFO:tasks.workunit.client.1.smithi181.stdout:7/613: rmdir d0/d1/d6/de/d17/d64/d85/d9a 39 2024-04-03T08:39:31.388 INFO:tasks.workunit.client.1.smithi181.stdout:7/614: stat d0/d1/d6/de/d17/d27/d93 0 2024-04-03T08:39:31.389 INFO:tasks.workunit.client.0.smithi157.stdout:0/853: write d2/d9/dc/dbe/dfb/f11f [248292,39383] 0 2024-04-03T08:39:31.389 INFO:tasks.workunit.client.0.smithi157.stdout:4/753: dwrite da/df/d6b/db9/fcf [0,4194304] 0 2024-04-03T08:39:31.395 INFO:tasks.workunit.client.0.smithi157.stdout:4/754: write da/df/d2f/d64/d8f/ffe [942352,124692] 0 2024-04-03T08:39:31.396 INFO:tasks.workunit.client.1.smithi181.stdout:1/674: creat d10/d15/d4a/d86/fd4 x:0 0 0 2024-04-03T08:39:31.402 INFO:tasks.workunit.client.1.smithi181.stdout:2/761: truncate d13/d1c/d4a/d68/fcc 1094046 0 2024-04-03T08:39:31.403 INFO:tasks.workunit.client.1.smithi181.stdout:8/599: dwrite d4/d45/f9b [0,4194304] 0 2024-04-03T08:39:31.404 INFO:tasks.workunit.client.1.smithi181.stdout:5/650: mkdir d4/d44/d71/dcf 0 2024-04-03T08:39:31.407 INFO:tasks.workunit.client.1.smithi181.stdout:3/716: symlink d0/d17/d63/d81/lf1 0 2024-04-03T08:39:31.410 INFO:tasks.workunit.client.0.smithi157.stdout:4/755: dread da/df/d99/fab [0,4194304] 0 2024-04-03T08:39:31.410 INFO:tasks.workunit.client.0.smithi157.stdout:3/786: write d8/d13/d1b/d5b/f90 [101560,92848] 0 2024-04-03T08:39:31.414 INFO:tasks.workunit.client.1.smithi181.stdout:4/698: rename d1/d16/d24/d5e/d31/d39/da1/cd8 to d1/d16/d24/d5e/d31/d39/d5d/d94/ce9 0 2024-04-03T08:39:31.415 INFO:tasks.workunit.client.0.smithi157.stdout:3/787: dread - d8/d13/fc3 zero size 2024-04-03T08:39:31.419 INFO:tasks.workunit.client.1.smithi181.stdout:9/711: dwrite d1/da/d13/d41/d32/fcd [0,4194304] 0 2024-04-03T08:39:31.419 INFO:tasks.workunit.client.1.smithi181.stdout:2/762: stat d13/d1c/d4a/d68/d72/l113 0 2024-04-03T08:39:31.421 INFO:tasks.workunit.client.0.smithi157.stdout:3/788: truncate d8/d1e/d2d/d39/d51/d48/dce/fcf 273974 0 2024-04-03T08:39:31.424 INFO:tasks.workunit.client.1.smithi181.stdout:0/649: dwrite d5/dc/d14/d29/f45 [0,4194304] 0 2024-04-03T08:39:31.425 INFO:tasks.workunit.client.0.smithi157.stdout:0/854: write d2/d9/dc/df/d6f/d9d/d6a/f76 [954817,88657] 0 2024-04-03T08:39:31.426 INFO:tasks.workunit.client.1.smithi181.stdout:2/763: write d13/d1c/fdf [1022280,2702] 0 2024-04-03T08:39:31.428 INFO:tasks.workunit.client.0.smithi157.stdout:4/756: getdents da/df/d24/d35/d53/d69 0 2024-04-03T08:39:31.431 INFO:tasks.workunit.client.1.smithi181.stdout:9/712: truncate d1/da/d1a/fd9 897376 0 2024-04-03T08:39:31.432 INFO:tasks.workunit.client.1.smithi181.stdout:4/699: mknod d1/d16/d24/d5e/d31/d39/da1/cea 0 2024-04-03T08:39:31.433 INFO:tasks.workunit.client.1.smithi181.stdout:6/697: dwrite d6/d7b/fd6 [0,4194304] 0 2024-04-03T08:39:31.434 INFO:tasks.workunit.client.1.smithi181.stdout:2/764: dread - d13/d1c/d4a/fdb zero size 2024-04-03T08:39:31.438 INFO:tasks.workunit.client.1.smithi181.stdout:1/675: creat d10/d15/d17/d19/fd5 x:0 0 0 2024-04-03T08:39:31.439 INFO:tasks.workunit.client.1.smithi181.stdout:1/676: dread - d10/d15/d17/d19/fd5 zero size 2024-04-03T08:39:31.442 INFO:tasks.workunit.client.0.smithi157.stdout:1/731: sync 2024-04-03T08:39:31.442 INFO:tasks.workunit.client.0.smithi157.stdout:6/792: sync 2024-04-03T08:39:31.442 INFO:tasks.workunit.client.1.smithi181.stdout:3/717: creat d0/d17/d36/d1e/db5/ff2 x:0 0 0 2024-04-03T08:39:31.444 INFO:tasks.workunit.client.0.smithi157.stdout:7/822: sync 2024-04-03T08:39:31.444 INFO:tasks.workunit.client.0.smithi157.stdout:9/803: sync 2024-04-03T08:39:31.444 INFO:tasks.workunit.client.0.smithi157.stdout:2/787: sync 2024-04-03T08:39:31.446 INFO:tasks.workunit.client.1.smithi181.stdout:7/615: dread d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:31.447 INFO:tasks.workunit.client.0.smithi157.stdout:9/804: read - d1/d94/f78 zero size 2024-04-03T08:39:31.449 INFO:tasks.workunit.client.0.smithi157.stdout:9/805: fdatasync d1/dab/dad/f101 0 2024-04-03T08:39:31.450 INFO:tasks.workunit.client.1.smithi181.stdout:2/765: symlink d13/da7/d85/de4/l118 0 2024-04-03T08:39:31.451 INFO:tasks.workunit.client.1.smithi181.stdout:8/600: link d4/d44/d59/d5f/l93 d4/d45/db/d14/lcd 0 2024-04-03T08:39:31.453 INFO:tasks.workunit.client.1.smithi181.stdout:1/677: symlink d10/d15/d17/d19/d33/d70/ld6 0 2024-04-03T08:39:31.454 INFO:tasks.workunit.client.1.smithi181.stdout:2/766: readlink d13/da7/d27/l4c 0 2024-04-03T08:39:31.455 INFO:tasks.workunit.client.1.smithi181.stdout:3/718: rmdir d0/d17/d36/d3b/d5a/d85 39 2024-04-03T08:39:31.461 INFO:tasks.workunit.client.0.smithi157.stdout:1/732: symlink d2/d11/lf3 0 2024-04-03T08:39:31.464 INFO:tasks.workunit.client.1.smithi181.stdout:1/678: truncate d10/d15/d17/d19/fd5 408789 0 2024-04-03T08:39:31.464 INFO:tasks.workunit.client.0.smithi157.stdout:9/806: unlink d1/f1b 0 2024-04-03T08:39:31.468 INFO:tasks.workunit.client.1.smithi181.stdout:9/713: dwrite d1/da/d1a/f27 [0,4194304] 0 2024-04-03T08:39:31.471 INFO:tasks.workunit.client.0.smithi157.stdout:9/807: readlink d1/d15/dca/ld1 0 2024-04-03T08:39:31.471 INFO:tasks.workunit.client.0.smithi157.stdout:6/793: mkdir d1/d5/d1b/d110 0 2024-04-03T08:39:31.472 INFO:tasks.workunit.client.1.smithi181.stdout:5/651: dwrite d4/fb7 [4194304,4194304] 0 2024-04-03T08:39:31.474 INFO:tasks.workunit.client.0.smithi157.stdout:7/823: unlink d0/d11/f71 0 2024-04-03T08:39:31.477 INFO:tasks.workunit.client.1.smithi181.stdout:7/616: symlink d0/le3 0 2024-04-03T08:39:31.481 INFO:tasks.workunit.client.0.smithi157.stdout:0/855: dread d2/d9/f57 [0,4194304] 0 2024-04-03T08:39:31.482 INFO:tasks.workunit.client.1.smithi181.stdout:2/767: mknod d13/da7/d85/de4/c119 0 2024-04-03T08:39:31.482 INFO:tasks.workunit.client.1.smithi181.stdout:4/700: rename d1/d16/d37/d34/d85/lcf to d1/d16/d24/d5e/d2b/leb 0 2024-04-03T08:39:31.484 INFO:tasks.workunit.client.0.smithi157.stdout:6/794: creat d1/d5/d1b/d97/f111 x:0 0 0 2024-04-03T08:39:31.484 INFO:tasks.workunit.client.1.smithi181.stdout:0/650: dwrite d5/dc/d14/d8d/fa4 [0,4194304] 0 2024-04-03T08:39:31.486 INFO:tasks.workunit.client.1.smithi181.stdout:1/679: fsync d10/d15/d17/d19/d33/d70/f81 0 2024-04-03T08:39:31.487 INFO:tasks.workunit.client.0.smithi157.stdout:7/824: chown d0/d11/d15/d17/d1c/d4f/d5f/fbb 0 1 2024-04-03T08:39:31.490 INFO:tasks.workunit.client.0.smithi157.stdout:2/788: dwrite d3/d2e/d32/d9f/fcc [0,4194304] 0 2024-04-03T08:39:31.491 INFO:tasks.workunit.client.1.smithi181.stdout:5/652: mkdir d4/d18/d25/d59/db3/dd0 0 2024-04-03T08:39:31.492 INFO:tasks.workunit.client.1.smithi181.stdout:6/698: dread d6/d31/d36/f5d [0,4194304] 0 2024-04-03T08:39:31.495 INFO:tasks.workunit.client.1.smithi181.stdout:8/601: dwrite d4/d45/d9/f38 [0,4194304] 0 2024-04-03T08:39:31.500 INFO:tasks.workunit.client.1.smithi181.stdout:9/714: fdatasync d1/da/d28/f9a 0 2024-04-03T08:39:31.500 INFO:tasks.workunit.client.1.smithi181.stdout:2/768: dread - d13/da7/fb2 zero size 2024-04-03T08:39:31.503 INFO:tasks.workunit.client.0.smithi157.stdout:9/808: truncate d1/d15/d27/d34/da6/fb6 1912998 0 2024-04-03T08:39:31.513 INFO:tasks.workunit.client.0.smithi157.stdout:1/733: dread d2/d11/d24/d39/d3b/d1b/d7f/fb1 [0,4194304] 0 2024-04-03T08:39:31.514 INFO:tasks.workunit.client.0.smithi157.stdout:2/789: rmdir d3/db/d44/d4c 39 2024-04-03T08:39:31.518 INFO:tasks.workunit.client.0.smithi157.stdout:2/790: truncate d3/d2e/d32/d9f/fea 846117 0 2024-04-03T08:39:31.520 INFO:tasks.workunit.client.0.smithi157.stdout:6/795: unlink d1/d5/d17/d29/ca1 0 2024-04-03T08:39:31.525 INFO:tasks.workunit.client.0.smithi157.stdout:6/796: write d1/d5/d17/d29/d62/d7f/d89/da4/fe1 [851979,73848] 0 2024-04-03T08:39:31.526 INFO:tasks.workunit.client.1.smithi181.stdout:3/719: creat d0/d17/d40/ff3 x:0 0 0 2024-04-03T08:39:31.527 INFO:tasks.workunit.client.1.smithi181.stdout:0/651: dread d5/d9/f9e [0,4194304] 0 2024-04-03T08:39:31.530 INFO:tasks.workunit.client.1.smithi181.stdout:4/701: rename d1/d16/d37/d34/d86/d9e/l5c to d1/d1e/d78/d98/lec 0 2024-04-03T08:39:31.530 INFO:tasks.workunit.client.0.smithi157.stdout:9/809: dread - d1/d15/d27/d5c/f76 zero size 2024-04-03T08:39:31.531 INFO:tasks.workunit.client.1.smithi181.stdout:2/769: dwrite d13/da7/d85/fa8 [0,4194304] 0 2024-04-03T08:39:31.534 INFO:tasks.workunit.client.1.smithi181.stdout:5/653: creat d4/d18/d25/d68/d77/fd1 x:0 0 0 2024-04-03T08:39:31.535 INFO:tasks.workunit.client.1.smithi181.stdout:8/602: mkdir d4/d45/dae/dce 0 2024-04-03T08:39:31.535 INFO:tasks.workunit.client.1.smithi181.stdout:4/702: fsync d1/d16/d24/d5e/d31/fa5 0 2024-04-03T08:39:31.537 INFO:tasks.workunit.client.0.smithi157.stdout:0/856: rename d2/d9/d5f/fa6 to d2/d9/d51/d63/f132 0 2024-04-03T08:39:31.537 INFO:tasks.workunit.client.0.smithi157.stdout:6/797: rename d1/d5 to d1/d5/d17/d29/da7/d112 22 2024-04-03T08:39:31.540 INFO:tasks.workunit.client.0.smithi157.stdout:7/825: write d0/d11/d15/d1b/db8/fac [832858,58500] 0 2024-04-03T08:39:31.540 INFO:tasks.workunit.client.0.smithi157.stdout:2/791: dread d3/d12/d43/f86 [0,4194304] 0 2024-04-03T08:39:31.542 INFO:tasks.workunit.client.1.smithi181.stdout:9/715: readlink d1/da/d13/d41/d32/l9b 0 2024-04-03T08:39:31.542 INFO:tasks.workunit.client.0.smithi157.stdout:9/810: dread - d1/d36/fb2 zero size 2024-04-03T08:39:31.547 INFO:tasks.workunit.client.0.smithi157.stdout:1/734: mkdir d2/d11/d24/d39/d3b/df4 0 2024-04-03T08:39:31.552 INFO:tasks.workunit.client.0.smithi157.stdout:7/826: unlink d0/d11/d6f/d89/d8c/d103/daf/lb3 0 2024-04-03T08:39:31.552 INFO:tasks.workunit.client.0.smithi157.stdout:6/798: mknod d1/d5/d17/d29/da7/db9/df0/c113 0 2024-04-03T08:39:31.556 INFO:tasks.workunit.client.0.smithi157.stdout:1/735: fsync d2/d11/d24/d67/f70 0 2024-04-03T08:39:31.561 INFO:tasks.workunit.client.0.smithi157.stdout:1/736: truncate d2/d11/d24/d39/d3b/fdf 303363 0 2024-04-03T08:39:31.562 INFO:tasks.workunit.client.0.smithi157.stdout:9/811: dwrite d1/fcd [0,4194304] 0 2024-04-03T08:39:31.567 INFO:tasks.workunit.client.0.smithi157.stdout:1/737: readlink d2/d11/d24/d39/d3b/d1b/d7f/ld9 0 2024-04-03T08:39:31.568 INFO:tasks.workunit.client.0.smithi157.stdout:0/857: link d2/d9/d36/d38/fd7 d2/d9/d5f/d85/f133 0 2024-04-03T08:39:31.568 INFO:tasks.workunit.client.0.smithi157.stdout:0/858: readlink d2/d9/dc/l24 0 2024-04-03T08:39:31.575 INFO:tasks.workunit.client.0.smithi157.stdout:6/799: dwrite d1/f6d [0,4194304] 0 2024-04-03T08:39:31.580 INFO:tasks.workunit.client.0.smithi157.stdout:9/812: mknod d1/d4a/d4d/da4/db8/c10f 0 2024-04-03T08:39:31.583 INFO:tasks.workunit.client.0.smithi157.stdout:9/813: write d1/d94/dbe/fe9 [491460,108465] 0 2024-04-03T08:39:31.588 INFO:tasks.workunit.client.0.smithi157.stdout:6/800: creat d1/d5/d17/d2a/d30/d95/dff/f114 x:0 0 0 2024-04-03T08:39:31.590 INFO:tasks.workunit.client.0.smithi157.stdout:2/792: write d3/db/d44/d4c/d5a/d88/dc6/fd2 [2316220,48024] 0 2024-04-03T08:39:31.606 INFO:tasks.workunit.client.0.smithi157.stdout:1/738: getdents d2/d11/d23/dc9/d5d 0 2024-04-03T08:39:31.606 INFO:tasks.workunit.client.0.smithi157.stdout:9/814: dwrite d1/d15/f107 [0,4194304] 0 2024-04-03T08:39:31.609 INFO:tasks.workunit.client.0.smithi157.stdout:7/827: dwrite d0/d11/d15/d17/d52/db6/dda/fdf [0,4194304] 0 2024-04-03T08:39:31.613 INFO:tasks.workunit.client.0.smithi157.stdout:7/828: read - d0/d11/d15/d17/d1c/f10b zero size 2024-04-03T08:39:31.613 INFO:tasks.workunit.client.1.smithi181.stdout:1/680: creat d10/d69/dd1/fd7 x:0 0 0 2024-04-03T08:39:31.614 INFO:tasks.workunit.client.0.smithi157.stdout:9/815: write d1/d15/d27/d5c/d79/f99 [3889353,11382] 0 2024-04-03T08:39:31.616 INFO:tasks.workunit.client.1.smithi181.stdout:7/617: rename d0/d1/d6/de/d17/d64/d85/laa to d0/d1/d6/de/da3/le4 0 2024-04-03T08:39:31.618 INFO:tasks.workunit.client.0.smithi157.stdout:0/859: link d2/d9/dc/df/d1b/d35/d3d/fa5 d2/d9/dc/f134 0 2024-04-03T08:39:31.618 INFO:tasks.workunit.client.0.smithi157.stdout:6/801: creat d1/d5/d17/d29/f115 x:0 0 0 2024-04-03T08:39:31.619 INFO:tasks.workunit.client.1.smithi181.stdout:0/652: chown d5/dc/d10/c54 832 1 2024-04-03T08:39:31.620 INFO:tasks.workunit.client.0.smithi157.stdout:9/816: write d1/d15/f31 [2140989,112804] 0 2024-04-03T08:39:31.621 INFO:tasks.workunit.client.1.smithi181.stdout:2/770: chown d13/da7/d85/dbd/fce 1 1 2024-04-03T08:39:31.622 INFO:tasks.workunit.client.0.smithi157.stdout:0/860: write d2/f103 [204374,75735] 0 2024-04-03T08:39:31.627 INFO:tasks.workunit.client.0.smithi157.stdout:0/861: chown d2/d9/d5f/cb9 5670 1 2024-04-03T08:39:31.629 INFO:tasks.workunit.client.1.smithi181.stdout:3/720: symlink d0/d5/lf4 0 2024-04-03T08:39:31.630 INFO:tasks.workunit.client.1.smithi181.stdout:1/681: creat d10/d69/fd8 x:0 0 0 2024-04-03T08:39:31.631 INFO:tasks.workunit.client.1.smithi181.stdout:6/699: creat d6/fda x:0 0 0 2024-04-03T08:39:31.633 INFO:tasks.workunit.client.1.smithi181.stdout:1/682: chown d10/d15/d17/d19/d33/f73 96710692 1 2024-04-03T08:39:31.634 INFO:tasks.workunit.client.1.smithi181.stdout:7/618: unlink d0/d1/d6/de/d17/d27/c95 0 2024-04-03T08:39:31.636 INFO:tasks.workunit.client.0.smithi157.stdout:8/815: sync 2024-04-03T08:39:31.637 INFO:tasks.workunit.client.1.smithi181.stdout:4/703: dread d1/d16/d24/d5e/d3f/d41/f87 [0,4194304] 0 2024-04-03T08:39:31.638 INFO:tasks.workunit.client.1.smithi181.stdout:2/771: symlink d13/d1c/d4a/d7f/db3/d81/l11a 0 2024-04-03T08:39:31.638 INFO:tasks.workunit.client.0.smithi157.stdout:6/802: symlink d1/d5/d17/d29/d62/l116 0 2024-04-03T08:39:31.640 INFO:tasks.workunit.client.0.smithi157.stdout:0/862: write d2/d9/dc/df/d1b/fb2 [8051460,93178] 0 2024-04-03T08:39:31.642 INFO:tasks.workunit.client.0.smithi157.stdout:1/739: dwrite d2/d11/d24/d39/d3b/d1b/d84/fe2 [0,4194304] 0 2024-04-03T08:39:31.646 INFO:tasks.workunit.client.0.smithi157.stdout:7/829: dread d0/d11/d15/d1b/db8/f3b [4194304,4194304] 0 2024-04-03T08:39:31.647 INFO:tasks.workunit.client.1.smithi181.stdout:7/619: dread d0/d1/d6/de/d17/f2c [0,4194304] 0 2024-04-03T08:39:31.648 INFO:tasks.workunit.client.0.smithi157.stdout:2/793: dread d3/d2e/f3b [0,4194304] 0 2024-04-03T08:39:31.653 INFO:tasks.workunit.client.1.smithi181.stdout:2/772: dwrite d13/d1c/d73/d8b/ff8 [0,4194304] 0 2024-04-03T08:39:31.656 INFO:tasks.workunit.client.0.smithi157.stdout:2/794: chown d3/d2e/d32/d9f/dbd/lc5 0 1 2024-04-03T08:39:31.674 INFO:tasks.workunit.client.0.smithi157.stdout:1/740: rename d2/d11/d23/dc9/d58/d94/da3/fda to d2/d11/d23/dc9/d58/d94/da3/ff5 0 2024-04-03T08:39:31.674 INFO:tasks.workunit.client.0.smithi157.stdout:9/817: dread d1/d15/d16/d9f/fd7 [0,4194304] 0 2024-04-03T08:39:31.676 INFO:tasks.workunit.client.0.smithi157.stdout:2/795: chown d3/c1e 41585170 1 2024-04-03T08:39:31.684 INFO:tasks.workunit.client.0.smithi157.stdout:8/816: rename d2/d11/d10/d24/d5b/d2e/d75/def to d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119 0 2024-04-03T08:39:31.686 INFO:tasks.workunit.client.0.smithi157.stdout:6/803: dread d1/d5/d17/d2a/d30/d95/f26 [0,4194304] 0 2024-04-03T08:39:31.687 INFO:tasks.workunit.client.1.smithi181.stdout:5/654: write d4/f13 [1146229,120274] 0 2024-04-03T08:39:31.689 INFO:tasks.workunit.client.1.smithi181.stdout:7/620: symlink d0/d1/d6/de/d17/d64/le5 0 2024-04-03T08:39:31.690 INFO:tasks.workunit.client.0.smithi157.stdout:5/864: sync 2024-04-03T08:39:31.692 INFO:tasks.workunit.client.0.smithi157.stdout:1/741: unlink d2/d11/lf3 0 2024-04-03T08:39:31.693 INFO:tasks.workunit.client.1.smithi181.stdout:2/773: symlink d13/d1c/d4a/d7f/db3/d81/l11b 0 2024-04-03T08:39:31.696 INFO:tasks.workunit.client.1.smithi181.stdout:0/653: write d5/d9/f7f [761074,31063] 0 2024-04-03T08:39:31.697 INFO:tasks.workunit.client.0.smithi157.stdout:9/818: dwrite d1/d15/d16/f67 [0,4194304] 0 2024-04-03T08:39:31.699 INFO:tasks.workunit.client.1.smithi181.stdout:0/654: chown d5/dc/d10/d58/dba/d90/l99 0 1 2024-04-03T08:39:31.700 INFO:tasks.workunit.client.1.smithi181.stdout:0/655: stat d5/dc/d14/d8d/fa4 0 2024-04-03T08:39:31.701 INFO:tasks.workunit.client.0.smithi157.stdout:2/796: unlink d3/d12/lb6 0 2024-04-03T08:39:31.702 INFO:tasks.workunit.client.1.smithi181.stdout:0/656: chown d5/dc/d14/d29/d46/l79 795877 1 2024-04-03T08:39:31.703 INFO:tasks.workunit.client.1.smithi181.stdout:8/603: truncate d4/d45/db/d14/fa6 3911459 0 2024-04-03T08:39:31.703 INFO:tasks.workunit.client.0.smithi157.stdout:7/830: link d0/d11/d6f/d89/d8c/dc6/d116/f11c d0/d11/d6f/d89/d8c/d103/d8e/d96/f11f 0 2024-04-03T08:39:31.707 INFO:tasks.workunit.client.1.smithi181.stdout:8/604: chown d4/d45/db/d14/lca 1313 1 2024-04-03T08:39:31.711 INFO:tasks.workunit.client.1.smithi181.stdout:9/716: getdents d1/da/d13/d22/d23/d36/d9c 0 2024-04-03T08:39:31.713 INFO:tasks.workunit.client.0.smithi157.stdout:9/819: rmdir d1/d15/d27/d34/da6 39 2024-04-03T08:39:31.713 INFO:tasks.workunit.client.1.smithi181.stdout:4/704: write d1/fb [1390188,15770] 0 2024-04-03T08:39:31.715 INFO:tasks.workunit.client.1.smithi181.stdout:7/621: truncate d0/d1/f78 141253 0 2024-04-03T08:39:31.718 INFO:tasks.workunit.client.0.smithi157.stdout:0/863: dwrite d2/d9/dc/d54/f75 [0,4194304] 0 2024-04-03T08:39:31.721 INFO:tasks.workunit.client.0.smithi157.stdout:2/797: creat d3/db/d44/d4c/d5a/d88/f112 x:0 0 0 2024-04-03T08:39:31.722 INFO:tasks.workunit.client.1.smithi181.stdout:7/622: chown d0/f3b 409068293 1 2024-04-03T08:39:31.723 INFO:tasks.workunit.client.1.smithi181.stdout:2/774: symlink d13/d1c/d4a/d7f/db3/dbf/l11c 0 2024-04-03T08:39:31.727 INFO:tasks.workunit.client.1.smithi181.stdout:6/700: dwrite d6/f13 [0,4194304] 0 2024-04-03T08:39:31.727 INFO:tasks.workunit.client.1.smithi181.stdout:3/721: dwrite d0/d5/d6/f39 [0,4194304] 0 2024-04-03T08:39:31.734 INFO:tasks.workunit.client.1.smithi181.stdout:9/717: write d1/da/d1a/fd9 [1609586,122147] 0 2024-04-03T08:39:31.735 INFO:tasks.workunit.client.0.smithi157.stdout:9/820: symlink d1/d15/d27/d34/dc7/l110 0 2024-04-03T08:39:31.742 INFO:tasks.workunit.client.1.smithi181.stdout:0/657: dwrite d5/dc/d10/d58/d6c/fb7 [0,4194304] 0 2024-04-03T08:39:31.742 INFO:tasks.workunit.client.1.smithi181.stdout:2/775: dread d13/da7/d27/f3a [0,4194304] 0 2024-04-03T08:39:31.744 INFO:tasks.workunit.client.1.smithi181.stdout:1/683: truncate d10/d15/d17/d19/fd5 161978 0 2024-04-03T08:39:31.748 INFO:tasks.workunit.client.0.smithi157.stdout:0/864: creat d2/d9/d36/d38/f135 x:0 0 0 2024-04-03T08:39:31.750 INFO:tasks.workunit.client.1.smithi181.stdout:8/605: truncate d4/d45/db/d5c/fa1 27022 0 2024-04-03T08:39:31.751 INFO:tasks.workunit.client.0.smithi157.stdout:7/831: symlink d0/d11/l120 0 2024-04-03T08:39:31.752 INFO:tasks.workunit.client.0.smithi157.stdout:5/865: dread dc/d29/f38 [0,4194304] 0 2024-04-03T08:39:31.755 INFO:tasks.workunit.client.0.smithi157.stdout:1/742: creat d2/d11/d24/d39/d3b/ff6 x:0 0 0 2024-04-03T08:39:31.755 INFO:tasks.workunit.client.0.smithi157.stdout:6/804: dread d1/d5/d17/d2a/d40/f7c [0,4194304] 0 2024-04-03T08:39:31.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/655: creat d4/d18/d2c/fd2 x:0 0 0 2024-04-03T08:39:31.759 INFO:tasks.workunit.client.0.smithi157.stdout:9/821: creat d1/d4a/d4d/da4/f111 x:0 0 0 2024-04-03T08:39:31.761 INFO:tasks.workunit.client.0.smithi157.stdout:2/798: write d3/d12/f7c [4145051,51747] 0 2024-04-03T08:39:31.763 INFO:tasks.workunit.client.0.smithi157.stdout:0/865: rmdir d2/dd8/dfd 39 2024-04-03T08:39:31.764 INFO:tasks.workunit.client.1.smithi181.stdout:6/701: dwrite d6/dc0/fc5 [0,4194304] 0 2024-04-03T08:39:31.764 INFO:tasks.workunit.client.1.smithi181.stdout:7/623: creat d0/d1/d6/de/d17/d64/d82/fe6 x:0 0 0 2024-04-03T08:39:31.768 INFO:tasks.workunit.client.0.smithi157.stdout:5/866: fsync dc/d29/d56/d18/d21/f61 0 2024-04-03T08:39:31.769 INFO:tasks.workunit.client.0.smithi157.stdout:8/817: dread d2/d11/d10/d24/d5b/d2e/d75/f76 [0,4194304] 0 2024-04-03T08:39:31.770 INFO:tasks.workunit.client.1.smithi181.stdout:3/722: dread d0/d5/f38 [0,4194304] 0 2024-04-03T08:39:31.770 INFO:tasks.workunit.client.1.smithi181.stdout:0/658: rename d5/dc/d75/daa/fca to d5/d9/d2c/dcc/fd1 0 2024-04-03T08:39:31.771 INFO:tasks.workunit.client.0.smithi157.stdout:3/789: sync 2024-04-03T08:39:31.771 INFO:tasks.workunit.client.0.smithi157.stdout:4/757: sync 2024-04-03T08:39:31.777 INFO:tasks.workunit.client.1.smithi181.stdout:3/723: truncate d0/d17/d63/d81/fc7 316825 0 2024-04-03T08:39:31.779 INFO:tasks.workunit.client.0.smithi157.stdout:1/743: creat d2/d11/d23/dc9/d58/d62/ff7 x:0 0 0 2024-04-03T08:39:31.780 INFO:tasks.workunit.client.1.smithi181.stdout:4/705: dwrite d1/f92 [0,4194304] 0 2024-04-03T08:39:31.781 INFO:tasks.workunit.client.1.smithi181.stdout:8/606: creat d4/d45/db/d5c/fcf x:0 0 0 2024-04-03T08:39:31.782 INFO:tasks.workunit.client.0.smithi157.stdout:8/818: readlink d2/d11/d10/d24/d5b/d2e/d75/l116 0 2024-04-03T08:39:31.792 INFO:tasks.workunit.client.0.smithi157.stdout:7/832: fdatasync d0/d11/d15/f87 0 2024-04-03T08:39:31.796 INFO:tasks.workunit.client.0.smithi157.stdout:0/866: write d2/f1d [4328747,94170] 0 2024-04-03T08:39:31.799 INFO:tasks.workunit.client.0.smithi157.stdout:7/833: chown d0/d11/d6f/d89/d8c/d103/d8e/d96 831080 1 2024-04-03T08:39:31.801 INFO:tasks.workunit.client.1.smithi181.stdout:9/718: symlink d1/da/d1a/ldc 0 2024-04-03T08:39:31.802 INFO:tasks.workunit.client.0.smithi157.stdout:6/805: dwrite d1/d5/f18 [0,4194304] 0 2024-04-03T08:39:31.811 INFO:tasks.workunit.client.1.smithi181.stdout:5/656: rename d4/d18/d55/db4/d90/f94 to d4/d18/d55/d5a/fd3 0 2024-04-03T08:39:31.812 INFO:tasks.workunit.client.1.smithi181.stdout:6/702: write d6/d31/d36/f87 [363252,74245] 0 2024-04-03T08:39:31.812 INFO:tasks.workunit.client.1.smithi181.stdout:2/776: getdents d13/da7/d40/d10f 0 2024-04-03T08:39:31.816 INFO:tasks.workunit.client.1.smithi181.stdout:7/624: dwrite d0/d1/f74 [4194304,4194304] 0 2024-04-03T08:39:31.818 INFO:tasks.workunit.client.1.smithi181.stdout:3/724: mknod d0/d5/d6/d32/d43/d6b/cf5 0 2024-04-03T08:39:31.818 INFO:tasks.workunit.client.1.smithi181.stdout:8/607: dread d4/f46 [0,4194304] 0 2024-04-03T08:39:31.820 INFO:tasks.workunit.client.1.smithi181.stdout:3/725: stat d0/d5/d6/c19 0 2024-04-03T08:39:31.823 INFO:tasks.workunit.client.1.smithi181.stdout:3/726: chown d0/d5/f38 18996114 1 2024-04-03T08:39:31.824 INFO:tasks.workunit.client.1.smithi181.stdout:4/706: write d1/f6d [1399436,31276] 0 2024-04-03T08:39:31.829 INFO:tasks.workunit.client.1.smithi181.stdout:6/703: mknod d6/d31/d36/d73/cdb 0 2024-04-03T08:39:31.831 INFO:tasks.workunit.client.1.smithi181.stdout:2/777: dread - d13/d1c/d6c/d7a/ffe zero size 2024-04-03T08:39:31.831 INFO:tasks.workunit.client.1.smithi181.stdout:6/704: chown d6/d31/d36/dba/da6/d4f/dd1/l2c 0 1 2024-04-03T08:39:31.833 INFO:tasks.workunit.client.1.smithi181.stdout:7/625: dread - d0/d1/d6/de/d17/d64/d85/d9a/fcd zero size 2024-04-03T08:39:31.834 INFO:tasks.workunit.client.1.smithi181.stdout:8/608: mkdir d4/d45/db/d14/dd0 0 2024-04-03T08:39:31.835 INFO:tasks.workunit.client.1.smithi181.stdout:8/609: fsync d4/d45/db/d5c/fcf 0 2024-04-03T08:39:31.838 INFO:tasks.workunit.client.1.smithi181.stdout:1/684: getdents d10/d15/d4a/d86 0 2024-04-03T08:39:31.842 INFO:tasks.workunit.client.1.smithi181.stdout:5/657: rename d4/d22/lb5 to d4/d44/ld4 0 2024-04-03T08:39:31.843 INFO:tasks.workunit.client.1.smithi181.stdout:4/707: mkdir d1/d16/d37/d34/d86/ded 0 2024-04-03T08:39:31.847 INFO:tasks.workunit.client.1.smithi181.stdout:6/705: creat d6/dc0/fdc x:0 0 0 2024-04-03T08:39:31.855 INFO:tasks.workunit.client.0.smithi157.stdout:5/867: creat dc/d29/d56/d52/f120 x:0 0 0 2024-04-03T08:39:31.855 INFO:tasks.workunit.client.1.smithi181.stdout:9/719: link d1/da/d28/d30/d3e/fd5 d1/da/d13/d41/fdd 0 2024-04-03T08:39:31.855 INFO:tasks.workunit.client.1.smithi181.stdout:0/659: getdents d5/dc 0 2024-04-03T08:39:31.856 INFO:tasks.workunit.client.1.smithi181.stdout:2/778: write d13/d7b/f7e [3913773,124716] 0 2024-04-03T08:39:31.857 INFO:tasks.workunit.client.0.smithi157.stdout:4/758: fdatasync da/df/d11/d5d/fb2 0 2024-04-03T08:39:31.858 INFO:tasks.workunit.client.1.smithi181.stdout:4/708: dwrite d1/d1e/d2c/f77 [4194304,4194304] 0 2024-04-03T08:39:31.861 INFO:tasks.workunit.client.0.smithi157.stdout:3/790: rmdir d8/d1e/d2d/d39/d51/d4c/d32 39 2024-04-03T08:39:31.861 INFO:tasks.workunit.client.1.smithi181.stdout:7/626: write d0/d1/f7e [790390,92635] 0 2024-04-03T08:39:31.861 INFO:tasks.workunit.client.0.smithi157.stdout:4/759: chown da/df/d24/f59 557809 1 2024-04-03T08:39:31.863 INFO:tasks.workunit.client.1.smithi181.stdout:5/658: truncate d4/d22/d4a/f5d 334878 0 2024-04-03T08:39:31.868 INFO:tasks.workunit.client.1.smithi181.stdout:6/706: dread - d6/d31/d36/dba/da6/d4f/dd1/d50/d64/f84 zero size 2024-04-03T08:39:31.869 INFO:tasks.workunit.client.0.smithi157.stdout:8/819: creat d2/d6f/db5/f11a x:0 0 0 2024-04-03T08:39:31.869 INFO:tasks.workunit.client.1.smithi181.stdout:9/720: mknod d1/da/d28/d30/d3e/d77/cde 0 2024-04-03T08:39:31.872 INFO:tasks.workunit.client.1.smithi181.stdout:7/627: dread d0/d1/d6/de/f42 [0,4194304] 0 2024-04-03T08:39:31.873 INFO:tasks.workunit.client.1.smithi181.stdout:8/610: getdents d4/d45/db/d14/d31/d1c/d51/d87/dc8 0 2024-04-03T08:39:31.873 INFO:tasks.workunit.client.0.smithi157.stdout:0/867: symlink d2/l136 0 2024-04-03T08:39:31.875 INFO:tasks.workunit.client.1.smithi181.stdout:6/707: chown d6/d31/d36/dba/da6/d4f/lad 3 1 2024-04-03T08:39:31.876 INFO:tasks.workunit.client.0.smithi157.stdout:3/791: dread d8/d13/d1b/d4e/da6/f95 [0,4194304] 0 2024-04-03T08:39:31.877 INFO:tasks.workunit.client.1.smithi181.stdout:0/660: dwrite d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:31.879 INFO:tasks.workunit.client.0.smithi157.stdout:6/806: rename d1/d5/d17/d2a/d30/d95/dff/f114 to d1/d5/d17/d2a/d37/dca/f117 0 2024-04-03T08:39:31.881 INFO:tasks.workunit.client.1.smithi181.stdout:2/779: creat d13/da7/d85/de4/f11d x:0 0 0 2024-04-03T08:39:31.881 INFO:tasks.workunit.client.0.smithi157.stdout:5/868: symlink dc/d29/d56/d9e/l121 0 2024-04-03T08:39:31.882 INFO:tasks.workunit.client.1.smithi181.stdout:1/685: mkdir d10/d15/d17/d19/dd9 0 2024-04-03T08:39:31.885 INFO:tasks.workunit.client.0.smithi157.stdout:9/822: creat d1/d15/d27/f112 x:0 0 0 2024-04-03T08:39:31.886 INFO:tasks.workunit.client.0.smithi157.stdout:8/820: dwrite d2/f39 [0,4194304] 0 2024-04-03T08:39:31.889 INFO:tasks.workunit.client.0.smithi157.stdout:9/823: stat d1/d15/d27/d5c 0 2024-04-03T08:39:31.890 INFO:tasks.workunit.client.0.smithi157.stdout:9/824: readlink d1/l7 0 2024-04-03T08:39:31.891 INFO:tasks.workunit.client.0.smithi157.stdout:1/744: mknod d2/d11/d23/dc9/d5d/db4/dbc/def/cf8 0 2024-04-03T08:39:31.893 INFO:tasks.workunit.client.0.smithi157.stdout:4/760: fsync da/df/d11/f1f 0 2024-04-03T08:39:31.893 INFO:tasks.workunit.client.0.smithi157.stdout:9/825: write d1/d94/f96 [2820059,123922] 0 2024-04-03T08:39:31.897 INFO:tasks.workunit.client.1.smithi181.stdout:3/727: dwrite d0/d17/d36/d3b/d5a/d85/f9f [0,4194304] 0 2024-04-03T08:39:31.899 INFO:tasks.workunit.client.1.smithi181.stdout:7/628: dread d0/d1/f4a [0,4194304] 0 2024-04-03T08:39:31.900 INFO:tasks.workunit.client.0.smithi157.stdout:9/826: chown d1/d15/d27/d5c/d79/f7c 181 1 2024-04-03T08:39:31.900 INFO:tasks.workunit.client.1.smithi181.stdout:3/728: chown d0/d5/d77 1470762073 1 2024-04-03T08:39:31.901 INFO:tasks.workunit.client.1.smithi181.stdout:8/611: dwrite d4/d44/d59/fcb [0,4194304] 0 2024-04-03T08:39:31.902 INFO:tasks.workunit.client.1.smithi181.stdout:6/708: write d6/d31/d36/dba/da6/f88 [2818829,97937] 0 2024-04-03T08:39:31.905 INFO:tasks.workunit.client.1.smithi181.stdout:8/612: dread - d4/d45/db/d5c/fc7 zero size 2024-04-03T08:39:31.906 INFO:tasks.workunit.client.1.smithi181.stdout:0/661: creat d5/dc/d10/fd2 x:0 0 0 2024-04-03T08:39:31.908 INFO:tasks.workunit.client.0.smithi157.stdout:0/868: symlink d2/d9/dc/df/d1b/d35/dc0/l137 0 2024-04-03T08:39:31.913 INFO:tasks.workunit.client.0.smithi157.stdout:0/869: write d2/d9/dc/df/d1b/d35/d3d/f58 [466532,24880] 0 2024-04-03T08:39:31.913 INFO:tasks.workunit.client.0.smithi157.stdout:3/792: symlink d8/d1e/d2d/d39/d51/d4c/dd6/de0/l113 0 2024-04-03T08:39:31.918 INFO:tasks.workunit.client.0.smithi157.stdout:1/745: dwrite d2/d11/d23/d73/fc2 [0,4194304] 0 2024-04-03T08:39:31.921 INFO:tasks.workunit.client.0.smithi157.stdout:5/869: creat dc/d35/f122 x:0 0 0 2024-04-03T08:39:31.921 INFO:tasks.workunit.client.0.smithi157.stdout:5/870: chown c5 516848387 1 2024-04-03T08:39:31.921 INFO:tasks.workunit.client.1.smithi181.stdout:4/709: dwrite d1/d16/d24/d5e/d3f/d41/f87 [0,4194304] 0 2024-04-03T08:39:31.926 INFO:tasks.workunit.client.1.smithi181.stdout:5/659: creat d4/d22/d4a/dad/db6/fd5 x:0 0 0 2024-04-03T08:39:31.927 INFO:tasks.workunit.client.0.smithi157.stdout:6/807: truncate d1/d5/d17/d29/da7/db9/fd3 240503 0 2024-04-03T08:39:31.930 INFO:tasks.workunit.client.1.smithi181.stdout:5/660: chown d4/d22/d4a/f5b 7 1 2024-04-03T08:39:31.934 INFO:tasks.workunit.client.1.smithi181.stdout:9/721: fsync d1/da/d28/d80/f97 0 2024-04-03T08:39:31.934 INFO:tasks.workunit.client.1.smithi181.stdout:5/661: chown d4/d18/d55/db4/f9f 10104 1 2024-04-03T08:39:31.935 INFO:tasks.workunit.client.1.smithi181.stdout:7/629: unlink d0/d1/d6/de/d17/f31 0 2024-04-03T08:39:31.936 INFO:tasks.workunit.client.0.smithi157.stdout:2/799: getdents d3/db/d44/d4c/d5a/d88/dc6 0 2024-04-03T08:39:31.938 INFO:tasks.workunit.client.1.smithi181.stdout:6/709: mknod d6/d3e/cdd 0 2024-04-03T08:39:31.939 INFO:tasks.workunit.client.1.smithi181.stdout:9/722: dread - d1/da/d13/d22/d23/fcf zero size 2024-04-03T08:39:31.939 INFO:tasks.workunit.client.1.smithi181.stdout:5/662: chown d4/d18/d25/d68/f88 22617 1 2024-04-03T08:39:31.940 INFO:tasks.workunit.client.1.smithi181.stdout:8/613: dread - d4/d45/d9/f89 zero size 2024-04-03T08:39:31.945 INFO:tasks.workunit.client.1.smithi181.stdout:8/614: write d4/d44/d59/f78 [1248780,35602] 0 2024-04-03T08:39:31.945 INFO:tasks.workunit.client.1.smithi181.stdout:2/780: getdents d13/da7/d40/d109 0 2024-04-03T08:39:31.948 INFO:tasks.workunit.client.0.smithi157.stdout:9/827: rename d1/d15/d27/daf/da7/fd3 to d1/d94/d75/f113 0 2024-04-03T08:39:31.950 INFO:tasks.workunit.client.1.smithi181.stdout:4/710: creat d1/d1e/d78/fee x:0 0 0 2024-04-03T08:39:31.953 INFO:tasks.workunit.client.0.smithi157.stdout:3/793: creat d8/d13/d1b/d4e/da6/f114 x:0 0 0 2024-04-03T08:39:31.954 INFO:tasks.workunit.client.1.smithi181.stdout:4/711: stat d1/d16/d24/d5e/d31/d39/da1/fc0 0 2024-04-03T08:39:31.956 INFO:tasks.workunit.client.1.smithi181.stdout:1/686: dwrite d10/d15/d17/d30/f55 [0,4194304] 0 2024-04-03T08:39:31.964 INFO:tasks.workunit.client.0.smithi157.stdout:7/834: getdents d0/d11/d15/d17/d43/d8a 0 2024-04-03T08:39:31.964 INFO:tasks.workunit.client.1.smithi181.stdout:5/663: creat d4/d18/d25/fd6 x:0 0 0 2024-04-03T08:39:31.966 INFO:tasks.workunit.client.1.smithi181.stdout:8/615: mkdir d4/d44/d59/d5f/d6c/dd1 0 2024-04-03T08:39:31.966 INFO:tasks.workunit.client.0.smithi157.stdout:6/808: rename d1/d5/d1b/l6c to d1/d5/d17/d2a/d30/d77/l118 0 2024-04-03T08:39:31.968 INFO:tasks.workunit.client.1.smithi181.stdout:8/616: chown d4/d45/db/f58 1 1 2024-04-03T08:39:31.969 INFO:tasks.workunit.client.1.smithi181.stdout:0/662: dwrite d5/dc/f71 [0,4194304] 0 2024-04-03T08:39:31.969 INFO:tasks.workunit.client.0.smithi157.stdout:9/828: creat d1/d4a/d4d/d86/f114 x:0 0 0 2024-04-03T08:39:31.971 INFO:tasks.workunit.client.1.smithi181.stdout:3/729: creat d0/ff6 x:0 0 0 2024-04-03T08:39:31.972 INFO:tasks.workunit.client.0.smithi157.stdout:0/870: symlink d2/d9/dc/df/l138 0 2024-04-03T08:39:31.973 INFO:tasks.workunit.client.1.smithi181.stdout:4/712: stat d1/d1e/d2c/f73 0 2024-04-03T08:39:31.976 INFO:tasks.workunit.client.1.smithi181.stdout:8/617: dread - d4/d44/f82 zero size 2024-04-03T08:39:31.978 INFO:tasks.workunit.client.0.smithi157.stdout:3/794: creat d8/d1e/d2d/d39/d51/d4c/dd6/de0/f115 x:0 0 0 2024-04-03T08:39:31.980 INFO:tasks.workunit.client.0.smithi157.stdout:4/761: truncate da/df/f57 472471 0 2024-04-03T08:39:31.982 INFO:tasks.workunit.client.1.smithi181.stdout:2/781: write d13/d1c/d4a/d68/dba/fd3 [1365701,84575] 0 2024-04-03T08:39:31.983 INFO:tasks.workunit.client.0.smithi157.stdout:5/871: creat dc/d29/d56/d9e/dc3/dde/de4/f123 x:0 0 0 2024-04-03T08:39:31.985 INFO:tasks.workunit.client.1.smithi181.stdout:8/618: write d4/d45/db/d14/f62 [2344937,52667] 0 2024-04-03T08:39:31.986 INFO:tasks.workunit.client.1.smithi181.stdout:3/730: dread d0/d5/d6/dd/fa9 [0,4194304] 0 2024-04-03T08:39:31.990 INFO:tasks.workunit.client.0.smithi157.stdout:7/835: rmdir d0/d11/d6f/d76 39 2024-04-03T08:39:31.991 INFO:tasks.workunit.client.1.smithi181.stdout:3/731: write d0/d17/d56/fbe [5138060,126899] 0 2024-04-03T08:39:31.994 INFO:tasks.workunit.client.1.smithi181.stdout:9/723: dwrite d1/da/d28/d30/d3e/fd5 [0,4194304] 0 2024-04-03T08:39:31.994 INFO:tasks.workunit.client.1.smithi181.stdout:5/664: dwrite d4/d18/d25/db0/fbb [0,4194304] 0 2024-04-03T08:39:31.995 INFO:tasks.workunit.client.0.smithi157.stdout:7/836: stat d0/d11/d15/d17/d43/d8a 0 2024-04-03T08:39:31.995 INFO:tasks.workunit.client.0.smithi157.stdout:9/829: dwrite d1/d15/d27/d5c/d79/f9d [4194304,4194304] 0 2024-04-03T08:39:31.999 INFO:tasks.workunit.client.0.smithi157.stdout:1/746: write d2/d11/d24/d39/d3b/d1b/fcd [569869,105234] 0 2024-04-03T08:39:31.999 INFO:tasks.workunit.client.0.smithi157.stdout:3/795: dwrite f4 [0,4194304] 0 2024-04-03T08:39:32.007 INFO:tasks.workunit.client.0.smithi157.stdout:2/800: write d3/d12/d43/d4b/d55/f59 [4154091,64366] 0 2024-04-03T08:39:32.010 INFO:tasks.workunit.client.1.smithi181.stdout:7/630: truncate d0/d1/f4a 600835 0 2024-04-03T08:39:32.010 INFO:tasks.workunit.client.1.smithi181.stdout:4/713: creat d1/d1e/d2c/d67/d93/fef x:0 0 0 2024-04-03T08:39:32.012 INFO:tasks.workunit.client.0.smithi157.stdout:8/821: getdents d2/d20/db1 0 2024-04-03T08:39:32.013 INFO:tasks.workunit.client.1.smithi181.stdout:2/782: rmdir d13/d7b 39 2024-04-03T08:39:32.018 INFO:tasks.workunit.client.0.smithi157.stdout:5/872: unlink dc/d29/d56/d9e/l121 0 2024-04-03T08:39:32.020 INFO:tasks.workunit.client.1.smithi181.stdout:7/631: write d0/d1/d6/de/d17/d64/d85/d9a/da4/fc2 [936584,71393] 0 2024-04-03T08:39:32.023 INFO:tasks.workunit.client.1.smithi181.stdout:0/663: dwrite d5/dc/d75/f9d [0,4194304] 0 2024-04-03T08:39:32.024 INFO:tasks.workunit.client.0.smithi157.stdout:6/809: mknod d1/d4b/da5/dd9/df9/c119 0 2024-04-03T08:39:32.025 INFO:tasks.workunit.client.1.smithi181.stdout:2/783: read d13/d1c/f38 [791419,85107] 0 2024-04-03T08:39:32.027 INFO:tasks.workunit.client.0.smithi157.stdout:9/830: creat d1/dab/dad/d100/f115 x:0 0 0 2024-04-03T08:39:32.031 INFO:tasks.workunit.client.0.smithi157.stdout:3/796: readlink d8/le4 0 2024-04-03T08:39:32.033 INFO:tasks.workunit.client.1.smithi181.stdout:6/710: getdents d6/d3e/d5e 0 2024-04-03T08:39:32.033 INFO:tasks.workunit.client.1.smithi181.stdout:3/732: chown d0/d17/d36/d3b/d5a/c71 5 1 2024-04-03T08:39:32.036 INFO:tasks.workunit.client.1.smithi181.stdout:1/687: link d10/d15/d17/d19/d33/d70/fc8 d10/d15/d17/d19/d4c/fda 0 2024-04-03T08:39:32.037 INFO:tasks.workunit.client.0.smithi157.stdout:2/801: creat d3/d2e/d65/f113 x:0 0 0 2024-04-03T08:39:32.040 INFO:tasks.workunit.client.1.smithi181.stdout:5/665: read d4/d18/d2c/f34 [310530,128398] 0 2024-04-03T08:39:32.042 INFO:tasks.workunit.client.0.smithi157.stdout:3/797: read d8/d1e/d2d/d3b/f6e [141192,110921] 0 2024-04-03T08:39:32.055 INFO:tasks.workunit.client.0.smithi157.stdout:4/762: dread da/f6f [0,4194304] 0 2024-04-03T08:39:32.055 INFO:tasks.workunit.client.0.smithi157.stdout:6/810: symlink d1/d5/d17/d2a/d37/l11a 0 2024-04-03T08:39:32.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:31 smithi157 ceph-mon[35083]: pgmap v12: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 89 MiB/s rd, 233 MiB/s wr, 501 op/s 2024-04-03T08:39:32.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:31 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:32.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:31 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:32.065 INFO:tasks.workunit.client.0.smithi157.stdout:9/831: dread d1/d15/d27/f39 [0,4194304] 0 2024-04-03T08:39:32.066 INFO:tasks.workunit.client.0.smithi157.stdout:1/747: dwrite d2/d11/d23/dc9/d86/fca [0,4194304] 0 2024-04-03T08:39:32.068 INFO:tasks.workunit.client.1.smithi181.stdout:2/784: dread d13/d1c/d4a/d68/f94 [0,4194304] 0 2024-04-03T08:39:32.069 INFO:tasks.workunit.client.0.smithi157.stdout:2/802: fdatasync d3/d2e/d32/fb7 0 2024-04-03T08:39:32.075 INFO:tasks.workunit.client.0.smithi157.stdout:1/748: write d2/d11/d24/d39/f54 [4274024,83324] 0 2024-04-03T08:39:32.077 INFO:tasks.workunit.client.1.smithi181.stdout:9/724: rename d1/da/d28/d30/c76 to d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/cdf 0 2024-04-03T08:39:32.079 INFO:tasks.workunit.client.0.smithi157.stdout:7/837: write d0/d11/d6f/d89/d8c/d103/f2d [3160197,29634] 0 2024-04-03T08:39:32.080 INFO:tasks.workunit.client.0.smithi157.stdout:3/798: unlink d8/d13/d1b/d4e/d50/d7c/dd8/d10d/f111 0 2024-04-03T08:39:32.082 INFO:tasks.workunit.client.1.smithi181.stdout:3/733: creat d0/d17/d36/d3b/ff7 x:0 0 0 2024-04-03T08:39:32.083 INFO:tasks.workunit.client.0.smithi157.stdout:7/838: write d0/d11/d15/d17/d1c/d4f/d5f/fe4 [932973,88122] 0 2024-04-03T08:39:32.084 INFO:tasks.workunit.client.1.smithi181.stdout:3/734: fsync d0/d17/d36/d3b/d5a/d85/f9f 0 2024-04-03T08:39:32.086 INFO:tasks.workunit.client.1.smithi181.stdout:3/735: dread - d0/d17/d36/d1e/fda zero size 2024-04-03T08:39:32.088 INFO:tasks.workunit.client.1.smithi181.stdout:4/714: mkdir d1/d16/d24/d5e/d31/d39/df0 0 2024-04-03T08:39:32.089 INFO:tasks.workunit.client.0.smithi157.stdout:5/873: write dc/d29/d56/d49/d53/f5a [4152848,84662] 0 2024-04-03T08:39:32.091 INFO:tasks.workunit.client.0.smithi157.stdout:0/871: link d2/d9/dc/df/d1b/d35/dc0/ffa d2/d9/dc/df/f139 0 2024-04-03T08:39:32.093 INFO:tasks.workunit.client.1.smithi181.stdout:1/688: mknod d10/d15/d17/d19/d33/d70/cdb 0 2024-04-03T08:39:32.097 INFO:tasks.workunit.client.0.smithi157.stdout:4/763: creat da/df/d99/ddb/f109 x:0 0 0 2024-04-03T08:39:32.099 INFO:tasks.workunit.client.1.smithi181.stdout:7/632: creat d0/d1/d94/fe7 x:0 0 0 2024-04-03T08:39:32.101 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:31 smithi181 ceph-mon[44183]: pgmap v12: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 89 MiB/s rd, 233 MiB/s wr, 501 op/s 2024-04-03T08:39:32.101 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:31 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:32.101 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:31 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:32.102 INFO:tasks.workunit.client.1.smithi181.stdout:0/664: link d5/d9/d2a/da1/fc6 d5/d9/d2a/da1/fd3 0 2024-04-03T08:39:32.102 INFO:tasks.workunit.client.1.smithi181.stdout:7/633: rename d0/d1/d6 to d0/d1/d6/de/d17/d64/d85/dd8/de8 22 2024-04-03T08:39:32.105 INFO:tasks.workunit.client.0.smithi157.stdout:2/803: fsync d3/db/d44/d4c/d5a/d88/dc6/f109 0 2024-04-03T08:39:32.107 INFO:tasks.workunit.client.1.smithi181.stdout:2/785: mknod d13/d1c/d4a/d68/c11e 0 2024-04-03T08:39:32.107 INFO:tasks.workunit.client.0.smithi157.stdout:2/804: stat d3/db/d44/lc8 0 2024-04-03T08:39:32.108 INFO:tasks.workunit.client.1.smithi181.stdout:6/711: truncate d6/d31/d36/f34 838390 0 2024-04-03T08:39:32.109 INFO:tasks.workunit.client.1.smithi181.stdout:2/786: write d13/d1c/d4a/d68/ffc [609159,126704] 0 2024-04-03T08:39:32.111 INFO:tasks.workunit.client.1.smithi181.stdout:2/787: write d13/da7/d27/d2f/f5c [3061698,105727] 0 2024-04-03T08:39:32.112 INFO:tasks.workunit.client.0.smithi157.stdout:1/749: creat d2/d11/d24/d39/d3b/d1b/d90/ff9 x:0 0 0 2024-04-03T08:39:32.116 INFO:tasks.workunit.client.1.smithi181.stdout:4/715: unlink d1/f32 0 2024-04-03T08:39:32.124 INFO:tasks.workunit.client.0.smithi157.stdout:7/839: symlink d0/d11/d6f/d89/d8c/d103/d8e/d96/l121 0 2024-04-03T08:39:32.126 INFO:tasks.workunit.client.0.smithi157.stdout:0/872: mknod d2/d9/dc/df/d6f/d9d/d6a/d91/c13a 0 2024-04-03T08:39:32.127 INFO:tasks.workunit.client.1.smithi181.stdout:2/788: rmdir d13/d1c/d4a/d7f/db3/dbf 39 2024-04-03T08:39:32.129 INFO:tasks.workunit.client.0.smithi157.stdout:1/750: truncate d2/d11/d24/d39/d3b/d1b/d7f/faa 2129473 0 2024-04-03T08:39:32.130 INFO:tasks.workunit.client.1.smithi181.stdout:2/789: chown d13/d1c/d4a/d7f/db3/f88 26 1 2024-04-03T08:39:32.130 INFO:tasks.workunit.client.0.smithi157.stdout:2/805: dwrite d3/f4e [0,4194304] 0 2024-04-03T08:39:32.135 INFO:tasks.workunit.client.0.smithi157.stdout:9/832: rename d1/d36/d46/ld9 to d1/d15/d27/l116 0 2024-04-03T08:39:32.136 INFO:tasks.workunit.client.0.smithi157.stdout:9/833: chown d1/d94/dbe/dbf 39750039 1 2024-04-03T08:39:32.139 INFO:tasks.workunit.client.1.smithi181.stdout:5/666: link d4/d22/d78/lc4 d4/d22/d53/ld7 0 2024-04-03T08:39:32.143 INFO:tasks.workunit.client.1.smithi181.stdout:5/667: read d4/d18/d55/db4/fa0 [1642528,115236] 0 2024-04-03T08:39:32.145 INFO:tasks.workunit.client.0.smithi157.stdout:0/873: creat d2/d9/d51/d63/d109/f13b x:0 0 0 2024-04-03T08:39:32.147 INFO:tasks.workunit.client.1.smithi181.stdout:2/790: dwrite d13/d1c/f9d [4194304,4194304] 0 2024-04-03T08:39:32.147 INFO:tasks.workunit.client.1.smithi181.stdout:1/689: write d10/d15/d41/f44 [407075,44865] 0 2024-04-03T08:39:32.150 INFO:tasks.workunit.client.0.smithi157.stdout:0/874: fdatasync d2/d9/d36/d38/f135 0 2024-04-03T08:39:32.151 INFO:tasks.workunit.client.1.smithi181.stdout:0/665: write d5/dc/d10/f80 [630102,63566] 0 2024-04-03T08:39:32.153 INFO:tasks.workunit.client.0.smithi157.stdout:4/764: write da/d26/f3d [5307644,45579] 0 2024-04-03T08:39:32.154 INFO:tasks.workunit.client.0.smithi157.stdout:6/811: dwrite d1/fb [0,4194304] 0 2024-04-03T08:39:32.158 INFO:tasks.workunit.client.1.smithi181.stdout:6/712: write d6/d31/d36/dba/da6/d4f/dd1/f38 [225324,3985] 0 2024-04-03T08:39:32.163 INFO:tasks.workunit.client.1.smithi181.stdout:7/634: dwrite d0/d1/d6/de/f5a [0,4194304] 0 2024-04-03T08:39:32.167 INFO:tasks.workunit.client.1.smithi181.stdout:4/716: truncate d1/d16/d24/d5e/d3f/d81/f99 240271 0 2024-04-03T08:39:32.168 INFO:tasks.workunit.client.0.smithi157.stdout:1/751: creat d2/d11/d24/d39/d3b/d1b/d7f/de9/ffa x:0 0 0 2024-04-03T08:39:32.172 INFO:tasks.workunit.client.1.smithi181.stdout:0/666: creat d5/d9/dc8/fd4 x:0 0 0 2024-04-03T08:39:32.174 INFO:tasks.workunit.client.1.smithi181.stdout:3/736: getdents d0/d17/d40 0 2024-04-03T08:39:32.175 INFO:tasks.workunit.client.1.smithi181.stdout:0/667: chown d5/dc/d14/d29/d46/fc4 0 1 2024-04-03T08:39:32.179 INFO:tasks.workunit.client.0.smithi157.stdout:3/799: rename d8/d13/f56 to d8/d1e/d2d/d39/d51/d7e/db1/de7/f116 0 2024-04-03T08:39:32.180 INFO:tasks.workunit.client.1.smithi181.stdout:4/717: symlink d1/d16/d24/d5e/d2b/db9/lf1 0 2024-04-03T08:39:32.180 INFO:tasks.workunit.client.1.smithi181.stdout:7/635: dwrite d0/d1/d6/de/f5a [4194304,4194304] 0 2024-04-03T08:39:32.181 INFO:tasks.workunit.client.0.smithi157.stdout:9/834: dread d1/d36/f61 [0,4194304] 0 2024-04-03T08:39:32.182 INFO:tasks.workunit.client.1.smithi181.stdout:4/718: write d1/d16/d37/d34/f35 [830737,101190] 0 2024-04-03T08:39:32.184 INFO:tasks.workunit.client.0.smithi157.stdout:1/752: creat d2/d11/d23/dc9/d5d/db4/dbc/ffb x:0 0 0 2024-04-03T08:39:32.187 INFO:tasks.workunit.client.1.smithi181.stdout:5/668: creat d4/d18/d55/db4/fd8 x:0 0 0 2024-04-03T08:39:32.189 INFO:tasks.workunit.client.0.smithi157.stdout:7/840: dread d0/d11/d15/d17/d52/f54 [0,4194304] 0 2024-04-03T08:39:32.189 INFO:tasks.workunit.client.1.smithi181.stdout:0/668: creat d5/dc/d10/d58/fd5 x:0 0 0 2024-04-03T08:39:32.192 INFO:tasks.workunit.client.0.smithi157.stdout:0/875: symlink d2/d9/dc/l13c 0 2024-04-03T08:39:32.194 INFO:tasks.workunit.client.1.smithi181.stdout:6/713: creat d6/d31/d36/dba/fde x:0 0 0 2024-04-03T08:39:32.195 INFO:tasks.workunit.client.0.smithi157.stdout:4/765: dread da/df/d6b/fb1 [0,4194304] 0 2024-04-03T08:39:32.197 INFO:tasks.workunit.client.1.smithi181.stdout:3/737: mkdir d0/d17/d63/df8 0 2024-04-03T08:39:32.200 INFO:tasks.workunit.client.1.smithi181.stdout:3/738: write d0/d17/d40/fd7 [699728,2905] 0 2024-04-03T08:39:32.205 INFO:tasks.workunit.client.0.smithi157.stdout:5/874: rename dc/d29/d56/d49 to dc/d29/d56/d9e/db5/dc9/d124 0 2024-04-03T08:39:32.213 INFO:tasks.workunit.client.1.smithi181.stdout:1/690: getdents d10/d15/d17/d19/d33/d70 0 2024-04-03T08:39:32.217 INFO:tasks.workunit.client.0.smithi157.stdout:6/812: rmdir d1/d5/d17/d2a/d40/dec/d92/dcd 0 2024-04-03T08:39:32.217 INFO:tasks.workunit.client.1.smithi181.stdout:0/669: mknod d5/d9/d2a/cd6 0 2024-04-03T08:39:32.220 INFO:tasks.workunit.client.0.smithi157.stdout:2/806: dwrite d3/d12/fd [0,4194304] 0 2024-04-03T08:39:32.222 INFO:tasks.workunit.client.1.smithi181.stdout:7/636: mkdir d0/d1/d6/de9 0 2024-04-03T08:39:32.224 INFO:tasks.workunit.client.0.smithi157.stdout:3/800: dwrite d8/f57 [0,4194304] 0 2024-04-03T08:39:32.226 INFO:tasks.workunit.client.1.smithi181.stdout:0/670: dread d5/dc/d14/d8d/f9a [0,4194304] 0 2024-04-03T08:39:32.228 INFO:tasks.workunit.client.1.smithi181.stdout:6/714: creat d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/fdf x:0 0 0 2024-04-03T08:39:32.229 INFO:tasks.workunit.client.1.smithi181.stdout:3/739: creat d0/d5/d6f/ff9 x:0 0 0 2024-04-03T08:39:32.230 INFO:tasks.workunit.client.1.smithi181.stdout:3/740: fsync d0/d5/d6/fce 0 2024-04-03T08:39:32.231 INFO:tasks.workunit.client.1.smithi181.stdout:9/725: sync 2024-04-03T08:39:32.231 INFO:tasks.workunit.client.1.smithi181.stdout:8/619: sync 2024-04-03T08:39:32.233 INFO:tasks.workunit.client.1.smithi181.stdout:9/726: write d1/da/f5a [1601969,89625] 0 2024-04-03T08:39:32.237 INFO:tasks.workunit.client.1.smithi181.stdout:9/727: fdatasync d1/f20 0 2024-04-03T08:39:32.239 INFO:tasks.workunit.client.0.smithi157.stdout:1/753: symlink d2/d11/d23/dc9/d64/lfc 0 2024-04-03T08:39:32.244 INFO:tasks.workunit.client.1.smithi181.stdout:4/719: truncate d1/d16/d24/d5e/d31/fa5 1901752 0 2024-04-03T08:39:32.250 INFO:tasks.workunit.client.1.smithi181.stdout:5/669: rename d4/f39 to d4/d18/d55/dae/fd9 0 2024-04-03T08:39:32.254 INFO:tasks.workunit.client.0.smithi157.stdout:6/813: read - d1/fcb zero size 2024-04-03T08:39:32.254 INFO:tasks.workunit.client.1.smithi181.stdout:7/637: rmdir d0/d1/d6/de/d17/d27/d72 39 2024-04-03T08:39:32.257 INFO:tasks.workunit.client.1.smithi181.stdout:0/671: symlink d5/dc/d10/d58/dba/d90/ld7 0 2024-04-03T08:39:32.259 INFO:tasks.workunit.client.0.smithi157.stdout:4/766: dread da/df/d2f/d64/f7b [0,4194304] 0 2024-04-03T08:39:32.265 INFO:tasks.workunit.client.1.smithi181.stdout:6/715: creat d6/d3e/db1/fe0 x:0 0 0 2024-04-03T08:39:32.266 INFO:tasks.workunit.client.0.smithi157.stdout:0/876: symlink d2/d9/dc/df/d1b/d35/l13d 0 2024-04-03T08:39:32.266 INFO:tasks.workunit.client.1.smithi181.stdout:5/670: dwrite d4/d18/d55/d5a/fbf [0,4194304] 0 2024-04-03T08:39:32.268 INFO:tasks.workunit.client.1.smithi181.stdout:6/716: write d6/d31/d36/dba/da6/f88 [1692851,64401] 0 2024-04-03T08:39:32.273 INFO:tasks.workunit.client.1.smithi181.stdout:6/717: chown d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/f6a 3585 1 2024-04-03T08:39:32.274 INFO:tasks.workunit.client.1.smithi181.stdout:1/691: dwrite d10/d15/d17/d19/d33/f6a [0,4194304] 0 2024-04-03T08:39:32.277 INFO:tasks.workunit.client.1.smithi181.stdout:6/718: fsync d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/f9d 0 2024-04-03T08:39:32.278 INFO:tasks.workunit.client.0.smithi157.stdout:2/807: dwrite d3/d2e/d65/fac [0,4194304] 0 2024-04-03T08:39:32.278 INFO:tasks.workunit.client.0.smithi157.stdout:5/875: symlink dc/d29/d56/d9e/db5/dc9/d124/l125 0 2024-04-03T08:39:32.283 INFO:tasks.workunit.client.0.smithi157.stdout:6/814: rmdir d1/d5/d17/d2a/d73 39 2024-04-03T08:39:32.286 INFO:tasks.workunit.client.0.smithi157.stdout:7/841: link d0/d11/d15/d1b/db4/lcb d0/d11/d15/d17/d1c/d88/l122 0 2024-04-03T08:39:32.287 INFO:tasks.workunit.client.1.smithi181.stdout:4/720: truncate d1/d16/d24/d5e/d31/d39/d5d/f88 1670356 0 2024-04-03T08:39:32.289 INFO:tasks.workunit.client.1.smithi181.stdout:4/721: chown d1/d16/d37/c2a 25827 1 2024-04-03T08:39:32.292 INFO:tasks.workunit.client.1.smithi181.stdout:4/722: fsync d1/d16/d24/d5e/d3f/d41/f87 0 2024-04-03T08:39:32.293 INFO:tasks.workunit.client.0.smithi157.stdout:0/877: creat d2/d9/d51/f13e x:0 0 0 2024-04-03T08:39:32.294 INFO:tasks.workunit.client.1.smithi181.stdout:7/638: rename d0/d1/d6/db9 to d0/d1/d6/de/d17/d64/d85/dd8/dea 0 2024-04-03T08:39:32.297 INFO:tasks.workunit.client.0.smithi157.stdout:9/835: link d1/l11 d1/d4a/l117 0 2024-04-03T08:39:32.298 INFO:tasks.workunit.client.1.smithi181.stdout:0/672: creat d5/d9/d2c/dcc/fd8 x:0 0 0 2024-04-03T08:39:32.298 INFO:tasks.workunit.client.0.smithi157.stdout:1/754: write d2/d11/d24/d39/d3b/fb5 [690787,11093] 0 2024-04-03T08:39:32.301 INFO:tasks.workunit.client.1.smithi181.stdout:0/673: write d5/dc/d10/d58/d6c/fb7 [4733790,125519] 0 2024-04-03T08:39:32.311 INFO:tasks.workunit.client.1.smithi181.stdout:5/671: mkdir d4/d18/d25/d59/db3/dda 0 2024-04-03T08:39:32.312 INFO:tasks.workunit.client.0.smithi157.stdout:3/801: dwrite d8/d1e/d2d/d3f/d4d/d8f/fa2 [0,4194304] 0 2024-04-03T08:39:32.315 INFO:tasks.workunit.client.0.smithi157.stdout:4/767: fsync da/df/d24/d35/d53/f84 0 2024-04-03T08:39:32.316 INFO:tasks.workunit.client.0.smithi157.stdout:3/802: dread - d8/d1e/d2d/d3b/d9e/df9/f104 zero size 2024-04-03T08:39:32.320 INFO:tasks.workunit.client.0.smithi157.stdout:3/803: write d8/d13/d1b/d4e/d50/d7c/dd8/ff2 [560480,55181] 0 2024-04-03T08:39:32.323 INFO:tasks.workunit.client.1.smithi181.stdout:8/620: mkdir d4/d2a/dd2 0 2024-04-03T08:39:32.331 INFO:tasks.workunit.client.0.smithi157.stdout:3/804: dread d8/d1e/d2d/f34 [0,4194304] 0 2024-04-03T08:39:32.333 INFO:tasks.workunit.client.1.smithi181.stdout:7/639: dread d0/d1/d6/de/d17/d64/fbc [0,4194304] 0 2024-04-03T08:39:32.335 INFO:tasks.workunit.client.1.smithi181.stdout:0/674: fsync d5/f8c 0 2024-04-03T08:39:32.336 INFO:tasks.workunit.client.0.smithi157.stdout:6/815: write d1/d5/d17/fba [1808326,38683] 0 2024-04-03T08:39:32.336 INFO:tasks.workunit.client.0.smithi157.stdout:2/808: symlink d3/db/d44/l114 0 2024-04-03T08:39:32.340 INFO:tasks.workunit.client.1.smithi181.stdout:5/672: truncate d4/d18/f23 1504787 0 2024-04-03T08:39:32.341 INFO:tasks.workunit.client.0.smithi157.stdout:2/809: fsync d3/d2e/d65/f113 0 2024-04-03T08:39:32.343 INFO:tasks.workunit.client.1.smithi181.stdout:3/741: creat d0/ffa x:0 0 0 2024-04-03T08:39:32.344 INFO:tasks.workunit.client.1.smithi181.stdout:0/675: dread d5/d9/f7f [0,4194304] 0 2024-04-03T08:39:32.345 INFO:tasks.workunit.client.0.smithi157.stdout:7/842: dread d0/d11/d6f/d89/d8c/d103/da5/fb2 [0,4194304] 0 2024-04-03T08:39:32.345 INFO:tasks.workunit.client.0.smithi157.stdout:9/836: write d1/d36/d46/f7a [1144425,45993] 0 2024-04-03T08:39:32.350 INFO:tasks.workunit.client.1.smithi181.stdout:8/621: dread d4/d44/f77 [0,4194304] 0 2024-04-03T08:39:32.350 INFO:tasks.workunit.client.0.smithi157.stdout:3/805: dread - d8/d13/d1b/d5b/fc7 zero size 2024-04-03T08:39:32.352 INFO:tasks.workunit.client.1.smithi181.stdout:7/640: dwrite d0/d1/d6/de/f44 [0,4194304] 0 2024-04-03T08:39:32.352 INFO:tasks.workunit.client.1.smithi181.stdout:8/622: chown d4/d45/d9/l1a 825 1 2024-04-03T08:39:32.355 INFO:tasks.workunit.client.1.smithi181.stdout:8/623: dread - d4/d44/f8d zero size 2024-04-03T08:39:32.356 INFO:tasks.workunit.client.1.smithi181.stdout:1/692: rename d10/d15/d4b/c67 to d10/d15/d4a/d86/cdc 0 2024-04-03T08:39:32.363 INFO:tasks.workunit.client.0.smithi157.stdout:1/755: rename d2/d11/d24/l6b to d2/d11/lfd 0 2024-04-03T08:39:32.363 INFO:tasks.workunit.client.0.smithi157.stdout:0/878: dwrite d2/d9/d36/d38/fd7 [0,4194304] 0 2024-04-03T08:39:32.365 INFO:tasks.workunit.client.1.smithi181.stdout:1/693: truncate d10/d15/d4a/fc2 128816 0 2024-04-03T08:39:32.367 INFO:tasks.workunit.client.1.smithi181.stdout:1/694: readlink d10/d15/d17/d23/d27/l75 0 2024-04-03T08:39:32.369 INFO:tasks.workunit.client.0.smithi157.stdout:3/806: unlink d8/d1e/d2d/f34 0 2024-04-03T08:39:32.369 INFO:tasks.workunit.client.1.smithi181.stdout:2/791: sync 2024-04-03T08:39:32.372 INFO:tasks.workunit.client.0.smithi157.stdout:6/816: mkdir d1/d5/d17/d29/d87/d11b 0 2024-04-03T08:39:32.375 INFO:tasks.workunit.client.1.smithi181.stdout:0/676: dread d5/dc/d14/d29/f78 [0,4194304] 0 2024-04-03T08:39:32.376 INFO:tasks.workunit.client.1.smithi181.stdout:6/719: rename l5 to d6/d31/d36/dba/d95/le1 0 2024-04-03T08:39:32.380 INFO:tasks.workunit.client.0.smithi157.stdout:0/879: readlink d2/d9/dc/df/d1b/d4a/d31/lec 0 2024-04-03T08:39:32.380 INFO:tasks.workunit.client.0.smithi157.stdout:4/768: dwrite da/f8b [0,4194304] 0 2024-04-03T08:39:32.381 INFO:tasks.workunit.client.1.smithi181.stdout:8/624: creat d4/d44/d59/d5f/d6c/fd3 x:0 0 0 2024-04-03T08:39:32.384 INFO:tasks.workunit.client.0.smithi157.stdout:9/837: dwrite d1/d36/d46/f7a [0,4194304] 0 2024-04-03T08:39:32.387 INFO:tasks.workunit.client.0.smithi157.stdout:9/838: write d1/f5 [3702533,100564] 0 2024-04-03T08:39:32.390 INFO:tasks.workunit.client.1.smithi181.stdout:2/792: dwrite d13/d1c/da5/dac/ff0 [0,4194304] 0 2024-04-03T08:39:32.397 INFO:tasks.workunit.client.1.smithi181.stdout:1/695: creat d10/d15/d17/d19/d33/d70/fdd x:0 0 0 2024-04-03T08:39:32.400 INFO:tasks.workunit.client.0.smithi157.stdout:6/817: mknod d1/d5/d17/d29/d62/d7f/c11c 0 2024-04-03T08:39:32.409 INFO:tasks.workunit.client.0.smithi157.stdout:0/880: dwrite d2/f1d [4194304,4194304] 0 2024-04-03T08:39:32.410 INFO:tasks.workunit.client.0.smithi157.stdout:4/769: fsync da/df/d6b/d95/fef 0 2024-04-03T08:39:32.414 INFO:tasks.workunit.client.1.smithi181.stdout:3/742: link d0/d17/leb d0/d17/d36/d3b/lfb 0 2024-04-03T08:39:32.416 INFO:tasks.workunit.client.1.smithi181.stdout:3/743: write d0/d5/d6/dd/d25/f4d [1604803,8084] 0 2024-04-03T08:39:32.419 INFO:tasks.workunit.client.0.smithi157.stdout:2/810: rename d3/db/d44/d4c/lee to d3/l115 0 2024-04-03T08:39:32.422 INFO:tasks.workunit.client.0.smithi157.stdout:3/807: read d8/d13/d1b/d83/fd4 [1101597,84188] 0 2024-04-03T08:39:32.423 INFO:tasks.workunit.client.0.smithi157.stdout:4/770: write da/f8b [4499885,69975] 0 2024-04-03T08:39:32.423 INFO:tasks.workunit.client.0.smithi157.stdout:6/818: fsync d1/d5/d17/d2a/d40/f7c 0 2024-04-03T08:39:32.424 INFO:tasks.workunit.client.0.smithi157.stdout:7/843: truncate d0/d11/d15/d17/d1c/d4f/d5f/fe4 3415066 0 2024-04-03T08:39:32.425 INFO:tasks.workunit.client.1.smithi181.stdout:5/673: write d4/d18/d55/dae/fd9 [3120499,49606] 0 2024-04-03T08:39:32.432 INFO:tasks.workunit.client.0.smithi157.stdout:6/819: read - d1/d5/d17/d2a/d30/d95/dff/f108 zero size 2024-04-03T08:39:32.433 INFO:tasks.workunit.client.1.smithi181.stdout:1/696: creat d10/d15/d17/d19/dd9/fde x:0 0 0 2024-04-03T08:39:32.440 INFO:tasks.workunit.client.0.smithi157.stdout:1/756: rename d2/d11/d23/d73/fc2 to d2/d11/d24/d39/d3b/d2e/d66/d91/d97/ffe 0 2024-04-03T08:39:32.440 INFO:tasks.workunit.client.1.smithi181.stdout:3/744: dwrite d0/d17/d63/d81/fc7 [0,4194304] 0 2024-04-03T08:39:32.442 INFO:tasks.workunit.client.1.smithi181.stdout:5/674: fdatasync d4/d18/d55/dae/fd9 0 2024-04-03T08:39:32.444 INFO:tasks.workunit.client.1.smithi181.stdout:4/723: rename d1/d16/d24/db5 to d1/d16/d24/d5e/d2b/df2 0 2024-04-03T08:39:32.447 INFO:tasks.workunit.client.0.smithi157.stdout:0/881: chown d2/d9/dc/df/d6f/d9d/d6a/cd6 124794112 1 2024-04-03T08:39:32.448 INFO:tasks.workunit.client.0.smithi157.stdout:4/771: chown da/df/f57 51038212 1 2024-04-03T08:39:32.450 INFO:tasks.workunit.client.1.smithi181.stdout:9/728: sync 2024-04-03T08:39:32.450 INFO:tasks.workunit.client.1.smithi181.stdout:8/625: link d4/d45/dae/cb0 d4/d45/db/d14/d31/d1c/d51/d87/cd4 0 2024-04-03T08:39:32.450 INFO:tasks.workunit.client.0.smithi157.stdout:4/772: chown da/df/l17 8383653 1 2024-04-03T08:39:32.452 INFO:tasks.workunit.client.0.smithi157.stdout:7/844: read - d0/d75/f8d zero size 2024-04-03T08:39:32.455 INFO:tasks.workunit.client.0.smithi157.stdout:6/820: creat d1/d4b/d38/da6/f11d x:0 0 0 2024-04-03T08:39:32.459 INFO:tasks.workunit.client.1.smithi181.stdout:0/677: dwrite d5/d9/d2a/da1/fc6 [0,4194304] 0 2024-04-03T08:39:32.462 INFO:tasks.workunit.client.1.smithi181.stdout:7/641: rename d0/d1/d6/de/c47 to d0/d1/d6/de/d17/d27/d93/ceb 0 2024-04-03T08:39:32.470 INFO:tasks.workunit.client.0.smithi157.stdout:9/839: dwrite d1/d15/d27/daf/da7/fbb [0,4194304] 0 2024-04-03T08:39:32.470 INFO:tasks.workunit.client.1.smithi181.stdout:0/678: truncate d5/dc/d10/d58/fd5 303458 0 2024-04-03T08:39:32.472 INFO:tasks.workunit.client.0.smithi157.stdout:3/808: write d8/d13/f60 [726820,44270] 0 2024-04-03T08:39:32.473 INFO:tasks.workunit.client.0.smithi157.stdout:1/757: creat d2/d11/d23/dc9/da1/ded/fff x:0 0 0 2024-04-03T08:39:32.476 INFO:tasks.workunit.client.1.smithi181.stdout:9/729: dwrite d1/da/d13/d22/d23/d36/d9c/fa7 [0,4194304] 0 2024-04-03T08:39:32.476 INFO:tasks.workunit.client.0.smithi157.stdout:9/840: read d1/d15/d27/d5c/faa [1012103,60431] 0 2024-04-03T08:39:32.480 INFO:tasks.workunit.client.0.smithi157.stdout:4/773: fdatasync da/fdd 0 2024-04-03T08:39:32.487 INFO:tasks.workunit.client.1.smithi181.stdout:5/675: write d4/d18/d25/d68/f97 [543548,17027] 0 2024-04-03T08:39:32.492 INFO:tasks.workunit.client.1.smithi181.stdout:6/720: sync 2024-04-03T08:39:32.497 INFO:tasks.workunit.client.1.smithi181.stdout:0/679: dwrite d5/dc/d10/d58/d6c/f5d [0,4194304] 0 2024-04-03T08:39:32.500 INFO:tasks.workunit.client.1.smithi181.stdout:5/676: truncate d4/d18/d25/d68/d77/fd1 75250 0 2024-04-03T08:39:32.504 INFO:tasks.workunit.client.0.smithi157.stdout:8/822: sync 2024-04-03T08:39:32.508 INFO:tasks.workunit.client.0.smithi157.stdout:3/809: creat d8/d1e/d2d/d39/d51/d48/dce/f117 x:0 0 0 2024-04-03T08:39:32.510 INFO:tasks.workunit.client.1.smithi181.stdout:4/724: dread d1/d16/d24/d5e/d3f/d41/f42 [0,4194304] 0 2024-04-03T08:39:32.513 INFO:tasks.workunit.client.0.smithi157.stdout:1/758: unlink d2/d11/d23/d73/fd1 0 2024-04-03T08:39:32.514 INFO:tasks.workunit.client.1.smithi181.stdout:8/626: mknod d4/d2a/dd2/cd5 0 2024-04-03T08:39:32.516 INFO:tasks.workunit.client.1.smithi181.stdout:1/697: link d10/d15/d17/f93 d10/d15/d17/d19/dd9/fdf 0 2024-04-03T08:39:32.516 INFO:tasks.workunit.client.0.smithi157.stdout:9/841: mknod d1/d15/d27/d34/dc7/c118 0 2024-04-03T08:39:32.517 INFO:tasks.workunit.client.0.smithi157.stdout:9/842: chown d1/d4a/d4d/d86 65105840 1 2024-04-03T08:39:32.520 INFO:tasks.workunit.client.1.smithi181.stdout:3/745: write d0/d5/d6/dd/f21 [892660,56854] 0 2024-04-03T08:39:32.521 INFO:tasks.workunit.client.0.smithi157.stdout:4/774: fsync da/df/f104 0 2024-04-03T08:39:32.528 INFO:tasks.workunit.client.0.smithi157.stdout:7/845: dwrite d0/d11/d6f/d89/d8c/d103/f10 [0,4194304] 0 2024-04-03T08:39:32.530 INFO:tasks.workunit.client.0.smithi157.stdout:0/882: write d2/d9/d5f/d105/f10a [958267,16390] 0 2024-04-03T08:39:32.530 INFO:tasks.workunit.client.0.smithi157.stdout:2/811: link d3/db/d44/d4c/d5a/fa0 d3/d12/f116 0 2024-04-03T08:39:32.533 INFO:tasks.workunit.client.0.smithi157.stdout:7/846: write d0/d11/d15/d17/d43/fb7 [3962443,11623] 0 2024-04-03T08:39:32.534 INFO:tasks.workunit.client.1.smithi181.stdout:7/642: truncate d0/d1/d6/de/d17/d27/f3a 2869180 0 2024-04-03T08:39:32.537 INFO:tasks.workunit.client.0.smithi157.stdout:0/883: dread - d2/d9/dc/df/d6f/d9d/d6a/d91/d10b/f121 zero size 2024-04-03T08:39:32.539 INFO:tasks.workunit.client.0.smithi157.stdout:8/823: truncate d2/d20/db1/dbc/de2/fe7 1650919 0 2024-04-03T08:39:32.539 INFO:tasks.workunit.client.1.smithi181.stdout:0/680: mknod d5/d9/d2c/dcc/cd9 0 2024-04-03T08:39:32.543 INFO:tasks.workunit.client.1.smithi181.stdout:4/725: mknod d1/d16/d24/d5e/d2b/df2/cf3 0 2024-04-03T08:39:32.543 INFO:tasks.workunit.client.1.smithi181.stdout:9/730: write d1/da/d13/d22/d23/d36/d91/d9d/d39/f59 [1906620,110175] 0 2024-04-03T08:39:32.544 INFO:tasks.workunit.client.0.smithi157.stdout:6/821: rename d1/d4b/d38/da6/cef to d1/d5/c11e 0 2024-04-03T08:39:32.551 INFO:tasks.workunit.client.1.smithi181.stdout:5/677: dread d4/d56/fa5 [0,4194304] 0 2024-04-03T08:39:32.552 INFO:tasks.workunit.client.1.smithi181.stdout:1/698: dwrite d10/d69/fd8 [0,4194304] 0 2024-04-03T08:39:32.558 INFO:tasks.workunit.client.0.smithi157.stdout:7/847: dread - d0/d11/d15/d17/d43/fc9 zero size 2024-04-03T08:39:32.565 INFO:tasks.workunit.client.0.smithi157.stdout:0/884: truncate d2/d9/dc/df/f139 607130 0 2024-04-03T08:39:32.567 INFO:tasks.workunit.client.0.smithi157.stdout:3/810: dwrite d8/d13/d1b/d4e/d50/d7c/fb7 [0,4194304] 0 2024-04-03T08:39:32.578 INFO:tasks.workunit.client.0.smithi157.stdout:6/822: rmdir d1/d4b/d38/d59 39 2024-04-03T08:39:32.579 INFO:tasks.workunit.client.0.smithi157.stdout:4/775: dwrite da/d26/ff0 [0,4194304] 0 2024-04-03T08:39:32.587 INFO:tasks.workunit.client.0.smithi157.stdout:7/848: creat d0/d11/d15/d17/d43/d8a/f123 x:0 0 0 2024-04-03T08:39:32.588 INFO:tasks.workunit.client.0.smithi157.stdout:2/812: dwrite d3/d2e/d65/fa2 [0,4194304] 0 2024-04-03T08:39:32.593 INFO:tasks.workunit.client.0.smithi157.stdout:8/824: write d2/d20/d23/f5c [4410894,9711] 0 2024-04-03T08:39:32.602 INFO:tasks.workunit.client.0.smithi157.stdout:9/843: getdents d1/d4a/d4d/d86/dd5 0 2024-04-03T08:39:32.604 INFO:tasks.workunit.client.0.smithi157.stdout:6/823: symlink d1/d4b/da5/dd9/df9/l11f 0 2024-04-03T08:39:32.608 INFO:tasks.workunit.client.0.smithi157.stdout:3/811: dwrite d8/d1e/d2d/d39/d51/d4c/f40 [4194304,4194304] 0 2024-04-03T08:39:32.610 INFO:tasks.workunit.client.0.smithi157.stdout:0/885: dread d2/d9/d51/f12b [0,4194304] 0 2024-04-03T08:39:32.627 INFO:tasks.workunit.client.0.smithi157.stdout:3/812: mkdir d8/d1e/d2d/d39/d51/d7e/db1/d118 0 2024-04-03T08:39:32.634 INFO:tasks.workunit.client.0.smithi157.stdout:8/825: getdents d2/d11/d10/d24/d5b/d109 0 2024-04-03T08:39:32.636 INFO:tasks.workunit.client.0.smithi157.stdout:2/813: dread d3/d12/f63 [0,4194304] 0 2024-04-03T08:39:32.639 INFO:tasks.workunit.client.0.smithi157.stdout:7/849: write d0/d11/d15/d17/fbc [498306,73303] 0 2024-04-03T08:39:32.641 INFO:tasks.workunit.client.0.smithi157.stdout:9/844: symlink d1/dab/d103/l119 0 2024-04-03T08:39:32.642 INFO:tasks.workunit.client.0.smithi157.stdout:4/776: dread da/df/d2f/d64/d8f/dbd/f5b [0,4194304] 0 2024-04-03T08:39:32.645 INFO:tasks.workunit.client.1.smithi181.stdout:2/793: rename d13/da7/d27/d2f/d5d/cad to d13/d1c/c11f 0 2024-04-03T08:39:32.648 INFO:tasks.workunit.client.1.smithi181.stdout:6/721: link d6/d3e/db1/fe0 d6/d53/d80/fe2 0 2024-04-03T08:39:32.648 INFO:tasks.workunit.client.0.smithi157.stdout:0/886: rename d2/d9/d51/d63/d71/fbc to d2/d9/dc/df/d6f/de3/f13f 0 2024-04-03T08:39:32.649 INFO:tasks.workunit.client.1.smithi181.stdout:6/722: write d6/f58 [4978055,22892] 0 2024-04-03T08:39:32.649 INFO:tasks.workunit.client.0.smithi157.stdout:6/824: creat d1/d4b/da5/f120 x:0 0 0 2024-04-03T08:39:32.650 INFO:tasks.workunit.client.0.smithi157.stdout:3/813: dwrite d8/d13/d1b/d4e/d50/fc9 [4194304,4194304] 0 2024-04-03T08:39:32.655 INFO:tasks.workunit.client.0.smithi157.stdout:6/825: read - d1/d5/d1b/d97/f111 zero size 2024-04-03T08:39:32.655 INFO:tasks.workunit.client.0.smithi157.stdout:7/850: symlink d0/d11/d6f/d89/d8c/deb/l124 0 2024-04-03T08:39:32.655 INFO:tasks.workunit.client.1.smithi181.stdout:0/681: rmdir d5 39 2024-04-03T08:39:32.658 INFO:tasks.workunit.client.0.smithi157.stdout:0/887: truncate d2/d9/dc/df/d6f/fd4 4722609 0 2024-04-03T08:39:32.661 INFO:tasks.workunit.client.0.smithi157.stdout:9/845: creat d1/d4a/d4d/d86/dd5/f11a x:0 0 0 2024-04-03T08:39:32.661 INFO:tasks.workunit.client.0.smithi157.stdout:0/888: write d2/d9/dc/d54/ff3 [1129835,69524] 0 2024-04-03T08:39:32.665 INFO:tasks.workunit.client.0.smithi157.stdout:4/777: rename da/df/f18 to da/df/d6b/d95/f10a 0 2024-04-03T08:39:32.670 INFO:tasks.workunit.client.1.smithi181.stdout:7/643: truncate d0/d1/d6/de/d6d/f77 1876123 0 2024-04-03T08:39:32.670 INFO:tasks.workunit.client.0.smithi157.stdout:7/851: dread d0/d11/d15/d1b/db8/f95 [0,4194304] 0 2024-04-03T08:39:32.670 INFO:tasks.workunit.client.0.smithi157.stdout:2/814: creat d3/db/d44/d4c/df1/d101/f117 x:0 0 0 2024-04-03T08:39:32.674 INFO:tasks.workunit.client.0.smithi157.stdout:8/826: write d2/d6f/d70/fab [519649,22674] 0 2024-04-03T08:39:32.680 INFO:tasks.workunit.client.1.smithi181.stdout:1/699: symlink d10/d15/d17/d19/d33/le0 0 2024-04-03T08:39:32.684 INFO:tasks.workunit.client.1.smithi181.stdout:3/746: rename d0/d17/d63/f76 to d0/d5/d6/d32/dc1/ffc 0 2024-04-03T08:39:32.686 INFO:tasks.workunit.client.0.smithi157.stdout:2/815: dwrite d3/db/d44/d4c/df1/fdb [0,4194304] 0 2024-04-03T08:39:32.686 INFO:tasks.workunit.client.1.smithi181.stdout:3/747: write d0/d17/f82 [1499602,48484] 0 2024-04-03T08:39:32.688 INFO:tasks.workunit.client.0.smithi157.stdout:2/816: truncate d3/f34 1361462 0 2024-04-03T08:39:32.693 INFO:tasks.workunit.client.1.smithi181.stdout:6/723: mknod d6/d31/ce3 0 2024-04-03T08:39:32.693 INFO:tasks.workunit.client.0.smithi157.stdout:4/778: fdatasync da/df/d2f/d54/fb4 0 2024-04-03T08:39:32.693 INFO:tasks.workunit.client.1.smithi181.stdout:3/748: dread d0/d5/fa [0,4194304] 0 2024-04-03T08:39:32.694 INFO:tasks.workunit.client.1.smithi181.stdout:6/724: chown d6/d31/d36/f4c 139 1 2024-04-03T08:39:32.697 INFO:tasks.workunit.client.0.smithi157.stdout:3/814: dread d8/f9 [0,4194304] 0 2024-04-03T08:39:32.699 INFO:tasks.workunit.client.1.smithi181.stdout:5/678: write d4/d18/d25/f3c [2589411,108253] 0 2024-04-03T08:39:32.702 INFO:tasks.workunit.client.0.smithi157.stdout:8/827: unlink d2/d11/f1d 0 2024-04-03T08:39:32.704 INFO:tasks.workunit.client.0.smithi157.stdout:0/889: mknod d2/d9/dc/c140 0 2024-04-03T08:39:32.707 INFO:tasks.workunit.client.0.smithi157.stdout:5/876: sync 2024-04-03T08:39:32.708 INFO:tasks.workunit.client.0.smithi157.stdout:2/817: readlink d3/l35 0 2024-04-03T08:39:32.710 INFO:tasks.workunit.client.0.smithi157.stdout:5/877: stat dc/d29/d56/d52/d9d/da5/daa 0 2024-04-03T08:39:32.711 INFO:tasks.workunit.client.0.smithi157.stdout:2/818: stat d3/db/d44/d4c/d5a/d88/f8c 0 2024-04-03T08:39:32.712 INFO:tasks.workunit.client.0.smithi157.stdout:9/846: link d1/d94/dbe/fe9 d1/d4a/d4d/f11b 0 2024-04-03T08:39:32.715 INFO:tasks.workunit.client.0.smithi157.stdout:7/852: creat d0/d11/d6f/d89/d8c/d103/de3/f125 x:0 0 0 2024-04-03T08:39:32.715 INFO:tasks.workunit.client.1.smithi181.stdout:2/794: dwrite d13/d1c/f51 [0,4194304] 0 2024-04-03T08:39:32.717 INFO:tasks.workunit.client.1.smithi181.stdout:7/644: rename d0/d1/d6/de/c8d to d0/d1/d6/de9/cec 0 2024-04-03T08:39:32.718 INFO:tasks.workunit.client.1.smithi181.stdout:4/726: write d1/d16/d24/d5e/f45 [1037352,89753] 0 2024-04-03T08:39:32.720 INFO:tasks.workunit.client.0.smithi157.stdout:6/826: creat d1/d5/d17/d2a/f121 x:0 0 0 2024-04-03T08:39:32.720 INFO:tasks.workunit.client.1.smithi181.stdout:1/700: dread d10/d15/d17/d30/f79 [0,4194304] 0 2024-04-03T08:39:32.721 INFO:tasks.workunit.client.0.smithi157.stdout:8/828: dwrite d2/d11/d10/d24/d5b/fda [4194304,4194304] 0 2024-04-03T08:39:32.726 INFO:tasks.workunit.client.1.smithi181.stdout:0/682: fsync d5/dc/d14/d29/f47 0 2024-04-03T08:39:32.727 INFO:tasks.workunit.client.0.smithi157.stdout:8/829: chown d2/d11/d10/d24/d5b/d53/faf 164678444 1 2024-04-03T08:39:32.728 INFO:tasks.workunit.client.1.smithi181.stdout:8/627: getdents d4/d45/d9/d70 0 2024-04-03T08:39:32.729 INFO:tasks.workunit.client.0.smithi157.stdout:6/827: write d1/d5/d17/d2a/d37/f7b [4740428,68596] 0 2024-04-03T08:39:32.730 INFO:tasks.workunit.client.0.smithi157.stdout:0/890: mknod d2/d9/dc/d54/df0/c141 0 2024-04-03T08:39:32.730 INFO:tasks.workunit.client.0.smithi157.stdout:5/878: mknod dc/d29/d56/d9e/dc3/de2/c126 0 2024-04-03T08:39:32.732 INFO:tasks.workunit.client.1.smithi181.stdout:4/727: dread d1/d16/d24/d5e/d3f/d41/f42 [0,4194304] 0 2024-04-03T08:39:32.737 INFO:tasks.workunit.client.1.smithi181.stdout:2/795: rmdir d13/da7/d85/de4 39 2024-04-03T08:39:32.741 INFO:tasks.workunit.client.0.smithi157.stdout:7/853: mknod d0/d11/d6f/d89/d8c/d103/da5/def/c126 0 2024-04-03T08:39:32.741 INFO:tasks.workunit.client.1.smithi181.stdout:7/645: unlink d0/d1/d6/de/f5a 0 2024-04-03T08:39:32.743 INFO:tasks.workunit.client.0.smithi157.stdout:3/815: rename d8/d1e/d2d/d39/f47 to d8/d13/d1b/d4e/f119 0 2024-04-03T08:39:32.746 INFO:tasks.workunit.client.0.smithi157.stdout:3/816: chown d8/d1e/d2d/d39/d51/d7e/db1/cdd 1 1 2024-04-03T08:39:32.748 INFO:tasks.workunit.client.0.smithi157.stdout:3/817: dread - d8/d13/fb0 zero size 2024-04-03T08:39:32.751 INFO:tasks.workunit.client.0.smithi157.stdout:5/879: symlink dc/d29/d56/d9e/dc3/dde/de4/l127 0 2024-04-03T08:39:32.753 INFO:tasks.workunit.client.0.smithi157.stdout:3/818: dread d8/f57 [4194304,4194304] 0 2024-04-03T08:39:32.755 INFO:tasks.workunit.client.0.smithi157.stdout:8/830: creat d2/d11/d10/d24/d5b/d2e/d75/d81/f11b x:0 0 0 2024-04-03T08:39:32.759 INFO:tasks.workunit.client.0.smithi157.stdout:7/854: symlink d0/d11/d6f/d89/d8c/d103/da5/l127 0 2024-04-03T08:39:32.761 INFO:tasks.workunit.client.1.smithi181.stdout:5/679: mknod d4/d18/d25/d59/db3/dd0/cdb 0 2024-04-03T08:39:32.763 INFO:tasks.workunit.client.0.smithi157.stdout:9/847: getdents d1/d94 0 2024-04-03T08:39:32.764 INFO:tasks.workunit.client.1.smithi181.stdout:9/731: getdents d1/da/d28/d30/d3e/d4e 0 2024-04-03T08:39:32.766 INFO:tasks.workunit.client.0.smithi157.stdout:9/848: read d1/d15/d27/ff6 [171779,19988] 0 2024-04-03T08:39:32.766 INFO:tasks.workunit.client.1.smithi181.stdout:9/732: fdatasync d1/da/d1a/f56 0 2024-04-03T08:39:32.767 INFO:tasks.workunit.client.0.smithi157.stdout:5/880: truncate dc/d29/d56/d18/d21/f5d 1461342 0 2024-04-03T08:39:32.768 INFO:tasks.workunit.client.1.smithi181.stdout:3/749: dwrite d0/d5/fa2 [0,4194304] 0 2024-04-03T08:39:32.768 INFO:tasks.workunit.client.1.smithi181.stdout:4/728: fsync d1/d16/d24/d5e/d3f/d6c/fb4 0 2024-04-03T08:39:32.769 INFO:tasks.workunit.client.0.smithi157.stdout:3/819: mknod d8/d1e/d2d/d39/d51/d48/dab/c11a 0 2024-04-03T08:39:32.770 INFO:tasks.workunit.client.0.smithi157.stdout:9/849: chown d1/d4a/d4d/da4/ffb 82123 1 2024-04-03T08:39:32.771 INFO:tasks.workunit.client.1.smithi181.stdout:2/796: mknod d13/d1c/d4a/d7f/db3/d8f/c120 0 2024-04-03T08:39:32.772 INFO:tasks.workunit.client.0.smithi157.stdout:5/881: write dc/f1f [3258363,70360] 0 2024-04-03T08:39:32.774 INFO:tasks.workunit.client.0.smithi157.stdout:8/831: mkdir d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119/d11c 0 2024-04-03T08:39:32.775 INFO:tasks.workunit.client.0.smithi157.stdout:9/850: read d1/d36/d46/f7a [4175537,91946] 0 2024-04-03T08:39:32.780 INFO:tasks.workunit.client.1.smithi181.stdout:1/701: mkdir d10/d15/d17/d23/daa/de1 0 2024-04-03T08:39:32.783 INFO:tasks.workunit.client.1.smithi181.stdout:6/725: creat d6/d31/d36/dba/da6/d4f/dd1/fe4 x:0 0 0 2024-04-03T08:39:32.784 INFO:tasks.workunit.client.1.smithi181.stdout:6/726: dread - d6/d3e/d5e/f90 zero size 2024-04-03T08:39:32.785 INFO:tasks.workunit.client.1.smithi181.stdout:6/727: chown d6/d31/d36/d73 6056768 1 2024-04-03T08:39:32.786 INFO:tasks.workunit.client.1.smithi181.stdout:0/683: fsync d5/d9/d2c/dcc/fd1 0 2024-04-03T08:39:32.788 INFO:tasks.workunit.client.1.smithi181.stdout:0/684: readlink d5/dc/d14/d29/d46/l79 0 2024-04-03T08:39:32.789 INFO:tasks.workunit.client.0.smithi157.stdout:6/828: write d1/f5e [368232,23550] 0 2024-04-03T08:39:32.791 INFO:tasks.workunit.client.0.smithi157.stdout:5/882: chown dc/d29/d56/d18/fab 6 1 2024-04-03T08:39:32.791 INFO:tasks.workunit.client.0.smithi157.stdout:0/891: dread d2/d9/dc/df/d1b/d35/f9e [0,4194304] 0 2024-04-03T08:39:32.794 INFO:tasks.workunit.client.0.smithi157.stdout:8/832: fdatasync d2/d11/d10/d24/d5b/d2e/d75/faa 0 2024-04-03T08:39:32.796 INFO:tasks.workunit.client.1.smithi181.stdout:8/628: dwrite d4/d45/db/fd [0,4194304] 0 2024-04-03T08:39:32.797 INFO:tasks.workunit.client.0.smithi157.stdout:5/883: write dc/d29/d56/d18/d21/f94 [1090504,4852] 0 2024-04-03T08:39:32.799 INFO:tasks.workunit.client.1.smithi181.stdout:4/729: unlink d1/d16/ccc 0 2024-04-03T08:39:32.800 INFO:tasks.workunit.client.0.smithi157.stdout:7/855: write d0/d11/d15/d17/f25 [1885651,63527] 0 2024-04-03T08:39:32.804 INFO:tasks.workunit.client.1.smithi181.stdout:4/730: chown d1/d16/d24/d5e/d31/d39/d5d/d9a/lae 19605 1 2024-04-03T08:39:32.807 INFO:tasks.workunit.client.1.smithi181.stdout:7/646: rename d0/d1/l32 to d0/d1/d6/de/da3/led 0 2024-04-03T08:39:32.810 INFO:tasks.workunit.client.1.smithi181.stdout:1/702: unlink d10/d15/d17/d19/d33/f73 0 2024-04-03T08:39:32.813 INFO:tasks.workunit.client.1.smithi181.stdout:6/728: unlink d6/d31/d36/d73/fa8 0 2024-04-03T08:39:32.816 INFO:tasks.workunit.client.1.smithi181.stdout:5/680: unlink d4/f3d 0 2024-04-03T08:39:32.817 INFO:tasks.workunit.client.1.smithi181.stdout:0/685: dread - d5/d9/f95 zero size 2024-04-03T08:39:32.817 INFO:tasks.workunit.client.1.smithi181.stdout:5/681: chown d4/d18/d55/d5a 5419 1 2024-04-03T08:39:32.821 INFO:tasks.workunit.client.1.smithi181.stdout:8/629: mknod d4/d45/db/d5c/d5e/cd6 0 2024-04-03T08:39:32.822 INFO:tasks.workunit.client.1.smithi181.stdout:8/630: fdatasync d4/d44/f8d 0 2024-04-03T08:39:32.826 INFO:tasks.workunit.client.0.smithi157.stdout:9/851: dread d1/d15/d27/d5c/d79/f7c [0,4194304] 0 2024-04-03T08:39:32.828 INFO:tasks.workunit.client.1.smithi181.stdout:3/750: rename d0/d5/d6/dd/d25/l72 to d0/d17/d36/d1e/db5/lfd 0 2024-04-03T08:39:32.834 INFO:tasks.workunit.client.1.smithi181.stdout:0/686: dwrite d5/dc/d14/d8d/fb4 [0,4194304] 0 2024-04-03T08:39:32.838 INFO:tasks.workunit.client.1.smithi181.stdout:4/731: dwrite d1/d16/d24/d5e/d3f/d41/f42 [0,4194304] 0 2024-04-03T08:39:32.841 INFO:tasks.workunit.client.1.smithi181.stdout:6/729: write d6/d31/d36/dba/da6/d4f/dd1/d9/f1b [1061795,108918] 0 2024-04-03T08:39:32.848 INFO:tasks.workunit.client.1.smithi181.stdout:9/733: rename d1/da/d13/d22/d23/d54 to d1/da/d13/d22/d23/de0 0 2024-04-03T08:39:32.851 INFO:tasks.workunit.client.1.smithi181.stdout:2/797: truncate d13/d1c/d4a/d68/f94 1029319 0 2024-04-03T08:39:32.852 INFO:tasks.workunit.client.1.smithi181.stdout:8/631: truncate d4/d45/db/d14/d31/d1c/d51/f8b 237003 0 2024-04-03T08:39:32.855 INFO:tasks.workunit.client.1.smithi181.stdout:3/751: symlink d0/d17/d36/d1e/lfe 0 2024-04-03T08:39:32.857 INFO:tasks.workunit.client.1.smithi181.stdout:3/752: stat d0/d5/d6/c19 0 2024-04-03T08:39:32.858 INFO:tasks.workunit.client.1.smithi181.stdout:1/703: symlink d10/d15/d17/le2 0 2024-04-03T08:39:32.860 INFO:tasks.workunit.client.1.smithi181.stdout:0/687: write d5/dc/d14/f9c [287786,2255] 0 2024-04-03T08:39:32.862 INFO:tasks.workunit.client.1.smithi181.stdout:4/732: creat d1/d16/d24/d5e/d3f/d81/ff4 x:0 0 0 2024-04-03T08:39:32.865 INFO:tasks.workunit.client.1.smithi181.stdout:5/682: link d4/d18/f61 d4/d44/d71/dcf/fdc 0 2024-04-03T08:39:32.867 INFO:tasks.workunit.client.1.smithi181.stdout:5/683: chown d4/d18/d55/db4/f9f 3 1 2024-04-03T08:39:32.868 INFO:tasks.workunit.client.1.smithi181.stdout:5/684: readlink d4/d22/l6a 0 2024-04-03T08:39:32.871 INFO:tasks.workunit.client.1.smithi181.stdout:7/647: write d0/f3b [1379508,68051] 0 2024-04-03T08:39:32.878 INFO:tasks.workunit.client.1.smithi181.stdout:2/798: mkdir d13/d1c/d4a/d68/dfa/df9/d121 0 2024-04-03T08:39:32.880 INFO:tasks.workunit.client.0.smithi157.stdout:3/820: creat d8/d1e/d2d/d39/d51/d4c/dd6/de0/f11b x:0 0 0 2024-04-03T08:39:32.881 INFO:tasks.workunit.client.0.smithi157.stdout:3/821: chown d8/d1e/d2d/d3f/dc8 11 1 2024-04-03T08:39:32.881 INFO:tasks.workunit.client.1.smithi181.stdout:1/704: mkdir d10/d15/d17/d37/de3 0 2024-04-03T08:39:32.883 INFO:tasks.workunit.client.1.smithi181.stdout:1/705: dread - d10/d15/d17/d23/db0/d8d/fba zero size 2024-04-03T08:39:32.888 INFO:tasks.workunit.client.1.smithi181.stdout:6/730: rename d6/d31/d36/f34 to d6/d31/d36/dba/d95/fe5 0 2024-04-03T08:39:32.898 INFO:tasks.workunit.client.0.smithi157.stdout:8/833: unlink d2/d20/l6d 0 2024-04-03T08:39:32.899 INFO:tasks.workunit.client.1.smithi181.stdout:7/648: dread - d0/d1/d6/de/d17/d64/d85/f98 zero size 2024-04-03T08:39:32.900 INFO:tasks.workunit.client.1.smithi181.stdout:8/632: dread d4/d2a/d37/f3d [0,4194304] 0 2024-04-03T08:39:32.901 INFO:tasks.workunit.client.1.smithi181.stdout:2/799: fsync d13/d1c/d6c/d7a/ffe 0 2024-04-03T08:39:32.905 INFO:tasks.workunit.client.0.smithi157.stdout:7/856: truncate d0/d11/d15/d17/d1c/da1/fa4 475681 0 2024-04-03T08:39:32.906 INFO:tasks.workunit.client.0.smithi157.stdout:8/834: dread d2/d20/f3c [0,4194304] 0 2024-04-03T08:39:32.911 INFO:tasks.workunit.client.0.smithi157.stdout:9/852: rename d1/d4a/d4d/da4/db8/c10f to d1/d15/d27/d34/dc7/c11c 0 2024-04-03T08:39:32.914 INFO:tasks.workunit.client.1.smithi181.stdout:4/733: dwrite d1/d16/d37/d34/d85/fc9 [0,4194304] 0 2024-04-03T08:39:32.914 INFO:tasks.workunit.client.0.smithi157.stdout:3/822: fsync d8/d1e/d2d/d39/f68 0 2024-04-03T08:39:32.916 INFO:tasks.workunit.client.1.smithi181.stdout:6/731: fdatasync d6/d31/d36/f5d 0 2024-04-03T08:39:32.919 INFO:tasks.workunit.client.1.smithi181.stdout:8/633: dwrite d4/d44/d59/d5f/d6c/fa3 [0,4194304] 0 2024-04-03T08:39:32.921 INFO:tasks.workunit.client.1.smithi181.stdout:8/634: dread - d4/d45/d9/d70/fbc zero size 2024-04-03T08:39:32.923 INFO:tasks.workunit.client.1.smithi181.stdout:8/635: dread - d4/d45/db/d14/d31/d1c/d51/d87/db1/fbe zero size 2024-04-03T08:39:32.924 INFO:tasks.workunit.client.0.smithi157.stdout:0/892: dwrite d2/d9/d51/d63/d71/f81 [0,4194304] 0 2024-04-03T08:39:32.928 INFO:tasks.workunit.client.1.smithi181.stdout:0/688: truncate d5/dc/d14/f22 446527 0 2024-04-03T08:39:32.929 INFO:tasks.workunit.client.1.smithi181.stdout:9/734: creat d1/fe1 x:0 0 0 2024-04-03T08:39:32.930 INFO:tasks.workunit.client.1.smithi181.stdout:8/636: chown d4/d45/db/d14/d31/d1c/d51/f52 54 1 2024-04-03T08:39:32.937 INFO:tasks.workunit.client.0.smithi157.stdout:5/884: dwrite dc/d29/d56/fb0 [0,4194304] 0 2024-04-03T08:39:32.939 INFO:tasks.workunit.client.0.smithi157.stdout:7/857: fsync d0/d11/d15/d17/f7d 0 2024-04-03T08:39:32.940 INFO:tasks.workunit.client.0.smithi157.stdout:6/829: write d1/d5/d17/d29/f5a [4125009,119616] 0 2024-04-03T08:39:32.950 INFO:tasks.workunit.client.0.smithi157.stdout:3/823: mkdir d8/d1e/d2d/d3f/d4d/d11c 0 2024-04-03T08:39:32.950 INFO:tasks.workunit.client.0.smithi157.stdout:9/853: unlink d1/d4a/d4d/dd6/ldb 0 2024-04-03T08:39:32.950 INFO:tasks.workunit.client.1.smithi181.stdout:5/685: dwrite d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:32.951 INFO:tasks.workunit.client.1.smithi181.stdout:2/800: mknod d13/d1c/d4a/d68/c122 0 2024-04-03T08:39:32.952 INFO:tasks.workunit.client.1.smithi181.stdout:3/753: creat d0/d17/fff x:0 0 0 2024-04-03T08:39:32.953 INFO:tasks.workunit.client.1.smithi181.stdout:5/686: write d4/d18/d55/db4/d96/fb1 [463490,67210] 0 2024-04-03T08:39:32.955 INFO:tasks.workunit.client.1.smithi181.stdout:4/734: fsync d1/d1e/d82/fdf 0 2024-04-03T08:39:32.957 INFO:tasks.workunit.client.1.smithi181.stdout:5/687: readlink d4/d18/d55/dae/lce 0 2024-04-03T08:39:32.959 INFO:tasks.workunit.client.1.smithi181.stdout:1/706: dread d10/d15/d17/d19/f68 [4194304,4194304] 0 2024-04-03T08:39:32.963 INFO:tasks.workunit.client.1.smithi181.stdout:6/732: rmdir d6/d31/d36/dba/d81 39 2024-04-03T08:39:32.964 INFO:tasks.workunit.client.1.smithi181.stdout:6/733: fsync d6/d3e/f7e 0 2024-04-03T08:39:32.966 INFO:tasks.workunit.client.1.smithi181.stdout:8/637: fsync d4/d45/d9/f86 0 2024-04-03T08:39:32.967 INFO:tasks.workunit.client.0.smithi157.stdout:8/835: write d2/d11/f93 [316585,73207] 0 2024-04-03T08:39:32.968 INFO:tasks.workunit.client.1.smithi181.stdout:8/638: stat d4/d45/d9/cc9 0 2024-04-03T08:39:32.973 INFO:tasks.workunit.client.0.smithi157.stdout:6/830: unlink d1/d5/d17/d2a/d40/dec/f68 0 2024-04-03T08:39:32.977 INFO:tasks.workunit.client.0.smithi157.stdout:9/854: unlink d1/d94/cd4 0 2024-04-03T08:39:32.978 INFO:tasks.workunit.client.0.smithi157.stdout:9/855: stat d1/d15/d27/f47 0 2024-04-03T08:39:32.979 INFO:tasks.workunit.client.1.smithi181.stdout:6/734: dwrite d6/dc0/fc5 [0,4194304] 0 2024-04-03T08:39:32.980 INFO:tasks.workunit.client.1.smithi181.stdout:6/735: chown d6/dc0/dd2 128902 1 2024-04-03T08:39:32.981 INFO:tasks.workunit.client.0.smithi157.stdout:3/824: symlink d8/d1e/d2d/d3f/dc8/l11d 0 2024-04-03T08:39:32.982 INFO:tasks.workunit.client.1.smithi181.stdout:2/801: mknod d13/d1c/d4a/d68/c123 0 2024-04-03T08:39:32.983 INFO:tasks.workunit.client.1.smithi181.stdout:9/735: write d1/da/d13/d41/d32/f67 [2301994,89539] 0 2024-04-03T08:39:32.984 INFO:tasks.workunit.client.0.smithi157.stdout:0/893: symlink d2/d9/d36/l142 0 2024-04-03T08:39:32.988 INFO:tasks.workunit.client.0.smithi157.stdout:8/836: unlink d2/d11/d10/l52 0 2024-04-03T08:39:32.990 INFO:tasks.workunit.client.1.smithi181.stdout:4/735: creat d1/d16/d37/ff5 x:0 0 0 2024-04-03T08:39:32.994 INFO:tasks.workunit.client.1.smithi181.stdout:5/688: creat d4/d22/d53/fdd x:0 0 0 2024-04-03T08:39:32.996 INFO:tasks.workunit.client.1.smithi181.stdout:1/707: write d10/d15/d17/d19/f3e [5514243,6275] 0 2024-04-03T08:39:32.998 INFO:tasks.workunit.client.1.smithi181.stdout:1/708: readlink d10/d69/ld0 0 2024-04-03T08:39:33.004 INFO:tasks.workunit.client.1.smithi181.stdout:3/754: dwrite d0/d5/f9d [0,4194304] 0 2024-04-03T08:39:33.007 INFO:tasks.workunit.client.0.smithi157.stdout:8/837: fsync d2/d11/d10/d24/f54 0 2024-04-03T08:39:33.008 INFO:tasks.workunit.client.1.smithi181.stdout:8/639: creat d4/d2a/d37/d67/fd7 x:0 0 0 2024-04-03T08:39:33.009 INFO:tasks.workunit.client.0.smithi157.stdout:6/831: getdents d1/d5/d17/d29/d87/d11b 0 2024-04-03T08:39:33.010 INFO:tasks.workunit.client.1.smithi181.stdout:7/649: creat d0/d1/d6/de/d17/fee x:0 0 0 2024-04-03T08:39:33.011 INFO:tasks.workunit.client.0.smithi157.stdout:0/894: dwrite d2/d9/d36/fee [0,4194304] 0 2024-04-03T08:39:33.014 INFO:tasks.workunit.client.1.smithi181.stdout:6/736: creat d6/d53/d80/fe6 x:0 0 0 2024-04-03T08:39:33.016 INFO:tasks.workunit.client.1.smithi181.stdout:6/737: dread - d6/d31/d36/dba/da6/fd5 zero size 2024-04-03T08:39:33.018 INFO:tasks.workunit.client.1.smithi181.stdout:3/755: dwrite d0/d5/d6/f1d [0,4194304] 0 2024-04-03T08:39:33.018 INFO:tasks.workunit.client.1.smithi181.stdout:2/802: creat d13/d1c/d6c/d111/f124 x:0 0 0 2024-04-03T08:39:33.021 INFO:tasks.workunit.client.0.smithi157.stdout:7/858: dwrite d0/d11/d15/d17/d1c/d4f/d5f/fe4 [0,4194304] 0 2024-04-03T08:39:33.022 INFO:tasks.workunit.client.1.smithi181.stdout:9/736: creat d1/da/d13/d41/daf/fe2 x:0 0 0 2024-04-03T08:39:33.023 INFO:tasks.workunit.client.0.smithi157.stdout:0/895: chown d2/d9/dc/df/d1b/d35/f9e 10112 1 2024-04-03T08:39:33.027 INFO:tasks.workunit.client.1.smithi181.stdout:5/689: creat d4/d18/d25/d59/fde x:0 0 0 2024-04-03T08:39:33.028 INFO:tasks.workunit.client.0.smithi157.stdout:6/832: read - d1/d5/d17/d2a/d40/dec/f91 zero size 2024-04-03T08:39:33.029 INFO:tasks.workunit.client.0.smithi157.stdout:9/856: dwrite d1/d15/d27/d5c/d79/fea [4194304,4194304] 0 2024-04-03T08:39:33.033 INFO:tasks.workunit.client.1.smithi181.stdout:4/736: dread d1/d16/d24/d5e/d3f/d81/f99 [0,4194304] 0 2024-04-03T08:39:33.035 INFO:tasks.workunit.client.1.smithi181.stdout:1/709: readlink d10/l60 0 2024-04-03T08:39:33.040 INFO:tasks.workunit.client.0.smithi157.stdout:3/825: dwrite d8/d13/d1b/d83/fd4 [0,4194304] 0 2024-04-03T08:39:33.040 INFO:tasks.workunit.client.0.smithi157.stdout:0/896: mkdir d2/d9/dc/d54/d143 0 2024-04-03T08:39:33.043 INFO:tasks.workunit.client.0.smithi157.stdout:0/897: dread - d2/d9/d36/f12a zero size 2024-04-03T08:39:33.045 INFO:tasks.workunit.client.0.smithi157.stdout:9/857: unlink d1/d15/d27/le3 0 2024-04-03T08:39:33.049 INFO:tasks.workunit.client.1.smithi181.stdout:0/689: link d5/d9/d2c/fad d5/dc/d10/d58/d6c/fda 0 2024-04-03T08:39:33.051 INFO:tasks.workunit.client.1.smithi181.stdout:4/737: dwrite d1/d1e/f5b [0,4194304] 0 2024-04-03T08:39:33.052 INFO:tasks.workunit.client.1.smithi181.stdout:7/650: unlink d0/d1/d6/de/f5e 0 2024-04-03T08:39:33.054 INFO:tasks.workunit.client.1.smithi181.stdout:4/738: write d1/d1e/d82/fdf [3865213,19622] 0 2024-04-03T08:39:33.060 INFO:tasks.workunit.client.0.smithi157.stdout:3/826: dread d8/d13/f60 [0,4194304] 0 2024-04-03T08:39:33.065 INFO:tasks.workunit.client.1.smithi181.stdout:9/737: mkdir d1/da/d28/d80/dd3/de3 0 2024-04-03T08:39:33.069 INFO:tasks.workunit.client.1.smithi181.stdout:1/710: mknod d10/d15/d41/ce4 0 2024-04-03T08:39:33.069 INFO:tasks.workunit.client.0.smithi157.stdout:9/858: truncate d1/d94/d75/f113 57453 0 2024-04-03T08:39:33.073 INFO:tasks.workunit.client.0.smithi157.stdout:8/838: dwrite d2/d20/f60 [0,4194304] 0 2024-04-03T08:39:33.076 INFO:tasks.workunit.client.0.smithi157.stdout:0/898: getdents d2/d9/dc/df/d1b/d35/d3d 0 2024-04-03T08:39:33.079 INFO:tasks.workunit.client.1.smithi181.stdout:0/690: rename d5/dc/d14/d8d/fa4 to d5/d9/d2c/fdb 0 2024-04-03T08:39:33.079 INFO:tasks.workunit.client.1.smithi181.stdout:7/651: mknod d0/d1/d6/de/d17/d64/d85/dd8/cef 0 2024-04-03T08:39:33.080 INFO:tasks.workunit.client.0.smithi157.stdout:8/839: dread - d2/d11/d10/d24/d5b/d2e/d75/d81/df0/f108 zero size 2024-04-03T08:39:33.081 INFO:tasks.workunit.client.1.smithi181.stdout:7/652: readlink d0/d1/d6/de/la6 0 2024-04-03T08:39:33.081 INFO:tasks.workunit.client.0.smithi157.stdout:9/859: readlink d1/d36/l37 0 2024-04-03T08:39:33.081 INFO:tasks.workunit.client.0.smithi157.stdout:6/833: dread d1/f3 [0,4194304] 0 2024-04-03T08:39:33.081 INFO:tasks.workunit.client.1.smithi181.stdout:7/653: chown d0/le3 3 1 2024-04-03T08:39:33.082 INFO:tasks.workunit.client.1.smithi181.stdout:4/739: mkdir d1/d16/d24/d61/df6 0 2024-04-03T08:39:33.082 INFO:tasks.workunit.client.0.smithi157.stdout:9/860: write d1/d4a/d4d/da4/f111 [214201,4568] 0 2024-04-03T08:39:33.085 INFO:tasks.workunit.client.1.smithi181.stdout:2/803: mkdir d13/d1c/d4a/d68/dfa/df9/d121/d125 0 2024-04-03T08:39:33.088 INFO:tasks.workunit.client.0.smithi157.stdout:6/834: chown d1/d5/d17/d29/c2d 2779 1 2024-04-03T08:39:33.090 INFO:tasks.workunit.client.0.smithi157.stdout:0/899: rename d2/d9/dc/df/d6f/fed to d2/d9/dc/dbe/dfb/dbb/dd1/f144 0 2024-04-03T08:39:33.093 INFO:tasks.workunit.client.0.smithi157.stdout:9/861: chown d1/d15/d27/d34/dc7/c11c 464503639 1 2024-04-03T08:39:33.094 INFO:tasks.workunit.client.1.smithi181.stdout:5/690: mknod d4/d18/d25/d59/db3/dda/cdf 0 2024-04-03T08:39:33.096 INFO:tasks.workunit.client.1.smithi181.stdout:9/738: rmdir d1/da/d13/d41 39 2024-04-03T08:39:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:32 smithi181 ceph-mon[44183]: pgmap v13: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 64 MiB/s rd, 150 MiB/s wr, 336 op/s 2024-04-03T08:39:33.098 INFO:tasks.workunit.client.0.smithi157.stdout:8/840: rename d2/d20/d77/lea to d2/d7b/l11d 0 2024-04-03T08:39:33.099 INFO:tasks.workunit.client.0.smithi157.stdout:3/827: write d8/d1e/d2d/d3f/d4d/f9a [233007,88658] 0 2024-04-03T08:39:33.100 INFO:tasks.workunit.client.1.smithi181.stdout:8/640: creat d4/fd8 x:0 0 0 2024-04-03T08:39:33.102 INFO:tasks.workunit.client.1.smithi181.stdout:7/654: dwrite d0/d1/d6/de/d17/d64/d85/d9a/da4/fab [0,4194304] 0 2024-04-03T08:39:33.104 INFO:tasks.workunit.client.0.smithi157.stdout:8/841: dread d2/d11/d10/fe9 [0,4194304] 0 2024-04-03T08:39:33.108 INFO:tasks.workunit.client.0.smithi157.stdout:6/835: rmdir d1/d5/d17/d29/da7/db9/df0/da8 39 2024-04-03T08:39:33.110 INFO:tasks.workunit.client.1.smithi181.stdout:6/738: truncate d6/d31/d36/dba/da6/d4f/d77/fbf 901780 0 2024-04-03T08:39:33.110 INFO:tasks.workunit.client.1.smithi181.stdout:3/756: link d0/d17/d40/fea d0/d17/d36/d1e/db5/f100 0 2024-04-03T08:39:33.111 INFO:tasks.workunit.client.1.smithi181.stdout:5/691: dread d4/d18/d55/dae/fd9 [0,4194304] 0 2024-04-03T08:39:33.118 INFO:tasks.workunit.client.0.smithi157.stdout:0/900: unlink d2/d9/d36/d82/l129 0 2024-04-03T08:39:33.120 INFO:tasks.workunit.client.0.smithi157.stdout:0/901: readlink d2/d9/d36/l72 0 2024-04-03T08:39:33.122 INFO:tasks.workunit.client.1.smithi181.stdout:2/804: rename d13/l60 to d13/d1c/d4a/d7f/db3/d81/l126 0 2024-04-03T08:39:33.125 INFO:tasks.workunit.client.1.smithi181.stdout:8/641: truncate d4/d45/db/f56 662274 0 2024-04-03T08:39:33.125 INFO:tasks.workunit.client.0.smithi157.stdout:6/836: dread - d1/d4b/d38/f9f zero size 2024-04-03T08:39:33.126 INFO:tasks.workunit.client.0.smithi157.stdout:0/902: read d2/d9/d5f/d105/f10a [307380,50290] 0 2024-04-03T08:39:33.127 INFO:tasks.workunit.client.1.smithi181.stdout:3/757: dwrite d0/d5/fe6 [0,4194304] 0 2024-04-03T08:39:33.128 INFO:tasks.workunit.client.0.smithi157.stdout:0/903: stat d2/f1d 0 2024-04-03T08:39:33.129 INFO:tasks.workunit.client.1.smithi181.stdout:3/758: chown d0/d5/d6/dd/lcc 52 1 2024-04-03T08:39:33.132 INFO:tasks.workunit.client.0.smithi157.stdout:9/862: dwrite d1/d15/d16/fc6 [0,4194304] 0 2024-04-03T08:39:33.132 INFO:tasks.workunit.client.0.smithi157.stdout:0/904: dread - d2/d9/d51/f13e zero size 2024-04-03T08:39:33.134 INFO:tasks.workunit.client.0.smithi157.stdout:8/842: getdents d2/d11/d10/d24/d5b/d2e/d94/ddb/d103 0 2024-04-03T08:39:33.138 INFO:tasks.workunit.client.0.smithi157.stdout:0/905: write d2/d9/dc/df/d6f/de3/fff [965218,68683] 0 2024-04-03T08:39:33.139 INFO:tasks.workunit.client.1.smithi181.stdout:5/692: dread d4/d18/d25/d68/d77/f9b [0,4194304] 0 2024-04-03T08:39:33.140 INFO:tasks.workunit.client.1.smithi181.stdout:2/805: creat d13/d1c/d4a/d68/dfa/f127 x:0 0 0 2024-04-03T08:39:33.140 INFO:tasks.workunit.client.1.smithi181.stdout:5/693: stat d4/d22/d53/d98 0 2024-04-03T08:39:33.143 INFO:tasks.workunit.client.1.smithi181.stdout:3/759: creat d0/d17/d63/db7/f101 x:0 0 0 2024-04-03T08:39:33.146 INFO:tasks.workunit.client.1.smithi181.stdout:5/694: write d4/d18/d55/d5a/fbf [3167577,83348] 0 2024-04-03T08:39:33.146 INFO:tasks.workunit.client.0.smithi157.stdout:6/837: chown d1/d5/d17/d29/da7/db9/df0/da8/fc5 368897 1 2024-04-03T08:39:33.151 INFO:tasks.workunit.client.1.smithi181.stdout:6/739: truncate d6/d31/d36/dba/da6/d4f/dd1/f6d 2294298 0 2024-04-03T08:39:33.154 INFO:tasks.workunit.client.1.smithi181.stdout:6/740: read d6/d31/f89 [99658,28870] 0 2024-04-03T08:39:33.155 INFO:tasks.workunit.client.0.smithi157.stdout:8/843: creat d2/d11/d10/d24/d5b/d2e/dcf/f11e x:0 0 0 2024-04-03T08:39:33.157 INFO:tasks.workunit.client.0.smithi157.stdout:3/828: write d8/d1e/f7b [189789,11136] 0 2024-04-03T08:39:33.157 INFO:tasks.workunit.client.0.smithi157.stdout:0/906: truncate d2/d9/dc/df/d1b/d4a/fc4 1756857 0 2024-04-03T08:39:33.158 INFO:tasks.workunit.client.1.smithi181.stdout:4/740: truncate d1/d16/d24/d5e/d2b/db9/fd5 3566960 0 2024-04-03T08:39:33.159 INFO:tasks.workunit.client.1.smithi181.stdout:0/691: getdents d5/d9/d2a/da1 0 2024-04-03T08:39:33.161 INFO:tasks.workunit.client.0.smithi157.stdout:3/829: dread - d8/d13/d1b/d5b/fc7 zero size 2024-04-03T08:39:33.162 INFO:tasks.workunit.client.0.smithi157.stdout:6/838: read - d1/d5/d1b/fdd zero size 2024-04-03T08:39:33.162 INFO:tasks.workunit.client.1.smithi181.stdout:9/739: write d1/da/d28/d80/dd3/fd4 [1205859,92408] 0 2024-04-03T08:39:33.163 INFO:tasks.workunit.client.1.smithi181.stdout:9/740: dread - d1/da/d13/d73/fb7 zero size 2024-04-03T08:39:33.164 INFO:tasks.workunit.client.0.smithi157.stdout:6/839: write d1/d5/d17/f67 [5189641,106918] 0 2024-04-03T08:39:33.164 INFO:tasks.workunit.client.0.smithi157.stdout:9/863: write d1/d4a/f4c [2874596,109961] 0 2024-04-03T08:39:33.166 INFO:tasks.workunit.client.0.smithi157.stdout:9/864: stat d1/dab/dad 0 2024-04-03T08:39:33.166 INFO:tasks.workunit.client.0.smithi157.stdout:0/907: rmdir d2/d9/d5f/d105 39 2024-04-03T08:39:33.167 INFO:tasks.workunit.client.1.smithi181.stdout:2/806: rename d13/da7/d27/d2f/d5d/fc0 to d13/d1c/d4a/d68/dba/f128 0 2024-04-03T08:39:33.169 INFO:tasks.workunit.client.0.smithi157.stdout:0/908: stat d2/d9/dc/df/d6f/fa9 0 2024-04-03T08:39:33.179 INFO:tasks.workunit.client.1.smithi181.stdout:7/655: dwrite d0/d1/f15 [0,4194304] 0 2024-04-03T08:39:33.179 INFO:tasks.workunit.client.1.smithi181.stdout:8/642: dwrite d4/d44/f5a [0,4194304] 0 2024-04-03T08:39:33.182 INFO:tasks.workunit.client.1.smithi181.stdout:3/760: dread d0/d5/d77/f8f [0,4194304] 0 2024-04-03T08:39:33.182 INFO:tasks.workunit.client.1.smithi181.stdout:6/741: creat d6/d31/d36/dba/d95/fe7 x:0 0 0 2024-04-03T08:39:33.183 INFO:tasks.workunit.client.1.smithi181.stdout:9/741: dwrite d1/da/d1a/d92/fb3 [0,4194304] 0 2024-04-03T08:39:33.185 INFO:tasks.workunit.client.1.smithi181.stdout:0/692: truncate d5/d9/d2e/f43 3089915 0 2024-04-03T08:39:33.185 INFO:tasks.workunit.client.0.smithi157.stdout:9/865: fdatasync d1/d15/f50 0 2024-04-03T08:39:33.194 INFO:tasks.workunit.client.1.smithi181.stdout:5/695: mknod d4/d18/d55/db4/ce0 0 2024-04-03T08:39:33.195 INFO:tasks.workunit.client.0.smithi157.stdout:0/909: dread d2/d9/dc/df/d1b/f59 [0,4194304] 0 2024-04-03T08:39:33.195 INFO:tasks.workunit.client.1.smithi181.stdout:7/656: dread - d0/f9f zero size 2024-04-03T08:39:33.198 INFO:tasks.workunit.client.1.smithi181.stdout:3/761: dwrite d0/ff6 [0,4194304] 0 2024-04-03T08:39:33.202 INFO:tasks.workunit.client.1.smithi181.stdout:4/741: mkdir d1/d1e/d2c/de4/df7 0 2024-04-03T08:39:33.202 INFO:tasks.workunit.client.1.smithi181.stdout:8/643: fdatasync d4/d45/db/d14/fb5 0 2024-04-03T08:39:33.209 INFO:tasks.workunit.client.0.smithi157.stdout:9/866: link d1/d4a/ca2 d1/d15/d27/daf/c11d 0 2024-04-03T08:39:33.209 INFO:tasks.workunit.client.0.smithi157.stdout:0/910: creat d2/d9/d36/d82/f145 x:0 0 0 2024-04-03T08:39:33.210 INFO:tasks.workunit.client.1.smithi181.stdout:2/807: creat d13/da7/d40/d10f/f129 x:0 0 0 2024-04-03T08:39:33.211 INFO:tasks.workunit.client.1.smithi181.stdout:0/693: dread d5/d9/f1d [0,4194304] 0 2024-04-03T08:39:33.211 INFO:tasks.workunit.client.0.smithi157.stdout:9/867: chown d1/d36/d69 300868255 1 2024-04-03T08:39:33.215 INFO:tasks.workunit.client.0.smithi157.stdout:6/840: dwrite d1/d5/d17/d2a/d40/dec/d92/dd6/feb [0,4194304] 0 2024-04-03T08:39:33.218 INFO:tasks.workunit.client.1.smithi181.stdout:5/696: chown d4/cd 178 1 2024-04-03T08:39:33.218 INFO:tasks.workunit.client.1.smithi181.stdout:3/762: rmdir d0/d17/d63 39 2024-04-03T08:39:33.219 INFO:tasks.workunit.client.0.smithi157.stdout:0/911: write d2/d9/dc/df/d6f/d9d/d6a/fe5 [159403,73426] 0 2024-04-03T08:39:33.219 INFO:tasks.workunit.client.1.smithi181.stdout:8/644: rename d4/d44/d59/d5f/d6c/fa3 to d4/d45/db/d14/dd0/fd9 0 2024-04-03T08:39:33.220 INFO:tasks.workunit.client.0.smithi157.stdout:6/841: fsync d1/d5/d17/d2a/d37/f7b 0 2024-04-03T08:39:33.221 INFO:tasks.workunit.client.1.smithi181.stdout:9/742: symlink d1/da/d28/d30/le4 0 2024-04-03T08:39:33.221 INFO:tasks.workunit.client.1.smithi181.stdout:6/742: mknod d6/d31/d36/dba/da6/d4f/dd1/d50/ce8 0 2024-04-03T08:39:33.222 INFO:tasks.workunit.client.0.smithi157.stdout:9/868: write d1/f42 [33782,1258] 0 2024-04-03T08:39:33.224 INFO:tasks.workunit.client.0.smithi157.stdout:0/912: write d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/f123 [65644,1321] 0 2024-04-03T08:39:33.225 INFO:tasks.workunit.client.1.smithi181.stdout:3/763: mkdir d0/d17/d36/d3b/d102 0 2024-04-03T08:39:33.227 INFO:tasks.workunit.client.0.smithi157.stdout:0/913: readlink d2/d9/dc/df/l138 0 2024-04-03T08:39:33.227 INFO:tasks.workunit.client.0.smithi157.stdout:6/842: creat d1/d5/d17/d2a/d40/dec/d92/f122 x:0 0 0 2024-04-03T08:39:33.229 INFO:tasks.workunit.client.1.smithi181.stdout:6/743: write d6/d31/d36/dba/da6/d4f/f7a [1456715,62824] 0 2024-04-03T08:39:33.231 INFO:tasks.workunit.client.1.smithi181.stdout:0/694: dwrite d5/dc/d14/d29/d46/f63 [4194304,4194304] 0 2024-04-03T08:39:33.234 INFO:tasks.workunit.client.1.smithi181.stdout:4/742: rename d1/d16/d24/d5e/d31/d39/d5d/d94 to d1/d16/d24/d5e/d31/d39/da1/df8 0 2024-04-03T08:39:33.236 INFO:tasks.workunit.client.0.smithi157.stdout:9/869: mknod d1/dab/dad/c11e 0 2024-04-03T08:39:33.237 INFO:tasks.workunit.client.1.smithi181.stdout:7/657: dwrite d0/d1/d6/de/d6d/d96/f9b [0,4194304] 0 2024-04-03T08:39:33.237 INFO:tasks.workunit.client.0.smithi157.stdout:6/843: readlink d1/l20 0 2024-04-03T08:39:33.238 INFO:tasks.workunit.client.0.smithi157.stdout:9/870: fdatasync d1/d4a/f4c 0 2024-04-03T08:39:33.238 INFO:tasks.workunit.client.1.smithi181.stdout:2/808: mknod d13/da7/c12a 0 2024-04-03T08:39:33.239 INFO:tasks.workunit.client.1.smithi181.stdout:9/743: creat d1/da/d13/d22/d23/de0/fe5 x:0 0 0 2024-04-03T08:39:33.241 INFO:tasks.workunit.client.0.smithi157.stdout:0/914: mkdir d2/d9/dc/df/d6f/d9d/d6a/d91/d10b/d146 0 2024-04-03T08:39:33.242 INFO:tasks.workunit.client.1.smithi181.stdout:2/809: write d13/d1c/d4a/d68/dfa/f127 [684837,163] 0 2024-04-03T08:39:33.244 INFO:tasks.workunit.client.1.smithi181.stdout:6/744: symlink d6/d3e/d5e/le9 0 2024-04-03T08:39:33.246 INFO:tasks.workunit.client.1.smithi181.stdout:0/695: symlink d5/dc/d14/d29/d46/ldc 0 2024-04-03T08:39:33.249 INFO:tasks.workunit.client.1.smithi181.stdout:0/696: dread - d5/dc/d10/d58/dba/fcf zero size 2024-04-03T08:39:33.251 INFO:tasks.workunit.client.1.smithi181.stdout:5/697: rename d4/d18/d55/d5a/f89 to d4/d18/d3e/fe1 0 2024-04-03T08:39:33.251 INFO:tasks.workunit.client.1.smithi181.stdout:8/645: dwrite d4/d45/d9/f4d [0,4194304] 0 2024-04-03T08:39:33.253 INFO:tasks.workunit.client.0.smithi157.stdout:0/915: mkdir d2/d9/dc/df/d6f/d9d/d147 0 2024-04-03T08:39:33.257 INFO:tasks.workunit.client.0.smithi157.stdout:6/844: creat d1/d5/d17/d29/da7/db9/dfb/f123 x:0 0 0 2024-04-03T08:39:33.262 INFO:tasks.workunit.client.1.smithi181.stdout:4/743: write d1/d1e/d82/fde [792472,31538] 0 2024-04-03T08:39:33.263 INFO:tasks.workunit.client.1.smithi181.stdout:6/745: mkdir d6/d53/dea 0 2024-04-03T08:39:33.264 INFO:tasks.workunit.client.1.smithi181.stdout:4/744: fsync d1/d16/d24/d5e/d31/d39/fbb 0 2024-04-03T08:39:33.268 INFO:tasks.workunit.client.1.smithi181.stdout:5/698: chown d4/c6 8032 1 2024-04-03T08:39:33.269 INFO:tasks.workunit.client.1.smithi181.stdout:8/646: readlink d4/d2a/d37/d67/l95 0 2024-04-03T08:39:33.270 INFO:tasks.workunit.client.1.smithi181.stdout:9/744: creat d1/da/d13/d41/d32/fe6 x:0 0 0 2024-04-03T08:39:33.274 INFO:tasks.workunit.client.0.smithi157.stdout:6/845: getdents d1/d5/d17/d29/da7/db9/df0 0 2024-04-03T08:39:33.274 INFO:tasks.workunit.client.1.smithi181.stdout:2/810: dread d13/d1c/d6c/fa2 [0,4194304] 0 2024-04-03T08:39:33.275 INFO:tasks.workunit.client.0.smithi157.stdout:4/779: sync 2024-04-03T08:39:33.275 INFO:tasks.workunit.client.0.smithi157.stdout:1/759: sync 2024-04-03T08:39:33.276 INFO:tasks.workunit.client.1.smithi181.stdout:6/746: mkdir d6/d31/d36/deb 0 2024-04-03T08:39:33.277 INFO:tasks.workunit.client.0.smithi157.stdout:6/846: dread - d1/fcb zero size 2024-04-03T08:39:33.281 INFO:tasks.workunit.client.0.smithi157.stdout:1/760: write d2/f45 [5014459,48782] 0 2024-04-03T08:39:33.281 INFO:tasks.workunit.client.1.smithi181.stdout:4/745: dwrite d1/d16/d37/d34/d69/fc7 [0,4194304] 0 2024-04-03T08:39:33.286 INFO:tasks.workunit.client.0.smithi157.stdout:6/847: fsync d1/d5/d17/d2a/d37/f60 0 2024-04-03T08:39:33.286 INFO:tasks.workunit.client.0.smithi157.stdout:1/761: readlink d2/d11/l29 0 2024-04-03T08:39:33.287 INFO:tasks.workunit.client.1.smithi181.stdout:4/746: chown d1/d16/d24/d5e/d31/d39/da1 1302589 1 2024-04-03T08:39:33.288 INFO:tasks.workunit.client.0.smithi157.stdout:0/916: dread d2/d9/dc/df/d6f/d9d/d6a/f76 [0,4194304] 0 2024-04-03T08:39:33.291 INFO:tasks.workunit.client.1.smithi181.stdout:3/764: getdents d0/d17/d36 0 2024-04-03T08:39:33.296 INFO:tasks.workunit.client.1.smithi181.stdout:9/745: write d1/da/d13/d22/f8d [4392506,46576] 0 2024-04-03T08:39:33.298 INFO:tasks.workunit.client.1.smithi181.stdout:2/811: truncate d13/da7/d27/f3a 871817 0 2024-04-03T08:39:33.300 INFO:tasks.workunit.client.1.smithi181.stdout:7/658: dread d0/d1/d6/de/d17/d64/f81 [0,4194304] 0 2024-04-03T08:39:33.301 INFO:tasks.workunit.client.0.smithi157.stdout:9/871: dread d1/d4a/f4c [0,4194304] 0 2024-04-03T08:39:33.302 INFO:tasks.workunit.client.0.smithi157.stdout:6/848: dread d1/d4b/d38/d59/f9b [0,4194304] 0 2024-04-03T08:39:33.303 INFO:tasks.workunit.client.1.smithi181.stdout:4/747: dwrite d1/d1e/d82/fde [0,4194304] 0 2024-04-03T08:39:33.306 INFO:tasks.workunit.client.1.smithi181.stdout:6/747: mknod d6/d3e/d40/dbc/dce/cec 0 2024-04-03T08:39:33.307 INFO:tasks.workunit.client.1.smithi181.stdout:0/697: write d5/dc/d10/d58/f8b [6494,68110] 0 2024-04-03T08:39:33.307 INFO:tasks.workunit.client.1.smithi181.stdout:6/748: dread - d6/d31/d36/fcf zero size 2024-04-03T08:39:33.309 INFO:tasks.workunit.client.1.smithi181.stdout:0/698: readlink d5/l6 0 2024-04-03T08:39:33.311 INFO:tasks.workunit.client.0.smithi157.stdout:0/917: dwrite d2/d9/dc/df/d6f/de3/f12f [0,4194304] 0 2024-04-03T08:39:33.312 INFO:tasks.workunit.client.1.smithi181.stdout:6/749: write d6/d31/d36/dba/da6/d4f/dd1/f3f [4932385,35241] 0 2024-04-03T08:39:33.312 INFO:tasks.workunit.client.0.smithi157.stdout:9/872: rmdir d1/d15/d16 39 2024-04-03T08:39:33.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:32 smithi157 ceph-mon[35083]: pgmap v13: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 64 MiB/s rd, 150 MiB/s wr, 336 op/s 2024-04-03T08:39:33.315 INFO:tasks.workunit.client.1.smithi181.stdout:6/750: write d6/d3e/d40/fb3 [651714,44085] 0 2024-04-03T08:39:33.316 INFO:tasks.workunit.client.1.smithi181.stdout:5/699: write d4/d56/f75 [1002775,1639] 0 2024-04-03T08:39:33.317 INFO:tasks.workunit.client.1.smithi181.stdout:9/746: write d1/da/d13/d41/daf/fbf [2141334,68011] 0 2024-04-03T08:39:33.317 INFO:tasks.workunit.client.0.smithi157.stdout:4/780: write da/df/d11/f66 [1252469,85873] 0 2024-04-03T08:39:33.319 INFO:tasks.workunit.client.1.smithi181.stdout:2/812: creat d13/d1c/d4a/d7f/db3/d8f/f12b x:0 0 0 2024-04-03T08:39:33.321 INFO:tasks.workunit.client.1.smithi181.stdout:7/659: creat d0/d1/d94/ff0 x:0 0 0 2024-04-03T08:39:33.328 INFO:tasks.workunit.client.1.smithi181.stdout:1/711: sync 2024-04-03T08:39:33.332 INFO:tasks.workunit.client.0.smithi157.stdout:9/873: creat d1/d15/d16/f11f x:0 0 0 2024-04-03T08:39:33.332 INFO:tasks.workunit.client.0.smithi157.stdout:1/762: dread d2/d11/d24/d39/f6f [0,4194304] 0 2024-04-03T08:39:33.332 INFO:tasks.workunit.client.1.smithi181.stdout:4/748: dread d1/d16/d24/d5e/d3f/d6c/fb4 [0,4194304] 0 2024-04-03T08:39:33.333 INFO:tasks.workunit.client.0.smithi157.stdout:4/781: fdatasync da/df/d24/d35/d6a/d78/f7a 0 2024-04-03T08:39:33.333 INFO:tasks.workunit.client.1.smithi181.stdout:2/813: rmdir d13/da7/d27/d2f/d5d 39 2024-04-03T08:39:33.334 INFO:tasks.workunit.client.1.smithi181.stdout:8/647: dwrite d4/d45/db/d14/d31/f54 [0,4194304] 0 2024-04-03T08:39:33.336 INFO:tasks.workunit.client.1.smithi181.stdout:4/749: dread - d1/d16/d55/f6e zero size 2024-04-03T08:39:33.337 INFO:tasks.workunit.client.1.smithi181.stdout:5/700: rename d4/d18/d25/d59/db3/dd0/cdb to d4/d18/d3e/ce2 0 2024-04-03T08:39:33.338 INFO:tasks.workunit.client.0.smithi157.stdout:6/849: link d1/d5/d17/d2a/d37/l9c d1/d5/d17/l124 0 2024-04-03T08:39:33.339 INFO:tasks.workunit.client.0.smithi157.stdout:9/874: creat d1/d15/d16/f120 x:0 0 0 2024-04-03T08:39:33.339 INFO:tasks.workunit.client.1.smithi181.stdout:5/701: read - d4/d22/d4a/fca zero size 2024-04-03T08:39:33.342 INFO:tasks.workunit.client.1.smithi181.stdout:9/747: creat d1/da/d13/d41/d65/dbb/fe7 x:0 0 0 2024-04-03T08:39:33.343 INFO:tasks.workunit.client.1.smithi181.stdout:0/699: write d5/dc/d10/d58/d6c/f5d [849937,117363] 0 2024-04-03T08:39:33.344 INFO:tasks.workunit.client.0.smithi157.stdout:6/850: chown d1/d5/d17/d29/d62/d7f/c11c 196831 1 2024-04-03T08:39:33.352 INFO:tasks.workunit.client.0.smithi157.stdout:9/875: rmdir d1/d15/d27/d5c/d79 39 2024-04-03T08:39:33.355 INFO:tasks.workunit.client.0.smithi157.stdout:0/918: dwrite d2/d9/dc/df/d6f/d9d/d6a/d91/fbf [4194304,4194304] 0 2024-04-03T08:39:33.357 INFO:tasks.workunit.client.1.smithi181.stdout:2/814: symlink d13/d1c/d4a/d7f/db3/de3/l12c 0 2024-04-03T08:39:33.360 INFO:tasks.workunit.client.1.smithi181.stdout:2/815: fsync d13/d1c/d4a/fdb 0 2024-04-03T08:39:33.360 INFO:tasks.workunit.client.0.smithi157.stdout:1/763: creat d2/d11/d23/dc9/d58/d94/da3/df1/f100 x:0 0 0 2024-04-03T08:39:33.361 INFO:tasks.workunit.client.1.smithi181.stdout:6/751: dread d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/f9d [0,4194304] 0 2024-04-03T08:39:33.362 INFO:tasks.workunit.client.0.smithi157.stdout:9/876: chown d1/c6c 3 1 2024-04-03T08:39:33.363 INFO:tasks.workunit.client.1.smithi181.stdout:4/750: rmdir d1/d16/d24/d5e 39 2024-04-03T08:39:33.364 INFO:tasks.workunit.client.0.smithi157.stdout:6/851: symlink d1/d5/d17/d2a/l125 0 2024-04-03T08:39:33.366 INFO:tasks.workunit.client.0.smithi157.stdout:9/877: mknod d1/d15/d16/c121 0 2024-04-03T08:39:33.367 INFO:tasks.workunit.client.1.smithi181.stdout:7/660: creat d0/db4/ff1 x:0 0 0 2024-04-03T08:39:33.370 INFO:tasks.workunit.client.1.smithi181.stdout:0/700: mknod d5/d9/d2c/dcc/cdd 0 2024-04-03T08:39:33.370 INFO:tasks.workunit.client.1.smithi181.stdout:3/765: getdents d0/d5/d6/dd/d5f/d95 0 2024-04-03T08:39:33.371 INFO:tasks.workunit.client.0.smithi157.stdout:1/764: truncate d2/d11/d23/dc9/d58/d62/ff7 437646 0 2024-04-03T08:39:33.375 INFO:tasks.workunit.client.1.smithi181.stdout:1/712: creat d10/d15/d17/d23/daa/de1/fe5 x:0 0 0 2024-04-03T08:39:33.376 INFO:tasks.workunit.client.1.smithi181.stdout:8/648: dread d4/d45/d9/f38 [0,4194304] 0 2024-04-03T08:39:33.377 INFO:tasks.workunit.client.0.smithi157.stdout:6/852: dread - d1/d5/d17/d29/da7/db9/f102 zero size 2024-04-03T08:39:33.377 INFO:tasks.workunit.client.0.smithi157.stdout:4/782: dwrite da/df/d99/fab [0,4194304] 0 2024-04-03T08:39:33.378 INFO:tasks.workunit.client.0.smithi157.stdout:9/878: creat d1/d4a/d4d/d86/dd5/f122 x:0 0 0 2024-04-03T08:39:33.378 INFO:tasks.workunit.client.1.smithi181.stdout:1/713: chown d10/d15/d17/lb3 4 1 2024-04-03T08:39:33.380 INFO:tasks.workunit.client.0.smithi157.stdout:1/765: write d2/d11/d24/d39/f54 [225078,12777] 0 2024-04-03T08:39:33.381 INFO:tasks.workunit.client.1.smithi181.stdout:5/702: dread d4/d44/d71/fa7 [0,4194304] 0 2024-04-03T08:39:33.385 INFO:tasks.workunit.client.0.smithi157.stdout:2/819: sync 2024-04-03T08:39:33.389 INFO:tasks.workunit.client.0.smithi157.stdout:0/919: dwrite d2/d9/d51/d63/d109/f13b [0,4194304] 0 2024-04-03T08:39:33.390 INFO:tasks.workunit.client.1.smithi181.stdout:0/701: creat d5/dc/d10/d58/db0/fde x:0 0 0 2024-04-03T08:39:33.392 INFO:tasks.workunit.client.0.smithi157.stdout:6/853: write d1/d5/d17/d29/d62/d7f/d89/ffa [1200879,116298] 0 2024-04-03T08:39:33.392 INFO:tasks.workunit.client.1.smithi181.stdout:3/766: creat d0/dbc/f103 x:0 0 0 2024-04-03T08:39:33.395 INFO:tasks.workunit.client.0.smithi157.stdout:9/879: rename d1/d94 to d1/d15/d27/daf/da7/d123 0 2024-04-03T08:39:33.398 INFO:tasks.workunit.client.1.smithi181.stdout:9/748: dwrite d1/da/d13/f3d [0,4194304] 0 2024-04-03T08:39:33.399 INFO:tasks.workunit.client.0.smithi157.stdout:1/766: creat d2/d11/d24/d39/d3b/d2e/d66/d91/d97/f101 x:0 0 0 2024-04-03T08:39:33.404 INFO:tasks.workunit.client.1.smithi181.stdout:6/752: rename d6/l76 to d6/d31/d36/d73/led 0 2024-04-03T08:39:33.405 INFO:tasks.workunit.client.0.smithi157.stdout:2/820: unlink d3/d2e/d32/l36 0 2024-04-03T08:39:33.406 INFO:tasks.workunit.client.1.smithi181.stdout:8/649: mknod d4/d44/d59/cda 0 2024-04-03T08:39:33.408 INFO:tasks.workunit.client.1.smithi181.stdout:1/714: fdatasync d10/d15/d17/d19/f6d 0 2024-04-03T08:39:33.410 INFO:tasks.workunit.client.0.smithi157.stdout:0/920: fdatasync d2/d9/dc/df/d1b/d35/f9e 0 2024-04-03T08:39:33.411 INFO:tasks.workunit.client.0.smithi157.stdout:4/783: write da/fad [2729168,61467] 0 2024-04-03T08:39:33.411 INFO:tasks.workunit.client.1.smithi181.stdout:4/751: symlink d1/d16/d24/d5e/d2b/db9/lf9 0 2024-04-03T08:39:33.413 INFO:tasks.workunit.client.1.smithi181.stdout:4/752: write d1/d1e/d82/fdf [2219604,124748] 0 2024-04-03T08:39:33.414 INFO:tasks.workunit.client.0.smithi157.stdout:6/854: symlink d1/d4b/l126 0 2024-04-03T08:39:33.414 INFO:tasks.workunit.client.0.smithi157.stdout:5/885: sync 2024-04-03T08:39:33.414 INFO:tasks.workunit.client.0.smithi157.stdout:7/859: sync 2024-04-03T08:39:33.415 INFO:tasks.workunit.client.0.smithi157.stdout:8/844: sync 2024-04-03T08:39:33.415 INFO:tasks.workunit.client.0.smithi157.stdout:3/830: sync 2024-04-03T08:39:33.415 INFO:tasks.workunit.client.1.smithi181.stdout:5/703: chown d4/d56/lc7 1 1 2024-04-03T08:39:33.416 INFO:tasks.workunit.client.0.smithi157.stdout:9/880: write d1/d15/d27/f55 [3018564,85021] 0 2024-04-03T08:39:33.417 INFO:tasks.workunit.client.1.smithi181.stdout:7/661: mknod d0/d1/d6/de/d17/d27/d72/cf2 0 2024-04-03T08:39:33.419 INFO:tasks.workunit.client.0.smithi157.stdout:1/767: write d2/d11/d24/d39/d3b/d2e/d66/d91/d97/ffe [3576944,114501] 0 2024-04-03T08:39:33.420 INFO:tasks.workunit.client.0.smithi157.stdout:9/881: chown d1/d4a/dc4/fd8 250915 1 2024-04-03T08:39:33.422 INFO:tasks.workunit.client.1.smithi181.stdout:0/702: creat d5/d9/d2a/da1/da8/fdf x:0 0 0 2024-04-03T08:39:33.422 INFO:tasks.workunit.client.1.smithi181.stdout:7/662: write d0/d1/d6/de/d17/d64/d85/d9a/da4/fab [3659645,101669] 0 2024-04-03T08:39:33.423 INFO:tasks.workunit.client.0.smithi157.stdout:9/882: chown d1/d4a/d4d/da4/ffb 664 1 2024-04-03T08:39:33.425 INFO:tasks.workunit.client.1.smithi181.stdout:0/703: write d5/dc/d10/d58/d6c/f15 [4979703,1588] 0 2024-04-03T08:39:33.427 INFO:tasks.workunit.client.1.smithi181.stdout:5/704: dread d4/d18/d55/d5a/fbf [0,4194304] 0 2024-04-03T08:39:33.428 INFO:tasks.workunit.client.1.smithi181.stdout:5/705: chown d4/d18/l9e 73093 1 2024-04-03T08:39:33.433 INFO:tasks.workunit.client.1.smithi181.stdout:6/753: creat d6/d3e/db1/fee x:0 0 0 2024-04-03T08:39:33.435 INFO:tasks.workunit.client.1.smithi181.stdout:6/754: write d6/f58 [2396152,32843] 0 2024-04-03T08:39:33.436 INFO:tasks.workunit.client.1.smithi181.stdout:8/650: mknod d4/d45/db/d5c/cdb 0 2024-04-03T08:39:33.438 INFO:tasks.workunit.client.0.smithi157.stdout:7/860: mkdir d0/d11/d15/d17/d1c/d128 0 2024-04-03T08:39:33.440 INFO:tasks.workunit.client.0.smithi157.stdout:8/845: fsync d2/d11/d10/fe3 0 2024-04-03T08:39:33.440 INFO:tasks.workunit.client.0.smithi157.stdout:7/861: stat d0/d11/d15/d17/d1c/d88 0 2024-04-03T08:39:33.441 INFO:tasks.workunit.client.1.smithi181.stdout:1/715: symlink d10/d15/d17/d19/d33/le6 0 2024-04-03T08:39:33.443 INFO:tasks.workunit.client.1.smithi181.stdout:1/716: chown d10/d69/ld0 179 1 2024-04-03T08:39:33.445 INFO:tasks.workunit.client.1.smithi181.stdout:1/717: chown d10/d15/d41/f61 62 1 2024-04-03T08:39:33.447 INFO:tasks.workunit.client.1.smithi181.stdout:9/749: dwrite d1/da/d13/d41/fa9 [0,4194304] 0 2024-04-03T08:39:33.448 INFO:tasks.workunit.client.1.smithi181.stdout:1/718: truncate d10/d15/d4a/fc2 1037576 0 2024-04-03T08:39:33.449 INFO:tasks.workunit.client.0.smithi157.stdout:0/921: unlink d2/d9/dc/dbe/dfb/dbb/cea 0 2024-04-03T08:39:33.449 INFO:tasks.workunit.client.1.smithi181.stdout:9/750: write d1/da/d1a/fd9 [2417510,61800] 0 2024-04-03T08:39:33.451 INFO:tasks.workunit.client.0.smithi157.stdout:0/922: chown d2/d9/dc/df/l11 11776 1 2024-04-03T08:39:33.452 INFO:tasks.workunit.client.0.smithi157.stdout:3/831: mknod d8/d13/d1b/d4e/c11e 0 2024-04-03T08:39:33.453 INFO:tasks.workunit.client.0.smithi157.stdout:6/855: dread d1/f48 [0,4194304] 0 2024-04-03T08:39:33.456 INFO:tasks.workunit.client.0.smithi157.stdout:2/821: creat d3/d12/d43/d4b/d55/d10c/f118 x:0 0 0 2024-04-03T08:39:33.456 INFO:tasks.workunit.client.0.smithi157.stdout:0/923: readlink d2/d9/d5f/d85/d106/le8 0 2024-04-03T08:39:33.458 INFO:tasks.workunit.client.0.smithi157.stdout:9/883: symlink d1/l124 0 2024-04-03T08:39:33.460 INFO:tasks.workunit.client.1.smithi181.stdout:5/706: mknod d4/d18/d3e/ce3 0 2024-04-03T08:39:33.460 INFO:tasks.workunit.client.0.smithi157.stdout:7/862: truncate d0/d11/f21 8316197 0 2024-04-03T08:39:33.465 INFO:tasks.workunit.client.1.smithi181.stdout:4/753: dwrite d1/d16/d37/d34/d85/fcb [0,4194304] 0 2024-04-03T08:39:33.465 INFO:tasks.workunit.client.0.smithi157.stdout:4/784: creat da/df/d24/d35/d53/f10b x:0 0 0 2024-04-03T08:39:33.468 INFO:tasks.workunit.client.1.smithi181.stdout:1/719: dwrite d10/d15/d4a/d6f/f7a [0,4194304] 0 2024-04-03T08:39:33.468 INFO:tasks.workunit.client.0.smithi157.stdout:8/846: dwrite d2/d11/d10/d24/d5b/d2e/d75/d81/f11b [0,4194304] 0 2024-04-03T08:39:33.469 INFO:tasks.workunit.client.1.smithi181.stdout:3/767: write d0/d17/f91 [410508,4980] 0 2024-04-03T08:39:33.471 INFO:tasks.workunit.client.1.smithi181.stdout:4/754: write d1/d16/d24/d5e/d2b/d56/f64 [170195,98725] 0 2024-04-03T08:39:33.474 INFO:tasks.workunit.client.1.smithi181.stdout:4/755: chown d1/l5 32 1 2024-04-03T08:39:33.476 INFO:tasks.workunit.client.1.smithi181.stdout:8/651: rename d4/d45/db/d5c to d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc 0 2024-04-03T08:39:33.477 INFO:tasks.workunit.client.0.smithi157.stdout:3/832: symlink d8/d13/d1b/d4e/d50/d7c/dd8/d10d/l11f 0 2024-04-03T08:39:33.480 INFO:tasks.workunit.client.0.smithi157.stdout:2/822: read d3/d12/f24 [407958,44708] 0 2024-04-03T08:39:33.481 INFO:tasks.workunit.client.0.smithi157.stdout:1/768: creat d2/d11/d24/d39/d3b/d2e/d66/d91/f102 x:0 0 0 2024-04-03T08:39:33.485 INFO:tasks.workunit.client.0.smithi157.stdout:0/924: mkdir d2/d9/dc/df/d6f/d9d/d6a/d91/dae/d148 0 2024-04-03T08:39:33.486 INFO:tasks.workunit.client.0.smithi157.stdout:1/769: write d2/f96 [807867,70939] 0 2024-04-03T08:39:33.486 INFO:tasks.workunit.client.1.smithi181.stdout:9/751: dread d1/da/d13/d41/d32/fcd [0,4194304] 0 2024-04-03T08:39:33.489 INFO:tasks.workunit.client.1.smithi181.stdout:2/816: getdents d13/d1c/d4a/d7f/db3/dbf 0 2024-04-03T08:39:33.489 INFO:tasks.workunit.client.0.smithi157.stdout:0/925: write d2/d9/dc/df/d6f/de3/f12f [71915,51961] 0 2024-04-03T08:39:33.493 INFO:tasks.workunit.client.1.smithi181.stdout:7/663: dread d0/d1/d6/de/d17/f2c [0,4194304] 0 2024-04-03T08:39:33.494 INFO:tasks.workunit.client.1.smithi181.stdout:7/664: chown d0/d1/d6/de9 3 1 2024-04-03T08:39:33.496 INFO:tasks.workunit.client.0.smithi157.stdout:0/926: chown d2/d9/dc/df/d1b/d4a/d31/lec 12240377 1 2024-04-03T08:39:33.496 INFO:tasks.workunit.client.1.smithi181.stdout:1/720: dwrite d10/d15/d17/d23/d27/f87 [4194304,4194304] 0 2024-04-03T08:39:33.497 INFO:tasks.workunit.client.0.smithi157.stdout:0/927: fsync d2/f1d 0 2024-04-03T08:39:33.498 INFO:tasks.workunit.client.0.smithi157.stdout:2/823: unlink d3/dab/cba 0 2024-04-03T08:39:33.500 INFO:tasks.workunit.client.0.smithi157.stdout:7/863: mknod d0/d11/d15/d17/d1c/d4f/d5f/d109/c129 0 2024-04-03T08:39:33.501 INFO:tasks.workunit.client.1.smithi181.stdout:6/755: link d6/d3e/f46 d6/d31/d36/dba/da6/d4f/d77/d8b/fef 0 2024-04-03T08:39:33.502 INFO:tasks.workunit.client.0.smithi157.stdout:0/928: stat d2/d9/dc/df/c16 0 2024-04-03T08:39:33.503 INFO:tasks.workunit.client.1.smithi181.stdout:6/756: write d6/d31/d36/dba/da6/d4f/dd1/f3f [2855434,2963] 0 2024-04-03T08:39:33.508 INFO:tasks.workunit.client.0.smithi157.stdout:3/833: dread - d8/d1e/d2d/d3b/d8c/df1/f107 zero size 2024-04-03T08:39:33.508 INFO:tasks.workunit.client.0.smithi157.stdout:7/864: stat d0/d11/d15/d1b/db8/le1 0 2024-04-03T08:39:33.508 INFO:tasks.workunit.client.0.smithi157.stdout:4/785: creat da/d7e/dba/f10c x:0 0 0 2024-04-03T08:39:33.514 INFO:tasks.workunit.client.1.smithi181.stdout:8/652: symlink d4/d2a/d37/d67/ldd 0 2024-04-03T08:39:33.518 INFO:tasks.workunit.client.1.smithi181.stdout:0/704: creat d5/dc/d14/fe0 x:0 0 0 2024-04-03T08:39:33.521 INFO:tasks.workunit.client.0.smithi157.stdout:8/847: dread d2/d6f/d70/d89/d59/df6/f102 [0,4194304] 0 2024-04-03T08:39:33.523 INFO:tasks.workunit.client.0.smithi157.stdout:8/848: chown d2/d11/d10/d24/d5b/d53/lb7 1 1 2024-04-03T08:39:33.523 INFO:tasks.workunit.client.1.smithi181.stdout:2/817: read - d13/fd4 zero size 2024-04-03T08:39:33.525 INFO:tasks.workunit.client.0.smithi157.stdout:2/824: creat d3/d12/d43/d4b/d55/d10c/f119 x:0 0 0 2024-04-03T08:39:33.533 INFO:tasks.workunit.client.0.smithi157.stdout:3/834: creat d8/d1e/d2d/d39/d51/d7e/f120 x:0 0 0 2024-04-03T08:39:33.534 INFO:tasks.workunit.client.1.smithi181.stdout:7/665: mknod d0/d1/d6/de/d17/d64/d82/cf3 0 2024-04-03T08:39:33.535 INFO:tasks.workunit.client.0.smithi157.stdout:6/856: link d1/l3e d1/d5/d17/d29/da7/l127 0 2024-04-03T08:39:33.537 INFO:tasks.workunit.client.1.smithi181.stdout:6/757: dread d6/d31/d36/dba/da6/d4f/f66 [0,4194304] 0 2024-04-03T08:39:33.540 INFO:tasks.workunit.client.0.smithi157.stdout:1/770: link d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fac d2/d11/d24/d39/d3b/df4/f103 0 2024-04-03T08:39:33.542 INFO:tasks.workunit.client.0.smithi157.stdout:8/849: fsync d2/fe5 0 2024-04-03T08:39:33.544 INFO:tasks.workunit.client.1.smithi181.stdout:4/756: mkdir d1/d16/d37/d34/d86/ded/dfa 0 2024-04-03T08:39:33.546 INFO:tasks.workunit.client.0.smithi157.stdout:2/825: mkdir d3/d2e/d65/d11a 0 2024-04-03T08:39:33.546 INFO:tasks.workunit.client.1.smithi181.stdout:3/768: write d0/d5/d77/fc8 [1019067,33507] 0 2024-04-03T08:39:33.548 INFO:tasks.workunit.client.1.smithi181.stdout:8/653: creat d4/d45/db/d14/d31/d1c/d51/fde x:0 0 0 2024-04-03T08:39:33.548 INFO:tasks.workunit.client.0.smithi157.stdout:9/884: truncate d1/d15/d16/d9f/fd7 139912 0 2024-04-03T08:39:33.551 INFO:tasks.workunit.client.1.smithi181.stdout:0/705: mkdir d5/dc/d75/de1 0 2024-04-03T08:39:33.557 INFO:tasks.workunit.client.1.smithi181.stdout:9/752: link d1/da/d28/d30/d3e/fa5 d1/da/d28/d30/d3e/d4e/d62/fe8 0 2024-04-03T08:39:33.558 INFO:tasks.workunit.client.1.smithi181.stdout:9/753: chown d1/da/d13/d22/d23 11 1 2024-04-03T08:39:33.559 INFO:tasks.workunit.client.1.smithi181.stdout:5/707: creat d4/d18/d55/db4/fe4 x:0 0 0 2024-04-03T08:39:33.559 INFO:tasks.workunit.client.0.smithi157.stdout:0/929: write d2/d9/d51/d63/f132 [3452554,42327] 0 2024-04-03T08:39:33.560 INFO:tasks.workunit.client.1.smithi181.stdout:5/708: fdatasync d4/d18/fb9 0 2024-04-03T08:39:33.563 INFO:tasks.workunit.client.1.smithi181.stdout:5/709: write d4/d22/d53/fdd [365680,118405] 0 2024-04-03T08:39:33.566 INFO:tasks.workunit.client.0.smithi157.stdout:8/850: creat d2/d11/d10/d24/d5b/d2e/dcf/dd2/f11f x:0 0 0 2024-04-03T08:39:33.568 INFO:tasks.workunit.client.0.smithi157.stdout:2/826: read - d3/fda zero size 2024-04-03T08:39:33.570 INFO:tasks.workunit.client.0.smithi157.stdout:2/827: dread - d3/fda zero size 2024-04-03T08:39:33.574 INFO:tasks.workunit.client.0.smithi157.stdout:6/857: dwrite d1/d5/d17/d2a/d37/dca/f117 [0,4194304] 0 2024-04-03T08:39:33.578 INFO:tasks.workunit.client.0.smithi157.stdout:4/786: mknod da/df/d2f/dbc/c10d 0 2024-04-03T08:39:33.581 INFO:tasks.workunit.client.0.smithi157.stdout:3/835: write d8/d1e/d2d/fc6 [500597,19239] 0 2024-04-03T08:39:33.582 INFO:tasks.workunit.client.1.smithi181.stdout:2/818: write d13/d1c/d6c/fda [110563,80919] 0 2024-04-03T08:39:33.583 INFO:tasks.workunit.client.1.smithi181.stdout:5/710: dread d4/d18/d25/db0/fbb [0,4194304] 0 2024-04-03T08:39:33.584 INFO:tasks.workunit.client.0.smithi157.stdout:0/930: creat d2/d9/dc/dbe/f149 x:0 0 0 2024-04-03T08:39:33.585 INFO:tasks.workunit.client.1.smithi181.stdout:5/711: read d4/f13 [1418181,82781] 0 2024-04-03T08:39:33.586 INFO:tasks.workunit.client.0.smithi157.stdout:7/865: link d0/d11/l12 d0/d11/d6f/d89/d8c/d103/da5/l12a 0 2024-04-03T08:39:33.589 INFO:tasks.workunit.client.0.smithi157.stdout:1/771: symlink d2/d11/d23/dc9/l104 0 2024-04-03T08:39:33.600 INFO:tasks.workunit.client.0.smithi157.stdout:3/836: symlink d8/d1e/d2d/d3b/d9e/l121 0 2024-04-03T08:39:33.607 INFO:tasks.workunit.client.0.smithi157.stdout:8/851: mknod d2/d20/df7/c120 0 2024-04-03T08:39:33.613 INFO:tasks.workunit.client.0.smithi157.stdout:4/787: mkdir da/d10e 0 2024-04-03T08:39:33.613 INFO:tasks.workunit.client.0.smithi157.stdout:7/866: write d0/d11/d15/d1b/db8/f3b [2972795,120612] 0 2024-04-03T08:39:33.615 INFO:tasks.workunit.client.0.smithi157.stdout:1/772: write d2/d11/d24/fb2 [929004,29723] 0 2024-04-03T08:39:33.618 INFO:tasks.workunit.client.1.smithi181.stdout:7/666: mkdir d0/d1/d6/de/d17/d27/d72/df4 0 2024-04-03T08:39:33.619 INFO:tasks.workunit.client.0.smithi157.stdout:1/773: chown d2/d11/d24/d39/d3b/d2e/c36 34 1 2024-04-03T08:39:33.622 INFO:tasks.workunit.client.0.smithi157.stdout:2/828: link d3/d2e/d32/d9f/fea d3/d2e/d32/d9f/f11b 0 2024-04-03T08:39:33.623 INFO:tasks.workunit.client.1.smithi181.stdout:4/757: mkdir d1/d16/d24/d5e/d31/d39/d5d/d9a/dfb 0 2024-04-03T08:39:33.624 INFO:tasks.workunit.client.0.smithi157.stdout:2/829: readlink d3/db/d44/d4c/d5a/d88/lc7 0 2024-04-03T08:39:33.624 INFO:tasks.workunit.client.1.smithi181.stdout:3/769: truncate d0/d5/d6/f4c 344260 0 2024-04-03T08:39:33.625 INFO:tasks.workunit.client.0.smithi157.stdout:9/885: getdents d1/d15/d27/daf/da7/d123/dbe 0 2024-04-03T08:39:33.626 INFO:tasks.workunit.client.1.smithi181.stdout:8/654: mknod d4/d45/db/d14/d31/d1c/d51/d87/db1/cdf 0 2024-04-03T08:39:33.628 INFO:tasks.workunit.client.0.smithi157.stdout:0/931: creat d2/d9/d5f/f14a x:0 0 0 2024-04-03T08:39:33.628 INFO:tasks.workunit.client.1.smithi181.stdout:7/667: dread d0/f50 [0,4194304] 0 2024-04-03T08:39:33.630 INFO:tasks.workunit.client.0.smithi157.stdout:4/788: fsync da/df/d2f/d54/f67 0 2024-04-03T08:39:33.641 INFO:tasks.workunit.client.1.smithi181.stdout:2/819: truncate d13/da7/d40/fbb 205265 0 2024-04-03T08:39:33.641 INFO:tasks.workunit.client.1.smithi181.stdout:6/758: dwrite d6/d31/d36/f44 [0,4194304] 0 2024-04-03T08:39:33.644 INFO:tasks.workunit.client.1.smithi181.stdout:1/721: link d10/d15/d17/d19/lc7 d10/d15/d17/d19/d33/d70/le7 0 2024-04-03T08:39:33.645 INFO:tasks.workunit.client.0.smithi157.stdout:9/886: symlink d1/d4a/d4d/dd6/l125 0 2024-04-03T08:39:33.648 INFO:tasks.workunit.client.1.smithi181.stdout:4/758: creat d1/d16/d24/d5e/d3f/d6c/dcd/ffc x:0 0 0 2024-04-03T08:39:33.651 INFO:tasks.workunit.client.1.smithi181.stdout:5/712: write d4/d44/f5f [495498,35504] 0 2024-04-03T08:39:33.652 INFO:tasks.workunit.client.1.smithi181.stdout:0/706: dwrite d5/d9/f7f [0,4194304] 0 2024-04-03T08:39:33.654 INFO:tasks.workunit.client.0.smithi157.stdout:3/837: link d8/d1e/d2d/d39/lda d8/d1e/d2d/d39/d51/d7e/l122 0 2024-04-03T08:39:33.661 INFO:tasks.workunit.client.0.smithi157.stdout:7/867: getdents d0/d11/d15/d1b/df6 0 2024-04-03T08:39:33.661 INFO:tasks.workunit.client.0.smithi157.stdout:0/932: write d2/d9/d36/fee [4829277,108339] 0 2024-04-03T08:39:33.663 INFO:tasks.workunit.client.1.smithi181.stdout:4/759: dwrite d1/d16/f23 [0,4194304] 0 2024-04-03T08:39:33.664 INFO:tasks.workunit.client.0.smithi157.stdout:2/830: link d3/d12/d43/d4b/d55/d10c/f118 d3/db/d44/d4c/d5a/d88/df6/f11c 0 2024-04-03T08:39:33.665 INFO:tasks.workunit.client.0.smithi157.stdout:1/774: dwrite d2/d11/d23/f8c [0,4194304] 0 2024-04-03T08:39:33.667 INFO:tasks.workunit.client.1.smithi181.stdout:6/759: mknod d6/dc0/cf0 0 2024-04-03T08:39:33.668 INFO:tasks.workunit.client.1.smithi181.stdout:6/760: readlink d6/d7b/lc2 0 2024-04-03T08:39:33.670 INFO:tasks.workunit.client.0.smithi157.stdout:9/887: symlink d1/d15/d27/daf/da7/d123/l126 0 2024-04-03T08:39:33.673 INFO:tasks.workunit.client.0.smithi157.stdout:2/831: dread d3/d2e/d32/d9f/f11b [0,4194304] 0 2024-04-03T08:39:33.673 INFO:tasks.workunit.client.1.smithi181.stdout:3/770: write d0/d5/d6/dd/d25/d50/fcb [5134448,48820] 0 2024-04-03T08:39:33.678 INFO:tasks.workunit.client.0.smithi157.stdout:8/852: getdents d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119 0 2024-04-03T08:39:33.683 INFO:tasks.workunit.client.0.smithi157.stdout:7/868: creat d0/d11/d15/d17/d1c/da1/f12b x:0 0 0 2024-04-03T08:39:33.684 INFO:tasks.workunit.client.0.smithi157.stdout:0/933: mknod d2/d9/dc/df/d1b/d4a/de4/df1/c14b 0 2024-04-03T08:39:33.684 INFO:tasks.workunit.client.1.smithi181.stdout:5/713: chown d4/l15 1856955 1 2024-04-03T08:39:33.687 INFO:tasks.workunit.client.1.smithi181.stdout:5/714: write d4/d44/f5f [1979964,58529] 0 2024-04-03T08:39:33.687 INFO:tasks.workunit.client.0.smithi157.stdout:1/775: mknod d2/d11/d23/dc9/d58/d62/c105 0 2024-04-03T08:39:33.688 INFO:tasks.workunit.client.0.smithi157.stdout:9/888: creat d1/d4a/d4d/dd6/f127 x:0 0 0 2024-04-03T08:39:33.689 INFO:tasks.workunit.client.1.smithi181.stdout:0/707: rmdir d5/d9/d2e 39 2024-04-03T08:39:33.690 INFO:tasks.workunit.client.1.smithi181.stdout:8/655: dwrite d4/d45/d96/fa9 [0,4194304] 0 2024-04-03T08:39:33.694 INFO:tasks.workunit.client.0.smithi157.stdout:2/832: readlink d3/d2e/d32/l8e 0 2024-04-03T08:39:33.694 INFO:tasks.workunit.client.1.smithi181.stdout:9/754: creat d1/da/d13/d22/d23/d36/fe9 x:0 0 0 2024-04-03T08:39:33.695 INFO:tasks.workunit.client.0.smithi157.stdout:9/889: write d1/d4a/d4d/f80 [1053015,41391] 0 2024-04-03T08:39:33.695 INFO:tasks.workunit.client.1.smithi181.stdout:8/656: truncate d4/d45/d96/fa9 4246503 0 2024-04-03T08:39:33.696 INFO:tasks.workunit.client.0.smithi157.stdout:8/853: dread - d2/d6f/d70/d89/fba zero size 2024-04-03T08:39:33.697 INFO:tasks.workunit.client.1.smithi181.stdout:4/760: truncate d1/d16/d55/f62 575054 0 2024-04-03T08:39:33.700 INFO:tasks.workunit.client.1.smithi181.stdout:4/761: chown d1/d16/d37/d34/d86 36356254 1 2024-04-03T08:39:33.703 INFO:tasks.workunit.client.0.smithi157.stdout:0/934: dread d2/d9/f110 [0,4194304] 0 2024-04-03T08:39:33.706 INFO:tasks.workunit.client.0.smithi157.stdout:7/869: symlink d0/d11/d15/d17/d1c/d4f/d5f/l12c 0 2024-04-03T08:39:33.706 INFO:tasks.workunit.client.1.smithi181.stdout:5/715: dread d4/f5 [0,4194304] 0 2024-04-03T08:39:33.707 INFO:tasks.workunit.client.0.smithi157.stdout:4/789: dwrite da/df/d2f/d64/d8f/dbd/f5b [0,4194304] 0 2024-04-03T08:39:33.708 INFO:tasks.workunit.client.0.smithi157.stdout:3/838: getdents d8/d1e/d2d/d3b/d9e/df9 0 2024-04-03T08:39:33.709 INFO:tasks.workunit.client.1.smithi181.stdout:1/722: dwrite d10/d15/d4a/fa9 [0,4194304] 0 2024-04-03T08:39:33.712 INFO:tasks.workunit.client.1.smithi181.stdout:0/708: creat d5/d9/d2c/dcc/fe2 x:0 0 0 2024-04-03T08:39:33.714 INFO:tasks.workunit.client.1.smithi181.stdout:0/709: chown d5/dc/d10/d58/d6c/fb7 14 1 2024-04-03T08:39:33.715 INFO:tasks.workunit.client.1.smithi181.stdout:8/657: mkdir d4/d45/db/d14/d31/d1c/d51/d87/de0 0 2024-04-03T08:39:33.715 INFO:tasks.workunit.client.0.smithi157.stdout:7/870: write d0/d11/d15/d17/d1c/d88/fc5 [3753676,74271] 0 2024-04-03T08:39:33.717 INFO:tasks.workunit.client.0.smithi157.stdout:0/935: mknod d2/d9/d51/c14c 0 2024-04-03T08:39:33.719 INFO:tasks.workunit.client.1.smithi181.stdout:4/762: unlink d1/d16/d24/d5e/d31/d39/da1/cad 0 2024-04-03T08:39:33.722 INFO:tasks.workunit.client.1.smithi181.stdout:6/761: mknod d6/d31/dbe/cf1 0 2024-04-03T08:39:33.725 INFO:tasks.workunit.client.0.smithi157.stdout:7/871: dread - d0/d11/d15/d17/d43/fc9 zero size 2024-04-03T08:39:33.727 INFO:tasks.workunit.client.0.smithi157.stdout:0/936: write d2/d9/d51/d63/f132 [3557944,68186] 0 2024-04-03T08:39:33.727 INFO:tasks.workunit.client.1.smithi181.stdout:3/771: rename d0/d17/d40/l8b to d0/d17/d63/df8/l104 0 2024-04-03T08:39:33.730 INFO:tasks.workunit.client.1.smithi181.stdout:3/772: write d0/d5/d6f/ff9 [1031297,45354] 0 2024-04-03T08:39:33.732 INFO:tasks.workunit.client.0.smithi157.stdout:9/890: dwrite d1/d15/d27/daf/da7/fbb [0,4194304] 0 2024-04-03T08:39:33.736 INFO:tasks.workunit.client.1.smithi181.stdout:1/723: creat d10/d15/d41/fe8 x:0 0 0 2024-04-03T08:39:33.738 INFO:tasks.workunit.client.1.smithi181.stdout:1/724: dread - d10/d15/d17/d19/d33/d70/fdd zero size 2024-04-03T08:39:33.740 INFO:tasks.workunit.client.0.smithi157.stdout:4/790: mkdir da/df/d2f/d64/d8f/dbd/d68/d10f 0 2024-04-03T08:39:33.744 INFO:tasks.workunit.client.0.smithi157.stdout:8/854: dread d2/d11/d10/d24/d5b/f1c [0,4194304] 0 2024-04-03T08:39:33.744 INFO:tasks.workunit.client.0.smithi157.stdout:4/791: dread - da/df/d11/f82 zero size 2024-04-03T08:39:33.745 INFO:tasks.workunit.client.0.smithi157.stdout:3/839: mkdir d8/d1e/d2d/d123 0 2024-04-03T08:39:33.746 INFO:tasks.workunit.client.0.smithi157.stdout:8/855: stat d2/d6f/db5/lf9 0 2024-04-03T08:39:33.747 INFO:tasks.workunit.client.1.smithi181.stdout:9/755: dwrite d1/da/d28/d30/d3e/d4e/da3/fad [0,4194304] 0 2024-04-03T08:39:33.749 INFO:tasks.workunit.client.0.smithi157.stdout:1/776: link d2/d11/d24/d39/d3b/d1b/d7f/c83 d2/d11/d24/d39/d3b/d1b/d84/c106 0 2024-04-03T08:39:33.752 INFO:tasks.workunit.client.0.smithi157.stdout:2/833: getdents d3/d12/d43/d4b/d55 0 2024-04-03T08:39:33.752 INFO:tasks.workunit.client.0.smithi157.stdout:9/891: fdatasync d1/d15/d27/daf/da7/d123/d75/fdf 0 2024-04-03T08:39:33.753 INFO:tasks.workunit.client.1.smithi181.stdout:8/658: dread d4/d44/f5b [4194304,4194304] 0 2024-04-03T08:39:33.754 INFO:tasks.workunit.client.0.smithi157.stdout:7/872: rename d0/d11/d15/d17/d43 to d0/d11/d6f/d89/d8c/d103/de3/d12d 0 2024-04-03T08:39:33.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/716: rename d4/d18/d25/d68/d77/dab to d4/d80/de5 0 2024-04-03T08:39:33.757 INFO:tasks.workunit.client.1.smithi181.stdout:3/773: mkdir d0/d17/d36/d3b/d5a/d93/d105 0 2024-04-03T08:39:33.758 INFO:tasks.workunit.client.1.smithi181.stdout:1/725: mknod d10/d15/d4a/d86/ce9 0 2024-04-03T08:39:33.759 INFO:tasks.workunit.client.0.smithi157.stdout:0/937: symlink d2/d9/d5f/d105/l14d 0 2024-04-03T08:39:33.760 INFO:tasks.workunit.client.1.smithi181.stdout:7/668: link d0/d1/d6/de/d17/d27/ld0 d0/d1/d6/lf5 0 2024-04-03T08:39:33.761 INFO:tasks.workunit.client.0.smithi157.stdout:8/856: chown d2/d11/d10/d24/d5b/d2e/d75/d81/fd0 264695142 1 2024-04-03T08:39:33.762 INFO:tasks.workunit.client.1.smithi181.stdout:7/669: chown d0/d1/d6/de/ld6 1736174854 1 2024-04-03T08:39:33.763 INFO:tasks.workunit.client.0.smithi157.stdout:8/857: dread - d2/d6f/d70/d89/fba zero size 2024-04-03T08:39:33.765 INFO:tasks.workunit.client.1.smithi181.stdout:4/763: getdents d1/d16/d24/d5e/d31/dba/ddd/de0 0 2024-04-03T08:39:33.767 INFO:tasks.workunit.client.0.smithi157.stdout:4/792: mknod da/df/d11/c110 0 2024-04-03T08:39:33.768 INFO:tasks.workunit.client.1.smithi181.stdout:6/762: symlink d6/d31/d36/dba/da6/d4f/dd1/d9/dd9/lf2 0 2024-04-03T08:39:33.770 INFO:tasks.workunit.client.0.smithi157.stdout:3/840: mkdir d8/d1e/d2d/d3b/d9e/dcd/d124 0 2024-04-03T08:39:33.772 INFO:tasks.workunit.client.1.smithi181.stdout:8/659: mknod d4/d45/d9/d70/ce1 0 2024-04-03T08:39:33.776 INFO:tasks.workunit.client.1.smithi181.stdout:3/774: unlink d0/d5/d77/f8f 0 2024-04-03T08:39:33.778 INFO:tasks.workunit.client.0.smithi157.stdout:9/892: dread d1/d15/d27/f49 [0,4194304] 0 2024-04-03T08:39:33.778 INFO:tasks.workunit.client.1.smithi181.stdout:3/775: write d0/d17/d36/d3b/d5a/f97 [1040526,77994] 0 2024-04-03T08:39:33.778 INFO:tasks.workunit.client.1.smithi181.stdout:5/717: creat d4/d18/d55/db4/d96/fe6 x:0 0 0 2024-04-03T08:39:33.780 INFO:tasks.workunit.client.1.smithi181.stdout:3/776: stat d0/d5/d6f/l70 0 2024-04-03T08:39:33.782 INFO:tasks.workunit.client.1.smithi181.stdout:3/777: dread - d0/d17/f26 zero size 2024-04-03T08:39:33.786 INFO:tasks.workunit.client.1.smithi181.stdout:9/756: creat d1/da/d13/d22/d23/d36/d91/d9d/daa/fea x:0 0 0 2024-04-03T08:39:33.787 INFO:tasks.workunit.client.1.smithi181.stdout:9/757: write d1/fe1 [710737,58050] 0 2024-04-03T08:39:33.794 INFO:tasks.workunit.client.1.smithi181.stdout:8/660: fsync d4/f5 0 2024-04-03T08:39:33.794 INFO:tasks.workunit.client.1.smithi181.stdout:0/710: dwrite d5/f40 [0,4194304] 0 2024-04-03T08:39:33.795 INFO:tasks.workunit.client.0.smithi157.stdout:4/793: rename da/df/lc3 to da/df/d24/d35/d6a/d78/l111 0 2024-04-03T08:39:33.796 INFO:tasks.workunit.client.0.smithi157.stdout:7/873: unlink d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/c7a 0 2024-04-03T08:39:33.796 INFO:tasks.workunit.client.0.smithi157.stdout:1/777: write d2/d11/d23/dc9/d58/d62/f95 [17551,26101] 0 2024-04-03T08:39:33.796 INFO:tasks.workunit.client.0.smithi157.stdout:9/893: creat d1/d4a/d4d/d86/f128 x:0 0 0 2024-04-03T08:39:33.797 INFO:tasks.workunit.client.1.smithi181.stdout:8/661: write d4/d44/d59/d5f/d6c/fd3 [166261,29503] 0 2024-04-03T08:39:33.799 INFO:tasks.workunit.client.0.smithi157.stdout:7/874: stat d0/d11/d6f/d89/d8c/d103/d8e/d96/ce7 0 2024-04-03T08:39:33.800 INFO:tasks.workunit.client.0.smithi157.stdout:1/778: stat d2/d11/d24/d39/d3b/d1b/fcd 0 2024-04-03T08:39:33.804 INFO:tasks.workunit.client.1.smithi181.stdout:5/718: unlink d4/d44/d71/c95 0 2024-04-03T08:39:33.807 INFO:tasks.workunit.client.1.smithi181.stdout:5/719: truncate d4/d18/d25/d68/d77/fc9 784267 0 2024-04-03T08:39:33.807 INFO:tasks.workunit.client.0.smithi157.stdout:0/938: symlink d2/d9/dc/df/d6f/d9d/d6a/d91/d10b/d146/l14e 0 2024-04-03T08:39:33.808 INFO:tasks.workunit.client.1.smithi181.stdout:3/778: mkdir d0/d17/d63/df8/d106 0 2024-04-03T08:39:33.814 INFO:tasks.workunit.client.1.smithi181.stdout:4/764: mkdir d1/d16/d24/d5e/d31/d39/df0/dfd 0 2024-04-03T08:39:33.815 INFO:tasks.workunit.client.0.smithi157.stdout:3/841: dwrite d8/f62 [0,4194304] 0 2024-04-03T08:39:33.817 INFO:tasks.workunit.client.1.smithi181.stdout:6/763: creat d6/dc0/dd2/ff3 x:0 0 0 2024-04-03T08:39:33.820 INFO:tasks.workunit.client.1.smithi181.stdout:0/711: symlink d5/dc/d14/d29/le3 0 2024-04-03T08:39:33.822 INFO:tasks.workunit.client.1.smithi181.stdout:8/662: mknod d4/d2a/d37/d67/ce2 0 2024-04-03T08:39:33.823 INFO:tasks.workunit.client.1.smithi181.stdout:0/712: stat d5/d9/d2a/f4f 0 2024-04-03T08:39:33.823 INFO:tasks.workunit.client.0.smithi157.stdout:8/858: dwrite d2/d6f/fd1 [0,4194304] 0 2024-04-03T08:39:33.823 INFO:tasks.workunit.client.1.smithi181.stdout:8/663: stat d4/d44/f82 0 2024-04-03T08:39:33.824 INFO:tasks.workunit.client.1.smithi181.stdout:1/726: rename d10/d15/d17/l5f to d10/d15/d17/lea 0 2024-04-03T08:39:33.826 INFO:tasks.workunit.client.1.smithi181.stdout:8/664: dread - d4/d45/d9/f89 zero size 2024-04-03T08:39:33.831 INFO:tasks.workunit.client.1.smithi181.stdout:3/779: unlink d0/d5/fa 0 2024-04-03T08:39:33.832 INFO:tasks.workunit.client.1.smithi181.stdout:4/765: dwrite d1/d1e/d2c/f77 [4194304,4194304] 0 2024-04-03T08:39:33.834 INFO:tasks.workunit.client.1.smithi181.stdout:7/670: link d0/d1/c8f d0/d1/d6/de/d17/d27/d93/cf6 0 2024-04-03T08:39:33.838 INFO:tasks.workunit.client.1.smithi181.stdout:9/758: mkdir d1/da/d13/deb 0 2024-04-03T08:39:33.841 INFO:tasks.workunit.client.1.smithi181.stdout:9/759: write d1/da/d13/d41/fa9 [1285856,77637] 0 2024-04-03T08:39:33.842 INFO:tasks.workunit.client.1.smithi181.stdout:9/760: stat d1/da/d13/d22 0 2024-04-03T08:39:33.845 INFO:tasks.workunit.client.1.smithi181.stdout:0/713: creat d5/dc/d75/fe4 x:0 0 0 2024-04-03T08:39:33.851 INFO:tasks.workunit.client.1.smithi181.stdout:3/780: symlink d0/d5/d77/l107 0 2024-04-03T08:39:33.854 INFO:tasks.workunit.client.0.smithi157.stdout:5/886: sync 2024-04-03T08:39:33.855 INFO:tasks.workunit.client.1.smithi181.stdout:7/671: creat d0/d1/d6/de/da3/ff7 x:0 0 0 2024-04-03T08:39:33.858 INFO:tasks.workunit.client.1.smithi181.stdout:7/672: chown d0/le3 26 1 2024-04-03T08:39:33.858 INFO:tasks.workunit.client.1.smithi181.stdout:5/720: dwrite d4/d18/d55/db4/fa0 [0,4194304] 0 2024-04-03T08:39:33.865 INFO:tasks.workunit.client.1.smithi181.stdout:7/673: write d0/d1/d6/de/d17/d64/d85/d9a/da4/fc2 [1678975,58576] 0 2024-04-03T08:39:33.869 INFO:tasks.workunit.client.1.smithi181.stdout:9/761: dread d1/da/d1a/f56 [0,4194304] 0 2024-04-03T08:39:33.870 INFO:tasks.workunit.client.1.smithi181.stdout:4/766: symlink d1/d16/d24/d5e/d31/d39/df0/dfd/lfe 0 2024-04-03T08:39:33.872 INFO:tasks.workunit.client.1.smithi181.stdout:8/665: dwrite d4/d45/db/f8c [0,4194304] 0 2024-04-03T08:39:33.872 INFO:tasks.workunit.client.1.smithi181.stdout:9/762: stat d1/da/d28/d30/d3e/d4e/f68 0 2024-04-03T08:39:33.874 INFO:tasks.workunit.client.1.smithi181.stdout:1/727: dread d10/d15/d17/d19/d33/f6a [0,4194304] 0 2024-04-03T08:39:33.875 INFO:tasks.workunit.client.1.smithi181.stdout:5/721: mkdir d4/d18/d25/de7 0 2024-04-03T08:39:33.881 INFO:tasks.workunit.client.1.smithi181.stdout:6/764: link d6/d31/d36/c27 d6/d9e/cf4 0 2024-04-03T08:39:33.885 INFO:tasks.workunit.client.1.smithi181.stdout:4/767: dread d1/d16/f13 [0,4194304] 0 2024-04-03T08:39:33.892 INFO:tasks.workunit.client.1.smithi181.stdout:3/781: write d0/d5/d6/f4c [786646,20402] 0 2024-04-03T08:39:33.893 INFO:tasks.workunit.client.1.smithi181.stdout:8/666: symlink d4/d45/d9/le3 0 2024-04-03T08:39:33.898 INFO:tasks.workunit.client.1.smithi181.stdout:4/768: creat d1/d16/d24/d5e/d3f/d6c/dcd/fff x:0 0 0 2024-04-03T08:39:33.898 INFO:tasks.workunit.client.1.smithi181.stdout:9/763: creat d1/da/d1a/fec x:0 0 0 2024-04-03T08:39:33.899 INFO:tasks.workunit.client.0.smithi157.stdout:9/894: fsync d1/d15/d27/d5c/d79/f9d 0 2024-04-03T08:39:33.899 INFO:tasks.workunit.client.1.smithi181.stdout:7/674: dread d0/d1/f15 [4194304,4194304] 0 2024-04-03T08:39:33.900 INFO:tasks.workunit.client.0.smithi157.stdout:1/779: creat d2/d11/d23/dc9/d58/d94/da3/f107 x:0 0 0 2024-04-03T08:39:33.902 INFO:tasks.workunit.client.0.smithi157.stdout:6/858: sync 2024-04-03T08:39:33.902 INFO:tasks.workunit.client.1.smithi181.stdout:8/667: chown d4/d45/db/d14/d31/d1c/d51/lad 175786266 1 2024-04-03T08:39:33.905 INFO:tasks.workunit.client.0.smithi157.stdout:2/834: getdents d3/db/d44/d4c/d5a/d88 0 2024-04-03T08:39:33.905 INFO:tasks.workunit.client.1.smithi181.stdout:8/668: stat d4/d45/d9/d70/l7b 0 2024-04-03T08:39:33.906 INFO:tasks.workunit.client.1.smithi181.stdout:3/782: truncate d0/d5/d6/d32/daa/fc6 169946 0 2024-04-03T08:39:33.906 INFO:tasks.workunit.client.1.smithi181.stdout:8/669: chown d4/d2a/d37/lc2 2352 1 2024-04-03T08:39:33.909 INFO:tasks.workunit.client.1.smithi181.stdout:9/764: mknod d1/da/d28/d80/ced 0 2024-04-03T08:39:33.909 INFO:tasks.workunit.client.0.smithi157.stdout:0/939: unlink d2/d9/d51/d63/d71/fe7 0 2024-04-03T08:39:33.912 INFO:tasks.workunit.client.1.smithi181.stdout:9/765: fdatasync d1/da/d28/d80/dd3/fd4 0 2024-04-03T08:39:33.913 INFO:tasks.workunit.client.1.smithi181.stdout:7/675: read d0/d1/d6/de/d17/d64/d85/d9a/da4/fab [3586147,90605] 0 2024-04-03T08:39:33.913 INFO:tasks.workunit.client.0.smithi157.stdout:3/842: fsync d8/d13/d1b/dc4/fcc 0 2024-04-03T08:39:33.914 INFO:tasks.workunit.client.1.smithi181.stdout:4/769: dwrite d1/d16/d24/d5e/d2b/db9/fe7 [0,4194304] 0 2024-04-03T08:39:33.914 INFO:tasks.workunit.client.1.smithi181.stdout:5/722: dread d4/d22/f38 [0,4194304] 0 2024-04-03T08:39:33.918 INFO:tasks.workunit.client.0.smithi157.stdout:8/859: creat d2/d6f/d70/f121 x:0 0 0 2024-04-03T08:39:33.919 INFO:tasks.workunit.client.1.smithi181.stdout:8/670: unlink d4/d45/f71 0 2024-04-03T08:39:33.919 INFO:tasks.workunit.client.1.smithi181.stdout:8/671: stat d4/d2a/cba 0 2024-04-03T08:39:33.919 INFO:tasks.workunit.client.1.smithi181.stdout:1/728: write d10/d15/d17/f94 [408937,60173] 0 2024-04-03T08:39:33.920 INFO:tasks.workunit.client.0.smithi157.stdout:8/860: fsync d2/d11/d10/d24/d5b/d2e/d75/d81/f104 0 2024-04-03T08:39:33.922 INFO:tasks.workunit.client.0.smithi157.stdout:5/887: rename dc/d29/d56/d87/fd3 to dc/dce/d112/f128 0 2024-04-03T08:39:33.923 INFO:tasks.workunit.client.1.smithi181.stdout:6/765: write d6/d31/d36/dba/da6/d4f/d77/fbf [1030133,45851] 0 2024-04-03T08:39:33.931 INFO:tasks.workunit.client.1.smithi181.stdout:9/766: fsync d1/da/d13/d41/d32/f3f 0 2024-04-03T08:39:33.933 INFO:tasks.workunit.client.1.smithi181.stdout:9/767: write d1/da/d1a/fec [416313,70115] 0 2024-04-03T08:39:33.933 INFO:tasks.workunit.client.0.smithi157.stdout:5/888: dread dc/d29/d56/d52/d9d/f111 [0,4194304] 0 2024-04-03T08:39:33.934 INFO:tasks.workunit.client.1.smithi181.stdout:9/768: chown d1/c9 49007 1 2024-04-03T08:39:33.936 INFO:tasks.workunit.client.1.smithi181.stdout:9/769: chown d1/da/d13/d22/d23/d36/d91/d9d 94281361 1 2024-04-03T08:39:33.938 INFO:tasks.workunit.client.0.smithi157.stdout:7/875: mkdir d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/d12e 0 2024-04-03T08:39:33.941 INFO:tasks.workunit.client.1.smithi181.stdout:3/783: mknod d0/d5/d6/dd/d25/c108 0 2024-04-03T08:39:33.943 INFO:tasks.workunit.client.1.smithi181.stdout:8/672: creat d4/d45/db/d14/d31/d1c/d51/fe4 x:0 0 0 2024-04-03T08:39:33.945 INFO:tasks.workunit.client.0.smithi157.stdout:0/940: unlink d2/d9/dc/df/l4e 0 2024-04-03T08:39:33.946 INFO:tasks.workunit.client.1.smithi181.stdout:5/723: write d4/d18/f83 [3955575,43891] 0 2024-04-03T08:39:33.950 INFO:tasks.workunit.client.0.smithi157.stdout:3/843: creat d8/d1e/d2d/d39/d51/d48/f125 x:0 0 0 2024-04-03T08:39:33.951 INFO:tasks.workunit.client.0.smithi157.stdout:3/844: stat d8/d1e/d2d/d3b/d9e/df9/l10b 0 2024-04-03T08:39:33.953 INFO:tasks.workunit.client.0.smithi157.stdout:8/861: creat d2/d11/d10/d24/d5b/d2e/d75/d81/f122 x:0 0 0 2024-04-03T08:39:33.956 INFO:tasks.workunit.client.1.smithi181.stdout:3/784: creat d0/d17/d36/d3b/f109 x:0 0 0 2024-04-03T08:39:33.957 INFO:tasks.workunit.client.0.smithi157.stdout:4/794: creat da/df/f112 x:0 0 0 2024-04-03T08:39:33.958 INFO:tasks.workunit.client.1.smithi181.stdout:3/785: chown d0/d17/d63/d81/f94 1245818 1 2024-04-03T08:39:33.959 INFO:tasks.workunit.client.0.smithi157.stdout:2/835: dwrite d3/f6c [0,4194304] 0 2024-04-03T08:39:33.959 INFO:tasks.workunit.client.0.smithi157.stdout:9/895: unlink d1/d4a/l117 0 2024-04-03T08:39:33.959 INFO:tasks.workunit.client.1.smithi181.stdout:6/766: dwrite d6/d31/d36/dba/da6/d4f/dd1/d9/f28 [0,4194304] 0 2024-04-03T08:39:33.959 INFO:tasks.workunit.client.1.smithi181.stdout:8/673: dread - d4/d45/d9/fa4 zero size 2024-04-03T08:39:33.961 INFO:tasks.workunit.client.0.smithi157.stdout:5/889: unlink dc/f12 0 2024-04-03T08:39:33.965 INFO:tasks.workunit.client.1.smithi181.stdout:6/767: truncate d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/f6a 2382919 0 2024-04-03T08:39:33.965 INFO:tasks.workunit.client.0.smithi157.stdout:6/859: symlink d1/d5/d17/d2a/d40/l128 0 2024-04-03T08:39:33.967 INFO:tasks.workunit.client.1.smithi181.stdout:6/768: write d6/d31/d36/f44 [4545911,100156] 0 2024-04-03T08:39:33.970 INFO:tasks.workunit.client.0.smithi157.stdout:0/941: rename d2/d9/dc/df/d1b/d35/d3d/c8f to d2/d9/d51/c14f 0 2024-04-03T08:39:33.971 INFO:tasks.workunit.client.1.smithi181.stdout:7/676: rename d0/d1/d6/de/lf to d0/d1/d6/de/d17/lf8 0 2024-04-03T08:39:33.974 INFO:tasks.workunit.client.1.smithi181.stdout:8/674: mknod d4/d44/d59/ce5 0 2024-04-03T08:39:33.981 INFO:tasks.workunit.client.0.smithi157.stdout:9/896: unlink d1/d4a/d4d/f95 0 2024-04-03T08:39:33.982 INFO:tasks.workunit.client.1.smithi181.stdout:7/677: fdatasync d0/f2f 0 2024-04-03T08:39:33.984 INFO:tasks.workunit.client.0.smithi157.stdout:2/836: read d3/d12/f7c [1254538,109289] 0 2024-04-03T08:39:33.988 INFO:tasks.workunit.client.0.smithi157.stdout:5/890: creat dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/ddb/f129 x:0 0 0 2024-04-03T08:39:33.989 INFO:tasks.workunit.client.0.smithi157.stdout:5/891: fsync dc/d29/d56/d52/f120 0 2024-04-03T08:39:33.990 INFO:tasks.workunit.client.1.smithi181.stdout:8/675: rename d4/d2a/f83 to d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/fe6 0 2024-04-03T08:39:33.991 INFO:tasks.workunit.client.0.smithi157.stdout:6/860: mkdir d1/d5/d17/d29/da7/d129 0 2024-04-03T08:39:33.993 INFO:tasks.workunit.client.1.smithi181.stdout:8/676: chown d4/d45/db/d14/d31/d1c/d51/d87/db1/cdf 397150703 1 2024-04-03T08:39:33.993 INFO:tasks.workunit.client.0.smithi157.stdout:3/845: mknod d8/d1e/d2d/d39/d51/d48/dab/dee/c126 0 2024-04-03T08:39:33.995 INFO:tasks.workunit.client.1.smithi181.stdout:8/677: dread - d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fc7 zero size 2024-04-03T08:39:33.995 INFO:tasks.workunit.client.0.smithi157.stdout:0/942: symlink d2/d9/dc/df/d6f/d9d/d6a/d91/d10b/d146/l150 0 2024-04-03T08:39:33.996 INFO:tasks.workunit.client.1.smithi181.stdout:1/729: link d10/c51 d10/d15/d17/d23/ceb 0 2024-04-03T08:39:33.997 INFO:tasks.workunit.client.1.smithi181.stdout:8/678: dread - d4/d45/db/d14/d31/d1c/d51/fde zero size 2024-04-03T08:39:33.999 INFO:tasks.workunit.client.1.smithi181.stdout:7/678: symlink d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/lf9 0 2024-04-03T08:39:33.999 INFO:tasks.workunit.client.1.smithi181.stdout:8/679: write d4/d45/db/d14/d31/f54 [4075580,99627] 0 2024-04-03T08:39:34.002 INFO:tasks.workunit.client.0.smithi157.stdout:9/897: fdatasync d1/d15/d27/daf/da7/d123/fc3 0 2024-04-03T08:39:34.006 INFO:tasks.workunit.client.1.smithi181.stdout:1/730: rmdir d10/d15/d41 39 2024-04-03T08:39:34.008 INFO:tasks.workunit.client.1.smithi181.stdout:5/724: dwrite d4/d22/d4a/f5d [0,4194304] 0 2024-04-03T08:39:34.010 INFO:tasks.workunit.client.1.smithi181.stdout:1/731: write d10/d15/d17/d19/d33/d70/fdd [354633,21348] 0 2024-04-03T08:39:34.012 INFO:tasks.workunit.client.1.smithi181.stdout:7/679: fsync d0/d1/d6/de/d17/f2c 0 2024-04-03T08:39:34.016 INFO:tasks.workunit.client.0.smithi157.stdout:4/795: dwrite da/df/d2f/fc0 [0,4194304] 0 2024-04-03T08:39:34.016 INFO:tasks.workunit.client.1.smithi181.stdout:6/769: dwrite d6/f3a [0,4194304] 0 2024-04-03T08:39:34.020 INFO:tasks.workunit.client.1.smithi181.stdout:3/786: link d0/d17/d36/d3b/d5a/d93/ca4 d0/dbc/c10a 0 2024-04-03T08:39:34.021 INFO:tasks.workunit.client.0.smithi157.stdout:6/861: rmdir d1/d5/d17/d2a/d40/dec/d92 39 2024-04-03T08:39:34.027 INFO:tasks.workunit.client.1.smithi181.stdout:5/725: symlink d4/d18/d25/d59/db3/dd0/le8 0 2024-04-03T08:39:34.028 INFO:tasks.workunit.client.0.smithi157.stdout:8/862: creat d2/d11/f123 x:0 0 0 2024-04-03T08:39:34.037 INFO:tasks.workunit.client.0.smithi157.stdout:7/876: symlink d0/d11/l12f 0 2024-04-03T08:39:34.040 INFO:tasks.workunit.client.0.smithi157.stdout:6/862: dwrite d1/d4b/da5/f120 [0,4194304] 0 2024-04-03T08:39:34.043 INFO:tasks.workunit.client.0.smithi157.stdout:5/892: mkdir dc/d29/d56/da4/d12a 0 2024-04-03T08:39:34.044 INFO:tasks.workunit.client.1.smithi181.stdout:1/732: unlink d10/d15/d4a/d86/cdc 0 2024-04-03T08:39:34.045 INFO:tasks.workunit.client.1.smithi181.stdout:7/680: symlink d0/d1/d6/de/d17/d27/lfa 0 2024-04-03T08:39:34.046 INFO:tasks.workunit.client.0.smithi157.stdout:4/796: creat da/df/d6b/f113 x:0 0 0 2024-04-03T08:39:34.048 INFO:tasks.workunit.client.0.smithi157.stdout:3/846: creat d8/d1e/d2d/d39/d51/d7e/db1/df5/f127 x:0 0 0 2024-04-03T08:39:34.049 INFO:tasks.workunit.client.0.smithi157.stdout:0/943: getdents d2/d9/dc/d54/d143 0 2024-04-03T08:39:34.051 INFO:tasks.workunit.client.1.smithi181.stdout:6/770: link d6/d31/d36/dba/da6/d4f/dd1/f3f d6/d31/ff5 0 2024-04-03T08:39:34.055 INFO:tasks.workunit.client.0.smithi157.stdout:8/863: symlink d2/d11/d10/d24/d5b/d2e/d75/da9/l124 0 2024-04-03T08:39:34.057 INFO:tasks.workunit.client.1.smithi181.stdout:3/787: write d0/d5/d6/dd/d25/f44 [3823139,116699] 0 2024-04-03T08:39:34.061 INFO:tasks.workunit.client.0.smithi157.stdout:9/898: mkdir d1/d15/d27/daf/d129 0 2024-04-03T08:39:34.063 INFO:tasks.workunit.client.1.smithi181.stdout:8/680: getdents d4/d44/d59/d5f 0 2024-04-03T08:39:34.063 INFO:tasks.workunit.client.1.smithi181.stdout:2/820: sync 2024-04-03T08:39:34.064 INFO:tasks.workunit.client.1.smithi181.stdout:5/726: dwrite d4/d22/d4a/f5b [0,4194304] 0 2024-04-03T08:39:34.064 INFO:tasks.workunit.client.1.smithi181.stdout:8/681: fsync d4/d45/db/fd 0 2024-04-03T08:39:34.065 INFO:tasks.workunit.client.0.smithi157.stdout:6/863: rmdir d1/d5/d17/d29/d80 39 2024-04-03T08:39:34.068 INFO:tasks.workunit.client.1.smithi181.stdout:6/771: fdatasync d6/d31/d36/dba/da6/d4f/d77/d8b/fbd 0 2024-04-03T08:39:34.071 INFO:tasks.workunit.client.1.smithi181.stdout:6/772: write d6/d3e/d40/fb3 [776214,104955] 0 2024-04-03T08:39:34.074 INFO:tasks.workunit.client.1.smithi181.stdout:3/788: symlink d0/d5/d6/dd/d25/d50/l10b 0 2024-04-03T08:39:34.076 INFO:tasks.workunit.client.0.smithi157.stdout:7/877: rename d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/f123 to d0/d11/d15/d17/d52/f130 0 2024-04-03T08:39:34.077 INFO:tasks.workunit.client.0.smithi157.stdout:2/837: truncate d3/d2e/f75 163379 0 2024-04-03T08:39:34.079 INFO:tasks.workunit.client.1.smithi181.stdout:7/681: symlink d0/d1/d6/de/d17/d27/d72/df4/lfb 0 2024-04-03T08:39:34.080 INFO:tasks.workunit.client.0.smithi157.stdout:2/838: fdatasync d3/db/d44/d4c/df1/fdb 0 2024-04-03T08:39:34.082 INFO:tasks.workunit.client.1.smithi181.stdout:5/727: creat d4/d22/d72/fe9 x:0 0 0 2024-04-03T08:39:34.084 INFO:tasks.workunit.client.1.smithi181.stdout:8/682: symlink d4/d45/db/d14/dd0/le7 0 2024-04-03T08:39:34.084 INFO:tasks.workunit.client.1.smithi181.stdout:5/728: write d4/d80/fa4 [691117,120081] 0 2024-04-03T08:39:34.085 INFO:tasks.workunit.client.0.smithi157.stdout:5/893: mkdir dc/d29/d56/d52/d9d/da5/d12b 0 2024-04-03T08:39:34.086 INFO:tasks.workunit.client.1.smithi181.stdout:1/733: write d10/d15/d17/d30/f7e [1579590,110874] 0 2024-04-03T08:39:34.087 INFO:tasks.workunit.client.0.smithi157.stdout:4/797: write da/df/d2f/d64/f96 [161108,68938] 0 2024-04-03T08:39:34.090 INFO:tasks.workunit.client.0.smithi157.stdout:8/864: rename d2/d11/d10/d24/d5b/fda to d2/d20/db1/d111/f125 0 2024-04-03T08:39:34.092 INFO:tasks.workunit.client.1.smithi181.stdout:6/773: fsync d6/d3e/d40/f4e 0 2024-04-03T08:39:34.094 INFO:tasks.workunit.client.0.smithi157.stdout:8/865: chown d2/d11/d10/d24/f10e 1642 1 2024-04-03T08:39:34.096 INFO:tasks.workunit.client.0.smithi157.stdout:3/847: mkdir d8/d13/d1b/d128 0 2024-04-03T08:39:34.102 INFO:tasks.workunit.client.0.smithi157.stdout:3/848: chown d8/d1e/d2d/d39/d51/d48/dab/dee/c126 9 1 2024-04-03T08:39:34.103 INFO:tasks.workunit.client.1.smithi181.stdout:5/729: dwrite d4/d18/fb9 [0,4194304] 0 2024-04-03T08:39:34.103 INFO:tasks.workunit.client.1.smithi181.stdout:3/789: dread d0/d5/d6/d32/daa/fae [0,4194304] 0 2024-04-03T08:39:34.103 INFO:tasks.workunit.client.1.smithi181.stdout:2/821: truncate d13/d1c/f63 3433265 0 2024-04-03T08:39:34.104 INFO:tasks.workunit.client.0.smithi157.stdout:0/944: dread d2/d9/dc/df/d1b/d35/f56 [0,4194304] 0 2024-04-03T08:39:34.105 INFO:tasks.workunit.client.0.smithi157.stdout:3/849: chown d8/d1e/d2d/d39/d51/d48/fc1 8371 1 2024-04-03T08:39:34.105 INFO:tasks.workunit.client.0.smithi157.stdout:6/864: truncate d1/d5/d17/d2a/d30/d95/f2e 823926 0 2024-04-03T08:39:34.107 INFO:tasks.workunit.client.0.smithi157.stdout:0/945: readlink d2/d9/dc/df/d1b/l47 0 2024-04-03T08:39:34.114 INFO:tasks.workunit.client.0.smithi157.stdout:4/798: unlink da/df/d24/f59 0 2024-04-03T08:39:34.115 INFO:tasks.workunit.client.1.smithi181.stdout:1/734: creat d10/d69/fec x:0 0 0 2024-04-03T08:39:34.118 INFO:tasks.workunit.client.0.smithi157.stdout:5/894: dread dc/d29/d56/d18/f1c [4194304,4194304] 0 2024-04-03T08:39:34.119 INFO:tasks.workunit.client.0.smithi157.stdout:8/866: read - d2/fad zero size 2024-04-03T08:39:34.123 INFO:tasks.workunit.client.0.smithi157.stdout:9/899: link d1/f5 d1/d15/d27/d34/da6/f12a 0 2024-04-03T08:39:34.125 INFO:tasks.workunit.client.1.smithi181.stdout:0/714: sync 2024-04-03T08:39:34.125 INFO:tasks.workunit.client.0.smithi157.stdout:3/850: mkdir d8/d13/d1b/d5b/d7f/d129 0 2024-04-03T08:39:34.128 INFO:tasks.workunit.client.1.smithi181.stdout:0/715: write d5/dc/d10/d30/f94 [2298813,34897] 0 2024-04-03T08:39:34.128 INFO:tasks.workunit.client.1.smithi181.stdout:2/822: dread d13/da7/f7c [0,4194304] 0 2024-04-03T08:39:34.130 INFO:tasks.workunit.client.0.smithi157.stdout:6/865: stat d1/d5/d17/d2a/d40/dec/d92/fe4 0 2024-04-03T08:39:34.132 INFO:tasks.workunit.client.1.smithi181.stdout:7/682: rename d0/d1/d6/de/d17/d64/d85/d87/cae to d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/cfc 0 2024-04-03T08:39:34.134 INFO:tasks.workunit.client.1.smithi181.stdout:6/774: dwrite d6/f60 [0,4194304] 0 2024-04-03T08:39:34.134 INFO:tasks.workunit.client.1.smithi181.stdout:8/683: mkdir d4/d45/db/d14/d31/d1c/de8 0 2024-04-03T08:39:34.138 INFO:tasks.workunit.client.0.smithi157.stdout:4/799: symlink da/df/d2f/d64/d8f/dbd/d68/l114 0 2024-04-03T08:39:34.143 INFO:tasks.workunit.client.1.smithi181.stdout:3/790: dwrite d0/d5/d6/d32/dc1/ffc [0,4194304] 0 2024-04-03T08:39:34.147 INFO:tasks.workunit.client.0.smithi157.stdout:8/867: mkdir d2/d20/db1/d111/d126 0 2024-04-03T08:39:34.148 INFO:tasks.workunit.client.1.smithi181.stdout:6/775: chown d6/d3e/db1/dc4/ld7 8 1 2024-04-03T08:39:34.150 INFO:tasks.workunit.client.0.smithi157.stdout:5/895: mknod dc/d29/d56/da4/c12c 0 2024-04-03T08:39:34.150 INFO:tasks.workunit.client.1.smithi181.stdout:1/735: unlink d10/d15/d17/d23/ceb 0 2024-04-03T08:39:34.151 INFO:tasks.workunit.client.0.smithi157.stdout:6/866: mknod d1/d5/d17/d29/da7/db9/dfb/c12a 0 2024-04-03T08:39:34.152 INFO:tasks.workunit.client.0.smithi157.stdout:5/896: chown l9 49363386 1 2024-04-03T08:39:34.153 INFO:tasks.workunit.client.1.smithi181.stdout:6/776: dread - d6/d31/d36/dba/da6/fd5 zero size 2024-04-03T08:39:34.154 INFO:tasks.workunit.client.0.smithi157.stdout:2/839: rename d3/db/d44/d4c/d5a/d88/f112 to d3/d12/f11d 0 2024-04-03T08:39:34.154 INFO:tasks.workunit.client.1.smithi181.stdout:7/683: truncate d0/d1/d6/de/f52 121108 0 2024-04-03T08:39:34.156 INFO:tasks.workunit.client.1.smithi181.stdout:6/777: dread - d6/d31/d36/dba/da6/d4f/dd1/fe4 zero size 2024-04-03T08:39:34.156 INFO:tasks.workunit.client.1.smithi181.stdout:2/823: dread d13/da7/d27/f4b [0,4194304] 0 2024-04-03T08:39:34.158 INFO:tasks.workunit.client.1.smithi181.stdout:6/778: chown d6/d31/d36/f9c 2790 1 2024-04-03T08:39:34.158 INFO:tasks.workunit.client.1.smithi181.stdout:0/716: unlink d5/d9/d2e/f39 0 2024-04-03T08:39:34.160 INFO:tasks.workunit.client.1.smithi181.stdout:6/779: chown d6/d31/d36/d73/l9a 13995 1 2024-04-03T08:39:34.164 INFO:tasks.workunit.client.1.smithi181.stdout:0/717: read d5/dc/d10/d58/d6c/f15 [1340134,92547] 0 2024-04-03T08:39:34.165 INFO:tasks.workunit.client.0.smithi157.stdout:4/800: creat da/d26/f115 x:0 0 0 2024-04-03T08:39:34.165 INFO:tasks.workunit.client.0.smithi157.stdout:3/851: creat d8/d1e/d2d/d3b/d9e/dcd/d124/f12a x:0 0 0 2024-04-03T08:39:34.165 INFO:tasks.workunit.client.0.smithi157.stdout:6/867: stat d1/d5/d17/d29/d62/l116 0 2024-04-03T08:39:34.166 INFO:tasks.workunit.client.1.smithi181.stdout:5/730: rename d4/d22/d53/ld7 to d4/d18/d55/dae/lea 0 2024-04-03T08:39:34.167 INFO:tasks.workunit.client.1.smithi181.stdout:2/824: creat d13/d1c/d4a/d7f/dcb/f12d x:0 0 0 2024-04-03T08:39:34.169 INFO:tasks.workunit.client.0.smithi157.stdout:0/946: getdents d2/d9/d5f 0 2024-04-03T08:39:34.174 INFO:tasks.workunit.client.0.smithi157.stdout:9/900: link d1/d15/d27/d5c/d79/f99 d1/d36/f12b 0 2024-04-03T08:39:34.177 INFO:tasks.workunit.client.0.smithi157.stdout:3/852: creat d8/d1e/d2d/d39/d51/d4c/dd6/de0/f12b x:0 0 0 2024-04-03T08:39:34.177 INFO:tasks.workunit.client.1.smithi181.stdout:1/736: mknod d10/d15/d17/ced 0 2024-04-03T08:39:34.179 INFO:tasks.workunit.client.0.smithi157.stdout:4/801: symlink da/d26/df4/l116 0 2024-04-03T08:39:34.180 INFO:tasks.workunit.client.1.smithi181.stdout:2/825: dwrite d13/da7/d85/ff2 [0,4194304] 0 2024-04-03T08:39:34.180 INFO:tasks.workunit.client.0.smithi157.stdout:8/868: dwrite d2/d6f/d70/d89/d59/df6/f102 [0,4194304] 0 2024-04-03T08:39:34.181 INFO:tasks.workunit.client.1.smithi181.stdout:3/791: rename d0/d17/d63/db7/f101 to d0/d17/d36/d8c/f10c 0 2024-04-03T08:39:34.182 INFO:tasks.workunit.client.0.smithi157.stdout:4/802: chown da/df/l85 29 1 2024-04-03T08:39:34.185 INFO:tasks.workunit.client.0.smithi157.stdout:8/869: chown d2/d11/d10/d24/c40 0 1 2024-04-03T08:39:34.187 INFO:tasks.workunit.client.0.smithi157.stdout:8/870: stat d2/d6f/d70/d89/lce 0 2024-04-03T08:39:34.200 INFO:tasks.workunit.client.0.smithi157.stdout:6/868: dread d1/d4b/f10d [0,4194304] 0 2024-04-03T08:39:34.239 INFO:tasks.workunit.client.1.smithi181.stdout:5/731: mknod d4/d44/ceb 0 2024-04-03T08:39:34.252 INFO:tasks.workunit.client.1.smithi181.stdout:5/732: dwrite d4/d18/d25/fd6 [0,4194304] 0 2024-04-03T08:39:34.260 INFO:tasks.workunit.client.1.smithi181.stdout:4/770: sync 2024-04-03T08:39:34.260 INFO:tasks.workunit.client.1.smithi181.stdout:9/770: sync 2024-04-03T08:39:34.261 INFO:tasks.workunit.client.1.smithi181.stdout:9/771: chown d1/da/d28/f9a 1812686 1 2024-04-03T08:39:34.264 INFO:tasks.workunit.client.1.smithi181.stdout:9/772: fsync d1/da/d13/d22/d23/d36/d91/d9d/daa/fea 0 2024-04-03T08:39:34.300 INFO:tasks.workunit.client.0.smithi157.stdout:5/897: rename dc/dce to dc/d29/d56/d9e/dc3/dde/de4/d12d 0 2024-04-03T08:39:34.305 INFO:tasks.workunit.client.0.smithi157.stdout:5/898: write dc/d29/d56/d18/d21/fc5 [3033640,109671] 0 2024-04-03T08:39:34.305 INFO:tasks.workunit.client.0.smithi157.stdout:0/947: creat d2/d9/dc/d54/f151 x:0 0 0 2024-04-03T08:39:34.314 INFO:tasks.workunit.client.1.smithi181.stdout:0/718: mkdir d5/dc/d14/de5 0 2024-04-03T08:39:34.316 INFO:tasks.workunit.client.1.smithi181.stdout:8/684: sync 2024-04-03T08:39:34.317 INFO:tasks.workunit.client.0.smithi157.stdout:3/853: read d8/d13/d1b/f6b [3654116,29562] 0 2024-04-03T08:39:34.332 INFO:tasks.workunit.client.0.smithi157.stdout:1/780: sync 2024-04-03T08:39:34.332 INFO:tasks.workunit.client.0.smithi157.stdout:7/878: sync 2024-04-03T08:39:34.333 INFO:tasks.workunit.client.0.smithi157.stdout:8/871: write d2/d20/d23/fc5 [371907,31938] 0 2024-04-03T08:39:34.333 INFO:tasks.workunit.client.1.smithi181.stdout:2/826: dread - d13/d1c/d4a/d7f/db3/de3/fee zero size 2024-04-03T08:39:34.334 INFO:tasks.workunit.client.0.smithi157.stdout:8/872: dread - d2/d6f/d70/d89/fba zero size 2024-04-03T08:39:34.337 INFO:tasks.workunit.client.1.smithi181.stdout:3/792: truncate d0/d17/d36/d3b/d5a/d85/f90 902046 0 2024-04-03T08:39:34.344 INFO:tasks.workunit.client.0.smithi157.stdout:2/840: link d3/db/d44/lc8 d3/db/d44/d4c/d5a/d88/df6/l11e 0 2024-04-03T08:39:34.356 INFO:tasks.workunit.client.1.smithi181.stdout:9/773: truncate d1/da/d13/d41/f2a 2967856 0 2024-04-03T08:39:34.365 INFO:tasks.workunit.client.1.smithi181.stdout:7/684: link d0/d1/d6/de/d17/c22 d0/d1/d6/dca/cfd 0 2024-04-03T08:39:34.370 INFO:tasks.workunit.client.0.smithi157.stdout:8/873: creat d2/d6f/d70/d89/d59/dc1/f127 x:0 0 0 2024-04-03T08:39:34.373 INFO:tasks.workunit.client.0.smithi157.stdout:2/841: truncate d3/d2e/d32/d9f/f104 98221 0 2024-04-03T08:39:34.376 INFO:tasks.workunit.client.1.smithi181.stdout:1/737: mknod d10/d15/d41/cee 0 2024-04-03T08:39:34.381 INFO:tasks.workunit.client.1.smithi181.stdout:5/733: mknod d4/d18/d2c/cec 0 2024-04-03T08:39:34.385 INFO:tasks.workunit.client.1.smithi181.stdout:4/771: mknod d1/d1e/d2c/d67/d9d/c100 0 2024-04-03T08:39:34.386 INFO:tasks.workunit.client.1.smithi181.stdout:9/774: dread d1/da/f21 [0,4194304] 0 2024-04-03T08:39:34.386 INFO:tasks.workunit.client.1.smithi181.stdout:4/772: dread - d1/d1e/d78/fee zero size 2024-04-03T08:39:34.388 INFO:tasks.workunit.client.0.smithi157.stdout:2/842: mkdir d3/d12/d43/d4b/d55/d11f 0 2024-04-03T08:39:34.389 INFO:tasks.workunit.client.1.smithi181.stdout:6/780: getdents d6/d53/d80 0 2024-04-03T08:39:34.390 INFO:tasks.workunit.client.1.smithi181.stdout:7/685: symlink d0/d1/d6/db0/lfe 0 2024-04-03T08:39:34.391 INFO:tasks.workunit.client.1.smithi181.stdout:7/686: fdatasync d0/d1/f74 0 2024-04-03T08:39:34.392 INFO:tasks.workunit.client.1.smithi181.stdout:7/687: readlink d0/d1/d6/de/l40 0 2024-04-03T08:39:34.394 INFO:tasks.workunit.client.1.smithi181.stdout:1/738: unlink d10/d15/d4a/d6f/f7a 0 2024-04-03T08:39:34.399 INFO:tasks.workunit.client.0.smithi157.stdout:2/843: creat d3/d12/d43/d4b/d55/d10c/f120 x:0 0 0 2024-04-03T08:39:34.400 INFO:tasks.workunit.client.1.smithi181.stdout:5/734: read - d4/d18/d3e/fa6 zero size 2024-04-03T08:39:34.402 INFO:tasks.workunit.client.1.smithi181.stdout:4/773: truncate d1/d1e/d82/d84/fe6 713083 0 2024-04-03T08:39:34.403 INFO:tasks.workunit.client.0.smithi157.stdout:8/874: dwrite d2/d20/db1/fd7 [0,4194304] 0 2024-04-03T08:39:34.403 INFO:tasks.workunit.client.1.smithi181.stdout:6/781: dread - d6/d53/f91 zero size 2024-04-03T08:39:34.414 INFO:tasks.workunit.client.1.smithi181.stdout:1/739: mknod d10/d15/d4b/d6c/cef 0 2024-04-03T08:39:34.420 INFO:tasks.workunit.client.0.smithi157.stdout:2/844: dread d3/d2e/f80 [0,4194304] 0 2024-04-03T08:39:34.427 INFO:tasks.workunit.client.0.smithi157.stdout:8/875: dwrite d2/d6f/d70/d89/d59/df6/f102 [0,4194304] 0 2024-04-03T08:39:34.490 INFO:tasks.workunit.client.0.smithi157.stdout:6/869: rename d1/d5/d17/d2a/l125 to d1/d5/d17/d29/da7/db9/l12b 0 2024-04-03T08:39:34.500 INFO:tasks.workunit.client.0.smithi157.stdout:6/870: rmdir d1/d5/d17/d29/d87/d11b 0 2024-04-03T08:39:34.503 INFO:tasks.workunit.client.0.smithi157.stdout:6/871: chown d1/d5/d17/d29/d62/l116 2896 1 2024-04-03T08:39:34.510 INFO:tasks.workunit.client.0.smithi157.stdout:6/872: mkdir d1/d5/d17/d2a/d30/d12c 0 2024-04-03T08:39:34.511 INFO:tasks.workunit.client.0.smithi157.stdout:6/873: read d1/d5/d17/d2a/d37/f25 [1275446,77398] 0 2024-04-03T08:39:34.516 INFO:tasks.workunit.client.0.smithi157.stdout:4/803: truncate da/df/d2f/d54/fd3 3870354 0 2024-04-03T08:39:34.523 INFO:tasks.workunit.client.0.smithi157.stdout:4/804: symlink da/df/d6b/db9/l117 0 2024-04-03T08:39:34.525 INFO:tasks.workunit.client.0.smithi157.stdout:9/901: dwrite d1/f33 [0,4194304] 0 2024-04-03T08:39:34.528 INFO:tasks.workunit.client.0.smithi157.stdout:3/854: dwrite d8/d1e/d2d/d3b/d8c/df1/f107 [0,4194304] 0 2024-04-03T08:39:34.533 INFO:tasks.workunit.client.0.smithi157.stdout:4/805: chown da/l1a 5 1 2024-04-03T08:39:34.533 INFO:tasks.workunit.client.0.smithi157.stdout:9/902: chown d1/d15/d27/daf/da7/d123/d75/f88 113923361 1 2024-04-03T08:39:34.534 INFO:tasks.workunit.client.0.smithi157.stdout:9/903: fdatasync d1/d4a/f4c 0 2024-04-03T08:39:34.537 INFO:tasks.workunit.client.0.smithi157.stdout:4/806: creat da/df/d2f/d64/d8f/f118 x:0 0 0 2024-04-03T08:39:34.543 INFO:tasks.workunit.client.0.smithi157.stdout:9/904: dread d1/f19 [0,4194304] 0 2024-04-03T08:39:34.549 INFO:tasks.workunit.client.0.smithi157.stdout:5/899: rename dc/d29/f5f to dc/d29/d56/d2e/f12e 0 2024-04-03T08:39:34.549 INFO:tasks.workunit.client.1.smithi181.stdout:2/827: sync 2024-04-03T08:39:34.550 INFO:tasks.workunit.client.1.smithi181.stdout:9/775: sync 2024-04-03T08:39:34.553 INFO:tasks.workunit.client.0.smithi157.stdout:9/905: symlink d1/d15/d27/daf/da7/l12c 0 2024-04-03T08:39:34.555 INFO:tasks.workunit.client.0.smithi157.stdout:3/855: getdents d8/d1e/d2d/d30 0 2024-04-03T08:39:34.557 INFO:tasks.workunit.client.1.smithi181.stdout:3/793: dwrite d0/d17/d63/d81/f88 [0,4194304] 0 2024-04-03T08:39:34.561 INFO:tasks.workunit.client.0.smithi157.stdout:7/879: rename d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/dee/lfa to d0/d11/d15/d17/d52/db6/dda/l131 0 2024-04-03T08:39:34.569 INFO:tasks.workunit.client.0.smithi157.stdout:6/874: rename d1/d5/d17/d2a/d40/dec/d92 to d1/d5/d17/d2a/d73/d12d 0 2024-04-03T08:39:34.570 INFO:tasks.workunit.client.0.smithi157.stdout:7/880: read d0/d11/d15/d17/d52/db6/dda/fdf [3597280,27135] 0 2024-04-03T08:39:34.576 INFO:tasks.workunit.client.0.smithi157.stdout:9/906: rename d1/d15/d27/d34/da6/cb4 to d1/d4a/dc4/c12d 0 2024-04-03T08:39:34.580 INFO:tasks.workunit.client.0.smithi157.stdout:6/875: mkdir d1/d4b/da5/dc7/d12e 0 2024-04-03T08:39:34.581 INFO:tasks.workunit.client.0.smithi157.stdout:8/876: write d2/d11/d10/f48 [2102318,94839] 0 2024-04-03T08:39:34.582 INFO:tasks.workunit.client.0.smithi157.stdout:2/845: dwrite d3/d12/f116 [0,4194304] 0 2024-04-03T08:39:34.583 INFO:tasks.workunit.client.1.smithi181.stdout:1/740: dwrite d10/d15/d17/d19/f40 [0,4194304] 0 2024-04-03T08:39:34.586 INFO:tasks.workunit.client.0.smithi157.stdout:8/877: chown d2/d20/db1/fd7 6892069 1 2024-04-03T08:39:34.598 INFO:tasks.workunit.client.0.smithi157.stdout:7/881: fsync d0/d11/f21 0 2024-04-03T08:39:34.600 INFO:tasks.workunit.client.0.smithi157.stdout:7/882: stat d0/d11/f1d 0 2024-04-03T08:39:34.603 INFO:tasks.workunit.client.0.smithi157.stdout:7/883: readlink d0/d11/d15/d17/d1c/d4f/l97 0 2024-04-03T08:39:34.604 INFO:tasks.workunit.client.1.smithi181.stdout:9/776: rmdir d1/da/d13/d73 39 2024-04-03T08:39:34.606 INFO:tasks.workunit.client.0.smithi157.stdout:8/878: truncate d2/d20/f65 1443667 0 2024-04-03T08:39:34.608 INFO:tasks.workunit.client.1.smithi181.stdout:6/782: rename d6/d9e to d6/df6 0 2024-04-03T08:39:34.615 INFO:tasks.workunit.client.1.smithi181.stdout:3/794: creat d0/d5/d6/dd/d5f/f10d x:0 0 0 2024-04-03T08:39:34.618 INFO:tasks.workunit.client.1.smithi181.stdout:9/777: symlink d1/da/d28/d30/d3e/lee 0 2024-04-03T08:39:34.624 INFO:tasks.workunit.client.1.smithi181.stdout:6/783: read d6/d53/d80/f86 [2819226,65114] 0 2024-04-03T08:39:34.624 INFO:tasks.workunit.client.1.smithi181.stdout:9/778: truncate d1/da/d13/d41/d65/f99 887776 0 2024-04-03T08:39:34.626 INFO:tasks.workunit.client.0.smithi157.stdout:7/884: creat d0/d11/d15/f132 x:0 0 0 2024-04-03T08:39:34.627 INFO:tasks.workunit.client.1.smithi181.stdout:6/784: rmdir d6/d53/d8d/d97 39 2024-04-03T08:39:34.629 INFO:tasks.workunit.client.0.smithi157.stdout:7/885: chown d0/d11/d6f/d89/d8c/deb/f10c 0 1 2024-04-03T08:39:34.630 INFO:tasks.workunit.client.1.smithi181.stdout:9/779: creat d1/da/d13/d22/d23/d36/d91/d9d/dd7/fef x:0 0 0 2024-04-03T08:39:34.631 INFO:tasks.workunit.client.0.smithi157.stdout:7/886: chown d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/fa6 732504 1 2024-04-03T08:39:34.632 INFO:tasks.workunit.client.1.smithi181.stdout:6/785: creat d6/d53/d80/ff7 x:0 0 0 2024-04-03T08:39:34.636 INFO:tasks.workunit.client.0.smithi157.stdout:2/846: unlink d3/d12/fe 0 2024-04-03T08:39:34.637 INFO:tasks.workunit.client.1.smithi181.stdout:6/786: creat d6/d31/d36/dba/da6/ff8 x:0 0 0 2024-04-03T08:39:34.639 INFO:tasks.workunit.client.1.smithi181.stdout:7/688: creat d0/d1/d6/fff x:0 0 0 2024-04-03T08:39:34.641 INFO:tasks.workunit.client.1.smithi181.stdout:6/787: symlink d6/d31/d36/dba/da6/d4f/dd1/d50/d64/lf9 0 2024-04-03T08:39:34.645 INFO:tasks.workunit.client.1.smithi181.stdout:7/689: unlink d0/d1/d6/de/d6d/d96/dbf/ccc 0 2024-04-03T08:39:34.646 INFO:tasks.workunit.client.1.smithi181.stdout:6/788: write d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/f6a [1828594,64121] 0 2024-04-03T08:39:34.647 INFO:tasks.workunit.client.1.smithi181.stdout:0/719: rename d5/d9/d2c to d5/d9/d2a/de6 0 2024-04-03T08:39:34.649 INFO:tasks.workunit.client.1.smithi181.stdout:9/780: dwrite d1/da/d13/d41/d32/fe6 [0,4194304] 0 2024-04-03T08:39:34.650 INFO:tasks.workunit.client.1.smithi181.stdout:6/789: chown d6/d31/d36/dba/d95 384322 1 2024-04-03T08:39:34.650 INFO:tasks.workunit.client.1.smithi181.stdout:0/720: chown d5/dc/d14/de5 362154 1 2024-04-03T08:39:34.652 INFO:tasks.workunit.client.0.smithi157.stdout:2/847: dwrite d3/d2e/d32/d9f/fcb [0,4194304] 0 2024-04-03T08:39:34.654 INFO:tasks.workunit.client.1.smithi181.stdout:6/790: readlink d6/d31/d36/dba/da6/d4f/dd1/l6e 0 2024-04-03T08:39:34.657 INFO:tasks.workunit.client.0.smithi157.stdout:1/781: sync 2024-04-03T08:39:34.657 INFO:tasks.workunit.client.0.smithi157.stdout:0/948: sync 2024-04-03T08:39:34.657 INFO:tasks.workunit.client.1.smithi181.stdout:8/685: rename d4/d2a/d37/f3d to d4/d2a/d37/d67/d91/fe9 0 2024-04-03T08:39:34.658 INFO:tasks.workunit.client.1.smithi181.stdout:1/741: rmdir d10/d15/d17 39 2024-04-03T08:39:34.658 INFO:tasks.workunit.client.1.smithi181.stdout:0/721: creat d5/dc/d10/fe7 x:0 0 0 2024-04-03T08:39:34.662 INFO:tasks.workunit.client.0.smithi157.stdout:1/782: chown d2/d11/d24/d39/l41 1 1 2024-04-03T08:39:34.663 INFO:tasks.workunit.client.0.smithi157.stdout:2/848: fsync d3/d12/d43/d4b/f73 0 2024-04-03T08:39:34.666 INFO:tasks.workunit.client.1.smithi181.stdout:9/781: mkdir d1/da/d28/d30/dd8/df0 0 2024-04-03T08:39:34.674 INFO:tasks.workunit.client.1.smithi181.stdout:6/791: dwrite d6/d31/d36/dba/da6/f88 [0,4194304] 0 2024-04-03T08:39:34.677 INFO:tasks.workunit.client.1.smithi181.stdout:0/722: mknod d5/d9/d2a/de6/dcc/ce8 0 2024-04-03T08:39:34.678 INFO:tasks.workunit.client.1.smithi181.stdout:0/723: readlink d5/lc0 0 2024-04-03T08:39:34.678 INFO:tasks.workunit.client.0.smithi157.stdout:1/783: mkdir d2/d11/d24/d108 0 2024-04-03T08:39:34.679 INFO:tasks.workunit.client.1.smithi181.stdout:8/686: dwrite d4/d45/f2e [0,4194304] 0 2024-04-03T08:39:34.680 INFO:tasks.workunit.client.1.smithi181.stdout:0/724: write d5/dc/d75/fe4 [314268,126902] 0 2024-04-03T08:39:34.686 INFO:tasks.workunit.client.0.smithi157.stdout:4/807: dwrite da/df/f104 [0,4194304] 0 2024-04-03T08:39:34.688 INFO:tasks.workunit.client.1.smithi181.stdout:6/792: creat d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/ffa x:0 0 0 2024-04-03T08:39:34.695 INFO:tasks.workunit.client.0.smithi157.stdout:0/949: link d2/d9/c68 d2/d9/dc/df/d1b/d4a/de4/df1/c152 0 2024-04-03T08:39:34.696 INFO:tasks.workunit.client.0.smithi157.stdout:6/876: rename d1/d5/d17/d2a/d40 to d1/d5/d17/d29/d12f 0 2024-04-03T08:39:34.699 INFO:tasks.workunit.client.0.smithi157.stdout:0/950: write d2/d9/d51/d63/f132 [4931207,45437] 0 2024-04-03T08:39:34.700 INFO:tasks.workunit.client.1.smithi181.stdout:4/774: rename d1/d1e/d2c/c33 to d1/d16/d24/c101 0 2024-04-03T08:39:34.703 INFO:tasks.workunit.client.0.smithi157.stdout:3/856: truncate d8/d1e/d2d/d39/d51/d7e/db1/f100 4188446 0 2024-04-03T08:39:34.706 INFO:tasks.workunit.client.1.smithi181.stdout:8/687: symlink d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/lea 0 2024-04-03T08:39:34.708 INFO:tasks.workunit.client.1.smithi181.stdout:8/688: stat d4/d2a/f5d 0 2024-04-03T08:39:34.710 INFO:tasks.workunit.client.1.smithi181.stdout:6/793: fdatasync d6/d3e/d40/f4e 0 2024-04-03T08:39:34.713 INFO:tasks.workunit.client.1.smithi181.stdout:8/689: chown d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/c98 9661 1 2024-04-03T08:39:34.713 INFO:tasks.workunit.client.0.smithi157.stdout:7/887: rename d0/d11/d15/f132 to d0/d11/d15/d17/d1c/d4f/d5f/f133 0 2024-04-03T08:39:34.715 INFO:tasks.workunit.client.1.smithi181.stdout:5/735: rename d4/d18/d55/dae/fd9 to d4/d18/d55/db4/d8a/fed 0 2024-04-03T08:39:34.719 INFO:tasks.workunit.client.1.smithi181.stdout:0/725: dread d5/d9/d2a/f64 [0,4194304] 0 2024-04-03T08:39:34.720 INFO:tasks.workunit.client.1.smithi181.stdout:6/794: creat d6/d3e/d40/ffb x:0 0 0 2024-04-03T08:39:34.722 INFO:tasks.workunit.client.0.smithi157.stdout:3/857: fsync d8/d1e/d2d/d3b/f6e 0 2024-04-03T08:39:34.729 INFO:tasks.workunit.client.0.smithi157.stdout:9/907: dwrite d1/d36/d46/fed [0,4194304] 0 2024-04-03T08:39:34.731 INFO:tasks.workunit.client.1.smithi181.stdout:3/795: rename d0/d5/d6/dd/fa9 to d0/d17/d36/d3b/d102/f10e 0 2024-04-03T08:39:34.734 INFO:tasks.workunit.client.0.smithi157.stdout:2/849: rename d3/d2e/d65 to d3/d2e/d32/d9f/da7/d121 0 2024-04-03T08:39:34.736 INFO:tasks.workunit.client.0.smithi157.stdout:6/877: creat d1/d5/d17/d2a/d30/d12c/f130 x:0 0 0 2024-04-03T08:39:34.742 INFO:tasks.workunit.client.0.smithi157.stdout:8/879: write d2/ffd [1255726,81741] 0 2024-04-03T08:39:34.744 INFO:tasks.workunit.client.0.smithi157.stdout:3/858: dwrite d8/d1e/d2d/d30/df0/f103 [0,4194304] 0 2024-04-03T08:39:34.745 INFO:tasks.workunit.client.1.smithi181.stdout:6/795: chown d6/d31/d36/dba/da6/d4f/dd1/l69 0 1 2024-04-03T08:39:34.748 INFO:tasks.workunit.client.1.smithi181.stdout:2/828: dwrite d13/d1c/d4a/d68/fcc [0,4194304] 0 2024-04-03T08:39:34.753 INFO:tasks.workunit.client.1.smithi181.stdout:3/796: truncate d0/dbc/fbf 158044 0 2024-04-03T08:39:34.755 INFO:tasks.workunit.client.1.smithi181.stdout:5/736: mkdir d4/d18/d55/d5a/dcd/dee 0 2024-04-03T08:39:34.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/737: fsync d4/d18/d2c/fd2 0 2024-04-03T08:39:34.758 INFO:tasks.workunit.client.1.smithi181.stdout:7/690: rmdir d0/d1/d6 39 2024-04-03T08:39:34.766 INFO:tasks.workunit.client.1.smithi181.stdout:0/726: creat d5/dc/d14/de5/fe9 x:0 0 0 2024-04-03T08:39:34.768 INFO:tasks.workunit.client.1.smithi181.stdout:0/727: chown d5/dc/c88 199841422 1 2024-04-03T08:39:34.768 INFO:tasks.workunit.client.1.smithi181.stdout:3/797: dwrite d0/d17/d36/d1e/f28 [0,4194304] 0 2024-04-03T08:39:34.769 INFO:tasks.workunit.client.1.smithi181.stdout:6/796: readlink d6/d3e/ld0 0 2024-04-03T08:39:34.769 INFO:tasks.workunit.client.0.smithi157.stdout:5/900: getdents dc/d29/d56/d52/d9d 0 2024-04-03T08:39:34.772 INFO:tasks.workunit.client.1.smithi181.stdout:6/797: write d6/d3e/d40/fb3 [1910953,5510] 0 2024-04-03T08:39:34.773 INFO:tasks.workunit.client.0.smithi157.stdout:8/880: rename d2/d11/d10/d24/d5b/d2e/f38 to d2/d11/d10/d24/d5b/d2e/dcf/f128 0 2024-04-03T08:39:34.774 INFO:tasks.workunit.client.0.smithi157.stdout:8/881: stat d2/d20/l44 0 2024-04-03T08:39:34.778 INFO:tasks.workunit.client.1.smithi181.stdout:5/738: readlink d4/d18/d55/l67 0 2024-04-03T08:39:34.783 INFO:tasks.workunit.client.1.smithi181.stdout:0/728: rename d5/d9/d60 to d5/dc/d8e/dea 0 2024-04-03T08:39:34.784 INFO:tasks.workunit.client.1.smithi181.stdout:1/742: truncate d10/d15/d4a/fc2 830094 0 2024-04-03T08:39:34.790 INFO:tasks.workunit.client.1.smithi181.stdout:3/798: truncate d0/d17/d36/f45 5215954 0 2024-04-03T08:39:34.791 INFO:tasks.workunit.client.1.smithi181.stdout:3/799: chown d0/d5/d6f/l69 247026 1 2024-04-03T08:39:34.791 INFO:tasks.workunit.client.0.smithi157.stdout:5/901: dwrite dc/d29/d56/d18/d21/f61 [0,4194304] 0 2024-04-03T08:39:34.791 INFO:tasks.workunit.client.0.smithi157.stdout:8/882: symlink d2/d20/d23/l129 0 2024-04-03T08:39:34.797 INFO:tasks.workunit.client.1.smithi181.stdout:5/739: creat d4/d22/d53/d98/fef x:0 0 0 2024-04-03T08:39:34.802 INFO:tasks.workunit.client.1.smithi181.stdout:7/691: chown d0/d1/d6/de9/cec 0 1 2024-04-03T08:39:34.805 INFO:tasks.workunit.client.0.smithi157.stdout:1/784: dwrite d2/d11/d24/d39/d3b/df4/f103 [0,4194304] 0 2024-04-03T08:39:34.809 INFO:tasks.workunit.client.0.smithi157.stdout:4/808: dwrite da/df/d24/f5c [0,4194304] 0 2024-04-03T08:39:34.809 INFO:tasks.workunit.client.0.smithi157.stdout:9/908: getdents d1/dab/d103 0 2024-04-03T08:39:34.809 INFO:tasks.workunit.client.1.smithi181.stdout:8/690: write d4/d45/db/d14/fb5 [5042335,800] 0 2024-04-03T08:39:34.811 INFO:tasks.workunit.client.1.smithi181.stdout:2/829: creat d13/f12e x:0 0 0 2024-04-03T08:39:34.812 INFO:tasks.workunit.client.0.smithi157.stdout:4/809: fdatasync da/df/d2f/d64/d8f/dbd/f5b 0 2024-04-03T08:39:34.812 INFO:tasks.workunit.client.0.smithi157.stdout:1/785: stat d2/d11/d24/d39/d3b/d2e/d66/fce 0 2024-04-03T08:39:34.828 INFO:tasks.workunit.client.1.smithi181.stdout:6/798: link d6/d31/d36/fcf d6/d3e/db1/dc4/dc9/ffc 0 2024-04-03T08:39:34.828 INFO:tasks.workunit.client.1.smithi181.stdout:4/775: write d1/d16/d24/d5e/d31/fa5 [1488310,4152] 0 2024-04-03T08:39:34.829 INFO:tasks.workunit.client.0.smithi157.stdout:7/888: write d0/d11/d15/d17/d52/db6/dda/de6/ff1 [1379144,97031] 0 2024-04-03T08:39:34.830 INFO:tasks.workunit.client.1.smithi181.stdout:5/740: truncate d4/d22/d53/f9a 843017 0 2024-04-03T08:39:34.831 INFO:tasks.workunit.client.0.smithi157.stdout:0/951: write d2/d9/f4f [1249753,120529] 0 2024-04-03T08:39:34.831 INFO:tasks.workunit.client.1.smithi181.stdout:4/776: read - d1/d16/d24/d5e/d2b/d56/f7e zero size 2024-04-03T08:39:34.832 INFO:tasks.workunit.client.1.smithi181.stdout:4/777: stat d1/c19 0 2024-04-03T08:39:34.833 INFO:tasks.workunit.client.1.smithi181.stdout:0/729: chown d5/dc/d14/d29/c84 75 1 2024-04-03T08:39:34.835 INFO:tasks.workunit.client.1.smithi181.stdout:0/730: write d5/d9/d2a/da1/fd3 [3744432,35273] 0 2024-04-03T08:39:34.836 INFO:tasks.workunit.client.1.smithi181.stdout:2/830: fsync d13/d1c/d6c/fa2 0 2024-04-03T08:39:34.837 INFO:tasks.workunit.client.1.smithi181.stdout:0/731: chown d5/dc/d75 68 1 2024-04-03T08:39:34.838 INFO:tasks.workunit.client.1.smithi181.stdout:8/691: rmdir d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e 39 2024-04-03T08:39:34.839 INFO:tasks.workunit.client.1.smithi181.stdout:0/732: read - d5/d9/d2a/de6/dcc/fd8 zero size 2024-04-03T08:39:34.839 INFO:tasks.workunit.client.0.smithi157.stdout:2/850: write d3/db/d44/d4c/d5a/d88/df6/f11c [196968,82470] 0 2024-04-03T08:39:34.842 INFO:tasks.workunit.client.1.smithi181.stdout:5/741: creat d4/d56/ff0 x:0 0 0 2024-04-03T08:39:34.844 INFO:tasks.workunit.client.1.smithi181.stdout:5/742: write d4/d18/d55/db4/fd8 [85147,97689] 0 2024-04-03T08:39:34.845 INFO:tasks.workunit.client.0.smithi157.stdout:6/878: truncate d1/d5/d17/fba 1338090 0 2024-04-03T08:39:34.847 INFO:tasks.workunit.client.1.smithi181.stdout:1/743: getdents d10/d15/d17/d19/dc3 0 2024-04-03T08:39:34.854 INFO:tasks.workunit.client.1.smithi181.stdout:3/800: rmdir d0/d17 39 2024-04-03T08:39:34.855 INFO:tasks.workunit.client.1.smithi181.stdout:2/831: creat d13/d1c/d4a/d68/dfa/df9/f12f x:0 0 0 2024-04-03T08:39:34.857 INFO:tasks.workunit.client.1.smithi181.stdout:8/692: write d4/d45/db/d14/dd0/fd9 [1556554,32797] 0 2024-04-03T08:39:34.858 INFO:tasks.workunit.client.1.smithi181.stdout:6/799: mkdir d6/d31/d36/dba/da6/d4f/dd1/d9/dfd 0 2024-04-03T08:39:34.858 INFO:tasks.workunit.client.1.smithi181.stdout:4/778: dwrite d1/d16/d24/d5e/f50 [0,4194304] 0 2024-04-03T08:39:34.859 INFO:tasks.workunit.client.1.smithi181.stdout:8/693: chown d4/d45/f9b 3900924 1 2024-04-03T08:39:34.862 INFO:tasks.workunit.client.1.smithi181.stdout:0/733: rename d5/d9/d2e to d5/dc/d14/de5/deb 0 2024-04-03T08:39:34.864 INFO:tasks.workunit.client.1.smithi181.stdout:0/734: write d5/dc/d10/d58/f8b [168574,8713] 0 2024-04-03T08:39:34.866 INFO:tasks.workunit.client.1.smithi181.stdout:0/735: readlink d5/dc/d10/d58/dba/d90/l99 0 2024-04-03T08:39:34.867 INFO:tasks.workunit.client.1.smithi181.stdout:5/743: creat d4/d18/d55/db4/d90/ff1 x:0 0 0 2024-04-03T08:39:34.869 INFO:tasks.workunit.client.1.smithi181.stdout:0/736: write d5/dc/d75/fe4 [882042,7730] 0 2024-04-03T08:39:34.870 INFO:tasks.workunit.client.1.smithi181.stdout:5/744: chown d4/d18/d55/db4/d90/ccc 219855011 1 2024-04-03T08:39:34.871 INFO:tasks.workunit.client.1.smithi181.stdout:1/744: mknod d10/d15/d17/d30/cf0 0 2024-04-03T08:39:34.873 INFO:tasks.workunit.client.1.smithi181.stdout:1/745: chown d10/d15/d41/f44 6547381 1 2024-04-03T08:39:34.874 INFO:tasks.workunit.client.1.smithi181.stdout:3/801: read - d0/d17/f26 zero size 2024-04-03T08:39:34.875 INFO:tasks.workunit.client.1.smithi181.stdout:2/832: unlink d13/d1c/d6c/d7a/ffe 0 2024-04-03T08:39:34.877 INFO:tasks.workunit.client.1.smithi181.stdout:4/779: creat d1/d1e/d2c/d67/d93/f102 x:0 0 0 2024-04-03T08:39:34.879 INFO:tasks.workunit.client.1.smithi181.stdout:4/780: fdatasync d1/d16/d24/d5e/d3f/d81/ff4 0 2024-04-03T08:39:34.884 INFO:tasks.workunit.client.1.smithi181.stdout:0/737: mkdir d5/dc/d14/d8d/dec 0 2024-04-03T08:39:34.885 INFO:tasks.workunit.client.1.smithi181.stdout:0/738: chown d5/dc/d10/d30/dab/laf 83936935 1 2024-04-03T08:39:34.887 INFO:tasks.workunit.client.1.smithi181.stdout:0/739: chown d5/dc/d10/d58/db0/fde 2029 1 2024-04-03T08:39:34.887 INFO:tasks.workunit.client.1.smithi181.stdout:5/745: rename d4/d18/d25/d59/db3/dd0 to d4/d18/d25/de7/df2 0 2024-04-03T08:39:34.889 INFO:tasks.workunit.client.1.smithi181.stdout:1/746: fdatasync d10/d15/d17/d19/d33/f64 0 2024-04-03T08:39:34.892 INFO:tasks.workunit.client.1.smithi181.stdout:2/833: mknod d13/da7/d40/c130 0 2024-04-03T08:39:34.900 INFO:tasks.workunit.client.0.smithi157.stdout:8/883: creat d2/d6f/d70/d89/d59/df6/f12a x:0 0 0 2024-04-03T08:39:34.902 INFO:tasks.workunit.client.0.smithi157.stdout:8/884: dread - d2/d20/d77/f7f zero size 2024-04-03T08:39:34.902 INFO:tasks.workunit.client.0.smithi157.stdout:5/902: mkdir dc/d29/d56/d9e/dc3/dde/de4/d12d/d12f 0 2024-04-03T08:39:34.904 INFO:tasks.workunit.client.1.smithi181.stdout:0/740: chown d5/dc/d14/d29/fc2 207 1 2024-04-03T08:39:34.906 INFO:tasks.workunit.client.1.smithi181.stdout:5/746: chown d4/d22/d78/lc4 1758 1 2024-04-03T08:39:34.910 INFO:tasks.workunit.client.1.smithi181.stdout:3/802: mkdir d0/d17/d10f 0 2024-04-03T08:39:34.910 INFO:tasks.workunit.client.1.smithi181.stdout:3/803: fdatasync d0/ffa 0 2024-04-03T08:39:34.911 INFO:tasks.workunit.client.0.smithi157.stdout:1/786: creat d2/d11/d24/dd5/f109 x:0 0 0 2024-04-03T08:39:34.912 INFO:tasks.workunit.client.0.smithi157.stdout:4/810: dread da/df/d2f/f4f [4194304,4194304] 0 2024-04-03T08:39:34.914 INFO:tasks.workunit.client.1.smithi181.stdout:3/804: truncate d0/d5/d6/dd/d25/f44 4484680 0 2024-04-03T08:39:34.914 INFO:tasks.workunit.client.1.smithi181.stdout:2/834: truncate d13/da7/f7d 281345 0 2024-04-03T08:39:34.915 INFO:tasks.workunit.client.0.smithi157.stdout:0/952: fsync d2/d9/dc/df/d1b/f59 0 2024-04-03T08:39:34.916 INFO:tasks.workunit.client.1.smithi181.stdout:2/835: write d13/fdd [4103104,130350] 0 2024-04-03T08:39:34.918 INFO:tasks.workunit.client.0.smithi157.stdout:6/879: truncate d1/d5/d17/d2a/d73/fc4 699184 0 2024-04-03T08:39:34.919 INFO:tasks.workunit.client.1.smithi181.stdout:3/805: truncate d0/d17/d36/fb9 823630 0 2024-04-03T08:39:34.920 INFO:tasks.workunit.client.1.smithi181.stdout:0/741: rename d5/d9/d2a/de6/dcc/ce8 to d5/d9/d2a/ced 0 2024-04-03T08:39:34.921 INFO:tasks.workunit.client.1.smithi181.stdout:5/747: dwrite d4/d56/ff0 [0,4194304] 0 2024-04-03T08:39:34.926 INFO:tasks.workunit.client.1.smithi181.stdout:4/781: write d1/d16/d24/d5e/f4f [2858317,45784] 0 2024-04-03T08:39:34.926 INFO:tasks.workunit.client.0.smithi157.stdout:9/909: symlink d1/d15/d27/daf/l12e 0 2024-04-03T08:39:34.929 INFO:tasks.workunit.client.1.smithi181.stdout:6/800: getdents d6/d31/d36/dba/da6/d4f/dd1/d50 0 2024-04-03T08:39:34.932 INFO:tasks.workunit.client.1.smithi181.stdout:2/836: mkdir d13/d1c/d4a/d7f/db3/d8f/d131 0 2024-04-03T08:39:34.935 INFO:tasks.workunit.client.0.smithi157.stdout:4/811: rename da/df/d24/d35/d53/d69 to da/d7e/d119 0 2024-04-03T08:39:34.940 INFO:tasks.workunit.client.0.smithi157.stdout:7/889: dread d0/d11/d6f/d76/da7/f23 [0,4194304] 0 2024-04-03T08:39:34.941 INFO:tasks.workunit.client.1.smithi181.stdout:9/782: sync 2024-04-03T08:39:34.942 INFO:tasks.workunit.client.0.smithi157.stdout:5/903: write dc/d29/f57 [2434620,48584] 0 2024-04-03T08:39:34.943 INFO:tasks.workunit.client.0.smithi157.stdout:5/904: stat dc/dbb/fe3 0 2024-04-03T08:39:34.943 INFO:tasks.workunit.client.0.smithi157.stdout:8/885: getdents d2/d20/db1/d111/d126 0 2024-04-03T08:39:34.944 INFO:tasks.workunit.client.1.smithi181.stdout:1/747: truncate d10/d15/d17/d30/f55 1737007 0 2024-04-03T08:39:34.946 INFO:tasks.workunit.client.1.smithi181.stdout:6/801: rename d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/ffa to d6/d3e/db1/dc4/dc9/ffe 0 2024-04-03T08:39:34.948 INFO:tasks.workunit.client.0.smithi157.stdout:9/910: fsync d1/d15/d27/daf/da7/d123/dbe/dbf/fc2 0 2024-04-03T08:39:34.950 INFO:tasks.workunit.client.0.smithi157.stdout:4/812: mknod da/df/d11/d5d/c11a 0 2024-04-03T08:39:34.951 INFO:tasks.workunit.client.0.smithi157.stdout:9/911: dread d1/d15/d27/d34/f53 [0,4194304] 0 2024-04-03T08:39:34.953 INFO:tasks.workunit.client.0.smithi157.stdout:2/851: write d3/d2e/f75 [662397,94107] 0 2024-04-03T08:39:34.953 INFO:tasks.workunit.client.1.smithi181.stdout:9/783: chown d1/c82 29194 1 2024-04-03T08:39:34.954 INFO:tasks.workunit.client.1.smithi181.stdout:6/802: dread d6/d31/d36/dba/fae [0,4194304] 0 2024-04-03T08:39:34.955 INFO:tasks.workunit.client.1.smithi181.stdout:0/742: chown d5/d9/d2a/ced 554788 1 2024-04-03T08:39:34.958 INFO:tasks.workunit.client.1.smithi181.stdout:4/782: creat d1/d1e/d2c/de4/df7/f103 x:0 0 0 2024-04-03T08:39:34.960 INFO:tasks.workunit.client.0.smithi157.stdout:5/905: truncate dc/d29/d56/d52/f58 2708198 0 2024-04-03T08:39:34.962 INFO:tasks.workunit.client.1.smithi181.stdout:1/748: mkdir d10/d15/d4a/d86/df1 0 2024-04-03T08:39:34.962 INFO:tasks.workunit.client.1.smithi181.stdout:5/748: dwrite d4/d18/d55/d5a/fbf [0,4194304] 0 2024-04-03T08:39:34.964 INFO:tasks.workunit.client.0.smithi157.stdout:6/880: creat d1/d5/d17/d2a/f131 x:0 0 0 2024-04-03T08:39:34.965 INFO:tasks.workunit.client.0.smithi157.stdout:5/906: dread dc/f85 [0,4194304] 0 2024-04-03T08:39:34.965 INFO:tasks.workunit.client.1.smithi181.stdout:5/749: chown d4/d18/d25/d68/c8c 463 1 2024-04-03T08:39:34.969 INFO:tasks.workunit.client.0.smithi157.stdout:7/890: creat d0/d75/f134 x:0 0 0 2024-04-03T08:39:34.971 INFO:tasks.workunit.client.1.smithi181.stdout:6/803: dwrite d6/d31/d36/dba/da6/d4f/fa9 [0,4194304] 0 2024-04-03T08:39:34.973 INFO:tasks.workunit.client.0.smithi157.stdout:2/852: dwrite d3/db/d44/d4c/df1/ff9 [0,4194304] 0 2024-04-03T08:39:34.975 INFO:tasks.workunit.client.1.smithi181.stdout:6/804: dread - d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/fdf zero size 2024-04-03T08:39:34.979 INFO:tasks.workunit.client.0.smithi157.stdout:7/891: write d0/d11/d15/d1b/db8/f3b [849101,127349] 0 2024-04-03T08:39:34.979 INFO:tasks.workunit.client.1.smithi181.stdout:6/805: truncate d6/d31/d36/dba/da6/d4f/f7a 3049916 0 2024-04-03T08:39:34.981 INFO:tasks.workunit.client.1.smithi181.stdout:3/806: getdents d0/d5/d6f 0 2024-04-03T08:39:34.981 INFO:tasks.workunit.client.0.smithi157.stdout:4/813: rename da/df/d24/d35/d53/f84 to da/f11b 0 2024-04-03T08:39:34.991 INFO:tasks.workunit.client.1.smithi181.stdout:0/743: mknod d5/dc/d14/cee 0 2024-04-03T08:39:34.992 INFO:tasks.workunit.client.0.smithi157.stdout:5/907: chown dc/d29/d43/da1/ld8 1 1 2024-04-03T08:39:34.992 INFO:tasks.workunit.client.0.smithi157.stdout:2/853: creat d3/db/d44/d4c/df1/f122 x:0 0 0 2024-04-03T08:39:34.992 INFO:tasks.workunit.client.0.smithi157.stdout:9/912: dread d1/d15/f1a [0,4194304] 0 2024-04-03T08:39:34.993 INFO:tasks.workunit.client.1.smithi181.stdout:4/783: write d1/d16/d24/d5e/d2b/d56/f71 [3520586,124049] 0 2024-04-03T08:39:34.995 INFO:tasks.workunit.client.0.smithi157.stdout:7/892: fsync d0/d11/d15/d17/f77 0 2024-04-03T08:39:34.995 INFO:tasks.workunit.client.1.smithi181.stdout:0/744: truncate d5/dc/d8e/dea/fa6 602582 0 2024-04-03T08:39:34.995 INFO:tasks.workunit.client.1.smithi181.stdout:4/784: fsync d1/d1e/d2c/f77 0 2024-04-03T08:39:34.996 INFO:tasks.workunit.client.1.smithi181.stdout:2/837: rename d13/d1c/d4a/d7f/db3/d8f/f93 to d13/da7/f132 0 2024-04-03T08:39:34.997 INFO:tasks.workunit.client.0.smithi157.stdout:9/913: read - d1/d4a/d4d/d86/dd5/f11a zero size 2024-04-03T08:39:34.999 INFO:tasks.workunit.client.1.smithi181.stdout:6/806: chown d6/d31/c35 25940 1 2024-04-03T08:39:35.003 INFO:tasks.workunit.client.0.smithi157.stdout:4/814: rmdir da/df/d2f/d64/d8f/dbd 39 2024-04-03T08:39:35.003 INFO:tasks.workunit.client.0.smithi157.stdout:5/908: mknod dc/d29/d56/d9e/dc3/dde/c130 0 2024-04-03T08:39:35.004 INFO:tasks.workunit.client.1.smithi181.stdout:7/692: sync 2024-04-03T08:39:35.005 INFO:tasks.workunit.client.0.smithi157.stdout:4/815: chown da/df/d2f/d54 210105255 1 2024-04-03T08:39:35.006 INFO:tasks.workunit.client.1.smithi181.stdout:9/784: rename d1/da/d28/d30/d3e/d77 to d1/da/d13/d41/daf/df1 0 2024-04-03T08:39:35.012 INFO:tasks.workunit.client.1.smithi181.stdout:0/745: write d5/d9/f1d [1223059,114708] 0 2024-04-03T08:39:35.016 INFO:tasks.workunit.client.0.smithi157.stdout:6/881: getdents d1/d5/d17/d2a/d30 0 2024-04-03T08:39:35.020 INFO:tasks.workunit.client.1.smithi181.stdout:4/785: write d1/d16/d24/d5e/d2b/d56/f7e [35810,117943] 0 2024-04-03T08:39:35.020 INFO:tasks.workunit.client.1.smithi181.stdout:6/807: mknod d6/d31/d36/d73/cff 0 2024-04-03T08:39:35.022 INFO:tasks.workunit.client.0.smithi157.stdout:5/909: truncate dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/f8e 1498800 0 2024-04-03T08:39:35.029 INFO:tasks.workunit.client.0.smithi157.stdout:7/893: dwrite d0/d11/d6f/d76/da7/f62 [0,4194304] 0 2024-04-03T08:39:35.038 INFO:tasks.workunit.client.0.smithi157.stdout:5/910: rmdir dc/d29/d56 39 2024-04-03T08:39:35.038 INFO:tasks.workunit.client.1.smithi181.stdout:3/807: creat d0/f110 x:0 0 0 2024-04-03T08:39:35.038 INFO:tasks.workunit.client.0.smithi157.stdout:4/816: write da/df/d2f/d64/d8f/dbd/fa4 [1715790,68781] 0 2024-04-03T08:39:35.039 INFO:tasks.workunit.client.1.smithi181.stdout:5/750: getdents d4/d18/d55/db4/d90 0 2024-04-03T08:39:35.040 INFO:tasks.workunit.client.0.smithi157.stdout:7/894: truncate d0/d11/d15/d17/d1c/f28 257796 0 2024-04-03T08:39:35.040 INFO:tasks.workunit.client.1.smithi181.stdout:7/693: dread d0/d1/d6/de/d6d/f77 [0,4194304] 0 2024-04-03T08:39:35.042 INFO:tasks.workunit.client.1.smithi181.stdout:6/808: chown d6/d53/d8d/d97/dcc 92541844 1 2024-04-03T08:39:35.044 INFO:tasks.workunit.client.0.smithi157.stdout:6/882: dwrite d1/d5/d17/d2a/d37/dca/f117 [0,4194304] 0 2024-04-03T08:39:35.044 INFO:tasks.workunit.client.1.smithi181.stdout:7/694: chown d0/d1/d6/de/d17/d27/d93/cf6 23941 1 2024-04-03T08:39:35.044 INFO:tasks.workunit.client.1.smithi181.stdout:4/786: creat d1/d16/d24/d5e/d3f/d6c/f104 x:0 0 0 2024-04-03T08:39:35.047 INFO:tasks.workunit.client.0.smithi157.stdout:9/914: dwrite d1/d15/d27/d5c/d79/f7c [4194304,4194304] 0 2024-04-03T08:39:35.048 INFO:tasks.workunit.client.1.smithi181.stdout:1/749: rename d10/d15/d17/d19/fd5 to d10/d15/d4b/ff2 0 2024-04-03T08:39:35.048 INFO:tasks.workunit.client.1.smithi181.stdout:7/695: write d0/d1/d6/de/d17/d64/d85/d9a/fcd [214947,36421] 0 2024-04-03T08:39:35.050 INFO:tasks.workunit.client.0.smithi157.stdout:9/915: chown d1/d15/d27/f47 80459462 1 2024-04-03T08:39:35.050 INFO:tasks.workunit.client.1.smithi181.stdout:9/785: mkdir d1/da/d1a/d92/dda/df2 0 2024-04-03T08:39:35.059 INFO:tasks.workunit.client.0.smithi157.stdout:6/883: truncate d1/d5/f46 2031184 0 2024-04-03T08:39:35.060 INFO:tasks.workunit.client.0.smithi157.stdout:9/916: creat d1/d4a/d4d/f12f x:0 0 0 2024-04-03T08:39:35.061 INFO:tasks.workunit.client.0.smithi157.stdout:4/817: symlink da/df/d24/d35/d53/de3/l11c 0 2024-04-03T08:39:35.062 INFO:tasks.workunit.client.1.smithi181.stdout:6/809: mkdir d6/d31/dbe/d100 0 2024-04-03T08:39:35.063 INFO:tasks.workunit.client.1.smithi181.stdout:4/787: mkdir d1/d16/d24/d5e/d3f/d81/d105 0 2024-04-03T08:39:35.065 INFO:tasks.workunit.client.1.smithi181.stdout:7/696: creat d0/d1/d6/de/d6d/f100 x:0 0 0 2024-04-03T08:39:35.065 INFO:tasks.workunit.client.1.smithi181.stdout:8/694: sync 2024-04-03T08:39:35.067 INFO:tasks.workunit.client.1.smithi181.stdout:0/746: creat d5/fef x:0 0 0 2024-04-03T08:39:35.071 INFO:tasks.workunit.client.1.smithi181.stdout:2/838: link d13/d1c/d4a/d7f/db3/d8f/c120 d13/da7/d85/de4/c133 0 2024-04-03T08:39:35.072 INFO:tasks.workunit.client.1.smithi181.stdout:0/747: write d5/d9/d2a/de6/fad [3720730,24079] 0 2024-04-03T08:39:35.073 INFO:tasks.workunit.client.0.smithi157.stdout:6/884: mkdir d1/d5/d17/d2a/d37/dca/d132 0 2024-04-03T08:39:35.076 INFO:tasks.workunit.client.1.smithi181.stdout:4/788: dread d1/d16/f13 [0,4194304] 0 2024-04-03T08:39:35.080 INFO:tasks.workunit.client.1.smithi181.stdout:7/697: stat d0/d1/d6/de/d17/d27/l97 0 2024-04-03T08:39:35.082 INFO:tasks.workunit.client.0.smithi157.stdout:6/885: creat d1/d5/d17/d29/da7/db9/dfb/f133 x:0 0 0 2024-04-03T08:39:35.082 INFO:tasks.workunit.client.0.smithi157.stdout:4/818: dwrite da/df/d24/f5c [0,4194304] 0 2024-04-03T08:39:35.083 INFO:tasks.workunit.client.1.smithi181.stdout:1/750: dread d10/d15/d41/fad [0,4194304] 0 2024-04-03T08:39:35.085 INFO:tasks.workunit.client.0.smithi157.stdout:6/886: stat d1/d5/d17/d2a/d73/c44 0 2024-04-03T08:39:35.088 INFO:tasks.workunit.client.0.smithi157.stdout:9/917: getdents d1/d15/d27/d5c/dbd 0 2024-04-03T08:39:35.089 INFO:tasks.workunit.client.0.smithi157.stdout:5/911: dread dc/d29/fa7 [0,4194304] 0 2024-04-03T08:39:35.090 INFO:tasks.workunit.client.1.smithi181.stdout:2/839: mknod d13/da7/d40/d10f/c134 0 2024-04-03T08:39:35.090 INFO:tasks.workunit.client.1.smithi181.stdout:8/695: dread d4/d44/fb3 [0,4194304] 0 2024-04-03T08:39:35.093 INFO:tasks.workunit.client.0.smithi157.stdout:7/895: dwrite d0/d11/d15/d1b/db8/fce [0,4194304] 0 2024-04-03T08:39:35.093 INFO:tasks.workunit.client.1.smithi181.stdout:5/751: creat d4/d18/d55/db4/ff3 x:0 0 0 2024-04-03T08:39:35.096 INFO:tasks.workunit.client.0.smithi157.stdout:7/896: write d0/d11/d6f/d89/d8c/d103/de3/f125 [555228,21557] 0 2024-04-03T08:39:35.097 INFO:tasks.workunit.client.1.smithi181.stdout:3/808: dwrite d0/d5/d6/d32/d43/f9b [0,4194304] 0 2024-04-03T08:39:35.098 INFO:tasks.workunit.client.1.smithi181.stdout:0/748: symlink d5/d9/d2a/lf0 0 2024-04-03T08:39:35.103 INFO:tasks.workunit.client.1.smithi181.stdout:9/786: write d1/da/d28/d80/f97 [1338918,36615] 0 2024-04-03T08:39:35.106 INFO:tasks.workunit.client.1.smithi181.stdout:9/787: write d1/da/d13/d22/f2e [1320314,101221] 0 2024-04-03T08:39:35.110 INFO:tasks.workunit.client.1.smithi181.stdout:1/751: creat d10/d15/d17/d19/d4c/ff3 x:0 0 0 2024-04-03T08:39:35.113 INFO:tasks.workunit.client.0.smithi157.stdout:9/918: truncate d1/d36/d46/f7a 3034984 0 2024-04-03T08:39:35.114 INFO:tasks.workunit.client.0.smithi157.stdout:4/819: dwrite da/df/f104 [0,4194304] 0 2024-04-03T08:39:35.114 INFO:tasks.workunit.client.0.smithi157.stdout:7/897: creat d0/d11/d15/d17/d1c/df5/f135 x:0 0 0 2024-04-03T08:39:35.121 INFO:tasks.workunit.client.0.smithi157.stdout:7/898: read d0/d11/d6f/d89/d8c/d103/de3/d12d/f45 [2388099,43299] 0 2024-04-03T08:39:35.125 INFO:tasks.workunit.client.1.smithi181.stdout:5/752: mknod d4/d22/d4a/dad/db6/cf4 0 2024-04-03T08:39:35.128 INFO:tasks.workunit.client.1.smithi181.stdout:7/698: write d0/d1/d6/f9 [2404022,19259] 0 2024-04-03T08:39:35.129 INFO:tasks.workunit.client.1.smithi181.stdout:3/809: creat d0/d5/d6/d32/d43/f111 x:0 0 0 2024-04-03T08:39:35.134 INFO:tasks.workunit.client.1.smithi181.stdout:5/753: read d4/d18/d55/d5a/fbf [1583917,117179] 0 2024-04-03T08:39:35.135 INFO:tasks.workunit.client.1.smithi181.stdout:0/749: truncate d5/dc/d14/d29/fc2 1588913 0 2024-04-03T08:39:35.136 INFO:tasks.workunit.client.1.smithi181.stdout:7/699: write d0/d1/d6/fff [561665,26485] 0 2024-04-03T08:39:35.137 INFO:tasks.workunit.client.1.smithi181.stdout:1/752: dwrite d10/d15/d41/f61 [0,4194304] 0 2024-04-03T08:39:35.140 INFO:tasks.workunit.client.1.smithi181.stdout:6/810: link d6/d3e/db1/ld8 d6/d31/d36/dba/da6/d4f/l101 0 2024-04-03T08:39:35.140 INFO:tasks.workunit.client.0.smithi157.stdout:7/899: unlink d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/fc2 0 2024-04-03T08:39:35.140 INFO:tasks.workunit.client.1.smithi181.stdout:2/840: dwrite d13/da7/d27/f2c [4194304,4194304] 0 2024-04-03T08:39:35.148 INFO:tasks.workunit.client.0.smithi157.stdout:6/887: getdents d1/d5/d17/d29/d12f 0 2024-04-03T08:39:35.149 INFO:tasks.workunit.client.1.smithi181.stdout:8/696: dwrite d4/f88 [0,4194304] 0 2024-04-03T08:39:35.154 INFO:tasks.workunit.client.0.smithi157.stdout:9/919: dwrite d1/d15/d27/daf/da7/d123/f78 [0,4194304] 0 2024-04-03T08:39:35.159 INFO:tasks.workunit.client.1.smithi181.stdout:3/810: chown d0/d57 916640103 1 2024-04-03T08:39:35.159 INFO:tasks.workunit.client.1.smithi181.stdout:9/788: write d1/da/d28/d80/dc6/fc7 [971142,360] 0 2024-04-03T08:39:35.169 INFO:tasks.workunit.client.1.smithi181.stdout:2/841: fdatasync d13/da7/d27/f8a 0 2024-04-03T08:39:35.171 INFO:tasks.workunit.client.0.smithi157.stdout:5/912: link dc/d29/d56/d2e/f12e dc/d29/d56/d2e/f131 0 2024-04-03T08:39:35.172 INFO:tasks.workunit.client.0.smithi157.stdout:4/820: getdents da/d26 0 2024-04-03T08:39:35.173 INFO:tasks.workunit.client.1.smithi181.stdout:5/754: read d4/d18/d25/d59/db3/fb8 [516996,28665] 0 2024-04-03T08:39:35.174 INFO:tasks.workunit.client.0.smithi157.stdout:7/900: rename d0/d11/d15/d17/d52/db6/dda/l131 to d0/d11/d15/d17/d1c/d4f/d5f/d109/l136 0 2024-04-03T08:39:35.175 INFO:tasks.workunit.client.0.smithi157.stdout:9/920: mkdir d1/dab/dad/d108/d130 0 2024-04-03T08:39:35.180 INFO:tasks.workunit.client.0.smithi157.stdout:9/921: chown d1/d15/d16/d9f/ff5 32908110 1 2024-04-03T08:39:35.185 INFO:tasks.workunit.client.0.smithi157.stdout:9/922: mkdir d1/dab/dad/d108/d131 0 2024-04-03T08:39:35.185 INFO:tasks.workunit.client.1.smithi181.stdout:0/750: write d5/dc/d10/d30/f6f [294857,8428] 0 2024-04-03T08:39:35.186 INFO:tasks.workunit.client.0.smithi157.stdout:9/923: stat d1/f3f 0 2024-04-03T08:39:35.186 INFO:tasks.workunit.client.1.smithi181.stdout:3/811: creat d0/d17/d36/d3b/d5a/d85/f112 x:0 0 0 2024-04-03T08:39:35.187 INFO:tasks.workunit.client.0.smithi157.stdout:9/924: stat d1/d15/d27/d5c/dbd 0 2024-04-03T08:39:35.189 INFO:tasks.workunit.client.0.smithi157.stdout:7/901: rename d0/d11/d15/d17/d1c/d88/l122 to d0/d11/d6f/d89/d8c/d103/da5/l137 0 2024-04-03T08:39:35.193 INFO:tasks.workunit.client.0.smithi157.stdout:9/925: mknod d1/d15/d27/d34/da6/c132 0 2024-04-03T08:39:35.197 INFO:tasks.workunit.client.0.smithi157.stdout:4/821: write da/df/d11/d5d/f7d [1450655,102648] 0 2024-04-03T08:39:35.198 INFO:tasks.workunit.client.1.smithi181.stdout:7/700: truncate d0/d1/f74 6425431 0 2024-04-03T08:39:35.199 INFO:tasks.workunit.client.0.smithi157.stdout:7/902: mknod d0/d11/d15/d17/d9f/c138 0 2024-04-03T08:39:35.202 INFO:tasks.workunit.client.0.smithi157.stdout:5/913: dread dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/f6f [0,4194304] 0 2024-04-03T08:39:35.204 INFO:tasks.workunit.client.0.smithi157.stdout:4/822: unlink da/df/l22 0 2024-04-03T08:39:35.208 INFO:tasks.workunit.client.1.smithi181.stdout:3/812: symlink d0/d17/d63/dd6/l113 0 2024-04-03T08:39:35.208 INFO:tasks.workunit.client.1.smithi181.stdout:8/697: dread d4/d45/db/d14/d31/f30 [4194304,4194304] 0 2024-04-03T08:39:35.211 INFO:tasks.workunit.client.1.smithi181.stdout:3/813: write d0/d5/d6/dd/d25/f44 [431221,70308] 0 2024-04-03T08:39:35.212 INFO:tasks.workunit.client.1.smithi181.stdout:6/811: rmdir d6/d31/dbe/d100 0 2024-04-03T08:39:35.214 INFO:tasks.workunit.client.1.smithi181.stdout:3/814: chown d0/d5/d6/f39 950317 1 2024-04-03T08:39:35.215 INFO:tasks.workunit.client.1.smithi181.stdout:7/701: dwrite d0/d1/d6/de/d17/f4c [0,4194304] 0 2024-04-03T08:39:35.217 INFO:tasks.workunit.client.1.smithi181.stdout:3/815: chown d0/d5/d6/dd/d25/c2b 29538508 1 2024-04-03T08:39:35.217 INFO:tasks.workunit.client.0.smithi157.stdout:4/823: dread - da/df/d2f/d54/d5f/fb3 zero size 2024-04-03T08:39:35.221 INFO:tasks.workunit.client.1.smithi181.stdout:5/755: creat d4/d18/d55/d5a/dcd/dee/ff5 x:0 0 0 2024-04-03T08:39:35.221 INFO:tasks.workunit.client.0.smithi157.stdout:7/903: link d0/d11/d15/d17/l33 d0/d11/d15/d17/d1c/l139 0 2024-04-03T08:39:35.222 INFO:tasks.workunit.client.1.smithi181.stdout:1/753: link d10/d15/d17/d23/d27/l2d d10/d15/d17/d23/db0/d8d/lf4 0 2024-04-03T08:39:35.224 INFO:tasks.workunit.client.1.smithi181.stdout:2/842: dwrite d13/d1c/f54 [0,4194304] 0 2024-04-03T08:39:35.232 INFO:tasks.workunit.client.0.smithi157.stdout:4/824: creat da/df/d24/f11d x:0 0 0 2024-04-03T08:39:35.233 INFO:tasks.workunit.client.1.smithi181.stdout:0/751: mknod d5/dc/d75/de1/cf1 0 2024-04-03T08:39:35.236 INFO:tasks.workunit.client.0.smithi157.stdout:5/914: dwrite dc/d29/d56/fb0 [4194304,4194304] 0 2024-04-03T08:39:35.238 INFO:tasks.workunit.client.0.smithi157.stdout:7/904: mknod d0/d11/d15/d17/d9f/c13a 0 2024-04-03T08:39:35.240 INFO:tasks.workunit.client.0.smithi157.stdout:7/905: fdatasync d0/d11/d15/d17/f25 0 2024-04-03T08:39:35.240 INFO:tasks.workunit.client.0.smithi157.stdout:9/926: dread d1/d15/d27/d5c/f5f [0,4194304] 0 2024-04-03T08:39:35.244 INFO:tasks.workunit.client.1.smithi181.stdout:8/698: fsync d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fb8 0 2024-04-03T08:39:35.247 INFO:tasks.workunit.client.1.smithi181.stdout:3/816: symlink d0/d17/d36/d3b/d102/l114 0 2024-04-03T08:39:35.248 INFO:tasks.workunit.client.0.smithi157.stdout:4/825: fsync da/df/d24/d35/d6a/d76/fc6 0 2024-04-03T08:39:35.257 INFO:tasks.workunit.client.1.smithi181.stdout:7/702: rename d0/d1/d6/dca/lde to d0/d1/d6/de/d17/d64/d82/l101 0 2024-04-03T08:39:35.257 INFO:tasks.workunit.client.0.smithi157.stdout:9/927: fsync d1/d36/f12b 0 2024-04-03T08:39:35.262 INFO:tasks.workunit.client.1.smithi181.stdout:1/754: mknod d10/d15/dce/cf5 0 2024-04-03T08:39:35.262 INFO:tasks.workunit.client.1.smithi181.stdout:9/789: write d1/da/d13/d73/f7f [7954711,104267] 0 2024-04-03T08:39:35.263 INFO:tasks.workunit.client.1.smithi181.stdout:1/755: dread - d10/d15/d17/d19/dd9/fdf zero size 2024-04-03T08:39:35.266 INFO:tasks.workunit.client.1.smithi181.stdout:4/789: sync 2024-04-03T08:39:35.266 INFO:tasks.workunit.client.1.smithi181.stdout:3/817: symlink d0/d5/d77/l115 0 2024-04-03T08:39:35.269 INFO:tasks.workunit.client.1.smithi181.stdout:6/812: write d6/d31/d36/dba/da6/d4f/f55 [1272519,91984] 0 2024-04-03T08:39:35.273 INFO:tasks.workunit.client.1.smithi181.stdout:7/703: readlink d0/d1/d6/de/d17/d27/ld0 0 2024-04-03T08:39:35.274 INFO:tasks.workunit.client.0.smithi157.stdout:5/915: write dc/d29/d56/d9e/dc3/ff0 [679435,51592] 0 2024-04-03T08:39:35.277 INFO:tasks.workunit.client.1.smithi181.stdout:8/699: write d4/d45/db/f66 [1483924,49818] 0 2024-04-03T08:39:35.278 INFO:tasks.workunit.client.1.smithi181.stdout:4/790: dread - d1/d16/d24/d5e/d2b/df2/fd9 zero size 2024-04-03T08:39:35.279 INFO:tasks.workunit.client.1.smithi181.stdout:0/752: dwrite d5/d9/d2a/f4f [0,4194304] 0 2024-04-03T08:39:35.280 INFO:tasks.workunit.client.0.smithi157.stdout:7/906: getdents d0/d11/d15 0 2024-04-03T08:39:35.280 INFO:tasks.workunit.client.1.smithi181.stdout:3/818: symlink d0/d17/d36/d1e/l116 0 2024-04-03T08:39:35.282 INFO:tasks.workunit.client.1.smithi181.stdout:2/843: truncate d13/d1c/d4a/d68/f9a 2339470 0 2024-04-03T08:39:35.282 INFO:tasks.workunit.client.0.smithi157.stdout:7/907: stat d0/d11/d6f/d89/d8c/d103/de3/d12d/fc9 0 2024-04-03T08:39:35.283 INFO:tasks.workunit.client.1.smithi181.stdout:2/844: readlink d13/d1c/d4a/d68/l24 0 2024-04-03T08:39:35.284 INFO:tasks.workunit.client.1.smithi181.stdout:2/845: fsync d13/f23 0 2024-04-03T08:39:35.284 INFO:tasks.workunit.client.1.smithi181.stdout:5/756: rename d4/d18/l4d to d4/d18/d25/de7/lf6 0 2024-04-03T08:39:35.288 INFO:tasks.workunit.client.0.smithi157.stdout:4/826: truncate da/df/d11/d5d/f7d 440379 0 2024-04-03T08:39:35.289 INFO:tasks.workunit.client.1.smithi181.stdout:7/704: creat d0/d1/d6/de/d6d/f102 x:0 0 0 2024-04-03T08:39:35.291 INFO:tasks.workunit.client.1.smithi181.stdout:7/705: fdatasync d0/d1/d6/de/d17/d64/fa5 0 2024-04-03T08:39:35.293 INFO:tasks.workunit.client.1.smithi181.stdout:1/756: mkdir d10/df6 0 2024-04-03T08:39:35.296 INFO:tasks.workunit.client.1.smithi181.stdout:7/706: read d0/d1/d6/de/f2a [738966,72153] 0 2024-04-03T08:39:35.296 INFO:tasks.workunit.client.0.smithi157.stdout:9/928: dwrite d1/d15/d27/f47 [0,4194304] 0 2024-04-03T08:39:35.299 INFO:tasks.workunit.client.0.smithi157.stdout:9/929: fdatasync d1/d15/f107 0 2024-04-03T08:39:35.300 INFO:tasks.workunit.client.1.smithi181.stdout:4/791: creat d1/d16/d24/d5e/d3f/d41/f106 x:0 0 0 2024-04-03T08:39:35.302 INFO:tasks.workunit.client.0.smithi157.stdout:5/916: dwrite dc/d29/d56/d18/f99 [0,4194304] 0 2024-04-03T08:39:35.304 INFO:tasks.workunit.client.1.smithi181.stdout:7/707: dread d0/d1/f4a [0,4194304] 0 2024-04-03T08:39:35.307 INFO:tasks.workunit.client.1.smithi181.stdout:3/819: mknod d0/d5/d6/d32/c117 0 2024-04-03T08:39:35.309 INFO:tasks.workunit.client.1.smithi181.stdout:8/700: write d4/d45/db/f94 [3679843,55053] 0 2024-04-03T08:39:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:34 smithi157 ceph-mon[35083]: pgmap v14: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 233 MiB/s wr, 535 op/s 2024-04-03T08:39:35.314 INFO:tasks.workunit.client.1.smithi181.stdout:5/757: readlink d4/l1e 0 2024-04-03T08:39:35.315 INFO:tasks.workunit.client.1.smithi181.stdout:5/758: fdatasync d4/d18/d2c/fc1 0 2024-04-03T08:39:35.317 INFO:tasks.workunit.client.0.smithi157.stdout:9/930: rename d1/d15/d27/f39 to d1/dab/f133 0 2024-04-03T08:39:35.318 INFO:tasks.workunit.client.0.smithi157.stdout:4/827: write da/df/d11/f82 [21130,99492] 0 2024-04-03T08:39:35.319 INFO:tasks.workunit.client.0.smithi157.stdout:4/828: chown da/df/d11/df9 26428 1 2024-04-03T08:39:35.321 INFO:tasks.workunit.client.1.smithi181.stdout:9/790: rename d1/da/d13/d22/d23/de0/fe5 to d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 0 2024-04-03T08:39:35.322 INFO:tasks.workunit.client.0.smithi157.stdout:4/829: dread - da/df/d99/ddb/f109 zero size 2024-04-03T08:39:35.322 INFO:tasks.workunit.client.0.smithi157.stdout:7/908: link d0/d11/d15/d17/l33 d0/d11/d6f/d89/d8c/d103/d8e/d96/df4/d110/l13b 0 2024-04-03T08:39:35.323 INFO:tasks.workunit.client.1.smithi181.stdout:0/753: write d5/d9/d2a/de6/f7a [4654376,126371] 0 2024-04-03T08:39:35.327 INFO:tasks.workunit.client.1.smithi181.stdout:2/846: read d13/d1c/d4a/d68/f86 [51633,30436] 0 2024-04-03T08:39:35.328 INFO:tasks.workunit.client.0.smithi157.stdout:9/931: unlink d1/l4e 0 2024-04-03T08:39:35.331 INFO:tasks.workunit.client.1.smithi181.stdout:1/757: readlink d10/d15/d4b/d6c/l8a 0 2024-04-03T08:39:35.334 INFO:tasks.workunit.client.0.smithi157.stdout:4/830: unlink da/df/d2f/d64/d8f/dbd/d68/lde 0 2024-04-03T08:39:35.343 INFO:tasks.workunit.client.0.smithi157.stdout:5/917: rename dc/d29/d56/d2e/fd5 to dc/d29/d56/d9e/db5/dc9/d124/f132 0 2024-04-03T08:39:35.344 INFO:tasks.workunit.client.1.smithi181.stdout:1/758: dwrite d10/d15/d4a/d6f/faf [0,4194304] 0 2024-04-03T08:39:35.344 INFO:tasks.workunit.client.1.smithi181.stdout:7/708: creat d0/d1/d6/de/d17/d64/d85/dd8/f103 x:0 0 0 2024-04-03T08:39:35.345 INFO:tasks.workunit.client.0.smithi157.stdout:4/831: unlink da/df/d2f/d54/d5f/c8e 0 2024-04-03T08:39:35.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:34 smithi181 ceph-mon[44183]: pgmap v14: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 233 MiB/s wr, 535 op/s 2024-04-03T08:39:35.347 INFO:tasks.workunit.client.1.smithi181.stdout:3/820: unlink d0/d5/d6f/l69 0 2024-04-03T08:39:35.351 INFO:tasks.workunit.client.0.smithi157.stdout:7/909: mknod d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/d5b/c13c 0 2024-04-03T08:39:35.357 INFO:tasks.workunit.client.0.smithi157.stdout:9/932: write d1/f93 [1325265,29873] 0 2024-04-03T08:39:35.357 INFO:tasks.workunit.client.0.smithi157.stdout:4/832: write da/de0/fed [5169686,4818] 0 2024-04-03T08:39:35.362 INFO:tasks.workunit.client.1.smithi181.stdout:6/813: creat d6/d31/d36/dba/da6/f102 x:0 0 0 2024-04-03T08:39:35.362 INFO:tasks.workunit.client.0.smithi157.stdout:5/918: read dc/d29/d43/fb7 [1133277,50117] 0 2024-04-03T08:39:35.362 INFO:tasks.workunit.client.1.smithi181.stdout:9/791: creat d1/da/d13/d41/daf/df1/ff4 x:0 0 0 2024-04-03T08:39:35.363 INFO:tasks.workunit.client.0.smithi157.stdout:3/859: sync 2024-04-03T08:39:35.365 INFO:tasks.workunit.client.1.smithi181.stdout:2/847: creat d13/d1c/da5/dac/f135 x:0 0 0 2024-04-03T08:39:35.365 INFO:tasks.workunit.client.0.smithi157.stdout:9/933: fsync d1/f42 0 2024-04-03T08:39:35.366 INFO:tasks.workunit.client.1.smithi181.stdout:6/814: chown d6/d31/d36/dba/da6/d4f/f66 6 1 2024-04-03T08:39:35.367 INFO:tasks.workunit.client.1.smithi181.stdout:2/848: fdatasync d13/f108 0 2024-04-03T08:39:35.368 INFO:tasks.workunit.client.1.smithi181.stdout:9/792: write d1/da/d13/d41/daf/fbf [2099562,25266] 0 2024-04-03T08:39:35.368 INFO:tasks.workunit.client.0.smithi157.stdout:5/919: creat dc/d29/d56/d9e/dc3/f133 x:0 0 0 2024-04-03T08:39:35.370 INFO:tasks.workunit.client.0.smithi157.stdout:5/920: chown dc/dbb/fe3 238071 1 2024-04-03T08:39:35.373 INFO:tasks.workunit.client.1.smithi181.stdout:1/759: dread d10/d15/d4b/d6c/f9f [4194304,4194304] 0 2024-04-03T08:39:35.378 INFO:tasks.workunit.client.1.smithi181.stdout:3/821: creat d0/d5/d6f/f118 x:0 0 0 2024-04-03T08:39:35.381 INFO:tasks.workunit.client.1.smithi181.stdout:8/701: rename d4/d2a/c3b to d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/ceb 0 2024-04-03T08:39:35.383 INFO:tasks.workunit.client.0.smithi157.stdout:5/921: mknod dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/ddb/c134 0 2024-04-03T08:39:35.384 INFO:tasks.workunit.client.1.smithi181.stdout:6/815: dwrite d6/d31/d36/f87 [0,4194304] 0 2024-04-03T08:39:35.384 INFO:tasks.workunit.client.0.smithi157.stdout:5/922: stat dc/d29/d56/d9e/c110 0 2024-04-03T08:39:35.385 INFO:tasks.workunit.client.0.smithi157.stdout:4/833: rename da/df/d24/f5c to da/df/d11/f11e 0 2024-04-03T08:39:35.386 INFO:tasks.workunit.client.1.smithi181.stdout:9/793: dwrite d1/da/d13/d22/d23/d36/d91/fb8 [0,4194304] 0 2024-04-03T08:39:35.388 INFO:tasks.workunit.client.0.smithi157.stdout:7/910: dread d0/d11/d6f/fe9 [0,4194304] 0 2024-04-03T08:39:35.397 INFO:tasks.workunit.client.0.smithi157.stdout:3/860: truncate d8/d1e/d2d/d39/d51/d7e/db1/de7/f116 940701 0 2024-04-03T08:39:35.397 INFO:tasks.workunit.client.0.smithi157.stdout:7/911: truncate d0/d11/d6f/d89/d8c/d103/d8e/d96/df4/ffb 4704516 0 2024-04-03T08:39:35.399 INFO:tasks.workunit.client.1.smithi181.stdout:4/792: truncate d1/d16/d24/d5e/d31/f75 419 0 2024-04-03T08:39:35.401 INFO:tasks.workunit.client.1.smithi181.stdout:5/759: dwrite d4/d22/f38 [0,4194304] 0 2024-04-03T08:39:35.402 INFO:tasks.workunit.client.0.smithi157.stdout:3/861: mkdir d8/d1e/d2d/d39/d12c 0 2024-04-03T08:39:35.403 INFO:tasks.workunit.client.1.smithi181.stdout:1/760: truncate d10/d15/d4a/d6f/fa8 4433967 0 2024-04-03T08:39:35.405 INFO:tasks.workunit.client.0.smithi157.stdout:3/862: fdatasync d8/d1e/d2d/d39/d51/d48/dce/fcf 0 2024-04-03T08:39:35.407 INFO:tasks.workunit.client.1.smithi181.stdout:6/816: rename d6/d7b to d6/dc0/d103 0 2024-04-03T08:39:35.408 INFO:tasks.workunit.client.1.smithi181.stdout:9/794: symlink d1/da/d13/d41/d65/dbb/lf5 0 2024-04-03T08:39:35.411 INFO:tasks.workunit.client.1.smithi181.stdout:9/795: chown d1/da/d13/d41/d32/fcd 195 1 2024-04-03T08:39:35.411 INFO:tasks.workunit.client.1.smithi181.stdout:2/849: symlink d13/l136 0 2024-04-03T08:39:35.411 INFO:tasks.workunit.client.0.smithi157.stdout:3/863: rmdir d8/d1e/d2d 39 2024-04-03T08:39:35.413 INFO:tasks.workunit.client.1.smithi181.stdout:5/760: creat d4/d22/d78/ff7 x:0 0 0 2024-04-03T08:39:35.413 INFO:tasks.workunit.client.1.smithi181.stdout:2/850: dread - d13/da7/fb2 zero size 2024-04-03T08:39:35.416 INFO:tasks.workunit.client.0.smithi157.stdout:3/864: write d8/d1e/d2d/d3f/d4d/d8f/fff [6859,57359] 0 2024-04-03T08:39:35.416 INFO:tasks.workunit.client.1.smithi181.stdout:7/709: link d0/d1/d6/db0/lbb d0/d1/d6/de/d6d/d96/dbf/l104 0 2024-04-03T08:39:35.417 INFO:tasks.workunit.client.0.smithi157.stdout:3/865: readlink d8/d1e/lcb 0 2024-04-03T08:39:35.417 INFO:tasks.workunit.client.1.smithi181.stdout:0/754: getdents d5/dc/d75/de1 0 2024-04-03T08:39:35.417 INFO:tasks.workunit.client.1.smithi181.stdout:1/761: creat d10/d15/d17/d19/d33/d70/ff7 x:0 0 0 2024-04-03T08:39:35.418 INFO:tasks.workunit.client.1.smithi181.stdout:2/851: dread - d13/d1c/d4a/d7f/db3/dbf/dd8/f117 zero size 2024-04-03T08:39:35.419 INFO:tasks.workunit.client.1.smithi181.stdout:4/793: mkdir d1/d16/d24/d5e/d31/d39/d5d/d107 0 2024-04-03T08:39:35.420 INFO:tasks.workunit.client.1.smithi181.stdout:7/710: chown d0/d1/d6/l33 8022 1 2024-04-03T08:39:35.421 INFO:tasks.workunit.client.1.smithi181.stdout:5/761: truncate d4/d18/f5c 3354649 0 2024-04-03T08:39:35.423 INFO:tasks.workunit.client.1.smithi181.stdout:4/794: write d1/d16/f23 [3725631,4203] 0 2024-04-03T08:39:35.424 INFO:tasks.workunit.client.1.smithi181.stdout:5/762: chown d4/d18/d2c 10893282 1 2024-04-03T08:39:35.424 INFO:tasks.workunit.client.0.smithi157.stdout:3/866: mknod d8/d1e/d2d/d3f/d4d/c12d 0 2024-04-03T08:39:35.428 INFO:tasks.workunit.client.0.smithi157.stdout:9/934: write d1/d36/d46/f7a [2385219,111110] 0 2024-04-03T08:39:35.429 INFO:tasks.workunit.client.1.smithi181.stdout:7/711: chown d0/d1/d6/de/d17/d64/d85/d9a/da4/fc2 150941 1 2024-04-03T08:39:35.430 INFO:tasks.workunit.client.1.smithi181.stdout:5/763: write d4/d22/d4a/fca [588270,16637] 0 2024-04-03T08:39:35.430 INFO:tasks.workunit.client.0.smithi157.stdout:9/935: chown d1/d4a/lc1 6 1 2024-04-03T08:39:35.430 INFO:tasks.workunit.client.0.smithi157.stdout:3/867: mkdir d8/d1e/d2d/d39/d51/d4c/dd6/de0/d12e 0 2024-04-03T08:39:35.431 INFO:tasks.workunit.client.1.smithi181.stdout:5/764: chown d4/cb 113575 1 2024-04-03T08:39:35.432 INFO:tasks.workunit.client.1.smithi181.stdout:8/702: link d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/cdb d4/cec 0 2024-04-03T08:39:35.433 INFO:tasks.workunit.client.0.smithi157.stdout:5/923: write dc/d29/d43/f66 [81870,92921] 0 2024-04-03T08:39:35.433 INFO:tasks.workunit.client.0.smithi157.stdout:9/936: chown d1/d15/f31 35 1 2024-04-03T08:39:35.435 INFO:tasks.workunit.client.0.smithi157.stdout:3/868: dread - d8/d1e/d2d/d39/d51/d7e/db1/df5/f127 zero size 2024-04-03T08:39:35.436 INFO:tasks.workunit.client.1.smithi181.stdout:6/817: dwrite d6/d31/d36/dba/da6/d4f/dd1/f38 [0,4194304] 0 2024-04-03T08:39:35.436 INFO:tasks.workunit.client.1.smithi181.stdout:9/796: link d1/da/d13/d22/d23/d36/fe9 d1/da/d13/d22/d23/d36/d91/ff6 0 2024-04-03T08:39:35.440 INFO:tasks.workunit.client.0.smithi157.stdout:9/937: rmdir d1/d15/d27/daf/da7 39 2024-04-03T08:39:35.443 INFO:tasks.workunit.client.1.smithi181.stdout:1/762: dwrite d10/d69/fd8 [0,4194304] 0 2024-04-03T08:39:35.449 INFO:tasks.workunit.client.1.smithi181.stdout:6/818: mkdir d6/d53/d8d/d97/db0/db5/d104 0 2024-04-03T08:39:35.452 INFO:tasks.workunit.client.0.smithi157.stdout:5/924: fdatasync dc/d29/d56/d2e/f131 0 2024-04-03T08:39:35.457 INFO:tasks.workunit.client.0.smithi157.stdout:3/869: symlink d8/d1e/d2d/d39/d51/d4c/dd6/de0/d12e/l12f 0 2024-04-03T08:39:35.459 INFO:tasks.workunit.client.1.smithi181.stdout:2/852: link d13/d1c/d4a/d68/dfa/cb6 d13/da7/d40/d109/c137 0 2024-04-03T08:39:35.466 INFO:tasks.workunit.client.0.smithi157.stdout:5/925: dread - dc/d29/d51/f117 zero size 2024-04-03T08:39:35.468 INFO:tasks.workunit.client.1.smithi181.stdout:9/797: rmdir d1/da/d13/d22/d23/d36/d91/d9d/dd7 39 2024-04-03T08:39:35.468 INFO:tasks.workunit.client.1.smithi181.stdout:0/755: dread d5/dc/d8e/dea/f61 [0,4194304] 0 2024-04-03T08:39:35.470 INFO:tasks.workunit.client.1.smithi181.stdout:9/798: chown d1/da/d13/d22/d23/d36/d9c 3704626 1 2024-04-03T08:39:35.470 INFO:tasks.workunit.client.0.smithi157.stdout:3/870: fdatasync d8/d13/d1b/dc4/fcc 0 2024-04-03T08:39:35.473 INFO:tasks.workunit.client.1.smithi181.stdout:1/763: stat d10/d15/d17/d23/d27/c3d 0 2024-04-03T08:39:35.474 INFO:tasks.workunit.client.1.smithi181.stdout:4/795: write d1/d1e/f2e [189397,68632] 0 2024-04-03T08:39:35.481 INFO:tasks.workunit.client.0.smithi157.stdout:5/926: creat dc/d29/d56/d18/f135 x:0 0 0 2024-04-03T08:39:35.485 INFO:tasks.workunit.client.1.smithi181.stdout:1/764: creat d10/d69/dd1/ff8 x:0 0 0 2024-04-03T08:39:35.488 INFO:tasks.workunit.client.0.smithi157.stdout:9/938: dread d1/d15/f43 [0,4194304] 0 2024-04-03T08:39:35.488 INFO:tasks.workunit.client.0.smithi157.stdout:3/871: write d8/d13/f1a [3650304,87440] 0 2024-04-03T08:39:35.488 INFO:tasks.workunit.client.1.smithi181.stdout:8/703: rename d4/d45/db/f94 to d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fed 0 2024-04-03T08:39:35.489 INFO:tasks.workunit.client.1.smithi181.stdout:5/765: dwrite d4/d44/d71/dcf/fdc [4194304,4194304] 0 2024-04-03T08:39:35.494 INFO:tasks.workunit.client.1.smithi181.stdout:7/712: dwrite d0/d1/f78 [0,4194304] 0 2024-04-03T08:39:35.494 INFO:tasks.workunit.client.1.smithi181.stdout:0/756: dwrite d5/d9/d2a/da1/fd3 [0,4194304] 0 2024-04-03T08:39:35.496 INFO:tasks.workunit.client.0.smithi157.stdout:3/872: truncate d8/d1e/d2d/d39/d51/d7e/f120 1042822 0 2024-04-03T08:39:35.497 INFO:tasks.workunit.client.1.smithi181.stdout:2/853: link d13/d1c/d4a/d68/dba/fea d13/da7/d85/f138 0 2024-04-03T08:39:35.497 INFO:tasks.workunit.client.0.smithi157.stdout:5/927: link dc/d29/d56/da4/c12c dc/d29/d56/d9e/db5/d113/c136 0 2024-04-03T08:39:35.500 INFO:tasks.workunit.client.1.smithi181.stdout:9/799: dread d1/da/d13/d41/d32/f67 [0,4194304] 0 2024-04-03T08:39:35.500 INFO:tasks.workunit.client.0.smithi157.stdout:9/939: mknod d1/dab/dad/dfa/c134 0 2024-04-03T08:39:35.503 INFO:tasks.workunit.client.0.smithi157.stdout:5/928: dread dc/f85 [0,4194304] 0 2024-04-03T08:39:35.504 INFO:tasks.workunit.client.1.smithi181.stdout:2/854: chown d13/da7/d27/d2f/l33 1913 1 2024-04-03T08:39:35.509 INFO:tasks.workunit.client.0.smithi157.stdout:9/940: mknod d1/dab/d103/c135 0 2024-04-03T08:39:35.510 INFO:tasks.workunit.client.1.smithi181.stdout:0/757: rename d5/dc/d10/d30/lc9 to d5/dc/d8e/lf2 0 2024-04-03T08:39:35.512 INFO:tasks.workunit.client.0.smithi157.stdout:3/873: link d8/d13/d1b/d83/fd4 d8/d13/d1b/dc4/dec/f130 0 2024-04-03T08:39:35.513 INFO:tasks.workunit.client.1.smithi181.stdout:1/765: fsync d10/d15/d4a/fc2 0 2024-04-03T08:39:35.514 INFO:tasks.workunit.client.1.smithi181.stdout:1/766: dread - d10/d15/d41/f83 zero size 2024-04-03T08:39:35.515 INFO:tasks.workunit.client.0.smithi157.stdout:5/929: unlink dc/d29/d56/d9e/dc3/dde/def/ff3 0 2024-04-03T08:39:35.516 INFO:tasks.workunit.client.1.smithi181.stdout:1/767: chown d10/d15/d4a/fc2 2712 1 2024-04-03T08:39:35.516 INFO:tasks.workunit.client.0.smithi157.stdout:9/941: rename d1/d4a/f52 to d1/dab/dad/d108/d131/f136 0 2024-04-03T08:39:35.519 INFO:tasks.workunit.client.1.smithi181.stdout:3/822: sync 2024-04-03T08:39:35.519 INFO:tasks.workunit.client.1.smithi181.stdout:9/800: creat d1/da/d28/d80/dd3/ff7 x:0 0 0 2024-04-03T08:39:35.520 INFO:tasks.workunit.client.1.smithi181.stdout:4/796: getdents d1/d16/d24/d5e/d31/d39/d5d 0 2024-04-03T08:39:35.521 INFO:tasks.workunit.client.0.smithi157.stdout:5/930: readlink dc/d29/d56/l25 0 2024-04-03T08:39:35.522 INFO:tasks.workunit.client.0.smithi157.stdout:9/942: dread - d1/d4a/d4d/da4/ffb zero size 2024-04-03T08:39:35.523 INFO:tasks.workunit.client.0.smithi157.stdout:9/943: readlink d1/d15/d27/d34/l3e 0 2024-04-03T08:39:35.523 INFO:tasks.workunit.client.0.smithi157.stdout:3/874: symlink d8/d1e/d2d/l131 0 2024-04-03T08:39:35.524 INFO:tasks.workunit.client.1.smithi181.stdout:8/704: rmdir d4/d44/dbb 0 2024-04-03T08:39:35.525 INFO:tasks.workunit.client.0.smithi157.stdout:5/931: truncate dc/d29/d56/d9e/db5/f11d 419174 0 2024-04-03T08:39:35.526 INFO:tasks.workunit.client.1.smithi181.stdout:1/768: unlink d10/d15/d4b/l71 0 2024-04-03T08:39:35.527 INFO:tasks.workunit.client.1.smithi181.stdout:9/801: read d1/da/d28/d80/dd3/fd4 [488466,3642] 0 2024-04-03T08:39:35.529 INFO:tasks.workunit.client.1.smithi181.stdout:4/797: fsync d1/d16/d24/d5e/d31/f65 0 2024-04-03T08:39:35.530 INFO:tasks.workunit.client.0.smithi157.stdout:3/875: unlink d8/d13/d1b/dc4/fcc 0 2024-04-03T08:39:35.530 INFO:tasks.workunit.client.1.smithi181.stdout:9/802: fsync d1/da/d28/d30/d3e/fd5 0 2024-04-03T08:39:35.530 INFO:tasks.workunit.client.1.smithi181.stdout:2/855: truncate d13/da7/d27/f114 1675301 0 2024-04-03T08:39:35.531 INFO:tasks.workunit.client.0.smithi157.stdout:5/932: write dc/d29/d56/d9e/dc3/de2/f10d [1226472,21307] 0 2024-04-03T08:39:35.532 INFO:tasks.workunit.client.1.smithi181.stdout:8/705: readlink d4/d45/db/d14/lcd 0 2024-04-03T08:39:35.537 INFO:tasks.workunit.client.0.smithi157.stdout:3/876: mknod d8/d1e/d2d/d39/d51/d4c/dd6/de0/c132 0 2024-04-03T08:39:35.537 INFO:tasks.workunit.client.1.smithi181.stdout:3/823: dwrite d0/d5/d6f/fe3 [0,4194304] 0 2024-04-03T08:39:35.545 INFO:tasks.workunit.client.0.smithi157.stdout:3/877: mkdir d8/d1e/d133 0 2024-04-03T08:39:35.546 INFO:tasks.workunit.client.1.smithi181.stdout:0/758: getdents d5/dc/d75/daa 0 2024-04-03T08:39:35.546 INFO:tasks.workunit.client.0.smithi157.stdout:3/878: fsync d8/d1e/d2d/d39/d51/d4c/dd6/de0/f12b 0 2024-04-03T08:39:35.547 INFO:tasks.workunit.client.1.smithi181.stdout:9/803: mknod d1/da/d13/d41/daf/df1/cf8 0 2024-04-03T08:39:35.547 INFO:tasks.workunit.client.1.smithi181.stdout:1/769: link d10/d15/d17/d23/d27/f92 d10/d15/d17/d23/d27/ff9 0 2024-04-03T08:39:35.547 INFO:tasks.workunit.client.1.smithi181.stdout:2/856: mkdir d13/da7/d27/d2f/dae/d139 0 2024-04-03T08:39:35.548 INFO:tasks.workunit.client.1.smithi181.stdout:8/706: chown d4/d2a/d37/fac 83786623 1 2024-04-03T08:39:35.549 INFO:tasks.workunit.client.1.smithi181.stdout:1/770: stat d10/d15/d41/c4e 0 2024-04-03T08:39:35.551 INFO:tasks.workunit.client.1.smithi181.stdout:2/857: write d13/d1c/d4a/d7f/db3/f53 [3108393,17102] 0 2024-04-03T08:39:35.552 INFO:tasks.workunit.client.1.smithi181.stdout:8/707: read - d4/d45/db/d14/d31/d1c/f53 zero size 2024-04-03T08:39:35.552 INFO:tasks.workunit.client.0.smithi157.stdout:3/879: truncate d8/d13/fc3 636294 0 2024-04-03T08:39:35.554 INFO:tasks.workunit.client.0.smithi157.stdout:3/880: chown d8/d1e/d2d/d3b/c94 4848 1 2024-04-03T08:39:35.559 INFO:tasks.workunit.client.0.smithi157.stdout:3/881: mkdir d8/d1e/d2d/d39/d51/d4c/dd6/d134 0 2024-04-03T08:39:35.562 INFO:tasks.workunit.client.1.smithi181.stdout:4/798: dread d1/d16/d37/d34/d69/fd0 [0,4194304] 0 2024-04-03T08:39:35.564 INFO:tasks.workunit.client.0.smithi157.stdout:3/882: fsync d8/d13/d1b/d4e/f99 0 2024-04-03T08:39:35.565 INFO:tasks.workunit.client.0.smithi157.stdout:3/883: readlink d8/d13/l55 0 2024-04-03T08:39:35.568 INFO:tasks.workunit.client.0.smithi157.stdout:9/944: write d1/d15/d16/f3a [5835643,108699] 0 2024-04-03T08:39:35.570 INFO:tasks.workunit.client.0.smithi157.stdout:9/945: chown d1/c6c 1632 1 2024-04-03T08:39:35.573 INFO:tasks.workunit.client.0.smithi157.stdout:3/884: getdents d8/d1e/d2d/d39/d51/d4c/dd6/d134 0 2024-04-03T08:39:35.577 INFO:tasks.workunit.client.0.smithi157.stdout:3/885: mknod d8/d13/d1b/d4e/d50/c135 0 2024-04-03T08:39:35.577 INFO:tasks.workunit.client.0.smithi157.stdout:5/933: write dc/d29/f38 [472756,109236] 0 2024-04-03T08:39:35.578 INFO:tasks.workunit.client.0.smithi157.stdout:1/787: sync 2024-04-03T08:39:35.585 INFO:tasks.workunit.client.0.smithi157.stdout:3/886: truncate d8/f28 4141431 0 2024-04-03T08:39:35.587 INFO:tasks.workunit.client.0.smithi157.stdout:3/887: chown d8/d1e/d2d/d3f/d4d/d8f/cc0 819043503 1 2024-04-03T08:39:35.594 INFO:tasks.workunit.client.0.smithi157.stdout:3/888: mkdir d8/d1e/d2d/d39/d51/d48/dab/d136 0 2024-04-03T08:39:35.603 INFO:tasks.workunit.client.0.smithi157.stdout:3/889: creat d8/d1e/d2d/f137 x:0 0 0 2024-04-03T08:39:35.604 INFO:tasks.workunit.client.1.smithi181.stdout:6/819: sync 2024-04-03T08:39:35.604 INFO:tasks.workunit.client.0.smithi157.stdout:3/890: stat d8/d13/l22 0 2024-04-03T08:39:35.605 INFO:tasks.workunit.client.0.smithi157.stdout:3/891: chown d8/le6 54836004 1 2024-04-03T08:39:35.606 INFO:tasks.workunit.client.1.smithi181.stdout:3/824: mknod d0/d5/d6/d3f/c119 0 2024-04-03T08:39:35.608 INFO:tasks.workunit.client.1.smithi181.stdout:9/804: fdatasync d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 0 2024-04-03T08:39:35.609 INFO:tasks.workunit.client.0.smithi157.stdout:9/946: write d1/d15/fc9 [1508051,24424] 0 2024-04-03T08:39:35.611 INFO:tasks.workunit.client.1.smithi181.stdout:2/858: mknod d13/d1c/da5/c13a 0 2024-04-03T08:39:35.612 INFO:tasks.workunit.client.0.smithi157.stdout:9/947: write d1/d15/d16/f11f [409487,62966] 0 2024-04-03T08:39:35.612 INFO:tasks.workunit.client.1.smithi181.stdout:8/708: readlink d4/d45/l4a 0 2024-04-03T08:39:35.613 INFO:tasks.workunit.client.0.smithi157.stdout:9/948: stat d1/d15/dca/ld1 0 2024-04-03T08:39:35.614 INFO:tasks.workunit.client.1.smithi181.stdout:6/820: rmdir d6 39 2024-04-03T08:39:35.619 INFO:tasks.workunit.client.0.smithi157.stdout:9/949: unlink d1/d15/d27/d34/dc7/c118 0 2024-04-03T08:39:35.621 INFO:tasks.workunit.client.1.smithi181.stdout:0/759: rename d5/dc/d14/d29/d46/c51 to d5/dc/d14/d8d/cf3 0 2024-04-03T08:39:35.621 INFO:tasks.workunit.client.0.smithi157.stdout:1/788: write d2/d11/d24/d39/d3b/fad [690275,5158] 0 2024-04-03T08:39:35.625 INFO:tasks.workunit.client.1.smithi181.stdout:8/709: dwrite d4/f88 [0,4194304] 0 2024-04-03T08:39:35.626 INFO:tasks.workunit.client.0.smithi157.stdout:5/934: truncate fa 7433101 0 2024-04-03T08:39:35.627 INFO:tasks.workunit.client.1.smithi181.stdout:2/859: chown d13/da7/d85/dbd/c107 37051879 1 2024-04-03T08:39:35.628 INFO:tasks.workunit.client.1.smithi181.stdout:2/860: dread - d13/da7/d85/de4/f106 zero size 2024-04-03T08:39:35.630 INFO:tasks.workunit.client.0.smithi157.stdout:1/789: write d2/d11/d24/d39/d3b/d1b/d7f/fa7 [2533454,89625] 0 2024-04-03T08:39:35.634 INFO:tasks.workunit.client.1.smithi181.stdout:6/821: stat d6/d31/d36/dba/da6/d4f/dd1/d50/f61 0 2024-04-03T08:39:35.635 INFO:tasks.workunit.client.0.smithi157.stdout:5/935: chown dc/d29/f57 0 1 2024-04-03T08:39:35.636 INFO:tasks.workunit.client.1.smithi181.stdout:1/771: link d10/d15/d41/l5c d10/d15/d17/d37/lfa 0 2024-04-03T08:39:35.637 INFO:tasks.workunit.client.1.smithi181.stdout:1/772: fdatasync d10/d15/d4a/f9d 0 2024-04-03T08:39:35.639 INFO:tasks.workunit.client.1.smithi181.stdout:9/805: rename d1/da/d13/l5d to d1/da/d13/d73/d7e/lf9 0 2024-04-03T08:39:35.639 INFO:tasks.workunit.client.1.smithi181.stdout:6/822: read d6/d31/f89 [109381,70326] 0 2024-04-03T08:39:35.640 INFO:tasks.workunit.client.0.smithi157.stdout:1/790: creat d2/d11/d23/dc9/da1/ded/f10a x:0 0 0 2024-04-03T08:39:35.641 INFO:tasks.workunit.client.0.smithi157.stdout:9/950: dread d1/d15/d27/d5c/d79/fea [0,4194304] 0 2024-04-03T08:39:35.642 INFO:tasks.workunit.client.0.smithi157.stdout:9/951: stat d1/d4a/f4c 0 2024-04-03T08:39:35.644 INFO:tasks.workunit.client.1.smithi181.stdout:8/710: unlink d4/d45/db/l47 0 2024-04-03T08:39:35.647 INFO:tasks.workunit.client.0.smithi157.stdout:3/892: write d8/f88 [681284,15256] 0 2024-04-03T08:39:35.649 INFO:tasks.workunit.client.0.smithi157.stdout:5/936: creat dc/d29/d56/d87/dd1/f137 x:0 0 0 2024-04-03T08:39:35.653 INFO:tasks.workunit.client.1.smithi181.stdout:9/806: dwrite d1/da/d13/d73/fb7 [0,4194304] 0 2024-04-03T08:39:35.657 INFO:tasks.workunit.client.1.smithi181.stdout:4/799: getdents d1/d16/d24/d5e/d31/d39/da1 0 2024-04-03T08:39:35.658 INFO:tasks.workunit.client.1.smithi181.stdout:4/800: readlink d1/d1e/d2c/l4c 0 2024-04-03T08:39:35.660 INFO:tasks.workunit.client.1.smithi181.stdout:3/825: truncate d0/ff6 2027492 0 2024-04-03T08:39:35.661 INFO:tasks.workunit.client.1.smithi181.stdout:8/711: unlink d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/l6a 0 2024-04-03T08:39:35.664 INFO:tasks.workunit.client.1.smithi181.stdout:5/766: sync 2024-04-03T08:39:35.665 INFO:tasks.workunit.client.0.smithi157.stdout:9/952: rename d1/d4a/d4d/dd6/l125 to d1/d15/d27/daf/da7/d123/dbe/l137 0 2024-04-03T08:39:35.668 INFO:tasks.workunit.client.0.smithi157.stdout:5/937: mknod dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/ddb/c138 0 2024-04-03T08:39:35.669 INFO:tasks.workunit.client.1.smithi181.stdout:4/801: dread d1/d16/d24/d5e/f50 [0,4194304] 0 2024-04-03T08:39:35.670 INFO:tasks.workunit.client.0.smithi157.stdout:9/953: write d1/d15/d27/daf/da7/fbb [1622236,39669] 0 2024-04-03T08:39:35.670 INFO:tasks.workunit.client.1.smithi181.stdout:1/773: mknod d10/cfb 0 2024-04-03T08:39:35.671 INFO:tasks.workunit.client.0.smithi157.stdout:1/791: link d2/d11/cdb d2/d11/d23/dc9/da1/c10b 0 2024-04-03T08:39:35.672 INFO:tasks.workunit.client.1.smithi181.stdout:1/774: write d10/da1/fa7 [743774,54720] 0 2024-04-03T08:39:35.672 INFO:tasks.workunit.client.1.smithi181.stdout:9/807: fdatasync d1/da/d28/d30/f6a 0 2024-04-03T08:39:35.680 INFO:tasks.workunit.client.0.smithi157.stdout:9/954: rmdir d1/d15/d27 39 2024-04-03T08:39:35.683 INFO:tasks.workunit.client.0.smithi157.stdout:9/955: fsync d1/d4a/d4d/d86/dd5/f122 0 2024-04-03T08:39:35.685 INFO:tasks.workunit.client.0.smithi157.stdout:9/956: chown d1/d15/d16/l7e 12770 1 2024-04-03T08:39:35.688 INFO:tasks.workunit.client.0.smithi157.stdout:3/893: dwrite d8/d1e/d2d/d3f/d4d/d8f/fd5 [0,4194304] 0 2024-04-03T08:39:35.688 INFO:tasks.workunit.client.1.smithi181.stdout:6/823: dread d6/d31/d36/f5d [0,4194304] 0 2024-04-03T08:39:35.690 INFO:tasks.workunit.client.1.smithi181.stdout:6/824: dread - d6/d3e/db1/dc4/dc9/ffc zero size 2024-04-03T08:39:35.693 INFO:tasks.workunit.client.0.smithi157.stdout:1/792: write d2/d11/d23/dc9/d58/f51 [868079,90356] 0 2024-04-03T08:39:35.695 INFO:tasks.workunit.client.1.smithi181.stdout:1/775: rename d10/d15/d17/d23/db0/d8d/fba to d10/d15/d4a/ffc 0 2024-04-03T08:39:35.701 INFO:tasks.workunit.client.0.smithi157.stdout:1/793: creat d2/d11/d23/dc9/da1/ded/f10c x:0 0 0 2024-04-03T08:39:35.702 INFO:tasks.workunit.client.1.smithi181.stdout:4/802: dread d1/d1e/f2e [0,4194304] 0 2024-04-03T08:39:35.705 INFO:tasks.workunit.client.0.smithi157.stdout:3/894: symlink d8/d13/d1b/d4e/d50/d7c/ddc/l138 0 2024-04-03T08:39:35.707 INFO:tasks.workunit.client.0.smithi157.stdout:5/938: getdents dc/d29/d56/d9e/dc3/de2 0 2024-04-03T08:39:35.711 INFO:tasks.workunit.client.1.smithi181.stdout:8/712: write d4/d45/db/d14/d31/d1c/d51/f8b [519344,64136] 0 2024-04-03T08:39:35.711 INFO:tasks.workunit.client.1.smithi181.stdout:6/825: creat d6/dc0/d103/f105 x:0 0 0 2024-04-03T08:39:35.712 INFO:tasks.workunit.client.0.smithi157.stdout:9/957: mkdir d1/d15/d27/daf/da7/d123/dbe/dbf/d138 0 2024-04-03T08:39:35.712 INFO:tasks.workunit.client.1.smithi181.stdout:6/826: stat d6/d53/c75 0 2024-04-03T08:39:35.713 INFO:tasks.workunit.client.1.smithi181.stdout:1/776: dwrite d10/d69/fec [0,4194304] 0 2024-04-03T08:39:35.716 INFO:tasks.workunit.client.0.smithi157.stdout:3/895: mknod d8/d1e/d2d/d3b/d9e/df9/c139 0 2024-04-03T08:39:35.716 INFO:tasks.workunit.client.0.smithi157.stdout:9/958: truncate d1/d36/d46/f7a 3484698 0 2024-04-03T08:39:35.716 INFO:tasks.workunit.client.1.smithi181.stdout:6/827: truncate d6/d3e/d40/ffb 702510 0 2024-04-03T08:39:35.722 INFO:tasks.workunit.client.0.smithi157.stdout:3/896: fsync d8/d1e/f7a 0 2024-04-03T08:39:35.724 INFO:tasks.workunit.client.0.smithi157.stdout:9/959: mknod d1/dab/dad/d108/d131/c139 0 2024-04-03T08:39:35.726 INFO:tasks.workunit.client.1.smithi181.stdout:4/803: truncate d1/d16/f54 1731431 0 2024-04-03T08:39:35.726 INFO:tasks.workunit.client.0.smithi157.stdout:1/794: link d2/d11/d23/dc9/d86/fbe d2/d11/d24/d67/f10d 0 2024-04-03T08:39:35.727 INFO:tasks.workunit.client.1.smithi181.stdout:4/804: readlink d1/d16/d55/lb0 0 2024-04-03T08:39:35.728 INFO:tasks.workunit.client.0.smithi157.stdout:1/795: dread - d2/d11/d24/d39/d3b/ff6 zero size 2024-04-03T08:39:35.731 INFO:tasks.workunit.client.1.smithi181.stdout:1/777: creat d10/d15/d4a/d6f/ffd x:0 0 0 2024-04-03T08:39:35.732 INFO:tasks.workunit.client.0.smithi157.stdout:3/897: mkdir d8/d1e/d2d/d3b/d8c/df1/d13a 0 2024-04-03T08:39:35.734 INFO:tasks.workunit.client.1.smithi181.stdout:6/828: dwrite d6/dc0/d103/fd6 [0,4194304] 0 2024-04-03T08:39:35.734 INFO:tasks.workunit.client.1.smithi181.stdout:9/808: creat d1/da/d13/d41/ffa x:0 0 0 2024-04-03T08:39:35.737 INFO:tasks.workunit.client.0.smithi157.stdout:5/939: getdents dc/d29/d56 0 2024-04-03T08:39:35.738 INFO:tasks.workunit.client.1.smithi181.stdout:7/713: sync 2024-04-03T08:39:35.738 INFO:tasks.workunit.client.1.smithi181.stdout:1/778: dread d10/d15/d17/d30/f65 [0,4194304] 0 2024-04-03T08:39:35.739 INFO:tasks.workunit.client.1.smithi181.stdout:5/767: getdents d4/d18/d55/db4/d96 0 2024-04-03T08:39:35.741 INFO:tasks.workunit.client.0.smithi157.stdout:0/953: sync 2024-04-03T08:39:35.742 INFO:tasks.workunit.client.1.smithi181.stdout:4/805: mknod d1/d16/d24/d5e/d31/d39/da1/c108 0 2024-04-03T08:39:35.742 INFO:tasks.workunit.client.1.smithi181.stdout:9/809: fsync d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 0 2024-04-03T08:39:35.743 INFO:tasks.workunit.client.1.smithi181.stdout:3/826: dread d0/ff6 [0,4194304] 0 2024-04-03T08:39:35.744 INFO:tasks.workunit.client.1.smithi181.stdout:4/806: chown d1/d1e/d82 148523452 1 2024-04-03T08:39:35.744 INFO:tasks.workunit.client.0.smithi157.stdout:1/796: rename d2/d11/d23/dc9/d5d/d9a/ld3 to d2/d11/d23/dc9/d58/d62/l10e 0 2024-04-03T08:39:35.747 INFO:tasks.workunit.client.1.smithi181.stdout:3/827: stat d0/d17/d36/d1e/lfe 0 2024-04-03T08:39:35.747 INFO:tasks.workunit.client.1.smithi181.stdout:9/810: chown d1/da/d13/d22/f2e 3377804 1 2024-04-03T08:39:35.754 INFO:tasks.workunit.client.0.smithi157.stdout:5/940: creat dc/d29/d56/d18/d21/f139 x:0 0 0 2024-04-03T08:39:35.754 INFO:tasks.workunit.client.1.smithi181.stdout:5/768: mknod d4/d44/cf8 0 2024-04-03T08:39:35.755 INFO:tasks.workunit.client.1.smithi181.stdout:5/769: chown d4/d18/d25/d68/f97 84568976 1 2024-04-03T08:39:35.755 INFO:tasks.workunit.client.0.smithi157.stdout:1/797: chown d2/d11/d23/dc9/d86/fbe 411 1 2024-04-03T08:39:35.756 INFO:tasks.workunit.client.1.smithi181.stdout:4/807: fsync d1/d16/d24/d5e/d31/d39/da1/fc0 0 2024-04-03T08:39:35.756 INFO:tasks.workunit.client.0.smithi157.stdout:9/960: dread d1/d15/d27/d34/f6d [4194304,4194304] 0 2024-04-03T08:39:35.757 INFO:tasks.workunit.client.1.smithi181.stdout:6/829: mknod d6/d31/d36/dba/da6/d4f/dd1/d50/d64/c106 0 2024-04-03T08:39:35.758 INFO:tasks.workunit.client.0.smithi157.stdout:1/798: readlink d2/d11/d24/d39/d3b/d2e/d66/d91/d97/lb6 0 2024-04-03T08:39:35.758 INFO:tasks.workunit.client.0.smithi157.stdout:3/898: write d8/d1e/d2d/d39/f6c [1074928,29376] 0 2024-04-03T08:39:35.759 INFO:tasks.workunit.client.1.smithi181.stdout:9/811: creat d1/da/d28/ffb x:0 0 0 2024-04-03T08:39:35.762 INFO:tasks.workunit.client.1.smithi181.stdout:8/713: dwrite d4/d44/d59/d5f/f75 [0,4194304] 0 2024-04-03T08:39:35.762 INFO:tasks.workunit.client.0.smithi157.stdout:9/961: creat d1/d15/d27/d5c/dbd/f13a x:0 0 0 2024-04-03T08:39:35.765 INFO:tasks.workunit.client.1.smithi181.stdout:3/828: unlink d0/d17/d36/d3b/d5a/c71 0 2024-04-03T08:39:35.765 INFO:tasks.workunit.client.0.smithi157.stdout:0/954: creat d2/d9/d51/d63/f153 x:0 0 0 2024-04-03T08:39:35.765 INFO:tasks.workunit.client.0.smithi157.stdout:3/899: dread d8/d1e/d2d/d39/d51/d7e/f120 [0,4194304] 0 2024-04-03T08:39:35.767 INFO:tasks.workunit.client.0.smithi157.stdout:1/799: rmdir d2/d11/d23/dc9/d58/d62 39 2024-04-03T08:39:35.771 INFO:tasks.workunit.client.1.smithi181.stdout:8/714: truncate d4/d44/d59/d5f/d6c/fd3 664056 0 2024-04-03T08:39:35.775 INFO:tasks.workunit.client.1.smithi181.stdout:6/830: unlink d6/d31/c35 0 2024-04-03T08:39:35.777 INFO:tasks.workunit.client.0.smithi157.stdout:3/900: mknod d8/d13/d1b/dc4/c13b 0 2024-04-03T08:39:35.778 INFO:tasks.workunit.client.1.smithi181.stdout:6/831: write d6/d53/d80/fe6 [787676,61939] 0 2024-04-03T08:39:35.780 INFO:tasks.workunit.client.1.smithi181.stdout:1/779: write d10/d15/d4b/ff2 [377414,65204] 0 2024-04-03T08:39:35.780 INFO:tasks.workunit.client.0.smithi157.stdout:1/800: write d2/d11/d24/d39/f6f [315285,37058] 0 2024-04-03T08:39:35.780 INFO:tasks.workunit.client.0.smithi157.stdout:3/901: read d8/d1e/d2d/d3b/f5a [6614632,15661] 0 2024-04-03T08:39:35.781 INFO:tasks.workunit.client.1.smithi181.stdout:5/770: mknod d4/d18/d55/db4/cf9 0 2024-04-03T08:39:35.782 INFO:tasks.workunit.client.0.smithi157.stdout:5/941: link dc/d29/d43/ff5 dc/d29/d56/d9e/dc3/dde/def/f13a 0 2024-04-03T08:39:35.788 INFO:tasks.workunit.client.1.smithi181.stdout:0/760: sync 2024-04-03T08:39:35.789 INFO:tasks.workunit.client.1.smithi181.stdout:2/861: sync 2024-04-03T08:39:35.789 INFO:tasks.workunit.client.0.smithi157.stdout:9/962: write d1/d15/d27/f45 [8742094,318] 0 2024-04-03T08:39:35.789 INFO:tasks.workunit.client.1.smithi181.stdout:8/715: write d4/d44/d59/d5f/d6c/fa7 [736176,18482] 0 2024-04-03T08:39:35.789 INFO:tasks.workunit.client.1.smithi181.stdout:9/812: symlink d1/da/d28/d30/d3e/dd6/lfc 0 2024-04-03T08:39:35.791 INFO:tasks.workunit.client.1.smithi181.stdout:1/780: mknod d10/d15/d4a/d6f/cfe 0 2024-04-03T08:39:35.792 INFO:tasks.workunit.client.0.smithi157.stdout:5/942: creat dc/d29/d56/d2e/f13b x:0 0 0 2024-04-03T08:39:35.793 INFO:tasks.workunit.client.0.smithi157.stdout:3/902: dread d8/d1e/d2d/d39/d51/d7e/f120 [0,4194304] 0 2024-04-03T08:39:35.794 INFO:tasks.workunit.client.1.smithi181.stdout:4/808: dread d1/f7 [0,4194304] 0 2024-04-03T08:39:35.797 INFO:tasks.workunit.client.0.smithi157.stdout:5/943: read - dc/d29/d43/fc6 zero size 2024-04-03T08:39:35.798 INFO:tasks.workunit.client.1.smithi181.stdout:2/862: rename d13/da7/l74 to d13/d1c/d4a/d68/d72/l13b 0 2024-04-03T08:39:35.798 INFO:tasks.workunit.client.1.smithi181.stdout:0/761: write d5/dc/d10/fe7 [626970,118087] 0 2024-04-03T08:39:35.800 INFO:tasks.workunit.client.0.smithi157.stdout:8/886: sync 2024-04-03T08:39:35.800 INFO:tasks.workunit.client.0.smithi157.stdout:7/912: sync 2024-04-03T08:39:35.800 INFO:tasks.workunit.client.0.smithi157.stdout:2/854: sync 2024-04-03T08:39:35.801 INFO:tasks.workunit.client.0.smithi157.stdout:4/834: sync 2024-04-03T08:39:35.801 INFO:tasks.workunit.client.0.smithi157.stdout:6/888: sync 2024-04-03T08:39:35.804 INFO:tasks.workunit.client.1.smithi181.stdout:0/762: write d5/d9/d2a/f4f [5098277,104489] 0 2024-04-03T08:39:35.804 INFO:tasks.workunit.client.1.smithi181.stdout:9/813: creat d1/da/d13/d41/d65/ffd x:0 0 0 2024-04-03T08:39:35.804 INFO:tasks.workunit.client.1.smithi181.stdout:7/714: dread d0/d1/d6/de/d17/d64/d85/d9a/da4/f6f [0,4194304] 0 2024-04-03T08:39:35.809 INFO:tasks.workunit.client.1.smithi181.stdout:9/814: chown d1/da/d13/d41 6 1 2024-04-03T08:39:35.810 INFO:tasks.workunit.client.0.smithi157.stdout:0/955: write d2/d9/d51/d63/fd9 [66529,127095] 0 2024-04-03T08:39:35.810 INFO:tasks.workunit.client.0.smithi157.stdout:5/944: mknod dc/d29/d56/d9e/dc3/dde/de4/d12d/c13c 0 2024-04-03T08:39:35.811 INFO:tasks.workunit.client.1.smithi181.stdout:3/829: write d0/dbc/fbf [941656,86000] 0 2024-04-03T08:39:35.812 INFO:tasks.workunit.client.0.smithi157.stdout:7/913: chown d0/d11/d15/d1b/cf8 450 1 2024-04-03T08:39:35.817 INFO:tasks.workunit.client.0.smithi157.stdout:5/945: chown dc/d29/d56/da4/cac 40565927 1 2024-04-03T08:39:35.818 INFO:tasks.workunit.client.0.smithi157.stdout:7/914: read - d0/d75/f134 zero size 2024-04-03T08:39:35.819 INFO:tasks.workunit.client.1.smithi181.stdout:6/832: getdents d6/d31/d36/dba/da6/d4f/dd1/d50/d64 0 2024-04-03T08:39:35.819 INFO:tasks.workunit.client.1.smithi181.stdout:0/763: mkdir d5/dc/d75/daa/df4 0 2024-04-03T08:39:35.821 INFO:tasks.workunit.client.1.smithi181.stdout:2/863: truncate d13/da7/f132 498894 0 2024-04-03T08:39:35.824 INFO:tasks.workunit.client.1.smithi181.stdout:0/764: stat d5/dc/d14/de5/deb 0 2024-04-03T08:39:35.824 INFO:tasks.workunit.client.1.smithi181.stdout:8/716: mknod d4/d45/db/d14/d31/d1c/d51/cee 0 2024-04-03T08:39:35.824 INFO:tasks.workunit.client.0.smithi157.stdout:3/903: dwrite d8/f62 [0,4194304] 0 2024-04-03T08:39:35.825 INFO:tasks.workunit.client.1.smithi181.stdout:1/781: dwrite d10/d15/d4a/d6f/ffd [0,4194304] 0 2024-04-03T08:39:35.826 INFO:tasks.workunit.client.1.smithi181.stdout:4/809: dread d1/d16/d24/d5e/f3c [0,4194304] 0 2024-04-03T08:39:35.827 INFO:tasks.workunit.client.1.smithi181.stdout:5/771: dwrite d4/d18/d55/f69 [0,4194304] 0 2024-04-03T08:39:35.827 INFO:tasks.workunit.client.1.smithi181.stdout:9/815: symlink d1/da/d13/d22/d23/d36/d91/lfe 0 2024-04-03T08:39:35.828 INFO:tasks.workunit.client.0.smithi157.stdout:4/835: dread da/df/f104 [0,4194304] 0 2024-04-03T08:39:35.831 INFO:tasks.workunit.client.1.smithi181.stdout:5/772: write d4/d18/d25/d68/f97 [1516126,79952] 0 2024-04-03T08:39:35.834 INFO:tasks.workunit.client.1.smithi181.stdout:3/830: fsync d0/d5/f38 0 2024-04-03T08:39:35.837 INFO:tasks.workunit.client.1.smithi181.stdout:3/831: truncate d0/f110 884913 0 2024-04-03T08:39:35.841 INFO:tasks.workunit.client.1.smithi181.stdout:5/773: write d4/d18/d55/db4/fa0 [1685436,13775] 0 2024-04-03T08:39:35.841 INFO:tasks.workunit.client.1.smithi181.stdout:2/864: fsync d13/da7/d27/f8a 0 2024-04-03T08:39:35.844 INFO:tasks.workunit.client.1.smithi181.stdout:8/717: dread - d4/d45/d9/fa4 zero size 2024-04-03T08:39:35.849 INFO:tasks.workunit.client.1.smithi181.stdout:4/810: rmdir d1/d16/d24/d5e/d31/d39/df0/dfd 39 2024-04-03T08:39:35.851 INFO:tasks.workunit.client.1.smithi181.stdout:8/718: readlink d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/lea 0 2024-04-03T08:39:35.853 INFO:tasks.workunit.client.1.smithi181.stdout:4/811: chown d1/d16/d37/d34/d86/fc6 121 1 2024-04-03T08:39:35.856 INFO:tasks.workunit.client.1.smithi181.stdout:5/774: dread d4/d56/ff0 [0,4194304] 0 2024-04-03T08:39:35.857 INFO:tasks.workunit.client.1.smithi181.stdout:4/812: write d1/d16/d24/d5e/d31/d39/f80 [2177894,33981] 0 2024-04-03T08:39:35.859 INFO:tasks.workunit.client.1.smithi181.stdout:4/813: dread - d1/d16/d55/f6e zero size 2024-04-03T08:39:35.859 INFO:tasks.workunit.client.1.smithi181.stdout:5/775: write d4/d22/d53/fdd [1459153,37798] 0 2024-04-03T08:39:35.862 INFO:tasks.workunit.client.1.smithi181.stdout:5/776: write d4/d22/d4a/f5d [4761232,70729] 0 2024-04-03T08:39:35.862 INFO:tasks.workunit.client.1.smithi181.stdout:4/814: chown d1/d16/d24/d5e/d2b/d56/c9b 63687197 1 2024-04-03T08:39:35.865 INFO:tasks.workunit.client.1.smithi181.stdout:0/765: getdents d5/dc/dc5 0 2024-04-03T08:39:35.868 INFO:tasks.workunit.client.1.smithi181.stdout:3/832: dread d0/d5/d6/dd/d25/f44 [0,4194304] 0 2024-04-03T08:39:35.872 INFO:tasks.workunit.client.1.smithi181.stdout:8/719: mkdir d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/def 0 2024-04-03T08:39:35.877 INFO:tasks.workunit.client.1.smithi181.stdout:5/777: readlink d4/d18/d25/de7/lf6 0 2024-04-03T08:39:35.879 INFO:tasks.workunit.client.1.smithi181.stdout:6/833: write d6/d31/d36/dba/da6/d4f/d77/d8b/fef [1024184,58454] 0 2024-04-03T08:39:35.882 INFO:tasks.workunit.client.1.smithi181.stdout:3/833: dread - d0/d17/fcf zero size 2024-04-03T08:39:35.882 INFO:tasks.workunit.client.1.smithi181.stdout:1/782: write d10/d15/d17/d19/d33/f72 [2788892,68907] 0 2024-04-03T08:39:35.884 INFO:tasks.workunit.client.1.smithi181.stdout:4/815: dread d1/d1e/d2c/f59 [0,4194304] 0 2024-04-03T08:39:35.887 INFO:tasks.workunit.client.1.smithi181.stdout:0/766: dwrite d5/dc/d14/de5/fe9 [0,4194304] 0 2024-04-03T08:39:35.887 INFO:tasks.workunit.client.1.smithi181.stdout:3/834: write d0/d5/d6f/ff9 [1787711,27821] 0 2024-04-03T08:39:35.888 INFO:tasks.workunit.client.1.smithi181.stdout:9/816: link d1/da/d13/d22/d23/d36/d91/d9d/f37 d1/da/d13/d22/d23/fff 0 2024-04-03T08:39:35.889 INFO:tasks.workunit.client.1.smithi181.stdout:3/835: stat d0/d17/d36/d1e/f31 0 2024-04-03T08:39:35.892 INFO:tasks.workunit.client.1.smithi181.stdout:0/767: fdatasync d5/dc/d10/d58/db0/fde 0 2024-04-03T08:39:35.897 INFO:tasks.workunit.client.1.smithi181.stdout:1/783: unlink d10/d15/d4a/d6f/f9c 0 2024-04-03T08:39:35.898 INFO:tasks.workunit.client.1.smithi181.stdout:1/784: fsync d10/d15/d17/d19/f40 0 2024-04-03T08:39:35.899 INFO:tasks.workunit.client.1.smithi181.stdout:1/785: chown d10/d15/d17/ced 11870 1 2024-04-03T08:39:35.899 INFO:tasks.workunit.client.0.smithi157.stdout:9/963: link d1/d15/d27/d5c/d79/f99 d1/d4a/d4d/da4/dcc/f13b 0 2024-04-03T08:39:35.900 INFO:tasks.workunit.client.1.smithi181.stdout:1/786: dread - d10/d15/d4a/d6f/f8e zero size 2024-04-03T08:39:35.902 INFO:tasks.workunit.client.1.smithi181.stdout:2/865: rename d13/da7/c9f to d13/d1c/d4a/d7f/db3/c13c 0 2024-04-03T08:39:35.905 INFO:tasks.workunit.client.0.smithi157.stdout:1/801: link d2/d11/d24/d39/d3b/d1b/d7f/ld9 d2/d11/d23/dc9/d58/l10f 0 2024-04-03T08:39:35.906 INFO:tasks.workunit.client.1.smithi181.stdout:9/817: dwrite d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 [0,4194304] 0 2024-04-03T08:39:35.907 INFO:tasks.workunit.client.0.smithi157.stdout:1/802: fdatasync d2/d11/d24/d39/d3b/d1b/fcd 0 2024-04-03T08:39:35.908 INFO:tasks.workunit.client.0.smithi157.stdout:0/956: mknod d2/d9/dc/df/d6f/d9d/d6a/d91/c154 0 2024-04-03T08:39:35.910 INFO:tasks.workunit.client.1.smithi181.stdout:3/836: dread d0/d17/d63/d81/f94 [0,4194304] 0 2024-04-03T08:39:35.910 INFO:tasks.workunit.client.0.smithi157.stdout:5/946: readlink dc/d29/d56/d9e/db5/dc9/d124/l6b 0 2024-04-03T08:39:35.914 INFO:tasks.workunit.client.1.smithi181.stdout:0/768: symlink d5/dc/lf5 0 2024-04-03T08:39:35.918 INFO:tasks.workunit.client.0.smithi157.stdout:2/855: mknod d3/d12/c123 0 2024-04-03T08:39:35.924 INFO:tasks.workunit.client.0.smithi157.stdout:9/964: unlink d1/dab/dad/d100/f115 0 2024-04-03T08:39:35.924 INFO:tasks.workunit.client.1.smithi181.stdout:8/720: write d4/f19 [4955181,63713] 0 2024-04-03T08:39:35.925 INFO:tasks.workunit.client.1.smithi181.stdout:2/866: symlink d13/da7/d40/l13d 0 2024-04-03T08:39:35.927 INFO:tasks.workunit.client.1.smithi181.stdout:4/816: mkdir d1/d16/d24/d5e/d3f/d109 0 2024-04-03T08:39:35.927 INFO:tasks.workunit.client.1.smithi181.stdout:8/721: chown d4/d45/db/d14/d31/d1c/d51/d87/db1/cdf 2816 1 2024-04-03T08:39:35.928 INFO:tasks.workunit.client.0.smithi157.stdout:6/889: fdatasync d1/d5/d17/f64 0 2024-04-03T08:39:35.928 INFO:tasks.workunit.client.1.smithi181.stdout:8/722: chown d4/d45/d9/f25 224 1 2024-04-03T08:39:35.930 INFO:tasks.workunit.client.1.smithi181.stdout:6/834: write d6/fb2 [120400,107698] 0 2024-04-03T08:39:35.931 INFO:tasks.workunit.client.1.smithi181.stdout:3/837: mknod d0/d5/d6/d3f/c11a 0 2024-04-03T08:39:35.931 INFO:tasks.workunit.client.0.smithi157.stdout:1/803: rmdir d2/d11/d23/dc9/d5d 39 2024-04-03T08:39:35.932 INFO:tasks.workunit.client.1.smithi181.stdout:6/835: readlink d6/d31/d36/l47 0 2024-04-03T08:39:35.932 INFO:tasks.workunit.client.1.smithi181.stdout:5/778: link d4/d18/d25/d68/l8d d4/dc3/lfa 0 2024-04-03T08:39:35.933 INFO:tasks.workunit.client.0.smithi157.stdout:1/804: write d2/d11/d24/fb2 [1157859,31267] 0 2024-04-03T08:39:35.936 INFO:tasks.workunit.client.1.smithi181.stdout:0/769: creat d5/dc/d14/de5/deb/ff6 x:0 0 0 2024-04-03T08:39:35.939 INFO:tasks.workunit.client.0.smithi157.stdout:7/915: mkdir d0/d11/d15/d17/d1c/d128/d13d 0 2024-04-03T08:39:35.941 INFO:tasks.workunit.client.1.smithi181.stdout:2/867: fsync d13/d7b/f7e 0 2024-04-03T08:39:35.943 INFO:tasks.workunit.client.0.smithi157.stdout:8/887: dwrite d2/f99 [0,4194304] 0 2024-04-03T08:39:35.943 INFO:tasks.workunit.client.1.smithi181.stdout:2/868: chown d13/d1c/d4a/d68/c123 12620 1 2024-04-03T08:39:35.950 INFO:tasks.workunit.client.0.smithi157.stdout:6/890: dwrite d1/d5/d17/d2a/d30/d95/dff/f108 [0,4194304] 0 2024-04-03T08:39:35.953 INFO:tasks.workunit.client.1.smithi181.stdout:1/787: dwrite d10/d15/d17/d19/d33/fa0 [0,4194304] 0 2024-04-03T08:39:35.965 INFO:tasks.workunit.client.1.smithi181.stdout:5/779: dread d4/d18/d3e/f6f [0,4194304] 0 2024-04-03T08:39:35.966 INFO:tasks.workunit.client.1.smithi181.stdout:0/770: truncate d5/dc/d14/f77 4840933 0 2024-04-03T08:39:35.968 INFO:tasks.workunit.client.1.smithi181.stdout:4/817: write d1/d16/dbc/fc1 [2079895,25395] 0 2024-04-03T08:39:35.970 INFO:tasks.workunit.client.1.smithi181.stdout:3/838: write d0/d17/f2e [709144,37572] 0 2024-04-03T08:39:35.973 INFO:tasks.workunit.client.1.smithi181.stdout:6/836: write d6/d31/d36/dba/da6/d4f/d77/d8b/fbd [297892,26306] 0 2024-04-03T08:39:35.974 INFO:tasks.workunit.client.1.smithi181.stdout:6/837: dread - d6/d3e/db1/fee zero size 2024-04-03T08:39:35.975 INFO:tasks.workunit.client.1.smithi181.stdout:9/818: rename d1/da/d13/d41/daf/df1/cde to d1/da/d13/d22/d23/c100 0 2024-04-03T08:39:35.977 INFO:tasks.workunit.client.0.smithi157.stdout:9/965: dwrite d1/dab/f133 [0,4194304] 0 2024-04-03T08:39:35.978 INFO:tasks.workunit.client.1.smithi181.stdout:9/819: chown d1/da/d1a/c69 0 1 2024-04-03T08:39:35.978 INFO:tasks.workunit.client.0.smithi157.stdout:7/916: symlink d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/l13e 0 2024-04-03T08:39:35.981 INFO:tasks.workunit.client.1.smithi181.stdout:0/771: mkdir d5/d9/d2a/da1/df7 0 2024-04-03T08:39:35.981 INFO:tasks.workunit.client.0.smithi157.stdout:9/966: write d1/d15/d27/f112 [124503,14783] 0 2024-04-03T08:39:35.982 INFO:tasks.workunit.client.1.smithi181.stdout:0/772: chown d5/l6 632 1 2024-04-03T08:39:35.982 INFO:tasks.workunit.client.1.smithi181.stdout:5/780: truncate d4/d18/f65 1734599 0 2024-04-03T08:39:35.983 INFO:tasks.workunit.client.1.smithi181.stdout:6/838: dread d6/d53/d80/fe6 [0,4194304] 0 2024-04-03T08:39:35.984 INFO:tasks.workunit.client.0.smithi157.stdout:2/856: dread d3/d2e/d32/f94 [0,4194304] 0 2024-04-03T08:39:35.984 INFO:tasks.workunit.client.1.smithi181.stdout:0/773: readlink d5/dc/d14/d29/le3 0 2024-04-03T08:39:35.990 INFO:tasks.workunit.client.1.smithi181.stdout:3/839: unlink d0/d17/d63/d81/f88 0 2024-04-03T08:39:35.992 INFO:tasks.workunit.client.0.smithi157.stdout:4/836: getdents da/d26/df4 0 2024-04-03T08:39:35.994 INFO:tasks.workunit.client.1.smithi181.stdout:2/869: dwrite d13/d1c/f3b [0,4194304] 0 2024-04-03T08:39:35.996 INFO:tasks.workunit.client.1.smithi181.stdout:8/723: rename d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/c98 to d4/d2a/d37/d67/cf0 0 2024-04-03T08:39:35.997 INFO:tasks.workunit.client.1.smithi181.stdout:8/724: readlink d4/d2a/l1e 0 2024-04-03T08:39:36.003 INFO:tasks.workunit.client.0.smithi157.stdout:7/917: dread - d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/f115 zero size 2024-04-03T08:39:36.009 INFO:tasks.workunit.client.0.smithi157.stdout:0/957: getdents d2/d9/dc/df/d6f/d9d/d6a/d91/d10b 0 2024-04-03T08:39:36.009 INFO:tasks.workunit.client.0.smithi157.stdout:5/947: link dc/f1f dc/d29/d56/d2e/f13d 0 2024-04-03T08:39:36.010 INFO:tasks.workunit.client.1.smithi181.stdout:3/840: fsync d0/ff6 0 2024-04-03T08:39:36.011 INFO:tasks.workunit.client.0.smithi157.stdout:8/888: creat d2/f12b x:0 0 0 2024-04-03T08:39:36.012 INFO:tasks.workunit.client.0.smithi157.stdout:0/958: chown d2/d9/d51/d63/d71/cfc 80 1 2024-04-03T08:39:36.013 INFO:tasks.workunit.client.0.smithi157.stdout:6/891: dread d1/d5/d17/d29/d62/d7f/d89/ffa [0,4194304] 0 2024-04-03T08:39:36.014 INFO:tasks.workunit.client.1.smithi181.stdout:2/870: dread d13/fc1 [0,4194304] 0 2024-04-03T08:39:36.015 INFO:tasks.workunit.client.0.smithi157.stdout:1/805: getdents d2/d11/d23/dc9/da1 0 2024-04-03T08:39:36.017 INFO:tasks.workunit.client.0.smithi157.stdout:6/892: chown d1/d5/d17/d2a/d37/c33 7 1 2024-04-03T08:39:36.018 INFO:tasks.workunit.client.0.smithi157.stdout:9/967: fdatasync d1/d15/d27/d34/da6/fb6 0 2024-04-03T08:39:36.021 INFO:tasks.workunit.client.1.smithi181.stdout:4/818: dread d1/d16/d24/d5e/f45 [0,4194304] 0 2024-04-03T08:39:36.023 INFO:tasks.workunit.client.0.smithi157.stdout:6/893: write d1/d5/d17/d29/f5a [2448759,117739] 0 2024-04-03T08:39:36.025 INFO:tasks.workunit.client.0.smithi157.stdout:8/889: symlink d2/d20/d23/l12c 0 2024-04-03T08:39:36.026 INFO:tasks.workunit.client.1.smithi181.stdout:0/774: write f2 [4548877,125892] 0 2024-04-03T08:39:36.028 INFO:tasks.workunit.client.0.smithi157.stdout:1/806: symlink d2/d11/d24/d39/d3b/d1b/l110 0 2024-04-03T08:39:36.029 INFO:tasks.workunit.client.1.smithi181.stdout:6/839: getdents d6/d53/d8d/d97/dcc 0 2024-04-03T08:39:36.031 INFO:tasks.workunit.client.0.smithi157.stdout:1/807: fdatasync d2/d11/d24/d39/d3b/df4/f103 0 2024-04-03T08:39:36.034 INFO:tasks.workunit.client.1.smithi181.stdout:5/781: truncate d4/d44/f5f 326475 0 2024-04-03T08:39:36.035 INFO:tasks.workunit.client.1.smithi181.stdout:3/841: symlink d0/d17/d36/l11b 0 2024-04-03T08:39:36.036 INFO:tasks.workunit.client.1.smithi181.stdout:8/725: fsync d4/d45/db/f56 0 2024-04-03T08:39:36.038 INFO:tasks.workunit.client.0.smithi157.stdout:5/948: fsync dc/d29/f57 0 2024-04-03T08:39:36.039 INFO:tasks.workunit.client.0.smithi157.stdout:9/968: creat d1/d15/d27/daf/da7/f13c x:0 0 0 2024-04-03T08:39:36.042 INFO:tasks.workunit.client.1.smithi181.stdout:9/820: dread d1/da/d28/d30/f87 [0,4194304] 0 2024-04-03T08:39:36.042 INFO:tasks.workunit.client.1.smithi181.stdout:0/775: dwrite d5/d9/d2a/da1/da8/fdf [0,4194304] 0 2024-04-03T08:39:36.042 INFO:tasks.workunit.client.0.smithi157.stdout:7/918: dwrite d0/d11/d15/f87 [0,4194304] 0 2024-04-03T08:39:36.044 INFO:tasks.workunit.client.0.smithi157.stdout:8/890: symlink d2/d11/d10/d24/d5b/d2e/d75/d81/df0/l12d 0 2024-04-03T08:39:36.045 INFO:tasks.workunit.client.1.smithi181.stdout:9/821: dread - d1/da/d13/d22/d23/d36/d91/d9d/daa/fea zero size 2024-04-03T08:39:36.046 INFO:tasks.workunit.client.0.smithi157.stdout:6/894: dwrite d1/f5e [0,4194304] 0 2024-04-03T08:39:36.050 INFO:tasks.workunit.client.0.smithi157.stdout:0/959: dread d2/d9/dc/df/d1b/d4a/fc4 [0,4194304] 0 2024-04-03T08:39:36.060 INFO:tasks.workunit.client.1.smithi181.stdout:0/776: dwrite d5/dc/d75/f91 [0,4194304] 0 2024-04-03T08:39:36.064 INFO:tasks.workunit.client.1.smithi181.stdout:2/871: mkdir d13/d1c/d4a/d68/dfa/df9/d121/d125/d13e 0 2024-04-03T08:39:36.064 INFO:tasks.workunit.client.0.smithi157.stdout:1/808: read d2/d11/d23/f79 [622097,75960] 0 2024-04-03T08:39:36.064 INFO:tasks.workunit.client.0.smithi157.stdout:5/949: fsync dc/d29/d56/fbf 0 2024-04-03T08:39:36.067 INFO:tasks.workunit.client.0.smithi157.stdout:7/919: readlink d0/la 0 2024-04-03T08:39:36.070 INFO:tasks.workunit.client.0.smithi157.stdout:8/891: dread d2/f99 [0,4194304] 0 2024-04-03T08:39:36.071 INFO:tasks.workunit.client.0.smithi157.stdout:9/969: rename d1/d15/dca to d1/d15/d16/d9f/d13d 0 2024-04-03T08:39:36.073 INFO:tasks.workunit.client.1.smithi181.stdout:9/822: symlink d1/da/d28/d30/d3e/d4e/da3/l101 0 2024-04-03T08:39:36.074 INFO:tasks.workunit.client.0.smithi157.stdout:6/895: dread - d1/d4b/d38/da6/fbd zero size 2024-04-03T08:39:36.077 INFO:tasks.workunit.client.0.smithi157.stdout:1/809: chown d2/d11/d24/dd5 0 1 2024-04-03T08:39:36.077 INFO:tasks.workunit.client.1.smithi181.stdout:3/842: rename d0/d17/d40/fd7 to d0/d5/d6/d32/f11c 0 2024-04-03T08:39:36.081 INFO:tasks.workunit.client.1.smithi181.stdout:0/777: creat d5/dc/d10/d58/ff8 x:0 0 0 2024-04-03T08:39:36.082 INFO:tasks.workunit.client.1.smithi181.stdout:2/872: dwrite d13/d1c/da5/dac/f135 [0,4194304] 0 2024-04-03T08:39:36.088 INFO:tasks.workunit.client.0.smithi157.stdout:0/960: rename d2/d9/d5f/d105/f10a to d2/d9/dc/df/d6f/d9d/f155 0 2024-04-03T08:39:36.093 INFO:tasks.workunit.client.0.smithi157.stdout:9/970: dread d1/f33 [0,4194304] 0 2024-04-03T08:39:36.095 INFO:tasks.workunit.client.0.smithi157.stdout:5/950: creat dc/d29/d56/d9e/db5/dc9/d124/d53/f13e x:0 0 0 2024-04-03T08:39:36.097 INFO:tasks.workunit.client.0.smithi157.stdout:0/961: read d2/d9/dc/df/d6f/d9d/d6a/f76 [622786,106398] 0 2024-04-03T08:39:36.100 INFO:tasks.workunit.client.1.smithi181.stdout:4/819: write d1/d16/f54 [1783997,90609] 0 2024-04-03T08:39:36.100 INFO:tasks.workunit.client.1.smithi181.stdout:5/782: dread d4/d22/d78/f85 [0,4194304] 0 2024-04-03T08:39:36.102 INFO:tasks.workunit.client.1.smithi181.stdout:4/820: stat d1/f7 0 2024-04-03T08:39:36.102 INFO:tasks.workunit.client.0.smithi157.stdout:6/896: creat d1/d5/d17/d29/da7/db9/f134 x:0 0 0 2024-04-03T08:39:36.103 INFO:tasks.workunit.client.1.smithi181.stdout:7/715: sync 2024-04-03T08:39:36.103 INFO:tasks.workunit.client.1.smithi181.stdout:1/788: sync 2024-04-03T08:39:36.103 INFO:tasks.workunit.client.1.smithi181.stdout:2/873: mkdir d13/d1c/d73/d13f 0 2024-04-03T08:39:36.104 INFO:tasks.workunit.client.1.smithi181.stdout:4/821: chown d1/d16/dbc/de1 178423305 1 2024-04-03T08:39:36.105 INFO:tasks.workunit.client.1.smithi181.stdout:6/840: dwrite d6/d53/f91 [0,4194304] 0 2024-04-03T08:39:36.105 INFO:tasks.workunit.client.1.smithi181.stdout:9/823: creat d1/da/d28/d30/dd8/df0/f102 x:0 0 0 2024-04-03T08:39:36.106 INFO:tasks.workunit.client.1.smithi181.stdout:8/726: dwrite d4/d44/d59/fb2 [0,4194304] 0 2024-04-03T08:39:36.112 INFO:tasks.workunit.client.0.smithi157.stdout:1/810: mknod d2/d11/d23/dc9/c111 0 2024-04-03T08:39:36.112 INFO:tasks.workunit.client.1.smithi181.stdout:7/716: chown d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/cc5 179612 1 2024-04-03T08:39:36.123 INFO:tasks.workunit.client.0.smithi157.stdout:0/962: creat d2/d9/dc/df/d1b/d4a/d31/f156 x:0 0 0 2024-04-03T08:39:36.124 INFO:tasks.workunit.client.1.smithi181.stdout:5/783: truncate d4/d44/f92 481696 0 2024-04-03T08:39:36.130 INFO:tasks.workunit.client.1.smithi181.stdout:9/824: dwrite d1/da/fab [0,4194304] 0 2024-04-03T08:39:36.130 INFO:tasks.workunit.client.1.smithi181.stdout:1/789: fdatasync d10/d15/d17/d19/d33/d70/f81 0 2024-04-03T08:39:36.134 INFO:tasks.workunit.client.0.smithi157.stdout:5/951: write dc/d29/d56/d52/d9d/da5/daa/fcf [4603506,6593] 0 2024-04-03T08:39:36.135 INFO:tasks.workunit.client.1.smithi181.stdout:6/841: rmdir d6/d3e/db1/dc4 39 2024-04-03T08:39:36.136 INFO:tasks.workunit.client.1.smithi181.stdout:4/822: mkdir d1/d16/d24/d5e/d31/d39/d5d/d9a/d10a 0 2024-04-03T08:39:36.138 INFO:tasks.workunit.client.1.smithi181.stdout:6/842: stat d6/d31/d36/dba/da6/d4f/dd1/f38 0 2024-04-03T08:39:36.139 INFO:tasks.workunit.client.1.smithi181.stdout:8/727: truncate d4/d45/d9/f89 16589 0 2024-04-03T08:39:36.142 INFO:tasks.workunit.client.1.smithi181.stdout:1/790: dread d10/d15/d17/d19/d33/f64 [0,4194304] 0 2024-04-03T08:39:36.142 INFO:tasks.workunit.client.0.smithi157.stdout:7/920: rename d0/d11/d6f/d89/d8c/d103/de3/d12d/fb7 to d0/d11/d6f/d89/f13f 0 2024-04-03T08:39:36.142 INFO:tasks.workunit.client.0.smithi157.stdout:9/971: dwrite d1/d36/d69/f6e [0,4194304] 0 2024-04-03T08:39:36.144 INFO:tasks.workunit.client.1.smithi181.stdout:3/843: unlink d0/d17/d36/d3b/d5a/d93/d9c/fc2 0 2024-04-03T08:39:36.144 INFO:tasks.workunit.client.0.smithi157.stdout:9/972: write d1/d4a/f4c [1639750,99917] 0 2024-04-03T08:39:36.144 INFO:tasks.workunit.client.0.smithi157.stdout:0/963: dwrite d2/d9/dc/df/d1b/f59 [0,4194304] 0 2024-04-03T08:39:36.148 INFO:tasks.workunit.client.0.smithi157.stdout:6/897: truncate d1/d5/d17/d2a/d37/f60 925417 0 2024-04-03T08:39:36.149 INFO:tasks.workunit.client.0.smithi157.stdout:8/892: link d2/d7b/fae d2/d11/d10/f12e 0 2024-04-03T08:39:36.150 INFO:tasks.workunit.client.1.smithi181.stdout:9/825: creat d1/da/d13/d41/d32/f103 x:0 0 0 2024-04-03T08:39:36.151 INFO:tasks.workunit.client.0.smithi157.stdout:1/811: fsync d2/d11/d24/d39/d3b/d1b/f2c 0 2024-04-03T08:39:36.153 INFO:tasks.workunit.client.1.smithi181.stdout:9/826: fsync d1/da/d28/d80/dd3/fd4 0 2024-04-03T08:39:36.153 INFO:tasks.workunit.client.0.smithi157.stdout:7/921: unlink d0/d11/d6f/d89/d8c/d103/da5/fdc 0 2024-04-03T08:39:36.154 INFO:tasks.workunit.client.1.smithi181.stdout:4/823: symlink d1/d16/d24/d5e/d31/dba/l10b 0 2024-04-03T08:39:36.154 INFO:tasks.workunit.client.0.smithi157.stdout:7/922: stat d0/d11/f1d 0 2024-04-03T08:39:36.155 INFO:tasks.workunit.client.0.smithi157.stdout:9/973: unlink d1/d36/d46/f54 0 2024-04-03T08:39:36.167 INFO:tasks.workunit.client.1.smithi181.stdout:6/843: mknod d6/d3e/d40/dbc/dce/c107 0 2024-04-03T08:39:36.169 INFO:tasks.workunit.client.0.smithi157.stdout:0/964: creat d2/d9/dc/df/d6f/d9d/d6a/f157 x:0 0 0 2024-04-03T08:39:36.178 INFO:tasks.workunit.client.1.smithi181.stdout:1/791: mknod d10/d15/d17/d23/d27/cff 0 2024-04-03T08:39:36.180 INFO:tasks.workunit.client.1.smithi181.stdout:1/792: fsync d10/d15/d17/d19/f3e 0 2024-04-03T08:39:36.181 INFO:tasks.workunit.client.0.smithi157.stdout:6/898: rename d1/d5/d17/d2a/d37/c14 to d1/d5/d17/d2a/d37/c135 0 2024-04-03T08:39:36.181 INFO:tasks.workunit.client.1.smithi181.stdout:6/844: dread d6/d3e/d40/fb3 [0,4194304] 0 2024-04-03T08:39:36.184 INFO:tasks.workunit.client.0.smithi157.stdout:6/899: stat d1/d5/d17/d29/da7/db9/df0/cd8 0 2024-04-03T08:39:36.184 INFO:tasks.workunit.client.0.smithi157.stdout:7/923: mkdir d0/d11/d15/d17/d1c/d4f/dcd/d140 0 2024-04-03T08:39:36.185 INFO:tasks.workunit.client.0.smithi157.stdout:6/900: chown d1/d5/cb1 168952 1 2024-04-03T08:39:36.186 INFO:tasks.workunit.client.0.smithi157.stdout:9/974: fsync d1/d15/d16/d9f/d13d/fe4 0 2024-04-03T08:39:36.189 INFO:tasks.workunit.client.0.smithi157.stdout:9/975: fdatasync d1/d15/d27/f112 0 2024-04-03T08:39:36.189 INFO:tasks.workunit.client.0.smithi157.stdout:0/965: dread - d2/d9/dc/f10d zero size 2024-04-03T08:39:36.190 INFO:tasks.workunit.client.1.smithi181.stdout:0/778: getdents d5/dc/d75/daa 0 2024-04-03T08:39:36.190 INFO:tasks.workunit.client.1.smithi181.stdout:5/784: symlink d4/d18/lfb 0 2024-04-03T08:39:36.191 INFO:tasks.workunit.client.1.smithi181.stdout:2/874: dwrite d13/da7/d27/f114 [0,4194304] 0 2024-04-03T08:39:36.193 INFO:tasks.workunit.client.1.smithi181.stdout:0/779: chown d5/dc/d14/d29/d46/ldc 128 1 2024-04-03T08:39:36.195 INFO:tasks.workunit.client.0.smithi157.stdout:7/924: creat d0/d75/f141 x:0 0 0 2024-04-03T08:39:36.197 INFO:tasks.workunit.client.0.smithi157.stdout:5/952: dread dc/d29/d56/d9e/db5/fd2 [0,4194304] 0 2024-04-03T08:39:36.198 INFO:tasks.workunit.client.1.smithi181.stdout:4/824: fsync d1/d16/d24/d5e/d3f/d81/f99 0 2024-04-03T08:39:36.202 INFO:tasks.workunit.client.1.smithi181.stdout:4/825: chown d1/d16/d24/d5e/d31/d39/d5d/d9a/dfb 246134784 1 2024-04-03T08:39:36.205 INFO:tasks.workunit.client.1.smithi181.stdout:8/728: dwrite d4/d44/d59/d5f/fa5 [0,4194304] 0 2024-04-03T08:39:36.205 INFO:tasks.workunit.client.0.smithi157.stdout:6/901: truncate d1/d5/d17/d2a/d30/d95/f58 795467 0 2024-04-03T08:39:36.207 INFO:tasks.workunit.client.1.smithi181.stdout:8/729: chown d4/d44/c9c 30391 1 2024-04-03T08:39:36.208 INFO:tasks.workunit.client.0.smithi157.stdout:6/902: chown d1/d5/d17/d2a/f131 1064 1 2024-04-03T08:39:36.209 INFO:tasks.workunit.client.0.smithi157.stdout:8/893: dwrite d2/d6f/d70/d89/d59/dc1/f10b [0,4194304] 0 2024-04-03T08:39:36.211 INFO:tasks.workunit.client.1.smithi181.stdout:1/793: unlink d10/d15/d17/d23/db0/lb8 0 2024-04-03T08:39:36.213 INFO:tasks.workunit.client.0.smithi157.stdout:5/953: fsync dc/f85 0 2024-04-03T08:39:36.215 INFO:tasks.workunit.client.1.smithi181.stdout:0/780: dwrite d5/dc/d14/fe0 [0,4194304] 0 2024-04-03T08:39:36.215 INFO:tasks.workunit.client.0.smithi157.stdout:6/903: chown d1/d5/d17/d29/da7/db9/f134 26417 1 2024-04-03T08:39:36.216 INFO:tasks.workunit.client.1.smithi181.stdout:1/794: chown d10/d15/d17/d19/d33/d70/cdb 254242385 1 2024-04-03T08:39:36.222 INFO:tasks.workunit.client.1.smithi181.stdout:7/717: rename d0/d1/d6/de/d17/d27/d72/c7b to d0/d1/d6/c105 0 2024-04-03T08:39:36.223 INFO:tasks.workunit.client.1.smithi181.stdout:5/785: unlink c3 0 2024-04-03T08:39:36.223 INFO:tasks.workunit.client.0.smithi157.stdout:0/966: dread d2/d9/dc/df/f139 [0,4194304] 0 2024-04-03T08:39:36.225 INFO:tasks.workunit.client.1.smithi181.stdout:2/875: dread d13/d1c/f38 [0,4194304] 0 2024-04-03T08:39:36.226 INFO:tasks.workunit.client.1.smithi181.stdout:5/786: dread - d4/d18/d2c/fd2 zero size 2024-04-03T08:39:36.227 INFO:tasks.workunit.client.0.smithi157.stdout:9/976: creat d1/d15/d27/f13e x:0 0 0 2024-04-03T08:39:36.229 INFO:tasks.workunit.client.0.smithi157.stdout:6/904: creat d1/d5/d17/d2a/d30/d95/dff/f136 x:0 0 0 2024-04-03T08:39:36.239 INFO:tasks.workunit.client.1.smithi181.stdout:8/730: chown d4/d45/db/d14/fa6 3185 1 2024-04-03T08:39:36.239 INFO:tasks.workunit.client.1.smithi181.stdout:1/795: dwrite d10/d15/d17/d30/f7e [0,4194304] 0 2024-04-03T08:39:36.242 INFO:tasks.workunit.client.0.smithi157.stdout:7/925: dwrite d0/d11/d6f/d89/d8c/d103/f80 [0,4194304] 0 2024-04-03T08:39:36.242 INFO:tasks.workunit.client.0.smithi157.stdout:5/954: mknod dc/d29/d56/d9e/dc3/dde/de4/d12d/d12f/c13f 0 2024-04-03T08:39:36.250 INFO:tasks.workunit.client.1.smithi181.stdout:5/787: mknod d4/d18/d3e/cfc 0 2024-04-03T08:39:36.251 INFO:tasks.workunit.client.0.smithi157.stdout:8/894: getdents d2/d6f/d70/d89 0 2024-04-03T08:39:36.251 INFO:tasks.workunit.client.1.smithi181.stdout:5/788: readlink d4/d18/d55/l67 0 2024-04-03T08:39:36.256 INFO:tasks.workunit.client.1.smithi181.stdout:3/844: getdents d0/d5/d77 0 2024-04-03T08:39:36.256 INFO:tasks.workunit.client.0.smithi157.stdout:5/955: mkdir dc/d29/d140 0 2024-04-03T08:39:36.257 INFO:tasks.workunit.client.0.smithi157.stdout:6/905: link d1/d5/d17/d29/d62/d7f/d89/da4/fee d1/d4b/d38/d59/f137 0 2024-04-03T08:39:36.260 INFO:tasks.workunit.client.0.smithi157.stdout:7/926: rename d0/d11/d15/d17/d1c/d4f/d5f/l7f to d0/d11/d15/d17/d1c/d4f/dcd/l142 0 2024-04-03T08:39:36.262 INFO:tasks.workunit.client.1.smithi181.stdout:7/718: rename d0/d1/d6/dca/cfd to d0/d1/d6/db0/c106 0 2024-04-03T08:39:36.263 INFO:tasks.workunit.client.0.smithi157.stdout:8/895: mknod d2/d11/d10/d24/d5b/d2e/dcf/c12f 0 2024-04-03T08:39:36.263 INFO:tasks.workunit.client.1.smithi181.stdout:5/789: mknod d4/d18/d25/d59/db3/dda/cfd 0 2024-04-03T08:39:36.266 INFO:tasks.workunit.client.0.smithi157.stdout:5/956: truncate dc/fd 260963 0 2024-04-03T08:39:36.267 INFO:tasks.workunit.client.1.smithi181.stdout:1/796: creat d10/d15/d17/d37/de3/f100 x:0 0 0 2024-04-03T08:39:36.267 INFO:tasks.workunit.client.1.smithi181.stdout:6/845: dwrite d6/d53/d80/fe2 [0,4194304] 0 2024-04-03T08:39:36.267 INFO:tasks.workunit.client.0.smithi157.stdout:5/957: dread - dc/f11a zero size 2024-04-03T08:39:36.268 INFO:tasks.workunit.client.1.smithi181.stdout:3/845: symlink d0/d17/d36/d3b/d5a/d93/l11d 0 2024-04-03T08:39:36.272 INFO:tasks.workunit.client.1.smithi181.stdout:9/827: write d1/da/d1a/f4c [393556,42699] 0 2024-04-03T08:39:36.272 INFO:tasks.workunit.client.0.smithi157.stdout:5/958: chown dc/d29/d56/d87/cba 11 1 2024-04-03T08:39:36.277 INFO:tasks.workunit.client.1.smithi181.stdout:3/846: dread d0/d5/d6/f4c [0,4194304] 0 2024-04-03T08:39:36.277 INFO:tasks.workunit.client.1.smithi181.stdout:5/790: creat d4/d80/ffe x:0 0 0 2024-04-03T08:39:36.281 INFO:tasks.workunit.client.0.smithi157.stdout:8/896: rename d2/f99 to d2/d11/d10/d24/d5b/d2e/dcf/dd2/f130 0 2024-04-03T08:39:36.285 INFO:tasks.workunit.client.0.smithi157.stdout:7/927: creat d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/d12e/f143 x:0 0 0 2024-04-03T08:39:36.285 INFO:tasks.workunit.client.0.smithi157.stdout:9/977: write d1/d15/d27/daf/da7/d123/fc3 [1477974,113848] 0 2024-04-03T08:39:36.285 INFO:tasks.workunit.client.0.smithi157.stdout:6/906: link d1/d5/fc2 d1/d5/d17/d29/da7/d129/f138 0 2024-04-03T08:39:36.291 INFO:tasks.workunit.client.1.smithi181.stdout:4/826: truncate d1/d1e/f5b 3035695 0 2024-04-03T08:39:36.295 INFO:tasks.workunit.client.1.smithi181.stdout:5/791: readlink d4/d18/l4f 0 2024-04-03T08:39:36.297 INFO:tasks.workunit.client.1.smithi181.stdout:2/876: dwrite d13/f59 [0,4194304] 0 2024-04-03T08:39:36.297 INFO:tasks.workunit.client.1.smithi181.stdout:0/781: write d5/d9/f28 [1918341,113437] 0 2024-04-03T08:39:36.300 INFO:tasks.workunit.client.1.smithi181.stdout:3/847: truncate d0/d17/fcf 350907 0 2024-04-03T08:39:36.300 INFO:tasks.workunit.client.0.smithi157.stdout:5/959: dwrite dc/d29/d56/d18/f135 [0,4194304] 0 2024-04-03T08:39:36.300 INFO:tasks.workunit.client.0.smithi157.stdout:0/967: dwrite d2/d9/dc/ff5 [0,4194304] 0 2024-04-03T08:39:36.300 INFO:tasks.workunit.client.0.smithi157.stdout:9/978: chown d1/d15/d27/daf/da7/d123/fc3 550 1 2024-04-03T08:39:36.303 INFO:tasks.workunit.client.0.smithi157.stdout:7/928: mknod d0/d11/d6f/d89/d8c/d103/d8e/d96/c144 0 2024-04-03T08:39:36.312 INFO:tasks.workunit.client.0.smithi157.stdout:6/907: mkdir d1/d4b/da5/d139 0 2024-04-03T08:39:36.312 INFO:tasks.workunit.client.1.smithi181.stdout:6/846: link d6/d3e/db1/fe0 d6/d53/d8d/d97/db0/f108 0 2024-04-03T08:39:36.313 INFO:tasks.workunit.client.0.smithi157.stdout:8/897: dread d2/d20/f3c [0,4194304] 0 2024-04-03T08:39:36.320 INFO:tasks.workunit.client.1.smithi181.stdout:9/828: dread d1/da/d13/d41/d65/fa6 [0,4194304] 0 2024-04-03T08:39:36.324 INFO:tasks.workunit.client.1.smithi181.stdout:9/829: truncate d1/da/d13/d22/d23/d36/fe9 513667 0 2024-04-03T08:39:36.332 INFO:tasks.workunit.client.0.smithi157.stdout:8/898: dread d2/d6f/d70/fab [0,4194304] 0 2024-04-03T08:39:36.333 INFO:tasks.workunit.client.1.smithi181.stdout:0/782: creat d5/d9/d2a/de6/ff9 x:0 0 0 2024-04-03T08:39:36.336 INFO:tasks.workunit.client.1.smithi181.stdout:4/827: dwrite d1/d1e/f2e [4194304,4194304] 0 2024-04-03T08:39:36.337 INFO:tasks.workunit.client.0.smithi157.stdout:7/929: mkdir d0/d11/d6f/d89/d8c/d103/de3/d145 0 2024-04-03T08:39:36.337 INFO:tasks.workunit.client.1.smithi181.stdout:3/848: chown d0/d5/d77/ld8 6689746 1 2024-04-03T08:39:36.338 INFO:tasks.workunit.client.1.smithi181.stdout:4/828: chown d1/d16 0 1 2024-04-03T08:39:36.339 INFO:tasks.workunit.client.1.smithi181.stdout:7/719: write d0/f54 [968287,103465] 0 2024-04-03T08:39:36.343 INFO:tasks.workunit.client.1.smithi181.stdout:8/731: rename d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fa1 to d4/d44/ff1 0 2024-04-03T08:39:36.345 INFO:tasks.workunit.client.1.smithi181.stdout:1/797: write d10/d15/d17/d23/d27/f3a [2144681,21495] 0 2024-04-03T08:39:36.351 INFO:tasks.workunit.client.1.smithi181.stdout:5/792: creat d4/d22/d72/d93/fff x:0 0 0 2024-04-03T08:39:36.353 INFO:tasks.workunit.client.1.smithi181.stdout:5/793: write d4/d18/d2c/fd2 [481159,46185] 0 2024-04-03T08:39:36.355 INFO:tasks.workunit.client.1.smithi181.stdout:0/783: creat d5/d9/d2a/ffa x:0 0 0 2024-04-03T08:39:36.357 INFO:tasks.workunit.client.1.smithi181.stdout:5/794: chown d4/d18/d25/d59/fde 5251 1 2024-04-03T08:39:36.357 INFO:tasks.workunit.client.0.smithi157.stdout:7/930: fdatasync d0/d11/d15/d17/d1c/d4f/d5f/f133 0 2024-04-03T08:39:36.358 INFO:tasks.workunit.client.0.smithi157.stdout:8/899: dwrite d2/ffd [0,4194304] 0 2024-04-03T08:39:36.360 INFO:tasks.workunit.client.1.smithi181.stdout:5/795: write d4/d18/d25/d59/fc8 [708395,88890] 0 2024-04-03T08:39:36.360 INFO:tasks.workunit.client.0.smithi157.stdout:0/968: dread d2/d9/dc/f5d [0,4194304] 0 2024-04-03T08:39:36.361 INFO:tasks.workunit.client.1.smithi181.stdout:3/849: chown d0/d17/d36/d1e/db5/ff2 18 1 2024-04-03T08:39:36.361 INFO:tasks.workunit.client.1.smithi181.stdout:7/720: rmdir d0/d1/d6/de 39 2024-04-03T08:39:36.363 INFO:tasks.workunit.client.0.smithi157.stdout:7/931: readlink d0/d11/d15/d17/d1c/l46 0 2024-04-03T08:39:36.367 INFO:tasks.workunit.client.0.smithi157.stdout:0/969: chown d2/d9/dc/df/d6f/d9d/d6a/d91/l12c 8 1 2024-04-03T08:39:36.367 INFO:tasks.workunit.client.0.smithi157.stdout:8/900: rename d2/d6f/d70/d89/lc6 to d2/d6f/db5/l131 0 2024-04-03T08:39:36.371 INFO:tasks.workunit.client.0.smithi157.stdout:0/970: chown d2/d9/dc/dbe/dfb 25108 1 2024-04-03T08:39:36.376 INFO:tasks.workunit.client.1.smithi181.stdout:0/784: creat d5/dc/d14/de5/ffb x:0 0 0 2024-04-03T08:39:36.377 INFO:tasks.workunit.client.0.smithi157.stdout:8/901: symlink d2/d6f/d70/l132 0 2024-04-03T08:39:36.378 INFO:tasks.workunit.client.0.smithi157.stdout:6/908: write d1/f48 [3866633,58931] 0 2024-04-03T08:39:36.381 INFO:tasks.workunit.client.1.smithi181.stdout:7/721: chown d0/f5b 183925 1 2024-04-03T08:39:36.385 INFO:tasks.workunit.client.1.smithi181.stdout:3/850: dwrite d0/d5/d6/dd/f21 [0,4194304] 0 2024-04-03T08:39:36.388 INFO:tasks.workunit.client.0.smithi157.stdout:5/960: dwrite dc/d29/d51/fcc [0,4194304] 0 2024-04-03T08:39:36.389 INFO:tasks.workunit.client.1.smithi181.stdout:2/877: rename d13/d1c/d4a/d7f/db3/c13c to d13/d1c/d4a/d7f/db3/d81/c140 0 2024-04-03T08:39:36.390 INFO:tasks.workunit.client.0.smithi157.stdout:6/909: mkdir d1/d5/d17/d2a/d73/d13a 0 2024-04-03T08:39:36.397 INFO:tasks.workunit.client.0.smithi157.stdout:8/902: stat d2/d11/d10/d24/d5b/d2e/d75/d81/c82 0 2024-04-03T08:39:36.398 INFO:tasks.workunit.client.1.smithi181.stdout:8/732: mknod d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/cf2 0 2024-04-03T08:39:36.398 INFO:tasks.workunit.client.0.smithi157.stdout:3/904: sync 2024-04-03T08:39:36.410 INFO:tasks.workunit.client.0.smithi157.stdout:7/932: write d0/d11/d15/d17/f7d [429898,64590] 0 2024-04-03T08:39:36.412 INFO:tasks.workunit.client.1.smithi181.stdout:9/830: getdents d1/da/d28/d30/dd8/df0 0 2024-04-03T08:39:36.420 INFO:tasks.workunit.client.1.smithi181.stdout:5/796: truncate d4/d18/d25/f41 1423936 0 2024-04-03T08:39:36.423 INFO:tasks.workunit.client.0.smithi157.stdout:3/905: mkdir d8/d1e/d2d/d39/d51/d48/dab/d136/d13c 0 2024-04-03T08:39:36.425 INFO:tasks.workunit.client.0.smithi157.stdout:0/971: dwrite d2/d9/dc/f134 [0,4194304] 0 2024-04-03T08:39:36.430 INFO:tasks.workunit.client.0.smithi157.stdout:3/906: write d8/d1e/d2d/d3f/d4d/d8f/fd5 [590564,105163] 0 2024-04-03T08:39:36.431 INFO:tasks.workunit.client.1.smithi181.stdout:8/733: dwrite d4/d2a/f24 [0,4194304] 0 2024-04-03T08:39:36.432 INFO:tasks.workunit.client.1.smithi181.stdout:7/722: write d0/d1/d6/de/d17/f2c [1083369,128059] 0 2024-04-03T08:39:36.432 INFO:tasks.workunit.client.0.smithi157.stdout:6/910: rmdir d1/d5/d17/d2a/d37/dca/d107 0 2024-04-03T08:39:36.437 INFO:tasks.workunit.client.0.smithi157.stdout:8/903: creat d2/d6f/d70/d89/d59/f133 x:0 0 0 2024-04-03T08:39:36.438 INFO:tasks.workunit.client.1.smithi181.stdout:6/847: rename d6/d31/d36/dba/fae to d6/d31/d36/dba/da6/d4f/dd1/d9/f109 0 2024-04-03T08:39:36.443 INFO:tasks.workunit.client.1.smithi181.stdout:0/785: dwrite d5/d9/f97 [4194304,4194304] 0 2024-04-03T08:39:36.447 INFO:tasks.workunit.client.1.smithi181.stdout:0/786: write d5/d9/d2a/de6/dcc/fe2 [204483,124247] 0 2024-04-03T08:39:36.448 INFO:tasks.workunit.client.1.smithi181.stdout:4/829: rename d1/d16/d24/d5e/d2b/d56/lc5 to d1/d16/d37/d34/d86/ded/l10c 0 2024-04-03T08:39:36.453 INFO:tasks.workunit.client.1.smithi181.stdout:8/734: mkdir d4/d44/df3 0 2024-04-03T08:39:36.455 INFO:tasks.workunit.client.0.smithi157.stdout:7/933: dwrite d0/d11/d6f/d89/d8c/d103/de3/d12d/f45 [0,4194304] 0 2024-04-03T08:39:36.462 INFO:tasks.workunit.client.1.smithi181.stdout:9/831: write d1/da/d13/d22/d23/d36/d91/d9d/f37 [1606549,67265] 0 2024-04-03T08:39:36.467 INFO:tasks.workunit.client.1.smithi181.stdout:9/832: write d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 [5124310,92837] 0 2024-04-03T08:39:36.469 INFO:tasks.workunit.client.0.smithi157.stdout:0/972: mknod d2/d9/dc/df/d1b/d35/c158 0 2024-04-03T08:39:36.470 INFO:tasks.workunit.client.1.smithi181.stdout:0/787: creat d5/dc/d14/de5/deb/ffc x:0 0 0 2024-04-03T08:39:36.471 INFO:tasks.workunit.client.1.smithi181.stdout:8/735: dread d4/f46 [0,4194304] 0 2024-04-03T08:39:36.474 INFO:tasks.workunit.client.0.smithi157.stdout:0/973: readlink d2/d9/dc/df/d1b/d35/dc0/l137 0 2024-04-03T08:39:36.477 INFO:tasks.workunit.client.1.smithi181.stdout:1/798: rename d10/c51 to d10/d15/d17/d23/db0/c101 0 2024-04-03T08:39:36.479 INFO:tasks.workunit.client.1.smithi181.stdout:1/799: fsync d10/d15/d17/d19/f3e 0 2024-04-03T08:39:36.482 INFO:tasks.workunit.client.0.smithi157.stdout:7/934: creat d0/d11/d6f/f146 x:0 0 0 2024-04-03T08:39:36.483 INFO:tasks.workunit.client.1.smithi181.stdout:1/800: truncate d10/d15/d17/d19/d33/d70/ff7 508345 0 2024-04-03T08:39:36.484 INFO:tasks.workunit.client.0.smithi157.stdout:3/907: dwrite d8/d13/d1b/d83/fd4 [4194304,4194304] 0 2024-04-03T08:39:36.486 INFO:tasks.workunit.client.1.smithi181.stdout:9/833: write d1/da/d13/d22/d23/fba [4848147,77739] 0 2024-04-03T08:39:36.487 INFO:tasks.workunit.client.0.smithi157.stdout:5/961: getdents dc/d29/d56 0 2024-04-03T08:39:36.488 INFO:tasks.workunit.client.0.smithi157.stdout:7/935: write d0/d11/d6f/d76/da7/f62 [3041225,51859] 0 2024-04-03T08:39:36.490 INFO:tasks.workunit.client.0.smithi157.stdout:6/911: dwrite d1/d4b/d38/d59/f9b [0,4194304] 0 2024-04-03T08:39:36.494 INFO:tasks.workunit.client.0.smithi157.stdout:7/936: stat d0/d11/d6f/d76/da7/f62 0 2024-04-03T08:39:36.495 INFO:tasks.workunit.client.1.smithi181.stdout:2/878: rename d13/d1c/d4a/d7f/db3/d81/l11b to d13/d1c/da5/l141 0 2024-04-03T08:39:36.496 INFO:tasks.workunit.client.1.smithi181.stdout:1/801: unlink d10/d15/d4b/d6c/cef 0 2024-04-03T08:39:36.501 INFO:tasks.workunit.client.1.smithi181.stdout:2/879: write d13/d1c/d4a/d68/dba/fd3 [1483197,85458] 0 2024-04-03T08:39:36.501 INFO:tasks.workunit.client.0.smithi157.stdout:3/908: mkdir d8/d1e/d2d/d39/d51/d7e/d13d 0 2024-04-03T08:39:36.505 INFO:tasks.workunit.client.1.smithi181.stdout:6/848: getdents d6/d31/d36/dba/d95 0 2024-04-03T08:39:36.506 INFO:tasks.workunit.client.1.smithi181.stdout:2/880: write d13/d1c/d4a/d68/dba/fd3 [535253,121946] 0 2024-04-03T08:39:36.508 INFO:tasks.workunit.client.1.smithi181.stdout:7/723: dread d0/d1/d6/de/d17/f55 [0,4194304] 0 2024-04-03T08:39:36.509 INFO:tasks.workunit.client.1.smithi181.stdout:9/834: truncate d1/da/d28/f64 769690 0 2024-04-03T08:39:36.511 INFO:tasks.workunit.client.1.smithi181.stdout:7/724: stat d0/d1/d6/de/d17/c3f 0 2024-04-03T08:39:36.512 INFO:tasks.workunit.client.1.smithi181.stdout:5/797: rename d4/d18/d25/d59/db3/dda/cdf to d4/d44/d71/dcf/c100 0 2024-04-03T08:39:36.512 INFO:tasks.workunit.client.1.smithi181.stdout:3/851: sync 2024-04-03T08:39:36.514 INFO:tasks.workunit.client.0.smithi157.stdout:6/912: unlink d1/d5/d17/d2a/d37/cc9 0 2024-04-03T08:39:36.514 INFO:tasks.workunit.client.1.smithi181.stdout:5/798: chown d4/d18/d25/c74 3142 1 2024-04-03T08:39:36.519 INFO:tasks.workunit.client.1.smithi181.stdout:0/788: dread d5/f74 [0,4194304] 0 2024-04-03T08:39:36.520 INFO:tasks.workunit.client.1.smithi181.stdout:0/789: chown d5/dc/d10/d58/ff8 497 1 2024-04-03T08:39:36.521 INFO:tasks.workunit.client.0.smithi157.stdout:7/937: rename d0/d11/d15/d1b/db4/lcb to d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/d5b/l147 0 2024-04-03T08:39:36.521 INFO:tasks.workunit.client.1.smithi181.stdout:8/736: write d4/d2a/d37/d67/d91/fe9 [660066,48022] 0 2024-04-03T08:39:36.522 INFO:tasks.workunit.client.1.smithi181.stdout:0/790: chown d5/d9/d2a/de6/f69 965295 1 2024-04-03T08:39:36.525 INFO:tasks.workunit.client.0.smithi157.stdout:6/913: rename d1/d5/d17/d2a/d30/d77/fdb to d1/d5/d17/d29/da7/d129/f13b 0 2024-04-03T08:39:36.527 INFO:tasks.workunit.client.0.smithi157.stdout:3/909: write d8/f28 [114788,99690] 0 2024-04-03T08:39:36.532 INFO:tasks.workunit.client.1.smithi181.stdout:6/849: mkdir d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/d10a 0 2024-04-03T08:39:36.533 INFO:tasks.workunit.client.0.smithi157.stdout:3/910: truncate d8/d1e/d2d/d3f/d4d/d8f/fff 175406 0 2024-04-03T08:39:36.534 INFO:tasks.workunit.client.0.smithi157.stdout:6/914: mknod d1/d5/d17/d29/da7/c13c 0 2024-04-03T08:39:36.535 INFO:tasks.workunit.client.1.smithi181.stdout:7/725: chown d0/d1/d6/de/d17/d64/d82/l101 276110 1 2024-04-03T08:39:36.536 INFO:tasks.workunit.client.1.smithi181.stdout:4/830: link d1/d16/d24/d5e/d31/d39/da1/df8/ce9 d1/d16/d24/d5e/d31/d39/c10d 0 2024-04-03T08:39:36.538 INFO:tasks.workunit.client.1.smithi181.stdout:5/799: creat d4/d18/d55/d5a/dcd/dee/f101 x:0 0 0 2024-04-03T08:39:36.544 INFO:tasks.workunit.client.0.smithi157.stdout:3/911: mkdir d8/d1e/d2d/d39/d51/d4c/dd6/de0/d13e 0 2024-04-03T08:39:36.545 INFO:tasks.workunit.client.1.smithi181.stdout:4/831: dread d1/d16/d24/d5e/d31/fa5 [0,4194304] 0 2024-04-03T08:39:36.549 INFO:tasks.workunit.client.0.smithi157.stdout:7/938: dread d0/d11/d6f/d89/d8c/d103/f65 [0,4194304] 0 2024-04-03T08:39:36.550 INFO:tasks.workunit.client.1.smithi181.stdout:8/737: mknod d4/d45/db/d14/dd0/cf4 0 2024-04-03T08:39:36.552 INFO:tasks.workunit.client.1.smithi181.stdout:9/835: symlink d1/l104 0 2024-04-03T08:39:36.552 INFO:tasks.workunit.client.1.smithi181.stdout:6/850: mkdir d6/d31/d36/dba/da6/d4f/dd1/d50/d64/d10b 0 2024-04-03T08:39:36.553 INFO:tasks.workunit.client.1.smithi181.stdout:8/738: dread - d4/fd8 zero size 2024-04-03T08:39:36.555 INFO:tasks.workunit.client.0.smithi157.stdout:7/939: symlink d0/d11/d15/d17/d1c/da1/l148 0 2024-04-03T08:39:36.556 INFO:tasks.workunit.client.0.smithi157.stdout:3/912: rmdir d8/d1e/d2d/d39/d51/d4c/dd6/d134 0 2024-04-03T08:39:36.557 INFO:tasks.workunit.client.1.smithi181.stdout:2/881: dwrite d13/d1c/f99 [0,4194304] 0 2024-04-03T08:39:36.558 INFO:tasks.workunit.client.1.smithi181.stdout:7/726: fsync d0/f3e 0 2024-04-03T08:39:36.559 INFO:tasks.workunit.client.0.smithi157.stdout:6/915: dwrite d1/fcb [0,4194304] 0 2024-04-03T08:39:36.559 INFO:tasks.workunit.client.0.smithi157.stdout:3/913: chown d8/d1e/d2d/d3b/f43 503011474 1 2024-04-03T08:39:36.565 INFO:tasks.workunit.client.1.smithi181.stdout:5/800: creat d4/d18/d55/db4/d90/f102 x:0 0 0 2024-04-03T08:39:36.566 INFO:tasks.workunit.client.1.smithi181.stdout:1/802: link d10/d15/d4b/c85 d10/d15/d17/d37/de3/c102 0 2024-04-03T08:39:36.566 INFO:tasks.workunit.client.0.smithi157.stdout:2/857: sync 2024-04-03T08:39:36.567 INFO:tasks.workunit.client.1.smithi181.stdout:3/852: truncate d0/d5/d77/fc8 976675 0 2024-04-03T08:39:36.568 INFO:tasks.workunit.client.1.smithi181.stdout:5/801: dread - d4/d22/d4a/dad/db6/fd5 zero size 2024-04-03T08:39:36.568 INFO:tasks.workunit.client.0.smithi157.stdout:3/914: creat d8/d13/d1b/d4e/da6/f13f x:0 0 0 2024-04-03T08:39:36.573 INFO:tasks.workunit.client.0.smithi157.stdout:3/915: mkdir d8/d1e/d2d/d39/d51/d48/d140 0 2024-04-03T08:39:36.574 INFO:tasks.workunit.client.0.smithi157.stdout:7/940: dwrite d0/d11/d6f/d89/d8c/d103/f2d [0,4194304] 0 2024-04-03T08:39:36.580 INFO:tasks.workunit.client.0.smithi157.stdout:7/941: rename d0/d11/d15/d17/f77 to d0/d11/d15/d1b/db8/f149 0 2024-04-03T08:39:36.581 INFO:tasks.workunit.client.0.smithi157.stdout:3/916: creat d8/d1e/d2d/d123/f141 x:0 0 0 2024-04-03T08:39:36.585 INFO:tasks.workunit.client.0.smithi157.stdout:7/942: dread - d0/d11/d15/d17/d1c/d4f/f104 zero size 2024-04-03T08:39:36.585 INFO:tasks.workunit.client.1.smithi181.stdout:5/802: dwrite d4/d18/d55/db4/fe4 [0,4194304] 0 2024-04-03T08:39:36.589 INFO:tasks.workunit.client.1.smithi181.stdout:5/803: write d4/d18/d55/db4/d90/f102 [280556,118826] 0 2024-04-03T08:39:36.614 INFO:tasks.workunit.client.0.smithi157.stdout:2/858: dread d3/d12/d43/d4b/d55/fde [0,4194304] 0 2024-04-03T08:39:36.618 INFO:tasks.workunit.client.1.smithi181.stdout:4/832: write d1/d16/d37/d34/d69/fd0 [191949,7016] 0 2024-04-03T08:39:36.620 INFO:tasks.workunit.client.1.smithi181.stdout:4/833: chown d1/d16/d24/d5e/d3f/d41/l44 133732 1 2024-04-03T08:39:36.621 INFO:tasks.workunit.client.0.smithi157.stdout:2/859: symlink d3/db/d44/d4c/d5a/d88/df6/l124 0 2024-04-03T08:39:36.621 INFO:tasks.workunit.client.1.smithi181.stdout:4/834: chown d1/d16/d24/d5e/d31/c9f 141 1 2024-04-03T08:39:36.625 INFO:tasks.workunit.client.0.smithi157.stdout:2/860: rmdir d3/d12 39 2024-04-03T08:39:36.626 INFO:tasks.workunit.client.1.smithi181.stdout:7/727: mknod d0/d1/d6/de/d6d/c107 0 2024-04-03T08:39:36.627 INFO:tasks.workunit.client.1.smithi181.stdout:1/803: symlink d10/d15/d17/d23/db0/d8d/l103 0 2024-04-03T08:39:36.632 INFO:tasks.workunit.client.0.smithi157.stdout:2/861: chown d3/d12/d43/d4b/l85 8 1 2024-04-03T08:39:36.635 INFO:tasks.workunit.client.1.smithi181.stdout:8/739: symlink d4/d44/lf5 0 2024-04-03T08:39:36.638 INFO:tasks.workunit.client.0.smithi157.stdout:2/862: unlink d3/d2e/d32/d9f/da7/d121/fa2 0 2024-04-03T08:39:36.639 INFO:tasks.workunit.client.1.smithi181.stdout:4/835: fdatasync d1/d16/f5a 0 2024-04-03T08:39:36.642 INFO:tasks.workunit.client.0.smithi157.stdout:7/943: dwrite d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/f78 [0,4194304] 0 2024-04-03T08:39:36.643 INFO:tasks.workunit.client.1.smithi181.stdout:6/851: creat d6/d31/d36/dba/d81/f10c x:0 0 0 2024-04-03T08:39:36.646 INFO:tasks.workunit.client.0.smithi157.stdout:2/863: fsync d3/db/f1f 0 2024-04-03T08:39:36.646 INFO:tasks.workunit.client.1.smithi181.stdout:2/882: mknod d13/da7/d85/c142 0 2024-04-03T08:39:36.648 INFO:tasks.workunit.client.0.smithi157.stdout:2/864: readlink d3/d12/d43/d4b/l99 0 2024-04-03T08:39:36.653 INFO:tasks.workunit.client.1.smithi181.stdout:1/804: rmdir d10/d15/d17/d19/d33/d70 39 2024-04-03T08:39:36.654 INFO:tasks.workunit.client.0.smithi157.stdout:2/865: mknod d3/db/d44/d4c/d5a/d88/dc6/c125 0 2024-04-03T08:39:36.657 INFO:tasks.workunit.client.1.smithi181.stdout:0/791: getdents d5/dc/d10/d58 0 2024-04-03T08:39:36.657 INFO:tasks.workunit.client.1.smithi181.stdout:8/740: dread d4/d45/d9/f38 [0,4194304] 0 2024-04-03T08:39:36.660 INFO:tasks.workunit.client.1.smithi181.stdout:9/836: creat d1/da/d13/d41/f105 x:0 0 0 2024-04-03T08:39:36.662 INFO:tasks.workunit.client.0.smithi157.stdout:7/944: dwrite d0/d75/f134 [0,4194304] 0 2024-04-03T08:39:36.663 INFO:tasks.workunit.client.0.smithi157.stdout:2/866: rmdir d3/da6 39 2024-04-03T08:39:36.664 INFO:tasks.workunit.client.0.smithi157.stdout:7/945: dread - d0/d11/d6f/d89/d8c/dc6/d116/f11c zero size 2024-04-03T08:39:36.665 INFO:tasks.workunit.client.1.smithi181.stdout:4/836: mkdir d1/d1e/d2c/d10e 0 2024-04-03T08:39:36.668 INFO:tasks.workunit.client.1.smithi181.stdout:6/852: rmdir d6/dc0/d103 39 2024-04-03T08:39:36.669 INFO:tasks.workunit.client.1.smithi181.stdout:4/837: write d1/f92 [3466765,34209] 0 2024-04-03T08:39:36.676 INFO:tasks.workunit.client.0.smithi157.stdout:2/867: mkdir d3/db/d44/d4c/d126 0 2024-04-03T08:39:36.679 INFO:tasks.workunit.client.1.smithi181.stdout:1/805: chown d10/d15/c29 30584166 1 2024-04-03T08:39:36.679 INFO:tasks.workunit.client.0.smithi157.stdout:7/946: dread d0/d11/d6f/fe9 [0,4194304] 0 2024-04-03T08:39:36.681 INFO:tasks.workunit.client.1.smithi181.stdout:0/792: creat d5/dc/d10/d58/dba/ffd x:0 0 0 2024-04-03T08:39:36.683 INFO:tasks.workunit.client.1.smithi181.stdout:8/741: creat d4/d2a/dd2/ff6 x:0 0 0 2024-04-03T08:39:36.683 INFO:tasks.workunit.client.1.smithi181.stdout:1/806: chown d10/da1/fb1 13906423 1 2024-04-03T08:39:36.685 INFO:tasks.workunit.client.0.smithi157.stdout:7/947: fdatasync d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/fa6 0 2024-04-03T08:39:36.688 INFO:tasks.workunit.client.1.smithi181.stdout:3/853: dwrite d0/d17/d36/d1e/f7e [0,4194304] 0 2024-04-03T08:39:36.688 INFO:tasks.workunit.client.0.smithi157.stdout:2/868: dread d3/d2e/f80 [0,4194304] 0 2024-04-03T08:39:36.689 INFO:tasks.workunit.client.1.smithi181.stdout:8/742: chown d4/d2a/d37/d67 3 1 2024-04-03T08:39:36.690 INFO:tasks.workunit.client.1.smithi181.stdout:0/793: dread - d5/dc/d10/d58/ff8 zero size 2024-04-03T08:39:36.692 INFO:tasks.workunit.client.0.smithi157.stdout:4/837: sync 2024-04-03T08:39:36.692 INFO:tasks.workunit.client.1.smithi181.stdout:5/804: getdents d4 0 2024-04-03T08:39:36.692 INFO:tasks.workunit.client.0.smithi157.stdout:7/948: mkdir d0/d11/d6f/d89/d8c/d103/d8e/d14a 0 2024-04-03T08:39:36.694 INFO:tasks.workunit.client.1.smithi181.stdout:9/837: rename d1/da/d13/d73/f7d to d1/da/d13/d22/d23/d36/d9c/f106 0 2024-04-03T08:39:36.697 INFO:tasks.workunit.client.1.smithi181.stdout:6/853: dwrite d6/d31/d36/dba/da6/fd5 [0,4194304] 0 2024-04-03T08:39:36.697 INFO:tasks.workunit.client.0.smithi157.stdout:4/838: dread da/df/d2f/d64/f96 [0,4194304] 0 2024-04-03T08:39:36.700 INFO:tasks.workunit.client.0.smithi157.stdout:2/869: mkdir d3/d2e/d32/d9f/da7/d127 0 2024-04-03T08:39:36.701 INFO:tasks.workunit.client.1.smithi181.stdout:9/838: chown d1/da/f21 31078 1 2024-04-03T08:39:36.702 INFO:tasks.workunit.client.1.smithi181.stdout:4/838: dwrite d1/d16/d24/d5e/d31/d39/da1/fc0 [0,4194304] 0 2024-04-03T08:39:36.704 INFO:tasks.workunit.client.0.smithi157.stdout:7/949: fdatasync d0/d11/d6f/d89/d8c/d103/daf/fbe 0 2024-04-03T08:39:36.707 INFO:tasks.workunit.client.1.smithi181.stdout:4/839: stat d1/d16/d24/d5e/d31/c9f 0 2024-04-03T08:39:36.707 INFO:tasks.workunit.client.1.smithi181.stdout:7/728: dwrite d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:36.710 INFO:tasks.workunit.client.1.smithi181.stdout:7/729: readlink d0/l5 0 2024-04-03T08:39:36.711 INFO:tasks.workunit.client.0.smithi157.stdout:7/950: read d0/d11/d15/d17/d1c/f47 [3779472,348] 0 2024-04-03T08:39:36.715 INFO:tasks.workunit.client.1.smithi181.stdout:1/807: dwrite d10/d15/d4a/d6f/ffd [4194304,4194304] 0 2024-04-03T08:39:36.719 INFO:tasks.workunit.client.0.smithi157.stdout:2/870: symlink d3/db/d44/d4c/df1/l128 0 2024-04-03T08:39:36.721 INFO:tasks.workunit.client.1.smithi181.stdout:5/805: symlink d4/d18/d55/d5a/dcd/dee/l103 0 2024-04-03T08:39:36.722 INFO:tasks.workunit.client.1.smithi181.stdout:8/743: creat d4/d45/db/d14/dd0/ff7 x:0 0 0 2024-04-03T08:39:36.722 INFO:tasks.workunit.client.1.smithi181.stdout:1/808: read - d10/d15/d17/d23/daa/de1/fe5 zero size 2024-04-03T08:39:36.731 INFO:tasks.workunit.client.0.smithi157.stdout:7/951: readlink d0/d11/d15/d17/d1c/d4f/dcd/l142 0 2024-04-03T08:39:36.732 INFO:tasks.workunit.client.1.smithi181.stdout:4/840: symlink d1/d16/d24/d61/l10f 0 2024-04-03T08:39:36.733 INFO:tasks.workunit.client.1.smithi181.stdout:4/841: readlink d1/d16/d55/lb0 0 2024-04-03T08:39:36.733 INFO:tasks.workunit.client.0.smithi157.stdout:7/952: chown d0/d11/l12f 329496 1 2024-04-03T08:39:36.733 INFO:tasks.workunit.client.1.smithi181.stdout:7/730: creat d0/d1/d6/de/d17/d64/d85/dd8/f108 x:0 0 0 2024-04-03T08:39:36.734 INFO:tasks.workunit.client.1.smithi181.stdout:9/839: dwrite d1/da/d13/d22/d23/d36/d91/d9d/f37 [0,4194304] 0 2024-04-03T08:39:36.735 INFO:tasks.workunit.client.0.smithi157.stdout:4/839: dwrite da/df/f74 [0,4194304] 0 2024-04-03T08:39:36.736 INFO:tasks.workunit.client.0.smithi157.stdout:2/871: mkdir d3/d2e/d32/d9f/d129 0 2024-04-03T08:39:36.738 INFO:tasks.workunit.client.1.smithi181.stdout:2/883: getdents d13/da7/d27/d2f/d5d 0 2024-04-03T08:39:36.738 INFO:tasks.workunit.client.0.smithi157.stdout:2/872: chown d3/d12/d43/d4b/d55/d11f 1065 1 2024-04-03T08:39:36.739 INFO:tasks.workunit.client.1.smithi181.stdout:5/806: creat d4/d22/d72/d93/f104 x:0 0 0 2024-04-03T08:39:36.744 INFO:tasks.workunit.client.0.smithi157.stdout:7/953: read d0/d11/d15/d17/d52/f5a [2766285,115541] 0 2024-04-03T08:39:36.745 INFO:tasks.workunit.client.1.smithi181.stdout:7/731: truncate d0/d1/d94/fe7 658012 0 2024-04-03T08:39:36.746 INFO:tasks.workunit.client.1.smithi181.stdout:0/794: rmdir d5/dc/dc5 0 2024-04-03T08:39:36.746 INFO:tasks.workunit.client.1.smithi181.stdout:3/854: creat d0/d5/d6/dd/d25/f11e x:0 0 0 2024-04-03T08:39:36.747 INFO:tasks.workunit.client.0.smithi157.stdout:2/873: rmdir d3/d12/d43/d4b/d55/d11f 0 2024-04-03T08:39:36.750 INFO:tasks.workunit.client.1.smithi181.stdout:6/854: write d6/d3e/d40/fb3 [1911863,124172] 0 2024-04-03T08:39:36.751 INFO:tasks.workunit.client.0.smithi157.stdout:7/954: mknod d0/d11/d6f/d89/d8c/d103/da5/c14b 0 2024-04-03T08:39:36.753 INFO:tasks.workunit.client.0.smithi157.stdout:2/874: creat d3/db/d44/f12a x:0 0 0 2024-04-03T08:39:36.755 INFO:tasks.workunit.client.1.smithi181.stdout:2/884: rename d13/da7/d27/f3a to d13/d1c/da5/f143 0 2024-04-03T08:39:36.756 INFO:tasks.workunit.client.1.smithi181.stdout:8/744: dwrite d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fc7 [0,4194304] 0 2024-04-03T08:39:36.757 INFO:tasks.workunit.client.1.smithi181.stdout:0/795: mknod d5/dc/d75/de1/cfe 0 2024-04-03T08:39:36.758 INFO:tasks.workunit.client.1.smithi181.stdout:9/840: truncate d1/da/d13/d41/d65/ffd 120701 0 2024-04-03T08:39:36.759 INFO:tasks.workunit.client.1.smithi181.stdout:7/732: readlink d0/d1/d6/de/d17/d27/d72/df4/lfb 0 2024-04-03T08:39:36.760 INFO:tasks.workunit.client.0.smithi157.stdout:7/955: creat d0/d11/d6f/d89/d8c/dc6/f14c x:0 0 0 2024-04-03T08:39:36.762 INFO:tasks.workunit.client.0.smithi157.stdout:4/840: dwrite da/df/d2f/d64/d8f/f118 [0,4194304] 0 2024-04-03T08:39:36.764 INFO:tasks.workunit.client.0.smithi157.stdout:4/841: stat da/df/d24/d35/f87 0 2024-04-03T08:39:36.767 INFO:tasks.workunit.client.1.smithi181.stdout:2/885: chown d13/d1c/ld1 30404885 1 2024-04-03T08:39:36.767 INFO:tasks.workunit.client.1.smithi181.stdout:0/796: write d5/dc/d10/d58/ff8 [523546,118411] 0 2024-04-03T08:39:36.767 INFO:tasks.workunit.client.0.smithi157.stdout:7/956: creat d0/d11/d15/d17/d52/f14d x:0 0 0 2024-04-03T08:39:36.774 INFO:tasks.workunit.client.0.smithi157.stdout:4/842: mkdir da/de0/d11f 0 2024-04-03T08:39:36.776 INFO:tasks.workunit.client.1.smithi181.stdout:6/855: fdatasync d6/d31/d36/dba/da6/fbb 0 2024-04-03T08:39:36.782 INFO:tasks.workunit.client.0.smithi157.stdout:4/843: truncate da/df/d2f/d64/d8f/dbd/f7c 717828 0 2024-04-03T08:39:36.784 INFO:tasks.workunit.client.0.smithi157.stdout:4/844: dread - da/df/d6b/f113 zero size 2024-04-03T08:39:36.784 INFO:tasks.workunit.client.1.smithi181.stdout:4/842: dwrite d1/d16/d24/d5e/d2b/d56/f71 [0,4194304] 0 2024-04-03T08:39:36.787 INFO:tasks.workunit.client.0.smithi157.stdout:4/845: mkdir da/df/d2f/d54/d120 0 2024-04-03T08:39:36.788 INFO:tasks.workunit.client.0.smithi157.stdout:4/846: dread - da/d26/f115 zero size 2024-04-03T08:39:36.791 INFO:tasks.workunit.client.1.smithi181.stdout:5/807: dwrite d4/d44/d71/dcf/fdc [4194304,4194304] 0 2024-04-03T08:39:36.791 INFO:tasks.workunit.client.1.smithi181.stdout:2/886: write ff [3576702,100453] 0 2024-04-03T08:39:36.792 INFO:tasks.workunit.client.1.smithi181.stdout:7/733: truncate d0/f9f 523279 0 2024-04-03T08:39:36.794 INFO:tasks.workunit.client.1.smithi181.stdout:9/841: truncate d1/da/d13/d22/fca 742463 0 2024-04-03T08:39:36.796 INFO:tasks.workunit.client.1.smithi181.stdout:2/887: rmdir d13/da7/d40/d10f 39 2024-04-03T08:39:36.798 INFO:tasks.workunit.client.1.smithi181.stdout:0/797: creat d5/dc/d8e/dea/fff x:0 0 0 2024-04-03T08:39:36.801 INFO:tasks.workunit.client.1.smithi181.stdout:6/856: dread - d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/fc1 zero size 2024-04-03T08:39:36.803 INFO:tasks.workunit.client.0.smithi157.stdout:2/875: dread d3/db/d44/f92 [0,4194304] 0 2024-04-03T08:39:36.805 INFO:tasks.workunit.client.1.smithi181.stdout:3/855: dread d0/d5/d6/d32/fdc [0,4194304] 0 2024-04-03T08:39:36.806 INFO:tasks.workunit.client.1.smithi181.stdout:1/809: dread d10/d15/d17/d23/db0/d8d/f9b [0,4194304] 0 2024-04-03T08:39:36.810 INFO:tasks.workunit.client.1.smithi181.stdout:5/808: mknod d4/d18/d55/db4/d90/c105 0 2024-04-03T08:39:36.812 INFO:tasks.workunit.client.1.smithi181.stdout:4/843: dread d1/d1e/d2c/f59 [0,4194304] 0 2024-04-03T08:39:36.812 INFO:tasks.workunit.client.1.smithi181.stdout:6/857: dread - d6/d53/d80/ff7 zero size 2024-04-03T08:39:36.815 INFO:tasks.workunit.client.1.smithi181.stdout:8/745: dread d4/d2a/d37/d67/d91/fe9 [0,4194304] 0 2024-04-03T08:39:36.816 INFO:tasks.workunit.client.1.smithi181.stdout:2/888: symlink d13/da7/d85/de4/l144 0 2024-04-03T08:39:36.816 INFO:tasks.workunit.client.1.smithi181.stdout:9/842: rmdir d1/da/d28/d30/d3e/d4e/da3 39 2024-04-03T08:39:36.819 INFO:tasks.workunit.client.1.smithi181.stdout:5/809: chown d4/d18/d2c/c36 124 1 2024-04-03T08:39:36.819 INFO:tasks.workunit.client.1.smithi181.stdout:3/856: symlink d0/dbc/l11f 0 2024-04-03T08:39:36.821 INFO:tasks.workunit.client.1.smithi181.stdout:5/810: stat d4/d80 0 2024-04-03T08:39:36.821 INFO:tasks.workunit.client.0.smithi157.stdout:2/876: read d3/db/d44/d4c/d5a/d88/fb0 [2053178,100282] 0 2024-04-03T08:39:36.822 INFO:tasks.workunit.client.1.smithi181.stdout:4/844: creat d1/d1e/d2c/de4/f110 x:0 0 0 2024-04-03T08:39:36.823 INFO:tasks.workunit.client.0.smithi157.stdout:4/847: dwrite da/df/d24/d35/d53/ff3 [0,4194304] 0 2024-04-03T08:39:36.825 INFO:tasks.workunit.client.1.smithi181.stdout:8/746: unlink d4/d45/db/d14/lca 0 2024-04-03T08:39:36.825 INFO:tasks.workunit.client.1.smithi181.stdout:3/857: fsync d0/d5/d6/dd/d25/f4d 0 2024-04-03T08:39:36.834 INFO:tasks.workunit.client.0.smithi157.stdout:9/979: sync 2024-04-03T08:39:36.834 INFO:tasks.workunit.client.0.smithi157.stdout:1/812: sync 2024-04-03T08:39:36.835 INFO:tasks.workunit.client.1.smithi181.stdout:0/798: creat d5/dc/d8e/dea/f100 x:0 0 0 2024-04-03T08:39:36.839 INFO:tasks.workunit.client.1.smithi181.stdout:7/734: dwrite d0/d1/d6/de/d17/d64/d85/d9a/da4/f7a [4194304,4194304] 0 2024-04-03T08:39:36.839 INFO:tasks.workunit.client.1.smithi181.stdout:1/810: write d10/d15/d17/d30/f99 [855085,111217] 0 2024-04-03T08:39:36.839 INFO:tasks.workunit.client.0.smithi157.stdout:9/980: truncate d1/d4a/d4d/d86/f128 359860 0 2024-04-03T08:39:36.850 INFO:tasks.workunit.client.1.smithi181.stdout:4/845: symlink d1/d16/d24/d5e/d31/d39/da1/l111 0 2024-04-03T08:39:36.850 INFO:tasks.workunit.client.1.smithi181.stdout:6/858: symlink d6/d31/d36/dba/da6/d4f/dd1/d50/d64/d10b/l10d 0 2024-04-03T08:39:36.852 INFO:tasks.workunit.client.1.smithi181.stdout:3/858: creat d0/d5/d6/dd/d25/d50/f120 x:0 0 0 2024-04-03T08:39:36.856 INFO:tasks.workunit.client.1.smithi181.stdout:5/811: write d4/ff [561937,64314] 0 2024-04-03T08:39:36.860 INFO:tasks.workunit.client.1.smithi181.stdout:9/843: mknod d1/da/d28/d30/d3e/d4e/da3/c107 0 2024-04-03T08:39:36.861 INFO:tasks.workunit.client.1.smithi181.stdout:1/811: write d10/d15/d17/d19/d33/f6a [3301387,107407] 0 2024-04-03T08:39:36.863 INFO:tasks.workunit.client.1.smithi181.stdout:5/812: truncate d4/d44/d71/fa7 4642557 0 2024-04-03T08:39:36.864 INFO:tasks.workunit.client.1.smithi181.stdout:4/846: mkdir d1/d16/d24/d61/d112 0 2024-04-03T08:39:36.866 INFO:tasks.workunit.client.1.smithi181.stdout:0/799: unlink d5/dc/d14/f77 0 2024-04-03T08:39:36.870 INFO:tasks.workunit.client.1.smithi181.stdout:2/889: rename d13/da7/d27/d2f/f8d to d13/da7/d40/f145 0 2024-04-03T08:39:36.872 INFO:tasks.workunit.client.1.smithi181.stdout:7/735: mkdir d0/d1/d6/de/d17/d64/d85/d9a/d109 0 2024-04-03T08:39:36.876 INFO:tasks.workunit.client.1.smithi181.stdout:1/812: creat d10/d15/d17/d23/daa/de1/f104 x:0 0 0 2024-04-03T08:39:36.876 INFO:tasks.workunit.client.1.smithi181.stdout:5/813: rmdir d4/d22/d4a 39 2024-04-03T08:39:36.876 INFO:tasks.workunit.client.1.smithi181.stdout:2/890: truncate d13/fdd 8520886 0 2024-04-03T08:39:36.878 INFO:tasks.workunit.client.1.smithi181.stdout:8/747: dread d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f9d [0,4194304] 0 2024-04-03T08:39:36.878 INFO:tasks.workunit.client.1.smithi181.stdout:0/800: rmdir d5/dc/d75/de1 39 2024-04-03T08:39:36.880 INFO:tasks.workunit.client.1.smithi181.stdout:6/859: symlink d6/d3e/d5e/l10e 0 2024-04-03T08:39:36.883 INFO:tasks.workunit.client.1.smithi181.stdout:4/847: rename d1/d16/d24/d5e/d31/c9f to d1/d16/d24/d5e/d31/d39/d5d/d9a/d10a/c113 0 2024-04-03T08:39:36.884 INFO:tasks.workunit.client.1.smithi181.stdout:1/813: stat d10/d15/d17/d30/l8f 0 2024-04-03T08:39:36.889 INFO:tasks.workunit.client.1.smithi181.stdout:0/801: read d5/dc/d14/f22 [197360,16239] 0 2024-04-03T08:39:36.893 INFO:tasks.workunit.client.1.smithi181.stdout:7/736: mkdir d0/d1/d6/de/d17/d64/d85/d87/d10a 0 2024-04-03T08:39:36.894 INFO:tasks.workunit.client.1.smithi181.stdout:8/748: truncate d4/d44/f8d 617299 0 2024-04-03T08:39:36.897 INFO:tasks.workunit.client.0.smithi157.stdout:2/877: unlink d3/db/d44/d4c/d5a/lcf 0 2024-04-03T08:39:36.898 INFO:tasks.workunit.client.1.smithi181.stdout:3/859: dwrite d0/d5/d6/dd/d25/f44 [0,4194304] 0 2024-04-03T08:39:36.901 INFO:tasks.workunit.client.1.smithi181.stdout:2/891: mknod d13/d1c/d4a/d68/d72/d116/c146 0 2024-04-03T08:39:36.904 INFO:tasks.workunit.client.1.smithi181.stdout:1/814: symlink d10/d15/d17/d30/l105 0 2024-04-03T08:39:36.904 INFO:tasks.workunit.client.1.smithi181.stdout:9/844: dread d1/da/d13/d41/fa9 [0,4194304] 0 2024-04-03T08:39:36.910 INFO:tasks.workunit.client.1.smithi181.stdout:0/802: readlink d5/dc/d10/d58/la5 0 2024-04-03T08:39:36.910 INFO:tasks.workunit.client.0.smithi157.stdout:9/981: mknod d1/d36/c13f 0 2024-04-03T08:39:36.913 INFO:tasks.workunit.client.0.smithi157.stdout:2/878: truncate d3/d12/d43/d4b/d55/fbc 429816 0 2024-04-03T08:39:36.920 INFO:tasks.workunit.client.0.smithi157.stdout:0/974: sync 2024-04-03T08:39:36.920 INFO:tasks.workunit.client.0.smithi157.stdout:8/904: sync 2024-04-03T08:39:36.921 INFO:tasks.workunit.client.1.smithi181.stdout:5/814: dwrite d4/f5e [0,4194304] 0 2024-04-03T08:39:36.922 INFO:tasks.workunit.client.0.smithi157.stdout:2/879: rmdir d3/db/d44/d4c/df1 39 2024-04-03T08:39:36.924 INFO:tasks.workunit.client.0.smithi157.stdout:9/982: dread d1/d36/d69/f6e [0,4194304] 0 2024-04-03T08:39:36.924 INFO:tasks.workunit.client.0.smithi157.stdout:4/848: write da/df/d2f/f38 [3392907,81465] 0 2024-04-03T08:39:36.926 INFO:tasks.workunit.client.0.smithi157.stdout:8/905: fdatasync d2/d20/db1/fdc 0 2024-04-03T08:39:36.927 INFO:tasks.workunit.client.1.smithi181.stdout:1/815: dwrite d10/d69/fd8 [0,4194304] 0 2024-04-03T08:39:36.928 INFO:tasks.workunit.client.0.smithi157.stdout:8/906: stat d2/d20/cb2 0 2024-04-03T08:39:36.929 INFO:tasks.workunit.client.0.smithi157.stdout:0/975: mkdir d2/d9/d5f/d85/d106/d159 0 2024-04-03T08:39:36.930 INFO:tasks.workunit.client.1.smithi181.stdout:1/816: chown d10/d15/d17/d37/la2 7006 1 2024-04-03T08:39:36.930 INFO:tasks.workunit.client.1.smithi181.stdout:7/737: write d0/d1/d6/de/d17/f24 [1125216,79878] 0 2024-04-03T08:39:36.932 INFO:tasks.workunit.client.0.smithi157.stdout:1/813: truncate d2/d11/d24/d39/d3b/d2e/d66/d91/d97/ffe 713153 0 2024-04-03T08:39:36.936 INFO:tasks.workunit.client.1.smithi181.stdout:9/845: creat d1/da/d28/d30/d3e/d4e/d62/f108 x:0 0 0 2024-04-03T08:39:36.938 INFO:tasks.workunit.client.0.smithi157.stdout:9/983: unlink d1/d15/d27/d34/dc7/fe1 0 2024-04-03T08:39:36.940 INFO:tasks.workunit.client.0.smithi157.stdout:1/814: truncate d2/d11/d24/d39/d3b/d2e/d66/d91/f102 696444 0 2024-04-03T08:39:36.941 INFO:tasks.workunit.client.1.smithi181.stdout:0/803: creat d5/dc/d10/d30/f101 x:0 0 0 2024-04-03T08:39:36.943 INFO:tasks.workunit.client.0.smithi157.stdout:4/849: mknod da/df/d6b/db9/c121 0 2024-04-03T08:39:36.944 INFO:tasks.workunit.client.1.smithi181.stdout:8/749: creat d4/d45/d96/ff8 x:0 0 0 2024-04-03T08:39:36.945 INFO:tasks.workunit.client.1.smithi181.stdout:8/750: dread - d4/d2a/dd2/ff6 zero size 2024-04-03T08:39:36.947 INFO:tasks.workunit.client.1.smithi181.stdout:4/848: link d1/d16/f54 d1/d16/f114 0 2024-04-03T08:39:36.948 INFO:tasks.workunit.client.1.smithi181.stdout:2/892: creat d13/da7/d40/d10f/f147 x:0 0 0 2024-04-03T08:39:36.951 INFO:tasks.workunit.client.1.smithi181.stdout:3/860: link d0/d17/d36/d3b/d5a/d85/f9f d0/d17/d56/f121 0 2024-04-03T08:39:36.951 INFO:tasks.workunit.client.1.smithi181.stdout:3/861: chown d0/d17/d36 1 1 2024-04-03T08:39:36.953 INFO:tasks.workunit.client.0.smithi157.stdout:1/815: chown d2/d11/d24/d39/f61 7003636 1 2024-04-03T08:39:36.955 INFO:tasks.workunit.client.0.smithi157.stdout:1/816: fsync d2/d11/d23/dc9/d58/f51 0 2024-04-03T08:39:36.957 INFO:tasks.workunit.client.1.smithi181.stdout:6/860: rmdir d6/d31/d36/dba/da6/d4f/dd1/d50/d5b/d10a 0 2024-04-03T08:39:36.958 INFO:tasks.workunit.client.0.smithi157.stdout:4/850: creat da/df/d6b/f122 x:0 0 0 2024-04-03T08:39:36.959 INFO:tasks.workunit.client.1.smithi181.stdout:1/817: mknod d10/d69/dd1/c106 0 2024-04-03T08:39:36.961 INFO:tasks.workunit.client.0.smithi157.stdout:8/907: rename d2/d11/f90 to d2/d20/db1/dbc/f134 0 2024-04-03T08:39:36.961 INFO:tasks.workunit.client.0.smithi157.stdout:6/916: sync 2024-04-03T08:39:36.962 INFO:tasks.workunit.client.0.smithi157.stdout:3/917: sync 2024-04-03T08:39:36.962 INFO:tasks.workunit.client.0.smithi157.stdout:7/957: sync 2024-04-03T08:39:36.962 INFO:tasks.workunit.client.0.smithi157.stdout:5/962: sync 2024-04-03T08:39:36.963 INFO:tasks.workunit.client.1.smithi181.stdout:7/738: rename d0/d1/d6/de/d17/d27/d93/c90 to d0/d1/d6/de/d17/d27/d72/c10b 0 2024-04-03T08:39:36.965 INFO:tasks.workunit.client.1.smithi181.stdout:3/862: dwrite d0/f110 [0,4194304] 0 2024-04-03T08:39:36.965 INFO:tasks.workunit.client.1.smithi181.stdout:7/739: chown d0/d1/d6/de/f44 156229885 1 2024-04-03T08:39:36.967 INFO:tasks.workunit.client.0.smithi157.stdout:9/984: mknod d1/dab/dad/d108/d130/c140 0 2024-04-03T08:39:36.968 INFO:tasks.workunit.client.1.smithi181.stdout:9/846: read d1/da/d13/d41/d32/f3f [4057823,7652] 0 2024-04-03T08:39:36.970 INFO:tasks.workunit.client.0.smithi157.stdout:9/985: write d1/d15/d16/f120 [626332,100885] 0 2024-04-03T08:39:36.972 INFO:tasks.workunit.client.1.smithi181.stdout:8/751: symlink d4/d45/db/d14/d31/d1c/d51/d87/db1/lf9 0 2024-04-03T08:39:36.974 INFO:tasks.workunit.client.1.smithi181.stdout:8/752: fdatasync d4/d45/db/f33 0 2024-04-03T08:39:36.977 INFO:tasks.workunit.client.1.smithi181.stdout:2/893: creat d13/da7/d27/f148 x:0 0 0 2024-04-03T08:39:36.979 INFO:tasks.workunit.client.0.smithi157.stdout:4/851: creat da/df/d24/d35/d6a/d76/f123 x:0 0 0 2024-04-03T08:39:36.980 INFO:tasks.workunit.client.0.smithi157.stdout:0/976: rename d2/d9/fe to d2/d9/dc/df/d6f/d9d/f15a 0 2024-04-03T08:39:36.981 INFO:tasks.workunit.client.0.smithi157.stdout:3/918: mkdir d8/d1e/d2d/d39/d142 0 2024-04-03T08:39:36.986 INFO:tasks.workunit.client.0.smithi157.stdout:2/880: link d3/l37 d3/db/d44/d4c/d5a/d88/d97/l12b 0 2024-04-03T08:39:36.986 INFO:tasks.workunit.client.1.smithi181.stdout:1/818: rmdir d10/d15/d17/d30 39 2024-04-03T08:39:36.991 INFO:tasks.workunit.client.1.smithi181.stdout:2/894: dwrite d13/f59 [4194304,4194304] 0 2024-04-03T08:39:36.999 INFO:tasks.workunit.client.0.smithi157.stdout:6/917: dread d1/d5/d17/d29/d62/d7f/d89/da4/fe1 [0,4194304] 0 2024-04-03T08:39:36.999 INFO:tasks.workunit.client.1.smithi181.stdout:0/804: creat d5/dc/d75/de1/f102 x:0 0 0 2024-04-03T08:39:37.000 INFO:tasks.workunit.client.0.smithi157.stdout:1/817: write d2/d11/d24/fb8 [508522,23341] 0 2024-04-03T08:39:37.003 INFO:tasks.workunit.client.1.smithi181.stdout:9/847: unlink d1/f5 0 2024-04-03T08:39:37.005 INFO:tasks.workunit.client.0.smithi157.stdout:1/818: readlink d2/d11/d23/dc9/da1/ded/lf2 0 2024-04-03T08:39:37.005 INFO:tasks.workunit.client.0.smithi157.stdout:0/977: dread d2/d9/dc/df/d1b/d4a/de4/f128 [0,4194304] 0 2024-04-03T08:39:37.005 INFO:tasks.workunit.client.0.smithi157.stdout:4/852: mknod da/df/d2f/dd8/c124 0 2024-04-03T08:39:37.006 INFO:tasks.workunit.client.0.smithi157.stdout:1/819: chown d2 43998882 1 2024-04-03T08:39:37.007 INFO:tasks.workunit.client.1.smithi181.stdout:4/849: mknod d1/d16/d24/d5e/c115 0 2024-04-03T08:39:37.010 INFO:tasks.workunit.client.1.smithi181.stdout:8/753: creat d4/d45/db/d14/d31/d1c/d51/d87/db1/ffa x:0 0 0 2024-04-03T08:39:37.012 INFO:tasks.workunit.client.0.smithi157.stdout:7/958: symlink d0/d11/d15/d17/d1c/d4f/dcd/d140/l14e 0 2024-04-03T08:39:37.017 INFO:tasks.workunit.client.1.smithi181.stdout:6/861: rename d6/d31/d36 to d6/d3e/db1/dc4/d10f 0 2024-04-03T08:39:37.019 INFO:tasks.workunit.client.0.smithi157.stdout:9/986: dwrite d1/d15/d27/f8a [0,4194304] 0 2024-04-03T08:39:37.020 INFO:tasks.workunit.client.1.smithi181.stdout:6/862: truncate d6/dc0/fdc 745063 0 2024-04-03T08:39:37.022 INFO:tasks.workunit.client.1.smithi181.stdout:1/819: mkdir d10/d69/dd1/d107 0 2024-04-03T08:39:37.023 INFO:tasks.workunit.client.1.smithi181.stdout:7/740: symlink d0/l10c 0 2024-04-03T08:39:37.024 INFO:tasks.workunit.client.0.smithi157.stdout:8/908: write d2/d20/f65 [2187625,27] 0 2024-04-03T08:39:37.024 INFO:tasks.workunit.client.1.smithi181.stdout:4/850: dwrite d1/d16/d24/d5e/d3f/d81/ff4 [0,4194304] 0 2024-04-03T08:39:37.028 INFO:tasks.workunit.client.1.smithi181.stdout:1/820: write d10/d69/dd1/fd7 [683628,43143] 0 2024-04-03T08:39:37.034 INFO:tasks.workunit.client.1.smithi181.stdout:5/815: getdents d4/d18/d55/db4/d8a 0 2024-04-03T08:39:37.041 INFO:tasks.workunit.client.0.smithi157.stdout:9/987: truncate d1/fa5 186226 0 2024-04-03T08:39:37.041 INFO:tasks.workunit.client.1.smithi181.stdout:6/863: dread d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/f61 [0,4194304] 0 2024-04-03T08:39:37.042 INFO:tasks.workunit.client.0.smithi157.stdout:6/918: dwrite d1/d5/d1b/faa [0,4194304] 0 2024-04-03T08:39:37.042 INFO:tasks.workunit.client.1.smithi181.stdout:8/754: dread d4/d45/d96/fa9 [0,4194304] 0 2024-04-03T08:39:37.044 INFO:tasks.workunit.client.0.smithi157.stdout:4/853: mknod da/df/d24/d35/d6a/d78/df5/c125 0 2024-04-03T08:39:37.047 INFO:tasks.workunit.client.0.smithi157.stdout:5/963: rename dc/d29/d56/d52/d9d/da5/dfd/f108 to dc/d29/f141 0 2024-04-03T08:39:37.048 INFO:tasks.workunit.client.0.smithi157.stdout:9/988: truncate d1/d15/d27/daf/da7/f13c 231174 0 2024-04-03T08:39:37.049 INFO:tasks.workunit.client.1.smithi181.stdout:0/805: creat d5/dc/d10/d58/db0/db8/f103 x:0 0 0 2024-04-03T08:39:37.049 INFO:tasks.workunit.client.1.smithi181.stdout:4/851: dwrite d1/d16/d24/d5e/d3f/d41/f106 [0,4194304] 0 2024-04-03T08:39:37.051 INFO:tasks.workunit.client.0.smithi157.stdout:8/909: symlink d2/d11/d10/d24/d5b/d2e/d94/l135 0 2024-04-03T08:39:37.052 INFO:tasks.workunit.client.1.smithi181.stdout:4/852: write d1/d1e/d2c/d67/d93/fef [133152,26963] 0 2024-04-03T08:39:37.053 INFO:tasks.workunit.client.1.smithi181.stdout:9/848: symlink d1/da/d1a/d92/dda/df2/l109 0 2024-04-03T08:39:37.056 INFO:tasks.workunit.client.0.smithi157.stdout:3/919: creat d8/d13/d1b/f143 x:0 0 0 2024-04-03T08:39:37.057 INFO:tasks.workunit.client.0.smithi157.stdout:6/919: dread d1/d5/d17/d29/d62/d7f/d89/da4/fe1 [0,4194304] 0 2024-04-03T08:39:37.059 INFO:tasks.workunit.client.1.smithi181.stdout:2/895: creat d13/d1c/d4a/f149 x:0 0 0 2024-04-03T08:39:37.061 INFO:tasks.workunit.client.0.smithi157.stdout:1/820: creat d2/d11/d23/dc9/d58/f112 x:0 0 0 2024-04-03T08:39:37.062 INFO:tasks.workunit.client.0.smithi157.stdout:9/989: mknod d1/d15/d16/c141 0 2024-04-03T08:39:37.063 INFO:tasks.workunit.client.1.smithi181.stdout:3/863: getdents d0/d57 0 2024-04-03T08:39:37.065 INFO:tasks.workunit.client.0.smithi157.stdout:7/959: dwrite d0/d11/d15/d1b/db8/f95 [0,4194304] 0 2024-04-03T08:39:37.066 INFO:tasks.workunit.client.1.smithi181.stdout:0/806: mknod d5/dc/c104 0 2024-04-03T08:39:37.070 INFO:tasks.workunit.client.1.smithi181.stdout:0/807: chown d5/dc/d14/f3c 127747038 1 2024-04-03T08:39:37.070 INFO:tasks.workunit.client.1.smithi181.stdout:1/821: symlink d10/d15/d17/d19/d33/l108 0 2024-04-03T08:39:37.075 INFO:tasks.workunit.client.1.smithi181.stdout:5/816: rename d4/d44/d71/dcf/c100 to d4/d18/d25/d59/db3/c106 0 2024-04-03T08:39:37.076 INFO:tasks.workunit.client.1.smithi181.stdout:2/896: creat d13/da7/d85/de4/f14a x:0 0 0 2024-04-03T08:39:37.078 INFO:tasks.workunit.client.0.smithi157.stdout:6/920: creat d1/d5/d17/d29/da7/d129/f13d x:0 0 0 2024-04-03T08:39:37.080 INFO:tasks.workunit.client.1.smithi181.stdout:2/897: write d13/d1c/d4a/d7f/db3/f53 [3707623,95263] 0 2024-04-03T08:39:37.083 INFO:tasks.workunit.client.1.smithi181.stdout:2/898: readlink d13/da7/d27/l4c 0 2024-04-03T08:39:37.085 INFO:tasks.workunit.client.0.smithi157.stdout:5/964: dread dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/f6f [0,4194304] 0 2024-04-03T08:39:37.085 INFO:tasks.workunit.client.0.smithi157.stdout:9/990: creat d1/d4a/d4d/d86/dd5/f142 x:0 0 0 2024-04-03T08:39:37.090 INFO:tasks.workunit.client.0.smithi157.stdout:7/960: symlink d0/d11/d15/d17/d52/l14f 0 2024-04-03T08:39:37.091 INFO:tasks.workunit.client.1.smithi181.stdout:0/808: dwrite d5/dc/d8e/dea/fff [0,4194304] 0 2024-04-03T08:39:37.094 INFO:tasks.workunit.client.1.smithi181.stdout:9/849: mknod d1/da/d13/d41/c10a 0 2024-04-03T08:39:37.094 INFO:tasks.workunit.client.1.smithi181.stdout:7/741: dread d0/d1/d6/de/d6d/fad [0,4194304] 0 2024-04-03T08:39:37.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:36 smithi181 ceph-mon[44183]: pgmap v15: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 80 MiB/s rd, 163 MiB/s wr, 391 op/s 2024-04-03T08:39:37.098 INFO:tasks.workunit.client.0.smithi157.stdout:2/881: rename d3/d12/d43/d4b to d3/db/d44/d12c 0 2024-04-03T08:39:37.099 INFO:tasks.workunit.client.1.smithi181.stdout:1/822: creat d10/d15/d17/d23/daa/de1/f109 x:0 0 0 2024-04-03T08:39:37.100 INFO:tasks.workunit.client.0.smithi157.stdout:4/854: dread da/df/d2f/d97/f9a [0,4194304] 0 2024-04-03T08:39:37.102 INFO:tasks.workunit.client.1.smithi181.stdout:8/755: rename d4/d2a/d37/d67 to d4/d2a/d37/dfb 0 2024-04-03T08:39:37.104 INFO:tasks.workunit.client.1.smithi181.stdout:2/899: dwrite d13/d1c/f3b [4194304,4194304] 0 2024-04-03T08:39:37.106 INFO:tasks.workunit.client.0.smithi157.stdout:8/910: dread d2/d11/d10/fe3 [4194304,4194304] 0 2024-04-03T08:39:37.107 INFO:tasks.workunit.client.0.smithi157.stdout:1/821: dwrite d2/d11/d24/d39/d3b/d1b/d7f/fa7 [0,4194304] 0 2024-04-03T08:39:37.119 INFO:tasks.workunit.client.1.smithi181.stdout:3/864: dread - d0/d17/d36/d8c/fe7 zero size 2024-04-03T08:39:37.121 INFO:tasks.workunit.client.0.smithi157.stdout:5/965: write dc/d29/d56/d18/d21/fea [1481051,64248] 0 2024-04-03T08:39:37.122 INFO:tasks.workunit.client.1.smithi181.stdout:1/823: dwrite d10/d15/d4a/d6f/ffd [4194304,4194304] 0 2024-04-03T08:39:37.122 INFO:tasks.workunit.client.0.smithi157.stdout:1/822: fdatasync d2/d11/d24/d39/d3b/d1b/d90/ff9 0 2024-04-03T08:39:37.123 INFO:tasks.workunit.client.0.smithi157.stdout:9/991: mknod d1/d15/d27/d34/dc7/c143 0 2024-04-03T08:39:37.124 INFO:tasks.workunit.client.0.smithi157.stdout:5/966: readlink dc/d29/d56/d9e/dc3/de2/l119 0 2024-04-03T08:39:37.130 INFO:tasks.workunit.client.1.smithi181.stdout:7/742: mknod d0/d1/d94/c10d 0 2024-04-03T08:39:37.131 INFO:tasks.workunit.client.0.smithi157.stdout:7/961: creat d0/d11/d15/d17/d1c/d4f/d5f/d61/f150 x:0 0 0 2024-04-03T08:39:37.133 INFO:tasks.workunit.client.1.smithi181.stdout:4/853: dwrite d1/d1e/d82/d84/fe6 [0,4194304] 0 2024-04-03T08:39:37.134 INFO:tasks.workunit.client.0.smithi157.stdout:0/978: rename d2/d9/dc/df/d6f/d9d/d6a/d91/dae/dd2/feb to d2/d9/dc/df/d6f/d9d/d6a/d91/d10b/f15b 0 2024-04-03T08:39:37.137 INFO:tasks.workunit.client.0.smithi157.stdout:8/911: truncate d2/d20/d77/f7f 948382 0 2024-04-03T08:39:37.138 INFO:tasks.workunit.client.1.smithi181.stdout:2/900: truncate d13/da7/fc4 194284 0 2024-04-03T08:39:37.139 INFO:tasks.workunit.client.0.smithi157.stdout:4/855: chown da/df/d24/d35/d6a/ld5 10825 1 2024-04-03T08:39:37.142 INFO:tasks.workunit.client.1.smithi181.stdout:5/817: rename d4/d22/f38 to d4/d18/d25/d68/f107 0 2024-04-03T08:39:37.142 INFO:tasks.workunit.client.1.smithi181.stdout:4/854: rename d1 to d1/d16/d24/d5e/d31/d39/d5d/d9a/d10a/d116 22 2024-04-03T08:39:37.148 INFO:tasks.workunit.client.0.smithi157.stdout:5/967: creat dc/d29/d56/d9e/db5/dc9/d124/d53/d6c/f142 x:0 0 0 2024-04-03T08:39:37.154 INFO:tasks.workunit.client.1.smithi181.stdout:3/865: creat d0/d5/d6/d32/d43/f122 x:0 0 0 2024-04-03T08:39:37.155 INFO:tasks.workunit.client.1.smithi181.stdout:9/850: dread d1/da/d13/d22/d23/d36/d9c/fbd [0,4194304] 0 2024-04-03T08:39:37.156 INFO:tasks.workunit.client.1.smithi181.stdout:3/866: chown d0/d17/d63/d81 8356 1 2024-04-03T08:39:37.156 INFO:tasks.workunit.client.0.smithi157.stdout:9/992: rename d1/d4a/d4d/d86/dd5/f142 to d1/d15/d16/d9f/d13d/f144 0 2024-04-03T08:39:37.158 INFO:tasks.workunit.client.1.smithi181.stdout:0/809: mknod d5/d9/c105 0 2024-04-03T08:39:37.158 INFO:tasks.workunit.client.1.smithi181.stdout:1/824: write d10/d15/d17/d30/f38 [3705278,52753] 0 2024-04-03T08:39:37.160 INFO:tasks.workunit.client.0.smithi157.stdout:1/823: mkdir d2/d11/d23/de1/d113 0 2024-04-03T08:39:37.161 INFO:tasks.workunit.client.0.smithi157.stdout:4/856: mkdir da/df/d11/df9/d126 0 2024-04-03T08:39:37.163 INFO:tasks.workunit.client.0.smithi157.stdout:7/962: symlink d0/d11/d6f/d89/d8c/d103/d8e/d96/df4/l151 0 2024-04-03T08:39:37.166 INFO:tasks.workunit.client.0.smithi157.stdout:1/824: chown d2/d11/d24/d39/d3b/d1b/d90/lcf 0 1 2024-04-03T08:39:37.168 INFO:tasks.workunit.client.0.smithi157.stdout:7/963: chown d0/d11/d15/d1b/l22 255112502 1 2024-04-03T08:39:37.169 INFO:tasks.workunit.client.0.smithi157.stdout:3/920: dread d8/d1e/d2d/d3b/d9e/df9/f97 [0,4194304] 0 2024-04-03T08:39:37.171 INFO:tasks.workunit.client.0.smithi157.stdout:8/912: rename d2/d20/cb2 to d2/d20/db1/dbc/c136 0 2024-04-03T08:39:37.172 INFO:tasks.workunit.client.1.smithi181.stdout:5/818: creat d4/d18/d25/f108 x:0 0 0 2024-04-03T08:39:37.172 INFO:tasks.workunit.client.1.smithi181.stdout:1/825: dwrite d10/d15/d17/d30/f99 [0,4194304] 0 2024-04-03T08:39:37.177 INFO:tasks.workunit.client.0.smithi157.stdout:9/993: mkdir d1/d4a/d4d/da4/dcc/d145 0 2024-04-03T08:39:37.180 INFO:tasks.workunit.client.0.smithi157.stdout:4/857: mknod da/df/d99/da8/c127 0 2024-04-03T08:39:37.184 INFO:tasks.workunit.client.0.smithi157.stdout:5/968: dwrite dc/d29/d51/fcc [0,4194304] 0 2024-04-03T08:39:37.185 INFO:tasks.workunit.client.1.smithi181.stdout:3/867: chown d0/d17/d36/l27 986527 1 2024-04-03T08:39:37.190 INFO:tasks.workunit.client.0.smithi157.stdout:6/921: dread d1/f6d [0,4194304] 0 2024-04-03T08:39:37.192 INFO:tasks.workunit.client.1.smithi181.stdout:4/855: dwrite d1/d1e/d2c/f59 [4194304,4194304] 0 2024-04-03T08:39:37.196 INFO:tasks.workunit.client.1.smithi181.stdout:0/810: read - d5/d9/d2a/da1/da8/fcd zero size 2024-04-03T08:39:37.198 INFO:tasks.workunit.client.0.smithi157.stdout:7/964: unlink d0/d11/d15/d17/d1c/d4f/dcd/c111 0 2024-04-03T08:39:37.205 INFO:tasks.workunit.client.0.smithi157.stdout:0/979: rename d2/d9/dc/df/d6f/d9d/d6a/d91 to d2/d9/d5f/d15c 0 2024-04-03T08:39:37.207 INFO:tasks.workunit.client.1.smithi181.stdout:7/743: truncate d0/d1/d6/de/f52 1121275 0 2024-04-03T08:39:37.214 INFO:tasks.workunit.client.0.smithi157.stdout:7/965: creat d0/d11/d15/d17/d1c/f152 x:0 0 0 2024-04-03T08:39:37.219 INFO:tasks.workunit.client.0.smithi157.stdout:9/994: rename d1/d15/d27/d5c/dbd/ce5 to d1/d15/d27/d5c/dbd/dfd/c146 0 2024-04-03T08:39:37.222 INFO:tasks.workunit.client.0.smithi157.stdout:0/980: rmdir d2/d9/dc/d54/df0 39 2024-04-03T08:39:37.225 INFO:tasks.workunit.client.0.smithi157.stdout:6/922: dwrite d1/d5/d17/d2a/d73/d12d/f122 [0,4194304] 0 2024-04-03T08:39:37.228 INFO:tasks.workunit.client.1.smithi181.stdout:9/851: mkdir d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/db2/d10b 0 2024-04-03T08:39:37.229 INFO:tasks.workunit.client.1.smithi181.stdout:9/852: chown d1/da/d28/f9a 7161 1 2024-04-03T08:39:37.231 INFO:tasks.workunit.client.1.smithi181.stdout:8/756: truncate d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f9d 2470980 0 2024-04-03T08:39:37.232 INFO:tasks.workunit.client.0.smithi157.stdout:0/981: stat d2/d9/dc/df/d1b/d35/d3d/ca0 0 2024-04-03T08:39:37.233 INFO:tasks.workunit.client.1.smithi181.stdout:8/757: write d4/d45/db/f8c [2418708,34051] 0 2024-04-03T08:39:37.234 INFO:tasks.workunit.client.0.smithi157.stdout:2/882: dwrite d3/d12/fa [0,4194304] 0 2024-04-03T08:39:37.236 INFO:tasks.workunit.client.1.smithi181.stdout:4/856: creat d1/d16/d24/d5e/d31/d39/d5d/d9a/f117 x:0 0 0 2024-04-03T08:39:37.238 INFO:tasks.workunit.client.1.smithi181.stdout:4/857: write d1/d1e/d2c/d67/d93/fef [672193,35688] 0 2024-04-03T08:39:37.239 INFO:tasks.workunit.client.0.smithi157.stdout:3/921: dread d8/d1e/d2d/d30/df0/f103 [0,4194304] 0 2024-04-03T08:39:37.250 INFO:tasks.workunit.client.1.smithi181.stdout:2/901: rename d13/d1c/d4a/d68/c123 to d13/d1c/d4a/d7f/db3/c14b 0 2024-04-03T08:39:37.252 INFO:tasks.workunit.client.0.smithi157.stdout:7/966: fsync d0/d11/d15/d17/d52/f130 0 2024-04-03T08:39:37.258 INFO:tasks.workunit.client.0.smithi157.stdout:5/969: write dc/d29/d56/d9e/db5/dc9/d124/f7a [387922,95591] 0 2024-04-03T08:39:37.265 INFO:tasks.workunit.client.0.smithi157.stdout:4/858: rename da/f11b to da/df/d24/d35/d6a/d78/f128 0 2024-04-03T08:39:37.267 INFO:tasks.workunit.client.1.smithi181.stdout:3/868: dwrite d0/d17/d63/d81/fa1 [0,4194304] 0 2024-04-03T08:39:37.268 INFO:tasks.workunit.client.1.smithi181.stdout:1/826: dwrite d10/d15/d4b/d6c/f9f [0,4194304] 0 2024-04-03T08:39:37.272 INFO:tasks.workunit.client.0.smithi157.stdout:6/923: unlink d1/d5/d17/d29/da7/db9/df0/d105/f10e 0 2024-04-03T08:39:37.274 INFO:tasks.workunit.client.1.smithi181.stdout:9/853: mkdir d1/da/d28/d30/d3e/d4e/d62/d10c 0 2024-04-03T08:39:37.275 INFO:tasks.workunit.client.1.smithi181.stdout:3/869: write d0/d5/d6/f1d [4255807,63258] 0 2024-04-03T08:39:37.277 INFO:tasks.workunit.client.1.smithi181.stdout:6/864: sync 2024-04-03T08:39:37.278 INFO:tasks.workunit.client.1.smithi181.stdout:9/854: chown d1/dcb 110 1 2024-04-03T08:39:37.279 INFO:tasks.workunit.client.0.smithi157.stdout:9/995: dwrite d1/d15/d27/daf/da7/d123/d75/fdf [0,4194304] 0 2024-04-03T08:39:37.279 INFO:tasks.workunit.client.1.smithi181.stdout:7/744: dwrite d0/d1/d6/de/d17/d64/d85/d87/fd3 [0,4194304] 0 2024-04-03T08:39:37.284 INFO:tasks.workunit.client.1.smithi181.stdout:4/858: dread d1/d1e/d2c/f77 [0,4194304] 0 2024-04-03T08:39:37.285 INFO:tasks.workunit.client.1.smithi181.stdout:9/855: chown d1/da/d13/d22/d23/fba 0 1 2024-04-03T08:39:37.285 INFO:tasks.workunit.client.1.smithi181.stdout:0/811: rename d5/dc/d14/de5/ffb to d5/dc/d10/d58/db0/f106 0 2024-04-03T08:39:37.286 INFO:tasks.workunit.client.0.smithi157.stdout:2/883: fdatasync d3/db/d44/d4c/df1/fdb 0 2024-04-03T08:39:37.288 INFO:tasks.workunit.client.0.smithi157.stdout:7/967: truncate d0/d11/d15/d17/f19 245597 0 2024-04-03T08:39:37.288 INFO:tasks.workunit.client.0.smithi157.stdout:5/970: symlink dc/d29/d56/l143 0 2024-04-03T08:39:37.288 INFO:tasks.workunit.client.0.smithi157.stdout:9/996: dread - d1/d15/d27/d5c/dbd/f13a zero size 2024-04-03T08:39:37.289 INFO:tasks.workunit.client.1.smithi181.stdout:4/859: chown d1/d16/d24/d61 24 1 2024-04-03T08:39:37.290 INFO:tasks.workunit.client.0.smithi157.stdout:7/968: stat d0/d11/l9b 0 2024-04-03T08:39:37.290 INFO:tasks.workunit.client.1.smithi181.stdout:0/812: dread - d5/dc/d10/fd2 zero size 2024-04-03T08:39:37.292 INFO:tasks.workunit.client.0.smithi157.stdout:4/859: read - da/df/d2f/d54/fe7 zero size 2024-04-03T08:39:37.299 INFO:tasks.workunit.client.0.smithi157.stdout:4/860: chown da/df/d2f/d54/fe7 0 1 2024-04-03T08:39:37.304 INFO:tasks.workunit.client.1.smithi181.stdout:1/827: dread - d10/d15/d4b/d6c/fa6 zero size 2024-04-03T08:39:37.307 INFO:tasks.workunit.client.0.smithi157.stdout:0/982: dwrite d2/f50 [0,4194304] 0 2024-04-03T08:39:37.307 INFO:tasks.workunit.client.0.smithi157.stdout:4/861: chown da/df/d99/da8/c127 8387 1 2024-04-03T08:39:37.314 INFO:tasks.workunit.client.0.smithi157.stdout:6/924: mkdir d1/d5/d17/d2a/d37/dca/d132/d13e 0 2024-04-03T08:39:37.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:36 smithi157 ceph-mon[35083]: pgmap v15: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 80 MiB/s rd, 163 MiB/s wr, 391 op/s 2024-04-03T08:39:37.317 INFO:tasks.workunit.client.0.smithi157.stdout:6/925: stat d1/d5/d17/d29/d12f/dec 0 2024-04-03T08:39:37.321 INFO:tasks.workunit.client.0.smithi157.stdout:9/997: mkdir d1/d15/d27/daf/da7/d123/dbe/dbf/d138/d147 0 2024-04-03T08:39:37.322 INFO:tasks.workunit.client.0.smithi157.stdout:7/969: read d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/fe0 [879051,84908] 0 2024-04-03T08:39:37.323 INFO:tasks.workunit.client.0.smithi157.stdout:0/983: fsync d2/d9/d51/f52 0 2024-04-03T08:39:37.326 INFO:tasks.workunit.client.1.smithi181.stdout:9/856: mkdir d1/da/d28/d80/d10d 0 2024-04-03T08:39:37.328 INFO:tasks.workunit.client.0.smithi157.stdout:3/922: dwrite d8/d1e/d2d/d39/d51/d4c/f78 [4194304,4194304] 0 2024-04-03T08:39:37.329 INFO:tasks.workunit.client.1.smithi181.stdout:9/857: write d1/da/d28/d30/d3e/d4e/d62/f108 [132354,40234] 0 2024-04-03T08:39:37.331 INFO:tasks.workunit.client.1.smithi181.stdout:8/758: rename d4/d2a/d37/lc2 to d4/d45/dae/lfc 0 2024-04-03T08:39:37.333 INFO:tasks.workunit.client.1.smithi181.stdout:5/819: link d4/d18/f65 d4/d18/d55/db4/d8a/f109 0 2024-04-03T08:39:37.340 INFO:tasks.workunit.client.0.smithi157.stdout:6/926: fdatasync d1/d5/d17/d2a/d73/d12d/fe4 0 2024-04-03T08:39:37.345 INFO:tasks.workunit.client.1.smithi181.stdout:1/828: dread d10/d15/d17/d23/d27/f87 [4194304,4194304] 0 2024-04-03T08:39:37.357 INFO:tasks.workunit.client.0.smithi157.stdout:9/998: dwrite d1/d15/d27/daf/da7/d123/f96 [0,4194304] 0 2024-04-03T08:39:37.358 INFO:tasks.workunit.client.0.smithi157.stdout:0/984: dread d2/d9/dc/d54/f8c [0,4194304] 0 2024-04-03T08:39:37.364 INFO:tasks.workunit.client.0.smithi157.stdout:3/923: creat d8/d1e/d2d/d39/d51/d48/dce/f144 x:0 0 0 2024-04-03T08:39:37.366 INFO:tasks.workunit.client.1.smithi181.stdout:0/813: mkdir d5/d9/d2a/da1/df7/d107 0 2024-04-03T08:39:37.370 INFO:tasks.workunit.client.1.smithi181.stdout:9/858: fsync d1/da/d28/d30/d3e/d4e/f68 0 2024-04-03T08:39:37.373 INFO:tasks.workunit.client.0.smithi157.stdout:6/927: creat d1/d5/d17/d29/da7/db9/df0/da8/f13f x:0 0 0 2024-04-03T08:39:37.374 INFO:tasks.workunit.client.0.smithi157.stdout:2/884: write d3/d12/d43/fb1 [427823,120796] 0 2024-04-03T08:39:37.379 INFO:tasks.workunit.client.0.smithi157.stdout:5/971: write dc/d29/d56/d9e/dc3/fdf [702190,74779] 0 2024-04-03T08:39:37.383 INFO:tasks.workunit.client.0.smithi157.stdout:2/885: fdatasync d3/d2e/d32/d9f/da7/d121/f113 0 2024-04-03T08:39:37.385 INFO:tasks.workunit.client.1.smithi181.stdout:2/902: getdents d13/da7/d85 0 2024-04-03T08:39:37.389 INFO:tasks.workunit.client.0.smithi157.stdout:3/924: mknod d8/d1e/d2d/d39/d51/d48/dab/dee/c145 0 2024-04-03T08:39:37.390 INFO:tasks.workunit.client.1.smithi181.stdout:3/870: dwrite d0/d5/d6f/f75 [4194304,4194304] 0 2024-04-03T08:39:37.393 INFO:tasks.workunit.client.1.smithi181.stdout:4/860: rename d1/d16/d24/d5e/d2b/l4d to d1/d16/d24/d5e/d31/l118 0 2024-04-03T08:39:37.397 INFO:tasks.workunit.client.1.smithi181.stdout:0/814: readlink d5/dc/d14/d29/l7d 0 2024-04-03T08:39:37.407 INFO:tasks.workunit.client.1.smithi181.stdout:5/820: write d4/d22/d78/faa [1237862,67763] 0 2024-04-03T08:39:37.408 INFO:tasks.workunit.client.0.smithi157.stdout:4/862: dwrite da/df/d2f/dbc/fec [0,4194304] 0 2024-04-03T08:39:37.409 INFO:tasks.workunit.client.1.smithi181.stdout:3/871: dwrite d0/d5/d6/dd/f21 [0,4194304] 0 2024-04-03T08:39:37.409 INFO:tasks.workunit.client.1.smithi181.stdout:7/745: link d0/d1/d6/de/d17/d64/d85/d87/l92 d0/db4/l10e 0 2024-04-03T08:39:37.410 INFO:tasks.workunit.client.1.smithi181.stdout:5/821: dread - d4/d18/d55/d5a/fd3 zero size 2024-04-03T08:39:37.412 INFO:tasks.workunit.client.0.smithi157.stdout:4/863: readlink da/d7e/lfc 0 2024-04-03T08:39:37.415 INFO:tasks.workunit.client.0.smithi157.stdout:3/925: mknod d8/d13/d1b/dc4/dec/c146 0 2024-04-03T08:39:37.415 INFO:tasks.workunit.client.1.smithi181.stdout:5/822: chown d4/d18/d55 88095904 1 2024-04-03T08:39:37.418 INFO:tasks.workunit.client.0.smithi157.stdout:6/928: write d1/d4b/fce [762700,22999] 0 2024-04-03T08:39:37.421 INFO:tasks.workunit.client.1.smithi181.stdout:3/872: write d0/d5/d6/dd/f21 [3287381,23615] 0 2024-04-03T08:39:37.424 INFO:tasks.workunit.client.0.smithi157.stdout:9/999: truncate d1/d15/fc9 616204 0 2024-04-03T08:39:37.424 INFO:tasks.workunit.client.0.smithi157.stdout:6/929: write d1/d5/d17/d2a/d37/dca/f117 [175883,105855] 0 2024-04-03T08:39:37.425 INFO:tasks.workunit.client.1.smithi181.stdout:0/815: dwrite d5/dc/d14/de5/deb/ffc [0,4194304] 0 2024-04-03T08:39:37.426 INFO:tasks.workunit.client.1.smithi181.stdout:9/859: write d1/da/d28/d30/d3e/fa5 [4675809,30428] 0 2024-04-03T08:39:37.429 INFO:tasks.workunit.client.0.smithi157.stdout:5/972: write dc/f59 [1445606,78843] 0 2024-04-03T08:39:37.431 INFO:tasks.workunit.client.1.smithi181.stdout:4/861: symlink d1/d16/d24/d5e/d3f/d81/l119 0 2024-04-03T08:39:37.431 INFO:tasks.workunit.client.1.smithi181.stdout:1/829: dwrite d10/d15/d17/d23/db0/fcc [4194304,4194304] 0 2024-04-03T08:39:37.436 INFO:tasks.workunit.client.0.smithi157.stdout:7/970: getdents d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f 0 2024-04-03T08:39:37.438 INFO:tasks.workunit.client.0.smithi157.stdout:2/886: rename d3/d2e/c2f to d3/d2e/d32/de3/c12d 0 2024-04-03T08:39:37.442 INFO:tasks.workunit.client.0.smithi157.stdout:4/864: dwrite da/df/d24/f11d [0,4194304] 0 2024-04-03T08:39:37.443 INFO:tasks.workunit.client.1.smithi181.stdout:2/903: unlink d13/d1c/d4a/d7f/cf6 0 2024-04-03T08:39:37.450 INFO:tasks.workunit.client.0.smithi157.stdout:5/973: dread - dc/d29/f141 zero size 2024-04-03T08:39:37.459 INFO:tasks.workunit.client.0.smithi157.stdout:6/930: mkdir d1/d5/d17/d2a/d140 0 2024-04-03T08:39:37.466 INFO:tasks.workunit.client.1.smithi181.stdout:7/746: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/l10f 0 2024-04-03T08:39:37.467 INFO:tasks.workunit.client.0.smithi157.stdout:7/971: rename d0/d11/d15/d17/f7d to d0/d11/d15/d17/d1c/d128/d13d/f153 0 2024-04-03T08:39:37.469 INFO:tasks.workunit.client.0.smithi157.stdout:6/931: dread - d1/d5/d17/d2a/f121 zero size 2024-04-03T08:39:37.470 INFO:tasks.workunit.client.1.smithi181.stdout:5/823: symlink d4/d18/l10a 0 2024-04-03T08:39:37.470 INFO:tasks.workunit.client.1.smithi181.stdout:2/904: chown d13/d1c/d4a/d68/f94 227110294 1 2024-04-03T08:39:37.476 INFO:tasks.workunit.client.1.smithi181.stdout:3/873: dread d0/d17/d36/fb8 [0,4194304] 0 2024-04-03T08:39:37.478 INFO:tasks.workunit.client.1.smithi181.stdout:2/905: chown d13/d1c/c11f 27434377 1 2024-04-03T08:39:37.479 INFO:tasks.workunit.client.1.smithi181.stdout:2/906: chown d13/da7/ld7 154496127 1 2024-04-03T08:39:37.481 INFO:tasks.workunit.client.1.smithi181.stdout:2/907: write d13/d1c/d6c/fa2 [4654402,80021] 0 2024-04-03T08:39:37.482 INFO:tasks.workunit.client.0.smithi157.stdout:6/932: dread d1/d5/d17/d2a/d37/f3b [0,4194304] 0 2024-04-03T08:39:37.484 INFO:tasks.workunit.client.0.smithi157.stdout:4/865: creat da/df/d24/d35/f129 x:0 0 0 2024-04-03T08:39:37.486 INFO:tasks.workunit.client.1.smithi181.stdout:5/824: unlink d4/d18/d3e/fa6 0 2024-04-03T08:39:37.487 INFO:tasks.workunit.client.0.smithi157.stdout:3/926: dread d8/f57 [0,4194304] 0 2024-04-03T08:39:37.491 INFO:tasks.workunit.client.1.smithi181.stdout:1/830: creat d10/d15/d17/d19/d33/f10a x:0 0 0 2024-04-03T08:39:37.496 INFO:tasks.workunit.client.0.smithi157.stdout:4/866: dread da/df/d24/f75 [4194304,4194304] 0 2024-04-03T08:39:37.497 INFO:tasks.workunit.client.1.smithi181.stdout:7/747: rename d0/d1/d6/de/d6d to d0/d1/d6/de/d17/d64/d85/d87/d10a/d110 0 2024-04-03T08:39:37.498 INFO:tasks.workunit.client.0.smithi157.stdout:2/887: dread d3/d12/f11 [0,4194304] 0 2024-04-03T08:39:37.500 INFO:tasks.workunit.client.0.smithi157.stdout:6/933: mknod d1/d4b/da5/d139/c141 0 2024-04-03T08:39:37.502 INFO:tasks.workunit.client.1.smithi181.stdout:9/860: write d1/da/d13/d22/d23/d36/d91/d9d/d39/f8f [425834,82119] 0 2024-04-03T08:39:37.503 INFO:tasks.workunit.client.1.smithi181.stdout:2/908: symlink d13/d1c/d4a/d7f/db3/de3/l14c 0 2024-04-03T08:39:37.505 INFO:tasks.workunit.client.0.smithi157.stdout:4/867: fdatasync da/df/d24/f75 0 2024-04-03T08:39:37.506 INFO:tasks.workunit.client.1.smithi181.stdout:5/825: mknod d4/d22/d53/d98/c10b 0 2024-04-03T08:39:37.507 INFO:tasks.workunit.client.0.smithi157.stdout:2/888: fsync d3/d2e/f80 0 2024-04-03T08:39:37.508 INFO:tasks.workunit.client.1.smithi181.stdout:0/816: link d5/f74 d5/dc/d14/f108 0 2024-04-03T08:39:37.509 INFO:tasks.workunit.client.0.smithi157.stdout:3/927: mkdir d8/d1e/d2d/d39/d51/d48/dac/d147 0 2024-04-03T08:39:37.511 INFO:tasks.workunit.client.0.smithi157.stdout:3/928: chown d8/d1e/d2d/d3b/d8c/f9c 250204 1 2024-04-03T08:39:37.513 INFO:tasks.workunit.client.0.smithi157.stdout:1/825: sync 2024-04-03T08:39:37.513 INFO:tasks.workunit.client.1.smithi181.stdout:4/862: truncate d1/d16/d24/d5e/d2b/db9/fe7 3052000 0 2024-04-03T08:39:37.514 INFO:tasks.workunit.client.1.smithi181.stdout:7/748: dwrite d0/d1/d6/de/d17/fee [0,4194304] 0 2024-04-03T08:39:37.517 INFO:tasks.workunit.client.1.smithi181.stdout:4/863: write d1/d1e/d2c/d67/d93/fef [220830,115701] 0 2024-04-03T08:39:37.517 INFO:tasks.workunit.client.0.smithi157.stdout:5/974: dwrite dc/d29/d56/d9e/dc3/fcd [0,4194304] 0 2024-04-03T08:39:37.518 INFO:tasks.workunit.client.1.smithi181.stdout:3/874: dwrite d0/d17/d36/d8c/f10c [0,4194304] 0 2024-04-03T08:39:37.521 INFO:tasks.workunit.client.1.smithi181.stdout:7/749: dread - d0/d1/d6/de/d17/d64/d85/dd8/f103 zero size 2024-04-03T08:39:37.525 INFO:tasks.workunit.client.0.smithi157.stdout:4/868: dread - da/df/d2f/d64/d8f/dbd/d68/fc7 zero size 2024-04-03T08:39:37.530 INFO:tasks.workunit.client.1.smithi181.stdout:0/817: stat d5/dc/c1b 0 2024-04-03T08:39:37.531 INFO:tasks.workunit.client.0.smithi157.stdout:2/889: creat d3/db/d44/d12c/d55/d10c/f12e x:0 0 0 2024-04-03T08:39:37.533 INFO:tasks.workunit.client.1.smithi181.stdout:9/861: truncate d1/da/d13/d41/d32/f3f 5803531 0 2024-04-03T08:39:37.534 INFO:tasks.workunit.client.1.smithi181.stdout:0/818: write d5/fef [323264,82827] 0 2024-04-03T08:39:37.537 INFO:tasks.workunit.client.0.smithi157.stdout:3/929: read d8/fc2 [109732,99949] 0 2024-04-03T08:39:37.539 INFO:tasks.workunit.client.1.smithi181.stdout:1/831: creat d10/d69/dd1/d107/f10b x:0 0 0 2024-04-03T08:39:37.550 INFO:tasks.workunit.client.1.smithi181.stdout:2/909: dwrite d13/d1c/d4a/d68/dba/fea [0,4194304] 0 2024-04-03T08:39:37.552 INFO:tasks.workunit.client.0.smithi157.stdout:4/869: symlink da/df/d24/d35/d6a/d78/l12a 0 2024-04-03T08:39:37.556 INFO:tasks.workunit.client.0.smithi157.stdout:2/890: rmdir d3/dab 39 2024-04-03T08:39:37.560 INFO:tasks.workunit.client.0.smithi157.stdout:5/975: write dc/f1f [2506726,54111] 0 2024-04-03T08:39:37.560 INFO:tasks.workunit.client.1.smithi181.stdout:9/862: chown d1/da/d13/d73/l70 742 1 2024-04-03T08:39:37.566 INFO:tasks.workunit.client.0.smithi157.stdout:3/930: dwrite d8/d13/d1b/d4e/d50/fc9 [8388608,4194304] 0 2024-04-03T08:39:37.566 INFO:tasks.workunit.client.1.smithi181.stdout:5/826: dwrite d4/d18/d55/f70 [0,4194304] 0 2024-04-03T08:39:37.566 INFO:tasks.workunit.client.1.smithi181.stdout:1/832: rename d10/d15/d17/le2 to d10/d69/l10c 0 2024-04-03T08:39:37.568 INFO:tasks.workunit.client.1.smithi181.stdout:3/875: creat d0/d5/d6/dd/d5f/d95/de9/f123 x:0 0 0 2024-04-03T08:39:37.568 INFO:tasks.workunit.client.1.smithi181.stdout:4/864: symlink d1/d16/d24/d5e/d31/d39/d5d/d9a/dfb/l11a 0 2024-04-03T08:39:37.571 INFO:tasks.workunit.client.1.smithi181.stdout:7/750: dread d0/d1/d6/de/d17/f2c [0,4194304] 0 2024-04-03T08:39:37.573 INFO:tasks.workunit.client.1.smithi181.stdout:5/827: dread - d4/d18/d55/db4/d90/ff1 zero size 2024-04-03T08:39:37.574 INFO:tasks.workunit.client.1.smithi181.stdout:4/865: write d1/d16/d24/d5e/d3f/d6c/dcd/ffc [332796,4466] 0 2024-04-03T08:39:37.578 INFO:tasks.workunit.client.0.smithi157.stdout:4/870: creat da/df/d2f/f12b x:0 0 0 2024-04-03T08:39:37.579 INFO:tasks.workunit.client.1.smithi181.stdout:4/866: chown d1/d16/d24/d5e/d31/d39/d5d/d9a/ce3 52 1 2024-04-03T08:39:37.580 INFO:tasks.workunit.client.0.smithi157.stdout:5/976: read dc/d29/d56/d9e/db5/dc9/d124/f132 [44384,21830] 0 2024-04-03T08:39:37.580 INFO:tasks.workunit.client.0.smithi157.stdout:1/826: dwrite d2/d11/d23/dc9/da1/fbb [0,4194304] 0 2024-04-03T08:39:37.581 INFO:tasks.workunit.client.0.smithi157.stdout:6/934: dwrite d1/d5/d17/d29/d62/d7f/d89/da4/fee [4194304,4194304] 0 2024-04-03T08:39:37.582 INFO:tasks.workunit.client.0.smithi157.stdout:3/931: dread - d8/d13/d1b/d4e/d50/d7c/fb3 zero size 2024-04-03T08:39:37.586 INFO:tasks.workunit.client.0.smithi157.stdout:3/932: chown d8/d1e/d2d/d3f/dc8 722082039 1 2024-04-03T08:39:37.588 INFO:tasks.workunit.client.1.smithi181.stdout:3/876: dwrite d0/d5/d6/dd/d5f/d95/de9/f123 [0,4194304] 0 2024-04-03T08:39:37.593 INFO:tasks.workunit.client.0.smithi157.stdout:3/933: dread - d8/d13/d1b/d5b/fc7 zero size 2024-04-03T08:39:37.594 INFO:tasks.workunit.client.0.smithi157.stdout:6/935: mknod d1/d5/d17/d2a/d37/dca/c142 0 2024-04-03T08:39:37.598 INFO:tasks.workunit.client.0.smithi157.stdout:1/827: fsync d2/d11/d23/dc9/d86/fa0 0 2024-04-03T08:39:37.599 INFO:tasks.workunit.client.0.smithi157.stdout:6/936: chown d1/d4b/d38/d59/l8b 29 1 2024-04-03T08:39:37.602 INFO:tasks.workunit.client.0.smithi157.stdout:5/977: mknod dc/d29/d56/d9e/dc3/dde/de4/d12d/d112/c144 0 2024-04-03T08:39:37.612 INFO:tasks.workunit.client.0.smithi157.stdout:2/891: dwrite d3/fda [0,4194304] 0 2024-04-03T08:39:37.622 INFO:tasks.workunit.client.0.smithi157.stdout:4/871: write da/d26/f92 [623976,5790] 0 2024-04-03T08:39:37.625 INFO:tasks.workunit.client.0.smithi157.stdout:2/892: creat d3/db/d44/d4c/d5a/d88/f12f x:0 0 0 2024-04-03T08:39:37.628 INFO:tasks.workunit.client.1.smithi181.stdout:0/819: fdatasync d5/d9/f32 0 2024-04-03T08:39:37.631 INFO:tasks.workunit.client.1.smithi181.stdout:2/910: mknod d13/d1c/d6c/d111/c14d 0 2024-04-03T08:39:37.634 INFO:tasks.workunit.client.1.smithi181.stdout:9/863: symlink d1/da/d28/d80/dd3/l10e 0 2024-04-03T08:39:37.636 INFO:tasks.workunit.client.0.smithi157.stdout:3/934: write d8/d13/d1b/fa1 [1366232,50251] 0 2024-04-03T08:39:37.639 INFO:tasks.workunit.client.0.smithi157.stdout:1/828: getdents d2/d11/d23/dc9 0 2024-04-03T08:39:37.641 INFO:tasks.workunit.client.1.smithi181.stdout:4/867: symlink d1/d1e/d2c/d67/d9d/l11b 0 2024-04-03T08:39:37.642 INFO:tasks.workunit.client.0.smithi157.stdout:2/893: fdatasync d3/d2e/f90 0 2024-04-03T08:39:37.646 INFO:tasks.workunit.client.0.smithi157.stdout:4/872: mkdir da/df/d2f/d64/d8f/dbd/d68/dce/df7/d12c 0 2024-04-03T08:39:37.647 INFO:tasks.workunit.client.1.smithi181.stdout:3/877: fsync d0/d17/d56/f121 0 2024-04-03T08:39:37.648 INFO:tasks.workunit.client.0.smithi157.stdout:4/873: readlink da/df/d2f/dbc/lac 0 2024-04-03T08:39:37.648 INFO:tasks.workunit.client.1.smithi181.stdout:3/878: chown d0/d17/d56/fbe 7 1 2024-04-03T08:39:37.649 INFO:tasks.workunit.client.0.smithi157.stdout:3/935: rmdir d8/d1e/d2d/d39/d51/d48/dac 39 2024-04-03T08:39:37.651 INFO:tasks.workunit.client.0.smithi157.stdout:1/829: unlink d2/d11/d23/dc9/d86/fbe 0 2024-04-03T08:39:37.652 INFO:tasks.workunit.client.1.smithi181.stdout:3/879: read d0/ff6 [1029842,39511] 0 2024-04-03T08:39:37.653 INFO:tasks.workunit.client.1.smithi181.stdout:0/820: unlink d5/dc/ff 0 2024-04-03T08:39:37.655 INFO:tasks.workunit.client.0.smithi157.stdout:5/978: dwrite dc/d29/d51/f64 [4194304,4194304] 0 2024-04-03T08:39:37.656 INFO:tasks.workunit.client.1.smithi181.stdout:2/911: creat d13/d1c/d4a/d7f/db3/d8f/f14e x:0 0 0 2024-04-03T08:39:37.657 INFO:tasks.workunit.client.0.smithi157.stdout:2/894: fdatasync d3/d2e/f3b 0 2024-04-03T08:39:37.661 INFO:tasks.workunit.client.1.smithi181.stdout:2/912: dread d13/d1c/d73/fa4 [8388608,4194304] 0 2024-04-03T08:39:37.661 INFO:tasks.workunit.client.0.smithi157.stdout:3/936: rmdir d8/d1e/d2d/d39/d51/d7e/db1/de7 39 2024-04-03T08:39:37.669 INFO:tasks.workunit.client.1.smithi181.stdout:4/868: unlink d1/d16/d24/d5e/d2b/df2/cbe 0 2024-04-03T08:39:37.670 INFO:tasks.workunit.client.1.smithi181.stdout:7/751: truncate d0/d1/d6/de/d17/d64/d85/d9a/da4/f7a 1045375 0 2024-04-03T08:39:37.672 INFO:tasks.workunit.client.1.smithi181.stdout:3/880: fdatasync d0/d5/d6/f4c 0 2024-04-03T08:39:37.673 INFO:tasks.workunit.client.1.smithi181.stdout:8/759: sync 2024-04-03T08:39:37.673 INFO:tasks.workunit.client.1.smithi181.stdout:6/865: sync 2024-04-03T08:39:37.673 INFO:tasks.workunit.client.0.smithi157.stdout:4/874: symlink da/df/d2f/d54/d120/l12d 0 2024-04-03T08:39:37.674 INFO:tasks.workunit.client.0.smithi157.stdout:2/895: rmdir d3/d2e/d32/d9f 39 2024-04-03T08:39:37.675 INFO:tasks.workunit.client.1.smithi181.stdout:0/821: creat d5/dc/d10/d30/f109 x:0 0 0 2024-04-03T08:39:37.677 INFO:tasks.workunit.client.1.smithi181.stdout:1/833: rename d10/d15/d17/d37/de3/c102 to d10/d15/d17/d19/d33/c10d 0 2024-04-03T08:39:37.677 INFO:tasks.workunit.client.1.smithi181.stdout:9/864: dwrite d1/da/d28/f6b [0,4194304] 0 2024-04-03T08:39:37.677 INFO:tasks.workunit.client.1.smithi181.stdout:0/822: truncate d5/fef 1013439 0 2024-04-03T08:39:37.679 INFO:tasks.workunit.client.0.smithi157.stdout:3/937: creat d8/d1e/d2d/d3b/d9e/dcd/d124/f148 x:0 0 0 2024-04-03T08:39:37.680 INFO:tasks.workunit.client.1.smithi181.stdout:1/834: stat d10/d15/d17/d23/f78 0 2024-04-03T08:39:37.683 INFO:tasks.workunit.client.1.smithi181.stdout:0/823: stat d5/d9/d2a/da1/da8/lbb 0 2024-04-03T08:39:37.692 INFO:tasks.workunit.client.0.smithi157.stdout:2/896: mkdir d3/d2e/d32/d3c/d130 0 2024-04-03T08:39:37.692 INFO:tasks.workunit.client.1.smithi181.stdout:8/760: dread d4/d44/d59/d5f/d6c/fd3 [0,4194304] 0 2024-04-03T08:39:37.697 INFO:tasks.workunit.client.1.smithi181.stdout:4/869: creat d1/d16/d24/d5e/d31/f11c x:0 0 0 2024-04-03T08:39:37.698 INFO:tasks.workunit.client.0.smithi157.stdout:3/938: dwrite d8/d13/d1b/d4e/d50/d7c/fb7 [0,4194304] 0 2024-04-03T08:39:37.699 INFO:tasks.workunit.client.0.smithi157.stdout:1/830: rename d2/f53 to d2/d11/d23/dc9/d58/d62/d74/f114 0 2024-04-03T08:39:37.701 INFO:tasks.workunit.client.1.smithi181.stdout:9/865: dread d1/da/d13/d41/d65/fa6 [0,4194304] 0 2024-04-03T08:39:37.706 INFO:tasks.workunit.client.1.smithi181.stdout:3/881: rename d0/d5/f9d to d0/d17/d10f/f124 0 2024-04-03T08:39:37.708 INFO:tasks.workunit.client.1.smithi181.stdout:6/866: mknod d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/c110 0 2024-04-03T08:39:37.709 INFO:tasks.workunit.client.0.smithi157.stdout:1/831: mkdir d2/d11/d24/d39/d115 0 2024-04-03T08:39:37.712 INFO:tasks.workunit.client.1.smithi181.stdout:0/824: mkdir d5/d9/d2a/da1/df7/d10a 0 2024-04-03T08:39:37.713 INFO:tasks.workunit.client.0.smithi157.stdout:5/979: dread dc/f67 [0,4194304] 0 2024-04-03T08:39:37.714 INFO:tasks.workunit.client.1.smithi181.stdout:2/913: dwrite d13/d1c/d4a/d7f/db3/de3/fee [0,4194304] 0 2024-04-03T08:39:37.714 INFO:tasks.workunit.client.1.smithi181.stdout:0/825: readlink d5/d9/d2a/da1/da8/lbd 0 2024-04-03T08:39:37.716 INFO:tasks.workunit.client.1.smithi181.stdout:1/835: truncate d10/d15/d17/f3f 1111309 0 2024-04-03T08:39:37.717 INFO:tasks.workunit.client.1.smithi181.stdout:7/752: mkdir d0/d1/d6/de/d17/d111 0 2024-04-03T08:39:37.718 INFO:tasks.workunit.client.0.smithi157.stdout:1/832: symlink d2/d11/d23/dc9/d58/d62/d74/l116 0 2024-04-03T08:39:37.718 INFO:tasks.workunit.client.0.smithi157.stdout:3/939: dread d8/d13/d1b/d4e/da6/fe5 [0,4194304] 0 2024-04-03T08:39:37.719 INFO:tasks.workunit.client.0.smithi157.stdout:5/980: truncate dc/d29/d56/fbf 399444 0 2024-04-03T08:39:37.730 INFO:tasks.workunit.client.0.smithi157.stdout:8/913: sync 2024-04-03T08:39:37.736 INFO:tasks.workunit.client.1.smithi181.stdout:9/866: fdatasync d1/da/d1a/f1f 0 2024-04-03T08:39:37.737 INFO:tasks.workunit.client.0.smithi157.stdout:5/981: dread - dc/d29/d56/d2e/ffb zero size 2024-04-03T08:39:37.740 INFO:tasks.workunit.client.0.smithi157.stdout:8/914: readlink d2/d11/l2c 0 2024-04-03T08:39:37.742 INFO:tasks.workunit.client.0.smithi157.stdout:3/940: creat d8/d1e/d2d/d39/d12c/f149 x:0 0 0 2024-04-03T08:39:37.744 INFO:tasks.workunit.client.0.smithi157.stdout:2/897: truncate d3/d12/fa 1839475 0 2024-04-03T08:39:37.751 INFO:tasks.workunit.client.1.smithi181.stdout:2/914: rmdir d13/d7b/ddc 39 2024-04-03T08:39:37.752 INFO:tasks.workunit.client.0.smithi157.stdout:2/898: rmdir d3/db/d44/d4c/d5a/d88/dc6 39 2024-04-03T08:39:37.753 INFO:tasks.workunit.client.1.smithi181.stdout:2/915: chown d13/da7/d27/d2f/d5d 297551019 1 2024-04-03T08:39:37.753 INFO:tasks.workunit.client.1.smithi181.stdout:4/870: write d1/d1e/d78/fd1 [907903,37615] 0 2024-04-03T08:39:37.754 INFO:tasks.workunit.client.0.smithi157.stdout:3/941: mkdir d8/d1e/d2d/d39/d51/d7e/db1/d14a 0 2024-04-03T08:39:37.755 INFO:tasks.workunit.client.0.smithi157.stdout:1/833: write d2/d11/d24/f2f [2159452,38825] 0 2024-04-03T08:39:37.755 INFO:tasks.workunit.client.0.smithi157.stdout:3/942: chown l5 815765 1 2024-04-03T08:39:37.756 INFO:tasks.workunit.client.1.smithi181.stdout:0/826: creat d5/dc/d10/d58/dba/d90/f10b x:0 0 0 2024-04-03T08:39:37.757 INFO:tasks.workunit.client.1.smithi181.stdout:0/827: stat d5/dc/d14 0 2024-04-03T08:39:37.758 INFO:tasks.workunit.client.0.smithi157.stdout:1/834: read - d2/d11/d23/dc9/d58/d94/da3/ff5 zero size 2024-04-03T08:39:37.759 INFO:tasks.workunit.client.1.smithi181.stdout:7/753: mkdir d0/d1/d6/dca/d112 0 2024-04-03T08:39:37.760 INFO:tasks.workunit.client.0.smithi157.stdout:1/835: chown d2/cbd 120855 1 2024-04-03T08:39:37.765 INFO:tasks.workunit.client.0.smithi157.stdout:3/943: creat d8/d13/d1b/d4e/d50/d7c/dd8/f14b x:0 0 0 2024-04-03T08:39:37.765 INFO:tasks.workunit.client.1.smithi181.stdout:9/867: mkdir d1/da/d13/d22/d23/d36/d9c/d10f 0 2024-04-03T08:39:37.767 INFO:tasks.workunit.client.0.smithi157.stdout:2/899: creat d3/f131 x:0 0 0 2024-04-03T08:39:37.769 INFO:tasks.workunit.client.1.smithi181.stdout:3/882: rename d0/dbc/c10a to d0/d17/d63/df8/c125 0 2024-04-03T08:39:37.770 INFO:tasks.workunit.client.0.smithi157.stdout:8/915: dwrite d2/d11/d10/d24/d5b/d2e/f58 [0,4194304] 0 2024-04-03T08:39:37.772 INFO:tasks.workunit.client.1.smithi181.stdout:0/828: dwrite d5/dc/d10/d30/f109 [0,4194304] 0 2024-04-03T08:39:37.774 INFO:tasks.workunit.client.1.smithi181.stdout:2/916: creat d13/d1c/d6c/d7a/f14f x:0 0 0 2024-04-03T08:39:37.778 INFO:tasks.workunit.client.1.smithi181.stdout:7/754: dread - d0/fd5 zero size 2024-04-03T08:39:37.778 INFO:tasks.workunit.client.1.smithi181.stdout:9/868: dread d1/da/d28/d30/f47 [0,4194304] 0 2024-04-03T08:39:37.779 INFO:tasks.workunit.client.0.smithi157.stdout:3/944: creat d8/d13/d1b/d5b/d7f/f14c x:0 0 0 2024-04-03T08:39:37.779 INFO:tasks.workunit.client.1.smithi181.stdout:8/761: creat d4/d45/ffd x:0 0 0 2024-04-03T08:39:37.781 INFO:tasks.workunit.client.0.smithi157.stdout:8/916: write d2/d11/d10/d24/d5b/d2e/dcf/f128 [744965,93169] 0 2024-04-03T08:39:37.781 INFO:tasks.workunit.client.0.smithi157.stdout:2/900: chown d3/d2e/l107 0 1 2024-04-03T08:39:37.781 INFO:tasks.workunit.client.0.smithi157.stdout:3/945: readlink d8/d13/d1b/d5b/d7f/l8b 0 2024-04-03T08:39:37.782 INFO:tasks.workunit.client.0.smithi157.stdout:1/836: link d2/d11/d23/dc9/d58/f4b d2/d11/d24/d39/f117 0 2024-04-03T08:39:37.786 INFO:tasks.workunit.client.1.smithi181.stdout:0/829: fdatasync d5/dc/d14/f5c 0 2024-04-03T08:39:37.792 INFO:tasks.workunit.client.0.smithi157.stdout:2/901: truncate d3/db/d44/f92 5340878 0 2024-04-03T08:39:37.796 INFO:tasks.workunit.client.1.smithi181.stdout:6/867: getdents d6/d53/d8d/d97/db0 0 2024-04-03T08:39:37.797 INFO:tasks.workunit.client.0.smithi157.stdout:8/917: symlink d2/d11/d10/d24/d5b/d2e/d94/ddb/d103/l137 0 2024-04-03T08:39:37.798 INFO:tasks.workunit.client.1.smithi181.stdout:6/868: dread - d6/d3e/db1/dc4/d10f/dba/d81/f10c zero size 2024-04-03T08:39:37.812 INFO:tasks.workunit.client.0.smithi157.stdout:3/946: link d8/d13/d1b/l70 d8/d1e/d2d/d123/l14d 0 2024-04-03T08:39:37.812 INFO:tasks.workunit.client.1.smithi181.stdout:3/883: write d0/d17/d36/d1e/fda [467775,113923] 0 2024-04-03T08:39:37.813 INFO:tasks.workunit.client.0.smithi157.stdout:1/837: dread d2/d11/d23/dc9/d58/f51 [0,4194304] 0 2024-04-03T08:39:37.817 INFO:tasks.workunit.client.1.smithi181.stdout:8/762: dread d4/d45/db/f58 [0,4194304] 0 2024-04-03T08:39:37.817 INFO:tasks.workunit.client.1.smithi181.stdout:0/830: symlink d5/d9/d2a/da1/df7/d107/l10c 0 2024-04-03T08:39:37.819 INFO:tasks.workunit.client.1.smithi181.stdout:5/828: sync 2024-04-03T08:39:37.821 INFO:tasks.workunit.client.1.smithi181.stdout:7/755: link d0/d1/d6/de/d17/d27/f28 d0/d1/d6/de9/f113 0 2024-04-03T08:39:37.822 INFO:tasks.workunit.client.1.smithi181.stdout:6/869: write d6/d3e/db1/dc4/d10f/dba/d81/fd4 [681019,72709] 0 2024-04-03T08:39:37.823 INFO:tasks.workunit.client.1.smithi181.stdout:4/871: dwrite d1/d16/d24/d5e/d31/f75 [0,4194304] 0 2024-04-03T08:39:37.824 INFO:tasks.workunit.client.0.smithi157.stdout:3/947: unlink d8/d1e/d2d/d3f/fe9 0 2024-04-03T08:39:37.826 INFO:tasks.workunit.client.0.smithi157.stdout:1/838: chown d2/d11/d23/dc9/d58/d94/da3/la6 149549380 1 2024-04-03T08:39:37.827 INFO:tasks.workunit.client.1.smithi181.stdout:9/869: link d1/da/d13/d41/d32/fcd d1/da/d13/d22/d23/f110 0 2024-04-03T08:39:37.830 INFO:tasks.workunit.client.1.smithi181.stdout:8/763: dread d4/d44/ff1 [0,4194304] 0 2024-04-03T08:39:37.833 INFO:tasks.workunit.client.0.smithi157.stdout:8/918: dwrite d2/d6f/f71 [0,4194304] 0 2024-04-03T08:39:37.834 INFO:tasks.workunit.client.1.smithi181.stdout:8/764: fsync d4/d2a/d37/dfb/fd7 0 2024-04-03T08:39:37.838 INFO:tasks.workunit.client.1.smithi181.stdout:4/872: rmdir d1/d1e/d78 39 2024-04-03T08:39:37.850 INFO:tasks.workunit.client.1.smithi181.stdout:5/829: mkdir d4/d22/d4a/dad/db6/d10c 0 2024-04-03T08:39:37.851 INFO:tasks.workunit.client.1.smithi181.stdout:7/756: write d0/d1/d6/de/f44 [2438138,43058] 0 2024-04-03T08:39:37.854 INFO:tasks.workunit.client.1.smithi181.stdout:4/873: creat d1/d16/d37/d34/d86/d9e/f11d x:0 0 0 2024-04-03T08:39:37.858 INFO:tasks.workunit.client.1.smithi181.stdout:3/884: write d0/d17/d40/fea [872798,129892] 0 2024-04-03T08:39:37.860 INFO:tasks.workunit.client.1.smithi181.stdout:9/870: rename d1/da/d13/d22/c75 to d1/da/d28/d30/dd8/c111 0 2024-04-03T08:39:37.861 INFO:tasks.workunit.client.1.smithi181.stdout:8/765: dread d4/d45/db/d14/f42 [0,4194304] 0 2024-04-03T08:39:37.863 INFO:tasks.workunit.client.1.smithi181.stdout:6/870: dwrite d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f49 [4194304,4194304] 0 2024-04-03T08:39:37.863 INFO:tasks.workunit.client.1.smithi181.stdout:5/830: mkdir d4/d18/d3e/d10d 0 2024-04-03T08:39:37.864 INFO:tasks.workunit.client.1.smithi181.stdout:8/766: dread - d4/d45/db/d14/d31/d1c/d51/fe4 zero size 2024-04-03T08:39:37.865 INFO:tasks.workunit.client.1.smithi181.stdout:0/831: getdents d5/dc/d10/d58/db0/db8 0 2024-04-03T08:39:37.866 INFO:tasks.workunit.client.1.smithi181.stdout:5/831: write d4/d18/d55/db4/d90/ff1 [428799,1024] 0 2024-04-03T08:39:37.868 INFO:tasks.workunit.client.1.smithi181.stdout:5/832: chown d4/f13 9529501 1 2024-04-03T08:39:37.870 INFO:tasks.workunit.client.1.smithi181.stdout:8/767: unlink d4/d2a/d37/dfb/ce2 0 2024-04-03T08:39:37.871 INFO:tasks.workunit.client.1.smithi181.stdout:5/833: chown d4/d22/d4a/dad/db6 244 1 2024-04-03T08:39:37.871 INFO:tasks.workunit.client.1.smithi181.stdout:0/832: mkdir d5/d9/d2a/de6/dcc/d10d 0 2024-04-03T08:39:37.877 INFO:tasks.workunit.client.1.smithi181.stdout:6/871: symlink d6/d3e/db1/dc4/d10f/dba/l111 0 2024-04-03T08:39:37.879 INFO:tasks.workunit.client.1.smithi181.stdout:5/834: creat d4/d18/d25/de7/f10e x:0 0 0 2024-04-03T08:39:37.880 INFO:tasks.workunit.client.1.smithi181.stdout:0/833: dread - d5/dc/d10/f86 zero size 2024-04-03T08:39:37.881 INFO:tasks.workunit.client.1.smithi181.stdout:4/874: rmdir d1/d16/d24/d5e/d3f/d81/d105 0 2024-04-03T08:39:37.883 INFO:tasks.workunit.client.1.smithi181.stdout:6/872: write d6/d3e/db1/dc4/d10f/dba/da6/d4f/f7a [491866,117819] 0 2024-04-03T08:39:37.883 INFO:tasks.workunit.client.1.smithi181.stdout:8/768: truncate d4/d45/db/d14/d31/fc1 398403 0 2024-04-03T08:39:37.885 INFO:tasks.workunit.client.1.smithi181.stdout:7/757: getdents d0/d1/d6 0 2024-04-03T08:39:37.886 INFO:tasks.workunit.client.1.smithi181.stdout:0/834: mkdir d5/d9/d2a/d10e 0 2024-04-03T08:39:37.888 INFO:tasks.workunit.client.1.smithi181.stdout:5/835: mknod d4/d18/d25/d68/d77/c10f 0 2024-04-03T08:39:37.889 INFO:tasks.workunit.client.1.smithi181.stdout:5/836: stat d4/d18/l10a 0 2024-04-03T08:39:37.889 INFO:tasks.workunit.client.0.smithi157.stdout:3/948: rename d8/d13/d1b/d5b/d7f/l8b to d8/d1e/d2d/d39/d142/l14e 0 2024-04-03T08:39:37.890 INFO:tasks.workunit.client.1.smithi181.stdout:9/871: getdents d1/da/d28/d30/d3e/d4e 0 2024-04-03T08:39:37.891 INFO:tasks.workunit.client.0.smithi157.stdout:0/985: sync 2024-04-03T08:39:37.892 INFO:tasks.workunit.client.0.smithi157.stdout:1/839: stat d2/d11/d23/dc9/d58/cd7 0 2024-04-03T08:39:37.894 INFO:tasks.workunit.client.1.smithi181.stdout:4/875: unlink d1/d16/d24/d61/fe2 0 2024-04-03T08:39:37.895 INFO:tasks.workunit.client.0.smithi157.stdout:8/919: mknod d2/ddd/c138 0 2024-04-03T08:39:37.896 INFO:tasks.workunit.client.1.smithi181.stdout:8/769: truncate d4/d44/d59/fcb 449303 0 2024-04-03T08:39:37.896 INFO:tasks.workunit.client.1.smithi181.stdout:4/876: chown d1/d1e/d2c/l4c 296 1 2024-04-03T08:39:37.897 INFO:tasks.workunit.client.0.smithi157.stdout:2/902: getdents d3/db/d44/d4c/d5a/d88/dc6 0 2024-04-03T08:39:37.899 INFO:tasks.workunit.client.1.smithi181.stdout:6/873: creat d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/f112 x:0 0 0 2024-04-03T08:39:37.899 INFO:tasks.workunit.client.1.smithi181.stdout:7/758: dwrite d0/d1/d94/ff0 [0,4194304] 0 2024-04-03T08:39:37.901 INFO:tasks.workunit.client.1.smithi181.stdout:0/835: creat d5/dc/d10/f10f x:0 0 0 2024-04-03T08:39:37.901 INFO:tasks.workunit.client.0.smithi157.stdout:3/949: fsync d8/d13/d1b/d4e/da6/fe5 0 2024-04-03T08:39:37.904 INFO:tasks.workunit.client.0.smithi157.stdout:0/986: truncate d2/d9/dc/f3c 527183 0 2024-04-03T08:39:37.908 INFO:tasks.workunit.client.0.smithi157.stdout:1/840: rename d2/d11/d23/dc9/d58/d94/da3/fa8 to d2/d11/d23/dc9/d58/d94/da3/df1/f118 0 2024-04-03T08:39:37.910 INFO:tasks.workunit.client.0.smithi157.stdout:8/920: truncate d2/d11/f95 1688970 0 2024-04-03T08:39:37.919 INFO:tasks.workunit.client.0.smithi157.stdout:8/921: dread d2/d20/d23/fc5 [0,4194304] 0 2024-04-03T08:39:37.920 INFO:tasks.workunit.client.0.smithi157.stdout:3/950: creat d8/d13/d1b/d5b/f14f x:0 0 0 2024-04-03T08:39:37.924 INFO:tasks.workunit.client.0.smithi157.stdout:1/841: creat d2/d11/d24/d39/d3b/d1b/d90/f119 x:0 0 0 2024-04-03T08:39:37.925 INFO:tasks.workunit.client.0.smithi157.stdout:1/842: chown d2/d11/l9b 2641 1 2024-04-03T08:39:37.925 INFO:tasks.workunit.client.1.smithi181.stdout:0/836: creat d5/dc/d14/de5/deb/f110 x:0 0 0 2024-04-03T08:39:37.926 INFO:tasks.workunit.client.0.smithi157.stdout:1/843: stat d2/d11/d24/d39/l52 0 2024-04-03T08:39:37.927 INFO:tasks.workunit.client.1.smithi181.stdout:4/877: dwrite d1/d16/d24/d5e/f50 [0,4194304] 0 2024-04-03T08:39:37.932 INFO:tasks.workunit.client.0.smithi157.stdout:0/987: chown d2/d9/d5f/d15c/d10b/f121 0 1 2024-04-03T08:39:37.932 INFO:tasks.workunit.client.1.smithi181.stdout:7/759: mknod d0/d1/d6/de/d17/c114 0 2024-04-03T08:39:37.933 INFO:tasks.workunit.client.1.smithi181.stdout:5/837: link d4/d22/d78/c8b d4/d18/d55/db4/d90/c110 0 2024-04-03T08:39:37.951 INFO:tasks.workunit.client.1.smithi181.stdout:5/838: creat d4/d80/de5/f111 x:0 0 0 2024-04-03T08:39:37.952 INFO:tasks.workunit.client.0.smithi157.stdout:3/951: creat d8/d13/d1b/d5b/d7f/d129/f150 x:0 0 0 2024-04-03T08:39:37.952 INFO:tasks.workunit.client.0.smithi157.stdout:2/903: write d3/d12/d43/f86 [4565625,23366] 0 2024-04-03T08:39:37.953 INFO:tasks.workunit.client.1.smithi181.stdout:9/872: dwrite d1/da/d13/d22/d23/f94 [4194304,4194304] 0 2024-04-03T08:39:37.961 INFO:tasks.workunit.client.0.smithi157.stdout:8/922: getdents d2/d7b 0 2024-04-03T08:39:37.963 INFO:tasks.workunit.client.1.smithi181.stdout:7/760: mkdir d0/d115 0 2024-04-03T08:39:37.963 INFO:tasks.workunit.client.1.smithi181.stdout:0/837: creat d5/dc/d10/d58/d6c/f111 x:0 0 0 2024-04-03T08:39:37.963 INFO:tasks.workunit.client.0.smithi157.stdout:1/844: dread d2/f3 [0,4194304] 0 2024-04-03T08:39:37.965 INFO:tasks.workunit.client.0.smithi157.stdout:7/972: sync 2024-04-03T08:39:37.965 INFO:tasks.workunit.client.0.smithi157.stdout:6/937: sync 2024-04-03T08:39:37.966 INFO:tasks.workunit.client.1.smithi181.stdout:8/770: dwrite d4/fab [0,4194304] 0 2024-04-03T08:39:37.966 INFO:tasks.workunit.client.1.smithi181.stdout:5/839: mknod d4/d18/d55/db4/d8a/c112 0 2024-04-03T08:39:37.966 INFO:tasks.workunit.client.0.smithi157.stdout:2/904: mkdir d3/db/d44/d4c/d5a/d88/dc6/d132 0 2024-04-03T08:39:37.968 INFO:tasks.workunit.client.0.smithi157.stdout:3/952: mkdir d8/d13/d1b/d4e/da6/da8/d151 0 2024-04-03T08:39:37.970 INFO:tasks.workunit.client.1.smithi181.stdout:6/874: dwrite d6/d3e/db1/dc4/d10f/f5d [0,4194304] 0 2024-04-03T08:39:37.972 INFO:tasks.workunit.client.1.smithi181.stdout:9/873: mknod d1/da/d1a/d92/c112 0 2024-04-03T08:39:37.974 INFO:tasks.workunit.client.0.smithi157.stdout:0/988: creat d2/d9/dc/df/f15d x:0 0 0 2024-04-03T08:39:37.974 INFO:tasks.workunit.client.0.smithi157.stdout:0/989: fdatasync d2/d9/dc/df/d6f/d9d/d6a/fe5 0 2024-04-03T08:39:37.975 INFO:tasks.workunit.client.0.smithi157.stdout:8/923: symlink d2/d11/d10/d24/d5b/d2e/d75/l139 0 2024-04-03T08:39:37.980 INFO:tasks.workunit.client.1.smithi181.stdout:0/838: mknod d5/dc/d10/d30/dab/c112 0 2024-04-03T08:39:37.983 INFO:tasks.workunit.client.1.smithi181.stdout:8/771: fsync d4/d44/d59/d5f/faa 0 2024-04-03T08:39:37.984 INFO:tasks.workunit.client.0.smithi157.stdout:3/953: chown d8/d13/d1b/d5b/f8a 4111 1 2024-04-03T08:39:37.989 INFO:tasks.workunit.client.1.smithi181.stdout:1/836: sync 2024-04-03T08:39:37.989 INFO:tasks.workunit.client.1.smithi181.stdout:5/840: rename d4/d18/d55/db4/d90/l84 to d4/d44/l113 0 2024-04-03T08:39:37.992 INFO:tasks.workunit.client.0.smithi157.stdout:7/973: mknod d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/d12e/c154 0 2024-04-03T08:39:37.998 INFO:tasks.workunit.client.0.smithi157.stdout:7/974: read d0/d11/d15/d1b/db8/f3b [577049,111856] 0 2024-04-03T08:39:37.999 INFO:tasks.workunit.client.1.smithi181.stdout:0/839: rmdir d5/dc/d10/d58/db0/db8 39 2024-04-03T08:39:38.001 INFO:tasks.workunit.client.0.smithi157.stdout:1/845: mkdir d2/d11/d24/d39/d3b/d11a 0 2024-04-03T08:39:38.002 INFO:tasks.workunit.client.1.smithi181.stdout:9/874: dread d1/da/d13/d73/f7f [4194304,4194304] 0 2024-04-03T08:39:38.002 INFO:tasks.workunit.client.0.smithi157.stdout:2/905: symlink d3/db/d44/d4c/l133 0 2024-04-03T08:39:38.004 INFO:tasks.workunit.client.1.smithi181.stdout:5/841: creat d4/d80/de5/f114 x:0 0 0 2024-04-03T08:39:38.005 INFO:tasks.workunit.client.0.smithi157.stdout:3/954: symlink d8/d13/d1b/d5b/d7f/d129/l152 0 2024-04-03T08:39:38.007 INFO:tasks.workunit.client.0.smithi157.stdout:6/938: rename d1/d5/d17/d29/da7/db9/l12b to d1/d5/d17/d2a/d140/l143 0 2024-04-03T08:39:38.007 INFO:tasks.workunit.client.0.smithi157.stdout:3/955: readlink d8/d1e/d2d/d39/d51/d4c/l108 0 2024-04-03T08:39:38.009 INFO:tasks.workunit.client.0.smithi157.stdout:6/939: dread - d1/d5/d1b/fdd zero size 2024-04-03T08:39:38.009 INFO:tasks.workunit.client.0.smithi157.stdout:8/924: getdents d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119/d11c 0 2024-04-03T08:39:38.010 INFO:tasks.workunit.client.1.smithi181.stdout:7/761: creat d0/d1/d6/de/d17/f116 x:0 0 0 2024-04-03T08:39:38.010 INFO:tasks.workunit.client.0.smithi157.stdout:7/975: rmdir d0/d11/d6f/d89/d8c/d103/da5/def 39 2024-04-03T08:39:38.012 INFO:tasks.workunit.client.1.smithi181.stdout:8/772: dread d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f9d [0,4194304] 0 2024-04-03T08:39:38.016 INFO:tasks.workunit.client.1.smithi181.stdout:5/842: unlink d4/d44/cf8 0 2024-04-03T08:39:38.018 INFO:tasks.workunit.client.1.smithi181.stdout:5/843: dread - d4/d80/ffe zero size 2024-04-03T08:39:38.021 INFO:tasks.workunit.client.1.smithi181.stdout:5/844: chown d4/d18/d25/d59/db3/dda/cfd 270832 1 2024-04-03T08:39:38.022 INFO:tasks.workunit.client.1.smithi181.stdout:4/878: sync 2024-04-03T08:39:38.022 INFO:tasks.workunit.client.1.smithi181.stdout:2/917: sync 2024-04-03T08:39:38.023 INFO:tasks.workunit.client.1.smithi181.stdout:3/885: sync 2024-04-03T08:39:38.023 INFO:tasks.workunit.client.0.smithi157.stdout:3/956: unlink d8/d1e/d2d/d39/d51/d48/dab/c11a 0 2024-04-03T08:39:38.024 INFO:tasks.workunit.client.1.smithi181.stdout:1/837: dwrite d10/d15/d4a/ffc [0,4194304] 0 2024-04-03T08:39:38.025 INFO:tasks.workunit.client.1.smithi181.stdout:7/762: creat d0/d1/d6/de/d17/d64/f117 x:0 0 0 2024-04-03T08:39:38.025 INFO:tasks.workunit.client.0.smithi157.stdout:8/925: readlink d2/d6f/d70/d89/l74 0 2024-04-03T08:39:38.028 INFO:tasks.workunit.client.1.smithi181.stdout:4/879: write d1/d1e/f2e [8953569,77867] 0 2024-04-03T08:39:38.030 INFO:tasks.workunit.client.1.smithi181.stdout:6/875: getdents d6/d3e/d40 0 2024-04-03T08:39:38.030 INFO:tasks.workunit.client.1.smithi181.stdout:8/773: symlink d4/d45/db/d14/d31/d1c/d51/d87/dc8/lfe 0 2024-04-03T08:39:38.031 INFO:tasks.workunit.client.0.smithi157.stdout:5/982: sync 2024-04-03T08:39:38.031 INFO:tasks.workunit.client.0.smithi157.stdout:4/875: sync 2024-04-03T08:39:38.031 INFO:tasks.workunit.client.1.smithi181.stdout:1/838: read d10/d15/d17/d30/f38 [405531,8217] 0 2024-04-03T08:39:38.032 INFO:tasks.workunit.client.0.smithi157.stdout:7/976: fsync d0/d11/d15/d17/d1c/f37 0 2024-04-03T08:39:38.033 INFO:tasks.workunit.client.1.smithi181.stdout:0/840: dread d5/d9/f7f [0,4194304] 0 2024-04-03T08:39:38.036 INFO:tasks.workunit.client.1.smithi181.stdout:0/841: stat d5/dc/d75/fe4 0 2024-04-03T08:39:38.038 INFO:tasks.workunit.client.0.smithi157.stdout:6/940: dwrite d1/d5/d17/d2a/d30/d12c/f130 [0,4194304] 0 2024-04-03T08:39:38.039 INFO:tasks.workunit.client.1.smithi181.stdout:9/875: link d1/da/d13/d41/d32/fe6 d1/da/d13/d41/d65/dbb/f113 0 2024-04-03T08:39:38.041 INFO:tasks.workunit.client.0.smithi157.stdout:7/977: truncate d0/d11/d15/d17/d52/f130 509380 0 2024-04-03T08:39:38.043 INFO:tasks.workunit.client.0.smithi157.stdout:3/957: fdatasync d8/f11 0 2024-04-03T08:39:38.051 INFO:tasks.workunit.client.0.smithi157.stdout:2/906: write d3/db/d44/d12c/f98 [441446,110395] 0 2024-04-03T08:39:38.051 INFO:tasks.workunit.client.1.smithi181.stdout:6/876: dwrite d6/d3e/db1/dc4/d10f/f9c [0,4194304] 0 2024-04-03T08:39:38.054 INFO:tasks.workunit.client.0.smithi157.stdout:8/926: creat d2/d20/db1/dbc/de2/f13a x:0 0 0 2024-04-03T08:39:38.055 INFO:tasks.workunit.client.1.smithi181.stdout:9/876: dread d1/da/d1a/fec [0,4194304] 0 2024-04-03T08:39:38.058 INFO:tasks.workunit.client.1.smithi181.stdout:9/877: chown d1/da/d13/d41 6082325 1 2024-04-03T08:39:38.060 INFO:tasks.workunit.client.0.smithi157.stdout:0/990: rename d2/d9/dc/f3c to d2/d9/dc/df/d1b/d4a/d31/f15e 0 2024-04-03T08:39:38.061 INFO:tasks.workunit.client.1.smithi181.stdout:2/918: creat d13/d1c/d73/f150 x:0 0 0 2024-04-03T08:39:38.061 INFO:tasks.workunit.client.0.smithi157.stdout:1/846: write d2/d11/d24/d39/d3b/d1b/d90/fcb [3269449,116667] 0 2024-04-03T08:39:38.065 INFO:tasks.workunit.client.1.smithi181.stdout:3/886: truncate d0/d5/d77/fc0 71391 0 2024-04-03T08:39:38.066 INFO:tasks.workunit.client.0.smithi157.stdout:5/983: symlink dc/d29/d56/d2e/l145 0 2024-04-03T08:39:38.069 INFO:tasks.workunit.client.1.smithi181.stdout:4/880: dread d1/d16/d24/d5e/d31/d39/da1/fc0 [0,4194304] 0 2024-04-03T08:39:38.070 INFO:tasks.workunit.client.0.smithi157.stdout:7/978: symlink d0/d11/d15/d1b/db8/l155 0 2024-04-03T08:39:38.072 INFO:tasks.workunit.client.0.smithi157.stdout:6/941: truncate d1/d5/d17/d2a/d30/d95/f26 993612 0 2024-04-03T08:39:38.075 INFO:tasks.workunit.client.1.smithi181.stdout:0/842: creat d5/dc/d10/d58/dba/d90/f113 x:0 0 0 2024-04-03T08:39:38.075 INFO:tasks.workunit.client.0.smithi157.stdout:2/907: fsync d3/db/d44/d12c/d55/f59 0 2024-04-03T08:39:38.078 INFO:tasks.workunit.client.0.smithi157.stdout:8/927: mkdir d2/d11/d10/d24/d5b/d2e/d94/d13b 0 2024-04-03T08:39:38.079 INFO:tasks.workunit.client.1.smithi181.stdout:8/774: dread d4/d44/d59/d5f/d6c/fd3 [0,4194304] 0 2024-04-03T08:39:38.082 INFO:tasks.workunit.client.1.smithi181.stdout:0/843: write d5/dc/d75/fe4 [670268,43093] 0 2024-04-03T08:39:38.084 INFO:tasks.workunit.client.0.smithi157.stdout:0/991: fdatasync d2/d9/d51/d63/d71/f92 0 2024-04-03T08:39:38.087 INFO:tasks.workunit.client.1.smithi181.stdout:6/877: dwrite d6/d3e/db1/dc4/d10f/dba/da6/ff8 [0,4194304] 0 2024-04-03T08:39:38.087 INFO:tasks.workunit.client.1.smithi181.stdout:9/878: fdatasync d1/da/d13/d22/d23/d36/d91/d9d/f83 0 2024-04-03T08:39:38.088 INFO:tasks.workunit.client.1.smithi181.stdout:8/775: write d4/d45/db/fd [3635616,126862] 0 2024-04-03T08:39:38.089 INFO:tasks.workunit.client.1.smithi181.stdout:5/845: dwrite d4/d18/d25/d59/db3/fb8 [0,4194304] 0 2024-04-03T08:39:38.092 INFO:tasks.workunit.client.1.smithi181.stdout:0/844: fdatasync d5/dc/d14/d8d/fb4 0 2024-04-03T08:39:38.092 INFO:tasks.workunit.client.1.smithi181.stdout:3/887: unlink d0/d17/lba 0 2024-04-03T08:39:38.096 INFO:tasks.workunit.client.1.smithi181.stdout:2/919: truncate d13/d1c/d4a/d68/f6f 859877 0 2024-04-03T08:39:38.096 INFO:tasks.workunit.client.0.smithi157.stdout:5/984: rmdir dc/d29/d56/d9e/dc3/de2 39 2024-04-03T08:39:38.098 INFO:tasks.workunit.client.1.smithi181.stdout:5/846: chown d4/d18/d25/d68/d77 1 1 2024-04-03T08:39:38.099 INFO:tasks.workunit.client.0.smithi157.stdout:3/958: write d8/d1e/d2d/d39/d51/d7e/f120 [34016,125606] 0 2024-04-03T08:39:38.100 INFO:tasks.workunit.client.1.smithi181.stdout:4/881: fsync d1/f7 0 2024-04-03T08:39:38.103 INFO:tasks.workunit.client.1.smithi181.stdout:7/763: dwrite d0/d1/f51 [0,4194304] 0 2024-04-03T08:39:38.107 INFO:tasks.workunit.client.1.smithi181.stdout:1/839: dread d10/d15/d41/f44 [0,4194304] 0 2024-04-03T08:39:38.110 INFO:tasks.workunit.client.1.smithi181.stdout:3/888: write d0/d5/d6/dd/d5f/d95/de9/f123 [955369,66182] 0 2024-04-03T08:39:38.113 INFO:tasks.workunit.client.0.smithi157.stdout:8/928: write d2/d11/d10/f48 [4013568,104981] 0 2024-04-03T08:39:38.118 INFO:tasks.workunit.client.1.smithi181.stdout:6/878: dwrite d6/fb2 [0,4194304] 0 2024-04-03T08:39:38.118 INFO:tasks.workunit.client.0.smithi157.stdout:4/876: rename da/df/d2f/d54/fd3 to da/df/d99/d107/f12e 0 2024-04-03T08:39:38.121 INFO:tasks.workunit.client.0.smithi157.stdout:4/877: readlink da/df/d24/d35/d6a/d78/l12a 0 2024-04-03T08:39:38.121 INFO:tasks.workunit.client.0.smithi157.stdout:0/992: unlink d2/d9/dc/df/d6f/d9d/d6a/f76 0 2024-04-03T08:39:38.122 INFO:tasks.workunit.client.1.smithi181.stdout:4/882: dwrite d1/d16/d37/f7d [4194304,4194304] 0 2024-04-03T08:39:38.122 INFO:tasks.workunit.client.0.smithi157.stdout:4/878: chown da/c25 61 1 2024-04-03T08:39:38.123 INFO:tasks.workunit.client.1.smithi181.stdout:6/879: read d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/f61 [566010,116114] 0 2024-04-03T08:39:38.124 INFO:tasks.workunit.client.0.smithi157.stdout:4/879: readlink da/df/d24/l4e 0 2024-04-03T08:39:38.132 INFO:tasks.workunit.client.0.smithi157.stdout:7/979: write d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/f115 [701494,102331] 0 2024-04-03T08:39:38.134 INFO:tasks.workunit.client.0.smithi157.stdout:7/980: stat d0/d11/fed 0 2024-04-03T08:39:38.138 INFO:tasks.workunit.client.1.smithi181.stdout:9/879: unlink d1/da/d1a/f4c 0 2024-04-03T08:39:38.141 INFO:tasks.workunit.client.0.smithi157.stdout:3/959: truncate d8/d13/d1b/d4e/d50/f10c 474926 0 2024-04-03T08:39:38.141 INFO:tasks.workunit.client.0.smithi157.stdout:7/981: readlink d0/d11/d6f/d89/d8c/lc4 0 2024-04-03T08:39:38.144 INFO:tasks.workunit.client.1.smithi181.stdout:2/920: symlink d13/d1c/d6c/l151 0 2024-04-03T08:39:38.145 INFO:tasks.workunit.client.0.smithi157.stdout:6/942: dwrite d1/d5/d17/d29/f115 [0,4194304] 0 2024-04-03T08:39:38.145 INFO:tasks.workunit.client.1.smithi181.stdout:4/883: dwrite d1/d16/d37/d34/d85/fc9 [0,4194304] 0 2024-04-03T08:39:38.150 INFO:tasks.workunit.client.0.smithi157.stdout:6/943: readlink d1/d5/d17/d29/d12f/lcc 0 2024-04-03T08:39:38.151 INFO:tasks.workunit.client.1.smithi181.stdout:4/884: stat d1/d16/cd7 0 2024-04-03T08:39:38.151 INFO:tasks.workunit.client.1.smithi181.stdout:2/921: read d13/d1c/d4a/d68/dba/fea [560794,115914] 0 2024-04-03T08:39:38.151 INFO:tasks.workunit.client.1.smithi181.stdout:3/889: symlink d0/d5/d6/d32/d43/l126 0 2024-04-03T08:39:38.151 INFO:tasks.workunit.client.0.smithi157.stdout:8/929: mkdir d2/d20/d77/d13c 0 2024-04-03T08:39:38.155 INFO:tasks.workunit.client.0.smithi157.stdout:6/944: chown d1/d4b/d38/da6/l10a 927 1 2024-04-03T08:39:38.155 INFO:tasks.workunit.client.0.smithi157.stdout:1/847: link d2/d11/d23/dc9/d58/lb0 d2/d11/d24/dd5/l11b 0 2024-04-03T08:39:38.160 INFO:tasks.workunit.client.0.smithi157.stdout:4/880: creat da/df/d2f/d64/d8f/dbd/d68/f12f x:0 0 0 2024-04-03T08:39:38.167 INFO:tasks.workunit.client.1.smithi181.stdout:6/880: rmdir d6/d3e/db1 39 2024-04-03T08:39:38.171 INFO:tasks.workunit.client.0.smithi157.stdout:2/908: dwrite d3/d12/fd [0,4194304] 0 2024-04-03T08:39:38.173 INFO:tasks.workunit.client.1.smithi181.stdout:8/776: mknod d4/d45/db/cff 0 2024-04-03T08:39:38.179 INFO:tasks.workunit.client.1.smithi181.stdout:0/845: creat d5/d9/d2a/d10e/f114 x:0 0 0 2024-04-03T08:39:38.181 INFO:tasks.workunit.client.0.smithi157.stdout:8/930: chown d2/d11/d10/d24/d5b/d53/f79 1 1 2024-04-03T08:39:38.182 INFO:tasks.workunit.client.1.smithi181.stdout:0/846: write d5/dc/d14/de5/deb/ffc [2942782,107767] 0 2024-04-03T08:39:38.182 INFO:tasks.workunit.client.1.smithi181.stdout:9/880: mkdir d1/da/d13/d41/daf/d114 0 2024-04-03T08:39:38.183 INFO:tasks.workunit.client.0.smithi157.stdout:0/993: creat d2/d9/d5f/d8d/f15f x:0 0 0 2024-04-03T08:39:38.184 INFO:tasks.workunit.client.1.smithi181.stdout:9/881: fdatasync d1/da/d13/d22/d23/fba 0 2024-04-03T08:39:38.187 INFO:tasks.workunit.client.0.smithi157.stdout:5/985: creat dc/f146 x:0 0 0 2024-04-03T08:39:38.188 INFO:tasks.workunit.client.0.smithi157.stdout:4/881: truncate da/df/d2f/d64/d8f/dbd/d68/fc7 778075 0 2024-04-03T08:39:38.190 INFO:tasks.workunit.client.1.smithi181.stdout:9/882: dread d1/da/d13/d22/d23/d36/d91/ff6 [0,4194304] 0 2024-04-03T08:39:38.190 INFO:tasks.workunit.client.1.smithi181.stdout:1/840: link d10/d69/fd8 d10/d15/d41/f10e 0 2024-04-03T08:39:38.192 INFO:tasks.workunit.client.1.smithi181.stdout:4/885: rename d1/d16/d37/d34/d86/cca to d1/d16/d24/d5e/d31/d39/da1/df8/c11e 0 2024-04-03T08:39:38.196 INFO:tasks.workunit.client.1.smithi181.stdout:4/886: truncate d1/d16/d24/d5e/d3f/d6c/f104 34263 0 2024-04-03T08:39:38.197 INFO:tasks.workunit.client.1.smithi181.stdout:6/881: chown d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/l1d 31365232 1 2024-04-03T08:39:38.197 INFO:tasks.workunit.client.0.smithi157.stdout:8/931: creat d2/d20/d77/f13d x:0 0 0 2024-04-03T08:39:38.200 INFO:tasks.workunit.client.0.smithi157.stdout:1/848: mknod d2/d11/d24/d39/d3b/d2e/d66/d91/c11c 0 2024-04-03T08:39:38.201 INFO:tasks.workunit.client.0.smithi157.stdout:6/945: truncate d1/d5/d17/d2a/d30/d95/f26 816901 0 2024-04-03T08:39:38.203 INFO:tasks.workunit.client.1.smithi181.stdout:6/882: dread d6/d3e/db1/dc4/d10f/dba/d81/fd4 [0,4194304] 0 2024-04-03T08:39:38.204 INFO:tasks.workunit.client.1.smithi181.stdout:0/847: dread d5/dc/d10/f80 [0,4194304] 0 2024-04-03T08:39:38.204 INFO:tasks.workunit.client.0.smithi157.stdout:4/882: mknod da/df/d2f/d54/d120/c130 0 2024-04-03T08:39:38.205 INFO:tasks.workunit.client.1.smithi181.stdout:7/764: creat d0/d1/d6/de/d17/d64/d85/d9a/f118 x:0 0 0 2024-04-03T08:39:38.206 INFO:tasks.workunit.client.0.smithi157.stdout:6/946: dread d1/d5/d17/f64 [0,4194304] 0 2024-04-03T08:39:38.207 INFO:tasks.workunit.client.1.smithi181.stdout:6/883: write d6/d3e/db1/dc4/d10f/dba/da6/fd5 [1577429,93726] 0 2024-04-03T08:39:38.208 INFO:tasks.workunit.client.0.smithi157.stdout:5/986: rename dc/d35/c41 to dc/d29/d56/d2e/c147 0 2024-04-03T08:39:38.213 INFO:tasks.workunit.client.0.smithi157.stdout:2/909: mkdir d3/db/d44/d4c/d5a/d88/d134 0 2024-04-03T08:39:38.215 INFO:tasks.workunit.client.1.smithi181.stdout:2/922: symlink d13/d1c/d4a/d68/dfa/df9/d121/d125/d13e/l152 0 2024-04-03T08:39:38.216 INFO:tasks.workunit.client.1.smithi181.stdout:8/777: write d4/d44/f5b [4138886,104836] 0 2024-04-03T08:39:38.217 INFO:tasks.workunit.client.0.smithi157.stdout:7/982: link d0/d11/d15/d17/d9f/daa/lbd d0/d11/d15/d17/d9f/l156 0 2024-04-03T08:39:38.218 INFO:tasks.workunit.client.1.smithi181.stdout:2/923: fsync d13/d1c/d4a/d68/dfa/df9/f12f 0 2024-04-03T08:39:38.220 INFO:tasks.workunit.client.0.smithi157.stdout:7/983: fdatasync d0/d11/d6f/d89/d8c/d103/de3/f125 0 2024-04-03T08:39:38.220 INFO:tasks.workunit.client.0.smithi157.stdout:0/994: mknod d2/d9/ddd/c160 0 2024-04-03T08:39:38.222 INFO:tasks.workunit.client.0.smithi157.stdout:7/984: chown d0/d11/d6f/d76/da7 1334249 1 2024-04-03T08:39:38.227 INFO:tasks.workunit.client.1.smithi181.stdout:4/887: mkdir d1/d16/d37/d34/d11f 0 2024-04-03T08:39:38.228 INFO:tasks.workunit.client.1.smithi181.stdout:4/888: readlink d1/d16/d55/lb0 0 2024-04-03T08:39:38.229 INFO:tasks.workunit.client.0.smithi157.stdout:6/947: fsync d1/d5/d1b/fdd 0 2024-04-03T08:39:38.234 INFO:tasks.workunit.client.1.smithi181.stdout:0/848: rename d5/f40 to d5/dc/d10/d58/f115 0 2024-04-03T08:39:38.236 INFO:tasks.workunit.client.0.smithi157.stdout:3/960: getdents d8/d1e/d2d/d39/d51/d48/dab 0 2024-04-03T08:39:38.237 INFO:tasks.workunit.client.1.smithi181.stdout:0/849: write d5/d9/d2a/de6/f7a [5012178,50781] 0 2024-04-03T08:39:38.239 INFO:tasks.workunit.client.0.smithi157.stdout:3/961: readlink d8/d1e/d2d/d39/d51/d7e/l122 0 2024-04-03T08:39:38.242 INFO:tasks.workunit.client.1.smithi181.stdout:7/765: chown d0/d1/d6/de/d17/d64/d85/d9a/da4/l84 22733 1 2024-04-03T08:39:38.243 INFO:tasks.workunit.client.0.smithi157.stdout:2/910: stat d3/da6/fb9 0 2024-04-03T08:39:38.248 INFO:tasks.workunit.client.1.smithi181.stdout:3/890: creat d0/d17/d40/f127 x:0 0 0 2024-04-03T08:39:38.248 INFO:tasks.workunit.client.0.smithi157.stdout:7/985: dwrite d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/f78 [4194304,4194304] 0 2024-04-03T08:39:38.250 INFO:tasks.workunit.client.0.smithi157.stdout:0/995: creat d2/d9/dc/df/d1b/d4a/f161 x:0 0 0 2024-04-03T08:39:38.250 INFO:tasks.workunit.client.1.smithi181.stdout:3/891: write d0/d5/d6/dd/d25/f44 [4727263,14354] 0 2024-04-03T08:39:38.252 INFO:tasks.workunit.client.1.smithi181.stdout:3/892: chown d0/d5/d6/d32/fdc 28308755 1 2024-04-03T08:39:38.253 INFO:tasks.workunit.client.1.smithi181.stdout:5/847: sync 2024-04-03T08:39:38.260 INFO:tasks.workunit.client.0.smithi157.stdout:1/849: creat d2/d11/d24/d39/d3b/d11a/f11d x:0 0 0 2024-04-03T08:39:38.260 INFO:tasks.workunit.client.1.smithi181.stdout:4/889: rename d1/d16/d24/d5e/d2b/d56/c9b to d1/d16/d24/d5e/d31/d39/da1/c120 0 2024-04-03T08:39:38.263 INFO:tasks.workunit.client.0.smithi157.stdout:6/948: mkdir d1/d5/d17/d2a/d30/d95/d144 0 2024-04-03T08:39:38.268 INFO:tasks.workunit.client.1.smithi181.stdout:7/766: dread d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f6e [0,4194304] 0 2024-04-03T08:39:38.277 INFO:tasks.workunit.client.0.smithi157.stdout:7/986: creat d0/d11/d6f/d89/d8c/d103/f157 x:0 0 0 2024-04-03T08:39:38.278 INFO:tasks.workunit.client.0.smithi157.stdout:8/932: link d2/d6f/db5/ffa d2/d11/d10/d24/d5b/d2e/d75/d81/f13e 0 2024-04-03T08:39:38.279 INFO:tasks.workunit.client.1.smithi181.stdout:2/924: write d13/d1c/d4a/d68/fa3 [871303,50828] 0 2024-04-03T08:39:38.280 INFO:tasks.workunit.client.1.smithi181.stdout:4/890: dread d1/d16/f13 [0,4194304] 0 2024-04-03T08:39:38.288 INFO:tasks.workunit.client.0.smithi157.stdout:4/883: truncate da/df/d24/d35/d53/ff3 3400117 0 2024-04-03T08:39:38.289 INFO:tasks.workunit.client.1.smithi181.stdout:5/848: mknod d4/d22/d4a/c115 0 2024-04-03T08:39:38.290 INFO:tasks.workunit.client.0.smithi157.stdout:5/987: dread dc/d29/d56/d9e/db5/dc9/d124/d7f/f82 [0,4194304] 0 2024-04-03T08:39:38.292 INFO:tasks.workunit.client.1.smithi181.stdout:6/884: link d6/d3e/d40/dbc/dce/c107 d6/d53/d8d/d97/c113 0 2024-04-03T08:39:38.299 INFO:tasks.workunit.client.0.smithi157.stdout:2/911: creat d3/d2e/d32/d3c/d130/f135 x:0 0 0 2024-04-03T08:39:38.299 INFO:tasks.workunit.client.1.smithi181.stdout:8/778: link d4/d2a/d37/dfb/fd7 d4/d44/f100 0 2024-04-03T08:39:38.301 INFO:tasks.workunit.client.1.smithi181.stdout:8/779: fsync d4/fd8 0 2024-04-03T08:39:38.303 INFO:tasks.workunit.client.1.smithi181.stdout:0/850: dwrite d5/fa0 [0,4194304] 0 2024-04-03T08:39:38.303 INFO:tasks.workunit.client.0.smithi157.stdout:0/996: write d2/d9/d36/f80 [630171,74750] 0 2024-04-03T08:39:38.307 INFO:tasks.workunit.client.1.smithi181.stdout:2/925: creat d13/da7/d85/dbd/f153 x:0 0 0 2024-04-03T08:39:38.308 INFO:tasks.workunit.client.1.smithi181.stdout:1/841: getdents d10/d15/d17/d23/daa/de1 0 2024-04-03T08:39:38.310 INFO:tasks.workunit.client.0.smithi157.stdout:5/988: dread dc/f67 [0,4194304] 0 2024-04-03T08:39:38.310 INFO:tasks.workunit.client.0.smithi157.stdout:7/987: truncate d0/d11/d6f/d89/d8c/d103/da5/ff0 779735 0 2024-04-03T08:39:38.310 INFO:tasks.workunit.client.1.smithi181.stdout:1/842: dread - d10/d15/d17/d19/dd9/fdf zero size 2024-04-03T08:39:38.311 INFO:tasks.workunit.client.0.smithi157.stdout:6/949: write d1/f3 [276196,105252] 0 2024-04-03T08:39:38.315 INFO:tasks.workunit.client.1.smithi181.stdout:9/883: sync 2024-04-03T08:39:38.316 INFO:tasks.workunit.client.0.smithi157.stdout:3/962: write d8/d1e/d2d/d3b/d9e/dcd/f106 [345246,112125] 0 2024-04-03T08:39:38.316 INFO:tasks.workunit.client.0.smithi157.stdout:6/950: chown d1/d5/d17/d2a/d30 199889 1 2024-04-03T08:39:38.317 INFO:tasks.workunit.client.1.smithi181.stdout:9/884: dread - d1/da/d13/d41/d32/f103 zero size 2024-04-03T08:39:38.319 INFO:tasks.workunit.client.0.smithi157.stdout:4/884: dread da/d7e/d119/fca [0,4194304] 0 2024-04-03T08:39:38.324 INFO:tasks.workunit.client.1.smithi181.stdout:3/893: link d0/d5/fa2 d0/dbc/f128 0 2024-04-03T08:39:38.325 INFO:tasks.workunit.client.1.smithi181.stdout:5/849: symlink d4/l116 0 2024-04-03T08:39:38.326 INFO:tasks.workunit.client.1.smithi181.stdout:1/843: dwrite d10/d15/d17/d23/daa/de1/f104 [0,4194304] 0 2024-04-03T08:39:38.328 INFO:tasks.workunit.client.1.smithi181.stdout:1/844: write d10/d15/d4a/ffc [4151020,28370] 0 2024-04-03T08:39:38.329 INFO:tasks.workunit.client.1.smithi181.stdout:6/885: fdatasync d6/d53/d80/fe6 0 2024-04-03T08:39:38.338 INFO:tasks.workunit.client.0.smithi157.stdout:8/933: unlink d2/d6f/d70/d89/lce 0 2024-04-03T08:39:38.340 INFO:tasks.workunit.client.0.smithi157.stdout:3/963: dread d8/d1e/d2d/d3b/d9e/df9/f97 [0,4194304] 0 2024-04-03T08:39:38.343 INFO:tasks.workunit.client.0.smithi157.stdout:8/934: chown d2/d6f/f71 23907170 1 2024-04-03T08:39:38.343 INFO:tasks.workunit.client.0.smithi157.stdout:3/964: fdatasync d8/d13/f1a 0 2024-04-03T08:39:38.352 INFO:tasks.workunit.client.0.smithi157.stdout:2/912: dwrite d3/d2e/d32/d9f/fcb [0,4194304] 0 2024-04-03T08:39:38.360 INFO:tasks.workunit.client.1.smithi181.stdout:0/851: rmdir d5 39 2024-04-03T08:39:38.363 INFO:tasks.workunit.client.1.smithi181.stdout:4/891: write d1/d16/d24/d5e/d3f/d41/f87 [2369280,74913] 0 2024-04-03T08:39:38.371 INFO:tasks.workunit.client.0.smithi157.stdout:7/988: fsync d0/d11/d6f/d76/da7/f62 0 2024-04-03T08:39:38.373 INFO:tasks.workunit.client.0.smithi157.stdout:7/989: chown d0/d11/d6f/d89/d8c/dc6/l102 1003962 1 2024-04-03T08:39:38.377 INFO:tasks.workunit.client.0.smithi157.stdout:6/951: mknod d1/d5/d17/d2a/d30/d77/c145 0 2024-04-03T08:39:38.382 INFO:tasks.workunit.client.0.smithi157.stdout:5/989: write dc/d29/d56/f68 [2311600,130867] 0 2024-04-03T08:39:38.386 INFO:tasks.workunit.client.1.smithi181.stdout:3/894: unlink d0/d17/l1b 0 2024-04-03T08:39:38.393 INFO:tasks.workunit.client.0.smithi157.stdout:8/935: write d2/d6f/d70/d89/d59/df6/f12a [990136,17529] 0 2024-04-03T08:39:38.393 INFO:tasks.workunit.client.1.smithi181.stdout:1/845: fsync d10/d15/d4a/fc2 0 2024-04-03T08:39:38.395 INFO:tasks.workunit.client.1.smithi181.stdout:1/846: stat d10/d15/d4a/d6f/ffd 0 2024-04-03T08:39:38.397 INFO:tasks.workunit.client.0.smithi157.stdout:8/936: chown d2/d6f/d70/d89/d59/df6/f102 13 1 2024-04-03T08:39:38.400 INFO:tasks.workunit.client.1.smithi181.stdout:7/767: rmdir d0/d1/d6/de/d17/d111 0 2024-04-03T08:39:38.409 INFO:tasks.workunit.client.1.smithi181.stdout:4/892: mkdir d1/d16/d37/d121 0 2024-04-03T08:39:38.410 INFO:tasks.workunit.client.0.smithi157.stdout:1/850: getdents d2/d11/d23/de1 0 2024-04-03T08:39:38.411 INFO:tasks.workunit.client.1.smithi181.stdout:4/893: dread - d1/d16/d24/d5e/d31/d39/da1/fb8 zero size 2024-04-03T08:39:38.411 INFO:tasks.workunit.client.1.smithi181.stdout:2/926: mknod d13/d1c/d73/d13f/c154 0 2024-04-03T08:39:38.413 INFO:tasks.workunit.client.0.smithi157.stdout:5/990: truncate dc/d29/d56/d18/fab 751690 0 2024-04-03T08:39:38.414 INFO:tasks.workunit.client.1.smithi181.stdout:9/885: mkdir d1/da/d13/d22/d23/d36/d115 0 2024-04-03T08:39:38.419 INFO:tasks.workunit.client.0.smithi157.stdout:0/997: rename d2/d9/dc/df/d1b/d35/dc0/l137 to d2/d9/d36/l162 0 2024-04-03T08:39:38.419 INFO:tasks.workunit.client.1.smithi181.stdout:9/886: fdatasync d1/da/d13/d41/daf/df1/ff4 0 2024-04-03T08:39:38.420 INFO:tasks.workunit.client.1.smithi181.stdout:9/887: write d1/da/d13/d41/f105 [288994,20080] 0 2024-04-03T08:39:38.423 INFO:tasks.workunit.client.0.smithi157.stdout:8/937: dread d2/d6f/d70/d89/d59/df6/f102 [0,4194304] 0 2024-04-03T08:39:38.426 INFO:tasks.workunit.client.1.smithi181.stdout:3/895: rename d0/d5/d6/dd to d0/d5/d6/d32/daa/d129 0 2024-04-03T08:39:38.429 INFO:tasks.workunit.client.0.smithi157.stdout:6/952: truncate d1/d4b/da5/fab 3429704 0 2024-04-03T08:39:38.429 INFO:tasks.workunit.client.0.smithi157.stdout:2/913: dwrite d3/d2e/d32/d9f/da7/d121/fc2 [0,4194304] 0 2024-04-03T08:39:38.434 INFO:tasks.workunit.client.1.smithi181.stdout:2/927: dread d13/d1c/f3b [0,4194304] 0 2024-04-03T08:39:38.434 INFO:tasks.workunit.client.1.smithi181.stdout:5/850: dwrite d4/d80/ffe [0,4194304] 0 2024-04-03T08:39:38.437 INFO:tasks.workunit.client.1.smithi181.stdout:2/928: read - d13/da7/d85/f112 zero size 2024-04-03T08:39:38.439 INFO:tasks.workunit.client.1.smithi181.stdout:2/929: chown d13/da7 13638 1 2024-04-03T08:39:38.439 INFO:tasks.workunit.client.0.smithi157.stdout:3/965: rename d8/d1e/d2d/d3b/d9e/df9/f85 to d8/d13/d1b/d5b/d7f/d129/f153 0 2024-04-03T08:39:38.441 INFO:tasks.workunit.client.1.smithi181.stdout:7/768: write d0/d1/d6/de/d17/d27/f36 [2202702,78005] 0 2024-04-03T08:39:38.442 INFO:tasks.workunit.client.1.smithi181.stdout:8/780: creat d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f101 x:0 0 0 2024-04-03T08:39:38.442 INFO:tasks.workunit.client.0.smithi157.stdout:1/851: dread d2/d11/d23/fc1 [0,4194304] 0 2024-04-03T08:39:38.442 INFO:tasks.workunit.client.0.smithi157.stdout:7/990: rename d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f to d0/d11/d6f/d89/d8c/d103/de3/d12d/d8a/d8f/d5b/d158 22 2024-04-03T08:39:38.444 INFO:tasks.workunit.client.1.smithi181.stdout:0/852: truncate d5/fa3 276253 0 2024-04-03T08:39:38.444 INFO:tasks.workunit.client.0.smithi157.stdout:0/998: truncate d2/d9/d36/d38/f83 1674470 0 2024-04-03T08:39:38.448 INFO:tasks.workunit.client.1.smithi181.stdout:7/769: chown d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/cdd 19406 1 2024-04-03T08:39:38.453 INFO:tasks.workunit.client.0.smithi157.stdout:8/938: creat d2/d20/d77/f13f x:0 0 0 2024-04-03T08:39:38.456 INFO:tasks.workunit.client.0.smithi157.stdout:3/966: dread d8/d1e/d2d/d3f/d4d/d8f/fff [0,4194304] 0 2024-04-03T08:39:38.457 INFO:tasks.workunit.client.1.smithi181.stdout:3/896: dread - d0/d17/d36/d1e/ff0 zero size 2024-04-03T08:39:38.458 INFO:tasks.workunit.client.0.smithi157.stdout:2/914: dwrite d3/d12/fd [0,4194304] 0 2024-04-03T08:39:38.465 INFO:tasks.workunit.client.0.smithi157.stdout:0/999: dread - d2/d9/d36/fc6 zero size 2024-04-03T08:39:38.468 INFO:tasks.workunit.client.1.smithi181.stdout:1/847: mknod d10/d15/d17/d19/d33/c10f 0 2024-04-03T08:39:38.470 INFO:tasks.workunit.client.1.smithi181.stdout:2/930: truncate d13/f41 1196098 0 2024-04-03T08:39:38.472 INFO:tasks.workunit.client.0.smithi157.stdout:1/852: creat d2/d11/d23/dc9/d5d/db4/dbc/f11e x:0 0 0 2024-04-03T08:39:38.473 INFO:tasks.workunit.client.1.smithi181.stdout:8/781: mknod d4/d2a/d37/dfb/c102 0 2024-04-03T08:39:38.474 INFO:tasks.workunit.client.0.smithi157.stdout:7/991: dread d0/d11/d6f/d89/fd6 [0,4194304] 0 2024-04-03T08:39:38.476 INFO:tasks.workunit.client.0.smithi157.stdout:8/939: creat d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119/f140 x:0 0 0 2024-04-03T08:39:38.477 INFO:tasks.workunit.client.1.smithi181.stdout:0/853: mknod d5/d9/d2a/de6/dcc/c116 0 2024-04-03T08:39:38.481 INFO:tasks.workunit.client.0.smithi157.stdout:3/967: dwrite d8/d1e/d2d/f137 [0,4194304] 0 2024-04-03T08:39:38.485 INFO:tasks.workunit.client.0.smithi157.stdout:2/915: dread d3/d12/fd [0,4194304] 0 2024-04-03T08:39:38.485 INFO:tasks.workunit.client.0.smithi157.stdout:1/853: truncate d2/d11/d23/dc9/d58/d94/da3/f107 753050 0 2024-04-03T08:39:38.486 INFO:tasks.workunit.client.1.smithi181.stdout:4/894: creat d1/d1e/d2c/d10e/f122 x:0 0 0 2024-04-03T08:39:38.486 INFO:tasks.workunit.client.1.smithi181.stdout:3/897: rmdir d0/d5 39 2024-04-03T08:39:38.487 INFO:tasks.workunit.client.0.smithi157.stdout:6/953: rename d1/d5/d17/d2a/d30/d95/f2e to d1/d5/d17/d2a/d37/dca/d132/f146 0 2024-04-03T08:39:38.487 INFO:tasks.workunit.client.0.smithi157.stdout:5/991: write dc/dbb/fe3 [681976,108673] 0 2024-04-03T08:39:38.487 INFO:tasks.workunit.client.0.smithi157.stdout:2/916: fsync d3/f4e 0 2024-04-03T08:39:38.488 INFO:tasks.workunit.client.1.smithi181.stdout:5/851: dread d4/d22/f26 [0,4194304] 0 2024-04-03T08:39:38.489 INFO:tasks.workunit.client.1.smithi181.stdout:3/898: chown d0/d17/f2e 48 1 2024-04-03T08:39:38.491 INFO:tasks.workunit.client.0.smithi157.stdout:6/954: dread - d1/d5/d17/d29/da7/d129/f13d zero size 2024-04-03T08:39:38.492 INFO:tasks.workunit.client.0.smithi157.stdout:7/992: fdatasync d0/d11/d6f/d89/d8c/dc6/fe8 0 2024-04-03T08:39:38.493 INFO:tasks.workunit.client.1.smithi181.stdout:3/899: write d0/d17/d36/d1e/f28 [1217395,13653] 0 2024-04-03T08:39:38.504 INFO:tasks.workunit.client.1.smithi181.stdout:8/782: dread d4/d45/d9/f4d [0,4194304] 0 2024-04-03T08:39:38.505 INFO:tasks.workunit.client.1.smithi181.stdout:4/895: dread d1/d16/d24/d5e/d31/d39/f80 [0,4194304] 0 2024-04-03T08:39:38.506 INFO:tasks.workunit.client.1.smithi181.stdout:1/848: mknod d10/d15/d4a/d86/c110 0 2024-04-03T08:39:38.508 INFO:tasks.workunit.client.1.smithi181.stdout:4/896: write d1/d16/d24/d5e/d31/fa5 [2188624,91230] 0 2024-04-03T08:39:38.509 INFO:tasks.workunit.client.1.smithi181.stdout:1/849: chown d10/d15/d41/fad 29588693 1 2024-04-03T08:39:38.509 INFO:tasks.workunit.client.1.smithi181.stdout:2/931: mkdir d13/d1c/d4a/d7f/db3/d8f/d155 0 2024-04-03T08:39:38.516 INFO:tasks.workunit.client.0.smithi157.stdout:5/992: mkdir dc/d29/d56/d87/d148 0 2024-04-03T08:39:38.519 INFO:tasks.workunit.client.0.smithi157.stdout:5/993: chown dc/d29/d51/l78 1 1 2024-04-03T08:39:38.520 INFO:tasks.workunit.client.1.smithi181.stdout:7/770: mkdir d0/d1/d6/de/d17/d27/d119 0 2024-04-03T08:39:38.521 INFO:tasks.workunit.client.1.smithi181.stdout:7/771: dread - d0/d1/d6/de/d17/d27/f56 zero size 2024-04-03T08:39:38.523 INFO:tasks.workunit.client.0.smithi157.stdout:1/854: rename d2/d11/d23/dc9/d58/d94/fe5 to d2/d11/d24/d39/d3b/d11a/f11f 0 2024-04-03T08:39:38.527 INFO:tasks.workunit.client.1.smithi181.stdout:5/852: symlink d4/d22/d78/l117 0 2024-04-03T08:39:38.529 INFO:tasks.workunit.client.0.smithi157.stdout:7/993: truncate d0/d11/d15/d17/d1c/f4b 2381300 0 2024-04-03T08:39:38.533 INFO:tasks.workunit.client.1.smithi181.stdout:6/886: link d6/d3e/db1/dc4/d10f/c27 d6/dc0/d103/c114 0 2024-04-03T08:39:38.536 INFO:tasks.workunit.client.0.smithi157.stdout:5/994: symlink dc/d29/d56/da4/l149 0 2024-04-03T08:39:38.539 INFO:tasks.workunit.client.0.smithi157.stdout:6/955: creat d1/d5/d17/d2a/df7/f147 x:0 0 0 2024-04-03T08:39:38.541 INFO:tasks.workunit.client.1.smithi181.stdout:1/850: unlink d10/d15/d41/f5d 0 2024-04-03T08:39:38.543 INFO:tasks.workunit.client.1.smithi181.stdout:4/897: unlink d1/d16/d24/d5e/d31/dba/l10b 0 2024-04-03T08:39:38.545 INFO:tasks.workunit.client.1.smithi181.stdout:1/851: read d10/d15/d17/d30/f65 [1793059,16688] 0 2024-04-03T08:39:38.545 INFO:tasks.workunit.client.1.smithi181.stdout:3/900: dwrite d0/d5/d6/d32/daa/d129/d25/f11e [0,4194304] 0 2024-04-03T08:39:38.547 INFO:tasks.workunit.client.1.smithi181.stdout:1/852: chown d10/d15/c97 1026135767 1 2024-04-03T08:39:38.549 INFO:tasks.workunit.client.1.smithi181.stdout:0/854: unlink d5/d9/dc8/fcb 0 2024-04-03T08:39:38.551 INFO:tasks.workunit.client.1.smithi181.stdout:7/772: chown d0/d1/d6/de/d17/d27/d72/c10b 172 1 2024-04-03T08:39:38.554 INFO:tasks.workunit.client.1.smithi181.stdout:9/888: link d1/da/d13/d22/d23/c44 d1/da/d13/d41/d32/c116 0 2024-04-03T08:39:38.554 INFO:tasks.workunit.client.0.smithi157.stdout:1/855: symlink d2/d11/d24/d39/d3b/l120 0 2024-04-03T08:39:38.565 INFO:tasks.workunit.client.1.smithi181.stdout:8/783: write d4/d2a/d37/dfb/fd7 [279266,88757] 0 2024-04-03T08:39:38.565 INFO:tasks.workunit.client.0.smithi157.stdout:3/968: write d8/d1e/d2d/d3b/d9e/fd2 [777823,79332] 0 2024-04-03T08:39:38.565 INFO:tasks.workunit.client.0.smithi157.stdout:8/940: getdents d2/d11/d10/d24/d5b/d2e/d94/ddb/d103 0 2024-04-03T08:39:38.568 INFO:tasks.workunit.client.1.smithi181.stdout:8/784: stat d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/def 0 2024-04-03T08:39:38.571 INFO:tasks.workunit.client.0.smithi157.stdout:2/917: link d3/db/d44/d12c/f7a d3/d2e/d32/f136 0 2024-04-03T08:39:38.577 INFO:tasks.workunit.client.1.smithi181.stdout:2/932: unlink d13/d1c/d4a/d68/dfa/cf7 0 2024-04-03T08:39:38.579 INFO:tasks.workunit.client.1.smithi181.stdout:4/898: mknod d1/d1e/d2c/de4/df7/c123 0 2024-04-03T08:39:38.588 INFO:tasks.workunit.client.0.smithi157.stdout:8/941: dwrite d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119/f140 [0,4194304] 0 2024-04-03T08:39:38.591 INFO:tasks.workunit.client.1.smithi181.stdout:1/853: truncate d10/d15/d17/d23/d27/f95 996589 0 2024-04-03T08:39:38.594 INFO:tasks.workunit.client.0.smithi157.stdout:6/956: rename d1/d5/d17/d2a/c74 to d1/d5/d17/d29/dc0/c148 0 2024-04-03T08:39:38.595 INFO:tasks.workunit.client.1.smithi181.stdout:7/773: mknod d0/d1/d6/de/d17/d64/d85/dd8/dea/c11a 0 2024-04-03T08:39:38.605 INFO:tasks.workunit.client.0.smithi157.stdout:8/942: creat d2/d11/d10/d24/d5b/d2e/d75/f141 x:0 0 0 2024-04-03T08:39:38.609 INFO:tasks.workunit.client.0.smithi157.stdout:8/943: chown d2/d6f/d70/d89/d59 5241276 1 2024-04-03T08:39:38.611 INFO:tasks.workunit.client.0.smithi157.stdout:3/969: rename d8/d1e/d2d/d3b/lfb to d8/d1e/d2d/d39/d51/d7e/db1/de7/l154 0 2024-04-03T08:39:38.611 INFO:tasks.workunit.client.0.smithi157.stdout:5/995: dwrite dc/d29/d56/d9e/fb8 [0,4194304] 0 2024-04-03T08:39:38.616 INFO:tasks.workunit.client.0.smithi157.stdout:6/957: mknod d1/d5/d17/d29/da7/db9/df0/da8/c149 0 2024-04-03T08:39:38.616 INFO:tasks.workunit.client.0.smithi157.stdout:3/970: write d8/d13/d1b/f143 [35535,82952] 0 2024-04-03T08:39:38.620 INFO:tasks.workunit.client.0.smithi157.stdout:7/994: dwrite d0/f20 [0,4194304] 0 2024-04-03T08:39:38.622 INFO:tasks.workunit.client.0.smithi157.stdout:6/958: chown d1/d4b/da5/dc7/fed 143416293 1 2024-04-03T08:39:38.626 INFO:tasks.workunit.client.0.smithi157.stdout:5/996: read dc/d29/d56/d9e/db5/dc9/d124/f7a [377731,21304] 0 2024-04-03T08:39:38.627 INFO:tasks.workunit.client.1.smithi181.stdout:7/774: dread d0/d1/d6/de/d17/f55 [0,4194304] 0 2024-04-03T08:39:38.628 INFO:tasks.workunit.client.0.smithi157.stdout:2/918: write d3/d2e/d32/f136 [137162,73353] 0 2024-04-03T08:39:38.629 INFO:tasks.workunit.client.0.smithi157.stdout:7/995: fsync d0/d11/d6f/d76/da7/f3a 0 2024-04-03T08:39:38.630 INFO:tasks.workunit.client.0.smithi157.stdout:5/997: write dc/d29/d56/f68 [696759,109185] 0 2024-04-03T08:39:38.632 INFO:tasks.workunit.client.0.smithi157.stdout:6/959: dread - d1/d4b/d38/da6/f11d zero size 2024-04-03T08:39:38.638 INFO:tasks.workunit.client.0.smithi157.stdout:1/856: dwrite d2/d11/d23/dc9/d64/f85 [4194304,4194304] 0 2024-04-03T08:39:38.644 INFO:tasks.workunit.client.0.smithi157.stdout:5/998: rmdir dc/d29/d56/d9e/dc3/dde/def/dfa 39 2024-04-03T08:39:38.648 INFO:tasks.workunit.client.0.smithi157.stdout:3/971: rename d8/d1e/d2d/d39/d51/d48/dce/f144 to d8/d1e/d2d/f155 0 2024-04-03T08:39:38.649 INFO:tasks.workunit.client.0.smithi157.stdout:6/960: dread d1/d5/d17/d29/d62/d7f/d89/da4/fe1 [0,4194304] 0 2024-04-03T08:39:38.650 INFO:tasks.workunit.client.0.smithi157.stdout:2/919: symlink d3/db/d44/d4c/d5a/d88/l137 0 2024-04-03T08:39:38.660 INFO:tasks.workunit.client.0.smithi157.stdout:7/996: dwrite d0/d11/d15/d17/d1c/df5/f135 [0,4194304] 0 2024-04-03T08:39:38.664 INFO:tasks.workunit.client.0.smithi157.stdout:1/857: symlink d2/d11/d24/l121 0 2024-04-03T08:39:38.666 INFO:tasks.workunit.client.0.smithi157.stdout:7/997: chown d0/d11/d6f/d89/d8c/d103/da5/fb2 42676908 1 2024-04-03T08:39:38.667 INFO:tasks.workunit.client.0.smithi157.stdout:6/961: mkdir d1/d4b/da5/d139/d14a 0 2024-04-03T08:39:38.667 INFO:tasks.workunit.client.0.smithi157.stdout:7/998: readlink d0/d11/l1e 0 2024-04-03T08:39:38.667 INFO:tasks.workunit.client.0.smithi157.stdout:1/858: chown d2/d11/d24/d39/d3b/d1b/lc8 1 1 2024-04-03T08:39:38.672 INFO:tasks.workunit.client.0.smithi157.stdout:3/972: symlink d8/d1e/d2d/d39/d51/d4c/dd6/de0/l156 0 2024-04-03T08:39:38.675 INFO:tasks.workunit.client.0.smithi157.stdout:2/920: rename d3/d2e/d32/d9f/dbd/lc5 to d3/db/d44/d4c/d5a/d88/df6/l138 0 2024-04-03T08:39:38.678 INFO:tasks.workunit.client.0.smithi157.stdout:8/944: write d2/d11/d10/d24/d5b/d2e/d75/d81/f13e [2586895,124201] 0 2024-04-03T08:39:38.678 INFO:tasks.workunit.client.0.smithi157.stdout:5/999: truncate dc/d29/d56/d9e/dc3/dde/de4/d12d/d112/f128 91673 0 2024-04-03T08:39:38.680 INFO:tasks.workunit.client.0.smithi157.stdout:6/962: write d1/d5/d17/d2a/d30/d77/f106 [3814443,6658] 0 2024-04-03T08:39:38.683 INFO:tasks.workunit.client.0.smithi157.stdout:7/999: mkdir d0/d11/d6f/d89/d8c/d103/daf/d159 0 2024-04-03T08:39:38.684 INFO:tasks.workunit.client.0.smithi157.stdout:1/859: creat d2/d11/d23/dc9/da1/ded/f122 x:0 0 0 2024-04-03T08:39:38.685 INFO:tasks.workunit.client.0.smithi157.stdout:4/885: sync 2024-04-03T08:39:38.688 INFO:tasks.workunit.client.0.smithi157.stdout:3/973: rmdir d8/d1e/d2d/d3f/d4d/d8f 39 2024-04-03T08:39:38.689 INFO:tasks.workunit.client.0.smithi157.stdout:4/886: dread - da/df/d24/d35/d53/f10b zero size 2024-04-03T08:39:38.693 INFO:tasks.workunit.client.0.smithi157.stdout:8/945: mkdir d2/d20/db1/d142 0 2024-04-03T08:39:38.707 INFO:tasks.workunit.client.1.smithi181.stdout:8/785: mkdir d4/d45/d96/d103 0 2024-04-03T08:39:38.709 INFO:tasks.workunit.client.0.smithi157.stdout:3/974: readlink d8/d1e/d2d/d39/d51/d4c/d32/lb8 0 2024-04-03T08:39:38.710 INFO:tasks.workunit.client.1.smithi181.stdout:2/933: truncate d13/da7/d27/d2f/d5d/f8c 4661031 0 2024-04-03T08:39:38.712 INFO:tasks.workunit.client.0.smithi157.stdout:4/887: link da/df/d11/f66 da/df/d99/ddb/f131 0 2024-04-03T08:39:38.713 INFO:tasks.workunit.client.0.smithi157.stdout:4/888: chown da/d26/cdf 31835982 1 2024-04-03T08:39:38.714 INFO:tasks.workunit.client.0.smithi157.stdout:8/946: mknod d2/d20/db1/d142/c143 0 2024-04-03T08:39:38.715 INFO:tasks.workunit.client.0.smithi157.stdout:2/921: write d3/f102 [663469,17861] 0 2024-04-03T08:39:38.716 INFO:tasks.workunit.client.1.smithi181.stdout:1/854: sync 2024-04-03T08:39:38.718 INFO:tasks.workunit.client.1.smithi181.stdout:9/889: mknod d1/da/d28/d80/d10d/c117 0 2024-04-03T08:39:38.720 INFO:tasks.workunit.client.0.smithi157.stdout:3/975: fdatasync d8/f2c 0 2024-04-03T08:39:38.721 INFO:tasks.workunit.client.1.smithi181.stdout:7/775: fdatasync d0/d1/f66 0 2024-04-03T08:39:38.727 INFO:tasks.workunit.client.0.smithi157.stdout:6/963: getdents d1/d4b 0 2024-04-03T08:39:38.728 INFO:tasks.workunit.client.1.smithi181.stdout:8/786: dwrite d4/d45/db/d14/fb5 [0,4194304] 0 2024-04-03T08:39:38.728 INFO:tasks.workunit.client.1.smithi181.stdout:6/887: creat d6/d3e/db1/dc4/d10f/dba/da6/f115 x:0 0 0 2024-04-03T08:39:38.733 INFO:tasks.workunit.client.0.smithi157.stdout:8/947: unlink d2/d11/d10/d24/d5b/c61 0 2024-04-03T08:39:38.737 INFO:tasks.workunit.client.0.smithi157.stdout:1/860: dwrite d2/d11/d24/d39/f7c [0,4194304] 0 2024-04-03T08:39:38.739 INFO:tasks.workunit.client.0.smithi157.stdout:2/922: mkdir d3/db/d44/d12c/d55/d139 0 2024-04-03T08:39:38.740 INFO:tasks.workunit.client.1.smithi181.stdout:0/855: dwrite d5/dc/d14/f108 [0,4194304] 0 2024-04-03T08:39:38.742 INFO:tasks.workunit.client.1.smithi181.stdout:0/856: stat d5/dc/d10/fd2 0 2024-04-03T08:39:38.743 INFO:tasks.workunit.client.1.smithi181.stdout:1/855: dread d10/d15/d17/d23/d27/ff9 [0,4194304] 0 2024-04-03T08:39:38.743 INFO:tasks.workunit.client.1.smithi181.stdout:4/899: creat d1/d16/d37/d121/f124 x:0 0 0 2024-04-03T08:39:38.744 INFO:tasks.workunit.client.1.smithi181.stdout:9/890: dread d1/da/d28/d30/d3e/d4e/d62/f108 [0,4194304] 0 2024-04-03T08:39:38.744 INFO:tasks.workunit.client.1.smithi181.stdout:0/857: write d5/dc/d75/fe4 [449800,31355] 0 2024-04-03T08:39:38.745 INFO:tasks.workunit.client.0.smithi157.stdout:3/976: dread d8/d1e/d2d/f137 [0,4194304] 0 2024-04-03T08:39:38.752 INFO:tasks.workunit.client.0.smithi157.stdout:2/923: mknod d3/db/d44/d4c/d5a/c13a 0 2024-04-03T08:39:38.757 INFO:tasks.workunit.client.0.smithi157.stdout:1/861: unlink d2/d11/d24/d39/d3b/c1e 0 2024-04-03T08:39:38.760 INFO:tasks.workunit.client.0.smithi157.stdout:1/862: stat d2/d11/d24/d39/d3b/d2e/d66/fd8 0 2024-04-03T08:39:38.760 INFO:tasks.workunit.client.1.smithi181.stdout:8/787: rmdir d4/d45/db/d14/dd0 39 2024-04-03T08:39:38.763 INFO:tasks.workunit.client.0.smithi157.stdout:3/977: creat d8/d1e/d2d/d3b/d9e/dcd/f157 x:0 0 0 2024-04-03T08:39:38.764 INFO:tasks.workunit.client.1.smithi181.stdout:0/858: dwrite d5/dc/d10/d58/db0/fde [0,4194304] 0 2024-04-03T08:39:38.764 INFO:tasks.workunit.client.0.smithi157.stdout:4/889: dwrite da/df/d24/d35/d6a/d78/fb0 [4194304,4194304] 0 2024-04-03T08:39:38.765 INFO:tasks.workunit.client.1.smithi181.stdout:6/888: symlink d6/d3e/db1/dc4/dc9/l116 0 2024-04-03T08:39:38.768 INFO:tasks.workunit.client.1.smithi181.stdout:1/856: mknod d10/d15/d17/d23/daa/de1/c111 0 2024-04-03T08:39:38.771 INFO:tasks.workunit.client.1.smithi181.stdout:9/891: symlink d1/da/d28/d30/d3e/d4e/da3/l118 0 2024-04-03T08:39:38.771 INFO:tasks.workunit.client.1.smithi181.stdout:5/853: dwrite d4/d44/f5f [0,4194304] 0 2024-04-03T08:39:38.771 INFO:tasks.workunit.client.1.smithi181.stdout:6/889: truncate d6/d3e/d40/fb3 2268955 0 2024-04-03T08:39:38.773 INFO:tasks.workunit.client.1.smithi181.stdout:6/890: stat d6/dc0/d103/lc2 0 2024-04-03T08:39:38.773 INFO:tasks.workunit.client.1.smithi181.stdout:9/892: chown d1/da/d13/d41/c38 0 1 2024-04-03T08:39:38.773 INFO:tasks.workunit.client.0.smithi157.stdout:1/863: creat d2/d11/d24/d39/d3b/d2e/d66/f123 x:0 0 0 2024-04-03T08:39:38.773 INFO:tasks.workunit.client.1.smithi181.stdout:3/901: link d0/d17/d63/df8/l104 d0/d17/d36/d3b/d5a/d93/d105/l12a 0 2024-04-03T08:39:38.777 INFO:tasks.workunit.client.1.smithi181.stdout:9/893: fdatasync d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 0 2024-04-03T08:39:38.779 INFO:tasks.workunit.client.0.smithi157.stdout:4/890: symlink da/df/d24/l132 0 2024-04-03T08:39:38.781 INFO:tasks.workunit.client.1.smithi181.stdout:2/934: write d13/da7/d85/fe5 [85550,130830] 0 2024-04-03T08:39:38.790 INFO:tasks.workunit.client.0.smithi157.stdout:4/891: mkdir da/df/d2f/dbc/dbe/d133 0 2024-04-03T08:39:38.794 INFO:tasks.workunit.client.1.smithi181.stdout:1/857: rmdir d10/da1 39 2024-04-03T08:39:38.795 INFO:tasks.workunit.client.1.smithi181.stdout:3/902: fdatasync d0/d17/f91 0 2024-04-03T08:39:38.796 INFO:tasks.workunit.client.0.smithi157.stdout:8/948: write d2/f39 [1468333,122225] 0 2024-04-03T08:39:38.797 INFO:tasks.workunit.client.1.smithi181.stdout:1/858: readlink d10/d15/d17/d23/d27/l75 0 2024-04-03T08:39:38.799 INFO:tasks.workunit.client.0.smithi157.stdout:3/978: dread d8/d13/d1b/d4e/f99 [0,4194304] 0 2024-04-03T08:39:38.800 INFO:tasks.workunit.client.0.smithi157.stdout:8/949: rmdir d2/d20/df7 39 2024-04-03T08:39:38.801 INFO:tasks.workunit.client.1.smithi181.stdout:1/859: write d10/d15/d17/d30/f7e [4943831,54468] 0 2024-04-03T08:39:38.803 INFO:tasks.workunit.client.1.smithi181.stdout:9/894: write d1/da/d13/d22/d23/de0/f98 [3089301,68503] 0 2024-04-03T08:39:38.803 INFO:tasks.workunit.client.1.smithi181.stdout:7/776: link d0/l8 d0/d115/l11b 0 2024-04-03T08:39:38.805 INFO:tasks.workunit.client.1.smithi181.stdout:4/900: creat d1/f125 x:0 0 0 2024-04-03T08:39:38.808 INFO:tasks.workunit.client.1.smithi181.stdout:3/903: rename d0/d5/d6 to d0/d5/d6/d32/daa/d129/d25/d12b 22 2024-04-03T08:39:38.809 INFO:tasks.workunit.client.1.smithi181.stdout:4/901: chown d1/d1e/d2c/d10e 25383113 1 2024-04-03T08:39:38.812 INFO:tasks.workunit.client.1.smithi181.stdout:0/859: dwrite d5/d9/d2a/f64 [0,4194304] 0 2024-04-03T08:39:38.814 INFO:tasks.workunit.client.0.smithi157.stdout:3/979: rename d8/d1e/d2d/d39/d51/d7e to d8/d13/d1b/d4e/d50/d10a/d158 0 2024-04-03T08:39:38.816 INFO:tasks.workunit.client.0.smithi157.stdout:8/950: symlink d2/d11/d10/d24/l144 0 2024-04-03T08:39:38.818 INFO:tasks.workunit.client.1.smithi181.stdout:2/935: dwrite d13/fc1 [0,4194304] 0 2024-04-03T08:39:38.824 INFO:tasks.workunit.client.1.smithi181.stdout:7/777: unlink d0/d1/d6/de/d17/d64/le1 0 2024-04-03T08:39:38.834 INFO:tasks.workunit.client.0.smithi157.stdout:3/980: unlink d8/d1e/d2d/d39/d51/d4c/d32/f42 0 2024-04-03T08:39:38.835 INFO:tasks.workunit.client.1.smithi181.stdout:3/904: mknod d0/d17/d63/db7/c12c 0 2024-04-03T08:39:38.836 INFO:tasks.workunit.client.0.smithi157.stdout:2/924: dwrite d3/d12/f7c [0,4194304] 0 2024-04-03T08:39:38.837 INFO:tasks.workunit.client.1.smithi181.stdout:3/905: stat d0/d17/d36/d1e/f7e 0 2024-04-03T08:39:38.837 INFO:tasks.workunit.client.0.smithi157.stdout:3/981: dread - d8/d13/d1b/d5b/d7f/f14c zero size 2024-04-03T08:39:38.838 INFO:tasks.workunit.client.1.smithi181.stdout:4/902: creat d1/d1e/d2c/de4/df7/f126 x:0 0 0 2024-04-03T08:39:38.846 INFO:tasks.workunit.client.1.smithi181.stdout:8/788: truncate d4/d45/db/f3a 3142684 0 2024-04-03T08:39:38.850 INFO:tasks.workunit.client.1.smithi181.stdout:5/854: write d4/d44/f92 [308393,46481] 0 2024-04-03T08:39:38.852 INFO:tasks.workunit.client.1.smithi181.stdout:7/778: mknod d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/c11c 0 2024-04-03T08:39:38.854 INFO:tasks.workunit.client.1.smithi181.stdout:0/860: mknod d5/c117 0 2024-04-03T08:39:38.856 INFO:tasks.workunit.client.1.smithi181.stdout:6/891: dwrite d6/d3e/d40/f4e [4194304,4194304] 0 2024-04-03T08:39:38.856 INFO:tasks.workunit.client.0.smithi157.stdout:4/892: dwrite da/df/d2f/d64/f81 [4194304,4194304] 0 2024-04-03T08:39:38.859 INFO:tasks.workunit.client.1.smithi181.stdout:1/860: link d10/f16 d10/df6/f112 0 2024-04-03T08:39:38.859 INFO:tasks.workunit.client.1.smithi181.stdout:2/936: mknod d13/da7/d40/c156 0 2024-04-03T08:39:38.861 INFO:tasks.workunit.client.0.smithi157.stdout:8/951: dread d2/f39 [0,4194304] 0 2024-04-03T08:39:38.862 INFO:tasks.workunit.client.1.smithi181.stdout:2/937: stat d13/f12e 0 2024-04-03T08:39:38.865 INFO:tasks.workunit.client.1.smithi181.stdout:5/855: chown d4/d18/d25/l4c 6887199 1 2024-04-03T08:39:38.866 INFO:tasks.workunit.client.1.smithi181.stdout:3/906: dwrite d0/d17/d36/d3b/f109 [0,4194304] 0 2024-04-03T08:39:38.867 INFO:tasks.workunit.client.1.smithi181.stdout:2/938: write d13/da7/d27/f114 [3094064,28688] 0 2024-04-03T08:39:38.871 INFO:tasks.workunit.client.0.smithi157.stdout:2/925: dread d3/f6c [0,4194304] 0 2024-04-03T08:39:38.872 INFO:tasks.workunit.client.1.smithi181.stdout:8/789: dwrite d4/f88 [0,4194304] 0 2024-04-03T08:39:38.873 INFO:tasks.workunit.client.1.smithi181.stdout:4/903: link d1/d16/d24/d5e/d2b/d56/f7e d1/d16/d37/d34/d86/ded/dfa/f127 0 2024-04-03T08:39:38.879 INFO:tasks.workunit.client.1.smithi181.stdout:1/861: mkdir d10/d69/dd1/d113 0 2024-04-03T08:39:38.884 INFO:tasks.workunit.client.1.smithi181.stdout:8/790: truncate d4/d45/db/d14/d31/d1c/d51/d87/db1/ffa 727948 0 2024-04-03T08:39:38.886 INFO:tasks.workunit.client.1.smithi181.stdout:1/862: write d10/d15/d17/d19/d33/fa0 [4731795,119200] 0 2024-04-03T08:39:38.890 INFO:tasks.workunit.client.1.smithi181.stdout:7/779: truncate d0/f9f 333446 0 2024-04-03T08:39:38.904 INFO:tasks.workunit.client.1.smithi181.stdout:9/895: write d1/da/d13/d41/f2a [2652731,6696] 0 2024-04-03T08:39:38.904 INFO:tasks.workunit.client.1.smithi181.stdout:3/907: symlink d0/d17/d36/d1e/l12d 0 2024-04-03T08:39:38.907 INFO:tasks.workunit.client.1.smithi181.stdout:4/904: fdatasync d1/d16/d24/d5e/d31/d39/fbb 0 2024-04-03T08:39:38.912 INFO:tasks.workunit.client.1.smithi181.stdout:6/892: truncate d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f6d 617494 0 2024-04-03T08:39:38.913 INFO:tasks.workunit.client.1.smithi181.stdout:0/861: write d5/dc/f1e [734808,98697] 0 2024-04-03T08:39:38.919 INFO:tasks.workunit.client.1.smithi181.stdout:3/908: rename d0/d5/f33 to d0/d5/d6/d3f/f12e 0 2024-04-03T08:39:38.924 INFO:tasks.workunit.client.1.smithi181.stdout:9/896: creat d1/da/d13/d22/d23/d36/d9c/f119 x:0 0 0 2024-04-03T08:39:38.925 INFO:tasks.workunit.client.1.smithi181.stdout:7/780: dread d0/d1/d6/de/d17/d64/f81 [0,4194304] 0 2024-04-03T08:39:38.927 INFO:tasks.workunit.client.1.smithi181.stdout:4/905: chown d1/d16/d24/d5e/d2b/db9/fe7 25453 1 2024-04-03T08:39:38.927 INFO:tasks.workunit.client.1.smithi181.stdout:9/897: fdatasync d1/da/d13/d22/d23/d36/d91/d9d/d39/f59 0 2024-04-03T08:39:38.930 INFO:tasks.workunit.client.1.smithi181.stdout:4/906: fsync d1/d16/d24/d5e/d3f/d6c/dcd/fff 0 2024-04-03T08:39:38.931 INFO:tasks.workunit.client.1.smithi181.stdout:6/893: fsync d6/dc0/fc5 0 2024-04-03T08:39:38.934 INFO:tasks.workunit.client.1.smithi181.stdout:6/894: chown d6/d53/f94 3745 1 2024-04-03T08:39:38.936 INFO:tasks.workunit.client.1.smithi181.stdout:0/862: fsync d5/d9/f1d 0 2024-04-03T08:39:38.938 INFO:tasks.workunit.client.1.smithi181.stdout:3/909: rename d0/dbc/l11f to d0/d17/d56/l12f 0 2024-04-03T08:39:38.942 INFO:tasks.workunit.client.1.smithi181.stdout:2/939: dwrite d13/fd4 [0,4194304] 0 2024-04-03T08:39:38.943 INFO:tasks.workunit.client.1.smithi181.stdout:8/791: creat d4/d45/d9/f104 x:0 0 0 2024-04-03T08:39:38.943 INFO:tasks.workunit.client.1.smithi181.stdout:3/910: write d0/d5/d6f/fe3 [2828067,93106] 0 2024-04-03T08:39:38.946 INFO:tasks.workunit.client.1.smithi181.stdout:5/856: dwrite d4/d18/d55/db4/d96/fb1 [0,4194304] 0 2024-04-03T08:39:38.947 INFO:tasks.workunit.client.1.smithi181.stdout:3/911: chown d0/d17/d63/dd6 8903 1 2024-04-03T08:39:38.953 INFO:tasks.workunit.client.1.smithi181.stdout:9/898: symlink d1/da/d13/d41/d65/l11a 0 2024-04-03T08:39:38.954 INFO:tasks.workunit.client.1.smithi181.stdout:1/863: creat d10/d15/d17/f114 x:0 0 0 2024-04-03T08:39:38.957 INFO:tasks.workunit.client.1.smithi181.stdout:4/907: mknod d1/d16/d24/d5e/d31/d39/da1/df8/c128 0 2024-04-03T08:39:38.961 INFO:tasks.workunit.client.0.smithi157.stdout:3/982: rename d8/d13/d1b/d4e/d50/d10a/d158/db1/df5/f127 to d8/d13/d1b/d83/f159 0 2024-04-03T08:39:38.961 INFO:tasks.workunit.client.1.smithi181.stdout:0/863: dwrite d5/d9/d2a/da1/da8/fdf [0,4194304] 0 2024-04-03T08:39:38.963 INFO:tasks.workunit.client.1.smithi181.stdout:0/864: fdatasync d5/dc/d10/d30/f6f 0 2024-04-03T08:39:38.967 INFO:tasks.workunit.client.1.smithi181.stdout:0/865: truncate d5/d9/d2a/de6/ff9 858530 0 2024-04-03T08:39:38.969 INFO:tasks.workunit.client.0.smithi157.stdout:8/952: fsync d2/d11/d10/d24/d5b/d2e/d75/f85 0 2024-04-03T08:39:38.971 INFO:tasks.workunit.client.1.smithi181.stdout:6/895: write d6/d53/d80/fe2 [4746063,21711] 0 2024-04-03T08:39:38.977 INFO:tasks.workunit.client.0.smithi157.stdout:4/893: dread da/df/d6b/f94 [0,4194304] 0 2024-04-03T08:39:38.982 INFO:tasks.workunit.client.1.smithi181.stdout:2/940: chown lc 3 1 2024-04-03T08:39:38.983 INFO:tasks.workunit.client.0.smithi157.stdout:3/983: creat d8/d13/d1b/d4e/d50/d10a/f15a x:0 0 0 2024-04-03T08:39:38.984 INFO:tasks.workunit.client.1.smithi181.stdout:7/781: creat d0/d1/d6/de/d17/d64/d85/d9a/d109/f11d x:0 0 0 2024-04-03T08:39:38.986 INFO:tasks.workunit.client.0.smithi157.stdout:3/984: fsync d8/d1e/d2d/d39/d51/d48/dce/fcf 0 2024-04-03T08:39:38.989 INFO:tasks.workunit.client.0.smithi157.stdout:8/953: read d2/d11/d10/fe9 [398035,7443] 0 2024-04-03T08:39:38.989 INFO:tasks.workunit.client.1.smithi181.stdout:3/912: symlink d0/d17/d36/d3b/d102/l130 0 2024-04-03T08:39:38.991 INFO:tasks.workunit.client.0.smithi157.stdout:2/926: fdatasync d3/d12/ff0 0 2024-04-03T08:39:38.992 INFO:tasks.workunit.client.1.smithi181.stdout:5/857: symlink d4/d18/d25/d68/d77/l118 0 2024-04-03T08:39:38.993 INFO:tasks.workunit.client.0.smithi157.stdout:4/894: mknod da/df/d11/df9/c134 0 2024-04-03T08:39:38.996 INFO:tasks.workunit.client.0.smithi157.stdout:3/985: dread d8/d13/d1b/d83/fea [0,4194304] 0 2024-04-03T08:39:38.998 INFO:tasks.workunit.client.0.smithi157.stdout:8/954: symlink d2/d20/db1/dbc/l145 0 2024-04-03T08:39:39.000 INFO:tasks.workunit.client.1.smithi181.stdout:9/899: rename d1/da/d28/d30/d3e/fa5 to d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/db2/d10b/f11b 0 2024-04-03T08:39:39.004 INFO:tasks.workunit.client.0.smithi157.stdout:4/895: fsync da/df/d24/d35/d3c/f71 0 2024-04-03T08:39:39.007 INFO:tasks.workunit.client.0.smithi157.stdout:4/896: fsync da/df/d24/d35/d53/f10b 0 2024-04-03T08:39:39.011 INFO:tasks.workunit.client.0.smithi157.stdout:2/927: symlink d3/db/l13b 0 2024-04-03T08:39:39.014 INFO:tasks.workunit.client.1.smithi181.stdout:8/792: symlink d4/d45/db/d14/dd0/l105 0 2024-04-03T08:39:39.017 INFO:tasks.workunit.client.1.smithi181.stdout:3/913: truncate d0/d17/f91 562024 0 2024-04-03T08:39:39.020 INFO:tasks.workunit.client.1.smithi181.stdout:5/858: creat d4/d18/d55/d5a/f119 x:0 0 0 2024-04-03T08:39:39.020 INFO:tasks.workunit.client.1.smithi181.stdout:3/914: read d0/d17/d63/d81/fa1 [3185261,61451] 0 2024-04-03T08:39:39.022 INFO:tasks.workunit.client.1.smithi181.stdout:1/864: fdatasync d10/da1/fb1 0 2024-04-03T08:39:39.028 INFO:tasks.workunit.client.0.smithi157.stdout:2/928: mkdir d3/db/d44/d12c/d55/d139/d13c 0 2024-04-03T08:39:39.029 INFO:tasks.workunit.client.1.smithi181.stdout:2/941: rename d13/d1c/d4a/d7f/db3/dbf/dd8 to d13/d1c/d73/d13f/d157 0 2024-04-03T08:39:39.033 INFO:tasks.workunit.client.1.smithi181.stdout:4/908: mknod d1/d16/d24/d61/df6/c129 0 2024-04-03T08:39:39.034 INFO:tasks.workunit.client.0.smithi157.stdout:3/986: dread d8/d13/d1b/d4e/f119 [0,4194304] 0 2024-04-03T08:39:39.034 INFO:tasks.workunit.client.0.smithi157.stdout:2/929: fsync d3/d12/f11 0 2024-04-03T08:39:39.036 INFO:tasks.workunit.client.0.smithi157.stdout:8/955: write d2/d20/db1/dbc/f134 [2031433,32653] 0 2024-04-03T08:39:39.037 INFO:tasks.workunit.client.1.smithi181.stdout:6/896: mknod d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/dfd/c117 0 2024-04-03T08:39:39.042 INFO:tasks.workunit.client.0.smithi157.stdout:4/897: dread da/df/d2f/d64/d8f/dbd/d68/dce/fea [0,4194304] 0 2024-04-03T08:39:39.043 INFO:tasks.workunit.client.1.smithi181.stdout:8/793: unlink d4/d45/db/d14/d31/d1c/d51/c9e 0 2024-04-03T08:39:39.048 INFO:tasks.workunit.client.0.smithi157.stdout:2/930: symlink d3/db/d44/d4c/d5a/d88/l13d 0 2024-04-03T08:39:39.049 INFO:tasks.workunit.client.1.smithi181.stdout:5/859: creat d4/d18/d25/db0/f11a x:0 0 0 2024-04-03T08:39:39.050 INFO:tasks.workunit.client.0.smithi157.stdout:4/898: rmdir da/df/d2f/d54 39 2024-04-03T08:39:39.054 INFO:tasks.workunit.client.0.smithi157.stdout:8/956: write d2/d6f/d70/f7e [3108333,30828] 0 2024-04-03T08:39:39.058 INFO:tasks.workunit.client.1.smithi181.stdout:4/909: creat d1/d16/d24/d61/df6/f12a x:0 0 0 2024-04-03T08:39:39.060 INFO:tasks.workunit.client.0.smithi157.stdout:3/987: dwrite d8/d13/d1b/d4e/d50/d10a/d158/fa4 [0,4194304] 0 2024-04-03T08:39:39.060 INFO:tasks.workunit.client.1.smithi181.stdout:9/900: creat d1/da/d13/deb/f11c x:0 0 0 2024-04-03T08:39:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:38 smithi157 ceph-mon[35083]: pgmap v16: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 80 MiB/s rd, 163 MiB/s wr, 391 op/s 2024-04-03T08:39:39.064 INFO:tasks.workunit.client.1.smithi181.stdout:9/901: stat d1/da/d13/d41/daf 0 2024-04-03T08:39:39.069 INFO:tasks.workunit.client.0.smithi157.stdout:3/988: mkdir d8/d1e/d2d/d3b/d8c/df1/d15b 0 2024-04-03T08:39:39.072 INFO:tasks.workunit.client.0.smithi157.stdout:2/931: getdents d3/db/d44/d4c/d5a/d88/df6 0 2024-04-03T08:39:39.078 INFO:tasks.workunit.client.0.smithi157.stdout:4/899: write da/df/d2f/d54/d5f/fd7 [3344350,7406] 0 2024-04-03T08:39:39.080 INFO:tasks.workunit.client.0.smithi157.stdout:4/900: stat da 0 2024-04-03T08:39:39.081 INFO:tasks.workunit.client.1.smithi181.stdout:8/794: write d4/d45/db/d14/d31/d1c/d51/f52 [3749201,18501] 0 2024-04-03T08:39:39.082 INFO:tasks.workunit.client.1.smithi181.stdout:4/910: creat d1/d16/d24/d5e/d31/d39/da1/df8/f12b x:0 0 0 2024-04-03T08:39:39.083 INFO:tasks.workunit.client.0.smithi157.stdout:4/901: chown da/f6f 136 1 2024-04-03T08:39:39.084 INFO:tasks.workunit.client.0.smithi157.stdout:2/932: mknod d3/dab/c13e 0 2024-04-03T08:39:39.085 INFO:tasks.workunit.client.0.smithi157.stdout:8/957: dwrite d2/d20/d23/f5c [0,4194304] 0 2024-04-03T08:39:39.085 INFO:tasks.workunit.client.1.smithi181.stdout:7/782: getdents d0/d1/d6/de/d17/d27/d93 0 2024-04-03T08:39:39.085 INFO:tasks.workunit.client.1.smithi181.stdout:0/866: link d5/dc/d10/d58/dba/l6e d5/dc/d10/d30/l118 0 2024-04-03T08:39:39.089 INFO:tasks.workunit.client.1.smithi181.stdout:4/911: fsync d1/d16/d24/d5e/d3f/d6c/dcd/ffc 0 2024-04-03T08:39:39.089 INFO:tasks.workunit.client.0.smithi157.stdout:2/933: unlink d3/db/fa1 0 2024-04-03T08:39:39.090 INFO:tasks.workunit.client.1.smithi181.stdout:0/867: fdatasync d5/d9/d2a/de6/fad 0 2024-04-03T08:39:39.090 INFO:tasks.workunit.client.1.smithi181.stdout:6/897: mkdir d6/d118 0 2024-04-03T08:39:39.090 INFO:tasks.workunit.client.0.smithi157.stdout:8/958: fdatasync d2/d11/d10/d24/d5b/d2e/d75/d81/df0/d119/f140 0 2024-04-03T08:39:39.092 INFO:tasks.workunit.client.0.smithi157.stdout:4/902: symlink da/df/d99/d107/l135 0 2024-04-03T08:39:39.093 INFO:tasks.workunit.client.1.smithi181.stdout:3/915: creat d0/d5/d6/d32/daa/d129/d25/f131 x:0 0 0 2024-04-03T08:39:39.093 INFO:tasks.workunit.client.1.smithi181.stdout:8/795: rename d4/d45/db/d14/f50 to d4/d45/dae/f106 0 2024-04-03T08:39:39.096 INFO:tasks.workunit.client.1.smithi181.stdout:5/860: dread d4/d18/d25/d68/f107 [0,4194304] 0 2024-04-03T08:39:39.096 INFO:tasks.workunit.client.0.smithi157.stdout:4/903: chown da/df/d24/d35/d6a/d78/f7a 1 1 2024-04-03T08:39:39.097 INFO:tasks.workunit.client.0.smithi157.stdout:8/959: fsync d2/d20/d77/f10c 0 2024-04-03T08:39:39.097 INFO:tasks.workunit.client.0.smithi157.stdout:3/989: dwrite d8/d13/d1b/d4e/da6/f89 [0,4194304] 0 2024-04-03T08:39:39.098 INFO:tasks.workunit.client.1.smithi181.stdout:9/902: truncate d1/da/d28/f64 528301 0 2024-04-03T08:39:39.100 INFO:tasks.workunit.client.1.smithi181.stdout:7/783: unlink d0/d1/d94/fe7 0 2024-04-03T08:39:39.102 INFO:tasks.workunit.client.1.smithi181.stdout:1/865: getdents d10/df6 0 2024-04-03T08:39:39.104 INFO:tasks.workunit.client.1.smithi181.stdout:4/912: mkdir d1/d16/d24/d5e/d31/dba/ddd/d12c 0 2024-04-03T08:39:39.105 INFO:tasks.workunit.client.1.smithi181.stdout:5/861: truncate d4/d18/d55/d5a/dcd/dee/f101 1373 0 2024-04-03T08:39:39.110 INFO:tasks.workunit.client.1.smithi181.stdout:4/913: fdatasync d1/d16/d37/d34/d69/fd0 0 2024-04-03T08:39:39.113 INFO:tasks.workunit.client.1.smithi181.stdout:8/796: mkdir d4/d45/db/d14/d31/d1c/d51/d87/db1/d107 0 2024-04-03T08:39:39.113 INFO:tasks.workunit.client.1.smithi181.stdout:2/942: dwrite d13/f41 [0,4194304] 0 2024-04-03T08:39:39.116 INFO:tasks.workunit.client.0.smithi157.stdout:4/904: truncate da/df/d2f/d64/f7b 294987 0 2024-04-03T08:39:39.118 INFO:tasks.workunit.client.1.smithi181.stdout:7/784: rename d0/c1e to d0/d1/d94/c11e 0 2024-04-03T08:39:39.120 INFO:tasks.workunit.client.0.smithi157.stdout:2/934: creat d3/d2e/d32/d9f/f13f x:0 0 0 2024-04-03T08:39:39.123 INFO:tasks.workunit.client.1.smithi181.stdout:3/916: symlink d0/d17/l132 0 2024-04-03T08:39:39.123 INFO:tasks.workunit.client.1.smithi181.stdout:7/785: write d0/d1/d6/de/d17/f116 [354250,17320] 0 2024-04-03T08:39:39.125 INFO:tasks.workunit.client.0.smithi157.stdout:8/960: creat d2/d20/d77/d13c/f146 x:0 0 0 2024-04-03T08:39:39.134 INFO:tasks.workunit.client.0.smithi157.stdout:2/935: truncate d3/d12/d43/f78 2812564 0 2024-04-03T08:39:39.136 INFO:tasks.workunit.client.0.smithi157.stdout:1/864: sync 2024-04-03T08:39:39.136 INFO:tasks.workunit.client.0.smithi157.stdout:6/964: sync 2024-04-03T08:39:39.136 INFO:tasks.workunit.client.1.smithi181.stdout:4/914: read d1/d1e/d82/fdf [109765,50646] 0 2024-04-03T08:39:39.144 INFO:tasks.workunit.client.0.smithi157.stdout:2/936: readlink d3/l26 0 2024-04-03T08:39:39.146 INFO:tasks.workunit.client.1.smithi181.stdout:7/786: creat d0/d1/d6/f11f x:0 0 0 2024-04-03T08:39:39.148 INFO:tasks.workunit.client.1.smithi181.stdout:3/917: dread d0/d17/d36/fb8 [0,4194304] 0 2024-04-03T08:39:39.149 INFO:tasks.workunit.client.1.smithi181.stdout:1/866: unlink d10/d15/d17/d19/d33/d70/ld6 0 2024-04-03T08:39:39.151 INFO:tasks.workunit.client.0.smithi157.stdout:3/990: write d8/d1e/d2d/d3b/d8c/f96 [87419,63840] 0 2024-04-03T08:39:39.152 INFO:tasks.workunit.client.1.smithi181.stdout:9/903: dwrite d1/da/d13/d41/d32/fe6 [0,4194304] 0 2024-04-03T08:39:39.153 INFO:tasks.workunit.client.0.smithi157.stdout:4/905: write da/d26/f5e [4505036,40436] 0 2024-04-03T08:39:39.154 INFO:tasks.workunit.client.1.smithi181.stdout:1/867: stat d10/d15/d4a/d6f/l9a 0 2024-04-03T08:39:39.155 INFO:tasks.workunit.client.1.smithi181.stdout:8/797: dread d4/d2a/fc4 [0,4194304] 0 2024-04-03T08:39:39.155 INFO:tasks.workunit.client.0.smithi157.stdout:6/965: dread d1/d5/d17/d2a/d37/dca/d132/f146 [0,4194304] 0 2024-04-03T08:39:39.159 INFO:tasks.workunit.client.0.smithi157.stdout:8/961: getdents d2/d6f/d70 0 2024-04-03T08:39:39.159 INFO:tasks.workunit.client.0.smithi157.stdout:4/906: readlink da/df/d24/d35/l8a 0 2024-04-03T08:39:39.162 INFO:tasks.workunit.client.1.smithi181.stdout:4/915: unlink d1/d16/d24/d5e/d31/d39/d5d/lb6 0 2024-04-03T08:39:39.164 INFO:tasks.workunit.client.0.smithi157.stdout:1/865: dread d2/d11/d23/f79 [0,4194304] 0 2024-04-03T08:39:39.166 INFO:tasks.workunit.client.1.smithi181.stdout:3/918: stat d0/d17/d36/c3c 0 2024-04-03T08:39:39.170 INFO:tasks.workunit.client.0.smithi157.stdout:3/991: creat d8/d13/d1b/d4e/d50/d7c/f15c x:0 0 0 2024-04-03T08:39:39.171 INFO:tasks.workunit.client.1.smithi181.stdout:9/904: unlink d1/da/d13/f3d 0 2024-04-03T08:39:39.172 INFO:tasks.workunit.client.0.smithi157.stdout:3/992: stat d8/d13/d1b/f143 0 2024-04-03T08:39:39.177 INFO:tasks.workunit.client.0.smithi157.stdout:3/993: read d8/f28 [1250021,120925] 0 2024-04-03T08:39:39.177 INFO:tasks.workunit.client.1.smithi181.stdout:2/943: write d13/da7/d40/fbb [16594,43975] 0 2024-04-03T08:39:39.178 INFO:tasks.workunit.client.0.smithi157.stdout:3/994: chown f4 432526 1 2024-04-03T08:39:39.180 INFO:tasks.workunit.client.1.smithi181.stdout:3/919: chown d0/d5/d6/c12 1119 1 2024-04-03T08:39:39.180 INFO:tasks.workunit.client.1.smithi181.stdout:5/862: dwrite d4/d56/f75 [0,4194304] 0 2024-04-03T08:39:39.181 INFO:tasks.workunit.client.0.smithi157.stdout:2/937: dwrite d3/db/f2a [0,4194304] 0 2024-04-03T08:39:39.185 INFO:tasks.workunit.client.1.smithi181.stdout:1/868: fsync d10/f16 0 2024-04-03T08:39:39.190 INFO:tasks.workunit.client.1.smithi181.stdout:8/798: dread d4/d45/db/f58 [0,4194304] 0 2024-04-03T08:39:39.194 INFO:tasks.workunit.client.1.smithi181.stdout:8/799: stat d4/d45/db/d14/d31/d1c/d51/d87/de0 0 2024-04-03T08:39:39.213 INFO:tasks.workunit.client.1.smithi181.stdout:8/800: dwrite d4/d45/db/d14/f62 [0,4194304] 0 2024-04-03T08:39:39.215 INFO:tasks.workunit.client.1.smithi181.stdout:8/801: stat d4/f27 0 2024-04-03T08:39:39.218 INFO:tasks.workunit.client.1.smithi181.stdout:9/905: dread d1/da/d13/d22/d23/fff [0,4194304] 0 2024-04-03T08:39:39.251 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:38 smithi181 ceph-mon[44183]: pgmap v16: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 80 MiB/s rd, 163 MiB/s wr, 391 op/s 2024-04-03T08:39:39.256 INFO:tasks.workunit.client.1.smithi181.stdout:7/787: getdents d0/d1/d6 0 2024-04-03T08:39:39.258 INFO:tasks.workunit.client.1.smithi181.stdout:7/788: write d0/d1/d94/ff0 [229305,8689] 0 2024-04-03T08:39:39.294 INFO:tasks.workunit.client.1.smithi181.stdout:0/868: sync 2024-04-03T08:39:39.294 INFO:tasks.workunit.client.1.smithi181.stdout:6/898: sync 2024-04-03T08:39:39.297 INFO:tasks.workunit.client.1.smithi181.stdout:6/899: write d6/d3e/db1/dc4/d10f/f44 [2830349,19178] 0 2024-04-03T08:39:39.329 INFO:tasks.workunit.client.0.smithi157.stdout:3/995: mkdir d8/d13/d1b/d5b/d7f/d129/d15d 0 2024-04-03T08:39:39.332 INFO:tasks.workunit.client.0.smithi157.stdout:3/996: readlink d8/d13/d1b/d4e/d50/d7c/dd8/d10d/l11f 0 2024-04-03T08:39:39.335 INFO:tasks.workunit.client.0.smithi157.stdout:8/962: write d2/fb [4544400,22714] 0 2024-04-03T08:39:39.340 INFO:tasks.workunit.client.1.smithi181.stdout:2/944: write d13/da7/d85/dbd/fce [1627741,119100] 0 2024-04-03T08:39:39.354 INFO:tasks.workunit.client.0.smithi157.stdout:8/963: mkdir d2/d20/db1/d142/d147 0 2024-04-03T08:39:39.355 INFO:tasks.workunit.client.1.smithi181.stdout:9/906: dwrite d1/da/d28/d30/d3e/d4e/d62/fe8 [0,4194304] 0 2024-04-03T08:39:39.355 INFO:tasks.workunit.client.1.smithi181.stdout:2/945: dwrite d13/fd4 [0,4194304] 0 2024-04-03T08:39:39.360 INFO:tasks.workunit.client.0.smithi157.stdout:2/938: link d3/d12/d43/l82 d3/db/d44/d4c/d126/l140 0 2024-04-03T08:39:39.365 INFO:tasks.workunit.client.1.smithi181.stdout:9/907: dread d1/da/d13/d22/f3b [0,4194304] 0 2024-04-03T08:39:39.368 INFO:tasks.workunit.client.0.smithi157.stdout:8/964: creat d2/d20/db1/d111/f148 x:0 0 0 2024-04-03T08:39:39.370 INFO:tasks.workunit.client.1.smithi181.stdout:6/900: readlink d6/d3e/db1/dc4/d10f/dba/da6/l32 0 2024-04-03T08:39:39.374 INFO:tasks.workunit.client.1.smithi181.stdout:6/901: chown d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/dd9/lf2 51118 1 2024-04-03T08:39:39.383 INFO:tasks.workunit.client.1.smithi181.stdout:4/916: write d1/d16/d24/d5e/d31/d39/d5d/d9a/f117 [751860,123185] 0 2024-04-03T08:39:39.384 INFO:tasks.workunit.client.1.smithi181.stdout:4/917: dread - d1/f125 zero size 2024-04-03T08:39:39.386 INFO:tasks.workunit.client.1.smithi181.stdout:4/918: chown d1/d16/d24/d5e/d3f 10331 1 2024-04-03T08:39:39.388 INFO:tasks.workunit.client.0.smithi157.stdout:8/965: creat d2/d20/d23/f149 x:0 0 0 2024-04-03T08:39:39.391 INFO:tasks.workunit.client.1.smithi181.stdout:3/920: mknod d0/d17/d63/df8/d106/c133 0 2024-04-03T08:39:39.392 INFO:tasks.workunit.client.0.smithi157.stdout:8/966: chown d2/d6f/d70/d89/d59/f133 32 1 2024-04-03T08:39:39.393 INFO:tasks.workunit.client.1.smithi181.stdout:3/921: dread - d0/d5/d6/f89 zero size 2024-04-03T08:39:39.394 INFO:tasks.workunit.client.0.smithi157.stdout:2/939: truncate d3/f84 392002 0 2024-04-03T08:39:39.402 INFO:tasks.workunit.client.1.smithi181.stdout:4/919: dwrite d1/d16/d24/d5e/d31/d39/d5d/d9a/f117 [0,4194304] 0 2024-04-03T08:39:39.408 INFO:tasks.workunit.client.1.smithi181.stdout:2/946: mknod d13/d1c/d4a/d7f/db3/d8f/c158 0 2024-04-03T08:39:39.411 INFO:tasks.workunit.client.1.smithi181.stdout:6/902: mknod d6/df6/c119 0 2024-04-03T08:39:39.415 INFO:tasks.workunit.client.1.smithi181.stdout:6/903: dread d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/f61 [0,4194304] 0 2024-04-03T08:39:39.421 INFO:tasks.workunit.client.1.smithi181.stdout:4/920: rmdir d1/d16/d37/d34/d85 39 2024-04-03T08:39:39.423 INFO:tasks.workunit.client.1.smithi181.stdout:2/947: creat d13/d1c/d4a/d7f/db3/d81/f159 x:0 0 0 2024-04-03T08:39:39.425 INFO:tasks.workunit.client.1.smithi181.stdout:9/908: truncate d1/da/f5a 3945588 0 2024-04-03T08:39:39.427 INFO:tasks.workunit.client.0.smithi157.stdout:1/866: rename d2/d11/d23/dc9/d58/d62/l10e to d2/d11/l124 0 2024-04-03T08:39:39.430 INFO:tasks.workunit.client.1.smithi181.stdout:6/904: dwrite d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d5b/f6a [0,4194304] 0 2024-04-03T08:39:39.442 INFO:tasks.workunit.client.1.smithi181.stdout:9/909: chown d1/da/d13/d22/fca 20 1 2024-04-03T08:39:39.442 INFO:tasks.workunit.client.1.smithi181.stdout:6/905: creat d6/d3e/d40/dbc/f11a x:0 0 0 2024-04-03T08:39:39.443 INFO:tasks.workunit.client.1.smithi181.stdout:0/869: creat d5/dc/d10/f119 x:0 0 0 2024-04-03T08:39:39.444 INFO:tasks.workunit.client.1.smithi181.stdout:9/910: read d1/da/d13/d22/d23/de0/f98 [1361954,78836] 0 2024-04-03T08:39:39.444 INFO:tasks.workunit.client.1.smithi181.stdout:4/921: creat d1/dce/f12d x:0 0 0 2024-04-03T08:39:39.448 INFO:tasks.workunit.client.1.smithi181.stdout:2/948: link d13/d1c/f99 d13/da7/d85/dbd/f15a 0 2024-04-03T08:39:39.449 INFO:tasks.workunit.client.1.smithi181.stdout:2/949: chown d13/d1c/d73/f150 2067258677 1 2024-04-03T08:39:39.453 INFO:tasks.workunit.client.1.smithi181.stdout:4/922: chown d1/d16/d24/d5e/d31/d39/d5d/d107 1112658 1 2024-04-03T08:39:39.456 INFO:tasks.workunit.client.1.smithi181.stdout:6/906: symlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/l11b 0 2024-04-03T08:39:39.459 INFO:tasks.workunit.client.0.smithi157.stdout:1/867: dread d2/d11/d24/d39/d3b/d1b/d7f/fa7 [0,4194304] 0 2024-04-03T08:39:39.460 INFO:tasks.workunit.client.1.smithi181.stdout:6/907: symlink d6/d3e/d40/dbc/l11c 0 2024-04-03T08:39:39.461 INFO:tasks.workunit.client.1.smithi181.stdout:4/923: dread d1/d16/d24/d5e/d3f/d81/f99 [0,4194304] 0 2024-04-03T08:39:39.463 INFO:tasks.workunit.client.1.smithi181.stdout:0/870: getdents d5/dc/d8e/dea 0 2024-04-03T08:39:39.465 INFO:tasks.workunit.client.1.smithi181.stdout:2/950: link d13/da7/d27/d2f/f9e d13/da7/d27/d2f/dae/d139/f15b 0 2024-04-03T08:39:39.470 INFO:tasks.workunit.client.1.smithi181.stdout:6/908: symlink d6/d3e/db1/l11d 0 2024-04-03T08:39:39.471 INFO:tasks.workunit.client.1.smithi181.stdout:2/951: truncate d13/d1c/d6c/d111/f115 348006 0 2024-04-03T08:39:39.473 INFO:tasks.workunit.client.1.smithi181.stdout:6/909: mkdir d6/d11e 0 2024-04-03T08:39:39.477 INFO:tasks.workunit.client.1.smithi181.stdout:6/910: mkdir d6/d53/d8d/d97/db0/d11f 0 2024-04-03T08:39:39.479 INFO:tasks.workunit.client.1.smithi181.stdout:8/802: rename d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/fc0 to d4/d2a/d37/f108 0 2024-04-03T08:39:39.483 INFO:tasks.workunit.client.1.smithi181.stdout:0/871: dread d5/d9/d2a/f4f [0,4194304] 0 2024-04-03T08:39:39.487 INFO:tasks.workunit.client.1.smithi181.stdout:2/952: dwrite d13/d1c/d4a/d7f/dcb/f12d [0,4194304] 0 2024-04-03T08:39:39.488 INFO:tasks.workunit.client.1.smithi181.stdout:8/803: creat d4/d45/db/d14/d31/d1c/de8/f109 x:0 0 0 2024-04-03T08:39:39.489 INFO:tasks.workunit.client.1.smithi181.stdout:8/804: chown d4/fd8 16079 1 2024-04-03T08:39:39.494 INFO:tasks.workunit.client.1.smithi181.stdout:2/953: dread d13/d1c/d73/fb0 [0,4194304] 0 2024-04-03T08:39:39.496 INFO:tasks.workunit.client.1.smithi181.stdout:8/805: dread d4/d44/f100 [0,4194304] 0 2024-04-03T08:39:39.500 INFO:tasks.workunit.client.1.smithi181.stdout:0/872: link d5/d9/f32 d5/d9/d2a/da1/da8/f11a 0 2024-04-03T08:39:39.513 INFO:tasks.workunit.client.1.smithi181.stdout:2/954: link d13/d1c/d4a/d68/dba/lff d13/d1c/d4a/d7f/db3/l15c 0 2024-04-03T08:39:39.516 INFO:tasks.workunit.client.1.smithi181.stdout:2/955: symlink d13/d1c/d73/d13f/d157/l15d 0 2024-04-03T08:39:39.521 INFO:tasks.workunit.client.1.smithi181.stdout:0/873: dread d5/dc/d14/fe0 [0,4194304] 0 2024-04-03T08:39:39.524 INFO:tasks.workunit.client.1.smithi181.stdout:0/874: creat d5/dc/d14/d8d/f11b x:0 0 0 2024-04-03T08:39:39.527 INFO:tasks.workunit.client.1.smithi181.stdout:0/875: fsync d5/d9/d2a/fbe 0 2024-04-03T08:39:39.529 INFO:tasks.workunit.client.1.smithi181.stdout:0/876: stat d5/dc/d10/fd2 0 2024-04-03T08:39:39.530 INFO:tasks.workunit.client.1.smithi181.stdout:2/956: dwrite d13/d1c/da5/dac/f135 [4194304,4194304] 0 2024-04-03T08:39:39.533 INFO:tasks.workunit.client.1.smithi181.stdout:0/877: symlink d5/dc/d8e/dea/l11c 0 2024-04-03T08:39:39.542 INFO:tasks.workunit.client.1.smithi181.stdout:2/957: link d13/d1c/d4a/d68/f86 d13/d1c/d73/d13f/d157/f15e 0 2024-04-03T08:39:39.546 INFO:tasks.workunit.client.1.smithi181.stdout:5/863: write d4/d18/d25/d68/f107 [860349,60777] 0 2024-04-03T08:39:39.551 INFO:tasks.workunit.client.1.smithi181.stdout:0/878: dwrite d5/dc/d10/d58/f8b [0,4194304] 0 2024-04-03T08:39:39.551 INFO:tasks.workunit.client.1.smithi181.stdout:5/864: unlink d4/d18/f35 0 2024-04-03T08:39:39.560 INFO:tasks.workunit.client.1.smithi181.stdout:0/879: mkdir d5/dc/d10/d58/db0/d11d 0 2024-04-03T08:39:39.561 INFO:tasks.workunit.client.1.smithi181.stdout:1/869: write d10/d15/d17/d19/f68 [4535269,101512] 0 2024-04-03T08:39:39.572 INFO:tasks.workunit.client.1.smithi181.stdout:0/880: unlink d5/dc/d10/d58/d6c/f15 0 2024-04-03T08:39:39.572 INFO:tasks.workunit.client.1.smithi181.stdout:1/870: fdatasync d10/d15/d41/fa3 0 2024-04-03T08:39:39.598 INFO:tasks.workunit.client.1.smithi181.stdout:0/881: rmdir d5/dc/d75/daa 39 2024-04-03T08:39:39.599 INFO:tasks.workunit.client.1.smithi181.stdout:1/871: mknod d10/d15/d17/d23/d27/c115 0 2024-04-03T08:39:39.599 INFO:tasks.workunit.client.1.smithi181.stdout:0/882: fsync d5/d9/d2a/da1/fd3 0 2024-04-03T08:39:39.601 INFO:tasks.workunit.client.1.smithi181.stdout:1/872: chown d10/d15/d17/d19/d33/d70/f81 22 1 2024-04-03T08:39:39.602 INFO:tasks.workunit.client.1.smithi181.stdout:0/883: fsync d5/dc/d14/d29/d46/fc4 0 2024-04-03T08:39:39.605 INFO:tasks.workunit.client.1.smithi181.stdout:1/873: creat d10/d15/d17/d23/d27/f116 x:0 0 0 2024-04-03T08:39:39.608 INFO:tasks.workunit.client.1.smithi181.stdout:1/874: creat d10/d69/dd1/d107/f117 x:0 0 0 2024-04-03T08:39:39.617 INFO:tasks.workunit.client.1.smithi181.stdout:0/884: dread d5/dc/d14/de5/deb/f43 [0,4194304] 0 2024-04-03T08:39:39.620 INFO:tasks.workunit.client.0.smithi157.stdout:8/967: dwrite d2/d11/d10/d24/d5b/f47 [0,4194304] 0 2024-04-03T08:39:39.621 INFO:tasks.workunit.client.1.smithi181.stdout:3/922: truncate d0/d5/d6/d32/dc1/ffc 3781399 0 2024-04-03T08:39:39.622 INFO:tasks.workunit.client.1.smithi181.stdout:0/885: rmdir d5/d9/d2a/da1 39 2024-04-03T08:39:39.624 INFO:tasks.workunit.client.1.smithi181.stdout:1/875: dwrite d10/d69/dd1/fd7 [0,4194304] 0 2024-04-03T08:39:39.627 INFO:tasks.workunit.client.1.smithi181.stdout:1/876: fdatasync d10/d15/d4b/d6c/f9f 0 2024-04-03T08:39:39.629 INFO:tasks.workunit.client.1.smithi181.stdout:3/923: dread d0/d5/d6/d32/fdc [0,4194304] 0 2024-04-03T08:39:39.633 INFO:tasks.workunit.client.0.smithi157.stdout:8/968: truncate d2/d11/d10/d24/d5b/d53/faf 880836 0 2024-04-03T08:39:39.634 INFO:tasks.workunit.client.1.smithi181.stdout:1/877: fsync d10/f16 0 2024-04-03T08:39:39.638 INFO:tasks.workunit.client.0.smithi157.stdout:8/969: fsync d2/d6f/f10d 0 2024-04-03T08:39:39.640 INFO:tasks.workunit.client.1.smithi181.stdout:3/924: truncate d0/d5/d6/d32/d43/f48 3254523 0 2024-04-03T08:39:39.642 INFO:tasks.workunit.client.1.smithi181.stdout:1/878: mkdir d10/d69/dd1/d118 0 2024-04-03T08:39:39.645 INFO:tasks.workunit.client.1.smithi181.stdout:3/925: creat d0/d5/d6/d32/daa/d129/d25/d50/f134 x:0 0 0 2024-04-03T08:39:39.646 INFO:tasks.workunit.client.0.smithi157.stdout:8/970: dread d2/d6f/d70/fc0 [0,4194304] 0 2024-04-03T08:39:39.650 INFO:tasks.workunit.client.1.smithi181.stdout:1/879: mkdir d10/d69/dd1/d107/d119 0 2024-04-03T08:39:39.650 INFO:tasks.workunit.client.1.smithi181.stdout:1/880: chown d10/d15/d17/d23/db0/d8d 25498 1 2024-04-03T08:39:39.651 INFO:tasks.workunit.client.0.smithi157.stdout:8/971: chown d2/d6f/d70/d89/l74 31851233 1 2024-04-03T08:39:39.654 INFO:tasks.workunit.client.1.smithi181.stdout:4/924: dwrite d1/d16/d24/f47 [0,4194304] 0 2024-04-03T08:39:39.656 INFO:tasks.workunit.client.1.smithi181.stdout:4/925: chown d1/d16/d24/d5e/f50 1064198549 1 2024-04-03T08:39:39.657 INFO:tasks.workunit.client.0.smithi157.stdout:8/972: getdents d2 0 2024-04-03T08:39:39.660 INFO:tasks.workunit.client.1.smithi181.stdout:7/789: unlink d0/d1/d6/de/d17/cd2 0 2024-04-03T08:39:39.661 INFO:tasks.workunit.client.0.smithi157.stdout:8/973: creat d2/d7b/f14a x:0 0 0 2024-04-03T08:39:39.664 INFO:tasks.workunit.client.1.smithi181.stdout:7/790: dread - d0/d1/d6/de/d17/d64/d85/dd8/f103 zero size 2024-04-03T08:39:39.666 INFO:tasks.workunit.client.1.smithi181.stdout:4/926: getdents d1/d16/d37/d34/d86/ded 0 2024-04-03T08:39:39.668 INFO:tasks.workunit.client.1.smithi181.stdout:6/911: dwrite d6/d3e/d5e/f90 [0,4194304] 0 2024-04-03T08:39:39.668 INFO:tasks.workunit.client.0.smithi157.stdout:1/868: rename d2/d11/d24/d39/d3b/d2e/d66/fd2 to d2/d11/d24/d39/d3b/d2e/d66/f125 0 2024-04-03T08:39:39.671 INFO:tasks.workunit.client.1.smithi181.stdout:7/791: dread d0/d1/d6/f68 [0,4194304] 0 2024-04-03T08:39:39.671 INFO:tasks.workunit.client.1.smithi181.stdout:4/927: creat d1/d16/d24/d5e/d31/d39/da1/f12e x:0 0 0 2024-04-03T08:39:39.674 INFO:tasks.workunit.client.0.smithi157.stdout:1/869: getdents d2/d11/d24/d39/d3b/d1b 0 2024-04-03T08:39:39.677 INFO:tasks.workunit.client.1.smithi181.stdout:8/806: dwrite d4/f27 [0,4194304] 0 2024-04-03T08:39:39.680 INFO:tasks.workunit.client.0.smithi157.stdout:1/870: truncate d2/d11/d24/d39/f54 2434752 0 2024-04-03T08:39:39.683 INFO:tasks.workunit.client.1.smithi181.stdout:2/958: write d13/d1c/f51 [2709746,119386] 0 2024-04-03T08:39:39.689 INFO:tasks.workunit.client.1.smithi181.stdout:9/911: mkdir d1/da/d13/d22/d23/d36/d91/d11d 0 2024-04-03T08:39:39.691 INFO:tasks.workunit.client.0.smithi157.stdout:2/940: rmdir d3/da6 39 2024-04-03T08:39:39.691 INFO:tasks.workunit.client.1.smithi181.stdout:9/912: fsync d1/da/d13/d41/fdd 0 2024-04-03T08:39:39.692 INFO:tasks.workunit.client.1.smithi181.stdout:2/959: creat d13/da7/d27/d2f/dae/f15f x:0 0 0 2024-04-03T08:39:39.695 INFO:tasks.workunit.client.1.smithi181.stdout:6/912: dwrite d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/f112 [0,4194304] 0 2024-04-03T08:39:39.697 INFO:tasks.workunit.client.0.smithi157.stdout:2/941: rmdir d3/db/d44/d4c/d5a/d88 39 2024-04-03T08:39:39.699 INFO:tasks.workunit.client.1.smithi181.stdout:6/913: write d6/d3e/db1/dc4/d10f/dba/da6/d4f/f7a [1288821,3070] 0 2024-04-03T08:39:39.699 INFO:tasks.workunit.client.1.smithi181.stdout:9/913: creat d1/da/d28/d30/d3e/d4e/f11e x:0 0 0 2024-04-03T08:39:39.701 INFO:tasks.workunit.client.0.smithi157.stdout:1/871: dwrite d2/d11/d24/d39/d3b/d2e/d66/d91/f102 [0,4194304] 0 2024-04-03T08:39:39.702 INFO:tasks.workunit.client.1.smithi181.stdout:2/960: symlink d13/d7b/ddc/l160 0 2024-04-03T08:39:39.714 INFO:tasks.workunit.client.1.smithi181.stdout:2/961: rmdir d13/da7/d85/de4 39 2024-04-03T08:39:39.715 INFO:tasks.workunit.client.0.smithi157.stdout:2/942: dread d3/db/d44/d12c/d55/fbc [0,4194304] 0 2024-04-03T08:39:39.718 INFO:tasks.workunit.client.1.smithi181.stdout:6/914: mknod d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/c120 0 2024-04-03T08:39:39.720 INFO:tasks.workunit.client.1.smithi181.stdout:6/915: dread - d6/d53/d80/ff7 zero size 2024-04-03T08:39:39.721 INFO:tasks.workunit.client.0.smithi157.stdout:2/943: mkdir d3/db/d44/d12c/d55/d141 0 2024-04-03T08:39:39.723 INFO:tasks.workunit.client.1.smithi181.stdout:6/916: write d6/d3e/db1/dc4/d10f/dba/da6/fd5 [1126581,86511] 0 2024-04-03T08:39:39.725 INFO:tasks.workunit.client.0.smithi157.stdout:2/944: write d3/db/d44/d12c/d55/d10c/f12e [158400,127489] 0 2024-04-03T08:39:39.726 INFO:tasks.workunit.client.1.smithi181.stdout:5/865: rename d4/dc3 to d4/d18/d55/db4/d96/d11b 0 2024-04-03T08:39:39.730 INFO:tasks.workunit.client.0.smithi157.stdout:2/945: mkdir d3/db/d44/d4c/df1/d101/d142 0 2024-04-03T08:39:39.731 INFO:tasks.workunit.client.1.smithi181.stdout:2/962: link d13/da7/caf d13/da7/d85/de4/c161 0 2024-04-03T08:39:39.733 INFO:tasks.workunit.client.1.smithi181.stdout:5/866: creat d4/d44/d71/dcf/f11c x:0 0 0 2024-04-03T08:39:39.735 INFO:tasks.workunit.client.1.smithi181.stdout:7/792: rename d0/d115/l11b to d0/d1/d6/de/d17/d27/d93/l120 0 2024-04-03T08:39:39.735 INFO:tasks.workunit.client.1.smithi181.stdout:2/963: rmdir d13/da7/d27/d2f/dae/d139 39 2024-04-03T08:39:39.736 INFO:tasks.workunit.client.1.smithi181.stdout:9/914: dread d1/da/d13/d22/d23/f110 [0,4194304] 0 2024-04-03T08:39:39.740 INFO:tasks.workunit.client.1.smithi181.stdout:5/867: rename d4/d18/d55/db4/d96/ca2 to d4/d18/d3e/c11d 0 2024-04-03T08:39:39.742 INFO:tasks.workunit.client.1.smithi181.stdout:9/915: creat d1/da/d28/d80/dd3/f11f x:0 0 0 2024-04-03T08:39:39.742 INFO:tasks.workunit.client.1.smithi181.stdout:6/917: dwrite d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d5b/f6a [0,4194304] 0 2024-04-03T08:39:39.746 INFO:tasks.workunit.client.1.smithi181.stdout:2/964: rename d13/da7/d85/de4/c119 to d13/d1c/d6c/d7a/c162 0 2024-04-03T08:39:39.750 INFO:tasks.workunit.client.1.smithi181.stdout:5/868: mkdir d4/d11e 0 2024-04-03T08:39:39.752 INFO:tasks.workunit.client.1.smithi181.stdout:6/918: symlink d6/l121 0 2024-04-03T08:39:39.754 INFO:tasks.workunit.client.1.smithi181.stdout:2/965: fsync d13/d1c/d4a/d7f/db3/d8f/f12b 0 2024-04-03T08:39:39.756 INFO:tasks.workunit.client.1.smithi181.stdout:9/916: dread d1/da/d28/f64 [0,4194304] 0 2024-04-03T08:39:39.756 INFO:tasks.workunit.client.1.smithi181.stdout:5/869: rmdir d4 39 2024-04-03T08:39:39.761 INFO:tasks.workunit.client.1.smithi181.stdout:0/886: dwrite d5/f6a [0,4194304] 0 2024-04-03T08:39:39.761 INFO:tasks.workunit.client.1.smithi181.stdout:2/966: mknod d13/da7/c163 0 2024-04-03T08:39:39.766 INFO:tasks.workunit.client.1.smithi181.stdout:1/881: write d10/d15/d17/d30/f79 [1458280,60545] 0 2024-04-03T08:39:39.766 INFO:tasks.workunit.client.1.smithi181.stdout:0/887: creat d5/dc/d10/d58/dba/f11e x:0 0 0 2024-04-03T08:39:39.768 INFO:tasks.workunit.client.1.smithi181.stdout:2/967: creat d13/d1c/d4a/d68/dfa/f164 x:0 0 0 2024-04-03T08:39:39.769 INFO:tasks.workunit.client.1.smithi181.stdout:0/888: chown d5/dc/d14/fe0 28 1 2024-04-03T08:39:39.769 INFO:tasks.workunit.client.1.smithi181.stdout:1/882: chown d10/d69/dd1/c106 54027737 1 2024-04-03T08:39:39.771 INFO:tasks.workunit.client.1.smithi181.stdout:6/919: mkdir d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/d122 0 2024-04-03T08:39:39.773 INFO:tasks.workunit.client.1.smithi181.stdout:6/920: readlink d6/d3e/d5e/l10e 0 2024-04-03T08:39:39.774 INFO:tasks.workunit.client.1.smithi181.stdout:7/793: dread d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f7d [0,4194304] 0 2024-04-03T08:39:39.774 INFO:tasks.workunit.client.1.smithi181.stdout:0/889: mkdir d5/dc/d14/d29/d46/d11f 0 2024-04-03T08:39:39.778 INFO:tasks.workunit.client.1.smithi181.stdout:0/890: symlink d5/dc/d10/d58/dba/d90/l120 0 2024-04-03T08:39:39.779 INFO:tasks.workunit.client.1.smithi181.stdout:4/928: write d1/d1e/d2c/f73 [4505726,98041] 0 2024-04-03T08:39:39.779 INFO:tasks.workunit.client.1.smithi181.stdout:6/921: symlink d6/d3e/db1/dc4/d10f/dba/l123 0 2024-04-03T08:39:39.781 INFO:tasks.workunit.client.1.smithi181.stdout:8/807: write d4/d45/db/d14/d31/d1c/d51/d87/db1/fbe [619539,36512] 0 2024-04-03T08:39:39.786 INFO:tasks.workunit.client.1.smithi181.stdout:0/891: fdatasync d5/dc/d10/d58/dba/d90/f10b 0 2024-04-03T08:39:39.786 INFO:tasks.workunit.client.0.smithi157.stdout:1/872: write d2/d11/d23/dc9/d86/f8b [25361,42139] 0 2024-04-03T08:39:39.791 INFO:tasks.workunit.client.1.smithi181.stdout:4/929: getdents d1/d1e/d2c/d10e 0 2024-04-03T08:39:39.792 INFO:tasks.workunit.client.1.smithi181.stdout:7/794: dwrite d0/d1/d6/de/d17/d64/fa5 [0,4194304] 0 2024-04-03T08:39:39.794 INFO:tasks.workunit.client.0.smithi157.stdout:1/873: rename d2/d11/d24/d39/l52 to d2/d11/d23/l126 0 2024-04-03T08:39:39.798 INFO:tasks.workunit.client.1.smithi181.stdout:9/917: creat d1/da/d28/d30/d3e/d4e/f120 x:0 0 0 2024-04-03T08:39:39.800 INFO:tasks.workunit.client.1.smithi181.stdout:6/922: rename d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/f112 to d6/d53/d8d/d97/db0/d11f/f124 0 2024-04-03T08:39:39.800 INFO:tasks.workunit.client.1.smithi181.stdout:9/918: read d1/da/d13/d41/f2a [988121,73349] 0 2024-04-03T08:39:39.800 INFO:tasks.workunit.client.0.smithi157.stdout:2/946: truncate d3/d12/f116 1790039 0 2024-04-03T08:39:39.802 INFO:tasks.workunit.client.1.smithi181.stdout:4/930: mknod d1/d16/d24/d61/df6/c12f 0 2024-04-03T08:39:39.814 INFO:tasks.workunit.client.1.smithi181.stdout:0/892: dread d5/dc/d75/f9d [0,4194304] 0 2024-04-03T08:39:39.815 INFO:tasks.workunit.client.1.smithi181.stdout:6/923: rmdir d6/d3e/db1/dc4/dc9 39 2024-04-03T08:39:39.818 INFO:tasks.workunit.client.1.smithi181.stdout:9/919: rename d1/da/d13/d73/l70 to d1/da/d28/d80/l121 0 2024-04-03T08:39:39.819 INFO:tasks.workunit.client.0.smithi157.stdout:2/947: dwrite d3/db/d44/d12c/d55/d10c/f118 [0,4194304] 0 2024-04-03T08:39:39.821 INFO:tasks.workunit.client.1.smithi181.stdout:5/870: write d4/d80/f8e [893353,81541] 0 2024-04-03T08:39:39.824 INFO:tasks.workunit.client.1.smithi181.stdout:8/808: getdents d4 0 2024-04-03T08:39:39.830 INFO:tasks.workunit.client.1.smithi181.stdout:6/924: symlink d6/d3e/db1/dc4/d10f/l125 0 2024-04-03T08:39:39.830 INFO:tasks.workunit.client.1.smithi181.stdout:2/968: write d13/d1c/d4a/d7f/db3/d81/fbe [827444,60307] 0 2024-04-03T08:39:39.839 INFO:tasks.workunit.client.0.smithi157.stdout:2/948: rename d3/d12/l2b to d3/d2e/l143 0 2024-04-03T08:39:39.840 INFO:tasks.workunit.client.1.smithi181.stdout:1/883: dwrite d10/d15/d17/d19/d33/f7d [0,4194304] 0 2024-04-03T08:39:39.850 INFO:tasks.workunit.client.1.smithi181.stdout:4/931: symlink d1/d16/d24/d5e/d31/d39/db1/dbd/l130 0 2024-04-03T08:39:39.851 INFO:tasks.workunit.client.1.smithi181.stdout:7/795: write d0/d1/f15 [8448163,1223] 0 2024-04-03T08:39:39.854 INFO:tasks.workunit.client.0.smithi157.stdout:1/874: dwrite d2/d11/d23/dc9/d5d/f60 [0,4194304] 0 2024-04-03T08:39:39.856 INFO:tasks.workunit.client.1.smithi181.stdout:0/893: write d5/dc/d75/f9d [218350,92367] 0 2024-04-03T08:39:39.857 INFO:tasks.workunit.client.1.smithi181.stdout:6/925: symlink d6/d53/d8d/d97/dcc/l126 0 2024-04-03T08:39:39.858 INFO:tasks.workunit.client.1.smithi181.stdout:0/894: chown d5/dc/d14/d8d/f9a 154092 1 2024-04-03T08:39:39.859 INFO:tasks.workunit.client.1.smithi181.stdout:4/932: truncate d1/d16/d37/d34/f35 2135079 0 2024-04-03T08:39:39.859 INFO:tasks.workunit.client.1.smithi181.stdout:9/920: write d1/da/d13/d22/d23/d36/d91/ff6 [989377,12790] 0 2024-04-03T08:39:39.861 INFO:tasks.workunit.client.1.smithi181.stdout:3/926: sync 2024-04-03T08:39:39.863 INFO:tasks.workunit.client.1.smithi181.stdout:8/809: write d4/d45/db/f56 [1038054,13267] 0 2024-04-03T08:39:39.866 INFO:tasks.workunit.client.1.smithi181.stdout:5/871: dread d4/d18/fb9 [0,4194304] 0 2024-04-03T08:39:39.868 INFO:tasks.workunit.client.1.smithi181.stdout:6/926: symlink d6/d3e/db1/dc4/l127 0 2024-04-03T08:39:39.869 INFO:tasks.workunit.client.1.smithi181.stdout:4/933: chown d1/d16/d24/d5e/d2b/db9/fd5 207 1 2024-04-03T08:39:39.870 INFO:tasks.workunit.client.1.smithi181.stdout:9/921: mknod d1/da/d13/c122 0 2024-04-03T08:39:39.872 INFO:tasks.workunit.client.1.smithi181.stdout:8/810: fdatasync d4/d2a/d37/dfb/fd7 0 2024-04-03T08:39:39.873 INFO:tasks.workunit.client.1.smithi181.stdout:1/884: dread d10/d15/d17/f3f [0,4194304] 0 2024-04-03T08:39:39.873 INFO:tasks.workunit.client.1.smithi181.stdout:3/927: symlink d0/d17/d63/df8/d106/l135 0 2024-04-03T08:39:39.874 INFO:tasks.workunit.client.1.smithi181.stdout:2/969: dread d13/da7/d27/f4b [0,4194304] 0 2024-04-03T08:39:39.876 INFO:tasks.workunit.client.1.smithi181.stdout:5/872: read d4/d18/d55/db4/f9f [50252,29385] 0 2024-04-03T08:39:39.877 INFO:tasks.workunit.client.1.smithi181.stdout:9/922: mknod d1/da/d28/d80/dc6/c123 0 2024-04-03T08:39:39.878 INFO:tasks.workunit.client.1.smithi181.stdout:1/885: write d10/d15/d17/d23/db0/fcc [7381994,114622] 0 2024-04-03T08:39:39.880 INFO:tasks.workunit.client.1.smithi181.stdout:1/886: chown d10/d15/d17/d23/d27/f116 180051 1 2024-04-03T08:39:39.881 INFO:tasks.workunit.client.1.smithi181.stdout:8/811: read d4/d45/db/d14/fa6 [971514,38020] 0 2024-04-03T08:39:39.883 INFO:tasks.workunit.client.1.smithi181.stdout:2/970: unlink d13/da7/d27/f4f 0 2024-04-03T08:39:39.888 INFO:tasks.workunit.client.0.smithi157.stdout:6/966: sync 2024-04-03T08:39:39.893 INFO:tasks.workunit.client.1.smithi181.stdout:6/927: rename d6/d3e/db1/dc4/d10f/dba/da6/d4f/d77/d8b/l9f to d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/l128 0 2024-04-03T08:39:39.894 INFO:tasks.workunit.client.0.smithi157.stdout:2/949: mknod d3/d12/c144 0 2024-04-03T08:39:39.897 INFO:tasks.workunit.client.1.smithi181.stdout:1/887: rmdir d10/d15/d17 39 2024-04-03T08:39:39.899 INFO:tasks.workunit.client.1.smithi181.stdout:3/928: dread d0/d5/d6/d32/d43/f48 [0,4194304] 0 2024-04-03T08:39:39.904 INFO:tasks.workunit.client.1.smithi181.stdout:5/873: mkdir d4/d18/d25/dac/d11f 0 2024-04-03T08:39:39.906 INFO:tasks.workunit.client.1.smithi181.stdout:6/928: rename d6/fb2 to d6/d3e/db1/dc4/d10f/deb/f129 0 2024-04-03T08:39:39.910 INFO:tasks.workunit.client.1.smithi181.stdout:6/929: write d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f38 [2232372,36416] 0 2024-04-03T08:39:39.911 INFO:tasks.workunit.client.0.smithi157.stdout:2/950: creat d3/d12/f145 x:0 0 0 2024-04-03T08:39:39.912 INFO:tasks.workunit.client.1.smithi181.stdout:8/812: dwrite d4/d45/f2e [0,4194304] 0 2024-04-03T08:39:39.912 INFO:tasks.workunit.client.1.smithi181.stdout:1/888: dread d10/d15/d17/d19/d33/f64 [0,4194304] 0 2024-04-03T08:39:39.913 INFO:tasks.workunit.client.0.smithi157.stdout:6/967: link d1/d4b/l126 d1/d5/d17/d29/d80/l14b 0 2024-04-03T08:39:39.914 INFO:tasks.workunit.client.1.smithi181.stdout:3/929: fsync d0/d5/d6/f11 0 2024-04-03T08:39:39.915 INFO:tasks.workunit.client.1.smithi181.stdout:2/971: mkdir d13/d1c/d4a/d7f/db3/d8f/d131/d165 0 2024-04-03T08:39:39.915 INFO:tasks.workunit.client.1.smithi181.stdout:4/934: write d1/d1e/d78/f97 [1618212,89486] 0 2024-04-03T08:39:39.916 INFO:tasks.workunit.client.0.smithi157.stdout:2/951: truncate d3/d2e/d32/d9f/fcb 4613737 0 2024-04-03T08:39:39.918 INFO:tasks.workunit.client.1.smithi181.stdout:2/972: stat d13/d1c/d4a/d7f/db3/dbf/l11c 0 2024-04-03T08:39:39.920 INFO:tasks.workunit.client.0.smithi157.stdout:6/968: rmdir d1/d5/d17/d29/da7/db9/dfb 39 2024-04-03T08:39:39.921 INFO:tasks.workunit.client.0.smithi157.stdout:1/875: write d2/d11/d24/d39/f117 [2894411,70849] 0 2024-04-03T08:39:39.929 INFO:tasks.workunit.client.1.smithi181.stdout:6/930: fsync d6/dc0/d103/f98 0 2024-04-03T08:39:39.931 INFO:tasks.workunit.client.1.smithi181.stdout:8/813: creat d4/d45/d96/f10a x:0 0 0 2024-04-03T08:39:39.933 INFO:tasks.workunit.client.1.smithi181.stdout:1/889: dread - d10/d15/d41/fe8 zero size 2024-04-03T08:39:39.935 INFO:tasks.workunit.client.0.smithi157.stdout:6/969: rename d1/d4b/d38/da6/cb4 to d1/d4b/da5/dc7/d12e/c14c 0 2024-04-03T08:39:39.936 INFO:tasks.workunit.client.0.smithi157.stdout:3/997: sync 2024-04-03T08:39:39.936 INFO:tasks.workunit.client.0.smithi157.stdout:4/907: sync 2024-04-03T08:39:39.937 INFO:tasks.workunit.client.0.smithi157.stdout:8/974: sync 2024-04-03T08:39:39.937 INFO:tasks.workunit.client.0.smithi157.stdout:2/952: truncate d3/d12/f7c 4019214 0 2024-04-03T08:39:39.938 INFO:tasks.workunit.client.1.smithi181.stdout:3/930: symlink d0/d17/d63/df8/d106/l136 0 2024-04-03T08:39:39.940 INFO:tasks.workunit.client.1.smithi181.stdout:5/874: mknod d4/c120 0 2024-04-03T08:39:39.940 INFO:tasks.workunit.client.0.smithi157.stdout:1/876: dwrite d2/d11/d24/fb2 [0,4194304] 0 2024-04-03T08:39:39.944 INFO:tasks.workunit.client.0.smithi157.stdout:3/998: fdatasync d8/d1e/d2d/f137 0 2024-04-03T08:39:39.944 INFO:tasks.workunit.client.0.smithi157.stdout:6/970: read d1/d5/d17/d29/faf [2657476,31776] 0 2024-04-03T08:39:39.947 INFO:tasks.workunit.client.1.smithi181.stdout:8/814: dread - d4/d45/d9/d70/fbc zero size 2024-04-03T08:39:39.948 INFO:tasks.workunit.client.0.smithi157.stdout:4/908: unlink da/df/d11/d5d/l102 0 2024-04-03T08:39:39.949 INFO:tasks.workunit.client.1.smithi181.stdout:1/890: mkdir d10/d15/d4a/d11a 0 2024-04-03T08:39:39.953 INFO:tasks.workunit.client.1.smithi181.stdout:3/931: mknod d0/d17/d36/d3b/d5a/d93/c137 0 2024-04-03T08:39:39.958 INFO:tasks.workunit.client.1.smithi181.stdout:5/875: write d4/d44/d71/fa7 [2179584,76365] 0 2024-04-03T08:39:39.959 INFO:tasks.workunit.client.1.smithi181.stdout:2/973: mkdir d13/d1c/d4a/d7f/db3/d166 0 2024-04-03T08:39:39.960 INFO:tasks.workunit.client.0.smithi157.stdout:8/975: write d2/d20/d23/fc5 [1421369,51682] 0 2024-04-03T08:39:39.964 INFO:tasks.workunit.client.1.smithi181.stdout:6/931: mkdir d6/d3e/d5e/d12a 0 2024-04-03T08:39:39.966 INFO:tasks.workunit.client.1.smithi181.stdout:4/935: dwrite d1/d16/f54 [0,4194304] 0 2024-04-03T08:39:39.968 INFO:tasks.workunit.client.0.smithi157.stdout:2/953: dread d3/db/d44/d4c/d5a/fd4 [0,4194304] 0 2024-04-03T08:39:39.969 INFO:tasks.workunit.client.0.smithi157.stdout:4/909: symlink da/df/d24/d35/l136 0 2024-04-03T08:39:39.972 INFO:tasks.workunit.client.0.smithi157.stdout:8/976: dread - d2/d6f/db5/f11a zero size 2024-04-03T08:39:39.975 INFO:tasks.workunit.client.1.smithi181.stdout:2/974: creat d13/d1c/d4a/d68/dfa/df9/f167 x:0 0 0 2024-04-03T08:39:39.976 INFO:tasks.workunit.client.0.smithi157.stdout:1/877: getdents d2/d11/d24/d39/d3b/d1b/d7f/de9 0 2024-04-03T08:39:39.979 INFO:tasks.workunit.client.1.smithi181.stdout:6/932: dread - d6/d3e/db1/dc4/d10f/dba/d95/fe7 zero size 2024-04-03T08:39:39.981 INFO:tasks.workunit.client.0.smithi157.stdout:2/954: fdatasync d3/d12/f24 0 2024-04-03T08:39:39.983 INFO:tasks.workunit.client.0.smithi157.stdout:4/910: mkdir da/df/d2f/d54/d5f/d137 0 2024-04-03T08:39:39.984 INFO:tasks.workunit.client.1.smithi181.stdout:4/936: dwrite d1/d1e/d82/d84/fe6 [0,4194304] 0 2024-04-03T08:39:39.984 INFO:tasks.workunit.client.1.smithi181.stdout:8/815: dwrite d4/d44/fb3 [0,4194304] 0 2024-04-03T08:39:39.985 INFO:tasks.workunit.client.1.smithi181.stdout:4/937: stat d1/d1e/d82/fde 0 2024-04-03T08:39:39.986 INFO:tasks.workunit.client.0.smithi157.stdout:6/971: rename d1/d5/d17/d2a/d73/d12d/dd6 to d1/d5/d17/d29/d12f/dec/d14d 0 2024-04-03T08:39:39.986 INFO:tasks.workunit.client.0.smithi157.stdout:4/911: fdatasync da/df/d11/f82 0 2024-04-03T08:39:39.989 INFO:tasks.workunit.client.1.smithi181.stdout:1/891: write d10/d15/d17/d19/dd9/fdf [513710,58507] 0 2024-04-03T08:39:39.989 INFO:tasks.workunit.client.0.smithi157.stdout:8/977: unlink d2/d11/d10/d24/d5b/d2e/d94/ddb/d103/l137 0 2024-04-03T08:39:39.990 INFO:tasks.workunit.client.0.smithi157.stdout:3/999: getdents d8/d13/d1b/d4e/da6/da8 0 2024-04-03T08:39:39.992 INFO:tasks.workunit.client.1.smithi181.stdout:1/892: chown d10/d15/d4a/d86 2 1 2024-04-03T08:39:39.992 INFO:tasks.workunit.client.1.smithi181.stdout:2/975: read d13/d1c/d6c/d111/f115 [276205,22936] 0 2024-04-03T08:39:39.993 INFO:tasks.workunit.client.0.smithi157.stdout:8/978: chown d2/d20/d23/f149 175173992 1 2024-04-03T08:39:39.993 INFO:tasks.workunit.client.0.smithi157.stdout:1/878: truncate d2/d11/f92 2538254 0 2024-04-03T08:39:39.995 INFO:tasks.workunit.client.1.smithi181.stdout:6/933: mknod d6/d3e/db1/dc4/d10f/d73/c12b 0 2024-04-03T08:39:39.998 INFO:tasks.workunit.client.1.smithi181.stdout:8/816: stat d4/d44/d59/fcb 0 2024-04-03T08:39:39.999 INFO:tasks.workunit.client.1.smithi181.stdout:4/938: mkdir d1/d16/d37/d34/d69/d131 0 2024-04-03T08:39:40.000 INFO:tasks.workunit.client.1.smithi181.stdout:3/932: dwrite d0/d17/d36/d3b/d5a/fec [0,4194304] 0 2024-04-03T08:39:40.001 INFO:tasks.workunit.client.1.smithi181.stdout:6/934: chown d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/dd9 386 1 2024-04-03T08:39:40.005 INFO:tasks.workunit.client.1.smithi181.stdout:4/939: write d1/d1e/d2c/de4/f110 [355476,40193] 0 2024-04-03T08:39:40.007 INFO:tasks.workunit.client.0.smithi157.stdout:4/912: rename da/df/d99/ddb/f131 to da/df/d2f/d64/d8f/dbd/d68/f138 0 2024-04-03T08:39:40.008 INFO:tasks.workunit.client.1.smithi181.stdout:2/976: mkdir d13/d1c/d4a/d7f/db3/d8f/d131/d168 0 2024-04-03T08:39:40.009 INFO:tasks.workunit.client.1.smithi181.stdout:3/933: mkdir d0/d5/d6/d32/dc1/d138 0 2024-04-03T08:39:40.009 INFO:tasks.workunit.client.1.smithi181.stdout:6/935: rename d6/d3e/ld0 to d6/d53/d8d/d97/l12c 0 2024-04-03T08:39:40.012 INFO:tasks.workunit.client.1.smithi181.stdout:8/817: read d4/d45/db/d14/d31/d1c/f2f [262368,109841] 0 2024-04-03T08:39:40.018 INFO:tasks.workunit.client.0.smithi157.stdout:6/972: rename d1/d5/d17/d29/d12f/lcc to d1/d5/d17/d29/da7/db9/df0/l14e 0 2024-04-03T08:39:40.024 INFO:tasks.workunit.client.0.smithi157.stdout:8/979: rename d2/d20/l44 to d2/d11/d10/d24/d5b/d2e/d94/d13b/l14b 0 2024-04-03T08:39:40.025 INFO:tasks.workunit.client.1.smithi181.stdout:6/936: mknod d6/d31/dbe/c12d 0 2024-04-03T08:39:40.026 INFO:tasks.workunit.client.0.smithi157.stdout:6/973: mknod d1/d5/d17/d2a/d140/c14f 0 2024-04-03T08:39:40.030 INFO:tasks.workunit.client.0.smithi157.stdout:2/955: write d3/da6/fb9 [5026491,24109] 0 2024-04-03T08:39:40.031 INFO:tasks.workunit.client.0.smithi157.stdout:8/980: read - d2/d11/d10/d24/d5b/d2e/d75/d81/f122 zero size 2024-04-03T08:39:40.032 INFO:tasks.workunit.client.1.smithi181.stdout:8/818: truncate d4/d45/db/d14/d31/f3c 1553322 0 2024-04-03T08:39:40.035 INFO:tasks.workunit.client.1.smithi181.stdout:8/819: write d4/d45/db/f33 [1099782,22807] 0 2024-04-03T08:39:40.039 INFO:tasks.workunit.client.0.smithi157.stdout:4/913: write da/df/d24/d35/d53/fa9 [2630498,107703] 0 2024-04-03T08:39:40.040 INFO:tasks.workunit.client.1.smithi181.stdout:2/977: mknod d13/da7/d85/dbd/c169 0 2024-04-03T08:39:40.040 INFO:tasks.workunit.client.1.smithi181.stdout:1/893: dwrite d10/d15/d17/d23/d27/d91/fc0 [0,4194304] 0 2024-04-03T08:39:40.041 INFO:tasks.workunit.client.1.smithi181.stdout:2/978: chown c5 2130947941 1 2024-04-03T08:39:40.041 INFO:tasks.workunit.client.0.smithi157.stdout:8/981: fdatasync d2/d11/d10/d24/d5b/d2e/d75/d81/f11b 0 2024-04-03T08:39:40.042 INFO:tasks.workunit.client.1.smithi181.stdout:4/940: getdents d1/d16/d37/d34/d86/ded 0 2024-04-03T08:39:40.042 INFO:tasks.workunit.client.0.smithi157.stdout:6/974: dread - d1/d5/d17/d29/da7/db9/dfb/f123 zero size 2024-04-03T08:39:40.044 INFO:tasks.workunit.client.1.smithi181.stdout:2/979: chown d13/d1c/d4a/d7f/dcb 7409 1 2024-04-03T08:39:40.045 INFO:tasks.workunit.client.0.smithi157.stdout:8/982: write d2/d11/d10/f48 [4596903,15399] 0 2024-04-03T08:39:40.048 INFO:tasks.workunit.client.1.smithi181.stdout:1/894: read d10/d15/d17/d19/d33/d70/ff7 [269870,7344] 0 2024-04-03T08:39:40.054 INFO:tasks.workunit.client.0.smithi157.stdout:4/914: symlink da/df/d24/d35/d53/de3/l139 0 2024-04-03T08:39:40.054 INFO:tasks.workunit.client.1.smithi181.stdout:3/934: truncate d0/d5/d6/d32/daa/d129/d25/f44 1208280 0 2024-04-03T08:39:40.056 INFO:tasks.workunit.client.0.smithi157.stdout:2/956: mknod d3/db/d44/d4c/d5a/d88/c146 0 2024-04-03T08:39:40.057 INFO:tasks.workunit.client.1.smithi181.stdout:4/941: creat d1/d16/d24/d5e/d2b/db9/f132 x:0 0 0 2024-04-03T08:39:40.058 INFO:tasks.workunit.client.0.smithi157.stdout:6/975: rmdir d1/d5/d17/d2a/d73 39 2024-04-03T08:39:40.059 INFO:tasks.workunit.client.1.smithi181.stdout:4/942: chown d1/d16/d24/d5e/d3f/d109 19994 1 2024-04-03T08:39:40.062 INFO:tasks.workunit.client.0.smithi157.stdout:4/915: unlink l3 0 2024-04-03T08:39:40.062 INFO:tasks.workunit.client.1.smithi181.stdout:8/820: truncate d4/f88 1790214 0 2024-04-03T08:39:40.066 INFO:tasks.workunit.client.1.smithi181.stdout:1/895: creat d10/d15/d17/d23/d27/d91/f11b x:0 0 0 2024-04-03T08:39:40.069 INFO:tasks.workunit.client.0.smithi157.stdout:4/916: read da/df/d24/d35/f87 [2711019,15272] 0 2024-04-03T08:39:40.072 INFO:tasks.workunit.client.0.smithi157.stdout:6/976: mknod d1/d4b/d38/c150 0 2024-04-03T08:39:40.076 INFO:tasks.workunit.client.1.smithi181.stdout:2/980: fdatasync d13/d1c/d4a/d68/f86 0 2024-04-03T08:39:40.078 INFO:tasks.workunit.client.0.smithi157.stdout:4/917: read da/df/d24/f11d [3638510,42478] 0 2024-04-03T08:39:40.080 INFO:tasks.workunit.client.1.smithi181.stdout:3/935: write d0/d5/d6/f11 [2694801,90612] 0 2024-04-03T08:39:40.081 INFO:tasks.workunit.client.1.smithi181.stdout:3/936: stat d0/d17/d36 0 2024-04-03T08:39:40.082 INFO:tasks.workunit.client.1.smithi181.stdout:3/937: chown d0/d5/d6/l58 143 1 2024-04-03T08:39:40.084 INFO:tasks.workunit.client.0.smithi157.stdout:8/983: dwrite d2/fe5 [0,4194304] 0 2024-04-03T08:39:40.087 INFO:tasks.workunit.client.0.smithi157.stdout:2/957: dread d3/f4e [0,4194304] 0 2024-04-03T08:39:40.093 INFO:tasks.workunit.client.1.smithi181.stdout:2/981: stat d13/d1c/d4a/d68/dba/lff 0 2024-04-03T08:39:40.096 INFO:tasks.workunit.client.1.smithi181.stdout:4/943: creat d1/d1e/d2c/dd2/f133 x:0 0 0 2024-04-03T08:39:40.096 INFO:tasks.workunit.client.0.smithi157.stdout:6/977: dwrite d1/d4b/fce [0,4194304] 0 2024-04-03T08:39:40.098 INFO:tasks.workunit.client.1.smithi181.stdout:8/821: truncate d4/d45/db/d14/fb5 3531586 0 2024-04-03T08:39:40.100 INFO:tasks.workunit.client.1.smithi181.stdout:7/796: sync 2024-04-03T08:39:40.107 INFO:tasks.workunit.client.1.smithi181.stdout:1/896: mkdir d10/d69/dd1/d113/d11c 0 2024-04-03T08:39:40.107 INFO:tasks.workunit.client.0.smithi157.stdout:4/918: creat da/df/d2f/dbc/f13a x:0 0 0 2024-04-03T08:39:40.110 INFO:tasks.workunit.client.0.smithi157.stdout:8/984: link d2/d11/d10/d24/d5b/l8e d2/d6f/d70/d89/d59/l14c 0 2024-04-03T08:39:40.112 INFO:tasks.workunit.client.1.smithi181.stdout:4/944: rename d1/d1e/d2c/dd2/f133 to d1/d16/d24/d5e/d31/d39/d5d/d9a/d10a/f134 0 2024-04-03T08:39:40.114 INFO:tasks.workunit.client.1.smithi181.stdout:8/822: rmdir d4/d45/db/d14/d31/d1c/d51/d87/dc8 39 2024-04-03T08:39:40.117 INFO:tasks.workunit.client.1.smithi181.stdout:7/797: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/l121 0 2024-04-03T08:39:40.120 INFO:tasks.workunit.client.0.smithi157.stdout:2/958: dwrite d3/d2e/f90 [0,4194304] 0 2024-04-03T08:39:40.121 INFO:tasks.workunit.client.1.smithi181.stdout:3/938: creat d0/d17/d36/d3b/d5a/d93/d105/f139 x:0 0 0 2024-04-03T08:39:40.121 INFO:tasks.workunit.client.1.smithi181.stdout:4/945: dread d1/d1e/d78/f97 [0,4194304] 0 2024-04-03T08:39:40.124 INFO:tasks.workunit.client.1.smithi181.stdout:4/946: dread - d1/d16/d24/d5e/d2b/db9/f132 zero size 2024-04-03T08:39:40.127 INFO:tasks.workunit.client.0.smithi157.stdout:4/919: write da/d26/f115 [781507,40765] 0 2024-04-03T08:39:40.128 INFO:tasks.workunit.client.0.smithi157.stdout:8/985: dwrite d2/d20/d77/f13f [0,4194304] 0 2024-04-03T08:39:40.129 INFO:tasks.workunit.client.1.smithi181.stdout:1/897: mkdir d10/d15/d17/d23/db0/d11d 0 2024-04-03T08:39:40.131 INFO:tasks.workunit.client.1.smithi181.stdout:2/982: write d13/d1c/d4a/fed [921179,89160] 0 2024-04-03T08:39:40.132 INFO:tasks.workunit.client.0.smithi157.stdout:6/978: link d1/d5/d17/d29/d62/d7f/fc8 d1/d5/d1b/d97/f151 0 2024-04-03T08:39:40.133 INFO:tasks.workunit.client.0.smithi157.stdout:2/959: chown d3/db/d44/d4c/d5a/d88/dc6/ld0 470 1 2024-04-03T08:39:40.141 INFO:tasks.workunit.client.0.smithi157.stdout:4/920: symlink da/df/d6b/d95/l13b 0 2024-04-03T08:39:40.143 INFO:tasks.workunit.client.1.smithi181.stdout:2/983: mknod d13/da7/d85/dbd/c16a 0 2024-04-03T08:39:40.146 INFO:tasks.workunit.client.1.smithi181.stdout:3/939: mkdir d0/d5/d6/d13a 0 2024-04-03T08:39:40.150 INFO:tasks.workunit.client.0.smithi157.stdout:6/979: truncate d1/d5/d17/d2a/d73/d12d/fe7 298099 0 2024-04-03T08:39:40.153 INFO:tasks.workunit.client.1.smithi181.stdout:7/798: rename d0/d1/d6/de/d17/d64/d85/dd8/cef to d0/d1/d6/de/d17/d64/d85/d9a/c122 0 2024-04-03T08:39:40.154 INFO:tasks.workunit.client.1.smithi181.stdout:2/984: symlink d13/d1c/d6c/d111/l16b 0 2024-04-03T08:39:40.155 INFO:tasks.workunit.client.1.smithi181.stdout:4/947: write d1/d16/d37/d34/d69/fc7 [3614077,75691] 0 2024-04-03T08:39:40.157 INFO:tasks.workunit.client.1.smithi181.stdout:1/898: write d10/d15/d4a/fa9 [4548084,24647] 0 2024-04-03T08:39:40.157 INFO:tasks.workunit.client.1.smithi181.stdout:3/940: fdatasync d0/d5/fa2 0 2024-04-03T08:39:40.158 INFO:tasks.workunit.client.1.smithi181.stdout:7/799: mknod d0/d1/d6/dca/c123 0 2024-04-03T08:39:40.158 INFO:tasks.workunit.client.0.smithi157.stdout:8/986: write d2/d11/d10/d24/d5b/d53/faf [568471,32712] 0 2024-04-03T08:39:40.162 INFO:tasks.workunit.client.1.smithi181.stdout:2/985: fdatasync d13/d1c/d4a/fdb 0 2024-04-03T08:39:40.162 INFO:tasks.workunit.client.1.smithi181.stdout:1/899: fdatasync d10/d15/d17/d19/d33/f6a 0 2024-04-03T08:39:40.163 INFO:tasks.workunit.client.0.smithi157.stdout:6/980: rename d1/d5/d17/d2a/d30/d95/dff to d1/d5/d17/d29/da7/d129/d152 0 2024-04-03T08:39:40.163 INFO:tasks.workunit.client.0.smithi157.stdout:8/987: readlink d2/d11/l2b 0 2024-04-03T08:39:40.163 INFO:tasks.workunit.client.0.smithi157.stdout:6/981: dread d1/d5/d17/f64 [0,4194304] 0 2024-04-03T08:39:40.166 INFO:tasks.workunit.client.1.smithi181.stdout:3/941: read d0/d17/fcf [74035,16418] 0 2024-04-03T08:39:40.166 INFO:tasks.workunit.client.1.smithi181.stdout:4/948: mknod d1/d16/d24/d5e/d31/d39/d5d/c135 0 2024-04-03T08:39:40.168 INFO:tasks.workunit.client.1.smithi181.stdout:1/900: symlink d10/d15/d41/l11e 0 2024-04-03T08:39:40.170 INFO:tasks.workunit.client.1.smithi181.stdout:7/800: rename d0/d1/d6/de/d17/d27/c70 to d0/d1/d6/de/d17/d27/d72/df4/c124 0 2024-04-03T08:39:40.173 INFO:tasks.workunit.client.1.smithi181.stdout:7/801: chown d0/d1/d6/de/d17/fee 0 1 2024-04-03T08:39:40.179 INFO:tasks.workunit.client.1.smithi181.stdout:4/949: dread d1/d16/f54 [0,4194304] 0 2024-04-03T08:39:40.180 INFO:tasks.workunit.client.1.smithi181.stdout:1/901: rename d10/d69/dd1/ff8 to d10/d69/f11f 0 2024-04-03T08:39:40.182 INFO:tasks.workunit.client.0.smithi157.stdout:6/982: truncate d1/d5/d17/d2a/d37/dca/d132/f146 663387 0 2024-04-03T08:39:40.183 INFO:tasks.workunit.client.0.smithi157.stdout:2/960: dread d3/db/f31 [0,4194304] 0 2024-04-03T08:39:40.188 INFO:tasks.workunit.client.0.smithi157.stdout:8/988: rename d2/d20/db1 to d2/d11/d10/d24/d5b/d14d 0 2024-04-03T08:39:40.192 INFO:tasks.workunit.client.1.smithi181.stdout:2/986: write d13/da7/d27/d2f/d5d/f67 [837096,53725] 0 2024-04-03T08:39:40.192 INFO:tasks.workunit.client.1.smithi181.stdout:3/942: write d0/d5/fe6 [3705809,68202] 0 2024-04-03T08:39:40.192 INFO:tasks.workunit.client.0.smithi157.stdout:4/921: dread da/df/d24/d35/d6a/d78/f128 [0,4194304] 0 2024-04-03T08:39:40.194 INFO:tasks.workunit.client.0.smithi157.stdout:6/983: rename d1/d5/d17/d29/da7/cd2 to d1/d5/d17/d2a/d30/d12c/c153 0 2024-04-03T08:39:40.196 INFO:tasks.workunit.client.0.smithi157.stdout:6/984: chown d1/d5/d17/d29/da7/db9/f102 7202 1 2024-04-03T08:39:40.200 INFO:tasks.workunit.client.1.smithi181.stdout:1/902: truncate d10/d15/d17/d23/d27/f92 4402987 0 2024-04-03T08:39:40.201 INFO:tasks.workunit.client.1.smithi181.stdout:7/802: write d0/d1/d6/de/d17/d64/d85/d9a/fd7 [443279,12998] 0 2024-04-03T08:39:40.204 INFO:tasks.workunit.client.0.smithi157.stdout:2/961: truncate d3/d2e/fa5 179337 0 2024-04-03T08:39:40.206 INFO:tasks.workunit.client.0.smithi157.stdout:2/962: write d3/f4e [192975,98029] 0 2024-04-03T08:39:40.208 INFO:tasks.workunit.client.1.smithi181.stdout:4/950: write d1/fb [1442152,31438] 0 2024-04-03T08:39:40.209 INFO:tasks.workunit.client.0.smithi157.stdout:8/989: dwrite d2/d6f/d70/d89/d59/df6/f12a [0,4194304] 0 2024-04-03T08:39:40.210 INFO:tasks.workunit.client.0.smithi157.stdout:6/985: readlink d1/d4b/d38/d59/l72 0 2024-04-03T08:39:40.210 INFO:tasks.workunit.client.1.smithi181.stdout:2/987: creat d13/d1c/d4a/d68/d72/f16c x:0 0 0 2024-04-03T08:39:40.210 INFO:tasks.workunit.client.1.smithi181.stdout:4/951: readlink d1/d16/d37/d34/d86/d9e/lc2 0 2024-04-03T08:39:40.212 INFO:tasks.workunit.client.1.smithi181.stdout:4/952: readlink d1/d16/d24/d5e/d3f/d81/la8 0 2024-04-03T08:39:40.212 INFO:tasks.workunit.client.1.smithi181.stdout:1/903: mkdir d10/d15/d4b/d6c/d120 0 2024-04-03T08:39:40.214 INFO:tasks.workunit.client.0.smithi157.stdout:2/963: unlink d3/db/d44/l114 0 2024-04-03T08:39:40.215 INFO:tasks.workunit.client.0.smithi157.stdout:1/879: sync 2024-04-03T08:39:40.216 INFO:tasks.workunit.client.1.smithi181.stdout:7/803: creat d0/d1/d6/de/d17/d64/d85/d87/d10a/f125 x:0 0 0 2024-04-03T08:39:40.217 INFO:tasks.workunit.client.1.smithi181.stdout:7/804: chown d0/d1/lc9 1373 1 2024-04-03T08:39:40.218 INFO:tasks.workunit.client.0.smithi157.stdout:1/880: read d2/f3 [2284042,76284] 0 2024-04-03T08:39:40.220 INFO:tasks.workunit.client.1.smithi181.stdout:7/805: chown d0/d1/d6/de/d17/d64/d85/d87/cc3 544562 1 2024-04-03T08:39:40.221 INFO:tasks.workunit.client.1.smithi181.stdout:3/943: fdatasync d0/d17/f91 0 2024-04-03T08:39:40.223 INFO:tasks.workunit.client.0.smithi157.stdout:1/881: write d2/d11/d24/d39/d3b/d2e/d66/f123 [815583,10226] 0 2024-04-03T08:39:40.224 INFO:tasks.workunit.client.1.smithi181.stdout:2/988: dread - d13/d1c/d4a/d68/dfa/df9/f110 zero size 2024-04-03T08:39:40.228 INFO:tasks.workunit.client.0.smithi157.stdout:1/882: truncate d2/d11/d24/fb8 980614 0 2024-04-03T08:39:40.228 INFO:tasks.workunit.client.0.smithi157.stdout:8/990: unlink d2/d20/df7/c120 0 2024-04-03T08:39:40.230 INFO:tasks.workunit.client.1.smithi181.stdout:7/806: creat d0/d1/d6/de/d17/d64/d85/d9a/d109/f126 x:0 0 0 2024-04-03T08:39:40.231 INFO:tasks.workunit.client.1.smithi181.stdout:5/876: sync 2024-04-03T08:39:40.231 INFO:tasks.workunit.client.1.smithi181.stdout:0/895: sync 2024-04-03T08:39:40.231 INFO:tasks.workunit.client.1.smithi181.stdout:6/937: sync 2024-04-03T08:39:40.231 INFO:tasks.workunit.client.1.smithi181.stdout:9/923: sync 2024-04-03T08:39:40.231 INFO:tasks.workunit.client.1.smithi181.stdout:3/944: rmdir d0/d5/d6/d32/daa/d129/d5f/d95/de9 39 2024-04-03T08:39:40.231 INFO:tasks.workunit.client.0.smithi157.stdout:2/964: truncate d3/db/d44/d4c/d5a/d88/f8c 1201432 0 2024-04-03T08:39:40.232 INFO:tasks.workunit.client.1.smithi181.stdout:4/953: symlink d1/d16/d24/d5e/d31/dba/ddd/de0/l136 0 2024-04-03T08:39:40.233 INFO:tasks.workunit.client.0.smithi157.stdout:1/883: rename d2/f96 to d2/d11/d24/d39/d3b/d1b/f127 0 2024-04-03T08:39:40.234 INFO:tasks.workunit.client.1.smithi181.stdout:0/896: write d5/d9/d2a/f64 [5042450,55255] 0 2024-04-03T08:39:40.235 INFO:tasks.workunit.client.0.smithi157.stdout:2/965: dread - d3/d2e/d32/d9f/da7/d121/f113 zero size 2024-04-03T08:39:40.235 INFO:tasks.workunit.client.0.smithi157.stdout:4/922: dread da/df/d24/d35/d53/ff3 [0,4194304] 0 2024-04-03T08:39:40.235 INFO:tasks.workunit.client.0.smithi157.stdout:8/991: mknod d2/d11/d10/d24/d5b/d2e/d94/ddb/c14e 0 2024-04-03T08:39:40.236 INFO:tasks.workunit.client.1.smithi181.stdout:4/954: stat d1/d16/d37/d34/d69/c91 0 2024-04-03T08:39:40.236 INFO:tasks.workunit.client.1.smithi181.stdout:3/945: fdatasync d0/d5/d6/d32/daa/d129/d25/d50/f120 0 2024-04-03T08:39:40.236 INFO:tasks.workunit.client.1.smithi181.stdout:6/938: dread - d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d5b/fdf zero size 2024-04-03T08:39:40.239 INFO:tasks.workunit.client.1.smithi181.stdout:7/807: rmdir d0/d1/d6/de/d17/d27/d72/df4 39 2024-04-03T08:39:40.242 INFO:tasks.workunit.client.0.smithi157.stdout:8/992: truncate d2/d11/d10/d24/d5b/d14d/d111/f148 606895 0 2024-04-03T08:39:40.244 INFO:tasks.workunit.client.0.smithi157.stdout:1/884: mkdir d2/d11/d24/d39/d3b/d1b/d7f/d128 0 2024-04-03T08:39:40.245 INFO:tasks.workunit.client.1.smithi181.stdout:0/897: creat d5/dc/d14/de5/f121 x:0 0 0 2024-04-03T08:39:40.247 INFO:tasks.workunit.client.1.smithi181.stdout:2/989: write d13/d1c/d4a/d68/fe6 [444883,78201] 0 2024-04-03T08:39:40.247 INFO:tasks.workunit.client.1.smithi181.stdout:0/898: chown d5/dc/d10/d58/la5 343095 1 2024-04-03T08:39:40.250 INFO:tasks.workunit.client.1.smithi181.stdout:6/939: dread d6/d3e/db1/dc4/d10f/dba/da6/d4f/f7a [0,4194304] 0 2024-04-03T08:39:40.250 INFO:tasks.workunit.client.0.smithi157.stdout:4/923: rename da/df/lb5 to da/df/d2f/dbc/dbe/d133/l13c 0 2024-04-03T08:39:40.251 INFO:tasks.workunit.client.1.smithi181.stdout:0/899: read d5/dc/d10/d30/f109 [114489,81071] 0 2024-04-03T08:39:40.252 INFO:tasks.workunit.client.0.smithi157.stdout:6/986: link d1/d5/d17/d29/da7/db9/df0/l14e d1/d5/d17/d2a/d37/dca/l154 0 2024-04-03T08:39:40.253 INFO:tasks.workunit.client.1.smithi181.stdout:3/946: rmdir d0/d5/d6f 39 2024-04-03T08:39:40.256 INFO:tasks.workunit.client.1.smithi181.stdout:4/955: creat d1/d16/d24/d5e/d31/d39/db1/f137 x:0 0 0 2024-04-03T08:39:40.258 INFO:tasks.workunit.client.1.smithi181.stdout:1/904: getdents d10/d15/d17/d19/d33/d70 0 2024-04-03T08:39:40.262 INFO:tasks.workunit.client.0.smithi157.stdout:2/966: dread d3/d12/d43/f78 [0,4194304] 0 2024-04-03T08:39:40.263 INFO:tasks.workunit.client.0.smithi157.stdout:8/993: dread d2/ddd/fdf [0,4194304] 0 2024-04-03T08:39:40.264 INFO:tasks.workunit.client.0.smithi157.stdout:4/924: rename da/df/d6b to da/df/d2f/d97/dc8/d13d 0 2024-04-03T08:39:40.265 INFO:tasks.workunit.client.1.smithi181.stdout:5/877: write d4/d18/f65 [925775,81607] 0 2024-04-03T08:39:40.266 INFO:tasks.workunit.client.0.smithi157.stdout:1/885: dwrite d2/d11/d24/d39/d3b/d2e/d66/f123 [0,4194304] 0 2024-04-03T08:39:40.266 INFO:tasks.workunit.client.1.smithi181.stdout:7/808: truncate d0/d1/d6/de/d17/d27/f5d 2521083 0 2024-04-03T08:39:40.268 INFO:tasks.workunit.client.1.smithi181.stdout:7/809: readlink d0/d1/d6/de/d17/d27/ld0 0 2024-04-03T08:39:40.270 INFO:tasks.workunit.client.1.smithi181.stdout:7/810: read d0/d1/d6/f9 [337841,32668] 0 2024-04-03T08:39:40.273 INFO:tasks.workunit.client.1.smithi181.stdout:0/900: rename d5/dc/d75/de1/cf1 to d5/dc/d10/d58/dba/c122 0 2024-04-03T08:39:40.273 INFO:tasks.workunit.client.1.smithi181.stdout:7/811: read d0/d1/d6/de/d17/d64/d85/d9a/da4/f6f [2627965,60064] 0 2024-04-03T08:39:40.275 INFO:tasks.workunit.client.0.smithi157.stdout:6/987: rename d1/d5/d17/d29/d80/cdc to d1/d5/d17/d2a/d30/d12c/c155 0 2024-04-03T08:39:40.275 INFO:tasks.workunit.client.1.smithi181.stdout:6/940: truncate d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/f15 3843620 0 2024-04-03T08:39:40.276 INFO:tasks.workunit.client.1.smithi181.stdout:4/956: stat d1/d1e/d78/cdc 0 2024-04-03T08:39:40.277 INFO:tasks.workunit.client.1.smithi181.stdout:1/905: creat d10/da1/f121 x:0 0 0 2024-04-03T08:39:40.278 INFO:tasks.workunit.client.1.smithi181.stdout:6/941: dread - d6/d3e/db1/dc4/d10f/fcf zero size 2024-04-03T08:39:40.279 INFO:tasks.workunit.client.1.smithi181.stdout:1/906: readlink d10/d15/d17/d23/l32 0 2024-04-03T08:39:40.280 INFO:tasks.workunit.client.0.smithi157.stdout:1/886: creat d2/d11/d23/dc9/d58/d94/da3/f129 x:0 0 0 2024-04-03T08:39:40.281 INFO:tasks.workunit.client.1.smithi181.stdout:5/878: rmdir d4/d22/d72 39 2024-04-03T08:39:40.283 INFO:tasks.workunit.client.1.smithi181.stdout:2/990: mknod d13/da7/d27/d2f/dae/c16d 0 2024-04-03T08:39:40.285 INFO:tasks.workunit.client.1.smithi181.stdout:2/991: readlink d13/da7/d40/l9c 0 2024-04-03T08:39:40.287 INFO:tasks.workunit.client.1.smithi181.stdout:4/957: dread d1/d1e/d2c/f73 [0,4194304] 0 2024-04-03T08:39:40.290 INFO:tasks.workunit.client.0.smithi157.stdout:8/994: dwrite d2/d11/d10/d24/d5b/d2e/f58 [0,4194304] 0 2024-04-03T08:39:40.291 INFO:tasks.workunit.client.0.smithi157.stdout:1/887: rmdir d2/d11/d23/dc9/d64 39 2024-04-03T08:39:40.293 INFO:tasks.workunit.client.1.smithi181.stdout:3/947: write d0/d17/d36/d3b/d5a/f97 [561486,63557] 0 2024-04-03T08:39:40.293 INFO:tasks.workunit.client.0.smithi157.stdout:2/967: link d3/db/d44/d4c/d5a/fbb d3/db/d44/d4c/d5a/d88/dc6/d132/f147 0 2024-04-03T08:39:40.294 INFO:tasks.workunit.client.0.smithi157.stdout:4/925: write da/df/d24/d35/d6a/f77 [5189908,88009] 0 2024-04-03T08:39:40.295 INFO:tasks.workunit.client.1.smithi181.stdout:7/812: creat d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f127 x:0 0 0 2024-04-03T08:39:40.299 INFO:tasks.workunit.client.1.smithi181.stdout:1/907: rename d10/d15/d17/d23/c3b to d10/d15/d17/d19/dc3/c122 0 2024-04-03T08:39:40.306 INFO:tasks.workunit.client.0.smithi157.stdout:1/888: creat d2/d11/d24/d108/f12a x:0 0 0 2024-04-03T08:39:40.306 INFO:tasks.workunit.client.0.smithi157.stdout:4/926: symlink da/df/d99/ddb/l13e 0 2024-04-03T08:39:40.312 INFO:tasks.workunit.client.1.smithi181.stdout:0/901: mknod d5/dc/d75/daa/c123 0 2024-04-03T08:39:40.316 INFO:tasks.workunit.client.0.smithi157.stdout:2/968: symlink d3/l148 0 2024-04-03T08:39:40.321 INFO:tasks.workunit.client.1.smithi181.stdout:6/942: mknod d6/d3e/db1/dc4/c12e 0 2024-04-03T08:39:40.324 INFO:tasks.workunit.client.1.smithi181.stdout:2/992: dread d13/da7/d27/f2c [4194304,4194304] 0 2024-04-03T08:39:40.324 INFO:tasks.workunit.client.0.smithi157.stdout:6/988: dread d1/d5/d17/fd7 [4194304,4194304] 0 2024-04-03T08:39:40.325 INFO:tasks.workunit.client.1.smithi181.stdout:7/813: mknod d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/c128 0 2024-04-03T08:39:40.327 INFO:tasks.workunit.client.1.smithi181.stdout:7/814: write d0/d1/d6/de/d17/d64/d85/d87/fd3 [3342745,81039] 0 2024-04-03T08:39:40.330 INFO:tasks.workunit.client.1.smithi181.stdout:4/958: rename d1/d16/d24/d5e/d3f/d6c/dcd/ffc to d1/d16/d24/d5e/d2b/db9/f138 0 2024-04-03T08:39:40.330 INFO:tasks.workunit.client.1.smithi181.stdout:7/815: fdatasync d0/d1/d6/de/d17/d64/d85/d9a/d109/f126 0 2024-04-03T08:39:40.330 INFO:tasks.workunit.client.0.smithi157.stdout:8/995: dread d2/d11/d10/d24/d5b/d2e/d75/d81/f11b [0,4194304] 0 2024-04-03T08:39:40.333 INFO:tasks.workunit.client.1.smithi181.stdout:1/908: symlink d10/d15/d17/d30/l123 0 2024-04-03T08:39:40.336 INFO:tasks.workunit.client.0.smithi157.stdout:2/969: creat d3/d2e/d32/d9f/da7/d127/f149 x:0 0 0 2024-04-03T08:39:40.339 INFO:tasks.workunit.client.0.smithi157.stdout:4/927: write da/df/f112 [683844,15979] 0 2024-04-03T08:39:40.342 INFO:tasks.workunit.client.0.smithi157.stdout:4/928: truncate da/d26/f115 1254922 0 2024-04-03T08:39:40.343 INFO:tasks.workunit.client.1.smithi181.stdout:3/948: unlink d0/d17/d36/d8c/cdb 0 2024-04-03T08:39:40.345 INFO:tasks.workunit.client.0.smithi157.stdout:4/929: dread - da/df/d24/d35/d6a/d76/fc6 zero size 2024-04-03T08:39:40.346 INFO:tasks.workunit.client.1.smithi181.stdout:6/943: fsync d6/d3e/db1/dc4/d10f/dba/fde 0 2024-04-03T08:39:40.347 INFO:tasks.workunit.client.0.smithi157.stdout:8/996: symlink d2/d6f/d70/d89/l14f 0 2024-04-03T08:39:40.348 INFO:tasks.workunit.client.0.smithi157.stdout:6/989: write d1/d5/d17/d29/d62/ff6 [623233,19721] 0 2024-04-03T08:39:40.350 INFO:tasks.workunit.client.0.smithi157.stdout:1/889: write d2/d11/d23/dc9/f9e [233901,78957] 0 2024-04-03T08:39:40.360 INFO:tasks.workunit.client.0.smithi157.stdout:8/997: creat d2/d20/df7/f150 x:0 0 0 2024-04-03T08:39:40.361 INFO:tasks.workunit.client.1.smithi181.stdout:7/816: dread - d0/d1/d6/de/d17/d64/d82/fe6 zero size 2024-04-03T08:39:40.363 INFO:tasks.workunit.client.1.smithi181.stdout:3/949: dread d0/d5/fe6 [0,4194304] 0 2024-04-03T08:39:40.363 INFO:tasks.workunit.client.1.smithi181.stdout:1/909: mkdir d10/d15/d4a/d6f/d124 0 2024-04-03T08:39:40.365 INFO:tasks.workunit.client.1.smithi181.stdout:3/950: stat d0/d5/d6/d32/daa/d129/d25/c108 0 2024-04-03T08:39:40.367 INFO:tasks.workunit.client.1.smithi181.stdout:5/879: creat d4/f121 x:0 0 0 2024-04-03T08:39:40.367 INFO:tasks.workunit.client.0.smithi157.stdout:2/970: getdents d3/d2e/d32/d9f/da7 0 2024-04-03T08:39:40.369 INFO:tasks.workunit.client.1.smithi181.stdout:2/993: dwrite d13/d1c/d4a/d68/f50 [0,4194304] 0 2024-04-03T08:39:40.369 INFO:tasks.workunit.client.1.smithi181.stdout:0/902: rename d5/d9/d2a/da1/df7/d107 to d5/dc/d10/d58/dba/d124 0 2024-04-03T08:39:40.372 INFO:tasks.workunit.client.0.smithi157.stdout:4/930: dwrite da/df/d11/f1f [4194304,4194304] 0 2024-04-03T08:39:40.372 INFO:tasks.workunit.client.0.smithi157.stdout:6/990: unlink d1/d5/d17/d29/da7/d129/f13b 0 2024-04-03T08:39:40.375 INFO:tasks.workunit.client.0.smithi157.stdout:6/991: readlink d1/d4b/d38/l78 0 2024-04-03T08:39:40.378 INFO:tasks.workunit.client.0.smithi157.stdout:6/992: chown d1/d5/d17/d29/da7/d129/d152/f136 3206 1 2024-04-03T08:39:40.380 INFO:tasks.workunit.client.1.smithi181.stdout:4/959: unlink d1/d16/d24/d5e/d31/d39/d5d/d9a/f117 0 2024-04-03T08:39:40.386 INFO:tasks.workunit.client.1.smithi181.stdout:7/817: unlink d0/d1/d6/de/d17/d27/ld0 0 2024-04-03T08:39:40.387 INFO:tasks.workunit.client.0.smithi157.stdout:8/998: mknod d2/d11/d10/d24/d5b/d14d/d111/d126/c151 0 2024-04-03T08:39:40.395 INFO:tasks.workunit.client.0.smithi157.stdout:4/931: creat da/df/d2f/d97/dc8/d13d/db9/f13f x:0 0 0 2024-04-03T08:39:40.399 INFO:tasks.workunit.client.1.smithi181.stdout:6/944: rename d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f3f to d6/d31/f12f 0 2024-04-03T08:39:40.401 INFO:tasks.workunit.client.1.smithi181.stdout:2/994: rmdir d13/d1c/d4a 39 2024-04-03T08:39:40.402 INFO:tasks.workunit.client.1.smithi181.stdout:0/903: dread d5/d9/d2a/de6/fad [0,4194304] 0 2024-04-03T08:39:40.406 INFO:tasks.workunit.client.0.smithi157.stdout:8/999: rename d2/d11/d10/d24/d5b/d14d/l118 to d2/d20/d77/l152 0 2024-04-03T08:39:40.408 INFO:tasks.workunit.client.1.smithi181.stdout:4/960: mknod d1/d16/d24/d61/c139 0 2024-04-03T08:39:40.408 INFO:tasks.workunit.client.0.smithi157.stdout:4/932: truncate da/df/d24/f75 4368745 0 2024-04-03T08:39:40.410 INFO:tasks.workunit.client.0.smithi157.stdout:4/933: readlink da/df/d2f/d54/l105 0 2024-04-03T08:39:40.411 INFO:tasks.workunit.client.1.smithi181.stdout:5/880: rename d4/d18/d25/db0/f11a to d4/d18/d55/db4/d96/f122 0 2024-04-03T08:39:40.411 INFO:tasks.workunit.client.1.smithi181.stdout:8/823: sync 2024-04-03T08:39:40.412 INFO:tasks.workunit.client.1.smithi181.stdout:5/881: chown d4/d22/d53/c54 1 1 2024-04-03T08:39:40.414 INFO:tasks.workunit.client.1.smithi181.stdout:0/904: fsync d5/d9/d2a/de6/fdb 0 2024-04-03T08:39:40.417 INFO:tasks.workunit.client.0.smithi157.stdout:6/993: dread d1/d4b/f10d [0,4194304] 0 2024-04-03T08:39:40.417 INFO:tasks.workunit.client.0.smithi157.stdout:1/890: dwrite d2/d11/d23/dc9/d58/d62/d74/f75 [0,4194304] 0 2024-04-03T08:39:40.422 INFO:tasks.workunit.client.0.smithi157.stdout:4/934: truncate da/d7e/dba/f10c 359406 0 2024-04-03T08:39:40.424 INFO:tasks.workunit.client.1.smithi181.stdout:8/824: unlink d4/d45/db/d14/d31/d1c/d51/lad 0 2024-04-03T08:39:40.426 INFO:tasks.workunit.client.0.smithi157.stdout:2/971: write d3/d12/f20 [572589,80858] 0 2024-04-03T08:39:40.430 INFO:tasks.workunit.client.1.smithi181.stdout:7/818: creat d0/d1/d6/de/d17/d64/d85/f129 x:0 0 0 2024-04-03T08:39:40.431 INFO:tasks.workunit.client.0.smithi157.stdout:4/935: symlink da/df/d2f/d97/dc8/d13d/l140 0 2024-04-03T08:39:40.433 INFO:tasks.workunit.client.1.smithi181.stdout:4/961: mknod d1/d16/d37/d34/d69/d131/c13a 0 2024-04-03T08:39:40.438 INFO:tasks.workunit.client.0.smithi157.stdout:6/994: symlink d1/d5/d17/d2a/d37/dca/d132/d13e/l156 0 2024-04-03T08:39:40.440 INFO:tasks.workunit.client.1.smithi181.stdout:8/825: mknod d4/d45/db/d14/d31/d1c/d51/d87/db1/c10b 0 2024-04-03T08:39:40.442 INFO:tasks.workunit.client.1.smithi181.stdout:7/819: symlink d0/db4/l12a 0 2024-04-03T08:39:40.443 INFO:tasks.workunit.client.0.smithi157.stdout:4/936: symlink da/df/d2f/dbc/dbe/d133/l141 0 2024-04-03T08:39:40.445 INFO:tasks.workunit.client.1.smithi181.stdout:4/962: unlink d1/d16/d24/d5e/f45 0 2024-04-03T08:39:40.445 INFO:tasks.workunit.client.0.smithi157.stdout:4/937: chown da/df/d24/d35/d3c/f71 8956 1 2024-04-03T08:39:40.446 INFO:tasks.workunit.client.1.smithi181.stdout:6/945: getdents d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50 0 2024-04-03T08:39:40.448 INFO:tasks.workunit.client.0.smithi157.stdout:2/972: mknod d3/db/d44/d4c/d5a/c14a 0 2024-04-03T08:39:40.449 INFO:tasks.workunit.client.1.smithi181.stdout:5/882: creat d4/d18/d2c/f123 x:0 0 0 2024-04-03T08:39:40.450 INFO:tasks.workunit.client.1.smithi181.stdout:5/883: readlink d4/d18/d25/l4c 0 2024-04-03T08:39:40.455 INFO:tasks.workunit.client.1.smithi181.stdout:6/946: fsync d6/df6/fd3 0 2024-04-03T08:39:40.459 INFO:tasks.workunit.client.1.smithi181.stdout:5/884: creat d4/d22/d53/d98/f124 x:0 0 0 2024-04-03T08:39:40.459 INFO:tasks.workunit.client.1.smithi181.stdout:8/826: creat d4/d45/db/d14/d31/d1c/d51/d87/db1/d107/f10c x:0 0 0 2024-04-03T08:39:40.466 INFO:tasks.workunit.client.0.smithi157.stdout:1/891: dwrite d2/d11/d23/dc9/da1/ded/fff [0,4194304] 0 2024-04-03T08:39:40.470 INFO:tasks.workunit.client.0.smithi157.stdout:6/995: dread d1/d5/d17/d2a/d73/d12d/f122 [0,4194304] 0 2024-04-03T08:39:40.472 INFO:tasks.workunit.client.0.smithi157.stdout:6/996: chown d1/d5/d17/d29/d62 59 1 2024-04-03T08:39:40.480 INFO:tasks.workunit.client.1.smithi181.stdout:8/827: mkdir d4/d44/d10d 0 2024-04-03T08:39:40.481 INFO:tasks.workunit.client.1.smithi181.stdout:7/820: dwrite d0/d1/d6/de/d17/d64/d85/f98 [0,4194304] 0 2024-04-03T08:39:40.488 INFO:tasks.workunit.client.0.smithi157.stdout:2/973: write d3/db/d44/d12c/f79 [701615,116205] 0 2024-04-03T08:39:40.488 INFO:tasks.workunit.client.1.smithi181.stdout:4/963: truncate d1/d1e/d82/d84/fe6 5872092 0 2024-04-03T08:39:40.490 INFO:tasks.workunit.client.1.smithi181.stdout:4/964: chown d1/d1e/d2c/d10e/f122 2144921 1 2024-04-03T08:39:40.490 INFO:tasks.workunit.client.0.smithi157.stdout:4/938: dread da/df/d2f/f40 [4194304,4194304] 0 2024-04-03T08:39:40.491 INFO:tasks.workunit.client.0.smithi157.stdout:2/974: chown d3/l10b 101268411 1 2024-04-03T08:39:40.492 INFO:tasks.workunit.client.1.smithi181.stdout:8/828: symlink d4/d44/d59/d5f/d6c/l10e 0 2024-04-03T08:39:40.493 INFO:tasks.workunit.client.1.smithi181.stdout:8/829: chown d4/d45/db/d14/d31/d1c/de8 575967 1 2024-04-03T08:39:40.499 INFO:tasks.workunit.client.0.smithi157.stdout:6/997: dread - d1/d5/d17/d29/d12f/dec/fa0 zero size 2024-04-03T08:39:40.499 INFO:tasks.workunit.client.0.smithi157.stdout:1/892: truncate d2/d11/d24/d39/d3b/d2e/d66/f123 3230146 0 2024-04-03T08:39:40.502 INFO:tasks.workunit.client.1.smithi181.stdout:5/885: dwrite d4/d18/d55/db4/d8a/fa9 [0,4194304] 0 2024-04-03T08:39:40.504 INFO:tasks.workunit.client.1.smithi181.stdout:6/947: dwrite d6/d31/f12f [0,4194304] 0 2024-04-03T08:39:40.504 INFO:tasks.workunit.client.0.smithi157.stdout:2/975: read d3/db/f31 [812380,48109] 0 2024-04-03T08:39:40.504 INFO:tasks.workunit.client.0.smithi157.stdout:6/998: dread d1/d5/d17/d2a/d37/f3b [0,4194304] 0 2024-04-03T08:39:40.506 INFO:tasks.workunit.client.0.smithi157.stdout:2/976: chown d3/da6/le4 65937 1 2024-04-03T08:39:40.510 INFO:tasks.workunit.client.0.smithi157.stdout:4/939: creat da/df/d11/df9/d126/f142 x:0 0 0 2024-04-03T08:39:40.513 INFO:tasks.workunit.client.1.smithi181.stdout:8/830: creat d4/d44/d59/d5f/d6c/dd1/f10f x:0 0 0 2024-04-03T08:39:40.515 INFO:tasks.workunit.client.0.smithi157.stdout:2/977: rmdir d3/db/d44/d12c/d55 39 2024-04-03T08:39:40.519 INFO:tasks.workunit.client.1.smithi181.stdout:7/821: dwrite d0/d1/d6/de/d17/d27/f4e [0,4194304] 0 2024-04-03T08:39:40.522 INFO:tasks.workunit.client.1.smithi181.stdout:5/886: unlink d4/d18/d55/db4/d96/fe6 0 2024-04-03T08:39:40.525 INFO:tasks.workunit.client.1.smithi181.stdout:5/887: write d4/d18/d55/db4/fa0 [1195462,4336] 0 2024-04-03T08:39:40.535 INFO:tasks.workunit.client.1.smithi181.stdout:7/822: mkdir d0/d1/d6/dca/d12b 0 2024-04-03T08:39:40.537 INFO:tasks.workunit.client.1.smithi181.stdout:4/965: getdents d1/d16/d37/d34/d86/ded/dfa 0 2024-04-03T08:39:40.540 INFO:tasks.workunit.client.0.smithi157.stdout:4/940: dwrite da/df/d2f/d64/d8f/dbd/d68/f12f [0,4194304] 0 2024-04-03T08:39:40.541 INFO:tasks.workunit.client.1.smithi181.stdout:5/888: creat d4/d18/d25/de7/df2/f125 x:0 0 0 2024-04-03T08:39:40.543 INFO:tasks.workunit.client.1.smithi181.stdout:8/831: rename d4/d45/dae/lfc to d4/d45/d96/d103/l110 0 2024-04-03T08:39:40.545 INFO:tasks.workunit.client.1.smithi181.stdout:7/823: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/dbf/l12c 0 2024-04-03T08:39:40.548 INFO:tasks.workunit.client.0.smithi157.stdout:4/941: write da/df/d2f/f4f [6339498,98978] 0 2024-04-03T08:39:40.553 INFO:tasks.workunit.client.1.smithi181.stdout:4/966: rename d1/d16/d24/d5e/d31 to d1/d16/d24/d5e/d3f/d81/d13b 0 2024-04-03T08:39:40.554 INFO:tasks.workunit.client.1.smithi181.stdout:8/832: fdatasync d4/d45/f9b 0 2024-04-03T08:39:40.555 INFO:tasks.workunit.client.0.smithi157.stdout:6/999: dwrite d1/d5/d17/f67 [4194304,4194304] 0 2024-04-03T08:39:40.556 INFO:tasks.workunit.client.1.smithi181.stdout:6/948: truncate d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f49 1571981 0 2024-04-03T08:39:40.558 INFO:tasks.workunit.client.0.smithi157.stdout:2/978: write d3/db/d44/d12c/d55/d10c/f119 [603144,81392] 0 2024-04-03T08:39:40.559 INFO:tasks.workunit.client.1.smithi181.stdout:5/889: dwrite d4/d18/d55/db4/d90/f102 [0,4194304] 0 2024-04-03T08:39:40.561 INFO:tasks.workunit.client.1.smithi181.stdout:7/824: rename d0/db4 to d0/d1/d6/de/d17/d64/d82/d12d 0 2024-04-03T08:39:40.565 INFO:tasks.workunit.client.0.smithi157.stdout:4/942: fdatasync da/df/d2f/d54/fb4 0 2024-04-03T08:39:40.565 INFO:tasks.workunit.client.1.smithi181.stdout:7/825: read d0/d1/d6/de/d17/d27/f36 [3728675,33487] 0 2024-04-03T08:39:40.567 INFO:tasks.workunit.client.1.smithi181.stdout:4/967: creat d1/d16/d24/d5e/d3f/d81/d13b/d39/da1/df8/f13c x:0 0 0 2024-04-03T08:39:40.573 INFO:tasks.workunit.client.0.smithi157.stdout:4/943: read da/df/f112 [632581,32347] 0 2024-04-03T08:39:40.583 INFO:tasks.workunit.client.1.smithi181.stdout:8/833: dread d4/f36 [0,4194304] 0 2024-04-03T08:39:40.583 INFO:tasks.workunit.client.0.smithi157.stdout:4/944: mkdir da/df/d2f/d64/d8f/dbd/d68/d143 0 2024-04-03T08:39:40.584 INFO:tasks.workunit.client.0.smithi157.stdout:4/945: readlink da/d26/l36 0 2024-04-03T08:39:40.585 INFO:tasks.workunit.client.1.smithi181.stdout:7/826: dread d0/d1/d6/de/d17/f38 [0,4194304] 0 2024-04-03T08:39:40.587 INFO:tasks.workunit.client.0.smithi157.stdout:4/946: write da/df/d2f/d64/d8f/fae [9263926,24257] 0 2024-04-03T08:39:40.587 INFO:tasks.workunit.client.1.smithi181.stdout:7/827: stat d0/d1/d6/de/d17/lc6 0 2024-04-03T08:39:40.591 INFO:tasks.workunit.client.0.smithi157.stdout:2/979: dwrite d3/db/d44/d4c/d5a/d88/f12f [0,4194304] 0 2024-04-03T08:39:40.591 INFO:tasks.workunit.client.1.smithi181.stdout:4/968: read d1/d1e/d2c/d67/d93/fef [151553,87340] 0 2024-04-03T08:39:40.593 INFO:tasks.workunit.client.0.smithi157.stdout:4/947: chown da/df/d24/d35/d6a/d78/fb0 0 1 2024-04-03T08:39:40.595 INFO:tasks.workunit.client.1.smithi181.stdout:5/890: dwrite d4/d18/d25/d59/fde [0,4194304] 0 2024-04-03T08:39:40.597 INFO:tasks.workunit.client.0.smithi157.stdout:2/980: read d3/f102 [619812,5525] 0 2024-04-03T08:39:40.600 INFO:tasks.workunit.client.0.smithi157.stdout:4/948: symlink da/df/d24/d35/d53/de3/l144 0 2024-04-03T08:39:40.616 INFO:tasks.workunit.client.0.smithi157.stdout:2/981: getdents d3/d12 0 2024-04-03T08:39:40.618 INFO:tasks.workunit.client.0.smithi157.stdout:2/982: read d3/d12/fd [2667739,76577] 0 2024-04-03T08:39:40.623 INFO:tasks.workunit.client.1.smithi181.stdout:9/924: sync 2024-04-03T08:39:40.626 INFO:tasks.workunit.client.0.smithi157.stdout:2/983: symlink d3/db/d44/d12c/d55/d141/l14b 0 2024-04-03T08:39:40.634 INFO:tasks.workunit.client.0.smithi157.stdout:2/984: mknod d3/d2e/d32/d9f/c14c 0 2024-04-03T08:39:40.637 INFO:tasks.workunit.client.0.smithi157.stdout:2/985: write d3/db/d44/d4c/df1/ff9 [3726687,4669] 0 2024-04-03T08:39:40.641 INFO:tasks.workunit.client.1.smithi181.stdout:8/834: chown d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/cd6 1 1 2024-04-03T08:39:40.643 INFO:tasks.workunit.client.0.smithi157.stdout:4/949: dwrite da/df/d2f/d54/f5a [4194304,4194304] 0 2024-04-03T08:39:40.645 INFO:tasks.workunit.client.1.smithi181.stdout:9/925: creat d1/da/d13/d41/d65/f124 x:0 0 0 2024-04-03T08:39:40.647 INFO:tasks.workunit.client.1.smithi181.stdout:8/835: symlink d4/d45/d96/d103/l111 0 2024-04-03T08:39:40.648 INFO:tasks.workunit.client.0.smithi157.stdout:4/950: chown da/df/d2f/d97/dc8/d13d/l140 499758 1 2024-04-03T08:39:40.651 INFO:tasks.workunit.client.1.smithi181.stdout:4/969: creat d1/d16/d24/d5e/f13d x:0 0 0 2024-04-03T08:39:40.653 INFO:tasks.workunit.client.1.smithi181.stdout:5/891: dread d4/d18/d3e/fe1 [0,4194304] 0 2024-04-03T08:39:40.655 INFO:tasks.workunit.client.1.smithi181.stdout:4/970: truncate d1/d16/d24/d5e/d2b/d56/f7e 467587 0 2024-04-03T08:39:40.655 INFO:tasks.workunit.client.0.smithi157.stdout:4/951: mkdir da/df/d2f/d97/dc8/d145 0 2024-04-03T08:39:40.657 INFO:tasks.workunit.client.1.smithi181.stdout:4/971: readlink d1/d1e/d2c/d67/d93/l9c 0 2024-04-03T08:39:40.658 INFO:tasks.workunit.client.0.smithi157.stdout:4/952: dread - da/df/d2f/d97/dc8/d13d/db9/f13f zero size 2024-04-03T08:39:40.658 INFO:tasks.workunit.client.1.smithi181.stdout:4/972: read d1/d16/d24/d5e/d3f/d81/f99 [168191,14665] 0 2024-04-03T08:39:40.661 INFO:tasks.workunit.client.0.smithi157.stdout:2/986: getdents d3/db/d44/d4c/d5a/d88/d97 0 2024-04-03T08:39:40.661 INFO:tasks.workunit.client.1.smithi181.stdout:5/892: creat d4/d22/d78/f126 x:0 0 0 2024-04-03T08:39:40.663 INFO:tasks.workunit.client.1.smithi181.stdout:9/926: creat d1/da/d28/d30/d3e/d4e/d62/d10c/f125 x:0 0 0 2024-04-03T08:39:40.663 INFO:tasks.workunit.client.1.smithi181.stdout:5/893: dread - d4/d18/d55/d5a/fd3 zero size 2024-04-03T08:39:40.665 INFO:tasks.workunit.client.1.smithi181.stdout:8/836: creat d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f112 x:0 0 0 2024-04-03T08:39:40.666 INFO:tasks.workunit.client.1.smithi181.stdout:4/973: creat d1/d16/d24/d5e/d2b/df2/f13e x:0 0 0 2024-04-03T08:39:40.669 INFO:tasks.workunit.client.1.smithi181.stdout:4/974: readlink d1/d16/d37/d34/d86/ded/l10c 0 2024-04-03T08:39:40.671 INFO:tasks.workunit.client.0.smithi157.stdout:4/953: dread da/df/d2f/d64/f7b [0,4194304] 0 2024-04-03T08:39:40.672 INFO:tasks.workunit.client.0.smithi157.stdout:2/987: link d3/db/d44/d4c/df1/ff9 d3/db/d44/d4c/df1/f14d 0 2024-04-03T08:39:40.672 INFO:tasks.workunit.client.1.smithi181.stdout:4/975: write d1/d16/d24/d5e/d3f/d81/d13b/f75 [1389295,6820] 0 2024-04-03T08:39:40.676 INFO:tasks.workunit.client.1.smithi181.stdout:8/837: symlink d4/d2a/d37/l113 0 2024-04-03T08:39:40.677 INFO:tasks.workunit.client.0.smithi157.stdout:4/954: symlink da/df/d99/ddb/l146 0 2024-04-03T08:39:40.679 INFO:tasks.workunit.client.1.smithi181.stdout:4/976: symlink d1/d1e/d2c/d10e/l13f 0 2024-04-03T08:39:40.680 INFO:tasks.workunit.client.1.smithi181.stdout:5/894: dread d4/d22/d78/f85 [0,4194304] 0 2024-04-03T08:39:40.681 INFO:tasks.workunit.client.0.smithi157.stdout:2/988: mknod d3/db/d44/d4c/d126/c14e 0 2024-04-03T08:39:40.683 INFO:tasks.workunit.client.1.smithi181.stdout:8/838: mkdir d4/d45/dae/dce/d114 0 2024-04-03T08:39:40.684 INFO:tasks.workunit.client.0.smithi157.stdout:4/955: unlink da/fad 0 2024-04-03T08:39:40.687 INFO:tasks.workunit.client.0.smithi157.stdout:4/956: write da/df/d11/d5d/fb2 [3027141,96566] 0 2024-04-03T08:39:40.688 INFO:tasks.workunit.client.1.smithi181.stdout:1/910: sync 2024-04-03T08:39:40.688 INFO:tasks.workunit.client.1.smithi181.stdout:3/951: sync 2024-04-03T08:39:40.688 INFO:tasks.workunit.client.1.smithi181.stdout:0/905: sync 2024-04-03T08:39:40.688 INFO:tasks.workunit.client.1.smithi181.stdout:2/995: sync 2024-04-03T08:39:40.688 INFO:tasks.workunit.client.1.smithi181.stdout:4/977: symlink d1/d1e/d2c/d67/d9d/l140 0 2024-04-03T08:39:40.691 INFO:tasks.workunit.client.1.smithi181.stdout:6/949: truncate d6/d3e/db1/dc4/d10f/dba/da6/fd5 300958 0 2024-04-03T08:39:40.696 INFO:tasks.workunit.client.1.smithi181.stdout:4/978: dread d1/d16/d24/d5e/d3f/d6c/fb4 [0,4194304] 0 2024-04-03T08:39:40.697 INFO:tasks.workunit.client.0.smithi157.stdout:2/989: dread d3/d2e/f90 [0,4194304] 0 2024-04-03T08:39:40.700 INFO:tasks.workunit.client.1.smithi181.stdout:1/911: fdatasync d10/d15/d4b/d6c/fa6 0 2024-04-03T08:39:40.704 INFO:tasks.workunit.client.0.smithi157.stdout:2/990: mknod d3/d2e/d32/de3/c14f 0 2024-04-03T08:39:40.705 INFO:tasks.workunit.client.1.smithi181.stdout:7/828: dwrite d0/d1/d6/f26 [0,4194304] 0 2024-04-03T08:39:40.707 INFO:tasks.workunit.client.0.smithi157.stdout:2/991: truncate d3/d12/f11d 948068 0 2024-04-03T08:39:40.708 INFO:tasks.workunit.client.1.smithi181.stdout:3/952: mkdir d0/d5/d6/d13b 0 2024-04-03T08:39:40.708 INFO:tasks.workunit.client.1.smithi181.stdout:4/979: read d1/d1e/d78/f97 [859281,2911] 0 2024-04-03T08:39:40.710 INFO:tasks.workunit.client.0.smithi157.stdout:2/992: readlink d3/db/d44/d12c/d55/l54 0 2024-04-03T08:39:40.712 INFO:tasks.workunit.client.1.smithi181.stdout:8/839: dread d4/d45/db/d14/fb5 [0,4194304] 0 2024-04-03T08:39:40.715 INFO:tasks.workunit.client.1.smithi181.stdout:0/906: link d5/dc/d14/de5/fe9 d5/d9/d2a/da1/f125 0 2024-04-03T08:39:40.717 INFO:tasks.workunit.client.1.smithi181.stdout:1/912: dwrite d10/d15/d17/d30/f79 [0,4194304] 0 2024-04-03T08:39:40.718 INFO:tasks.workunit.client.1.smithi181.stdout:8/840: chown d4/d44/d59/d5f/faa 41820 1 2024-04-03T08:39:40.719 INFO:tasks.workunit.client.1.smithi181.stdout:7/829: rmdir d0/d1/d6/db0 39 2024-04-03T08:39:40.720 INFO:tasks.workunit.client.1.smithi181.stdout:9/927: write d1/da/d13/d22/d23/d36/d91/d9d/dd7/fef [560084,40453] 0 2024-04-03T08:39:40.720 INFO:tasks.workunit.client.0.smithi157.stdout:2/993: mknod d3/db/d44/c150 0 2024-04-03T08:39:40.722 INFO:tasks.workunit.client.1.smithi181.stdout:9/928: fsync d1/da/d13/d41/ffa 0 2024-04-03T08:39:40.726 INFO:tasks.workunit.client.1.smithi181.stdout:0/907: mknod d5/d9/d2a/da1/df7/c126 0 2024-04-03T08:39:40.727 INFO:tasks.workunit.client.1.smithi181.stdout:0/908: chown d5/dc/d75/daa 888320800 1 2024-04-03T08:39:40.736 INFO:tasks.workunit.client.1.smithi181.stdout:8/841: creat d4/d2a/d37/dfb/f115 x:0 0 0 2024-04-03T08:39:40.738 INFO:tasks.workunit.client.1.smithi181.stdout:9/929: unlink d1/da/d13/d41/c10a 0 2024-04-03T08:39:40.738 INFO:tasks.workunit.client.1.smithi181.stdout:3/953: dwrite d0/d5/d6/d32/f11c [0,4194304] 0 2024-04-03T08:39:40.740 INFO:tasks.workunit.client.1.smithi181.stdout:4/980: rename d1/d16/l8b to d1/d16/d24/d5e/d3f/d81/d13b/d39/db1/l141 0 2024-04-03T08:39:40.741 INFO:tasks.workunit.client.0.smithi157.stdout:4/957: write da/df/d99/fab [1104444,60189] 0 2024-04-03T08:39:40.743 INFO:tasks.workunit.client.1.smithi181.stdout:1/913: creat d10/d69/dd1/d107/d119/f125 x:0 0 0 2024-04-03T08:39:40.745 INFO:tasks.workunit.client.0.smithi157.stdout:4/958: creat da/df/d24/d35/d6a/d78/f147 x:0 0 0 2024-04-03T08:39:40.745 INFO:tasks.workunit.client.1.smithi181.stdout:2/996: getdents d13/d1c/d4a/d7f/db3/d8f/d131 0 2024-04-03T08:39:40.746 INFO:tasks.workunit.client.1.smithi181.stdout:6/950: write d6/d3e/db1/dc4/d10f/dba/da6/f102 [592377,57115] 0 2024-04-03T08:39:40.749 INFO:tasks.workunit.client.1.smithi181.stdout:3/954: symlink d0/dbc/l13c 0 2024-04-03T08:39:40.751 INFO:tasks.workunit.client.1.smithi181.stdout:4/981: fsync d1/d16/f114 0 2024-04-03T08:39:40.752 INFO:tasks.workunit.client.1.smithi181.stdout:5/895: dwrite d4/d18/f5c [0,4194304] 0 2024-04-03T08:39:40.756 INFO:tasks.workunit.client.0.smithi157.stdout:2/994: write d3/d2e/d32/d9f/ff7 [2049885,29230] 0 2024-04-03T08:39:40.759 INFO:tasks.workunit.client.1.smithi181.stdout:5/896: chown d4/d22/d53/f6d 182343 1 2024-04-03T08:39:40.762 INFO:tasks.workunit.client.1.smithi181.stdout:8/842: truncate d4/d44/d59/f78 111483 0 2024-04-03T08:39:40.763 INFO:tasks.workunit.client.1.smithi181.stdout:5/897: fsync d4/d18/d55/db4/fa0 0 2024-04-03T08:39:40.765 INFO:tasks.workunit.client.1.smithi181.stdout:2/997: truncate d13/d1c/d4a/d68/f5b 960736 0 2024-04-03T08:39:40.766 INFO:tasks.workunit.client.1.smithi181.stdout:8/843: write d4/f27 [4156638,97096] 0 2024-04-03T08:39:40.768 INFO:tasks.workunit.client.1.smithi181.stdout:3/955: dread d0/d17/d36/d1e/fda [0,4194304] 0 2024-04-03T08:39:40.768 INFO:tasks.workunit.client.0.smithi157.stdout:2/995: symlink d3/db/d44/d4c/d5a/d88/dc6/d132/l151 0 2024-04-03T08:39:40.770 INFO:tasks.workunit.client.1.smithi181.stdout:5/898: write d4/d18/f65 [873331,118040] 0 2024-04-03T08:39:40.770 INFO:tasks.workunit.client.1.smithi181.stdout:0/909: link d5/dc/d10/d58/dba/fcf d5/dc/d75/de1/f127 0 2024-04-03T08:39:40.772 INFO:tasks.workunit.client.1.smithi181.stdout:8/844: truncate d4/fd8 92951 0 2024-04-03T08:39:40.772 INFO:tasks.workunit.client.1.smithi181.stdout:1/914: dwrite d10/d15/d17/d30/f7e [0,4194304] 0 2024-04-03T08:39:40.773 INFO:tasks.workunit.client.0.smithi157.stdout:2/996: mknod d3/d2e/d32/d9f/da7/c152 0 2024-04-03T08:39:40.775 INFO:tasks.workunit.client.1.smithi181.stdout:8/845: fdatasync d4/d45/ffd 0 2024-04-03T08:39:40.775 INFO:tasks.workunit.client.1.smithi181.stdout:3/956: chown d0/d17/d36/d3b/d5a/d93/l11d 7 1 2024-04-03T08:39:40.777 INFO:tasks.workunit.client.1.smithi181.stdout:4/982: fsync d1/d1e/f5b 0 2024-04-03T08:39:40.778 INFO:tasks.workunit.client.0.smithi157.stdout:4/959: dwrite da/df/d24/d35/d53/ff3 [0,4194304] 0 2024-04-03T08:39:40.779 INFO:tasks.workunit.client.0.smithi157.stdout:2/997: creat d3/d2e/d32/d3c/f153 x:0 0 0 2024-04-03T08:39:40.780 INFO:tasks.workunit.client.1.smithi181.stdout:9/930: link d1/da/d28/d80/ced d1/da/d1a/d92/dda/c126 0 2024-04-03T08:39:40.780 INFO:tasks.workunit.client.1.smithi181.stdout:3/957: read d0/dbc/fbf [398876,111948] 0 2024-04-03T08:39:40.780 INFO:tasks.workunit.client.1.smithi181.stdout:6/951: dread d6/d3e/db1/dc4/d10f/dba/da6/d4f/f7a [0,4194304] 0 2024-04-03T08:39:40.782 INFO:tasks.workunit.client.1.smithi181.stdout:2/998: symlink d13/d1c/d4a/d68/dfa/df9/d121/l16e 0 2024-04-03T08:39:40.784 INFO:tasks.workunit.client.1.smithi181.stdout:2/999: chown d13/da7/c163 257261 1 2024-04-03T08:39:40.784 INFO:tasks.workunit.client.1.smithi181.stdout:9/931: chown d1/da/d13/d22/d23/fcf 1 1 2024-04-03T08:39:40.786 INFO:tasks.workunit.client.1.smithi181.stdout:7/830: creat d0/d1/d6/de/d17/d27/d72/f12e x:0 0 0 2024-04-03T08:39:40.788 INFO:tasks.workunit.client.1.smithi181.stdout:8/846: dread d4/d45/db/d14/d31/d1c/d51/f8b [0,4194304] 0 2024-04-03T08:39:40.792 INFO:tasks.workunit.client.1.smithi181.stdout:8/847: write d4/d2a/f24 [5084831,105843] 0 2024-04-03T08:39:40.796 INFO:tasks.workunit.client.1.smithi181.stdout:0/910: write d5/dc/d10/d58/db0/db8/f103 [805990,15772] 0 2024-04-03T08:39:40.800 INFO:tasks.workunit.client.1.smithi181.stdout:8/848: chown d4/d45/db/d14/dd0/l105 207 1 2024-04-03T08:39:40.800 INFO:tasks.workunit.client.1.smithi181.stdout:3/958: unlink d0/d17/d56/cad 0 2024-04-03T08:39:40.800 INFO:tasks.workunit.client.1.smithi181.stdout:4/983: symlink d1/d16/d24/d5e/d3f/d81/d13b/d39/da1/l142 0 2024-04-03T08:39:40.801 INFO:tasks.workunit.client.1.smithi181.stdout:6/952: fdatasync d6/d3e/db1/dc4/d10f/dba/fde 0 2024-04-03T08:39:40.802 INFO:tasks.workunit.client.1.smithi181.stdout:5/899: dwrite d4/d22/d72/d93/f104 [0,4194304] 0 2024-04-03T08:39:40.803 INFO:tasks.workunit.client.1.smithi181.stdout:9/932: mkdir d1/da/d28/d30/d3e/d4e/d62/d10c/d127 0 2024-04-03T08:39:40.804 INFO:tasks.workunit.client.1.smithi181.stdout:3/959: chown d0/d5/d6/f4c 105920431 1 2024-04-03T08:39:40.805 INFO:tasks.workunit.client.1.smithi181.stdout:8/849: write d4/d45/db/fd [3845502,91509] 0 2024-04-03T08:39:40.805 INFO:tasks.workunit.client.1.smithi181.stdout:7/831: dread - d0/d1/d6/de/d17/d64/d82/d12d/ff1 zero size 2024-04-03T08:39:40.812 INFO:tasks.workunit.client.1.smithi181.stdout:4/984: fdatasync d1/d16/f13 0 2024-04-03T08:39:40.815 INFO:tasks.workunit.client.0.smithi157.stdout:1/893: sync 2024-04-03T08:39:40.815 INFO:tasks.workunit.client.1.smithi181.stdout:6/953: symlink d6/df6/l130 0 2024-04-03T08:39:40.815 INFO:tasks.workunit.client.0.smithi157.stdout:4/960: dwrite da/df/d2f/dd8/fe1 [0,4194304] 0 2024-04-03T08:39:40.816 INFO:tasks.workunit.client.1.smithi181.stdout:5/900: symlink d4/d18/d25/de7/l127 0 2024-04-03T08:39:40.818 INFO:tasks.workunit.client.1.smithi181.stdout:3/960: stat d0/d17/d40/ff3 0 2024-04-03T08:39:40.818 INFO:tasks.workunit.client.1.smithi181.stdout:5/901: stat d4/d18/d55/f69 0 2024-04-03T08:39:40.819 INFO:tasks.workunit.client.1.smithi181.stdout:1/915: link d10/d15/d17/d19/d33/le0 d10/d15/d17/d19/d4c/l126 0 2024-04-03T08:39:40.821 INFO:tasks.workunit.client.0.smithi157.stdout:2/998: dwrite d3/db/d44/d12c/d55/f59 [0,4194304] 0 2024-04-03T08:39:40.826 INFO:tasks.workunit.client.0.smithi157.stdout:2/999: write d3/db/f2a [1937214,71719] 0 2024-04-03T08:39:40.828 INFO:tasks.workunit.client.0.smithi157.stdout:1/894: mknod d2/d11/d23/dc9/d5d/d9a/c12b 0 2024-04-03T08:39:40.829 INFO:tasks.workunit.client.1.smithi181.stdout:8/850: fdatasync d4/d45/db/f3a 0 2024-04-03T08:39:40.834 INFO:tasks.workunit.client.1.smithi181.stdout:7/832: mknod d0/d1/d6/de/d17/d64/d85/d9a/da4/c12f 0 2024-04-03T08:39:40.835 INFO:tasks.workunit.client.1.smithi181.stdout:4/985: mknod d1/d16/d24/d61/df6/c143 0 2024-04-03T08:39:40.836 INFO:tasks.workunit.client.1.smithi181.stdout:3/961: dwrite d0/d17/d36/d1e/db5/f100 [0,4194304] 0 2024-04-03T08:39:40.838 INFO:tasks.workunit.client.0.smithi157.stdout:1/895: creat d2/d11/d24/d39/f12c x:0 0 0 2024-04-03T08:39:40.839 INFO:tasks.workunit.client.1.smithi181.stdout:6/954: creat d6/d31/f131 x:0 0 0 2024-04-03T08:39:40.842 INFO:tasks.workunit.client.1.smithi181.stdout:1/916: mknod d10/d15/d17/d19/d4c/c127 0 2024-04-03T08:39:40.844 INFO:tasks.workunit.client.1.smithi181.stdout:6/955: write d6/d3e/db1/dc4/d10f/f9c [711634,11628] 0 2024-04-03T08:39:40.844 INFO:tasks.workunit.client.1.smithi181.stdout:0/911: creat d5/d9/d2a/f128 x:0 0 0 2024-04-03T08:39:40.845 INFO:tasks.workunit.client.1.smithi181.stdout:5/902: truncate d4/d18/d55/d5a/dcd/dee/ff5 1947 0 2024-04-03T08:39:40.846 INFO:tasks.workunit.client.1.smithi181.stdout:9/933: write d1/da/d13/d41/daf/fe2 [26153,107723] 0 2024-04-03T08:39:40.849 INFO:tasks.workunit.client.1.smithi181.stdout:5/903: truncate d4/d44/f92 1307941 0 2024-04-03T08:39:40.853 INFO:tasks.workunit.client.0.smithi157.stdout:4/961: dwrite da/df/d2f/d64/d8f/dbd/d68/f138 [0,4194304] 0 2024-04-03T08:39:40.854 INFO:tasks.workunit.client.1.smithi181.stdout:7/833: creat d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/f130 x:0 0 0 2024-04-03T08:39:40.858 INFO:tasks.workunit.client.1.smithi181.stdout:3/962: fdatasync d0/d17/d36/d1e/ff0 0 2024-04-03T08:39:40.863 INFO:tasks.workunit.client.1.smithi181.stdout:1/917: creat d10/d15/d17/d23/daa/f128 x:0 0 0 2024-04-03T08:39:40.866 INFO:tasks.workunit.client.1.smithi181.stdout:4/986: dread d1/d16/d24/d5e/d3f/d81/d13b/d39/d5d/f88 [0,4194304] 0 2024-04-03T08:39:40.870 INFO:tasks.workunit.client.1.smithi181.stdout:9/934: mkdir d1/da/d13/d41/d65/d128 0 2024-04-03T08:39:40.870 INFO:tasks.workunit.client.1.smithi181.stdout:8/851: write d4/d44/f6f [2147650,21427] 0 2024-04-03T08:39:40.875 INFO:tasks.workunit.client.1.smithi181.stdout:6/956: truncate d6/d3e/db1/dc4/d10f/dba/da6/d4f/fa1 1290666 0 2024-04-03T08:39:40.877 INFO:tasks.workunit.client.1.smithi181.stdout:7/834: rename d0/d1 to d0/d1/d6/d131 22 2024-04-03T08:39:40.878 INFO:tasks.workunit.client.1.smithi181.stdout:6/957: truncate d6/d3e/db1/fe0 5506076 0 2024-04-03T08:39:40.880 INFO:tasks.workunit.client.1.smithi181.stdout:0/912: write d5/d9/d2a/de6/dcc/fd1 [2489446,104767] 0 2024-04-03T08:39:40.883 INFO:tasks.workunit.client.1.smithi181.stdout:1/918: truncate d10/d15/d17/d23/f78 746724 0 2024-04-03T08:39:40.891 INFO:tasks.workunit.client.1.smithi181.stdout:9/935: read d1/da/d13/d22/d23/d36/d9c/fa7 [4156602,33341] 0 2024-04-03T08:39:40.891 INFO:tasks.workunit.client.1.smithi181.stdout:5/904: dread d4/d18/f23 [0,4194304] 0 2024-04-03T08:39:40.895 INFO:tasks.workunit.client.1.smithi181.stdout:7/835: mkdir d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d132 0 2024-04-03T08:39:40.898 INFO:tasks.workunit.client.1.smithi181.stdout:0/913: creat d5/dc/d10/d58/db0/db8/f129 x:0 0 0 2024-04-03T08:39:40.901 INFO:tasks.workunit.client.1.smithi181.stdout:6/958: mkdir d6/d11e/d132 0 2024-04-03T08:39:40.902 INFO:tasks.workunit.client.1.smithi181.stdout:6/959: readlink d6/l30 0 2024-04-03T08:39:40.902 INFO:tasks.workunit.client.1.smithi181.stdout:9/936: symlink d1/da/d28/d80/d10d/l129 0 2024-04-03T08:39:40.902 INFO:tasks.workunit.client.1.smithi181.stdout:3/963: dwrite d0/d5/d6/d3f/fb3 [0,4194304] 0 2024-04-03T08:39:40.906 INFO:tasks.workunit.client.1.smithi181.stdout:5/905: rename d4/d18/f23 to d4/d18/d25/dac/f128 0 2024-04-03T08:39:40.908 INFO:tasks.workunit.client.1.smithi181.stdout:4/987: creat d1/d1e/f144 x:0 0 0 2024-04-03T08:39:40.910 INFO:tasks.workunit.client.1.smithi181.stdout:8/852: creat d4/d2a/d37/f116 x:0 0 0 2024-04-03T08:39:40.916 INFO:tasks.workunit.client.1.smithi181.stdout:7/836: dwrite d0/d1/d6/de/d17/d64/d85/d87/fd3 [0,4194304] 0 2024-04-03T08:39:40.916 INFO:tasks.workunit.client.1.smithi181.stdout:0/914: creat d5/dc/d14/d8d/dec/f12a x:0 0 0 2024-04-03T08:39:40.920 INFO:tasks.workunit.client.1.smithi181.stdout:5/906: mknod d4/d44/c129 0 2024-04-03T08:39:40.925 INFO:tasks.workunit.client.1.smithi181.stdout:6/960: dwrite d6/d3e/db1/dc4/d10f/f5d [0,4194304] 0 2024-04-03T08:39:40.926 INFO:tasks.workunit.client.1.smithi181.stdout:6/961: chown d6/dc0/d103/f105 10 1 2024-04-03T08:39:40.927 INFO:tasks.workunit.client.1.smithi181.stdout:3/964: truncate d0/d17/d36/d3b/d5a/fd1 471933 0 2024-04-03T08:39:40.927 INFO:tasks.workunit.client.1.smithi181.stdout:9/937: rename d1/da/d13/d22/d23/d36/d91/lc2 to d1/da/d13/d41/daf/l12a 0 2024-04-03T08:39:40.929 INFO:tasks.workunit.client.0.smithi157.stdout:1/896: creat d2/d11/d24/d39/d3b/d1b/d90/f12d x:0 0 0 2024-04-03T08:39:40.929 INFO:tasks.workunit.client.1.smithi181.stdout:6/962: write d6/d53/f91 [1623830,97906] 0 2024-04-03T08:39:40.932 INFO:tasks.workunit.client.1.smithi181.stdout:0/915: symlink d5/dc/d14/d8d/dec/l12b 0 2024-04-03T08:39:40.936 INFO:tasks.workunit.client.1.smithi181.stdout:0/916: write d5/fef [61155,27033] 0 2024-04-03T08:39:40.937 INFO:tasks.workunit.client.1.smithi181.stdout:5/907: symlink d4/d44/d71/dcf/l12a 0 2024-04-03T08:39:40.939 INFO:tasks.workunit.client.1.smithi181.stdout:7/837: dwrite d0/d1/d6/de/d17/d64/d85/dd8/f108 [0,4194304] 0 2024-04-03T08:39:40.940 INFO:tasks.workunit.client.1.smithi181.stdout:5/908: chown d4/d44/c47 437848 1 2024-04-03T08:39:40.941 INFO:tasks.workunit.client.0.smithi157.stdout:4/962: truncate da/df/d2f/d64/faf 117272 0 2024-04-03T08:39:40.946 INFO:tasks.workunit.client.0.smithi157.stdout:1/897: dread - d2/d11/d23/dc9/d58/d62/fd4 zero size 2024-04-03T08:39:40.946 INFO:tasks.workunit.client.1.smithi181.stdout:3/965: mknod d0/d57/c13d 0 2024-04-03T08:39:40.948 INFO:tasks.workunit.client.1.smithi181.stdout:3/966: write d0/d5/d6/d32/f11c [192765,111244] 0 2024-04-03T08:39:40.952 INFO:tasks.workunit.client.1.smithi181.stdout:9/938: symlink d1/da/d13/d22/d23/de0/l12b 0 2024-04-03T08:39:40.954 INFO:tasks.workunit.client.1.smithi181.stdout:6/963: unlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f39 0 2024-04-03T08:39:40.957 INFO:tasks.workunit.client.0.smithi157.stdout:4/963: creat da/df/d11/f148 x:0 0 0 2024-04-03T08:39:40.958 INFO:tasks.workunit.client.0.smithi157.stdout:4/964: chown da/df/d11/df9/d126 60060519 1 2024-04-03T08:39:40.961 INFO:tasks.workunit.client.0.smithi157.stdout:1/898: link d2/d11/d23/dc9/d5d/d9a/lbf d2/d11/d24/d39/d3b/d1b/d7f/d128/l12e 0 2024-04-03T08:39:40.965 INFO:tasks.workunit.client.1.smithi181.stdout:5/909: symlink d4/d18/d25/dac/l12b 0 2024-04-03T08:39:40.966 INFO:tasks.workunit.client.1.smithi181.stdout:5/910: chown d4/d18/d2c/fd2 20991 1 2024-04-03T08:39:40.970 INFO:tasks.workunit.client.1.smithi181.stdout:3/967: mkdir d0/d17/d36/d3b/d13e 0 2024-04-03T08:39:40.971 INFO:tasks.workunit.client.1.smithi181.stdout:9/939: mkdir d1/da/d1a/d92/dda/d12c 0 2024-04-03T08:39:40.973 INFO:tasks.workunit.client.1.smithi181.stdout:9/940: write d1/da/d28/f6b [4350087,84995] 0 2024-04-03T08:39:40.974 INFO:tasks.workunit.client.1.smithi181.stdout:9/941: stat d1/da/d1a/c69 0 2024-04-03T08:39:40.977 INFO:tasks.workunit.client.1.smithi181.stdout:8/853: rename d4/d45/db/d14/d31/f30 to d4/d45/d9/f117 0 2024-04-03T08:39:40.978 INFO:tasks.workunit.client.0.smithi157.stdout:4/965: dread da/df/d24/d35/d6a/d78/fb0 [0,4194304] 0 2024-04-03T08:39:40.982 INFO:tasks.workunit.client.1.smithi181.stdout:3/968: fdatasync d0/d5/d6/d32/daa/d129/d5f/f10d 0 2024-04-03T08:39:40.987 INFO:tasks.workunit.client.1.smithi181.stdout:4/988: write d1/d16/d37/f7d [4776418,3766] 0 2024-04-03T08:39:40.988 INFO:tasks.workunit.client.1.smithi181.stdout:8/854: unlink d4/d44/ff1 0 2024-04-03T08:39:40.989 INFO:tasks.workunit.client.1.smithi181.stdout:9/942: dwrite d1/da/d13/d22/d23/d36/d91/d9d/daa/fea [0,4194304] 0 2024-04-03T08:39:40.990 INFO:tasks.workunit.client.1.smithi181.stdout:8/855: readlink d4/d45/db/l10 0 2024-04-03T08:39:40.990 INFO:tasks.workunit.client.0.smithi157.stdout:4/966: fsync da/df/d11/f11e 0 2024-04-03T08:39:40.992 INFO:tasks.workunit.client.1.smithi181.stdout:3/969: mknod d0/d17/d36/d3b/c13f 0 2024-04-03T08:39:40.992 INFO:tasks.workunit.client.0.smithi157.stdout:4/967: dread - da/df/d2f/d54/fb4 zero size 2024-04-03T08:39:40.994 INFO:tasks.workunit.client.1.smithi181.stdout:7/838: link d0/d1/d6/de/c67 d0/c133 0 2024-04-03T08:39:40.996 INFO:tasks.workunit.client.1.smithi181.stdout:4/989: creat d1/d16/d24/d5e/d3f/d81/d13b/d39/d5d/d9a/dfb/f145 x:0 0 0 2024-04-03T08:39:41.001 INFO:tasks.workunit.client.1.smithi181.stdout:0/917: write d5/d9/f3e [3096616,119634] 0 2024-04-03T08:39:41.001 INFO:tasks.workunit.client.1.smithi181.stdout:8/856: dread d4/d44/f100 [0,4194304] 0 2024-04-03T08:39:41.001 INFO:tasks.workunit.client.0.smithi157.stdout:4/968: unlink da/df/d2f/d54/f5a 0 2024-04-03T08:39:41.005 INFO:tasks.workunit.client.0.smithi157.stdout:1/899: write d2/d11/d23/dc9/d58/d62/d74/fb7 [2218988,12424] 0 2024-04-03T08:39:41.006 INFO:tasks.workunit.client.1.smithi181.stdout:7/839: chown d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/f130 6756 1 2024-04-03T08:39:41.008 INFO:tasks.workunit.client.1.smithi181.stdout:6/964: dwrite d6/d3e/db1/dc4/dc9/ffe [0,4194304] 0 2024-04-03T08:39:41.008 INFO:tasks.workunit.client.1.smithi181.stdout:4/990: symlink d1/d16/d24/d5e/d3f/d81/d13b/d39/db1/l146 0 2024-04-03T08:39:41.011 INFO:tasks.workunit.client.1.smithi181.stdout:8/857: unlink d4/d2a/l1e 0 2024-04-03T08:39:41.011 INFO:tasks.workunit.client.1.smithi181.stdout:5/911: write d4/d18/d25/f3c [3854615,122044] 0 2024-04-03T08:39:41.013 INFO:tasks.workunit.client.0.smithi157.stdout:1/900: creat d2/d11/d23/dc9/d5d/d9a/f12f x:0 0 0 2024-04-03T08:39:41.016 INFO:tasks.workunit.client.0.smithi157.stdout:4/969: dread da/df/d11/f66 [0,4194304] 0 2024-04-03T08:39:41.016 INFO:tasks.workunit.client.1.smithi181.stdout:9/943: dwrite d1/da/d13/d22/d23/d36/d91/d9d/daa/ff3 [4194304,4194304] 0 2024-04-03T08:39:41.017 INFO:tasks.workunit.client.1.smithi181.stdout:7/840: chown d0/d1/d6/ca 436 1 2024-04-03T08:39:41.021 INFO:tasks.workunit.client.1.smithi181.stdout:7/841: dread - d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f127 zero size 2024-04-03T08:39:41.022 INFO:tasks.workunit.client.0.smithi157.stdout:1/901: dread - d2/d11/d23/dc9/da1/ded/f10c zero size 2024-04-03T08:39:41.026 INFO:tasks.workunit.client.0.smithi157.stdout:1/902: readlink d2/d11/d24/d39/d3b/d1b/l110 0 2024-04-03T08:39:41.029 INFO:tasks.workunit.client.1.smithi181.stdout:9/944: chown d1/da/d28/d30/d3e/d4e/f68 7676 1 2024-04-03T08:39:41.032 INFO:tasks.workunit.client.0.smithi157.stdout:4/970: dread da/f8b [4194304,4194304] 0 2024-04-03T08:39:41.033 INFO:tasks.workunit.client.1.smithi181.stdout:4/991: creat d1/d16/d24/d5e/d3f/f147 x:0 0 0 2024-04-03T08:39:41.034 INFO:tasks.workunit.client.1.smithi181.stdout:3/970: dwrite d0/d5/d6/d32/fdc [0,4194304] 0 2024-04-03T08:39:41.036 INFO:tasks.workunit.client.1.smithi181.stdout:4/992: write d1/d1e/d2c/f59 [8100617,103883] 0 2024-04-03T08:39:41.037 INFO:tasks.workunit.client.1.smithi181.stdout:3/971: chown d0/d17/d36/d1e/f80 757 1 2024-04-03T08:39:41.037 INFO:tasks.workunit.client.1.smithi181.stdout:7/842: mknod d0/d1/d6/de/d17/d27/c134 0 2024-04-03T08:39:41.038 INFO:tasks.workunit.client.1.smithi181.stdout:6/965: link d6/f3a d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64/d10b/f133 0 2024-04-03T08:39:41.038 INFO:tasks.workunit.client.0.smithi157.stdout:4/971: mknod da/df/d24/d35/c149 0 2024-04-03T08:39:41.039 INFO:tasks.workunit.client.0.smithi157.stdout:1/903: link d2/d11/d23/dc9/d64/lfc d2/d11/d24/d39/d3b/d2e/d66/d91/d97/l130 0 2024-04-03T08:39:41.041 INFO:tasks.workunit.client.1.smithi181.stdout:6/966: write d6/d3e/d40/fb3 [1463561,66988] 0 2024-04-03T08:39:41.043 INFO:tasks.workunit.client.1.smithi181.stdout:8/858: rename d4/d45/d9/f4d to d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f118 0 2024-04-03T08:39:41.046 INFO:tasks.workunit.client.1.smithi181.stdout:0/918: getdents d5/dc/d8e/dea 0 2024-04-03T08:39:41.046 INFO:tasks.workunit.client.0.smithi157.stdout:4/972: rename da/df/d11/f82 to da/df/d11/d5d/f14a 0 2024-04-03T08:39:41.047 INFO:tasks.workunit.client.1.smithi181.stdout:4/993: truncate d1/d16/d24/d5e/d3f/d6c/f104 907020 0 2024-04-03T08:39:41.049 INFO:tasks.workunit.client.1.smithi181.stdout:5/912: link d4/l15 d4/d18/d25/de7/l12c 0 2024-04-03T08:39:41.053 INFO:tasks.workunit.client.1.smithi181.stdout:4/994: truncate d1/d16/d24/d5e/d3f/d81/d13b/d39/db1/f137 262886 0 2024-04-03T08:39:41.054 INFO:tasks.workunit.client.1.smithi181.stdout:7/843: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/l135 0 2024-04-03T08:39:41.056 INFO:tasks.workunit.client.1.smithi181.stdout:3/972: truncate d0/d5/d6/d32/daa/d129/d5f/f10d 89563 0 2024-04-03T08:39:41.056 INFO:tasks.workunit.client.0.smithi157.stdout:1/904: dwrite d2/d11/d24/d39/f117 [0,4194304] 0 2024-04-03T08:39:41.058 INFO:tasks.workunit.client.0.smithi157.stdout:4/973: rmdir da/de0 39 2024-04-03T08:39:41.062 INFO:tasks.workunit.client.0.smithi157.stdout:1/905: creat d2/d11/d24/d108/f131 x:0 0 0 2024-04-03T08:39:41.069 INFO:tasks.workunit.client.1.smithi181.stdout:5/913: dwrite d4/d18/d55/d5a/dcd/dee/f101 [0,4194304] 0 2024-04-03T08:39:41.070 INFO:tasks.workunit.client.0.smithi157.stdout:1/906: rename d2/d11/f98 to d2/d11/d24/d39/d115/f132 0 2024-04-03T08:39:41.074 INFO:tasks.workunit.client.0.smithi157.stdout:4/974: creat da/df/f14b x:0 0 0 2024-04-03T08:39:41.078 INFO:tasks.workunit.client.0.smithi157.stdout:4/975: dread - da/df/d99/da8/fe9 zero size 2024-04-03T08:39:41.081 INFO:tasks.workunit.client.1.smithi181.stdout:6/967: symlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/l134 0 2024-04-03T08:39:41.081 INFO:tasks.workunit.client.1.smithi181.stdout:0/919: mknod d5/dc/d10/d58/db0/d11d/c12c 0 2024-04-03T08:39:41.082 INFO:tasks.workunit.client.0.smithi157.stdout:1/907: mkdir d2/d11/d24/d39/d3b/d2e/d66/d91/d133 0 2024-04-03T08:39:41.082 INFO:tasks.workunit.client.0.smithi157.stdout:4/976: chown da/df/d2f/d97/dc8/d13d/d95/f10a 809311 1 2024-04-03T08:39:41.083 INFO:tasks.workunit.client.1.smithi181.stdout:3/973: chown d0/d5/d6f/le5 1 1 2024-04-03T08:39:41.087 INFO:tasks.workunit.client.1.smithi181.stdout:5/914: mkdir d4/d22/d53/d98/dc2/d12d 0 2024-04-03T08:39:41.087 INFO:tasks.workunit.client.1.smithi181.stdout:1/919: sync 2024-04-03T08:39:41.092 INFO:tasks.workunit.client.1.smithi181.stdout:4/995: dwrite d1/d1e/d2c/de4/f110 [0,4194304] 0 2024-04-03T08:39:41.093 INFO:tasks.workunit.client.1.smithi181.stdout:6/968: mkdir d6/d3e/d40/d135 0 2024-04-03T08:39:41.096 INFO:tasks.workunit.client.1.smithi181.stdout:7/844: dread d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:41.097 INFO:tasks.workunit.client.0.smithi157.stdout:1/908: fsync d2/d11/d24/d39/d3b/d2e/d66/f125 0 2024-04-03T08:39:41.098 INFO:tasks.workunit.client.1.smithi181.stdout:9/945: dwrite d1/da/d13/d22/d23/de0/f98 [0,4194304] 0 2024-04-03T08:39:41.102 INFO:tasks.workunit.client.1.smithi181.stdout:0/920: mkdir d5/d9/d12d 0 2024-04-03T08:39:41.104 INFO:tasks.workunit.client.0.smithi157.stdout:1/909: symlink d2/d11/d23/dc9/d5d/db4/l134 0 2024-04-03T08:39:41.104 INFO:tasks.workunit.client.1.smithi181.stdout:1/920: truncate d10/d15/d17/d37/fb7 291028 0 2024-04-03T08:39:41.104 INFO:tasks.workunit.client.1.smithi181.stdout:8/859: dwrite d4/d45/db/d14/f42 [4194304,4194304] 0 2024-04-03T08:39:41.107 INFO:tasks.workunit.client.1.smithi181.stdout:4/996: chown d1/d16/d37/d34/d86/ded/dfa 88586619 1 2024-04-03T08:39:41.107 INFO:tasks.workunit.client.1.smithi181.stdout:1/921: chown d10/d15/f34 508964 1 2024-04-03T08:39:41.108 INFO:tasks.workunit.client.1.smithi181.stdout:7/845: symlink d0/l136 0 2024-04-03T08:39:41.118 INFO:tasks.workunit.client.0.smithi157.stdout:1/910: fdatasync d2/d11/f26 0 2024-04-03T08:39:41.118 INFO:tasks.workunit.client.0.smithi157.stdout:4/977: write da/df/d99/ddb/fdc [1004015,127665] 0 2024-04-03T08:39:41.120 INFO:tasks.workunit.client.0.smithi157.stdout:1/911: dread - d2/d11/d24/d39/f12c zero size 2024-04-03T08:39:41.121 INFO:tasks.workunit.client.1.smithi181.stdout:0/921: symlink d5/d9/d2a/de6/l12e 0 2024-04-03T08:39:41.122 INFO:tasks.workunit.client.1.smithi181.stdout:4/997: chown d1/d16/d24/d5e/d3f 448 1 2024-04-03T08:39:41.124 INFO:tasks.workunit.client.1.smithi181.stdout:9/946: readlink d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/ld2 0 2024-04-03T08:39:41.125 INFO:tasks.workunit.client.0.smithi157.stdout:1/912: unlink d2/d11/d24/d39/l82 0 2024-04-03T08:39:41.127 INFO:tasks.workunit.client.1.smithi181.stdout:5/915: link d4/c33 d4/d22/d72/c12e 0 2024-04-03T08:39:41.129 INFO:tasks.workunit.client.0.smithi157.stdout:4/978: rename da/df/d2f/d54/l62 to da/df/d2f/d64/d8f/dbd/d68/d143/l14c 0 2024-04-03T08:39:41.131 INFO:tasks.workunit.client.1.smithi181.stdout:4/998: write d1/d1e/d82/d84/fe6 [6462312,52116] 0 2024-04-03T08:39:41.131 INFO:tasks.workunit.client.1.smithi181.stdout:3/974: dread d0/d5/fe6 [0,4194304] 0 2024-04-03T08:39:41.135 INFO:tasks.workunit.client.0.smithi157.stdout:1/913: creat d2/d11/d23/dc9/da1/f135 x:0 0 0 2024-04-03T08:39:41.136 INFO:tasks.workunit.client.1.smithi181.stdout:7/846: symlink d0/d1/d6/de/d17/d64/l137 0 2024-04-03T08:39:41.136 INFO:tasks.workunit.client.0.smithi157.stdout:1/914: chown d2/d11/d24 47727 1 2024-04-03T08:39:41.138 INFO:tasks.workunit.client.0.smithi157.stdout:4/979: mkdir da/df/d2f/d97/dc8/d13d/db9/d14d 0 2024-04-03T08:39:41.142 INFO:tasks.workunit.client.1.smithi181.stdout:0/922: rename d5/dc/d8e/dea to d5/d9/d2a/da1/df7/d10a/d12f 0 2024-04-03T08:39:41.142 INFO:tasks.workunit.client.0.smithi157.stdout:1/915: readlink d2/d11/d23/dc9/l104 0 2024-04-03T08:39:41.144 INFO:tasks.workunit.client.0.smithi157.stdout:4/980: creat da/df/d2f/dbc/dbe/d133/f14e x:0 0 0 2024-04-03T08:39:41.145 INFO:tasks.workunit.client.0.smithi157.stdout:4/981: stat da/df/f57 0 2024-04-03T08:39:41.147 INFO:tasks.workunit.client.1.smithi181.stdout:8/860: creat d4/d44/df3/f119 x:0 0 0 2024-04-03T08:39:41.148 INFO:tasks.workunit.client.0.smithi157.stdout:1/916: mknod d2/d11/d24/d108/c136 0 2024-04-03T08:39:41.151 INFO:tasks.workunit.client.0.smithi157.stdout:1/917: write d2/d11/d24/d39/f12c [365979,809] 0 2024-04-03T08:39:41.152 INFO:tasks.workunit.client.1.smithi181.stdout:3/975: mknod d0/d17/d10f/c140 0 2024-04-03T08:39:41.152 INFO:tasks.workunit.client.1.smithi181.stdout:1/922: write d10/d15/d17/d37/fb7 [926120,70074] 0 2024-04-03T08:39:41.153 INFO:tasks.workunit.client.1.smithi181.stdout:7/847: creat d0/d1/d94/f138 x:0 0 0 2024-04-03T08:39:41.154 INFO:tasks.workunit.client.1.smithi181.stdout:3/976: write d0/d17/d40/fea [3471757,17558] 0 2024-04-03T08:39:41.154 INFO:tasks.workunit.client.0.smithi157.stdout:4/982: truncate da/df/d2f/d64/d8f/dbd/fa4 783868 0 2024-04-03T08:39:41.156 INFO:tasks.workunit.client.1.smithi181.stdout:3/977: chown d0/d17/f54 21640358 1 2024-04-03T08:39:41.157 INFO:tasks.workunit.client.1.smithi181.stdout:9/947: rename d1/da/d13/d22/f31 to d1/da/d13/deb/f12d 0 2024-04-03T08:39:41.158 INFO:tasks.workunit.client.1.smithi181.stdout:0/923: mknod d5/dc/d14/de5/c130 0 2024-04-03T08:39:41.160 INFO:tasks.workunit.client.0.smithi157.stdout:1/918: mkdir d2/d11/d23/dc9/d5d/db4/dbc/def/d137 0 2024-04-03T08:39:41.163 INFO:tasks.workunit.client.0.smithi157.stdout:4/983: read da/fdd [1167696,61012] 0 2024-04-03T08:39:41.164 INFO:tasks.workunit.client.1.smithi181.stdout:8/861: read d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f118 [2823931,28212] 0 2024-04-03T08:39:41.165 INFO:tasks.workunit.client.0.smithi157.stdout:1/919: symlink d2/d11/d23/de1/l138 0 2024-04-03T08:39:41.168 INFO:tasks.workunit.client.0.smithi157.stdout:1/920: dread - d2/d11/d23/dc9/d5d/d9a/f12f zero size 2024-04-03T08:39:41.170 INFO:tasks.workunit.client.1.smithi181.stdout:3/978: unlink d0/d17/d36/d3b/d102/l114 0 2024-04-03T08:39:41.175 INFO:tasks.workunit.client.1.smithi181.stdout:5/916: link d4/d22/d78/f7f d4/d18/d25/d59/db3/dda/f12f 0 2024-04-03T08:39:41.177 INFO:tasks.workunit.client.1.smithi181.stdout:5/917: chown d4/d18/d55/db4/ce0 59 1 2024-04-03T08:39:41.178 INFO:tasks.workunit.client.1.smithi181.stdout:8/862: symlink d4/l11a 0 2024-04-03T08:39:41.181 INFO:tasks.workunit.client.0.smithi157.stdout:4/984: rename da/df/d24/d35/d6a/d78/l111 to da/df/d99/d107/l14f 0 2024-04-03T08:39:41.184 INFO:tasks.workunit.client.1.smithi181.stdout:7/848: rename d0/d1/d6/de/d17/d27/f28 to d0/d1/d94/f139 0 2024-04-03T08:39:41.186 INFO:tasks.workunit.client.0.smithi157.stdout:1/921: symlink d2/d11/d23/dc9/l139 0 2024-04-03T08:39:41.189 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:40 smithi157 ceph-mon[35083]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 114 MiB/s rd, 239 MiB/s wr, 572 op/s 2024-04-03T08:39:41.190 INFO:tasks.workunit.client.1.smithi181.stdout:1/923: dread d10/d15/d17/d30/f38 [0,4194304] 0 2024-04-03T08:39:41.196 INFO:tasks.workunit.client.0.smithi157.stdout:4/985: rename da/df/d2f/d64/d8f/dbd/d68/dce/fea to da/df/d2f/d64/d8f/dbd/d68/f150 0 2024-04-03T08:39:41.198 INFO:tasks.workunit.client.0.smithi157.stdout:4/986: fsync da/df/d2f/d97/dc8/d13d/f122 0 2024-04-03T08:39:41.201 INFO:tasks.workunit.client.0.smithi157.stdout:4/987: truncate da/df/f14b 410412 0 2024-04-03T08:39:41.202 INFO:tasks.workunit.client.0.smithi157.stdout:1/922: creat d2/d11/d23/dc9/d5d/db4/dbc/def/d137/f13a x:0 0 0 2024-04-03T08:39:41.203 INFO:tasks.workunit.client.1.smithi181.stdout:0/924: write d5/dc/d10/f86 [303590,8148] 0 2024-04-03T08:39:41.205 INFO:tasks.workunit.client.0.smithi157.stdout:1/923: fsync d2/d11/d24/fb2 0 2024-04-03T08:39:41.205 INFO:tasks.workunit.client.1.smithi181.stdout:7/849: fdatasync d0/f9f 0 2024-04-03T08:39:41.207 INFO:tasks.workunit.client.1.smithi181.stdout:1/924: dread d10/d15/d17/d19/d33/f6a [0,4194304] 0 2024-04-03T08:39:41.208 INFO:tasks.workunit.client.1.smithi181.stdout:0/925: readlink d5/dc/d8e/l9b 0 2024-04-03T08:39:41.209 INFO:tasks.workunit.client.1.smithi181.stdout:4/999: dwrite d1/d16/d37/d34/d85/fc9 [0,4194304] 0 2024-04-03T08:39:41.211 INFO:tasks.workunit.client.0.smithi157.stdout:4/988: creat da/df/d2f/d64/d8f/f151 x:0 0 0 2024-04-03T08:39:41.212 INFO:tasks.workunit.client.1.smithi181.stdout:0/926: chown d5/d9/d2a/da1/df7/c126 15 1 2024-04-03T08:39:41.214 INFO:tasks.workunit.client.1.smithi181.stdout:7/850: readlink d0/d1/d6/lf5 0 2024-04-03T08:39:41.215 INFO:tasks.workunit.client.1.smithi181.stdout:9/948: dwrite d1/da/d13/d41/d65/dbb/fe7 [0,4194304] 0 2024-04-03T08:39:41.222 INFO:tasks.workunit.client.1.smithi181.stdout:1/925: mknod d10/d69/dd1/d113/c129 0 2024-04-03T08:39:41.222 INFO:tasks.workunit.client.1.smithi181.stdout:8/863: write d4/f27 [1333172,113609] 0 2024-04-03T08:39:41.222 INFO:tasks.workunit.client.1.smithi181.stdout:9/949: readlink d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/ld2 0 2024-04-03T08:39:41.226 INFO:tasks.workunit.client.1.smithi181.stdout:1/926: chown d10/d15/d17/d19/f2f 368709 1 2024-04-03T08:39:41.226 INFO:tasks.workunit.client.1.smithi181.stdout:3/979: dwrite d0/d5/d6/d32/d43/f60 [0,4194304] 0 2024-04-03T08:39:41.234 INFO:tasks.workunit.client.1.smithi181.stdout:1/927: chown d10/d15/d17/d19/d33/d70/fc8 1557463 1 2024-04-03T08:39:41.237 INFO:tasks.workunit.client.0.smithi157.stdout:1/924: getdents d2/d11/d23/dc9/d86 0 2024-04-03T08:39:41.240 INFO:tasks.workunit.client.1.smithi181.stdout:3/980: rmdir d0/d5/d6/d13b 0 2024-04-03T08:39:41.243 INFO:tasks.workunit.client.1.smithi181.stdout:8/864: rename d4/d45/db/d14/d31/d1c/d51/f8b to d4/d44/d59/d5f/f11b 0 2024-04-03T08:39:41.245 INFO:tasks.workunit.client.0.smithi157.stdout:1/925: mkdir d2/d11/d23/de1/d13b 0 2024-04-03T08:39:41.247 INFO:tasks.workunit.client.1.smithi181.stdout:1/928: truncate d10/d15/d17/d23/d27/f92 2702121 0 2024-04-03T08:39:41.250 INFO:tasks.workunit.client.1.smithi181.stdout:1/929: symlink d10/d69/dd1/d107/l12a 0 2024-04-03T08:39:41.250 INFO:tasks.workunit.client.1.smithi181.stdout:3/981: dread d0/d5/d6/d32/daa/fd5 [0,4194304] 0 2024-04-03T08:39:41.253 INFO:tasks.workunit.client.1.smithi181.stdout:3/982: symlink d0/d57/l141 0 2024-04-03T08:39:41.254 INFO:tasks.workunit.client.0.smithi157.stdout:4/989: dread da/df/d2f/d54/f67 [0,4194304] 0 2024-04-03T08:39:41.256 INFO:tasks.workunit.client.1.smithi181.stdout:3/983: fsync d0/d17/f82 0 2024-04-03T08:39:41.258 INFO:tasks.workunit.client.1.smithi181.stdout:1/930: link d10/d15/d17/d37/de3/f100 d10/d15/d17/d23/daa/f12b 0 2024-04-03T08:39:41.259 INFO:tasks.workunit.client.1.smithi181.stdout:7/851: dread d0/d1/d6/de/d17/fee [0,4194304] 0 2024-04-03T08:39:41.265 INFO:tasks.workunit.client.0.smithi157.stdout:4/990: dread da/df/d2f/d64/faf [0,4194304] 0 2024-04-03T08:39:41.265 INFO:tasks.workunit.client.1.smithi181.stdout:1/931: creat d10/df6/f12c x:0 0 0 2024-04-03T08:39:41.268 INFO:tasks.workunit.client.1.smithi181.stdout:7/852: fdatasync d0/d1/d6/de/f42 0 2024-04-03T08:39:41.269 INFO:tasks.workunit.client.1.smithi181.stdout:1/932: creat d10/da1/f12d x:0 0 0 2024-04-03T08:39:41.270 INFO:tasks.workunit.client.0.smithi157.stdout:4/991: symlink da/df/d2f/d97/dc8/d145/l152 0 2024-04-03T08:39:41.271 INFO:tasks.workunit.client.0.smithi157.stdout:1/926: dread d2/d11/d24/d39/d3b/d1b/f4e [0,4194304] 0 2024-04-03T08:39:41.273 INFO:tasks.workunit.client.0.smithi157.stdout:1/927: readlink d2/d11/d23/dc9/l139 0 2024-04-03T08:39:41.275 INFO:tasks.workunit.client.0.smithi157.stdout:1/928: stat d2/d11/d24/d39/d3b/d2e/d66/fce 0 2024-04-03T08:39:41.275 INFO:tasks.workunit.client.1.smithi181.stdout:1/933: mknod d10/d69/c12e 0 2024-04-03T08:39:41.276 INFO:tasks.workunit.client.1.smithi181.stdout:1/934: stat d10/d15/d41/f44 0 2024-04-03T08:39:41.279 INFO:tasks.workunit.client.1.smithi181.stdout:3/984: write d0/d17/f54 [805241,61098] 0 2024-04-03T08:39:41.281 INFO:tasks.workunit.client.1.smithi181.stdout:1/935: symlink d10/d15/d4b/d6c/d120/l12f 0 2024-04-03T08:39:41.283 INFO:tasks.workunit.client.1.smithi181.stdout:1/936: chown d10/d69/dd1/d113/c129 1178898 1 2024-04-03T08:39:41.284 INFO:tasks.workunit.client.1.smithi181.stdout:3/985: creat d0/d17/d36/d3b/f142 x:0 0 0 2024-04-03T08:39:41.285 INFO:tasks.workunit.client.1.smithi181.stdout:7/853: write d0/d1/d6/f68 [25707,23348] 0 2024-04-03T08:39:41.287 INFO:tasks.workunit.client.1.smithi181.stdout:1/937: symlink d10/d15/d4a/l130 0 2024-04-03T08:39:41.287 INFO:tasks.workunit.client.1.smithi181.stdout:6/969: sync 2024-04-03T08:39:41.289 INFO:tasks.workunit.client.0.smithi157.stdout:1/929: write d2/d11/d23/fc1 [585229,93369] 0 2024-04-03T08:39:41.289 INFO:tasks.workunit.client.0.smithi157.stdout:4/992: dwrite da/df/f14b [0,4194304] 0 2024-04-03T08:39:41.290 INFO:tasks.workunit.client.1.smithi181.stdout:3/986: creat d0/d17/d36/d3b/d5a/d85/f143 x:0 0 0 2024-04-03T08:39:41.290 INFO:tasks.workunit.client.1.smithi181.stdout:1/938: rmdir d10/d15/d17/d23/d27 39 2024-04-03T08:39:41.292 INFO:tasks.workunit.client.1.smithi181.stdout:6/970: chown d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d64 1658099285 1 2024-04-03T08:39:41.294 INFO:tasks.workunit.client.0.smithi157.stdout:1/930: creat d2/d11/d23/dc9/d58/d62/d74/f13c x:0 0 0 2024-04-03T08:39:41.295 INFO:tasks.workunit.client.1.smithi181.stdout:1/939: symlink d10/d69/dd1/d113/l131 0 2024-04-03T08:39:41.297 INFO:tasks.workunit.client.1.smithi181.stdout:3/987: mknod d0/d17/d36/d3b/d5a/c144 0 2024-04-03T08:39:41.301 INFO:tasks.workunit.client.1.smithi181.stdout:6/971: mknod d6/d53/dea/c136 0 2024-04-03T08:39:41.304 INFO:tasks.workunit.client.0.smithi157.stdout:4/993: getdents da/df/d2f/d64/d8f/dbd/d68 0 2024-04-03T08:39:41.307 INFO:tasks.workunit.client.1.smithi181.stdout:7/854: dread d0/d1/d6/de/d17/d64/d85/dd8/f108 [0,4194304] 0 2024-04-03T08:39:41.312 INFO:tasks.workunit.client.1.smithi181.stdout:3/988: dread d0/d17/d36/d3b/d5a/fec [0,4194304] 0 2024-04-03T08:39:41.314 INFO:tasks.workunit.client.0.smithi157.stdout:1/931: dwrite d2/d11/d24/fb8 [0,4194304] 0 2024-04-03T08:39:41.315 INFO:tasks.workunit.client.0.smithi157.stdout:4/994: rmdir da/df 39 2024-04-03T08:39:41.319 INFO:tasks.workunit.client.0.smithi157.stdout:1/932: stat d2/d11/d23/de1/l138 0 2024-04-03T08:39:41.321 INFO:tasks.workunit.client.1.smithi181.stdout:3/989: dread - d0/d17/fff zero size 2024-04-03T08:39:41.321 INFO:tasks.workunit.client.1.smithi181.stdout:1/940: write d10/d15/d17/d37/f56 [1783785,65161] 0 2024-04-03T08:39:41.323 INFO:tasks.workunit.client.1.smithi181.stdout:7/855: dwrite d0/d1/f51 [0,4194304] 0 2024-04-03T08:39:41.324 INFO:tasks.workunit.client.0.smithi157.stdout:4/995: mkdir da/df/d2f/d97/dc8/d153 0 2024-04-03T08:39:41.325 INFO:tasks.workunit.client.0.smithi157.stdout:1/933: symlink d2/d11/d23/dc9/l13d 0 2024-04-03T08:39:41.327 INFO:tasks.workunit.client.0.smithi157.stdout:4/996: write da/df/d2f/dbc/dbe/d133/f14e [229747,75443] 0 2024-04-03T08:39:41.327 INFO:tasks.workunit.client.1.smithi181.stdout:6/972: link d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/l134 d6/d53/d8d/d97/db0/db5/l137 0 2024-04-03T08:39:41.329 INFO:tasks.workunit.client.1.smithi181.stdout:6/973: chown d6/d3e/d5e 28075159 1 2024-04-03T08:39:41.329 INFO:tasks.workunit.client.0.smithi157.stdout:4/997: readlink da/df/d24/d35/d53/de3/l144 0 2024-04-03T08:39:41.329 INFO:tasks.workunit.client.1.smithi181.stdout:1/941: creat d10/d15/d17/d23/db0/d8d/f132 x:0 0 0 2024-04-03T08:39:41.330 INFO:tasks.workunit.client.1.smithi181.stdout:7/856: readlink d0/d1/d6/de/da3/le4 0 2024-04-03T08:39:41.332 INFO:tasks.workunit.client.0.smithi157.stdout:4/998: chown da/df/c6c 8404919 1 2024-04-03T08:39:41.336 INFO:tasks.workunit.client.0.smithi157.stdout:1/934: getdents d2/d11/d23/dc9/d58/d62/d74 0 2024-04-03T08:39:41.337 INFO:tasks.workunit.client.0.smithi157.stdout:1/935: chown d2/d11/d24/d39/d3b/c6d 56015658 1 2024-04-03T08:39:41.340 INFO:tasks.workunit.client.0.smithi157.stdout:4/999: rename da/df/d2f/f40 to da/df/d2f/d54/d5f/f154 0 2024-04-03T08:39:41.340 INFO:tasks.workunit.client.0.smithi157.stdout:1/936: read - d2/d11/d23/dc9/d58/f112 zero size 2024-04-03T08:39:41.345 INFO:tasks.workunit.client.1.smithi181.stdout:7/857: write d0/d1/d6/de/f42 [235468,85468] 0 2024-04-03T08:39:41.345 INFO:tasks.workunit.client.1.smithi181.stdout:6/974: write d6/d3e/db1/dc4/d10f/dba/d95/fe7 [275487,79311] 0 2024-04-03T08:39:41.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:40 smithi181 ceph-mon[44183]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 114 MiB/s rd, 239 MiB/s wr, 572 op/s 2024-04-03T08:39:41.347 INFO:tasks.workunit.client.0.smithi157.stdout:1/937: rename d2/d11/d23/dc9/d58/d62/d74/f114 to d2/d11/d23/dc9/d5d/db4/dbc/def/d137/f13e 0 2024-04-03T08:39:41.352 INFO:tasks.workunit.client.1.smithi181.stdout:6/975: link d6/d3e/d5e/f90 d6/d3e/db1/dc4/d10f/dba/d95/f138 0 2024-04-03T08:39:41.353 INFO:tasks.workunit.client.0.smithi157.stdout:1/938: rename d2/d11/d23/dc9/d58/f112 to d2/d11/d24/d39/dc6/f13f 0 2024-04-03T08:39:41.354 INFO:tasks.workunit.client.1.smithi181.stdout:7/858: getdents d0/d1/d6/de/d17/d64/d85/d87 0 2024-04-03T08:39:41.356 INFO:tasks.workunit.client.1.smithi181.stdout:6/976: readlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/l134 0 2024-04-03T08:39:41.357 INFO:tasks.workunit.client.1.smithi181.stdout:6/977: dread - d6/d3e/db1/dc4/dc9/ffc zero size 2024-04-03T08:39:41.367 INFO:tasks.workunit.client.1.smithi181.stdout:6/978: rename d6/d3e/db1/dc4/d10f/dba/d81/fc3 to d6/d3e/db1/dc4/d10f/d73/f139 0 2024-04-03T08:39:41.375 INFO:tasks.workunit.client.1.smithi181.stdout:6/979: write d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/f61 [1183201,9158] 0 2024-04-03T08:39:41.376 INFO:tasks.workunit.client.0.smithi157.stdout:1/939: dwrite d2/d11/f26 [0,4194304] 0 2024-04-03T08:39:41.380 INFO:tasks.workunit.client.1.smithi181.stdout:6/980: symlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d5b/l13a 0 2024-04-03T08:39:41.381 INFO:tasks.workunit.client.1.smithi181.stdout:7/859: dread d0/d1/d94/f139 [0,4194304] 0 2024-04-03T08:39:41.383 INFO:tasks.workunit.client.1.smithi181.stdout:6/981: chown d6/d3e/db1/dc4/d10f/dba/da6/d4f/d77/d8b/fef 185638 1 2024-04-03T08:39:41.386 INFO:tasks.workunit.client.1.smithi181.stdout:6/982: symlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/l13b 0 2024-04-03T08:39:41.389 INFO:tasks.workunit.client.1.smithi181.stdout:6/983: fsync d6/d3e/db1/dc4/d10f/f87 0 2024-04-03T08:39:41.394 INFO:tasks.workunit.client.1.smithi181.stdout:6/984: rename d6/d3e/db1/dc4/d10f/f9c to d6/d3e/db1/f13c 0 2024-04-03T08:39:41.395 INFO:tasks.workunit.client.0.smithi157.stdout:1/940: write d2/d11/d23/dc9/d5d/db4/dbc/ffb [1013621,74388] 0 2024-04-03T08:39:41.396 INFO:tasks.workunit.client.1.smithi181.stdout:7/860: write d0/d1/d6/de/d17/f2c [2966553,31180] 0 2024-04-03T08:39:41.401 INFO:tasks.workunit.client.0.smithi157.stdout:1/941: symlink d2/d11/d24/d39/d3b/d2e/d66/d91/d133/l140 0 2024-04-03T08:39:41.406 INFO:tasks.workunit.client.0.smithi157.stdout:1/942: mkdir d2/d11/d23/dc9/d58/d62/d141 0 2024-04-03T08:39:41.410 INFO:tasks.workunit.client.0.smithi157.stdout:1/943: rename d2/d11/d23/dc9/d58/d62/d74/f13c to d2/d11/d24/d39/dc6/f142 0 2024-04-03T08:39:41.411 INFO:tasks.workunit.client.0.smithi157.stdout:1/944: fsync d2/d11/d24/d39/f54 0 2024-04-03T08:39:41.415 INFO:tasks.workunit.client.0.smithi157.stdout:1/945: dread d2/d11/d24/d39/f12c [0,4194304] 0 2024-04-03T08:39:41.419 INFO:tasks.workunit.client.0.smithi157.stdout:1/946: link d2/d11/d24/d39/f117 d2/f143 0 2024-04-03T08:39:41.423 INFO:tasks.workunit.client.0.smithi157.stdout:1/947: creat d2/d11/d24/d39/d3b/d2e/d66/d91/d133/f144 x:0 0 0 2024-04-03T08:39:41.432 INFO:tasks.workunit.client.0.smithi157.stdout:1/948: dread d2/d11/d23/dc9/d58/d62/d74/f75 [0,4194304] 0 2024-04-03T08:39:41.435 INFO:tasks.workunit.client.0.smithi157.stdout:1/949: truncate d2/f143 8245775 0 2024-04-03T08:39:41.436 INFO:tasks.workunit.client.0.smithi157.stdout:1/950: chown d2/f88 210603614 1 2024-04-03T08:39:41.437 INFO:tasks.workunit.client.0.smithi157.stdout:1/951: chown d2/d11/d24/d39/f61 363537 1 2024-04-03T08:39:41.440 INFO:tasks.workunit.client.0.smithi157.stdout:1/952: creat d2/d11/d24/d39/d3b/d2e/d66/f145 x:0 0 0 2024-04-03T08:39:41.444 INFO:tasks.workunit.client.0.smithi157.stdout:1/953: creat d2/d11/d23/dc9/d58/d94/f146 x:0 0 0 2024-04-03T08:39:41.451 INFO:tasks.workunit.client.0.smithi157.stdout:1/954: write d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 [357270,71200] 0 2024-04-03T08:39:41.456 INFO:tasks.workunit.client.0.smithi157.stdout:1/955: dread d2/d11/d23/dc9/d5d/db4/dbc/def/d137/f13e [0,4194304] 0 2024-04-03T08:39:41.478 INFO:tasks.workunit.client.0.smithi157.stdout:1/956: dread d2/d11/d24/d39/d3b/df4/f103 [0,4194304] 0 2024-04-03T08:39:41.481 INFO:tasks.workunit.client.0.smithi157.stdout:1/957: creat d2/d11/d23/dc9/d5d/db4/dbc/def/d137/f147 x:0 0 0 2024-04-03T08:39:41.484 INFO:tasks.workunit.client.1.smithi181.stdout:7/861: write d0/d1/f4a [1078439,17003] 0 2024-04-03T08:39:41.484 INFO:tasks.workunit.client.1.smithi181.stdout:6/985: link d6/d31/ce3 d6/dc0/c13d 0 2024-04-03T08:39:41.488 INFO:tasks.workunit.client.1.smithi181.stdout:7/862: symlink d0/d1/d6/de/d17/d27/d72/df4/l13a 0 2024-04-03T08:39:41.492 INFO:tasks.workunit.client.1.smithi181.stdout:7/863: mknod d0/d1/d6/ddf/c13b 0 2024-04-03T08:39:41.495 INFO:tasks.workunit.client.1.smithi181.stdout:7/864: symlink d0/d1/d6/de/d17/d27/d93/l13c 0 2024-04-03T08:39:41.495 INFO:tasks.workunit.client.0.smithi157.stdout:1/958: dwrite d2/d11/d24/d39/d3b/d1b/d7f/fa7 [0,4194304] 0 2024-04-03T08:39:41.497 INFO:tasks.workunit.client.1.smithi181.stdout:7/865: write d0/d1/d6/de/d17/f116 [140830,33414] 0 2024-04-03T08:39:41.497 INFO:tasks.workunit.client.0.smithi157.stdout:1/959: fsync d2/d11/d24/f2f 0 2024-04-03T08:39:41.500 INFO:tasks.workunit.client.1.smithi181.stdout:7/866: write d0/d1/d6/de/d17/d64/d85/f98 [2766464,26429] 0 2024-04-03T08:39:41.504 INFO:tasks.workunit.client.1.smithi181.stdout:7/867: chown d0/d1/d6/de9/f113 174635781 1 2024-04-03T08:39:41.506 INFO:tasks.workunit.client.1.smithi181.stdout:6/986: dread d6/df6/fd3 [0,4194304] 0 2024-04-03T08:39:41.507 INFO:tasks.workunit.client.1.smithi181.stdout:7/868: write d0/d1/d6/de/d17/d27/f36 [5206708,58768] 0 2024-04-03T08:39:41.510 INFO:tasks.workunit.client.0.smithi157.stdout:1/960: getdents d2/d11/d24/d39/d3b/d2e/d66/d91 0 2024-04-03T08:39:41.512 INFO:tasks.workunit.client.1.smithi181.stdout:6/987: creat d6/d11e/d132/f13e x:0 0 0 2024-04-03T08:39:41.515 INFO:tasks.workunit.client.1.smithi181.stdout:6/988: fdatasync d6/d31/f89 0 2024-04-03T08:39:41.516 INFO:tasks.workunit.client.1.smithi181.stdout:7/869: read d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/f9c [89259,92275] 0 2024-04-03T08:39:41.519 INFO:tasks.workunit.client.0.smithi157.stdout:1/961: link d2/d11/d24/d39/d3b/d2e/d66/d91/d97/fb9 d2/d11/d23/dc9/f148 0 2024-04-03T08:39:41.520 INFO:tasks.workunit.client.1.smithi181.stdout:7/870: mknod d0/d1/d6/de/d17/d64/d85/d87/d10a/c13d 0 2024-04-03T08:39:41.522 INFO:tasks.workunit.client.1.smithi181.stdout:7/871: write d0/d1/d6/f11f [519375,92049] 0 2024-04-03T08:39:41.533 INFO:tasks.workunit.client.1.smithi181.stdout:7/872: dread d0/d1/d6/de/d17/fee [0,4194304] 0 2024-04-03T08:39:41.535 INFO:tasks.workunit.client.0.smithi157.stdout:1/962: dwrite d2/d11/d24/d39/d3b/d2e/d66/d91/d97/f101 [0,4194304] 0 2024-04-03T08:39:41.537 INFO:tasks.workunit.client.1.smithi181.stdout:7/873: creat d0/d1/d6/de/d17/d64/d82/d12d/f13e x:0 0 0 2024-04-03T08:39:41.537 INFO:tasks.workunit.client.1.smithi181.stdout:6/989: dread d6/dc0/d103/f98 [0,4194304] 0 2024-04-03T08:39:41.538 INFO:tasks.workunit.client.1.smithi181.stdout:6/990: readlink d6/d53/d80/l78 0 2024-04-03T08:39:41.542 INFO:tasks.workunit.client.1.smithi181.stdout:6/991: creat d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d9/dfd/f13f x:0 0 0 2024-04-03T08:39:41.548 INFO:tasks.workunit.client.1.smithi181.stdout:6/992: unlink d6/d3e/db1/dc4/d10f/dba/da6/d4f/lad 0 2024-04-03T08:39:41.552 INFO:tasks.workunit.client.1.smithi181.stdout:7/874: dwrite d0/f9f [0,4194304] 0 2024-04-03T08:39:41.554 INFO:tasks.workunit.client.1.smithi181.stdout:6/993: creat d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/d50/d5b/f140 x:0 0 0 2024-04-03T08:39:41.556 INFO:tasks.workunit.client.0.smithi157.stdout:1/963: dread d2/d11/d23/dc9/d58/f4b [4194304,4194304] 0 2024-04-03T08:39:41.558 INFO:tasks.workunit.client.0.smithi157.stdout:1/964: dread - d2/d11/d23/dc9/da1/feb zero size 2024-04-03T08:39:41.560 INFO:tasks.workunit.client.1.smithi181.stdout:6/994: rmdir d6/d3e/db1/dc4/d10f/dba/da6 39 2024-04-03T08:39:41.562 INFO:tasks.workunit.client.0.smithi157.stdout:1/965: unlink d2/d11/d23/dc9/l139 0 2024-04-03T08:39:41.563 INFO:tasks.workunit.client.1.smithi181.stdout:6/995: creat d6/d3e/d40/dbc/f141 x:0 0 0 2024-04-03T08:39:41.567 INFO:tasks.workunit.client.1.smithi181.stdout:6/996: creat d6/d3e/db1/dc4/d10f/deb/f142 x:0 0 0 2024-04-03T08:39:41.568 INFO:tasks.workunit.client.0.smithi157.stdout:1/966: getdents d2 0 2024-04-03T08:39:41.569 INFO:tasks.workunit.client.1.smithi181.stdout:0/927: sync 2024-04-03T08:39:41.569 INFO:tasks.workunit.client.1.smithi181.stdout:5/918: sync 2024-04-03T08:39:41.571 INFO:tasks.workunit.client.1.smithi181.stdout:7/875: dwrite d0/d1/d6/f61 [0,4194304] 0 2024-04-03T08:39:41.572 INFO:tasks.workunit.client.0.smithi157.stdout:1/967: symlink d2/d11/d24/d39/d3b/d2e/l149 0 2024-04-03T08:39:41.574 INFO:tasks.workunit.client.1.smithi181.stdout:0/928: symlink d5/d9/d2a/l131 0 2024-04-03T08:39:41.576 INFO:tasks.workunit.client.0.smithi157.stdout:1/968: symlink d2/d11/d23/dc9/d58/d94/l14a 0 2024-04-03T08:39:41.579 INFO:tasks.workunit.client.1.smithi181.stdout:0/929: rename d5/fef to d5/dc/d14/d8d/dec/f132 0 2024-04-03T08:39:41.583 INFO:tasks.workunit.client.0.smithi157.stdout:1/969: link d2/d11/d24/d39/d3b/f59 d2/d11/d23/dc9/f14b 0 2024-04-03T08:39:41.593 INFO:tasks.workunit.client.1.smithi181.stdout:5/919: dwrite d4/d18/d25/d59/fde [0,4194304] 0 2024-04-03T08:39:41.593 INFO:tasks.workunit.client.1.smithi181.stdout:6/997: dwrite d6/d3e/db1/dc4/d10f/dba/da6/d4f/dd1/f38 [4194304,4194304] 0 2024-04-03T08:39:41.595 INFO:tasks.workunit.client.1.smithi181.stdout:5/920: write d4/d80/de5/f111 [1018618,88471] 0 2024-04-03T08:39:41.597 INFO:tasks.workunit.client.1.smithi181.stdout:6/998: stat d6/d3e/db1/dc4/d10f/dba/da6/d4f/fa9 0 2024-04-03T08:39:41.599 INFO:tasks.workunit.client.1.smithi181.stdout:6/999: chown d6/d53/d8d/d97/db0/d11f/f124 120194 1 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.0.smithi157.stdout:1/970: dread d2/d11/d23/dc9/d86/fca [0,4194304] 0 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.0.smithi157.stdout:1/971: creat d2/d11/d24/d67/f14c x:0 0 0 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.0.smithi157.stdout:1/972: dread - d2/d11/d23/dc9/d58/d94/da3/ff5 zero size 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.0.smithi157.stdout:1/973: dwrite d2/d11/d24/f1c [0,4194304] 0 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.0.smithi157.stdout:1/974: stat d2/d11/d24/d39/d3b/d2e/d66/d91/d133/f144 0 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.1.smithi181.stdout:5/921: dread - d4/d22/d53/d98/fef zero size 2024-04-03T08:39:41.652 INFO:tasks.workunit.client.1.smithi181.stdout:5/922: creat d4/d18/d55/d5a/dcd/f130 x:0 0 0 2024-04-03T08:39:41.653 INFO:tasks.workunit.client.1.smithi181.stdout:0/930: write d5/dc/f21 [3202159,2899] 0 2024-04-03T08:39:41.653 INFO:tasks.workunit.client.1.smithi181.stdout:0/931: creat d5/dc/d14/de5/f133 x:0 0 0 2024-04-03T08:39:41.653 INFO:tasks.workunit.client.1.smithi181.stdout:0/932: write d5/dc/d14/d8d/dec/f132 [1591788,46667] 0 2024-04-03T08:39:41.653 INFO:tasks.workunit.client.1.smithi181.stdout:5/923: dwrite d4/d18/d55/db4/d96/fc5 [0,4194304] 0 2024-04-03T08:39:41.653 INFO:tasks.workunit.client.1.smithi181.stdout:0/933: mkdir d5/dc/d14/d29/d46/d11f/d134 0 2024-04-03T08:39:41.654 INFO:tasks.workunit.client.1.smithi181.stdout:0/934: mknod d5/dc/d14/d8d/c135 0 2024-04-03T08:39:41.656 INFO:tasks.workunit.client.1.smithi181.stdout:0/935: write d5/dc/d14/de5/deb/ffc [157742,10686] 0 2024-04-03T08:39:41.660 INFO:tasks.workunit.client.1.smithi181.stdout:5/924: write d4/d80/fa4 [782441,105795] 0 2024-04-03T08:39:41.663 INFO:tasks.workunit.client.1.smithi181.stdout:0/936: rename d5/d9/d2a/de6/dcc/c116 to d5/dc/d10/d58/db0/d11d/c136 0 2024-04-03T08:39:41.664 INFO:tasks.workunit.client.0.smithi157.stdout:1/975: write d2/d11/d23/dc9/d58/d62/f95 [248749,81183] 0 2024-04-03T08:39:41.665 INFO:tasks.workunit.client.0.smithi157.stdout:1/976: stat d2 0 2024-04-03T08:39:41.665 INFO:tasks.workunit.client.1.smithi181.stdout:5/925: creat d4/d22/d4a/dad/db6/d10c/f131 x:0 0 0 2024-04-03T08:39:41.668 INFO:tasks.workunit.client.1.smithi181.stdout:5/926: chown d4/f5 7257273 1 2024-04-03T08:39:41.676 INFO:tasks.workunit.client.1.smithi181.stdout:5/927: truncate d4/d18/f5c 1205699 0 2024-04-03T08:39:41.678 INFO:tasks.workunit.client.1.smithi181.stdout:5/928: chown d4/d18/d55/dae/lea 3019778 1 2024-04-03T08:39:41.680 INFO:tasks.workunit.client.1.smithi181.stdout:0/937: dwrite d5/dc/d10/d58/db0/f106 [0,4194304] 0 2024-04-03T08:39:41.683 INFO:tasks.workunit.client.0.smithi157.stdout:1/977: dwrite d2/d11/d23/f79 [0,4194304] 0 2024-04-03T08:39:41.684 INFO:tasks.workunit.client.1.smithi181.stdout:5/929: symlink d4/d18/d55/db4/l132 0 2024-04-03T08:39:41.686 INFO:tasks.workunit.client.1.smithi181.stdout:0/938: truncate d5/dc/f71 4960179 0 2024-04-03T08:39:41.687 INFO:tasks.workunit.client.1.smithi181.stdout:5/930: chown d4/d22/d53/f9a 2370 1 2024-04-03T08:39:41.689 INFO:tasks.workunit.client.1.smithi181.stdout:5/931: truncate d4/d22/d78/f126 211418 0 2024-04-03T08:39:41.692 INFO:tasks.workunit.client.1.smithi181.stdout:5/932: chown d4/d44/f92 317 1 2024-04-03T08:39:41.694 INFO:tasks.workunit.client.1.smithi181.stdout:9/950: sync 2024-04-03T08:39:41.694 INFO:tasks.workunit.client.1.smithi181.stdout:8/865: sync 2024-04-03T08:39:41.695 INFO:tasks.workunit.client.1.smithi181.stdout:3/990: sync 2024-04-03T08:39:41.698 INFO:tasks.workunit.client.1.smithi181.stdout:3/991: stat d0/d17/d36/d8c/lb0 0 2024-04-03T08:39:41.698 INFO:tasks.workunit.client.1.smithi181.stdout:5/933: rename d4/d18/d2c/l7d to d4/d18/d55/l133 0 2024-04-03T08:39:41.700 INFO:tasks.workunit.client.1.smithi181.stdout:8/866: symlink d4/d45/d9/d70/l11c 0 2024-04-03T08:39:41.701 INFO:tasks.workunit.client.0.smithi157.stdout:1/978: dread d2/d11/d24/d39/d3b/df4/f103 [0,4194304] 0 2024-04-03T08:39:41.703 INFO:tasks.workunit.client.1.smithi181.stdout:5/934: mknod d4/d22/d53/c134 0 2024-04-03T08:39:41.704 INFO:tasks.workunit.client.0.smithi157.stdout:1/979: symlink d2/d11/d24/d108/l14d 0 2024-04-03T08:39:41.705 INFO:tasks.workunit.client.1.smithi181.stdout:0/939: dwrite d5/d9/f7f [0,4194304] 0 2024-04-03T08:39:41.706 INFO:tasks.workunit.client.1.smithi181.stdout:5/935: creat d4/d18/d55/dae/f135 x:0 0 0 2024-04-03T08:39:41.708 INFO:tasks.workunit.client.1.smithi181.stdout:5/936: stat d4/d18/d2c/c66 0 2024-04-03T08:39:41.713 INFO:tasks.workunit.client.0.smithi157.stdout:1/980: unlink d2/d11/d23/dc9/da1/ded/f10a 0 2024-04-03T08:39:41.714 INFO:tasks.workunit.client.1.smithi181.stdout:3/992: dread d0/d17/d36/d3b/d5a/f97 [0,4194304] 0 2024-04-03T08:39:41.716 INFO:tasks.workunit.client.1.smithi181.stdout:0/940: creat d5/dc/d10/f137 x:0 0 0 2024-04-03T08:39:41.718 INFO:tasks.workunit.client.1.smithi181.stdout:8/867: creat d4/d2a/f11d x:0 0 0 2024-04-03T08:39:41.718 INFO:tasks.workunit.client.1.smithi181.stdout:0/941: write d5/dc/d75/de1/f102 [347776,6712] 0 2024-04-03T08:39:41.720 INFO:tasks.workunit.client.0.smithi157.stdout:1/981: readlink d2/d11/d24/d39/d3b/d2e/l99 0 2024-04-03T08:39:41.722 INFO:tasks.workunit.client.1.smithi181.stdout:5/937: symlink d4/d22/d4a/l136 0 2024-04-03T08:39:41.722 INFO:tasks.workunit.client.1.smithi181.stdout:9/951: write d1/da/d28/d30/dd8/df0/f102 [918411,362] 0 2024-04-03T08:39:41.723 INFO:tasks.workunit.client.1.smithi181.stdout:3/993: readlink d0/d5/d6/lc 0 2024-04-03T08:39:41.725 INFO:tasks.workunit.client.1.smithi181.stdout:8/868: symlink d4/d44/d59/d5f/l11e 0 2024-04-03T08:39:41.727 INFO:tasks.workunit.client.1.smithi181.stdout:5/938: symlink d4/d22/d53/d98/l137 0 2024-04-03T08:39:41.728 INFO:tasks.workunit.client.0.smithi157.stdout:1/982: mknod d2/d11/d24/d39/d3b/d2e/d66/d91/c14e 0 2024-04-03T08:39:41.729 INFO:tasks.workunit.client.1.smithi181.stdout:5/939: truncate d4/f121 157043 0 2024-04-03T08:39:41.729 INFO:tasks.workunit.client.1.smithi181.stdout:3/994: mknod d0/d17/d63/db7/c145 0 2024-04-03T08:39:41.729 INFO:tasks.workunit.client.1.smithi181.stdout:5/940: stat d4 0 2024-04-03T08:39:41.731 INFO:tasks.workunit.client.0.smithi157.stdout:1/983: symlink d2/d11/d24/d108/l14f 0 2024-04-03T08:39:41.732 INFO:tasks.workunit.client.1.smithi181.stdout:5/941: write d4/d22/d4a/dad/db6/d10c/f131 [709840,40777] 0 2024-04-03T08:39:41.736 INFO:tasks.workunit.client.1.smithi181.stdout:5/942: creat d4/d18/d55/f138 x:0 0 0 2024-04-03T08:39:41.742 INFO:tasks.workunit.client.1.smithi181.stdout:9/952: write d1/da/d13/d22/fca [1788938,14478] 0 2024-04-03T08:39:41.743 INFO:tasks.workunit.client.1.smithi181.stdout:1/942: sync 2024-04-03T08:39:41.744 INFO:tasks.workunit.client.1.smithi181.stdout:3/995: rename d0/d17/d63/db7 to d0/d17/d36/d3b/d146 0 2024-04-03T08:39:41.746 INFO:tasks.workunit.client.1.smithi181.stdout:1/943: rmdir d10/df6 39 2024-04-03T08:39:41.747 INFO:tasks.workunit.client.1.smithi181.stdout:3/996: dread - d0/d57/fc5 zero size 2024-04-03T08:39:41.749 INFO:tasks.workunit.client.1.smithi181.stdout:9/953: creat d1/da/d28/f12e x:0 0 0 2024-04-03T08:39:41.752 INFO:tasks.workunit.client.1.smithi181.stdout:0/942: dwrite d5/d9/d2a/de6/dcc/fe2 [0,4194304] 0 2024-04-03T08:39:41.752 INFO:tasks.workunit.client.1.smithi181.stdout:1/944: symlink d10/d15/d17/d30/l133 0 2024-04-03T08:39:41.757 INFO:tasks.workunit.client.1.smithi181.stdout:9/954: mkdir d1/da/d13/deb/d12f 0 2024-04-03T08:39:41.760 INFO:tasks.workunit.client.1.smithi181.stdout:0/943: chown d5/dc/d10/d58/dba/d90/l99 1037113 1 2024-04-03T08:39:41.761 INFO:tasks.workunit.client.1.smithi181.stdout:8/869: dread d4/d2a/d37/fac [0,4194304] 0 2024-04-03T08:39:41.762 INFO:tasks.workunit.client.0.smithi157.stdout:1/984: dread d2/d11/d24/d39/d115/f132 [0,4194304] 0 2024-04-03T08:39:41.763 INFO:tasks.workunit.client.1.smithi181.stdout:1/945: link d10/d15/d4a/d86/cb5 d10/d69/dd1/d113/d11c/c134 0 2024-04-03T08:39:41.763 INFO:tasks.workunit.client.1.smithi181.stdout:5/943: dread d4/d22/f26 [4194304,4194304] 0 2024-04-03T08:39:41.765 INFO:tasks.workunit.client.1.smithi181.stdout:5/944: stat d4/d18/d25/fd6 0 2024-04-03T08:39:41.765 INFO:tasks.workunit.client.1.smithi181.stdout:1/946: fdatasync d10/d15/d17/f114 0 2024-04-03T08:39:41.766 INFO:tasks.workunit.client.1.smithi181.stdout:9/955: symlink d1/da/d13/d41/daf/df1/l130 0 2024-04-03T08:39:41.767 INFO:tasks.workunit.client.1.smithi181.stdout:3/997: link d0/d17/d63/df8/l104 d0/d5/d6/d32/dc1/l147 0 2024-04-03T08:39:41.767 INFO:tasks.workunit.client.0.smithi157.stdout:1/985: chown d2/d11/d24/cb3 3 1 2024-04-03T08:39:41.769 INFO:tasks.workunit.client.0.smithi157.stdout:1/986: write d2/d11/d23/dc9/d58/d94/f146 [497262,20681] 0 2024-04-03T08:39:41.772 INFO:tasks.workunit.client.1.smithi181.stdout:9/956: fdatasync d1/da/d28/d30/f6a 0 2024-04-03T08:39:41.773 INFO:tasks.workunit.client.1.smithi181.stdout:1/947: symlink d10/df6/l135 0 2024-04-03T08:39:41.774 INFO:tasks.workunit.client.1.smithi181.stdout:8/870: rename d4/d45/db/d14/d31/d1c/laf to d4/d44/l11f 0 2024-04-03T08:39:41.776 INFO:tasks.workunit.client.1.smithi181.stdout:1/948: stat d10/d69/dd1/d118 0 2024-04-03T08:39:41.778 INFO:tasks.workunit.client.1.smithi181.stdout:1/949: chown d10/d15/d17/d19/d33 154 1 2024-04-03T08:39:41.782 INFO:tasks.workunit.client.1.smithi181.stdout:0/944: dwrite d5/dc/d14/d8d/fb4 [0,4194304] 0 2024-04-03T08:39:41.785 INFO:tasks.workunit.client.1.smithi181.stdout:8/871: rename d4/d45/db/d14/dd0 to d4/d44/d59/d120 0 2024-04-03T08:39:41.787 INFO:tasks.workunit.client.1.smithi181.stdout:8/872: readlink d4/d44/d59/d5f/l93 0 2024-04-03T08:39:41.789 INFO:tasks.workunit.client.1.smithi181.stdout:9/957: mknod d1/da/d13/d41/d65/d128/c131 0 2024-04-03T08:39:41.790 INFO:tasks.workunit.client.1.smithi181.stdout:5/945: truncate d4/d18/d55/db4/fe4 898336 0 2024-04-03T08:39:41.790 INFO:tasks.workunit.client.0.smithi157.stdout:1/987: dread d2/d11/d24/d39/d3b/d2e/d66/d91/d97/f101 [0,4194304] 0 2024-04-03T08:39:41.794 INFO:tasks.workunit.client.1.smithi181.stdout:1/950: dread d10/d15/d4b/ff2 [0,4194304] 0 2024-04-03T08:39:41.794 INFO:tasks.workunit.client.1.smithi181.stdout:8/873: symlink d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/def/l121 0 2024-04-03T08:39:41.796 INFO:tasks.workunit.client.1.smithi181.stdout:5/946: unlink d4/c6 0 2024-04-03T08:39:41.799 INFO:tasks.workunit.client.1.smithi181.stdout:3/998: dwrite d0/d5/d6/d3f/f12e [4194304,4194304] 0 2024-04-03T08:39:41.802 INFO:tasks.workunit.client.1.smithi181.stdout:7/876: sync 2024-04-03T08:39:41.802 INFO:tasks.workunit.client.1.smithi181.stdout:5/947: mknod d4/d18/d25/de7/df2/c139 0 2024-04-03T08:39:41.808 INFO:tasks.workunit.client.1.smithi181.stdout:0/945: link d5/dc/d10/d58/db0/d11d/c136 d5/dc/d14/d8d/dec/c138 0 2024-04-03T08:39:41.810 INFO:tasks.workunit.client.1.smithi181.stdout:3/999: rename d0/d17/f91 to d0/d17/d36/d3b/d102/f148 0 2024-04-03T08:39:41.813 INFO:tasks.workunit.client.1.smithi181.stdout:9/958: getdents d1/da/d13/d22/d23/d36/d9c 0 2024-04-03T08:39:41.814 INFO:tasks.workunit.client.1.smithi181.stdout:8/874: dwrite d4/d44/d59/d5f/d6c/dd1/f10f [0,4194304] 0 2024-04-03T08:39:41.815 INFO:tasks.workunit.client.1.smithi181.stdout:9/959: chown d1/da/d28/d80/dd3/ff7 705926270 1 2024-04-03T08:39:41.827 INFO:tasks.workunit.client.1.smithi181.stdout:9/960: rename d1/da/d13/deb to d1/dcb/d132 0 2024-04-03T08:39:41.827 INFO:tasks.workunit.client.1.smithi181.stdout:5/948: link d4/d18/d55/l67 d4/d18/d25/dac/d11f/l13a 0 2024-04-03T08:39:41.828 INFO:tasks.workunit.client.1.smithi181.stdout:8/875: symlink d4/d45/db/d14/l122 0 2024-04-03T08:39:41.832 INFO:tasks.workunit.client.1.smithi181.stdout:1/951: dwrite d10/d15/d17/d19/d33/f64 [0,4194304] 0 2024-04-03T08:39:41.839 INFO:tasks.workunit.client.1.smithi181.stdout:9/961: rmdir d1/da/d13/d22/d23/d36/d91/d9d/daa 39 2024-04-03T08:39:41.840 INFO:tasks.workunit.client.1.smithi181.stdout:7/877: dwrite d0/d1/d6/fff [0,4194304] 0 2024-04-03T08:39:41.848 INFO:tasks.workunit.client.1.smithi181.stdout:8/876: creat d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/f123 x:0 0 0 2024-04-03T08:39:41.850 INFO:tasks.workunit.client.1.smithi181.stdout:8/877: chown d4/d2a/dd2/ff6 35403941 1 2024-04-03T08:39:41.855 INFO:tasks.workunit.client.1.smithi181.stdout:9/962: truncate d1/da/d13/d41/d32/fcd 2001892 0 2024-04-03T08:39:41.858 INFO:tasks.workunit.client.1.smithi181.stdout:5/949: dwrite d4/d18/d25/d59/fc8 [0,4194304] 0 2024-04-03T08:39:41.864 INFO:tasks.workunit.client.1.smithi181.stdout:9/963: creat d1/da/d28/d30/d3e/f133 x:0 0 0 2024-04-03T08:39:41.872 INFO:tasks.workunit.client.1.smithi181.stdout:7/878: creat d0/d1/d6/de/d17/d64/d85/f13f x:0 0 0 2024-04-03T08:39:41.880 INFO:tasks.workunit.client.1.smithi181.stdout:1/952: dread d10/d15/d17/d23/d27/d91/fc0 [0,4194304] 0 2024-04-03T08:39:41.883 INFO:tasks.workunit.client.1.smithi181.stdout:9/964: link d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/c90 d1/da/d28/d80/dd3/de3/c134 0 2024-04-03T08:39:41.885 INFO:tasks.workunit.client.1.smithi181.stdout:7/879: creat d0/f140 x:0 0 0 2024-04-03T08:39:41.887 INFO:tasks.workunit.client.1.smithi181.stdout:8/878: dread d4/d44/d59/d5f/f75 [0,4194304] 0 2024-04-03T08:39:41.887 INFO:tasks.workunit.client.1.smithi181.stdout:1/953: rename d10/d69/dd1/d107/l12a to d10/d15/d4b/l136 0 2024-04-03T08:39:41.889 INFO:tasks.workunit.client.1.smithi181.stdout:8/879: write d4/d45/db/f8c [404045,34350] 0 2024-04-03T08:39:41.891 INFO:tasks.workunit.client.1.smithi181.stdout:5/950: dwrite d4/d18/d25/fd6 [0,4194304] 0 2024-04-03T08:39:41.893 INFO:tasks.workunit.client.1.smithi181.stdout:9/965: dread d1/da/d13/d41/d65/f99 [0,4194304] 0 2024-04-03T08:39:41.894 INFO:tasks.workunit.client.1.smithi181.stdout:7/880: read d0/d1/d6/de/f69 [178218,14476] 0 2024-04-03T08:39:41.896 INFO:tasks.workunit.client.1.smithi181.stdout:1/954: unlink d10/c84 0 2024-04-03T08:39:41.896 INFO:tasks.workunit.client.1.smithi181.stdout:0/946: sync 2024-04-03T08:39:41.897 INFO:tasks.workunit.client.1.smithi181.stdout:9/966: write d1/da/d28/d30/d3e/d4e/f11e [99404,30729] 0 2024-04-03T08:39:41.901 INFO:tasks.workunit.client.1.smithi181.stdout:5/951: creat d4/d18/d25/d59/db3/f13b x:0 0 0 2024-04-03T08:39:41.904 INFO:tasks.workunit.client.1.smithi181.stdout:1/955: creat d10/df6/f137 x:0 0 0 2024-04-03T08:39:41.908 INFO:tasks.workunit.client.1.smithi181.stdout:8/880: dread d4/f46 [0,4194304] 0 2024-04-03T08:39:41.909 INFO:tasks.workunit.client.1.smithi181.stdout:9/967: chown d1/dcb/d132/f12d 32372161 1 2024-04-03T08:39:41.910 INFO:tasks.workunit.client.1.smithi181.stdout:0/947: truncate d5/dc/d10/fe7 244009 0 2024-04-03T08:39:41.912 INFO:tasks.workunit.client.1.smithi181.stdout:0/948: read - d5/dc/d14/d8d/f11b zero size 2024-04-03T08:39:41.917 INFO:tasks.workunit.client.1.smithi181.stdout:1/956: fsync d10/d15/d4b/f98 0 2024-04-03T08:39:41.925 INFO:tasks.workunit.client.1.smithi181.stdout:8/881: write d4/fd8 [219207,47202] 0 2024-04-03T08:39:41.927 INFO:tasks.workunit.client.1.smithi181.stdout:8/882: chown d4/d45/db/d14/d31/c4f 108 1 2024-04-03T08:39:41.930 INFO:tasks.workunit.client.1.smithi181.stdout:1/957: dwrite d10/d15/d17/d19/d33/f7d [0,4194304] 0 2024-04-03T08:39:41.937 INFO:tasks.workunit.client.1.smithi181.stdout:0/949: rename d5/dc/d10/d58/la5 to d5/dc/d14/de5/l139 0 2024-04-03T08:39:41.940 INFO:tasks.workunit.client.1.smithi181.stdout:0/950: fdatasync d5/dc/d10/d30/f6f 0 2024-04-03T08:39:41.948 INFO:tasks.workunit.client.1.smithi181.stdout:9/968: link d1/da/d28/d30/dd8/df0/f102 d1/da/d28/d80/dd3/de3/f135 0 2024-04-03T08:39:41.950 INFO:tasks.workunit.client.1.smithi181.stdout:8/883: creat d4/d45/d96/f124 x:0 0 0 2024-04-03T08:39:41.951 INFO:tasks.workunit.client.1.smithi181.stdout:7/881: write d0/d1/d6/de/d17/d64/d85/d9a/da4/f7a [325694,82563] 0 2024-04-03T08:39:41.952 INFO:tasks.workunit.client.1.smithi181.stdout:1/958: fsync d10/d15/d41/f61 0 2024-04-03T08:39:41.954 INFO:tasks.workunit.client.1.smithi181.stdout:8/884: write d4/d45/db/d14/d31/d1c/d51/fe4 [538901,119425] 0 2024-04-03T08:39:41.955 INFO:tasks.workunit.client.1.smithi181.stdout:5/952: rmdir d4/d18/d25/d79 0 2024-04-03T08:39:41.959 INFO:tasks.workunit.client.1.smithi181.stdout:9/969: creat d1/da/d13/d41/daf/f136 x:0 0 0 2024-04-03T08:39:41.961 INFO:tasks.workunit.client.1.smithi181.stdout:0/951: dread d5/dc/d14/f22 [0,4194304] 0 2024-04-03T08:39:41.965 INFO:tasks.workunit.client.1.smithi181.stdout:1/959: rename d10/d15/d17/f93 to d10/d69/dd1/f138 0 2024-04-03T08:39:41.968 INFO:tasks.workunit.client.1.smithi181.stdout:7/882: dwrite d0/f3b [0,4194304] 0 2024-04-03T08:39:41.971 INFO:tasks.workunit.client.1.smithi181.stdout:5/953: dwrite d4/d18/d25/d68/f107 [0,4194304] 0 2024-04-03T08:39:41.977 INFO:tasks.workunit.client.1.smithi181.stdout:1/960: read - d10/d15/d17/d19/dd9/fde zero size 2024-04-03T08:39:41.979 INFO:tasks.workunit.client.1.smithi181.stdout:8/885: getdents d4/d45/d96/d103 0 2024-04-03T08:39:41.980 INFO:tasks.workunit.client.1.smithi181.stdout:7/883: link d0/d1/d6/de/f42 d0/d1/d6/de/d17/d64/d85/dd8/f141 0 2024-04-03T08:39:41.981 INFO:tasks.workunit.client.1.smithi181.stdout:9/970: getdents d1/da/d28/d30/d3e/d4e/d62/d10c 0 2024-04-03T08:39:42.005 INFO:tasks.workunit.client.1.smithi181.stdout:5/954: dread d4/d44/f5f [0,4194304] 0 2024-04-03T08:39:42.024 INFO:tasks.workunit.client.1.smithi181.stdout:7/884: truncate d0/d1/d6/de/d17/f38 148333 0 2024-04-03T08:39:42.026 INFO:tasks.workunit.client.1.smithi181.stdout:5/955: symlink d4/d18/d25/de7/df2/l13c 0 2024-04-03T08:39:42.027 INFO:tasks.workunit.client.1.smithi181.stdout:5/956: chown d4/d18/d3e/ce3 502 1 2024-04-03T08:39:42.028 INFO:tasks.workunit.client.1.smithi181.stdout:7/885: fsync d0/d1/d94/f139 0 2024-04-03T08:39:42.030 INFO:tasks.workunit.client.1.smithi181.stdout:7/886: write d0/d1/f15 [2530135,88083] 0 2024-04-03T08:39:42.031 INFO:tasks.workunit.client.1.smithi181.stdout:1/961: link d10/d15/d17/d23/db0/d8d/ccb d10/d15/d17/d23/c139 0 2024-04-03T08:39:42.032 INFO:tasks.workunit.client.1.smithi181.stdout:1/962: read - d10/df6/f137 zero size 2024-04-03T08:39:42.035 INFO:tasks.workunit.client.1.smithi181.stdout:5/957: rename d4/d80/de5/f111 to d4/d18/d55/db4/f13d 0 2024-04-03T08:39:42.036 INFO:tasks.workunit.client.1.smithi181.stdout:1/963: creat d10/df6/f13a x:0 0 0 2024-04-03T08:39:42.037 INFO:tasks.workunit.client.1.smithi181.stdout:7/887: mknod d0/d1/d6/de/d17/d64/d82/d12d/c142 0 2024-04-03T08:39:42.037 INFO:tasks.workunit.client.1.smithi181.stdout:0/952: truncate d5/d9/d2a/de6/f7a 4079423 0 2024-04-03T08:39:42.042 INFO:tasks.workunit.client.1.smithi181.stdout:5/958: rename d4/d18/d55/dae/f135 to d4/d18/d25/d59/db3/f13e 0 2024-04-03T08:39:42.043 INFO:tasks.workunit.client.1.smithi181.stdout:1/964: truncate d10/d15/d17/f7f 4543585 0 2024-04-03T08:39:42.046 INFO:tasks.workunit.client.1.smithi181.stdout:0/953: creat d5/dc/d10/d30/dab/f13a x:0 0 0 2024-04-03T08:39:42.047 INFO:tasks.workunit.client.1.smithi181.stdout:7/888: creat d0/d1/d6/db0/f143 x:0 0 0 2024-04-03T08:39:42.049 INFO:tasks.workunit.client.1.smithi181.stdout:1/965: dread - d10/d15/d17/d19/d4c/ff3 zero size 2024-04-03T08:39:42.050 INFO:tasks.workunit.client.1.smithi181.stdout:8/886: dwrite d4/d45/d9/f117 [4194304,4194304] 0 2024-04-03T08:39:42.051 INFO:tasks.workunit.client.1.smithi181.stdout:0/954: creat d5/d9/d2a/de6/f13b x:0 0 0 2024-04-03T08:39:42.058 INFO:tasks.workunit.client.1.smithi181.stdout:0/955: chown d5/dc/d10/d58/f115 248586176 1 2024-04-03T08:39:42.061 INFO:tasks.workunit.client.1.smithi181.stdout:8/887: creat d4/d45/db/d14/d31/d1c/d51/d87/db1/d107/f125 x:0 0 0 2024-04-03T08:39:42.065 INFO:tasks.workunit.client.1.smithi181.stdout:9/971: sync 2024-04-03T08:39:42.065 INFO:tasks.workunit.client.1.smithi181.stdout:5/959: dwrite d4/d18/d2c/f123 [0,4194304] 0 2024-04-03T08:39:42.069 INFO:tasks.workunit.client.1.smithi181.stdout:0/956: write d5/dc/d10/d58/dba/f11e [603581,104745] 0 2024-04-03T08:39:42.069 INFO:tasks.workunit.client.1.smithi181.stdout:8/888: symlink d4/d2a/dd2/l126 0 2024-04-03T08:39:42.075 INFO:tasks.workunit.client.1.smithi181.stdout:5/960: dread - d4/d18/d55/f138 zero size 2024-04-03T08:39:42.076 INFO:tasks.workunit.client.1.smithi181.stdout:9/972: rename d1/c9 to d1/c137 0 2024-04-03T08:39:42.079 INFO:tasks.workunit.client.1.smithi181.stdout:7/889: dwrite d0/d1/d94/ff0 [0,4194304] 0 2024-04-03T08:39:42.080 INFO:tasks.workunit.client.1.smithi181.stdout:0/957: rename d5/dc/d14/d29/f5a to d5/d9/dc8/f13c 0 2024-04-03T08:39:42.082 INFO:tasks.workunit.client.1.smithi181.stdout:8/889: getdents d4/d45/db/d14 0 2024-04-03T08:39:42.083 INFO:tasks.workunit.client.1.smithi181.stdout:5/961: creat d4/d44/d71/f13f x:0 0 0 2024-04-03T08:39:42.085 INFO:tasks.workunit.client.1.smithi181.stdout:0/958: readlink d5/d9/d2a/lf0 0 2024-04-03T08:39:42.086 INFO:tasks.workunit.client.1.smithi181.stdout:1/966: dwrite d10/d15/d17/d23/daa/f128 [0,4194304] 0 2024-04-03T08:39:42.087 INFO:tasks.workunit.client.1.smithi181.stdout:5/962: readlink d4/d18/d55/db4/l132 0 2024-04-03T08:39:42.088 INFO:tasks.workunit.client.1.smithi181.stdout:9/973: symlink d1/da/d13/d22/d23/d36/d9c/d10f/l138 0 2024-04-03T08:39:42.091 INFO:tasks.workunit.client.1.smithi181.stdout:7/890: mkdir d0/d1/d6/de/d17/d27/d144 0 2024-04-03T08:39:42.093 INFO:tasks.workunit.client.1.smithi181.stdout:1/967: symlink d10/d15/d17/d37/l13b 0 2024-04-03T08:39:42.093 INFO:tasks.workunit.client.1.smithi181.stdout:0/959: creat d5/d9/d2a/da1/df7/d10a/f13d x:0 0 0 2024-04-03T08:39:42.094 INFO:tasks.workunit.client.1.smithi181.stdout:8/890: mkdir d4/d44/d59/d120/d127 0 2024-04-03T08:39:42.094 INFO:tasks.workunit.client.1.smithi181.stdout:1/968: chown d10/d15/d17/d30/f82 225956 1 2024-04-03T08:39:42.095 INFO:tasks.workunit.client.1.smithi181.stdout:7/891: chown d0/d1/d6/de/d17/d64/d85/d9a/f118 257555 1 2024-04-03T08:39:42.096 INFO:tasks.workunit.client.1.smithi181.stdout:7/892: chown d0/l136 8 1 2024-04-03T08:39:42.099 INFO:tasks.workunit.client.1.smithi181.stdout:1/969: read d10/d15/d17/d23/d27/f87 [3932646,8211] 0 2024-04-03T08:39:42.099 INFO:tasks.workunit.client.1.smithi181.stdout:9/974: mkdir d1/da/d13/d41/d32/d139 0 2024-04-03T08:39:42.103 INFO:tasks.workunit.client.1.smithi181.stdout:9/975: unlink d1/da/d28/f6b 0 2024-04-03T08:39:42.105 INFO:tasks.workunit.client.1.smithi181.stdout:7/893: unlink d0/d1/d6/db0/c106 0 2024-04-03T08:39:42.106 INFO:tasks.workunit.client.1.smithi181.stdout:1/970: mkdir d10/d15/d17/d23/db0/d8d/d13c 0 2024-04-03T08:39:42.111 INFO:tasks.workunit.client.1.smithi181.stdout:9/976: mkdir d1/da/d1a/d92/d13a 0 2024-04-03T08:39:42.114 INFO:tasks.workunit.client.1.smithi181.stdout:7/894: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/l145 0 2024-04-03T08:39:42.115 INFO:tasks.workunit.client.1.smithi181.stdout:0/960: getdents d5/d9/d2a/da1/df7/d10a 0 2024-04-03T08:39:42.118 INFO:tasks.workunit.client.1.smithi181.stdout:1/971: write d10/d69/f77 [232722,111073] 0 2024-04-03T08:39:42.119 INFO:tasks.workunit.client.1.smithi181.stdout:9/977: mknod d1/da/d13/d22/d23/d36/d91/d9d/daa/c13b 0 2024-04-03T08:39:42.119 INFO:tasks.workunit.client.1.smithi181.stdout:5/963: dwrite d4/d18/d3e/f6f [0,4194304] 0 2024-04-03T08:39:42.120 INFO:tasks.workunit.client.1.smithi181.stdout:0/961: write d5/d9/d2a/f64 [896592,122508] 0 2024-04-03T08:39:42.124 INFO:tasks.workunit.client.1.smithi181.stdout:1/972: creat d10/d15/d4b/d6c/d120/f13d x:0 0 0 2024-04-03T08:39:42.128 INFO:tasks.workunit.client.1.smithi181.stdout:5/964: read d4/d18/d2c/f40 [2508703,18766] 0 2024-04-03T08:39:42.128 INFO:tasks.workunit.client.1.smithi181.stdout:0/962: creat d5/dc/d10/d58/db0/f13e x:0 0 0 2024-04-03T08:39:42.132 INFO:tasks.workunit.client.1.smithi181.stdout:7/895: dread d0/d1/d6/de/d17/d64/d85/dd8/f108 [0,4194304] 0 2024-04-03T08:39:42.133 INFO:tasks.workunit.client.1.smithi181.stdout:5/965: read d4/ff [386855,103811] 0 2024-04-03T08:39:42.136 INFO:tasks.workunit.client.1.smithi181.stdout:5/966: rmdir d4/d18/d2c 39 2024-04-03T08:39:42.139 INFO:tasks.workunit.client.1.smithi181.stdout:7/896: read d0/d1/d6/de/d17/d64/d85/d9a/da4/f6f [1253402,77222] 0 2024-04-03T08:39:42.142 INFO:tasks.workunit.client.1.smithi181.stdout:9/978: dwrite d1/da/d28/d30/d3e/d4e/d62/fe8 [0,4194304] 0 2024-04-03T08:39:42.217 INFO:tasks.workunit.client.1.smithi181.stdout:5/967: creat d4/d18/d2c/f140 x:0 0 0 2024-04-03T08:39:42.218 INFO:tasks.workunit.client.1.smithi181.stdout:7/897: chown d0/d1/d6/de/d17/d64/d85/d9a/c122 149 1 2024-04-03T08:39:42.221 INFO:tasks.workunit.client.1.smithi181.stdout:1/973: dread f2 [0,4194304] 0 2024-04-03T08:39:42.222 INFO:tasks.workunit.client.1.smithi181.stdout:9/979: write d1/da/d13/d22/d23/d36/d9c/fa7 [3226149,21693] 0 2024-04-03T08:39:42.223 INFO:tasks.workunit.client.1.smithi181.stdout:5/968: link d4/d18/d2c/fc1 d4/d18/d25/dac/f141 0 2024-04-03T08:39:42.224 INFO:tasks.workunit.client.1.smithi181.stdout:5/969: readlink d4/d56/lc7 0 2024-04-03T08:39:42.225 INFO:tasks.workunit.client.1.smithi181.stdout:1/974: unlink d10/d15/d17/d23/d27/l2d 0 2024-04-03T08:39:42.228 INFO:tasks.workunit.client.1.smithi181.stdout:9/980: mknod d1/da/d13/d22/d23/d36/d91/d9d/c13c 0 2024-04-03T08:39:42.230 INFO:tasks.workunit.client.1.smithi181.stdout:5/970: write d4/d18/f28 [339623,110008] 0 2024-04-03T08:39:42.232 INFO:tasks.workunit.client.1.smithi181.stdout:9/981: rmdir d1/da/d13/d41/daf 39 2024-04-03T08:39:42.237 INFO:tasks.workunit.client.1.smithi181.stdout:9/982: mknod d1/da/d28/d80/dc6/c13d 0 2024-04-03T08:39:42.240 INFO:tasks.workunit.client.1.smithi181.stdout:5/971: write d4/d22/d78/f85 [2150112,35006] 0 2024-04-03T08:39:42.240 INFO:tasks.workunit.client.1.smithi181.stdout:1/975: dwrite d10/d15/d17/d19/d33/f6a [4194304,4194304] 0 2024-04-03T08:39:42.245 INFO:tasks.workunit.client.1.smithi181.stdout:5/972: creat d4/d18/d55/d5a/f142 x:0 0 0 2024-04-03T08:39:42.246 INFO:tasks.workunit.client.1.smithi181.stdout:9/983: write d1/da/d13/d73/fb7 [2102439,96735] 0 2024-04-03T08:39:42.248 INFO:tasks.workunit.client.1.smithi181.stdout:1/976: write d10/d69/fd8 [578279,116621] 0 2024-04-03T08:39:42.249 INFO:tasks.workunit.client.1.smithi181.stdout:5/973: fdatasync d4/d22/d4a/dad/db6/d10c/f131 0 2024-04-03T08:39:42.250 INFO:tasks.workunit.client.1.smithi181.stdout:9/984: write d1/da/d28/d80/dd3/f11f [928581,7944] 0 2024-04-03T08:39:42.253 INFO:tasks.workunit.client.1.smithi181.stdout:1/977: creat d10/d15/d17/d37/f13e x:0 0 0 2024-04-03T08:39:42.255 INFO:tasks.workunit.client.1.smithi181.stdout:5/974: mknod d4/d22/d53/d98/dc2/d12d/c143 0 2024-04-03T08:39:42.255 INFO:tasks.workunit.client.1.smithi181.stdout:9/985: truncate d1/da/d13/d41/f1b 1826421 0 2024-04-03T08:39:42.258 INFO:tasks.workunit.client.1.smithi181.stdout:8/891: sync 2024-04-03T08:39:42.259 INFO:tasks.workunit.client.1.smithi181.stdout:1/978: read d10/d15/d4a/d6f/fa8 [1887745,19978] 0 2024-04-03T08:39:42.260 INFO:tasks.workunit.client.1.smithi181.stdout:9/986: chown d1/da/d28/d30/d3e/d4e/c74 45 1 2024-04-03T08:39:42.263 INFO:tasks.workunit.client.1.smithi181.stdout:8/892: dread - d4/d45/db/d14/d31/d1c/d51/d87/db1/d107/f125 zero size 2024-04-03T08:39:42.269 INFO:tasks.workunit.client.1.smithi181.stdout:9/987: rename d1/da/d28/d80/dd3/fd4 to d1/da/d13/d22/d23/f13e 0 2024-04-03T08:39:42.272 INFO:tasks.workunit.client.1.smithi181.stdout:8/893: rename d4/d44/d59/d5f/l93 to d4/d45/dae/dce/l128 0 2024-04-03T08:39:42.273 INFO:tasks.workunit.client.1.smithi181.stdout:5/975: dwrite d4/d18/fb9 [0,4194304] 0 2024-04-03T08:39:42.277 INFO:tasks.workunit.client.1.smithi181.stdout:9/988: mknod d1/da/d28/d30/d3e/d4e/d62/d10c/d127/c13f 0 2024-04-03T08:39:42.279 INFO:tasks.workunit.client.1.smithi181.stdout:5/976: creat d4/d18/d25/d68/f144 x:0 0 0 2024-04-03T08:39:42.285 INFO:tasks.workunit.client.1.smithi181.stdout:1/979: dread d10/d15/d17/d30/f7e [0,4194304] 0 2024-04-03T08:39:42.287 INFO:tasks.workunit.client.1.smithi181.stdout:1/980: readlink d10/d69/dd1/d113/l131 0 2024-04-03T08:39:42.288 INFO:tasks.workunit.client.1.smithi181.stdout:9/989: rmdir d1/da/d13/d22/d23/d36/d91/d11d 0 2024-04-03T08:39:42.289 INFO:tasks.workunit.client.1.smithi181.stdout:8/894: write d4/d2a/d37/f3f [5460498,3125] 0 2024-04-03T08:39:42.293 INFO:tasks.workunit.client.1.smithi181.stdout:8/895: creat d4/d2a/d37/dfb/f129 x:0 0 0 2024-04-03T08:39:42.295 INFO:tasks.workunit.client.1.smithi181.stdout:5/977: dwrite d4/d18/d25/db0/fbb [0,4194304] 0 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi181 to 2642M 2024-04-03T08:39:42.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:42.321 INFO:tasks.workunit.client.1.smithi181.stdout:9/990: rename d1/da/d28/d30/d3e to d1/da/d13/d22/d23/d36/d91/d9d/daa/d140 0 2024-04-03T08:39:42.322 INFO:tasks.workunit.client.1.smithi181.stdout:5/978: mkdir d4/d18/d25/d59/db3/d145 0 2024-04-03T08:39:42.322 INFO:tasks.workunit.client.1.smithi181.stdout:8/896: dread - d4/d45/db/d14/d31/d1c/d51/fde zero size 2024-04-03T08:39:42.327 INFO:tasks.workunit.client.1.smithi181.stdout:9/991: rename d1/da/d28/d80/dc6/c13d to d1/da/d13/d22/d23/d36/d91/c141 0 2024-04-03T08:39:42.329 INFO:tasks.workunit.client.1.smithi181.stdout:9/992: read - d1/da/d13/d41/d65/f124 zero size 2024-04-03T08:39:42.331 INFO:tasks.workunit.client.1.smithi181.stdout:5/979: write d4/d22/f63 [4348063,89572] 0 2024-04-03T08:39:42.333 INFO:tasks.workunit.client.1.smithi181.stdout:8/897: getdents d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e 0 2024-04-03T08:39:42.335 INFO:tasks.workunit.client.1.smithi181.stdout:5/980: rmdir d4/d18/d55/d5a 39 2024-04-03T08:39:42.336 INFO:tasks.workunit.client.1.smithi181.stdout:8/898: chown d4/d45/db/d14/lb4 2350 1 2024-04-03T08:39:42.341 INFO:tasks.workunit.client.1.smithi181.stdout:8/899: rmdir d4/d44/d59/d120/d127 0 2024-04-03T08:39:42.342 INFO:tasks.workunit.client.1.smithi181.stdout:5/981: rename d4/d18/d25/d59/db3/d145 to d4/d18/d55/d5a/dcd/dee/d146 0 2024-04-03T08:39:42.344 INFO:tasks.workunit.client.1.smithi181.stdout:8/900: write d4/d45/db/f8c [4103483,4401] 0 2024-04-03T08:39:42.349 INFO:tasks.workunit.client.1.smithi181.stdout:5/982: getdents d4/d18/d55/db4/d90 0 2024-04-03T08:39:42.350 INFO:tasks.workunit.client.1.smithi181.stdout:9/993: dwrite d1/da/d13/d22/d23/d36/d91/d9d/daa/d140/d4e/d62/d10c/f125 [0,4194304] 0 2024-04-03T08:39:42.351 INFO:tasks.workunit.client.1.smithi181.stdout:8/901: dread - d4/d45/db/d14/d31/d1c/d51/d87/db1/d107/f10c zero size 2024-04-03T08:39:42.352 INFO:tasks.workunit.client.1.smithi181.stdout:5/983: rmdir d4/d80 39 2024-04-03T08:39:42.355 INFO:tasks.workunit.client.1.smithi181.stdout:8/902: chown d4/d45/db/d14/d31/d1c/de8/f109 1153 1 2024-04-03T08:39:42.355 INFO:tasks.workunit.client.1.smithi181.stdout:9/994: write d1/da/d13/d41/daf/df1/ff4 [229152,118105] 0 2024-04-03T08:39:42.355 INFO:tasks.workunit.client.1.smithi181.stdout:5/984: fsync d4/d18/d55/d5a/fbf 0 2024-04-03T08:39:42.360 INFO:tasks.workunit.client.1.smithi181.stdout:5/985: creat d4/d22/d4a/f147 x:0 0 0 2024-04-03T08:39:42.364 INFO:tasks.workunit.client.1.smithi181.stdout:5/986: creat d4/d18/d25/d68/f148 x:0 0 0 2024-04-03T08:39:42.366 INFO:tasks.workunit.client.1.smithi181.stdout:9/995: creat d1/da/d13/d22/d23/d36/d91/d9d/daa/d140/d4e/da3/f142 x:0 0 0 2024-04-03T08:39:42.371 INFO:tasks.workunit.client.1.smithi181.stdout:9/996: symlink d1/da/d13/l143 0 2024-04-03T08:39:42.376 INFO:tasks.workunit.client.1.smithi181.stdout:9/997: readlink d1/da/d13/d22/d23/d36/d91/d9d/d39/d7c/lb4 0 2024-04-03T08:39:42.386 INFO:tasks.workunit.client.1.smithi181.stdout:9/998: rename d1/da/d13/d22/d23/d36/d91/d9d/f37 to d1/da/d28/d30/dd8/df0/f144 0 2024-04-03T08:39:42.387 INFO:tasks.workunit.client.1.smithi181.stdout:0/963: sync 2024-04-03T08:39:42.387 INFO:tasks.workunit.client.1.smithi181.stdout:7/898: sync 2024-04-03T08:39:42.388 INFO:tasks.workunit.client.1.smithi181.stdout:5/987: dwrite d4/d22/d53/d98/f124 [0,4194304] 0 2024-04-03T08:39:42.391 INFO:tasks.workunit.client.1.smithi181.stdout:7/899: symlink d0/d1/d6/ddf/l146 0 2024-04-03T08:39:42.391 INFO:tasks.workunit.client.1.smithi181.stdout:0/964: write d5/d9/f7f [2802260,65644] 0 2024-04-03T08:39:42.392 INFO:tasks.workunit.client.1.smithi181.stdout:8/903: dread d4/d2a/d37/f3f [0,4194304] 0 2024-04-03T08:39:42.394 INFO:tasks.workunit.client.1.smithi181.stdout:5/988: mkdir d4/d18/d25/db0/d149 0 2024-04-03T08:39:42.399 INFO:tasks.workunit.client.1.smithi181.stdout:0/965: creat d5/dc/d10/d58/dba/d124/f13f x:0 0 0 2024-04-03T08:39:42.403 INFO:tasks.workunit.client.1.smithi181.stdout:8/904: getdents d4/d2a/d37/dfb/d91 0 2024-04-03T08:39:42.403 INFO:tasks.workunit.client.1.smithi181.stdout:5/989: dread d4/d44/f92 [0,4194304] 0 2024-04-03T08:39:42.408 INFO:tasks.workunit.client.1.smithi181.stdout:0/966: creat d5/dc/d10/d58/d6c/f140 x:0 0 0 2024-04-03T08:39:42.409 INFO:tasks.workunit.client.1.smithi181.stdout:8/905: mknod d4/d45/db/d14/d31/d1c/d51/d87/db1/c12a 0 2024-04-03T08:39:42.413 INFO:tasks.workunit.client.1.smithi181.stdout:0/967: chown d5/dc/d10/d58/d6c/la2 738900 1 2024-04-03T08:39:42.414 INFO:tasks.workunit.client.1.smithi181.stdout:7/900: dwrite d0/d1/d6/de/f69 [0,4194304] 0 2024-04-03T08:39:42.417 INFO:tasks.workunit.client.1.smithi181.stdout:7/901: write d0/d1/d94/f138 [962326,77267] 0 2024-04-03T08:39:42.417 INFO:tasks.workunit.client.1.smithi181.stdout:8/906: creat d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/def/f12b x:0 0 0 2024-04-03T08:39:42.420 INFO:tasks.workunit.client.1.smithi181.stdout:0/968: symlink d5/dc/d75/l141 0 2024-04-03T08:39:42.421 INFO:tasks.workunit.client.1.smithi181.stdout:7/902: chown d0/d1/d6/de/d17/d64/d85 2 1 2024-04-03T08:39:42.422 INFO:tasks.workunit.client.1.smithi181.stdout:5/990: dwrite d4/d22/d72/d93/f104 [0,4194304] 0 2024-04-03T08:39:42.424 INFO:tasks.workunit.client.1.smithi181.stdout:0/969: fsync d5/dc/d10/f8f 0 2024-04-03T08:39:42.430 INFO:tasks.workunit.client.0.smithi157.stdout:1/988: sync 2024-04-03T08:39:42.433 INFO:tasks.workunit.client.1.smithi181.stdout:0/970: truncate d5/d9/f97 6568810 0 2024-04-03T08:39:42.434 INFO:tasks.workunit.client.1.smithi181.stdout:8/907: dread d4/d44/d59/f78 [0,4194304] 0 2024-04-03T08:39:42.435 INFO:tasks.workunit.client.1.smithi181.stdout:0/971: stat d5/dc/d10/d30/l3d 0 2024-04-03T08:39:42.435 INFO:tasks.workunit.client.0.smithi157.stdout:1/989: symlink d2/d11/d24/d39/d115/l150 0 2024-04-03T08:39:42.437 INFO:tasks.workunit.client.1.smithi181.stdout:0/972: fdatasync d5/d9/d2a/da1/fc6 0 2024-04-03T08:39:42.437 INFO:tasks.workunit.client.1.smithi181.stdout:0/973: stat d5/dc/d75/l141 0 2024-04-03T08:39:42.439 INFO:tasks.workunit.client.1.smithi181.stdout:7/903: rename d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/dbf/l104 to d0/d1/d6/de/da3/l147 0 2024-04-03T08:39:42.439 INFO:tasks.workunit.client.1.smithi181.stdout:5/991: link d4/d18/d55/d5a/dcd/dee/l103 d4/d22/d72/d93/l14a 0 2024-04-03T08:39:42.441 INFO:tasks.workunit.client.1.smithi181.stdout:8/908: mkdir d4/d44/d59/d5f/d12c 0 2024-04-03T08:39:42.443 INFO:tasks.workunit.client.1.smithi181.stdout:0/974: symlink d5/dc/d14/d8d/dec/l142 0 2024-04-03T08:39:42.444 INFO:tasks.workunit.client.1.smithi181.stdout:0/975: fdatasync d5/d9/d2a/de6/dcc/fe2 0 2024-04-03T08:39:42.447 INFO:tasks.workunit.client.0.smithi157.stdout:1/990: creat d2/d11/d24/d39/d3b/d2e/d66/d91/f151 x:0 0 0 2024-04-03T08:39:42.449 INFO:tasks.workunit.client.1.smithi181.stdout:7/904: dread d0/d1/d94/ff0 [0,4194304] 0 2024-04-03T08:39:42.452 INFO:tasks.workunit.client.1.smithi181.stdout:8/909: mkdir d4/d45/db/d12d 0 2024-04-03T08:39:42.463 INFO:tasks.workunit.client.0.smithi157.stdout:1/991: dwrite d2/d11/d24/fb8 [0,4194304] 0 2024-04-03T08:39:42.463 INFO:tasks.workunit.client.1.smithi181.stdout:7/905: link d0/d1/d6/de/d17/d64/c76 d0/d1/d6/de/d17/d27/d72/c148 0 2024-04-03T08:39:42.467 INFO:tasks.workunit.client.1.smithi181.stdout:7/906: stat d0/d1/d6/de/d17/f24 0 2024-04-03T08:39:42.471 INFO:tasks.workunit.client.1.smithi181.stdout:7/907: truncate d0/d1/d6/fff 4819882 0 2024-04-03T08:39:42.473 INFO:tasks.workunit.client.1.smithi181.stdout:5/992: dread d4/f5e [0,4194304] 0 2024-04-03T08:39:42.475 INFO:tasks.workunit.client.1.smithi181.stdout:8/910: dwrite d4/d45/db/d14/d31/d1c/d51/d87/db1/fb7 [0,4194304] 0 2024-04-03T08:39:42.478 INFO:tasks.workunit.client.1.smithi181.stdout:7/908: unlink d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/fad 0 2024-04-03T08:39:42.480 INFO:tasks.workunit.client.1.smithi181.stdout:5/993: mkdir d4/d22/d4a/dad/d14b 0 2024-04-03T08:39:42.484 INFO:tasks.workunit.client.1.smithi181.stdout:5/994: symlink d4/d18/d55/db4/d8a/l14c 0 2024-04-03T08:39:42.485 INFO:tasks.workunit.client.1.smithi181.stdout:7/909: symlink d0/d1/d6/dca/l149 0 2024-04-03T08:39:42.489 INFO:tasks.workunit.client.1.smithi181.stdout:7/910: rmdir d0/d1/d6/de/da3 39 2024-04-03T08:39:42.489 INFO:tasks.workunit.client.0.smithi157.stdout:1/992: dwrite d2/d11/d24/d39/d3b/d2e/d66/f145 [0,4194304] 0 2024-04-03T08:39:42.493 INFO:tasks.workunit.client.1.smithi181.stdout:7/911: write d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/f130 [541045,115670] 0 2024-04-03T08:39:42.494 INFO:tasks.workunit.client.1.smithi181.stdout:8/911: truncate d4/d45/db/d14/f49 4106879 0 2024-04-03T08:39:42.497 INFO:tasks.workunit.client.1.smithi181.stdout:8/912: dread - d4/d2a/d37/dfb/f129 zero size 2024-04-03T08:39:42.499 INFO:tasks.workunit.client.0.smithi157.stdout:1/993: dread - d2/d11/d23/dc9/d5d/db4/dbc/def/d137/f147 zero size 2024-04-03T08:39:42.499 INFO:tasks.workunit.client.1.smithi181.stdout:7/912: chown d0/d1/d6/de/d17/d27/d93/l120 6 1 2024-04-03T08:39:42.501 INFO:tasks.workunit.client.1.smithi181.stdout:5/995: dwrite d4/d18/d25/d68/f107 [0,4194304] 0 2024-04-03T08:39:42.501 INFO:tasks.workunit.client.1.smithi181.stdout:8/913: mknod d4/d45/dae/dce/d114/c12e 0 2024-04-03T08:39:42.502 INFO:tasks.workunit.client.1.smithi181.stdout:7/913: dread - d0/d1/d6/de/d17/d64/d85/f129 zero size 2024-04-03T08:39:42.508 INFO:tasks.workunit.client.1.smithi181.stdout:5/996: mkdir d4/d18/d25/d59/d14d 0 2024-04-03T08:39:42.509 INFO:tasks.workunit.client.0.smithi157.stdout:1/994: creat d2/d11/d23/dc9/d58/d94/f152 x:0 0 0 2024-04-03T08:39:42.509 INFO:tasks.workunit.client.1.smithi181.stdout:8/914: creat d4/d45/db/d14/d31/f12f x:0 0 0 2024-04-03T08:39:42.511 INFO:tasks.workunit.client.0.smithi157.stdout:1/995: fsync d2/d11/d23/dc9/da1/ded/fff 0 2024-04-03T08:39:42.512 INFO:tasks.workunit.client.1.smithi181.stdout:5/997: mknod d4/d18/d3e/c14e 0 2024-04-03T08:39:42.514 INFO:tasks.workunit.client.0.smithi157.stdout:1/996: dread - d2/d11/d24/dd5/f109 zero size 2024-04-03T08:39:42.525 INFO:tasks.workunit.client.1.smithi181.stdout:7/914: write d0/d1/d6/de/d17/d64/f7c [371757,57636] 0 2024-04-03T08:39:42.526 INFO:tasks.workunit.client.1.smithi181.stdout:5/998: dwrite d4/d22/f63 [4194304,4194304] 0 2024-04-03T08:39:42.527 INFO:tasks.workunit.client.1.smithi181.stdout:8/915: truncate d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fed 3950387 0 2024-04-03T08:39:42.533 INFO:tasks.workunit.client.0.smithi157.stdout:1/997: dwrite d2/d11/d24/d39/dc6/f142 [0,4194304] 0 2024-04-03T08:39:42.535 INFO:tasks.workunit.client.1.smithi181.stdout:7/915: creat d0/d1/d6/de/d17/d27/f14a x:0 0 0 2024-04-03T08:39:42.537 INFO:tasks.workunit.client.1.smithi181.stdout:7/916: readlink d0/d1/d6/de/d17/lf8 0 2024-04-03T08:39:42.538 INFO:tasks.workunit.client.0.smithi157.stdout:1/998: unlink d2/d11/d24/d39/d3b/c6d 0 2024-04-03T08:39:42.539 INFO:tasks.workunit.client.1.smithi181.stdout:1/981: sync 2024-04-03T08:39:42.543 INFO:tasks.workunit.client.1.smithi181.stdout:1/982: mkdir d10/d15/d17/d19/d4c/d13f 0 2024-04-03T08:39:42.545 INFO:tasks.workunit.client.0.smithi157.stdout:1/999: creat d2/d11/d24/d108/f153 x:0 0 0 2024-04-03T08:39:42.546 INFO:tasks.workunit.client.1.smithi181.stdout:1/983: stat d10/d15/d17/d23/daa/f128 0 2024-04-03T08:39:42.548 INFO:tasks.workunit.client.1.smithi181.stdout:7/917: write d0/d1/d94/f139 [53200,63476] 0 2024-04-03T08:39:42.551 INFO:tasks.workunit.client.1.smithi181.stdout:7/918: mkdir d0/d1/d6/db0/d14b 0 2024-04-03T08:39:42.554 INFO:tasks.workunit.client.0.smithi157.stderr:+ rm -rf -- ./tmp.gdQsQELSAJ 2024-04-03T08:39:42.557 INFO:tasks.workunit.client.1.smithi181.stdout:7/919: mkdir d0/d1/d6/de/d17/d64/d85/dd8/dea/d14c 0 2024-04-03T08:39:42.566 INFO:tasks.workunit.client.1.smithi181.stdout:5/999: dread d4/d18/d25/d68/d77/f9b [0,4194304] 0 2024-04-03T08:39:42.567 INFO:tasks.workunit.client.1.smithi181.stdout:8/916: dread d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fb8 [0,4194304] 0 2024-04-03T08:39:42.572 INFO:tasks.workunit.client.1.smithi181.stdout:1/984: dread d10/d15/d17/d23/d27/f3a [0,4194304] 0 2024-04-03T08:39:42.575 INFO:tasks.workunit.client.1.smithi181.stdout:1/985: fsync d10/d15/d17/d19/f6d 0 2024-04-03T08:39:42.580 INFO:tasks.workunit.client.1.smithi181.stdout:1/986: write d10/d15/d41/f44 [696411,91959] 0 2024-04-03T08:39:42.581 INFO:tasks.workunit.client.1.smithi181.stdout:7/920: dread d0/f3e [0,4194304] 0 2024-04-03T08:39:42.585 INFO:tasks.workunit.client.1.smithi181.stdout:1/987: symlink d10/d15/d4b/d6c/l140 0 2024-04-03T08:39:42.586 INFO:tasks.workunit.client.1.smithi181.stdout:8/917: dwrite d4/d44/d59/d120/fd9 [0,4194304] 0 2024-04-03T08:39:42.586 INFO:tasks.workunit.client.1.smithi181.stdout:1/988: chown d10/d69/ld0 43612800 1 2024-04-03T08:39:42.589 INFO:tasks.workunit.client.1.smithi181.stdout:7/921: fdatasync d0/d1/f66 0 2024-04-03T08:39:42.596 INFO:tasks.workunit.client.1.smithi181.stdout:8/918: chown d4/d2a/d37/dfb/d91/fe9 68 1 2024-04-03T08:39:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi181 to 2642M 2024-04-03T08:39:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:42.598 INFO:tasks.workunit.client.1.smithi181.stdout:8/919: dread - d4/d45/db/d14/d31/f12f zero size 2024-04-03T08:39:42.638 INFO:tasks.workunit.client.1.smithi181.stdout:7/922: rename d0/d1/d6/de/d17/d64/d85/d9a/d109 to d0/d1/d6/de/d17/d64/d14d 0 2024-04-03T08:39:42.640 INFO:tasks.workunit.client.1.smithi181.stdout:1/989: rmdir d10/d69/dd1/d118 0 2024-04-03T08:39:42.641 INFO:tasks.workunit.client.1.smithi181.stdout:7/923: fsync d0/f54 0 2024-04-03T08:39:42.651 INFO:tasks.workunit.client.1.smithi181.stdout:7/924: rename d0/d1/d6/de/d17/d27/f3a to d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/f14e 0 2024-04-03T08:39:42.653 INFO:tasks.workunit.client.1.smithi181.stdout:7/925: read d0/d1/d6/f11f [323031,111834] 0 2024-04-03T08:39:42.657 INFO:tasks.workunit.client.1.smithi181.stdout:9/999: sync 2024-04-03T08:39:42.657 INFO:tasks.workunit.client.1.smithi181.stdout:0/976: sync 2024-04-03T08:39:42.683 INFO:tasks.workunit.client.1.smithi181.stdout:8/920: dwrite d4/d2a/d37/dfb/fd7 [0,4194304] 0 2024-04-03T08:39:42.690 INFO:tasks.workunit.client.1.smithi181.stdout:1/990: dwrite d10/d15/d17/d19/d33/d70/fdd [0,4194304] 0 2024-04-03T08:39:42.692 INFO:tasks.workunit.client.1.smithi181.stdout:8/921: mknod d4/d2a/d37/c130 0 2024-04-03T08:39:42.696 INFO:tasks.workunit.client.1.smithi181.stdout:8/922: fsync d4/d44/d59/d5f/d6c/dd1/f10f 0 2024-04-03T08:39:42.712 INFO:tasks.workunit.client.1.smithi181.stdout:1/991: dwrite d10/d15/d17/d23/d27/f116 [0,4194304] 0 2024-04-03T08:39:42.717 INFO:tasks.workunit.client.1.smithi181.stdout:8/923: dwrite d4/d45/d96/f124 [0,4194304] 0 2024-04-03T08:39:42.721 INFO:tasks.workunit.client.1.smithi181.stdout:1/992: unlink d10/d15/d17/d19/d4c/c127 0 2024-04-03T08:39:42.735 INFO:tasks.workunit.client.1.smithi181.stdout:1/993: symlink d10/d15/d4a/d6f/d124/l141 0 2024-04-03T08:39:42.737 INFO:tasks.workunit.client.1.smithi181.stdout:8/924: rmdir d4/d45/db/d14/d31/d1c/d51/d87/de0 0 2024-04-03T08:39:42.753 INFO:tasks.workunit.client.1.smithi181.stdout:8/925: dwrite d4/f36 [0,4194304] 0 2024-04-03T08:39:42.756 INFO:tasks.workunit.client.1.smithi181.stdout:8/926: fdatasync d4/d45/db/d14/d31/d1c/d51/d87/db1/ffa 0 2024-04-03T08:39:42.766 INFO:tasks.workunit.client.1.smithi181.stdout:1/994: dread d10/f11 [0,4194304] 0 2024-04-03T08:39:42.766 INFO:tasks.workunit.client.1.smithi181.stdout:8/927: link d4/d45/db/d14/fb5 d4/d44/d59/f131 0 2024-04-03T08:39:42.767 INFO:tasks.workunit.client.1.smithi181.stdout:1/995: read - d10/d15/d41/fa3 zero size 2024-04-03T08:39:42.770 INFO:tasks.workunit.client.1.smithi181.stdout:7/926: sync 2024-04-03T08:39:42.770 INFO:tasks.workunit.client.1.smithi181.stdout:0/977: sync 2024-04-03T08:39:42.772 INFO:tasks.workunit.client.1.smithi181.stdout:0/978: chown d5/dc/d75/de1/f102 1313865 1 2024-04-03T08:39:42.773 INFO:tasks.workunit.client.1.smithi181.stdout:8/928: creat d4/f132 x:0 0 0 2024-04-03T08:39:42.774 INFO:tasks.workunit.client.1.smithi181.stdout:7/927: write d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f127 [903374,54280] 0 2024-04-03T08:39:42.775 INFO:tasks.workunit.client.1.smithi181.stdout:0/979: chown d5/dc/d10/d58/d6c/fda 10 1 2024-04-03T08:39:42.776 INFO:tasks.workunit.client.1.smithi181.stdout:0/980: readlink d5/dc/d14/d29/d46/l6d 0 2024-04-03T08:39:42.780 INFO:tasks.workunit.client.1.smithi181.stdout:8/929: fsync d4/f19 0 2024-04-03T08:39:42.787 INFO:tasks.workunit.client.1.smithi181.stdout:8/930: dread - d4/d45/db/d14/d31/f12f zero size 2024-04-03T08:39:42.787 INFO:tasks.workunit.client.1.smithi181.stdout:7/928: dwrite d0/d1/f15 [4194304,4194304] 0 2024-04-03T08:39:42.794 INFO:tasks.workunit.client.1.smithi181.stdout:7/929: rename d0/d1/d6/de/d17/d64/d85/f13f to d0/d115/f14f 0 2024-04-03T08:39:42.805 INFO:tasks.workunit.client.1.smithi181.stdout:0/981: write d5/dc/d14/d29/fc2 [740540,110822] 0 2024-04-03T08:39:42.808 INFO:tasks.workunit.client.1.smithi181.stdout:0/982: readlink d5/dc/d10/d30/l118 0 2024-04-03T08:39:42.810 INFO:tasks.workunit.client.1.smithi181.stdout:8/931: dread d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f118 [0,4194304] 0 2024-04-03T08:39:42.812 INFO:tasks.workunit.client.1.smithi181.stdout:0/983: creat d5/dc/d14/d29/d46/d11f/f143 x:0 0 0 2024-04-03T08:39:42.813 INFO:tasks.workunit.client.1.smithi181.stdout:7/930: dwrite d0/d1/d6/de/d17/f1b [0,4194304] 0 2024-04-03T08:39:42.813 INFO:tasks.workunit.client.1.smithi181.stdout:8/932: read d4/d45/db/d14/d31/d1c/d51/d87/db1/fb7 [6077,6425] 0 2024-04-03T08:39:42.816 INFO:tasks.workunit.client.1.smithi181.stdout:7/931: fdatasync d0/d1/d6/de/d17/d27/f4e 0 2024-04-03T08:39:42.824 INFO:tasks.workunit.client.1.smithi181.stdout:0/984: write d5/dc/d14/d29/f78 [3585224,53895] 0 2024-04-03T08:39:42.825 INFO:tasks.workunit.client.1.smithi181.stdout:7/932: unlink d0/d1/d6/de/d17/d64/d85/f129 0 2024-04-03T08:39:42.830 INFO:tasks.workunit.client.1.smithi181.stdout:7/933: creat d0/d1/d6/de/d17/d64/f150 x:0 0 0 2024-04-03T08:39:42.831 INFO:tasks.workunit.client.1.smithi181.stdout:1/996: sync 2024-04-03T08:39:42.836 INFO:tasks.workunit.client.1.smithi181.stdout:1/997: mkdir d10/d15/d17/d19/d33/d142 0 2024-04-03T08:39:42.840 INFO:tasks.workunit.client.1.smithi181.stdout:1/998: chown d10/d15/d17/d19/d33/c10d 555383332 1 2024-04-03T08:39:42.846 INFO:tasks.workunit.client.1.smithi181.stdout:1/999: unlink d10/d15/d4a/c53 0 2024-04-03T08:39:42.846 INFO:tasks.workunit.client.1.smithi181.stdout:7/934: dwrite d0/d1/d6/de/d17/d64/d14d/f11d [0,4194304] 0 2024-04-03T08:39:42.851 INFO:tasks.workunit.client.1.smithi181.stdout:8/933: dwrite d4/d44/d59/d5f/d6c/f81 [0,4194304] 0 2024-04-03T08:39:42.853 INFO:tasks.workunit.client.1.smithi181.stdout:7/935: write d0/d1/d6/de/d17/f24 [2995492,99711] 0 2024-04-03T08:39:42.862 INFO:tasks.workunit.client.1.smithi181.stdout:0/985: dwrite d5/dc/d14/d29/f47 [0,4194304] 0 2024-04-03T08:39:42.871 INFO:tasks.workunit.client.1.smithi181.stdout:0/986: truncate d5/d9/d2a/f128 253743 0 2024-04-03T08:39:42.884 INFO:tasks.workunit.client.1.smithi181.stdout:0/987: link d5/dc/d10/d58/dba/d90/f113 d5/dc/d10/d30/f144 0 2024-04-03T08:39:42.886 INFO:tasks.workunit.client.1.smithi181.stdout:8/934: dwrite d4/d45/db/d14/d31/d1c/d51/fde [0,4194304] 0 2024-04-03T08:39:42.891 INFO:tasks.workunit.client.1.smithi181.stdout:0/988: rename d5/dc/d10/fd2 to d5/dc/d10/d30/f145 0 2024-04-03T08:39:42.893 INFO:tasks.workunit.client.1.smithi181.stdout:0/989: write d5/dc/d10/d58/db0/f13e [619268,31630] 0 2024-04-03T08:39:42.897 INFO:tasks.workunit.client.1.smithi181.stdout:8/935: mkdir d4/d45/db/d14/d31/d1c/d51/d87/d133 0 2024-04-03T08:39:42.917 INFO:tasks.workunit.client.1.smithi181.stdout:8/936: write d4/d45/db/d14/d31/d1c/f53 [884075,122155] 0 2024-04-03T08:39:42.919 INFO:tasks.workunit.client.1.smithi181.stdout:0/990: dread f2 [4194304,4194304] 0 2024-04-03T08:39:42.921 INFO:tasks.workunit.client.1.smithi181.stdout:8/937: creat d4/d44/d59/d5f/d6c/dd1/f134 x:0 0 0 2024-04-03T08:39:42.926 INFO:tasks.workunit.client.1.smithi181.stdout:0/991: creat d5/d9/d2a/f146 x:0 0 0 2024-04-03T08:39:42.931 INFO:tasks.workunit.client.1.smithi181.stdout:8/938: creat d4/d45/f135 x:0 0 0 2024-04-03T08:39:42.934 INFO:tasks.workunit.client.1.smithi181.stdout:8/939: chown d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc 81463408 1 2024-04-03T08:39:42.936 INFO:tasks.workunit.client.1.smithi181.stdout:8/940: stat d4/d45/db/d14 0 2024-04-03T08:39:42.939 INFO:tasks.workunit.client.1.smithi181.stdout:0/992: dwrite d5/dc/f21 [4194304,4194304] 0 2024-04-03T08:39:42.940 INFO:tasks.workunit.client.1.smithi181.stdout:7/936: sync 2024-04-03T08:39:42.941 INFO:tasks.workunit.client.1.smithi181.stdout:7/937: chown d0/d1/d6/ddf 2272365 1 2024-04-03T08:39:42.945 INFO:tasks.workunit.client.1.smithi181.stdout:7/938: truncate d0/d1/d6/de/d17/d64/d14d/f126 486576 0 2024-04-03T08:39:42.947 INFO:tasks.workunit.client.1.smithi181.stdout:8/941: write d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f118 [1649983,103184] 0 2024-04-03T08:39:42.950 INFO:tasks.workunit.client.1.smithi181.stdout:0/993: link d5/dc/c1b d5/d9/d2a/d10e/c147 0 2024-04-03T08:39:42.952 INFO:tasks.workunit.client.1.smithi181.stdout:7/939: creat d0/d1/d6/de/d17/d64/d85/d9a/da4/db3/dc4/f151 x:0 0 0 2024-04-03T08:39:42.958 INFO:tasks.workunit.client.1.smithi181.stdout:0/994: creat d5/dc/d10/d58/db0/db8/f148 x:0 0 0 2024-04-03T08:39:42.963 INFO:tasks.workunit.client.1.smithi181.stdout:8/942: truncate d4/d45/db/d14/d31/d1c/f53 922652 0 2024-04-03T08:39:42.963 INFO:tasks.workunit.client.1.smithi181.stdout:0/995: rmdir d5/dc/d14/d29/d46 39 2024-04-03T08:39:42.966 INFO:tasks.workunit.client.1.smithi181.stdout:8/943: mkdir d4/d45/dae/d136 0 2024-04-03T08:39:42.967 INFO:tasks.workunit.client.1.smithi181.stdout:7/940: truncate d0/d1/d6/de/f69 2887616 0 2024-04-03T08:39:42.968 INFO:tasks.workunit.client.1.smithi181.stdout:0/996: readlink d5/dc/d14/d29/d46/ldc 0 2024-04-03T08:39:42.969 INFO:tasks.workunit.client.1.smithi181.stdout:7/941: truncate d0/d1/d6/fff 5304955 0 2024-04-03T08:39:42.976 INFO:tasks.workunit.client.1.smithi181.stdout:7/942: fsync d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f102 0 2024-04-03T08:39:42.991 INFO:tasks.workunit.client.1.smithi181.stdout:8/944: dwrite d4/d2a/f5d [0,4194304] 0 2024-04-03T08:39:42.995 INFO:tasks.workunit.client.1.smithi181.stdout:8/945: creat d4/d44/d59/d5f/d6c/dd1/f137 x:0 0 0 2024-04-03T08:39:42.996 INFO:tasks.workunit.client.1.smithi181.stdout:7/943: dwrite d0/d1/d6/de/d17/d64/fa5 [0,4194304] 0 2024-04-03T08:39:42.999 INFO:tasks.workunit.client.1.smithi181.stdout:0/997: dread d5/dc/d10/d58/db0/fde [0,4194304] 0 2024-04-03T08:39:43.006 INFO:tasks.workunit.client.1.smithi181.stdout:7/944: creat d0/d1/d6/f152 x:0 0 0 2024-04-03T08:39:43.009 INFO:tasks.workunit.client.1.smithi181.stdout:7/945: fsync d0/d1/d6/de/d17/d27/d72/f12e 0 2024-04-03T08:39:43.015 INFO:tasks.workunit.client.1.smithi181.stdout:7/946: mknod d0/d1/d6/dca/d12b/c153 0 2024-04-03T08:39:43.017 INFO:tasks.workunit.client.1.smithi181.stdout:8/946: dwrite d4/d44/d59/d5f/f75 [0,4194304] 0 2024-04-03T08:39:43.022 INFO:tasks.workunit.client.1.smithi181.stdout:8/947: chown d4/d44/l11f 245608175 1 2024-04-03T08:39:43.023 INFO:tasks.workunit.client.1.smithi181.stdout:7/947: symlink d0/d1/d6/de/d17/d27/l154 0 2024-04-03T08:39:43.024 INFO:tasks.workunit.client.1.smithi181.stdout:0/998: write d5/f7c [4223222,33439] 0 2024-04-03T08:39:43.031 INFO:tasks.workunit.client.1.smithi181.stdout:7/948: mknod d0/d1/d6/de/d17/d64/d85/dd8/dea/c155 0 2024-04-03T08:39:43.035 INFO:tasks.workunit.client.1.smithi181.stdout:8/948: rename d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/f123 to d4/f138 0 2024-04-03T08:39:43.040 INFO:tasks.workunit.client.1.smithi181.stdout:7/949: link d0/d1/d6/de/d17/c22 d0/d1/d6/de/d17/d64/d85/d87/c156 0 2024-04-03T08:39:43.044 INFO:tasks.workunit.client.1.smithi181.stdout:8/949: write d4/d44/f82 [485372,87493] 0 2024-04-03T08:39:43.045 INFO:tasks.workunit.client.1.smithi181.stdout:7/950: mknod d0/d1/d6/de/d17/d64/d85/d87/d10a/c157 0 2024-04-03T08:39:43.047 INFO:tasks.workunit.client.1.smithi181.stdout:8/950: chown d4/d44/d59/ce5 1507843 1 2024-04-03T08:39:43.051 INFO:tasks.workunit.client.1.smithi181.stdout:8/951: fdatasync d4/d45/db/d14/d31/d1c/f2b 0 2024-04-03T08:39:43.055 INFO:tasks.workunit.client.1.smithi181.stdout:7/951: write d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/f9c [2485679,87354] 0 2024-04-03T08:39:43.056 INFO:tasks.workunit.client.1.smithi181.stdout:0/999: dread d5/d9/f28 [0,4194304] 0 2024-04-03T08:39:43.057 INFO:tasks.workunit.client.1.smithi181.stdout:8/952: symlink d4/d45/db/d14/d31/d1c/d51/d87/l139 0 2024-04-03T08:39:43.059 INFO:tasks.workunit.client.1.smithi181.stdout:8/953: chown d4/d45/db/d14 355 1 2024-04-03T08:39:43.064 INFO:tasks.workunit.client.1.smithi181.stdout:8/954: link d4/d45/db/d14/fc3 d4/d45/d96/f13a 0 2024-04-03T08:39:43.067 INFO:tasks.workunit.client.1.smithi181.stdout:8/955: creat d4/d44/df3/f13b x:0 0 0 2024-04-03T08:39:43.072 INFO:tasks.workunit.client.1.smithi181.stdout:7/952: dwrite d0/d1/d6/de/d17/d64/d82/d12d/f13e [0,4194304] 0 2024-04-03T08:39:43.079 INFO:tasks.workunit.client.1.smithi181.stdout:7/953: unlink d0/d1/d6/de/d17/d64/d85/d9a/da4/l84 0 2024-04-03T08:39:43.084 INFO:tasks.workunit.client.1.smithi181.stdout:8/956: dwrite d4/d45/db/d14/fb5 [0,4194304] 0 2024-04-03T08:39:43.087 INFO:tasks.workunit.client.1.smithi181.stdout:7/954: dread d0/d1/d94/f138 [0,4194304] 0 2024-04-03T08:39:43.092 INFO:tasks.workunit.client.1.smithi181.stdout:7/955: truncate d0/f2f 2316989 0 2024-04-03T08:39:43.092 INFO:tasks.workunit.client.1.smithi181.stdout:8/957: rmdir d4/d44/d10d 0 2024-04-03T08:39:43.102 INFO:tasks.workunit.client.1.smithi181.stdout:8/958: dread d4/d45/db/d14/d31/f3c [0,4194304] 0 2024-04-03T08:39:43.105 INFO:tasks.workunit.client.1.smithi181.stdout:7/956: dread d0/d1/d6/de/d17/d64/d85/dd8/f108 [0,4194304] 0 2024-04-03T08:39:43.127 INFO:tasks.workunit.client.1.smithi181.stdout:7/957: link d0/d1/d6/de/da3/ff7 d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/dbf/f158 0 2024-04-03T08:39:43.129 INFO:tasks.workunit.client.1.smithi181.stdout:8/959: dwrite d4/d45/db/f66 [0,4194304] 0 2024-04-03T08:39:43.130 INFO:tasks.workunit.client.1.smithi181.stdout:8/960: stat d4/d45/d9/le3 0 2024-04-03T08:39:43.137 INFO:tasks.workunit.client.1.smithi181.stdout:7/958: stat d0/d1/d6/de/d17/d64/d85/d87/lce 0 2024-04-03T08:39:43.143 INFO:tasks.workunit.client.1.smithi181.stdout:7/959: mkdir d0/d1/d6/de/d17/d64/d85/dd8/dea/d14c/d159 0 2024-04-03T08:39:43.146 INFO:tasks.workunit.client.1.smithi181.stdout:8/961: dwrite d4/d44/d59/d120/fd9 [0,4194304] 0 2024-04-03T08:39:43.149 INFO:tasks.workunit.client.1.smithi181.stdout:7/960: creat d0/d1/d6/de/d17/f15a x:0 0 0 2024-04-03T08:39:43.151 INFO:tasks.workunit.client.1.smithi181.stdout:8/962: stat d4/d2a/d37/c40 0 2024-04-03T08:39:43.157 INFO:tasks.workunit.client.1.smithi181.stdout:8/963: link d4/d45/d96/d103/l111 d4/d2a/d37/dfb/d91/l13c 0 2024-04-03T08:39:43.160 INFO:tasks.workunit.client.1.smithi181.stdout:8/964: mknod d4/d45/d9/c13d 0 2024-04-03T08:39:43.164 INFO:tasks.workunit.client.1.smithi181.stdout:8/965: dread - d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/f101 zero size 2024-04-03T08:39:43.165 INFO:tasks.workunit.client.1.smithi181.stdout:7/961: dwrite d0/d1/d6/de/d17/d64/d85/dd8/f103 [0,4194304] 0 2024-04-03T08:39:43.178 INFO:tasks.workunit.client.1.smithi181.stdout:7/962: mkdir d0/d1/d6/de/d17/d64/d85/dd8/dea/d14c/d159/d15b 0 2024-04-03T08:39:43.181 INFO:tasks.workunit.client.1.smithi181.stdout:7/963: write d0/d1/d6/de/d17/f24 [3290882,46518] 0 2024-04-03T08:39:43.184 INFO:tasks.workunit.client.1.smithi181.stdout:8/966: write d4/d45/db/d14/d31/fc1 [770565,117556] 0 2024-04-03T08:39:43.189 INFO:tasks.workunit.client.1.smithi181.stdout:7/964: rename d0/d1/d6/de/d17/f4c to d0/d1/d6/dca/d12b/f15c 0 2024-04-03T08:39:43.194 INFO:tasks.workunit.client.1.smithi181.stdout:8/967: symlink d4/d45/db/d14/d31/d1c/d51/d87/d133/l13e 0 2024-04-03T08:39:43.201 INFO:tasks.workunit.client.1.smithi181.stdout:8/968: truncate d4/f19 2044064 0 2024-04-03T08:39:43.206 INFO:tasks.workunit.client.1.smithi181.stdout:8/969: mknod d4/d45/db/d14/d31/d1c/d51/d87/d133/c13f 0 2024-04-03T08:39:43.208 INFO:tasks.workunit.client.1.smithi181.stdout:7/965: dwrite d0/d1/d6/f26 [0,4194304] 0 2024-04-03T08:39:43.211 INFO:tasks.workunit.client.1.smithi181.stdout:8/970: creat d4/d45/dae/f140 x:0 0 0 2024-04-03T08:39:43.214 INFO:tasks.workunit.client.1.smithi181.stdout:7/966: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/l15d 0 2024-04-03T08:39:43.220 INFO:tasks.workunit.client.1.smithi181.stdout:7/967: truncate d0/d1/d6/f4d 273633 0 2024-04-03T08:39:43.222 INFO:tasks.workunit.client.1.smithi181.stdout:7/968: write d0/d1/d6/de/d17/d64/d14d/f126 [110240,45545] 0 2024-04-03T08:39:43.227 INFO:tasks.workunit.client.1.smithi181.stdout:8/971: getdents d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/def 0 2024-04-03T08:39:43.240 INFO:tasks.workunit.client.1.smithi181.stdout:8/972: mkdir d4/d45/dae/d136/d141 0 2024-04-03T08:39:43.243 INFO:tasks.workunit.client.1.smithi181.stdout:8/973: write d4/d45/db/d14/d31/d1c/d51/f52 [2845790,32743] 0 2024-04-03T08:39:43.244 INFO:tasks.workunit.client.1.smithi181.stdout:8/974: read - d4/f132 zero size 2024-04-03T08:39:43.245 INFO:tasks.workunit.client.1.smithi181.stdout:7/969: write d0/d1/d6/f11f [1386278,110182] 0 2024-04-03T08:39:43.260 INFO:tasks.workunit.client.1.smithi181.stdout:8/975: mkdir d4/d45/db/d12d/d142 0 2024-04-03T08:39:43.265 INFO:tasks.workunit.client.1.smithi181.stdout:8/976: rename d4/d44/lf5 to d4/d44/d59/d5f/d12c/l143 0 2024-04-03T08:39:43.269 INFO:tasks.workunit.client.1.smithi181.stdout:8/977: rename d4/d2a/d37/dfb/ldd to d4/d45/dae/dce/l144 0 2024-04-03T08:39:43.289 INFO:tasks.workunit.client.1.smithi181.stdout:8/978: dwrite d4/d45/d96/f13a [0,4194304] 0 2024-04-03T08:39:43.296 INFO:tasks.workunit.client.1.smithi181.stdout:8/979: rename d4/d44/d59/d5f/d6c/dd1/f137 to d4/d45/dae/d136/f145 0 2024-04-03T08:39:43.306 INFO:tasks.workunit.client.1.smithi181.stdout:8/980: dread d4/d44/d59/d5f/f75 [0,4194304] 0 2024-04-03T08:39:43.311 INFO:tasks.workunit.client.1.smithi181.stdout:8/981: mkdir d4/d45/db/d14/d31/d1c/d51/d87/db1/d146 0 2024-04-03T08:39:43.316 INFO:tasks.workunit.client.1.smithi181.stdout:8/982: unlink d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/f7a 0 2024-04-03T08:39:43.319 INFO:tasks.workunit.client.1.smithi181.stdout:8/983: unlink d4/d45/db/d14/lb4 0 2024-04-03T08:39:43.321 INFO:tasks.workunit.client.1.smithi181.stdout:8/984: rmdir d4/d44/d59 39 2024-04-03T08:39:43.349 INFO:tasks.workunit.client.1.smithi181.stdout:8/985: dwrite d4/d45/db/d14/d31/d1c/f53 [0,4194304] 0 2024-04-03T08:39:43.365 INFO:tasks.workunit.client.1.smithi181.stdout:8/986: dwrite d4/d45/db/d14/d31/d1c/d51/fde [4194304,4194304] 0 2024-04-03T08:39:43.374 INFO:tasks.workunit.client.1.smithi181.stdout:7/970: sync 2024-04-03T08:39:43.374 INFO:tasks.workunit.client.1.smithi181.stdout:8/987: write d4/f36 [4794055,72569] 0 2024-04-03T08:39:43.383 INFO:tasks.workunit.client.1.smithi181.stdout:7/971: creat d0/d1/d6/de/d17/d27/d93/f15e x:0 0 0 2024-04-03T08:39:43.383 INFO:tasks.workunit.client.1.smithi181.stdout:8/988: dread d4/d45/d9/f89 [0,4194304] 0 2024-04-03T08:39:43.386 INFO:tasks.workunit.client.1.smithi181.stdout:7/972: stat d0/d1/d6/ddf/c13b 0 2024-04-03T08:39:43.392 INFO:tasks.workunit.client.1.smithi181.stdout:7/973: rmdir d0 39 2024-04-03T08:39:43.400 INFO:tasks.workunit.client.1.smithi181.stdout:8/989: dwrite d4/d45/ffd [0,4194304] 0 2024-04-03T08:39:43.411 INFO:tasks.workunit.client.1.smithi181.stdout:7/974: dwrite d0/f3b [0,4194304] 0 2024-04-03T08:39:43.414 INFO:tasks.workunit.client.1.smithi181.stdout:8/990: link d4/d45/d9/f1b d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/d5e/f147 0 2024-04-03T08:39:43.417 INFO:tasks.workunit.client.1.smithi181.stdout:7/975: creat d0/d1/d6/de/d17/d64/d85/d9a/da4/f15f x:0 0 0 2024-04-03T08:39:43.427 INFO:tasks.workunit.client.1.smithi181.stdout:7/976: truncate d0/d1/d6/de/d17/d64/d85/d9a/da4/f89 271327 0 2024-04-03T08:39:43.430 INFO:tasks.workunit.client.1.smithi181.stdout:7/977: fdatasync d0/d1/d6/de/d17/d64/d85/d9a/fd7 0 2024-04-03T08:39:43.439 INFO:tasks.workunit.client.1.smithi181.stdout:8/991: dread d4/d45/d9/f117 [0,4194304] 0 2024-04-03T08:39:43.460 INFO:tasks.workunit.client.1.smithi181.stdout:7/978: dread d0/d1/d6/de/d17/d64/d85/f98 [0,4194304] 0 2024-04-03T08:39:43.464 INFO:tasks.workunit.client.1.smithi181.stdout:8/992: dwrite d4/d45/db/f58 [0,4194304] 0 2024-04-03T08:39:43.478 INFO:tasks.workunit.client.1.smithi181.stdout:7/979: dwrite d0/d1/d6/de/d17/d64/d85/dd8/f103 [4194304,4194304] 0 2024-04-03T08:39:43.480 INFO:tasks.workunit.client.1.smithi181.stdout:7/980: read d0/d1/f4a [3489789,31684] 0 2024-04-03T08:39:43.488 INFO:tasks.workunit.client.1.smithi181.stdout:7/981: creat d0/d1/d6/de/d17/d64/d85/dd8/dea/d14c/d159/d15b/f160 x:0 0 0 2024-04-03T08:39:43.492 INFO:tasks.workunit.client.1.smithi181.stdout:8/993: dread d4/d45/dae/f106 [0,4194304] 0 2024-04-03T08:39:43.502 INFO:tasks.workunit.client.1.smithi181.stdout:8/994: write d4/d2a/dd2/ff6 [921755,5923] 0 2024-04-03T08:39:43.506 INFO:tasks.workunit.client.1.smithi181.stdout:8/995: chown d4/d45/dae/d136/f145 14 1 2024-04-03T08:39:43.509 INFO:tasks.workunit.client.1.smithi181.stdout:7/982: dwrite d0/fd5 [0,4194304] 0 2024-04-03T08:39:43.511 INFO:tasks.workunit.client.1.smithi181.stdout:8/996: write d4/d45/db/d14/d31/d1c/d51/d87/db1/fbe [1083067,17420] 0 2024-04-03T08:39:43.519 INFO:tasks.workunit.client.1.smithi181.stdout:7/983: mknod d0/d1/d6/de/d17/d64/d85/d87/c161 0 2024-04-03T08:39:43.521 INFO:tasks.workunit.client.1.smithi181.stdout:8/997: dread d4/d44/f100 [0,4194304] 0 2024-04-03T08:39:43.522 INFO:tasks.workunit.client.1.smithi181.stdout:7/984: chown d0/d1/d6/de/d17/d64/d85/d87/d10a/f125 71896974 1 2024-04-03T08:39:43.526 INFO:tasks.workunit.client.1.smithi181.stdout:7/985: fsync d0/d1/d6/de/d17/fee 0 2024-04-03T08:39:43.530 INFO:tasks.workunit.client.1.smithi181.stdout:8/998: link d4/d45/db/d14/d31/d1c/d51/d87/l139 d4/d45/d96/l148 0 2024-04-03T08:39:43.534 INFO:tasks.workunit.client.1.smithi181.stdout:7/986: creat d0/d1/d6/de/d17/d27/f162 x:0 0 0 2024-04-03T08:39:43.543 INFO:tasks.workunit.client.1.smithi181.stdout:8/999: write d4/d45/db/d14/d31/d1c/d51/d87/dc8/ddc/fb8 [3932705,62525] 0 2024-04-03T08:39:43.543 INFO:tasks.workunit.client.1.smithi181.stdout:7/987: write d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f100 [115149,114876] 0 2024-04-03T08:39:43.545 INFO:tasks.workunit.client.1.smithi181.stdout:7/988: chown d0/d1/d6/de/c14 2 1 2024-04-03T08:39:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:43 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:43 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:43 smithi157 ceph-mon[35083]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 73 MiB/s rd, 159 MiB/s wr, 379 op/s 2024-04-03T08:39:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:43 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:43.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:43 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:43 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:43 smithi181 ceph-mon[44183]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 73 MiB/s rd, 159 MiB/s wr, 379 op/s 2024-04-03T08:39:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:43 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:43.716 INFO:tasks.workunit.client.1.smithi181.stdout:7/989: sync 2024-04-03T08:39:43.719 INFO:tasks.workunit.client.1.smithi181.stdout:7/990: rmdir d0/d1/d6/de/d17/d27/d93 39 2024-04-03T08:39:43.722 INFO:tasks.workunit.client.1.smithi181.stdout:7/991: symlink d0/d1/d6/de/d17/d64/d82/d12d/l163 0 2024-04-03T08:39:43.725 INFO:tasks.workunit.client.1.smithi181.stdout:7/992: symlink d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/d96/dbf/l164 0 2024-04-03T08:39:43.743 INFO:tasks.workunit.client.1.smithi181.stdout:7/993: write d0/d1/f78 [3334779,89285] 0 2024-04-03T08:39:43.748 INFO:tasks.workunit.client.1.smithi181.stdout:7/994: dread d0/d1/d6/de/d17/d64/d85/d87/d10a/d110/f6e [0,4194304] 0 2024-04-03T08:39:43.754 INFO:tasks.workunit.client.1.smithi181.stdout:7/995: creat d0/d1/f165 x:0 0 0 2024-04-03T08:39:43.760 INFO:tasks.workunit.client.1.smithi181.stdout:7/996: write d0/d1/f4a [1498330,3741] 0 2024-04-03T08:39:43.762 INFO:tasks.workunit.client.1.smithi181.stdout:7/997: write d0/d1/f78 [4999011,64823] 0 2024-04-03T08:39:43.765 INFO:tasks.workunit.client.1.smithi181.stdout:7/998: dread - d0/d1/d6/de/d17/d27/d93/f15e zero size 2024-04-03T08:39:43.767 INFO:tasks.workunit.client.1.smithi181.stdout:7/999: write d0/f3b [2617412,95520] 0 2024-04-03T08:39:43.775 INFO:tasks.workunit.client.1.smithi181.stderr:+ rm -rf -- ./tmp.xoIbm6sGkM 2024-04-03T08:39:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: Adjusting osd_memory_target on smithi157 to 1618M 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:39:45.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:44 smithi157 ceph-mon[35083]: pgmap v19: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 101 MiB/s rd, 216 MiB/s wr, 540 op/s 2024-04-03T08:39:45.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: Adjusting osd_memory_target on smithi157 to 1618M 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:39:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:39:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:39:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:39:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:39:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:44 smithi181 ceph-mon[44183]: pgmap v19: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 101 MiB/s rd, 216 MiB/s wr, 540 op/s 2024-04-03T08:39:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:45 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:39:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:45 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:39:46.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:45 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:39:46.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:45 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:39:46.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:45 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:39:46.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:45 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:39:47.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: Reconfiguring node-exporter.smithi157 (dependencies changed)... 2024-04-03T08:39:47.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: Reconfiguring daemon node-exporter.smithi157 on smithi157 2024-04-03T08:39:47.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:47 smithi181 ceph-mon[44183]: pgmap v20: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 61 MiB/s rd, 133 MiB/s wr, 341 op/s 2024-04-03T08:39:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:39:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: Reconfiguring node-exporter.smithi157 (dependencies changed)... 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: Reconfiguring daemon node-exporter.smithi157 on smithi157 2024-04-03T08:39:47.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:47 smithi157 ceph-mon[35083]: pgmap v20: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 61 MiB/s rd, 133 MiB/s wr, 341 op/s 2024-04-03T08:39:49.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:48 smithi157 ceph-mon[35083]: pgmap v21: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 61 MiB/s rd, 133 MiB/s wr, 341 op/s 2024-04-03T08:39:49.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:48 smithi181 ceph-mon[44183]: pgmap v21: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 61 MiB/s rd, 133 MiB/s wr, 341 op/s 2024-04-03T08:39:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:50 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:50 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:50 smithi157 ceph-mon[35083]: Reconfiguring alertmanager.smithi157 (dependencies changed)... 2024-04-03T08:39:51.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:50 smithi157 ceph-mon[35083]: Reconfiguring daemon alertmanager.smithi157 on smithi157 2024-04-03T08:39:51.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:50 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:51.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:50 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:51.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:50 smithi181 ceph-mon[44183]: Reconfiguring alertmanager.smithi157 (dependencies changed)... 2024-04-03T08:39:51.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:50 smithi181 ceph-mon[44183]: Reconfiguring daemon alertmanager.smithi157 on smithi157 2024-04-03T08:39:51.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:51 smithi157 ceph-mon[35083]: pgmap v22: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 62 MiB/s rd, 133 MiB/s wr, 416 op/s 2024-04-03T08:39:52.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:51 smithi181 ceph-mon[44183]: pgmap v22: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 62 MiB/s rd, 133 MiB/s wr, 416 op/s 2024-04-03T08:39:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 -- 172.21.15.157:0/4228596467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 msgr2=0x7f4cb40fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 --2- 172.21.15.157:0/4228596467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb40fd310 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8004940 tx=0x7f4ca8009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 -- 172.21.15.157:0/4228596467 shutdown_connections 2024-04-03T08:39:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 --2- 172.21.15.157:0/4228596467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cb40fe0d0 0x7f4cb40fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 --2- 172.21.15.157:0/4228596467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb40fd310 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 -- 172.21.15.157:0/4228596467 >> 172.21.15.157:0/4228596467 conn(0x7f4cb40f8560 msgr2=0x7f4cb40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 -- 172.21.15.157:0/4228596467 shutdown_connections 2024-04-03T08:39:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.950+0000 7f4cbc400700 1 -- 172.21.15.157:0/4228596467 wait complete. 2024-04-03T08:39:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.951+0000 7f4cbc400700 1 Processor -- start 2024-04-03T08:39:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.951+0000 7f4cbc400700 1 -- start start 2024-04-03T08:39:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cbc400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb410fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cbc400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cb40fe0d0 0x7f4cb41101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cbc400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb4110830 con 0x7f4cb40fcee0 2024-04-03T08:39:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cbc400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb4111020 con 0x7f4cb40fe0d0 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cb9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb410fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cb9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb410fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53322/0 (socket says 172.21.15.157:53322) 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cb9a00700 1 -- 172.21.15.157:0/3941645282 learned_addr learned my addr 172.21.15.157:0/3941645282 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.952+0000 7f4cb9000700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cb40fe0d0 0x7f4cb41101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.953+0000 7f4cb9a00700 1 -- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cb40fe0d0 msgr2=0x7f4cb41101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.953+0000 7f4cb9a00700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cb40fe0d0 0x7f4cb41101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.953+0000 7f4cb9a00700 1 -- 172.21.15.157:0/3941645282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8005040 con 0x7f4cb40fcee0 2024-04-03T08:39:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.954+0000 7f4cb9a00700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb410fc60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800b970 tx=0x7f4ca8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.954+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ca800e040 con 0x7f4cb40fcee0 2024-04-03T08:39:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.954+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ca8004290 con 0x7f4cb40fcee0 2024-04-03T08:39:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.954+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ca801c3f0 con 0x7f4cb40fcee0 2024-04-03T08:39:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.954+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb41112a0 con 0x7f4cb40fcee0 2024-04-03T08:39:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.954+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb4111860 con 0x7f4cb40fcee0 2024-04-03T08:39:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.955+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb4101a60 con 0x7f4cb40fcee0 2024-04-03T08:39:52.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.959+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f4ca800bbf0 con 0x7f4cb40fcee0 2024-04-03T08:39:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.960+0000 7f4cb1600700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4c9c06b3b0 0x7f4c9c06d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.960+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4ca808bbc0 con 0x7f4cb40fcee0 2024-04-03T08:39:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.961+0000 7f4cb9000700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4c9c06b3b0 0x7f4c9c06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.962+0000 7f4cb9000700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4c9c06b3b0 0x7f4c9c06d860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009bf0 tx=0x7f4ca40091a0 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:52.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:52.964+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4ca8059700 con 0x7f4cb40fcee0 2024-04-03T08:39:53.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:52 smithi157 ceph-mon[35083]: pgmap v23: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 28 MiB/s rd, 57 MiB/s wr, 235 op/s 2024-04-03T08:39:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.285+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cb4111ad0 con 0x7f4c9c06b3b0 2024-04-03T08:39:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.286+0000 7f4cb1600700 1 -- 172.21.15.157:0/3941645282 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4cb4111ad0 con 0x7f4c9c06b3b0 2024-04-03T08:39:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4c9c06b3b0 msgr2=0x7f4c9c06d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4c9c06b3b0 0x7f4c9c06d860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009bf0 tx=0x7f4ca40091a0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 msgr2=0x7f4cb410fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb410fc60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800b970 tx=0x7f4ca8009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 shutdown_connections 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f4c9c06b3b0 0x7f4c9c06d860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb40fcee0 0x7f4cb410fc60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 --2- 172.21.15.157:0/3941645282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cb40fe0d0 0x7f4cb41101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 >> 172.21.15.157:0/3941645282 conn(0x7f4cb40f8560 msgr2=0x7f4cb40f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:53.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.290+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 shutdown_connections 2024-04-03T08:39:53.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.291+0000 7f4cbc400700 1 -- 172.21.15.157:0/3941645282 wait complete. 2024-04-03T08:39:53.308 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:39:53.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:52 smithi181 ceph-mon[44183]: pgmap v23: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 28 MiB/s rd, 57 MiB/s wr, 235 op/s 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 -- 172.21.15.157:0/784684395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 msgr2=0x7f15940ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 --2- 172.21.15.157:0/784684395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940ff9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1584004940 tx=0x7f1584009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 -- 172.21.15.157:0/784684395 shutdown_connections 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 --2- 172.21.15.157:0/784684395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 0x7f1594102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 --2- 172.21.15.157:0/784684395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940ff9c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 -- 172.21.15.157:0/784684395 >> 172.21.15.157:0/784684395 conn(0x7f15940f7430 msgr2=0x7f15940f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 -- 172.21.15.157:0/784684395 shutdown_connections 2024-04-03T08:39:53.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.473+0000 7f159aa00700 1 -- 172.21.15.157:0/784684395 wait complete. 2024-04-03T08:39:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.474+0000 7f159aa00700 1 Processor -- start 2024-04-03T08:39:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.474+0000 7f159aa00700 1 -- start start 2024-04-03T08:39:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f159aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f159aa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 0x7f15940fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f159aa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940fbe00 con 0x7f15940662e0 2024-04-03T08:39:53.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f159aa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940fbf40 con 0x7f15940fff00 2024-04-03T08:39:53.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:53.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940fd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53338/0 (socket says 172.21.15.157:53338) 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593e00700 1 -- 172.21.15.157:0/1504856016 learned_addr learned my addr 172.21.15.157:0/1504856016 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593400700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 0x7f15940fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593e00700 1 -- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 msgr2=0x7f15940fb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593e00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 0x7f15940fb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593e00700 1 -- 172.21.15.157:0/1504856016 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584005040 con 0x7f15940662e0 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.475+0000 7f1593400700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 0x7f15940fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.476+0000 7f1593e00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940fd350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1584000c00 tx=0x7f1584009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.476+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158400e070 con 0x7f15940662e0 2024-04-03T08:39:53.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.476+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15940fc1c0 con 0x7f15940662e0 2024-04-03T08:39:53.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.476+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f158401c400 con 0x7f15940662e0 2024-04-03T08:39:53.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.476+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158400b5f0 con 0x7f15940662e0 2024-04-03T08:39:53.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.476+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940fc720 con 0x7f15940662e0 2024-04-03T08:39:53.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.477+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159405f5f0 con 0x7f15940662e0 2024-04-03T08:39:53.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.478+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f158401ca50 con 0x7f15940662e0 2024-04-03T08:39:53.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.479+0000 7f158be00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f157806b380 0x7f157806d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:53.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.479+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f158408b4f0 con 0x7f15940662e0 2024-04-03T08:39:53.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.482+0000 7f1593400700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f157806b380 0x7f157806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:53.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.483+0000 7f1593400700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f157806b380 0x7f157806d830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f157c004600 tx=0x7f157c00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:53.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.484+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1584055480 con 0x7f15940662e0 2024-04-03T08:39:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.847+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15940f8f70 con 0x7f157806b380 2024-04-03T08:39:53.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.848+0000 7f158be00700 1 -- 172.21.15.157:0/1504856016 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f15940f8f70 con 0x7f157806b380 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f157806b380 msgr2=0x7f157806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f157806b380 0x7f157806d830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f157c004600 tx=0x7f157c00b040 comp rx=0 tx=0).stop 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 msgr2=0x7f15940fd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940fd350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1584000c00 tx=0x7f1584009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 shutdown_connections 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f157806b380 0x7f157806d830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15940662e0 0x7f15940fd350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 --2- 172.21.15.157:0/1504856016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15940fff00 0x7f15940fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 >> 172.21.15.157:0/1504856016 conn(0x7f15940f7430 msgr2=0x7f15940f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 shutdown_connections 2024-04-03T08:39:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:53.851+0000 7f159aa00700 1 -- 172.21.15.157:0/1504856016 wait complete. 2024-04-03T08:39:54.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.034+0000 7f6661200700 1 -- 172.21.15.157:0/2669558753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 msgr2=0x7f665c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.034+0000 7f6661200700 1 --2- 172.21.15.157:0/2669558753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c070e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6648004940 tx=0x7f6648009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.034+0000 7f6661200700 1 -- 172.21.15.157:0/2669558753 shutdown_connections 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.035+0000 7f6661200700 1 --2- 172.21.15.157:0/2669558753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c070e10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.035+0000 7f6661200700 1 --2- 172.21.15.157:0/2669558753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 0x7f665c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.035+0000 7f6661200700 1 -- 172.21.15.157:0/2669558753 >> 172.21.15.157:0/2669558753 conn(0x7f665c0f84e0 msgr2=0x7f665c0fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.035+0000 7f6661200700 1 -- 172.21.15.157:0/2669558753 shutdown_connections 2024-04-03T08:39:54.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.035+0000 7f6661200700 1 -- 172.21.15.157:0/2669558753 wait complete. 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.036+0000 7f6661200700 1 Processor -- start 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.036+0000 7f6661200700 1 -- start start 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.036+0000 7f6661200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.036+0000 7f6661200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 0x7f665c114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.036+0000 7f6661200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c114bc0 con 0x7f665c071f50 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.036+0000 7f6661200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c115360 con 0x7f665c0709a0 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 0x7f665c114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:54.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 0x7f665c114530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53356/0 (socket says 172.21.15.157:53356) 2024-04-03T08:39:54.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:37748/0 (socket says 172.21.15.157:37748) 2024-04-03T08:39:54.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659400700 1 -- 172.21.15.157:0/1410284373 learned_addr learned my addr 172.21.15.157:0/1410284373 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:54.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659e00700 1 -- 172.21.15.157:0/1410284373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 msgr2=0x7f665c114530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:54.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659e00700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 0x7f665c114530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.037+0000 7f6659e00700 1 -- 172.21.15.157:0/1410284373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648005040 con 0x7f665c0709a0 2024-04-03T08:39:54.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.038+0000 7f6659e00700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c113ff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f664c00b550 tx=0x7f664c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:54.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.038+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c00f6f0 con 0x7f665c0709a0 2024-04-03T08:39:54.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.038+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f664c00fd20 con 0x7f665c0709a0 2024-04-03T08:39:54.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.038+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c0103a0 con 0x7f665c0709a0 2024-04-03T08:39:54.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.038+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c115640 con 0x7f665c0709a0 2024-04-03T08:39:54.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.040+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c115c00 con 0x7f665c0709a0 2024-04-03T08:39:54.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.041+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c05f5f0 con 0x7f665c0709a0 2024-04-03T08:39:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.043+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f664c011400 con 0x7f665c0709a0 2024-04-03T08:39:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.044+0000 7f6652000700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f664006b2e0 0x7f664006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:54.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.044+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f664c089740 con 0x7f665c0709a0 2024-04-03T08:39:54.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.044+0000 7f6659400700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f664006b2e0 0x7f664006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:54.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.045+0000 7f6659400700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f664006b2e0 0x7f664006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f664800b3b0 tx=0x7f6648009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.048+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f664c057480 con 0x7f665c0709a0 2024-04-03T08:39:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:53 smithi157 ceph-mon[35083]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:53 smithi157 ceph-mon[35083]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:54.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:53 smithi181 ceph-mon[44183]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:54.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:53 smithi181 ceph-mon[44183]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:54.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.376+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f665c115fc0 con 0x7f664006b2e0 2024-04-03T08:39:54.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.388+0000 7f6652000700 1 -- 172.21.15.157:0/1410284373 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f665c115fc0 con 0x7f664006b2e0 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (8m) 12s ago 10m 13.3M - 0.25.0 c8568f914cd2 25dcb4a9cbb2 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (10m) 12s ago 10m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (9m) 24s ago 9m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (8m) 12s ago 9m 74.8M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (3m) 12s ago 3m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (3m) 12s ago 3m 195M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (3m) 24s ago 3m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (3m) 24s ago 3m 118M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (11m) 12s ago 11m 330M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (69s) 24s ago 8m 487M - 19.0.0-1670-g1fb5d106 c318aa90b546 b4f1b4d00cca 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (11m) 12s ago 11m 49.6M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:39:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (8m) 24s ago 8m 40.0M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 starting - - - - 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (9m) 24s ago 9m 7646k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (8m) 12s ago 8m 208M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (7m) 12s ago 7m 210M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (7m) 12s ago 7m 178M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (6m) 24s ago 6m 254M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (6m) 24s ago 6m 215M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (5m) 24s ago 5m 242M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:39:54.391 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (8m) 12s ago 9m 50.7M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f664006b2e0 msgr2=0x7f664006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f664006b2e0 0x7f664006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f664800b3b0 tx=0x7f6648009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 msgr2=0x7f665c113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c113ff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f664c00b550 tx=0x7f664c0091a0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 shutdown_connections 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f664006b2e0 0x7f664006d790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f665c0709a0 0x7f665c113ff0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 --2- 172.21.15.157:0/1410284373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c071f50 0x7f665c114530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.391+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 >> 172.21.15.157:0/1410284373 conn(0x7f665c0f84e0 msgr2=0x7f665c0f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:54.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.392+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 shutdown_connections 2024-04-03T08:39:54.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.392+0000 7f6661200700 1 -- 172.21.15.157:0/1410284373 wait complete. 2024-04-03T08:39:54.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.588+0000 7f14a3200700 1 -- 172.21.15.157:0/323266061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 msgr2=0x7f149c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:54.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.588+0000 7f14a3200700 1 --2- 172.21.15.157:0/323266061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 0x7f149c06e2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f148c004a50 tx=0x7f148c00af40 comp rx=0 tx=0).stop 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.589+0000 7f14a3200700 1 -- 172.21.15.157:0/323266061 shutdown_connections 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.589+0000 7f14a3200700 1 --2- 172.21.15.157:0/323266061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.589+0000 7f14a3200700 1 --2- 172.21.15.157:0/323266061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 0x7f149c06e2b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.589+0000 7f14a3200700 1 -- 172.21.15.157:0/323266061 >> 172.21.15.157:0/323266061 conn(0x7f149c069de0 msgr2=0x7f149c06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.589+0000 7f14a3200700 1 -- 172.21.15.157:0/323266061 shutdown_connections 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.589+0000 7f14a3200700 1 -- 172.21.15.157:0/323266061 wait complete. 2024-04-03T08:39:54.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.590+0000 7f14a3200700 1 Processor -- start 2024-04-03T08:39:54.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.590+0000 7f14a3200700 1 -- start start 2024-04-03T08:39:54.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.591+0000 7f14a3200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0808b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:54.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.591+0000 7f14a3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 0x7f149c07ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:54.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.591+0000 7f14a3200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c080eb0 con 0x7f149c06ec40 2024-04-03T08:39:54.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.591+0000 7f14a3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c081020 con 0x7f149c06fda0 2024-04-03T08:39:54.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.592+0000 7f149be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:54.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.592+0000 7f149be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53384/0 (socket says 172.21.15.157:53384) 2024-04-03T08:39:54.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.592+0000 7f149be00700 1 -- 172.21.15.157:0/2955316243 learned_addr learned my addr 172.21.15.157:0/2955316243 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:54.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.592+0000 7f149b400700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 0x7f149c07ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:54.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.593+0000 7f149be00700 1 -- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 msgr2=0x7f149c07ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:54.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.593+0000 7f149be00700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 0x7f149c07ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:54.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.593+0000 7f149be00700 1 -- 172.21.15.157:0/2955316243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c005040 con 0x7f149c06ec40 2024-04-03T08:39:54.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.594+0000 7f149be00700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0808b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f148c000c00 tx=0x7f148c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:54.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.594+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f148c00f040 con 0x7f149c06ec40 2024-04-03T08:39:54.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.594+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f148c00a880 con 0x7f149c06ec40 2024-04-03T08:39:54.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.594+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f148c01e650 con 0x7f149c06ec40 2024-04-03T08:39:54.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.594+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c07f560 con 0x7f149c06ec40 2024-04-03T08:39:54.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.594+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c07fb20 con 0x7f149c06ec40 2024-04-03T08:39:54.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.596+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c04c710 con 0x7f149c06ec40 2024-04-03T08:39:54.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.599+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f148c014420 con 0x7f149c06ec40 2024-04-03T08:39:54.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.600+0000 7f1493e00700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f148006f700 0x7f1480071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:54.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.600+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f148c08bc20 con 0x7f149c06ec40 2024-04-03T08:39:54.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.601+0000 7f149b400700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f148006f700 0x7f1480071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.602+0000 7f149b400700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f148006f700 0x7f1480071bb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1488004600 tx=0x7f148800b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:54.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:54.606+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f148c0597a0 con 0x7f149c06ec40 2024-04-03T08:39:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.015+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f149c12aff0 con 0x7f149c06ec40 2024-04-03T08:39:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.016+0000 7f1493e00700 1 -- 172.21.15.157:0/2955316243 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f148c059330 con 0x7f149c06ec40 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:39:55.017 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:39:55.018 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:39:55.018 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:39:55.018 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 13, 2024-04-03T08:39:55.018 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:39:55.018 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:39:55.018 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f148006f700 msgr2=0x7f1480071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f148006f700 0x7f1480071bb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1488004600 tx=0x7f148800b040 comp rx=0 tx=0).stop 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 msgr2=0x7f149c0808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0808b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f148c000c00 tx=0x7f148c00af40 comp rx=0 tx=0).stop 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 shutdown_connections 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f148006f700 0x7f1480071bb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f149c06ec40 0x7f149c0808b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 --2- 172.21.15.157:0/2955316243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f149c06fda0 0x7f149c07ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 >> 172.21.15.157:0/2955316243 conn(0x7f149c069de0 msgr2=0x7f149c072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 shutdown_connections 2024-04-03T08:39:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.019+0000 7f14a3200700 1 -- 172.21.15.157:0/2955316243 wait complete. 2024-04-03T08:39:55.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:54 smithi157 ceph-mon[35083]: from='client.24555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:55.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:54 smithi157 ceph-mon[35083]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 29 MiB/s rd, 58 MiB/s wr, 312 op/s 2024-04-03T08:39:55.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 -- 172.21.15.157:0/3329012335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fcee0 msgr2=0x7f81ac0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 --2- 172.21.15.157:0/3329012335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fcee0 0x7f81ac0fd310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f81a0004940 tx=0x7f81a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:55.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 -- 172.21.15.157:0/3329012335 shutdown_connections 2024-04-03T08:39:55.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 --2- 172.21.15.157:0/3329012335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fe0d0 0x7f81ac0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 --2- 172.21.15.157:0/3329012335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fcee0 0x7f81ac0fd310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 -- 172.21.15.157:0/3329012335 >> 172.21.15.157:0/3329012335 conn(0x7f81ac0f8560 msgr2=0x7f81ac0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:55.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 -- 172.21.15.157:0/3329012335 shutdown_connections 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.192+0000 7f81b4600700 1 -- 172.21.15.157:0/3329012335 wait complete. 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.193+0000 7f81b4600700 1 Processor -- start 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.193+0000 7f81b4600700 1 -- start start 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b4600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 0x7f81ac10b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b4600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fe0d0 0x7f81ac10bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b4600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac10c300 con 0x7f81ac0fe0d0 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b4600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac10cb50 con 0x7f81ac0fcee0 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b1c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 0x7f81ac10b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:55.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b1c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 0x7f81ac10b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:37782/0 (socket says 172.21.15.157:37782) 2024-04-03T08:39:55.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.194+0000 7f81b1c00700 1 -- 172.21.15.157:0/1432922102 learned_addr learned my addr 172.21.15.157:0/1432922102 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:55.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.195+0000 7f81b1c00700 1 -- 172.21.15.157:0/1432922102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fe0d0 msgr2=0x7f81ac10bcb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.195+0000 7f81b1200700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fe0d0 0x7f81ac10bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.195+0000 7f81b1c00700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fe0d0 0x7f81ac10bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.195+0000 7f81b1c00700 1 -- 172.21.15.157:0/1432922102 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0005040 con 0x7f81ac0fcee0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.195+0000 7f81b1200700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fe0d0 0x7f81ac10bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.196+0000 7f81b1c00700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 0x7f81ac10b770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81a0000c00 tx=0x7f81a0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.196+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a000e030 con 0x7f81ac0fcee0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.196+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81a001c400 con 0x7f81ac0fcee0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.196+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a001cea0 con 0x7f81ac0fcee0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.196+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac10cdd0 con 0x7f81ac0fcee0 2024-04-03T08:39:55.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.196+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac10d310 con 0x7f81ac0fcee0 2024-04-03T08:39:55.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.198+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac103b10 con 0x7f81ac0fcee0 2024-04-03T08:39:55.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.199+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f81a001c940 con 0x7f81ac0fcee0 2024-04-03T08:39:55.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.199+0000 7f81a9600700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f819406b2e0 0x7f819406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:55.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.200+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f81a008b310 con 0x7f81ac0fcee0 2024-04-03T08:39:55.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.200+0000 7f81b1200700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f819406b2e0 0x7f819406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:55.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.201+0000 7f81b1200700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f819406b2e0 0x7f819406d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8198004600 tx=0x7f819800b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:55.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.205+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f81a0055320 con 0x7f81ac0fcee0 2024-04-03T08:39:55.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:54 smithi181 ceph-mon[44183]: from='client.24555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:55.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:54 smithi181 ceph-mon[44183]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 29 MiB/s rd, 58 MiB/s wr, 312 op/s 2024-04-03T08:39:55.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.545+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81ac04bed0 con 0x7f81ac0fcee0 2024-04-03T08:39:55.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.546+0000 7f81a9600700 1 -- 172.21.15.157:0/1432922102 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f81a00589e0 con 0x7f81ac0fcee0 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:39:55.547 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:39:55.548 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:39:55.549 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:55.550 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:39:55.551 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:39:55.551 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:55.551 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f819406b2e0 msgr2=0x7f819406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f819406b2e0 0x7f819406d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8198004600 tx=0x7f819800b040 comp rx=0 tx=0).stop 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 msgr2=0x7f81ac10b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 0x7f81ac10b770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81a0000c00 tx=0x7f81a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 shutdown_connections 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f819406b2e0 0x7f819406d790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81ac0fcee0 0x7f81ac10b770 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81a0000c00 tx=0x7f81a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 --2- 172.21.15.157:0/1432922102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81ac0fe0d0 0x7f81ac10bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 >> 172.21.15.157:0/1432922102 conn(0x7f81ac0f8560 msgr2=0x7f81ac0f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:55.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.549+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 shutdown_connections 2024-04-03T08:39:55.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.550+0000 7f81b4600700 1 -- 172.21.15.157:0/1432922102 wait complete. 2024-04-03T08:39:55.553 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:39:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 -- 172.21.15.157:0/3177176908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 msgr2=0x7fc5140fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 --2- 172.21.15.157:0/3177176908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc5140fe540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc500004970 tx=0x7fc500009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 -- 172.21.15.157:0/3177176908 shutdown_connections 2024-04-03T08:39:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 --2- 172.21.15.157:0/3177176908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc5140fe540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 --2- 172.21.15.157:0/3177176908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5140fcee0 0x7fc5140fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 -- 172.21.15.157:0/3177176908 >> 172.21.15.157:0/3177176908 conn(0x7fc5140f8560 msgr2=0x7fc5140fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:55.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.762+0000 7fc51a800700 1 -- 172.21.15.157:0/3177176908 shutdown_connections 2024-04-03T08:39:55.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.763+0000 7fc51a800700 1 -- 172.21.15.157:0/3177176908 wait complete. 2024-04-03T08:39:55.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.763+0000 7fc51a800700 1 Processor -- start 2024-04-03T08:39:55.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.764+0000 7fc51a800700 1 -- start start 2024-04-03T08:39:55.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.764+0000 7fc51a800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5140fcee0 0x7fc51410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:55.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.764+0000 7fc51a800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc514110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:55.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.764+0000 7fc51a800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc514110700 con 0x7fc5140fcee0 2024-04-03T08:39:55.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.764+0000 7fc51a800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc514110f50 con 0x7fc5140fe0d0 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc514110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc514110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:37800/0 (socket says 172.21.15.157:37800) 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 -- 172.21.15.157:0/1564976126 learned_addr learned my addr 172.21.15.157:0/1564976126 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 -- 172.21.15.157:0/1564976126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5140fcee0 msgr2=0x7fc51410fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5140fcee0 0x7fc51410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 -- 172.21.15.157:0/1564976126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500005040 con 0x7fc5140fe0d0 2024-04-03T08:39:55.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.765+0000 7fc512a00700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc514110100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc500005010 tx=0x7fc500009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:55.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.766+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc50000e040 con 0x7fc5140fe0d0 2024-04-03T08:39:55.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.766+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc500013420 con 0x7fc5140fe0d0 2024-04-03T08:39:55.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.766+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc50001c630 con 0x7fc5140fe0d0 2024-04-03T08:39:55.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.766+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5141111d0 con 0x7fc5140fe0d0 2024-04-03T08:39:55.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.767+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5141116e0 con 0x7fc5140fe0d0 2024-04-03T08:39:55.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.768+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514101a60 con 0x7fc5140fe0d0 2024-04-03T08:39:55.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.769+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fc500013a20 con 0x7fc5140fe0d0 2024-04-03T08:39:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.770+0000 7fc50b400700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc4f806b2e0 0x7fc4f806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.770+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc50008aa70 con 0x7fc5140fe0d0 2024-04-03T08:39:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.771+0000 7fc513400700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc4f806b2e0 0x7fc4f806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.772+0000 7fc513400700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc4f806b2e0 0x7fc4f806d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc5140fcc20 tx=0x7fc50400b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:55.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:55.775+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc5000585b0 con 0x7fc5140fe0d0 2024-04-03T08:39:56.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.099+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc514111a10 con 0x7fc4f806b2e0 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.101+0000 7fc50b400700 1 -- 172.21.15.157:0/1564976126 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc514111a10 con 0x7fc4f806b2e0 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "1/21 daemons upgraded", 2024-04-03T08:39:56.102 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:39:56.103 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:39:56.103 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:39:56.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc4f806b2e0 msgr2=0x7fc4f806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc4f806b2e0 0x7fc4f806d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc5140fcc20 tx=0x7fc50400b040 comp rx=0 tx=0).stop 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 msgr2=0x7fc514110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc514110100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc500005010 tx=0x7fc500009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 shutdown_connections 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc4f806b2e0 0x7fc4f806d790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5140fcee0 0x7fc51410fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 --2- 172.21.15.157:0/1564976126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5140fe0d0 0x7fc514110100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.105+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 >> 172.21.15.157:0/1564976126 conn(0x7fc5140f8560 msgr2=0x7fc5140f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:56.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.106+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 shutdown_connections 2024-04-03T08:39:56.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.106+0000 7fc51a800700 1 -- 172.21.15.157:0/1564976126 wait complete. 2024-04-03T08:39:56.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 -- 172.21.15.157:0/1195851847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 msgr2=0x7fcaf8070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:56.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 --2- 172.21.15.157:0/1195851847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 0x7fcaf8070ce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcae4004880 tx=0x7fcae4009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:56.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 -- 172.21.15.157:0/1195851847 shutdown_connections 2024-04-03T08:39:56.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 --2- 172.21.15.157:0/1195851847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 0x7fcaf8070ce0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 --2- 172.21.15.157:0/1195851847 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 -- 172.21.15.157:0/1195851847 >> 172.21.15.157:0/1195851847 conn(0x7fcaf80f85a0 msgr2=0x7fcaf80fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:56.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 -- 172.21.15.157:0/1195851847 shutdown_connections 2024-04-03T08:39:56.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.294+0000 7fcaffc00700 1 -- 172.21.15.157:0/1195851847 wait complete. 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.295+0000 7fcaffc00700 1 Processor -- start 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.295+0000 7fcaffc00700 1 -- start start 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaffc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 0x7fcaf810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaffc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaffc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8110770 con 0x7fcaf8070870 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaffc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8110fc0 con 0x7fcaf8071e20 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaf7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcafd200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 0x7fcaf810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaf7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:37814/0 (socket says 172.21.15.157:37814) 2024-04-03T08:39:56.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.296+0000 7fcaf7e00700 1 -- 172.21.15.157:0/42929176 learned_addr learned my addr 172.21.15.157:0/42929176 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:39:56.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf7e00700 1 -- 172.21.15.157:0/42929176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 msgr2=0x7fcaf810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:56.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf7e00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 0x7fcaf810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf7e00700 1 -- 172.21.15.157:0/42929176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4005040 con 0x7fcaf8071e20 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf7e00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8110170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcae4000c00 tx=0x7fcae4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae400e030 con 0x7fcaf8071e20 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcae4013e90 con 0x7fcaf8071e20 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae40123c0 con 0x7fcaf8071e20 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.297+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf8111240 con 0x7fcaf8071e20 2024-04-03T08:39:56.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.298+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf8111780 con 0x7fcaf8071e20 2024-04-03T08:39:56.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.300+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf805f5f0 con 0x7fcaf8071e20 2024-04-03T08:39:56.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.301+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fcae401c400 con 0x7fcaf8071e20 2024-04-03T08:39:56.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.302+0000 7fcaf4c00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fcae006b2e0 0x7fcae006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:39:56.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.302+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcae408b230 con 0x7fcaf8071e20 2024-04-03T08:39:56.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.303+0000 7fcafd200700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fcae006b2e0 0x7fcae006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:39:56.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.303+0000 7fcafd200700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fcae006b2e0 0x7fcae006d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009b80 tx=0x7fcaec00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:39:56.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.307+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcae4058ed0 con 0x7fcaf8071e20 2024-04-03T08:39:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:55 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2955316243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:39:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:55 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1432922102' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:39:56.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:55 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2955316243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:39:56.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:55 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1432922102' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:39:56.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.751+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcaf805f5f0 con 0x7fcaf8071e20 2024-04-03T08:39:56.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.752+0000 7fcaf4c00700 1 -- 172.21.15.157:0/42929176 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcae405f070 con 0x7fcaf8071e20 2024-04-03T08:39:56.753 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fcae006b2e0 msgr2=0x7fcae006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fcae006b2e0 0x7fcae006d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009b80 tx=0x7fcaec00b040 comp rx=0 tx=0).stop 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 msgr2=0x7fcaf8110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8110170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcae4000c00 tx=0x7fcae4009e30 comp rx=0 tx=0).stop 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 shutdown_connections 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fcae006b2e0 0x7fcae006d790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaf8070870 0x7fcaf810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 --2- 172.21.15.157:0/42929176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaf8071e20 0x7fcaf8110170 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 >> 172.21.15.157:0/42929176 conn(0x7fcaf80f85a0 msgr2=0x7fcaf80f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 shutdown_connections 2024-04-03T08:39:56.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:39:56.755+0000 7fcaffc00700 1 -- 172.21.15.157:0/42929176 wait complete. 2024-04-03T08:39:57.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:56 smithi181 ceph-mon[44183]: from='client.24567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:57.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:56 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/42929176' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:39:57.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:56 smithi181 ceph-mon[44183]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 151 op/s 2024-04-03T08:39:57.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:56 smithi157 ceph-mon[35083]: from='client.24567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:39:57.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:56 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/42929176' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:39:57.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:56 smithi157 ceph-mon[35083]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 151 op/s 2024-04-03T08:39:58.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:58 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:58.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:58 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:58.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:58 smithi157 ceph-mon[35083]: Reconfiguring grafana.smithi157 (dependencies changed)... 2024-04-03T08:39:58.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:58 smithi157 ceph-mon[35083]: Reconfiguring daemon grafana.smithi157 on smithi157 2024-04-03T08:39:58.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:58 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:58.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:58 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:58 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:39:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:58 smithi181 ceph-mon[44183]: Reconfiguring grafana.smithi157 (dependencies changed)... 2024-04-03T08:39:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:58 smithi181 ceph-mon[44183]: Reconfiguring daemon grafana.smithi157 on smithi157 2024-04-03T08:39:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:58 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:39:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:39:59 smithi157 ceph-mon[35083]: pgmap v26: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 151 op/s 2024-04-03T08:39:59.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:39:59 smithi181 ceph-mon[44183]: pgmap v26: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 151 op/s 2024-04-03T08:40:00.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:00 smithi157 ceph-mon[35083]: overall HEALTH_OK 2024-04-03T08:40:00.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:00 smithi181 ceph-mon[44183]: overall HEALTH_OK 2024-04-03T08:40:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:01 smithi157 ceph-mon[35083]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-04-03T08:40:01.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:01 smithi181 ceph-mon[44183]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-04-03T08:40:03.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:02 smithi157 ceph-mon[35083]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 928 KiB/s rd, 1016 KiB/s wr, 140 op/s 2024-04-03T08:40:03.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:02 smithi181 ceph-mon[44183]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 928 KiB/s rd, 1016 KiB/s wr, 140 op/s 2024-04-03T08:40:03.348 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T08:40:03.348 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T08:40:04.591 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T08:40:04.591 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-03T08:40:05.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:04 smithi181 ceph-mon[44183]: pgmap v29: 65 pgs: 65 active+clean; 755 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 207 op/s 2024-04-03T08:40:05.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:04 smithi157 ceph-mon[35083]: pgmap v29: 65 pgs: 65 active+clean; 755 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 207 op/s 2024-04-03T08:40:07.177 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:06 smithi181 ceph-mon[44183]: pgmap v30: 65 pgs: 65 active+clean; 755 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 995 KiB/s rd, 969 KiB/s wr, 130 op/s 2024-04-03T08:40:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:06 smithi157 ceph-mon[35083]: pgmap v30: 65 pgs: 65 active+clean; 755 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 995 KiB/s rd, 969 KiB/s wr, 130 op/s 2024-04-03T08:40:09.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:08 smithi157 ceph-mon[35083]: pgmap v31: 65 pgs: 65 active+clean; 755 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 995 KiB/s rd, 969 KiB/s wr, 130 op/s 2024-04-03T08:40:09.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:08 smithi181 ceph-mon[44183]: pgmap v31: 65 pgs: 65 active+clean; 755 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 995 KiB/s rd, 969 KiB/s wr, 130 op/s 2024-04-03T08:40:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:10 smithi157 ceph-mon[35083]: pgmap v32: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-04-03T08:40:11.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:10 smithi181 ceph-mon[44183]: pgmap v32: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-04-03T08:40:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:12 smithi157 ceph-mon[35083]: pgmap v33: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 935 KiB/s rd, 995 KiB/s wr, 163 op/s 2024-04-03T08:40:13.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:12 smithi181 ceph-mon[44183]: pgmap v33: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 935 KiB/s rd, 995 KiB/s wr, 163 op/s 2024-04-03T08:40:14.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:14.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:14 smithi157 ceph-mon[35083]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 296 op/s 2024-04-03T08:40:15.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:14 smithi181 ceph-mon[44183]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 296 op/s 2024-04-03T08:40:17.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:16 smithi181 ceph-mon[44183]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1000 KiB/s rd, 1.0 MiB/s wr, 228 op/s 2024-04-03T08:40:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:16 smithi157 ceph-mon[35083]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1000 KiB/s rd, 1.0 MiB/s wr, 228 op/s 2024-04-03T08:40:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:18 smithi157 ceph-mon[35083]: pgmap v36: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1000 KiB/s rd, 1.0 MiB/s wr, 246 op/s 2024-04-03T08:40:19.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:18 smithi181 ceph-mon[44183]: pgmap v36: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1000 KiB/s rd, 1.0 MiB/s wr, 246 op/s 2024-04-03T08:40:21.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:20 smithi157 ceph-mon[35083]: pgmap v37: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-04-03T08:40:21.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:20 smithi181 ceph-mon[44183]: pgmap v37: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-04-03T08:40:23.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:22 smithi157 ceph-mon[35083]: pgmap v38: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 969 KiB/s rd, 965 KiB/s wr, 252 op/s 2024-04-03T08:40:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:22 smithi181 ceph-mon[44183]: pgmap v38: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 969 KiB/s rd, 965 KiB/s wr, 252 op/s 2024-04-03T08:40:25.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:24 smithi157 ceph-mon[35083]: pgmap v39: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 410 op/s 2024-04-03T08:40:25.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:24 smithi181 ceph-mon[44183]: pgmap v39: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 410 op/s 2024-04-03T08:40:26.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 -- 172.21.15.157:0/3474055375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fe0d0 msgr2=0x7fe1480fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:26.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 --2- 172.21.15.157:0/3474055375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fe0d0 0x7fe1480fe540 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe134004940 tx=0x7fe134009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:26.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 -- 172.21.15.157:0/3474055375 shutdown_connections 2024-04-03T08:40:26.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 --2- 172.21.15.157:0/3474055375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fe0d0 0x7fe1480fe540 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 --2- 172.21.15.157:0/3474055375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1480fcee0 0x7fe1480fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 -- 172.21.15.157:0/3474055375 >> 172.21.15.157:0/3474055375 conn(0x7fe1480f8560 msgr2=0x7fe1480fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.919+0000 7fe14d000700 1 -- 172.21.15.157:0/3474055375 shutdown_connections 2024-04-03T08:40:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.920+0000 7fe14d000700 1 -- 172.21.15.157:0/3474055375 wait complete. 2024-04-03T08:40:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.921+0000 7fe14d000700 1 Processor -- start 2024-04-03T08:40:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.921+0000 7fe14d000700 1 -- start start 2024-04-03T08:40:26.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.921+0000 7fe14d000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 0x7fe148071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:26.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.921+0000 7fe14d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1480fe0d0 0x7fe148070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:26.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.921+0000 7fe14d000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480708a0 con 0x7fe1480fcee0 2024-04-03T08:40:26.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.921+0000 7fe14d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480709e0 con 0x7fe1480fe0d0 2024-04-03T08:40:26.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 0x7fe148071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:26.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 0x7fe148071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42742/0 (socket says 172.21.15.157:42742) 2024-04-03T08:40:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 -- 172.21.15.157:0/3615172803 learned_addr learned my addr 172.21.15.157:0/3615172803 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145400700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1480fe0d0 0x7fe148070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 -- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1480fe0d0 msgr2=0x7fe148070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1480fe0d0 0x7fe148070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 -- 172.21.15.157:0/3615172803 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134005040 con 0x7fe1480fcee0 2024-04-03T08:40:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.922+0000 7fe145e00700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 0x7fe148071df0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe13800eb70 tx=0x7fe13800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.923+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe138007cc0 con 0x7fe1480fcee0 2024-04-03T08:40:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.923+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe13800f040 con 0x7fe1480fcee0 2024-04-03T08:40:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.923+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13800cb20 con 0x7fe1480fcee0 2024-04-03T08:40:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.923+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe148070c60 con 0x7fe1480fcee0 2024-04-03T08:40:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.923+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148115a40 con 0x7fe1480fcee0 2024-04-03T08:40:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.924+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14805f5f0 con 0x7fe1480fcee0 2024-04-03T08:40:26.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.926+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fe13800cc80 con 0x7fe1480fcee0 2024-04-03T08:40:26.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.927+0000 7fe13e000700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fe12c06b2e0 0x7fe12c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:26.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.927+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe1380897d0 con 0x7fe1480fcee0 2024-04-03T08:40:26.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.928+0000 7fe145400700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fe12c06b2e0 0x7fe12c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:26.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.929+0000 7fe145400700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fe12c06b2e0 0x7fe12c06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe134009fd0 tx=0x7fe134009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:26.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:26.931+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe13804f620 con 0x7fe1480fcee0 2024-04-03T08:40:27.178 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:26 smithi181 ceph-mon[44183]: pgmap v40: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 989 KiB/s rd, 1.0 MiB/s wr, 278 op/s 2024-04-03T08:40:27.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.275+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe148102490 con 0x7fe12c06b2e0 2024-04-03T08:40:27.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.277+0000 7fe13e000700 1 -- 172.21.15.157:0/3615172803 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe148102490 con 0x7fe12c06b2e0 2024-04-03T08:40:27.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fe12c06b2e0 msgr2=0x7fe12c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:27.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fe12c06b2e0 0x7fe12c06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe134009fd0 tx=0x7fe134009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:27.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 msgr2=0x7fe148071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:27.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 0x7fe148071df0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe13800eb70 tx=0x7fe13800b040 comp rx=0 tx=0).stop 2024-04-03T08:40:27.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 shutdown_connections 2024-04-03T08:40:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fe12c06b2e0 0x7fe12c06d790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1480fcee0 0x7fe148071df0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 --2- 172.21.15.157:0/3615172803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1480fe0d0 0x7fe148070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.281+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 >> 172.21.15.157:0/3615172803 conn(0x7fe1480f8560 msgr2=0x7fe1480f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.282+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 shutdown_connections 2024-04-03T08:40:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.282+0000 7fe14d000700 1 -- 172.21.15.157:0/3615172803 wait complete. 2024-04-03T08:40:27.299 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:40:27.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:26 smithi157 ceph-mon[35083]: pgmap v40: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 989 KiB/s rd, 1.0 MiB/s wr, 278 op/s 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 -- 172.21.15.157:0/994553061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 msgr2=0x7efcb40fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 --2- 172.21.15.157:0/994553061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb40fd310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efcac004940 tx=0x7efcac009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 -- 172.21.15.157:0/994553061 shutdown_connections 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 --2- 172.21.15.157:0/994553061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 0x7efcb40fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 --2- 172.21.15.157:0/994553061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb40fd310 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 -- 172.21.15.157:0/994553061 >> 172.21.15.157:0/994553061 conn(0x7efcb40f8560 msgr2=0x7efcb40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:27.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 -- 172.21.15.157:0/994553061 shutdown_connections 2024-04-03T08:40:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.454+0000 7efcbb400700 1 -- 172.21.15.157:0/994553061 wait complete. 2024-04-03T08:40:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.455+0000 7efcbb400700 1 Processor -- start 2024-04-03T08:40:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.455+0000 7efcbb400700 1 -- start start 2024-04-03T08:40:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcbb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb410fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcbb400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 0x7efcb4110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcbb400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4110720 con 0x7efcb40fcee0 2024-04-03T08:40:27.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcbb400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4110f70 con 0x7efcb40fe0d0 2024-04-03T08:40:27.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcb8a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb410fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:27.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcb3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 0x7efcb4110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:27.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcb8a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb410fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42752/0 (socket says 172.21.15.157:42752) 2024-04-03T08:40:27.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.456+0000 7efcb8a00700 1 -- 172.21.15.157:0/1113442420 learned_addr learned my addr 172.21.15.157:0/1113442420 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:27.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb8a00700 1 -- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 msgr2=0x7efcb4110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:27.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb8a00700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 0x7efcb4110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb8a00700 1 -- 172.21.15.157:0/1113442420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac005040 con 0x7efcb40fcee0 2024-04-03T08:40:27.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb3e00700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 0x7efcb4110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:40:27.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb8a00700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb410fbe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcac00b0d0 tx=0x7efcac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:27.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcac00e070 con 0x7efcb40fcee0 2024-04-03T08:40:27.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcac013de0 con 0x7efcb40fcee0 2024-04-03T08:40:27.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb41111f0 con 0x7efcb40fcee0 2024-04-03T08:40:27.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcac00b410 con 0x7efcb40fcee0 2024-04-03T08:40:27.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.457+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb4111730 con 0x7efcb40fcee0 2024-04-03T08:40:27.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.459+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4101a60 con 0x7efcb40fcee0 2024-04-03T08:40:27.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.461+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7efcac01d460 con 0x7efcb40fcee0 2024-04-03T08:40:27.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.462+0000 7efcb0c00700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7efc9806b2e0 0x7efc9806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:27.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.462+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efcac08b6e0 con 0x7efcb40fcee0 2024-04-03T08:40:27.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.463+0000 7efcb3e00700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7efc9806b2e0 0x7efc9806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:27.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.463+0000 7efcb3e00700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7efc9806b2e0 0x7efc9806d790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009b80 tx=0x7efc9c00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:27.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.467+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efcac059260 con 0x7efcb40fcee0 2024-04-03T08:40:27.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.822+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcb41119a0 con 0x7efc9806b2e0 2024-04-03T08:40:27.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.824+0000 7efcb0c00700 1 -- 172.21.15.157:0/1113442420 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7efcb41119a0 con 0x7efc9806b2e0 2024-04-03T08:40:27.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.827+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7efc9806b2e0 msgr2=0x7efc9806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:27.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.827+0000 7efcbb400700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7efc9806b2e0 0x7efc9806d790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009b80 tx=0x7efc9c00b040 comp rx=0 tx=0).stop 2024-04-03T08:40:27.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.827+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 msgr2=0x7efcb410fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:27.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.827+0000 7efcbb400700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb410fbe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcac00b0d0 tx=0x7efcac009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:27.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 shutdown_connections 2024-04-03T08:40:27.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7efc9806b2e0 0x7efc9806d790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcb40fcee0 0x7efcb410fbe0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 --2- 172.21.15.157:0/1113442420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcb40fe0d0 0x7efcb4110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:27.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 >> 172.21.15.157:0/1113442420 conn(0x7efcb40f8560 msgr2=0x7efcb40f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:27.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 shutdown_connections 2024-04-03T08:40:27.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:27.828+0000 7efcbb400700 1 -- 172.21.15.157:0/1113442420 wait complete. 2024-04-03T08:40:28.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.018+0000 7fb5e7200700 1 -- 172.21.15.157:0/1658788093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 msgr2=0x7fb5e00fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.018+0000 7fb5e7200700 1 --2- 172.21.15.157:0/1658788093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e00fd7b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0004940 tx=0x7fb5d0009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.019+0000 7fb5e7200700 1 -- 172.21.15.157:0/1658788093 shutdown_connections 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.019+0000 7fb5e7200700 1 --2- 172.21.15.157:0/1658788093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 0x7fb5e0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.019+0000 7fb5e7200700 1 --2- 172.21.15.157:0/1658788093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e00fd7b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.019+0000 7fb5e7200700 1 -- 172.21.15.157:0/1658788093 >> 172.21.15.157:0/1658788093 conn(0x7fb5e00f7430 msgr2=0x7fb5e00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.019+0000 7fb5e7200700 1 -- 172.21.15.157:0/1658788093 shutdown_connections 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.019+0000 7fb5e7200700 1 -- 172.21.15.157:0/1658788093 wait complete. 2024-04-03T08:40:28.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.020+0000 7fb5e7200700 1 Processor -- start 2024-04-03T08:40:28.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.020+0000 7fb5e7200700 1 -- start start 2024-04-03T08:40:28.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.020+0000 7fb5e7200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:28.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.020+0000 7fb5e7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 0x7fb5e006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.020+0000 7fb5e7200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e006fff0 con 0x7fb5e00662e0 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.020+0000 7fb5e7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e006ee30 con 0x7fb5e00fdcf0 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5dfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5df400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 0x7fb5e006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5dfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42770/0 (socket says 172.21.15.157:42770) 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5dfe00700 1 -- 172.21.15.157:0/2475815002 learned_addr learned my addr 172.21.15.157:0/2475815002 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5dfe00700 1 -- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 msgr2=0x7fb5e006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5dfe00700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 0x7fb5e006e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5dfe00700 1 -- 172.21.15.157:0/2475815002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0005040 con 0x7fb5e00662e0 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.021+0000 7fb5df400700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 0x7fb5e006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.022+0000 7fb5dfe00700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e006e3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0000c00 tx=0x7fb5d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.022+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d000e070 con 0x7fb5e00662e0 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.022+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e006f030 con 0x7fb5e00662e0 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.022+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e0102000 con 0x7fb5e00662e0 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.022+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5d001c400 con 0x7fb5e00662e0 2024-04-03T08:40:28.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.022+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d000b650 con 0x7fb5e00662e0 2024-04-03T08:40:28.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.023+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c00052e0 con 0x7fb5e00662e0 2024-04-03T08:40:28.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.025+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fb5d0013af0 con 0x7fb5e00662e0 2024-04-03T08:40:28.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.026+0000 7fb5d7e00700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb5c406b2e0 0x7fb5c406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:28.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.027+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb5d008b230 con 0x7fb5e00662e0 2024-04-03T08:40:28.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.027+0000 7fb5df400700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb5c406b2e0 0x7fb5c406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:28.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.028+0000 7fb5df400700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb5c406b2e0 0x7fb5c406d790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009b80 tx=0x7fb5cc00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:28.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.033+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb5d0055300 con 0x7fb5e00662e0 2024-04-03T08:40:28.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:27 smithi157 ceph-mon[35083]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:28.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:27 smithi157 ceph-mon[35083]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:27 smithi181 ceph-mon[44183]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:27 smithi181 ceph-mon[44183]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.395+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c0000bf0 con 0x7fb5c406b2e0 2024-04-03T08:40:28.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.406+0000 7fb5d7e00700 1 -- 172.21.15.157:0/2475815002 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb5c0000bf0 con 0x7fb5c406b2e0 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 starting - - - - 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (10m) 46s ago 10m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (9m) 58s ago 9m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (8m) 46s ago 10m 74.8M - 9.4.7 954c08fa6188 1008584add94 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (4m) 46s ago 4m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (4m) 46s ago 4m 195M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (4m) 58s ago 4m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (4m) 58s ago 4m 118M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (12m) 46s ago 12m 330M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (103s) 58s ago 9m 487M - 19.0.0-1670-g1fb5d106 c318aa90b546 b4f1b4d00cca 2024-04-03T08:40:28.407 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (12m) 46s ago 12m 49.6M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (9m) 58s ago 9m 40.0M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 starting - - - - 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (9m) 58s ago 9m 7646k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (8m) 46s ago 8m 208M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (8m) 46s ago 8m 210M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (7m) 46s ago 7m 178M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (7m) 58s ago 7m 254M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (6m) 58s ago 6m 215M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (6m) 58s ago 6m 242M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:40:28.408 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (8m) 46s ago 10m 50.7M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:40:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb5c406b2e0 msgr2=0x7fb5c406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb5c406b2e0 0x7fb5c406d790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009b80 tx=0x7fb5cc00b040 comp rx=0 tx=0).stop 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 msgr2=0x7fb5e006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e006e3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0000c00 tx=0x7fb5d0009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 shutdown_connections 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb5c406b2e0 0x7fb5c406d790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e00662e0 0x7fb5e006e3b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 --2- 172.21.15.157:0/2475815002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e00fdcf0 0x7fb5e006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 >> 172.21.15.157:0/2475815002 conn(0x7fb5e00f7430 msgr2=0x7fb5e00f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 shutdown_connections 2024-04-03T08:40:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.409+0000 7fb5e7200700 1 -- 172.21.15.157:0/2475815002 wait complete. 2024-04-03T08:40:28.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.577+0000 7f8b11400700 1 -- 172.21.15.157:0/920878215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c1002a0 msgr2=0x7f8b0c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.577+0000 7f8b11400700 1 --2- 172.21.15.157:0/920878215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c100710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8af8004940 tx=0x7f8af8009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.577+0000 7f8b11400700 1 -- 172.21.15.157:0/920878215 shutdown_connections 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.577+0000 7f8b11400700 1 --2- 172.21.15.157:0/920878215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c100710 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.577+0000 7f8b11400700 1 --2- 172.21.15.157:0/920878215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c0ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.577+0000 7f8b11400700 1 -- 172.21.15.157:0/920878215 >> 172.21.15.157:0/920878215 conn(0x7f8b0c0fa950 msgr2=0x7f8b0c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.578+0000 7f8b11400700 1 -- 172.21.15.157:0/920878215 shutdown_connections 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.578+0000 7f8b11400700 1 -- 172.21.15.157:0/920878215 wait complete. 2024-04-03T08:40:28.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.578+0000 7f8b11400700 1 Processor -- start 2024-04-03T08:40:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.579+0000 7f8b11400700 1 -- start start 2024-04-03T08:40:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.579+0000 7f8b11400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:28.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.579+0000 7f8b11400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.579+0000 7f8b11400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c1106d0 con 0x7f8b0c0feff0 2024-04-03T08:40:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.579+0000 7f8b11400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c110f20 con 0x7f8b0c1002a0 2024-04-03T08:40:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.580+0000 7f8b0a800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.580+0000 7f8b0a800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c10fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42788/0 (socket says 172.21.15.157:42788) 2024-04-03T08:40:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.580+0000 7f8b0a800700 1 -- 172.21.15.157:0/3895170581 learned_addr learned my addr 172.21.15.157:0/3895170581 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:28.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.580+0000 7f8b09e00700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b09e00700 1 -- 172.21.15.157:0/3895170581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 msgr2=0x7f8b0c10fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b09e00700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c10fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b09e00700 1 -- 172.21.15.157:0/3895170581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8005040 con 0x7f8b0c1002a0 2024-04-03T08:40:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b0a800700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:40:28.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b09e00700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c1100d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8af800b0d0 tx=0x7f8af8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af800e070 con 0x7f8b0c1002a0 2024-04-03T08:40:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8af8013de0 con 0x7f8b0c1002a0 2024-04-03T08:40:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.581+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af800be30 con 0x7f8b0c1002a0 2024-04-03T08:40:28.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.582+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c111120 con 0x7f8b0c1002a0 2024-04-03T08:40:28.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.583+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c111640 con 0x7f8b0c1002a0 2024-04-03T08:40:28.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.584+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c05f5f0 con 0x7f8b0c1002a0 2024-04-03T08:40:28.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.585+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f8af800b680 con 0x7f8b0c1002a0 2024-04-03T08:40:28.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.586+0000 7f8b02a00700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f8af006b2e0 0x7f8af006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:28.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.586+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8af808a650 con 0x7f8b0c1002a0 2024-04-03T08:40:28.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.586+0000 7f8b0a800700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f8af006b2e0 0x7f8af006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:28.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.587+0000 7f8b0a800700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f8af006b2e0 0x7f8af006d790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0041d0 tx=0x7f8afc00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:28.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.590+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8af8058230 con 0x7f8b0c1002a0 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.951+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b0c107ae0 con 0x7f8b0c1002a0 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.951+0000 7f8b02a00700 1 -- 172.21.15.157:0/3895170581 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f8af8057dc0 con 0x7f8b0c1002a0 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f8af006b2e0 msgr2=0x7f8af006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f8af006b2e0 0x7f8af006d790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0041d0 tx=0x7f8afc00b040 comp rx=0 tx=0).stop 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c1002a0 msgr2=0x7f8b0c1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c1100d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8af800b0d0 tx=0x7f8af8009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 shutdown_connections 2024-04-03T08:40:29.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f8af006b2e0 0x7f8af006d790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b0c0feff0 0x7f8b0c10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 --2- 172.21.15.157:0/3895170581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b0c1002a0 0x7f8b0c1100d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 >> 172.21.15.157:0/3895170581 conn(0x7f8b0c0fa950 msgr2=0x7f8b0c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 shutdown_connections 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:28.954+0000 7f8b11400700 1 -- 172.21.15.157:0/3895170581 wait complete. 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:40:29.138 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 13, 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:40:29.139 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:40:29.140 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:40:29.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.141+0000 7f5db1000700 1 -- 172.21.15.157:0/659392190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fdec0 msgr2=0x7f5dac0fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.141+0000 7f5db1000700 1 --2- 172.21.15.157:0/659392190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fdec0 0x7f5dac0fe330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5d98004940 tx=0x7f5d98009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:29.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.141+0000 7f5db1000700 1 -- 172.21.15.157:0/659392190 shutdown_connections 2024-04-03T08:40:29.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.141+0000 7f5db1000700 1 --2- 172.21.15.157:0/659392190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fdec0 0x7f5dac0fe330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.141+0000 7f5db1000700 1 --2- 172.21.15.157:0/659392190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5dac0fcc10 0x7f5dac0fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.141+0000 7f5db1000700 1 -- 172.21.15.157:0/659392190 >> 172.21.15.157:0/659392190 conn(0x7f5dac0f83d0 msgr2=0x7f5dac0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:29.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.142+0000 7f5db1000700 1 -- 172.21.15.157:0/659392190 shutdown_connections 2024-04-03T08:40:29.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.142+0000 7f5db1000700 1 -- 172.21.15.157:0/659392190 wait complete. 2024-04-03T08:40:29.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.143+0000 7f5db1000700 1 Processor -- start 2024-04-03T08:40:29.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.143+0000 7f5db1000700 1 -- start start 2024-04-03T08:40:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.143+0000 7f5db1000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 0x7f5dac10fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5db1000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5dac0fdec0 0x7f5dac10ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5db1000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac110580 con 0x7f5dac0fcc10 2024-04-03T08:40:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5db1000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac110dd0 con 0x7f5dac0fdec0 2024-04-03T08:40:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5dab400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 0x7f5dac10fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5dab400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 0x7f5dac10fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42806/0 (socket says 172.21.15.157:42806) 2024-04-03T08:40:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5dab400700 1 -- 172.21.15.157:0/906739002 learned_addr learned my addr 172.21.15.157:0/906739002 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.144+0000 7f5daaa00700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5dac0fdec0 0x7f5dac10ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.145+0000 7f5dab400700 1 -- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5dac0fdec0 msgr2=0x7f5dac10ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.145+0000 7f5dab400700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5dac0fdec0 0x7f5dac10ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.145+0000 7f5dab400700 1 -- 172.21.15.157:0/906739002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98005040 con 0x7f5dac0fcc10 2024-04-03T08:40:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.145+0000 7f5dab400700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 0x7f5dac10fa40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c830 tx=0x7f5d9c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:29.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.146+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9c0106f0 con 0x7f5dac0fcc10 2024-04-03T08:40:29.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.146+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac111030 con 0x7f5dac0fcc10 2024-04-03T08:40:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.147+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac1115f0 con 0x7f5dac0fcc10 2024-04-03T08:40:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.147+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d9c010d20 con 0x7f5dac0fcc10 2024-04-03T08:40:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.147+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9c0113a0 con 0x7f5dac0fcc10 2024-04-03T08:40:29.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.151+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c0052e0 con 0x7f5dac0fcc10 2024-04-03T08:40:29.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.151+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f5d9c012400 con 0x7f5dac0fcc10 2024-04-03T08:40:29.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.152+0000 7f5da3400700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5d9006b2e0 0x7f5d9006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:29.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.153+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5d9c089ba0 con 0x7f5dac0fcc10 2024-04-03T08:40:29.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.153+0000 7f5daaa00700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5d9006b2e0 0x7f5d9006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.154+0000 7f5daaa00700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5d9006b2e0 0x7f5d9006d790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800b3b0 tx=0x7f5d98009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:29.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.162+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5d9c0578b0 con 0x7f5dac0fcc10 2024-04-03T08:40:29.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:28 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:29.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:29 smithi157 ceph-mon[35083]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:29.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:29 smithi157 ceph-mon[35083]: pgmap v41: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 989 KiB/s rd, 1.0 MiB/s wr, 304 op/s 2024-04-03T08:40:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:28 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:28 smithi181 ceph-mon[44183]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:29.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:28 smithi181 ceph-mon[44183]: pgmap v41: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 989 KiB/s rd, 1.0 MiB/s wr, 304 op/s 2024-04-03T08:40:29.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.573+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d8c005860 con 0x7f5dac0fcc10 2024-04-03T08:40:29.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.574+0000 7f5da3400700 1 -- 172.21.15.157:0/906739002 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f5d9c057440 con 0x7f5dac0fcc10 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:40:29.576 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:40:29.577 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:40:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:40:29.579 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:40:29.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.576+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5d9006b2e0 msgr2=0x7f5d9006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.576+0000 7f5db1000700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5d9006b2e0 0x7f5d9006d790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800b3b0 tx=0x7f5d98009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:29.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.576+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 msgr2=0x7f5dac10fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.576+0000 7f5db1000700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 0x7f5dac10fa40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c830 tx=0x7f5d9c004470 comp rx=0 tx=0).stop 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 shutdown_connections 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5d9006b2e0 0x7f5d9006d790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5dac0fcc10 0x7f5dac10fa40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 --2- 172.21.15.157:0/906739002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5dac0fdec0 0x7f5dac10ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 >> 172.21.15.157:0/906739002 conn(0x7f5dac0f83d0 msgr2=0x7f5dac0f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 shutdown_connections 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.577+0000 7f5db1000700 1 -- 172.21.15.157:0/906739002 wait complete. 2024-04-03T08:40:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 -- 172.21.15.157:0/2394521735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fcee0 msgr2=0x7fde500fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 --2- 172.21.15.157:0/2394521735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fcee0 0x7fde500fd310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde40004970 tx=0x7fde40009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 -- 172.21.15.157:0/2394521735 shutdown_connections 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 --2- 172.21.15.157:0/2394521735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fe0d0 0x7fde500fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 --2- 172.21.15.157:0/2394521735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fcee0 0x7fde500fd310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 -- 172.21.15.157:0/2394521735 >> 172.21.15.157:0/2394521735 conn(0x7fde500f8560 msgr2=0x7fde500fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:29.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 -- 172.21.15.157:0/2394521735 shutdown_connections 2024-04-03T08:40:29.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.761+0000 7fde54a00700 1 -- 172.21.15.157:0/2394521735 wait complete. 2024-04-03T08:40:29.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.762+0000 7fde54a00700 1 Processor -- start 2024-04-03T08:40:29.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.763+0000 7fde54a00700 1 -- start start 2024-04-03T08:40:29.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.763+0000 7fde54a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fcee0 0x7fde5010d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:29.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.763+0000 7fde54a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fe0d0 0x7fde5010def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:29.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.763+0000 7fde54a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5010e4f0 con 0x7fde500fcee0 2024-04-03T08:40:29.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.763+0000 7fde54a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5010ed40 con 0x7fde500fe0d0 2024-04-03T08:40:29.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.764+0000 7fde4d400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fe0d0 0x7fde5010def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:29.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.764+0000 7fde4d400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fe0d0 0x7fde5010def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:36452/0 (socket says 172.21.15.157:36452) 2024-04-03T08:40:29.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.764+0000 7fde4d400700 1 -- 172.21.15.157:0/3840662239 learned_addr learned my addr 172.21.15.157:0/3840662239 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:29.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.764+0000 7fde4de00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fcee0 0x7fde5010d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde4de00700 1 -- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fe0d0 msgr2=0x7fde5010def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde4de00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fe0d0 0x7fde5010def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde4de00700 1 -- 172.21.15.157:0/3840662239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40005040 con 0x7fde500fcee0 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde4de00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fcee0 0x7fde5010d9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fde40005010 tx=0x7fde40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde4000e040 con 0x7fde500fcee0 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde40013420 con 0x7fde500fcee0 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde4001c630 con 0x7fde500fcee0 2024-04-03T08:40:29.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.765+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5010efc0 con 0x7fde500fcee0 2024-04-03T08:40:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.766+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5010f480 con 0x7fde500fcee0 2024-04-03T08:40:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.767+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5005f5f0 con 0x7fde500fcee0 2024-04-03T08:40:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.769+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fde40013a20 con 0x7fde500fcee0 2024-04-03T08:40:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.770+0000 7fde46000700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fde3406b330 0x7fde3406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.771+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fde4008ae40 con 0x7fde500fcee0 2024-04-03T08:40:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.771+0000 7fde4d400700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fde3406b330 0x7fde3406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:29.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.772+0000 7fde4d400700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fde3406b330 0x7fde3406d7e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0041d0 tx=0x7fde3c00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:29.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:29.776+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fde40058900 con 0x7fde500fcee0 2024-04-03T08:40:30.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.106+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde5010f8a0 con 0x7fde3406b330 2024-04-03T08:40:30.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.108+0000 7fde46000700 1 -- 172.21.15.157:0/3840662239 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fde5010f8a0 con 0x7fde3406b330 2024-04-03T08:40:30.108 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "1/21 daemons upgraded", 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:40:30.109 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:40:30.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.111+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fde3406b330 msgr2=0x7fde3406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:30.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.111+0000 7fde54a00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fde3406b330 0x7fde3406d7e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0041d0 tx=0x7fde3c00b040 comp rx=0 tx=0).stop 2024-04-03T08:40:30.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.111+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fcee0 msgr2=0x7fde5010d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:30.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.111+0000 7fde54a00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fcee0 0x7fde5010d9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fde40005010 tx=0x7fde40009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:30.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 shutdown_connections 2024-04-03T08:40:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fde3406b330 0x7fde3406d7e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde500fcee0 0x7fde5010d9b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 --2- 172.21.15.157:0/3840662239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde500fe0d0 0x7fde5010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 >> 172.21.15.157:0/3840662239 conn(0x7fde500f8560 msgr2=0x7fde500f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 shutdown_connections 2024-04-03T08:40:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.112+0000 7fde54a00700 1 -- 172.21.15.157:0/3840662239 wait complete. 2024-04-03T08:40:30.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 -- 172.21.15.157:0/2884692000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 msgr2=0x7fb86c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:30.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 --2- 172.21.15.157:0/2884692000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c101dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb860004940 tx=0x7fb860009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:30.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 -- 172.21.15.157:0/2884692000 shutdown_connections 2024-04-03T08:40:30.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 --2- 172.21.15.157:0/2884692000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c102300 0x7fb86c1046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 --2- 172.21.15.157:0/2884692000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c101dc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 -- 172.21.15.157:0/2884692000 >> 172.21.15.157:0/2884692000 conn(0x7fb86c0f7430 msgr2=0x7fb86c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.311+0000 7fb873a00700 1 -- 172.21.15.157:0/2884692000 shutdown_connections 2024-04-03T08:40:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.312+0000 7fb873a00700 1 -- 172.21.15.157:0/2884692000 wait complete. 2024-04-03T08:40:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.313+0000 7fb873a00700 1 Processor -- start 2024-04-03T08:40:30.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:29 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3895170581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:40:30.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:29 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/906739002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.313+0000 7fb873a00700 1 -- start start 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.313+0000 7fb873a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.313+0000 7fb873a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c102300 0x7fb86c114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.313+0000 7fb873a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c114b70 con 0x7fb86c0662e0 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.313+0000 7fb873a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c115320 con 0x7fb86c102300 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb871000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb86be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c102300 0x7fb86c114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb871000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42840/0 (socket says 172.21.15.157:42840) 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb871000700 1 -- 172.21.15.157:0/2203685281 learned_addr learned my addr 172.21.15.157:0/2203685281 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb871000700 1 -- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c102300 msgr2=0x7fb86c114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb871000700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c102300 0x7fb86c114570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.314+0000 7fb871000700 1 -- 172.21.15.157:0/2203685281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860005040 con 0x7fb86c0662e0 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.315+0000 7fb871000700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c114030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb86000b970 tx=0x7fb860009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.315+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86000e040 con 0x7fb86c0662e0 2024-04-03T08:40:30.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.315+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb860004290 con 0x7fb86c0662e0 2024-04-03T08:40:30.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.315+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c115520 con 0x7fb86c0662e0 2024-04-03T08:40:30.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.315+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86001c3f0 con 0x7fb86c0662e0 2024-04-03T08:40:30.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.316+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c115ae0 con 0x7fb86c0662e0 2024-04-03T08:40:30.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.317+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c0f8fb0 con 0x7fb86c0662e0 2024-04-03T08:40:30.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.318+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fb86000bbf0 con 0x7fb86c0662e0 2024-04-03T08:40:30.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.319+0000 7fb868c00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb85406b2e0 0x7fb85406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:40:30.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.319+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb86008b070 con 0x7fb86c0662e0 2024-04-03T08:40:30.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.320+0000 7fb86be00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb85406b2e0 0x7fb85406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:40:30.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.320+0000 7fb86be00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb85406b2e0 0x7fb85406d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb858009fd0 tx=0x7fb85800b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:40:30.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.324+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb860058c60 con 0x7fb86c0662e0 2024-04-03T08:40:30.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:29 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/3895170581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:40:30.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:29 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/906739002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:40:30.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.804+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb86c04bed0 con 0x7fb86c0662e0 2024-04-03T08:40:30.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.805+0000 7fb868c00700 1 -- 172.21.15.157:0/2203685281 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb8600587f0 con 0x7fb86c0662e0 2024-04-03T08:40:30.806 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:40:30.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb85406b2e0 msgr2=0x7fb85406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:30.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb85406b2e0 0x7fb85406d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb858009fd0 tx=0x7fb85800b040 comp rx=0 tx=0).stop 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 msgr2=0x7fb86c114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c114030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb86000b970 tx=0x7fb860009e30 comp rx=0 tx=0).stop 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 shutdown_connections 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fb85406b2e0 0x7fb85406d790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb86c0662e0 0x7fb86c114030 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 --2- 172.21.15.157:0/2203685281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c102300 0x7fb86c114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 >> 172.21.15.157:0/2203685281 conn(0x7fb86c0f7430 msgr2=0x7fb86c0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 shutdown_connections 2024-04-03T08:40:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:40:30.808+0000 7fb873a00700 1 -- 172.21.15.157:0/2203685281 wait complete. 2024-04-03T08:40:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:30 smithi157 ceph-mon[35083]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:30 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2203685281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:40:31.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:30 smithi157 ceph-mon[35083]: pgmap v42: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 424 op/s 2024-04-03T08:40:31.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:30 smithi181 ceph-mon[44183]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:40:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:30 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2203685281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:40:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:30 smithi181 ceph-mon[44183]: pgmap v42: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 424 op/s 2024-04-03T08:40:33.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:32 smithi157 ceph-mon[35083]: pgmap v43: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 322 op/s 2024-04-03T08:40:33.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:32 smithi181 ceph-mon[44183]: pgmap v43: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 322 op/s 2024-04-03T08:40:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:34 smithi157 ceph-mon[35083]: pgmap v44: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 512 op/s 2024-04-03T08:40:35.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:34 smithi181 ceph-mon[44183]: pgmap v44: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 512 op/s 2024-04-03T08:40:37.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:36 smithi181 ceph-mon[44183]: pgmap v45: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-04-03T08:40:37.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:36 smithi157 ceph-mon[35083]: pgmap v45: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-04-03T08:40:39.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:38 smithi157 ceph-mon[35083]: pgmap v46: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-04-03T08:40:39.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:38 smithi181 ceph-mon[44183]: pgmap v46: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-04-03T08:40:41.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:40 smithi157 ceph-mon[35083]: pgmap v47: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 701 op/s 2024-04-03T08:40:41.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:40 smithi181 ceph-mon[44183]: pgmap v47: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 701 op/s 2024-04-03T08:40:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:42 smithi157 ceph-mon[35083]: pgmap v48: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 563 op/s 2024-04-03T08:40:43.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:42 smithi181 ceph-mon[44183]: pgmap v48: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 563 op/s 2024-04-03T08:40:44.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:43 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:44.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:43 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:45.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:44 smithi157 ceph-mon[35083]: pgmap v49: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-04-03T08:40:45.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:44 smithi181 ceph-mon[44183]: pgmap v49: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-04-03T08:40:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:46 smithi157 ceph-mon[35083]: mgrmap e26: smithi181.mfhidq(active, since 93s), standbys: smithi157.qfvynr 2024-04-03T08:40:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:46 smithi157 ceph-mon[35083]: pgmap v50: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 848 op/s 2024-04-03T08:40:47.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:46 smithi181 ceph-mon[44183]: mgrmap e26: smithi181.mfhidq(active, since 93s), standbys: smithi157.qfvynr 2024-04-03T08:40:47.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:46 smithi181 ceph-mon[44183]: pgmap v50: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 848 op/s 2024-04-03T08:40:49.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:48 smithi157 ceph-mon[35083]: pgmap v51: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 848 op/s 2024-04-03T08:40:49.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:48 smithi181 ceph-mon[44183]: pgmap v51: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 848 op/s 2024-04-03T08:40:51.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:50 smithi157 ceph-mon[35083]: pgmap v52: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 990 op/s 2024-04-03T08:40:51.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:50 smithi181 ceph-mon[44183]: pgmap v52: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 990 op/s 2024-04-03T08:40:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:52 smithi157 ceph-mon[35083]: pgmap v53: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 674 op/s 2024-04-03T08:40:53.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:52 smithi181 ceph-mon[44183]: pgmap v53: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 674 op/s 2024-04-03T08:40:55.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:54 smithi157 ceph-mon[35083]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 815 op/s 2024-04-03T08:40:55.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:54 smithi181 ceph-mon[44183]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 815 op/s 2024-04-03T08:40:57.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:56 smithi157 ceph-mon[35083]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 950 KiB/s rd, 930 KiB/s wr, 340 op/s 2024-04-03T08:40:57.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:56 smithi181 ceph-mon[44183]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 950 KiB/s rd, 930 KiB/s wr, 340 op/s 2024-04-03T08:40:58.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:58 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:58.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:58 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:40:59.274 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:40:59 smithi157 ceph-mon[35083]: pgmap v56: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 950 KiB/s rd, 930 KiB/s wr, 340 op/s 2024-04-03T08:40:59.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:40:59 smithi181 ceph-mon[44183]: pgmap v56: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 950 KiB/s rd, 930 KiB/s wr, 340 op/s 2024-04-03T08:41:01.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.036+0000 7f348f200700 1 -- 172.21.15.157:0/1301927641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 msgr2=0x7f34900ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.036+0000 7f348f200700 1 --2- 172.21.15.157:0/1301927641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f34900ff830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3480004880 tx=0x7f3480009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.036+0000 7f348f200700 1 -- 172.21.15.157:0/1301927641 shutdown_connections 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.036+0000 7f348f200700 1 --2- 172.21.15.157:0/1301927641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34900ffd70 0x7f3490102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.036+0000 7f348f200700 1 --2- 172.21.15.157:0/1301927641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f34900ff830 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.036+0000 7f348f200700 1 -- 172.21.15.157:0/1301927641 >> 172.21.15.157:0/1301927641 conn(0x7f34900f72a0 msgr2=0x7f34900f96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.037+0000 7f348f200700 1 -- 172.21.15.157:0/1301927641 shutdown_connections 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.037+0000 7f348f200700 1 -- 172.21.15.157:0/1301927641 wait complete. 2024-04-03T08:41:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.039+0000 7f348f200700 1 Processor -- start 2024-04-03T08:41:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.039+0000 7f348f200700 1 -- start start 2024-04-03T08:41:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.040+0000 7f348f200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f349010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.040+0000 7f348f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34900ffd70 0x7f349010b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.040+0000 7f348f200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490110200 con 0x7f3490066cd0 2024-04-03T08:41:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.040+0000 7f348f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490110340 con 0x7f34900ffd70 2024-04-03T08:41:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.040+0000 7f348de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f349010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.041+0000 7f348de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f349010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48718/0 (socket says 172.21.15.157:48718) 2024-04-03T08:41:01.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.041+0000 7f348de00700 1 -- 172.21.15.157:0/2402588867 learned_addr learned my addr 172.21.15.157:0/2402588867 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:01.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.041+0000 7f348d400700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34900ffd70 0x7f349010b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:01.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.041+0000 7f348de00700 1 -- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34900ffd70 msgr2=0x7f349010b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:01.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.041+0000 7f348de00700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34900ffd70 0x7f349010b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.041+0000 7f348de00700 1 -- 172.21.15.157:0/2402588867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480005040 con 0x7f3490066cd0 2024-04-03T08:41:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.043+0000 7f348de00700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f349010fbb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3480000c00 tx=0x7f3480009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:01.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.044+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348000e040 con 0x7f3490066cd0 2024-04-03T08:41:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.044+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3480014c30 con 0x7f3490066cd0 2024-04-03T08:41:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.044+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348001cea0 con 0x7f3490066cd0 2024-04-03T08:41:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.045+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349010bc00 con 0x7f3490066cd0 2024-04-03T08:41:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.045+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349010c1c0 con 0x7f3490066cd0 2024-04-03T08:41:01.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.048+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900faf40 con 0x7f3490066cd0 2024-04-03T08:41:01.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.048+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f348001c3f0 con 0x7f3490066cd0 2024-04-03T08:41:01.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.050+0000 7f3486000700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f347406b1c0 0x7f347406d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.050+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f348008a4d0 con 0x7f3490066cd0 2024-04-03T08:41:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.050+0000 7f348d400700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f347406b1c0 0x7f347406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.051+0000 7f348d400700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f347406b1c0 0x7f347406d670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f347c004fd0 tx=0x7f347c00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:01.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.058+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3480054990 con 0x7f3490066cd0 2024-04-03T08:41:01.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:00 smithi157 ceph-mon[35083]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 476 op/s 2024-04-03T08:41:01.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:00 smithi181 ceph-mon[44183]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 476 op/s 2024-04-03T08:41:01.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.457+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34900f8de0 con 0x7f347406b1c0 2024-04-03T08:41:01.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.458+0000 7f3486000700 1 -- 172.21.15.157:0/2402588867 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f34900f8de0 con 0x7f347406b1c0 2024-04-03T08:41:01.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f347406b1c0 msgr2=0x7f347406d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:01.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f347406b1c0 0x7f347406d670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f347c004fd0 tx=0x7f347c00b040 comp rx=0 tx=0).stop 2024-04-03T08:41:01.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 msgr2=0x7f349010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f349010fbb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3480000c00 tx=0x7f3480009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 shutdown_connections 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f347406b1c0 0x7f347406d670 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3490066cd0 0x7f349010fbb0 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3480000c00 tx=0x7f3480009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 --2- 172.21.15.157:0/2402588867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34900ffd70 0x7f349010b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.461+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 >> 172.21.15.157:0/2402588867 conn(0x7f34900f72a0 msgr2=0x7f34900f76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.462+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 shutdown_connections 2024-04-03T08:41:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.462+0000 7f348f200700 1 -- 172.21.15.157:0/2402588867 wait complete. 2024-04-03T08:41:01.479 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:41:01.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.652+0000 7f6beb800700 1 -- 172.21.15.157:0/3210865841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fcee0 msgr2=0x7f6be40fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:01.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.652+0000 7f6beb800700 1 --2- 172.21.15.157:0/3210865841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fcee0 0x7f6be40fd310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8004970 tx=0x7f6bd8009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:01.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.653+0000 7f6beb800700 1 -- 172.21.15.157:0/3210865841 shutdown_connections 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.653+0000 7f6beb800700 1 --2- 172.21.15.157:0/3210865841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fe0d0 0x7f6be40fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.653+0000 7f6beb800700 1 --2- 172.21.15.157:0/3210865841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fcee0 0x7f6be40fd310 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.653+0000 7f6beb800700 1 -- 172.21.15.157:0/3210865841 >> 172.21.15.157:0/3210865841 conn(0x7f6be40f8560 msgr2=0x7f6be40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.653+0000 7f6beb800700 1 -- 172.21.15.157:0/3210865841 shutdown_connections 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.653+0000 7f6beb800700 1 -- 172.21.15.157:0/3210865841 wait complete. 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.654+0000 7f6beb800700 1 Processor -- start 2024-04-03T08:41:01.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.654+0000 7f6beb800700 1 -- start start 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6beb800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 0x7f6be410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6beb800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fe0d0 0x7f6be410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6beb800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be410e540 con 0x7f6be40fcee0 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6beb800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be410ed40 con 0x7f6be40fe0d0 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6be8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 0x7f6be410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6be8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 0x7f6be410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48734/0 (socket says 172.21.15.157:48734) 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6be8e00700 1 -- 172.21.15.157:0/1759138786 learned_addr learned my addr 172.21.15.157:0/1759138786 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.655+0000 7f6be3e00700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fe0d0 0x7f6be410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.656+0000 7f6be8e00700 1 -- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fe0d0 msgr2=0x7f6be410df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.656+0000 7f6be8e00700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fe0d0 0x7f6be410df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.656+0000 7f6be8e00700 1 -- 172.21.15.157:0/1759138786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0005040 con 0x7f6be40fcee0 2024-04-03T08:41:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.656+0000 7f6be8e00700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 0x7f6be410da00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800b8c0 tx=0x7f6bd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.657+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd800e040 con 0x7f6be40fcee0 2024-04-03T08:41:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.657+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bd8009660 con 0x7f6be40fcee0 2024-04-03T08:41:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.657+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd801c630 con 0x7f6be40fcee0 2024-04-03T08:41:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.657+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8005040 con 0x7f6be40fcee0 2024-04-03T08:41:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.657+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be410f370 con 0x7f6be40fcee0 2024-04-03T08:41:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.658+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be405f5f0 con 0x7f6be40fcee0 2024-04-03T08:41:01.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.660+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f6bd80097d0 con 0x7f6be40fcee0 2024-04-03T08:41:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.662+0000 7f6be0c00700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f6bcc06b2a0 0x7f6bcc06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.662+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6bd808b9a0 con 0x7f6be40fcee0 2024-04-03T08:41:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.663+0000 7f6be3e00700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f6bcc06b2a0 0x7f6bcc06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.663+0000 7f6be3e00700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f6bcc06b2a0 0x7f6bcc06d750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009fd0 tx=0x7f6bd0009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:01.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:01.667+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6bd8059700 con 0x7f6be40fcee0 2024-04-03T08:41:02.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.071+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6be410f6f0 con 0x7f6bcc06b2a0 2024-04-03T08:41:02.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.072+0000 7f6be0c00700 1 -- 172.21.15.157:0/1759138786 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6be410f6f0 con 0x7f6bcc06b2a0 2024-04-03T08:41:02.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.076+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f6bcc06b2a0 msgr2=0x7f6bcc06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.076+0000 7f6beb800700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f6bcc06b2a0 0x7f6bcc06d750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009fd0 tx=0x7f6bd0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:02.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.076+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 msgr2=0x7f6be410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.076+0000 7f6beb800700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 0x7f6be410da00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800b8c0 tx=0x7f6bd8009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.078+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 shutdown_connections 2024-04-03T08:41:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.078+0000 7f6beb800700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f6bcc06b2a0 0x7f6bcc06d750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.078+0000 7f6beb800700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40fcee0 0x7f6be410da00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.078+0000 7f6beb800700 1 --2- 172.21.15.157:0/1759138786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6be40fe0d0 0x7f6be410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.078+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 >> 172.21.15.157:0/1759138786 conn(0x7f6be40f8560 msgr2=0x7f6be40f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:02.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.079+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 shutdown_connections 2024-04-03T08:41:02.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.079+0000 7f6beb800700 1 -- 172.21.15.157:0/1759138786 wait complete. 2024-04-03T08:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.283+0000 7f6149600700 1 -- 172.21.15.157:0/552382661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 msgr2=0x7f6144070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.283+0000 7f6149600700 1 --2- 172.21.15.157:0/552382661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144070350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6134004970 tx=0x7f6134009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.284+0000 7f6149600700 1 -- 172.21.15.157:0/552382661 shutdown_connections 2024-04-03T08:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.284+0000 7f6149600700 1 --2- 172.21.15.157:0/552382661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 0x7f6144070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.284+0000 7f6149600700 1 --2- 172.21.15.157:0/552382661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144070350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.284+0000 7f6149600700 1 -- 172.21.15.157:0/552382661 >> 172.21.15.157:0/552382661 conn(0x7f61440f85a0 msgr2=0x7f61440fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.285+0000 7f6149600700 1 -- 172.21.15.157:0/552382661 shutdown_connections 2024-04-03T08:41:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.285+0000 7f6149600700 1 -- 172.21.15.157:0/552382661 wait complete. 2024-04-03T08:41:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.286+0000 7f6149600700 1 Processor -- start 2024-04-03T08:41:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.286+0000 7f6149600700 1 -- start start 2024-04-03T08:41:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6149600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 0x7f614410fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6149600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:02.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6149600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144110710 con 0x7f6144070890 2024-04-03T08:41:02.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6149600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144110f60 con 0x7f6144071e40 2024-04-03T08:41:02.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6142000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:02.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6142000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:50880/0 (socket says 172.21.15.157:50880) 2024-04-03T08:41:02.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.287+0000 7f6142000700 1 -- 172.21.15.157:0/441898419 learned_addr learned my addr 172.21.15.157:0/441898419 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.288+0000 7f6142a00700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 0x7f614410fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.288+0000 7f6142000700 1 -- 172.21.15.157:0/441898419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 msgr2=0x7f614410fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.288+0000 7f6142000700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 0x7f614410fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.288+0000 7f6142000700 1 -- 172.21.15.157:0/441898419 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134005040 con 0x7f6144071e40 2024-04-03T08:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.288+0000 7f6142a00700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 0x7f614410fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.288+0000 7f6142000700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144110110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f613000eb40 tx=0x7f613000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.289+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6130007cc0 con 0x7f6144071e40 2024-04-03T08:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.289+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f613000f040 con 0x7f6144071e40 2024-04-03T08:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.289+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6130009620 con 0x7f6144071e40 2024-04-03T08:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.289+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61441111e0 con 0x7f6144071e40 2024-04-03T08:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.289+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144111720 con 0x7f6144071e40 2024-04-03T08:41:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.291+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61240052e0 con 0x7f6144071e40 2024-04-03T08:41:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.293+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f6130009780 con 0x7f6144071e40 2024-04-03T08:41:02.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.294+0000 7f613aa00700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f612806b2e0 0x7f612806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:02.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.294+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6130089780 con 0x7f6144071e40 2024-04-03T08:41:02.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.295+0000 7f6142a00700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f612806b2e0 0x7f612806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:02.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.296+0000 7f6142a00700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f612806b2e0 0x7f612806d790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f613400b790 tx=0x7f6134009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:02.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.299+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f613004f620 con 0x7f6144071e40 2024-04-03T08:41:02.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.693+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6124000bf0 con 0x7f612806b2e0 2024-04-03T08:41:02.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.703+0000 7f613aa00700 1 -- 172.21.15.157:0/441898419 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6124000bf0 con 0x7f612806b2e0 2024-04-03T08:41:02.704 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 starting - - - - 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (11m) 80s ago 11m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (10m) 92s ago 10m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 starting - - - - 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (5m) 80s ago 5m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (4m) 80s ago 4m 195M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (5m) 92s ago 5m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (4m) 92s ago 4m 118M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (12m) 80s ago 12m 330M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (2m) 92s ago 10m 487M - 19.0.0-1670-g1fb5d106 c318aa90b546 b4f1b4d00cca 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (12m) 80s ago 13m 49.6M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (10m) 92s ago 10m 40.0M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 starting - - - - 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (10m) 92s ago 10m 7646k - 1.5.0 0da6a335fe13 8d6e93206df3 2024-04-03T08:41:02.705 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (9m) 80s ago 9m 208M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:41:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (8m) 80s ago 8m 210M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:41:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (8m) 80s ago 8m 178M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:41:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (7m) 92s ago 7m 254M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:41:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (7m) 92s ago 7m 215M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:41:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (6m) 92s ago 6m 242M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:41:02.706 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (9m) 80s ago 10m 50.7M - 2.43.0 a07b618ecd1d 3f22b5e86a26 2024-04-03T08:41:02.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.707+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f612806b2e0 msgr2=0x7f612806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.707+0000 7f6149600700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f612806b2e0 0x7f612806d790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f613400b790 tx=0x7f6134009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:02.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.707+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 msgr2=0x7f6144110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.707+0000 7f6149600700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144110110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f613000eb40 tx=0x7f613000b040 comp rx=0 tx=0).stop 2024-04-03T08:41:02.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.708+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 shutdown_connections 2024-04-03T08:41:02.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.708+0000 7f6149600700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f612806b2e0 0x7f612806d790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.708+0000 7f6149600700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144070890 0x7f614410fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.708+0000 7f6149600700 1 --2- 172.21.15.157:0/441898419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144071e40 0x7f6144110110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.708+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 >> 172.21.15.157:0/441898419 conn(0x7f61440f85a0 msgr2=0x7f61440f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:02.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.709+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 shutdown_connections 2024-04-03T08:41:02.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.709+0000 7f6149600700 1 -- 172.21.15.157:0/441898419 wait complete. 2024-04-03T08:41:02.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.929+0000 7f04f6c00700 1 -- 172.21.15.157:0/2684264960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 msgr2=0x7f04f00fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.929+0000 7f04f6c00700 1 --2- 172.21.15.157:0/2684264960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f00fd310 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f04e0004940 tx=0x7f04e0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:02.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.930+0000 7f04f6c00700 1 -- 172.21.15.157:0/2684264960 shutdown_connections 2024-04-03T08:41:02.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.930+0000 7f04f6c00700 1 --2- 172.21.15.157:0/2684264960 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f00fe0d0 0x7f04f00fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.930+0000 7f04f6c00700 1 --2- 172.21.15.157:0/2684264960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f00fd310 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.930+0000 7f04f6c00700 1 -- 172.21.15.157:0/2684264960 >> 172.21.15.157:0/2684264960 conn(0x7f04f00f8560 msgr2=0x7f04f00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.931+0000 7f04f6c00700 1 -- 172.21.15.157:0/2684264960 shutdown_connections 2024-04-03T08:41:02.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.931+0000 7f04f6c00700 1 -- 172.21.15.157:0/2684264960 wait complete. 2024-04-03T08:41:02.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.933+0000 7f04f6c00700 1 Processor -- start 2024-04-03T08:41:02.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.933+0000 7f04f6c00700 1 -- start start 2024-04-03T08:41:02.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04f6c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f010fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:02.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04f6c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f00fe0d0 0x7f04f01101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04efe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f010fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04f6c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01107d0 con 0x7f04f00fcee0 2024-04-03T08:41:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04f6c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0110fd0 con 0x7f04f00fe0d0 2024-04-03T08:41:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04efe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f010fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49590/0 (socket says 172.21.15.157:49590) 2024-04-03T08:41:02.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.934+0000 7f04efe00700 1 -- 172.21.15.157:0/1339080920 learned_addr learned my addr 172.21.15.157:0/1339080920 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.935+0000 7f04ef400700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f00fe0d0 0x7f04f01101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.935+0000 7f04efe00700 1 -- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f00fe0d0 msgr2=0x7f04f01101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.935+0000 7f04efe00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f00fe0d0 0x7f04f01101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.935+0000 7f04efe00700 1 -- 172.21.15.157:0/1339080920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04f00fcee0 2024-04-03T08:41:02.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.936+0000 7f04efe00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f010fc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f04e000b970 tx=0x7f04e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.936+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e000e040 con 0x7f04f00fcee0 2024-04-03T08:41:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.936+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04e0004290 con 0x7f04f00fcee0 2024-04-03T08:41:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.936+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e001c3f0 con 0x7f04f00fcee0 2024-04-03T08:41:02.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.936+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f0111250 con 0x7f04f00fcee0 2024-04-03T08:41:02.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.937+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f0111790 con 0x7f04f00fcee0 2024-04-03T08:41:02.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.939+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f005f5f0 con 0x7f04f00fcee0 2024-04-03T08:41:02.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.940+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f04e000bbf0 con 0x7f04f00fcee0 2024-04-03T08:41:02.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.942+0000 7f04e7e00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f04d406b2e0 0x7f04d406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:02.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.942+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f04e008ad80 con 0x7f04f00fcee0 2024-04-03T08:41:02.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.943+0000 7f04ef400700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f04d406b2e0 0x7f04d406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:02.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.944+0000 7f04ef400700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f04d406b2e0 0x7f04d406d790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004f20 tx=0x7f04dc00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:02.960+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f04e0058ae0 con 0x7f04f00fcee0 2024-04-03T08:41:03.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:02 smithi157 ceph-mon[35083]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:03.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:02 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:03.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:02 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:03.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:02 smithi157 ceph-mon[35083]: Reconfiguring prometheus.smithi157 (dependencies changed)... 2024-04-03T08:41:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:02 smithi181 ceph-mon[44183]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:02 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:02 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:02 smithi181 ceph-mon[44183]: Reconfiguring prometheus.smithi157 (dependencies changed)... 2024-04-03T08:41:03.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.428+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f04f0111b00 con 0x7f04f00fcee0 2024-04-03T08:41:03.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.429+0000 7f04e7e00700 1 -- 172.21.15.157:0/1339080920 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f04e0058670 con 0x7f04f00fcee0 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:41:03.430 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:41:03.431 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:03.431 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:41:03.431 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 13, 2024-04-03T08:41:03.431 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:41:03.431 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:41:03.431 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f04d406b2e0 msgr2=0x7f04d406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f04d406b2e0 0x7f04d406d790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004f20 tx=0x7f04dc00b040 comp rx=0 tx=0).stop 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 msgr2=0x7f04f010fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f010fc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f04e000b970 tx=0x7f04e0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 shutdown_connections 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f04d406b2e0 0x7f04d406d790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00fcee0 0x7f04f010fc90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 --2- 172.21.15.157:0/1339080920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04f00fe0d0 0x7f04f01101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 >> 172.21.15.157:0/1339080920 conn(0x7f04f00f8560 msgr2=0x7f04f00f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 shutdown_connections 2024-04-03T08:41:03.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.432+0000 7f04f6c00700 1 -- 172.21.15.157:0/1339080920 wait complete. 2024-04-03T08:41:03.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.609+0000 7feb50c00700 1 -- 172.21.15.157:0/438549412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 msgr2=0x7feb4c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.609+0000 7feb50c00700 1 --2- 172.21.15.157:0/438549412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 0x7feb4c102380 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb38004940 tx=0x7feb38009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.610+0000 7feb50c00700 1 -- 172.21.15.157:0/438549412 shutdown_connections 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.610+0000 7feb50c00700 1 --2- 172.21.15.157:0/438549412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 0x7feb4c102380 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.610+0000 7feb50c00700 1 --2- 172.21.15.157:0/438549412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.610+0000 7feb50c00700 1 -- 172.21.15.157:0/438549412 >> 172.21.15.157:0/438549412 conn(0x7feb4c0f7430 msgr2=0x7feb4c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.610+0000 7feb50c00700 1 -- 172.21.15.157:0/438549412 shutdown_connections 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.610+0000 7feb50c00700 1 -- 172.21.15.157:0/438549412 wait complete. 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.611+0000 7feb50c00700 1 Processor -- start 2024-04-03T08:41:03.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.611+0000 7feb50c00700 1 -- start start 2024-04-03T08:41:03.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.611+0000 7feb50c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:03.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.611+0000 7feb50c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 0x7feb4c110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:03.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb50c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c110870 con 0x7feb4c0fffa0 2024-04-03T08:41:03.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb50c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c110fb0 con 0x7feb4c066240 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb49e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb49e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c10fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:50926/0 (socket says 172.21.15.157:50926) 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb49e00700 1 -- 172.21.15.157:0/2141249622 learned_addr learned my addr 172.21.15.157:0/2141249622 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb49e00700 1 -- 172.21.15.157:0/2141249622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 msgr2=0x7feb4c110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb49e00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 0x7feb4c110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.612+0000 7feb49e00700 1 -- 172.21.15.157:0/2141249622 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38005040 con 0x7feb4c066240 2024-04-03T08:41:03.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.613+0000 7feb49e00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c10fd30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb3c002a80 tx=0x7feb3c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:03.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.613+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3c007cc0 con 0x7feb4c066240 2024-04-03T08:41:03.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.613+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c111290 con 0x7feb4c066240 2024-04-03T08:41:03.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.613+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb3c00f040 con 0x7feb4c066240 2024-04-03T08:41:03.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.613+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3c00dad0 con 0x7feb4c066240 2024-04-03T08:41:03.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.613+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c111850 con 0x7feb4c066240 2024-04-03T08:41:03.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.615+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c05f5f0 con 0x7feb4c066240 2024-04-03T08:41:03.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.616+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7feb3c00dc30 con 0x7feb4c066240 2024-04-03T08:41:03.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.617+0000 7feb42000700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7feb3006b2a0 0x7feb3006d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:03.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.617+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7feb3c089940 con 0x7feb4c066240 2024-04-03T08:41:03.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.617+0000 7feb49400700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7feb3006b2a0 0x7feb3006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:03.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.618+0000 7feb49400700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7feb3006b2a0 0x7feb3006d750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feb38004f90 tx=0x7feb38009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:03.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:03.623+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7feb3c057620 con 0x7feb4c066240 2024-04-03T08:41:04.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.065+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feb4c111bd0 con 0x7feb4c066240 2024-04-03T08:41:04.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.066+0000 7feb42000700 1 -- 172.21.15.157:0/2141249622 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7feb3c0571b0 con 0x7feb4c066240 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:41:04.068 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:41:04.069 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:41:04.070 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:04.071 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:04.071 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:04.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7feb3006b2a0 msgr2=0x7feb3006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7feb3006b2a0 0x7feb3006d750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feb38004f90 tx=0x7feb38009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 msgr2=0x7feb4c10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c10fd30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb3c002a80 tx=0x7feb3c004600 comp rx=0 tx=0).stop 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 shutdown_connections 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7feb3006b2a0 0x7feb3006d750 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb4c066240 0x7feb4c10fd30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 --2- 172.21.15.157:0/2141249622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb4c0fffa0 0x7feb4c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 >> 172.21.15.157:0/2141249622 conn(0x7feb4c0f7430 msgr2=0x7feb4c0fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 shutdown_connections 2024-04-03T08:41:04.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.070+0000 7feb50c00700 1 -- 172.21.15.157:0/2141249622 wait complete. 2024-04-03T08:41:04.073 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:41:04.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:03 smithi181 ceph-mon[44183]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:04.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:03 smithi181 ceph-mon[44183]: Reconfiguring daemon prometheus.smithi157 on smithi157 2024-04-03T08:41:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:03 smithi181 ceph-mon[44183]: from='client.24609 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:03 smithi181 ceph-mon[44183]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 830 KiB/s rd, 843 KiB/s wr, 277 op/s 2024-04-03T08:41:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:03 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1339080920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.249+0000 7f72d6800700 1 -- 172.21.15.157:0/584042814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 msgr2=0x7f72d00fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.249+0000 7f72d6800700 1 --2- 172.21.15.157:0/584042814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 0x7f72d00fe460 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72bc004940 tx=0x7f72bc009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.250+0000 7f72d6800700 1 -- 172.21.15.157:0/584042814 shutdown_connections 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.250+0000 7f72d6800700 1 --2- 172.21.15.157:0/584042814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 0x7f72d00fe460 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.250+0000 7f72d6800700 1 --2- 172.21.15.157:0/584042814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d00fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.250+0000 7f72d6800700 1 -- 172.21.15.157:0/584042814 >> 172.21.15.157:0/584042814 conn(0x7f72d00f8560 msgr2=0x7f72d00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.250+0000 7f72d6800700 1 -- 172.21.15.157:0/584042814 shutdown_connections 2024-04-03T08:41:04.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.250+0000 7f72d6800700 1 -- 172.21.15.157:0/584042814 wait complete. 2024-04-03T08:41:04.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.251+0000 7f72d6800700 1 Processor -- start 2024-04-03T08:41:04.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.251+0000 7f72d6800700 1 -- start start 2024-04-03T08:41:04.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72d6800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:04.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72d6800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 0x7f72d0110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:04.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72d6800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d0110750 con 0x7f72d00fdff0 2024-04-03T08:41:04.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72d6800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d0110fa0 con 0x7f72d00fce80 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72cf400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72cf400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d010fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:50954/0 (socket says 172.21.15.157:50954) 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.252+0000 7f72cf400700 1 -- 172.21.15.157:0/3477281336 learned_addr learned my addr 172.21.15.157:0/3477281336 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.253+0000 7f72cea00700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 0x7f72d0110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.253+0000 7f72cf400700 1 -- 172.21.15.157:0/3477281336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 msgr2=0x7f72d0110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.253+0000 7f72cf400700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 0x7f72d0110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.253+0000 7f72cf400700 1 -- 172.21.15.157:0/3477281336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc005040 con 0x7f72d00fce80 2024-04-03T08:41:04.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.253+0000 7f72cf400700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d010fc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c8c0 tx=0x7f72c00044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:04.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.253+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72c000a760 con 0x7f72d00fce80 2024-04-03T08:41:04.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.254+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d0111280 con 0x7f72d00fce80 2024-04-03T08:41:04.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.254+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72c000ad90 con 0x7f72d00fce80 2024-04-03T08:41:04.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.254+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72c00113a0 con 0x7f72d00fce80 2024-04-03T08:41:04.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.254+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d01117c0 con 0x7f72d00fce80 2024-04-03T08:41:04.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.255+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d005f5f0 con 0x7f72d00fce80 2024-04-03T08:41:04.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.256+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f72c0012400 con 0x7f72d00fce80 2024-04-03T08:41:04.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.257+0000 7f72c7400700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f72b406b1d0 0x7f72b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:04.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.257+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f72c0089c00 con 0x7f72d00fce80 2024-04-03T08:41:04.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.257+0000 7f72cea00700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f72b406b1d0 0x7f72b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:04.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.258+0000 7f72cea00700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f72b406b1d0 0x7f72b406d680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009fd0 tx=0x7f72bc009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:04.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.261+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f72c00578e0 con 0x7f72d00fce80 2024-04-03T08:41:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:03 smithi157 ceph-mon[35083]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:03 smithi157 ceph-mon[35083]: Reconfiguring daemon prometheus.smithi157 on smithi157 2024-04-03T08:41:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:03 smithi157 ceph-mon[35083]: from='client.24609 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:03 smithi157 ceph-mon[35083]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 830 KiB/s rd, 843 KiB/s wr, 277 op/s 2024-04-03T08:41:04.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:03 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1339080920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:41:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.550+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72d0111ab0 con 0x7f72b406b1d0 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.551+0000 7f72c7400700 1 -- 172.21.15.157:0/3477281336 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f72d0111ab0 con 0x7f72b406b1d0 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "1/21 daemons upgraded", 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:41:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:41:04.554 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:41:04.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f72b406b1d0 msgr2=0x7f72b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f72b406b1d0 0x7f72b406d680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009fd0 tx=0x7f72bc009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 msgr2=0x7f72d010fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d010fc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c8c0 tx=0x7f72c00044c0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 shutdown_connections 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f72b406b1d0 0x7f72b406d680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72d00fce80 0x7f72d010fc10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 --2- 172.21.15.157:0/3477281336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d00fdff0 0x7f72d0110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.554+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 >> 172.21.15.157:0/3477281336 conn(0x7f72d00f8560 msgr2=0x7f72d00f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:04.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.555+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 shutdown_connections 2024-04-03T08:41:04.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.555+0000 7f72d6800700 1 -- 172.21.15.157:0/3477281336 wait complete. 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 -- 172.21.15.157:0/2475742120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fcc10 msgr2=0x7f06b80fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 --2- 172.21.15.157:0/2475742120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fcc10 0x7f06b80fd020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06a8004940 tx=0x7f06a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 -- 172.21.15.157:0/2475742120 shutdown_connections 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 --2- 172.21.15.157:0/2475742120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdec0 0x7f06b80fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 --2- 172.21.15.157:0/2475742120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fcc10 0x7f06b80fd020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 -- 172.21.15.157:0/2475742120 >> 172.21.15.157:0/2475742120 conn(0x7f06b80f83d0 msgr2=0x7f06b80fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:04.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 -- 172.21.15.157:0/2475742120 shutdown_connections 2024-04-03T08:41:04.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.745+0000 7f06bd200700 1 -- 172.21.15.157:0/2475742120 wait complete. 2024-04-03T08:41:04.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.746+0000 7f06bd200700 1 Processor -- start 2024-04-03T08:41:04.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.746+0000 7f06bd200700 1 -- start start 2024-04-03T08:41:04.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06bd200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fcc10 0x7f06b8113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:04.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06bd200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdec0 0x7f06b8114380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:04.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06bd200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8114980 con 0x7f06b80fcc10 2024-04-03T08:41:04.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06bd200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8115110 con 0x7f06b80fdec0 2024-04-03T08:41:04.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06b7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fcc10 0x7f06b8113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:04.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06b6a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdec0 0x7f06b8114380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:04.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06b7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fcc10 0x7f06b8113e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49636/0 (socket says 172.21.15.157:49636) 2024-04-03T08:41:04.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.747+0000 7f06b7400700 1 -- 172.21.15.157:0/3695352682 learned_addr learned my addr 172.21.15.157:0/3695352682 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:04.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06b6a00700 1 -- 172.21.15.157:0/3695352682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fcc10 msgr2=0x7f06b8113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06b6a00700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fcc10 0x7f06b8113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06b6a00700 1 -- 172.21.15.157:0/3695352682 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8005040 con 0x7f06b80fdec0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06b6a00700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdec0 0x7f06b8114380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009fd0 tx=0x7f06a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a4004e90 con 0x7f06b80fdec0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06a400f040 con 0x7f06b80fdec0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.748+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a400ca50 con 0x7f06b80fdec0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.749+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b8115360 con 0x7f06b80fdec0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.749+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b8115920 con 0x7f06b80fdec0 2024-04-03T08:41:04.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.750+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b8101850 con 0x7f06b80fdec0 2024-04-03T08:41:04.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.751+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f06a4007cc0 con 0x7f06b80fdec0 2024-04-03T08:41:04.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.752+0000 7f06af400700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f069c06b2a0 0x7f069c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:04.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.752+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f06a40895a0 con 0x7f06b80fdec0 2024-04-03T08:41:04.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.752+0000 7f06b7400700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f069c06b2a0 0x7f069c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:04.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.753+0000 7f06b7400700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f069c06b2a0 0x7f069c06d750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06a80136a0 tx=0x7f06a8009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:04.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:04.756+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f06a404f620 con 0x7f06b80fdec0 2024-04-03T08:41:05.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:04 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2141249622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:41:05.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.240+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f06b804bed0 con 0x7f06b80fdec0 2024-04-03T08:41:05.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.240+0000 7f06af400700 1 -- 172.21.15.157:0/3695352682 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f06a4057330 con 0x7f06b80fdec0 2024-04-03T08:41:05.242 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f069c06b2a0 msgr2=0x7f069c06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f069c06b2a0 0x7f069c06d750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06a80136a0 tx=0x7f06a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdec0 msgr2=0x7f06b8114380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdec0 0x7f06b8114380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009fd0 tx=0x7f06a400b040 comp rx=0 tx=0).stop 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 shutdown_connections 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f069c06b2a0 0x7f069c06d750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fcc10 0x7f06b8113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 --2- 172.21.15.157:0/3695352682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdec0 0x7f06b8114380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 >> 172.21.15.157:0/3695352682 conn(0x7f06b80f83d0 msgr2=0x7f06b80f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 shutdown_connections 2024-04-03T08:41:05.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:05.244+0000 7f06bd200700 1 -- 172.21.15.157:0/3695352682 wait complete. 2024-04-03T08:41:05.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:04 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2141249622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:41:06.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:05 smithi181 ceph-mon[44183]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:06.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:05 smithi181 ceph-mon[44183]: pgmap v59: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-04-03T08:41:06.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:05 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/3695352682' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:41:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:05 smithi157 ceph-mon[35083]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:05 smithi157 ceph-mon[35083]: pgmap v59: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-04-03T08:41:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:05 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/3695352682' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:41:07.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:06 smithi181 ceph-mon[44183]: pgmap v60: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 858 KiB/s rd, 971 KiB/s wr, 259 op/s 2024-04-03T08:41:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:06 smithi157 ceph-mon[35083]: pgmap v60: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 858 KiB/s rd, 971 KiB/s wr, 259 op/s 2024-04-03T08:41:09.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:08 smithi157 ceph-mon[35083]: pgmap v61: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 858 KiB/s rd, 971 KiB/s wr, 259 op/s 2024-04-03T08:41:09.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:08 smithi181 ceph-mon[44183]: pgmap v61: 65 pgs: 65 active+clean; 248 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 858 KiB/s rd, 971 KiB/s wr, 259 op/s 2024-04-03T08:41:11.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:10 smithi157 ceph-mon[35083]: pgmap v62: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 381 op/s 2024-04-03T08:41:11.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:10 smithi181 ceph-mon[44183]: pgmap v62: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 381 op/s 2024-04-03T08:41:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:12 smithi157 ceph-mon[35083]: pgmap v63: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 957 KiB/s rd, 943 KiB/s wr, 245 op/s 2024-04-03T08:41:13.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:12 smithi181 ceph-mon[44183]: pgmap v63: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 957 KiB/s rd, 943 KiB/s wr, 245 op/s 2024-04-03T08:41:14.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:13 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:14.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:13 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:14 smithi157 ceph-mon[35083]: pgmap v64: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-04-03T08:41:15.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:14 smithi181 ceph-mon[44183]: pgmap v64: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-04-03T08:41:17.176 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:16 smithi181 ceph-mon[44183]: pgmap v65: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 939 KiB/s rd, 919 KiB/s wr, 255 op/s 2024-04-03T08:41:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:16 smithi157 ceph-mon[35083]: pgmap v65: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 939 KiB/s rd, 919 KiB/s wr, 255 op/s 2024-04-03T08:41:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:18 smithi157 ceph-mon[35083]: pgmap v66: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 939 KiB/s rd, 919 KiB/s wr, 255 op/s 2024-04-03T08:41:19.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:18 smithi181 ceph-mon[44183]: pgmap v66: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 939 KiB/s rd, 919 KiB/s wr, 255 op/s 2024-04-03T08:41:20.706 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-03T08:41:20.706 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-03T08:41:21.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:20 smithi157 ceph-mon[35083]: pgmap v67: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 391 op/s 2024-04-03T08:41:21.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:20 smithi181 ceph-mon[44183]: pgmap v67: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 391 op/s 2024-04-03T08:41:22.483 DEBUG:teuthology.parallel:result is None 2024-04-03T08:41:23.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:22 smithi157 ceph-mon[35083]: pgmap v68: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 786 KiB/s rd, 926 KiB/s wr, 269 op/s 2024-04-03T08:41:23.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:22 smithi181 ceph-mon[44183]: pgmap v68: 65 pgs: 65 active+clean; 224 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 786 KiB/s rd, 926 KiB/s wr, 269 op/s 2024-04-03T08:41:24.458 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-03T08:41:24.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-03T08:41:25.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:24 smithi157 ceph-mon[35083]: pgmap v69: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2024-04-03T08:41:25.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:24 smithi181 ceph-mon[44183]: pgmap v69: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2024-04-03T08:41:25.520 DEBUG:teuthology.parallel:result is None 2024-04-03T08:41:25.520 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T08:41:25.615 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T08:41:25.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-03T08:41:25.697 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-03T08:41:25.697 DEBUG:teuthology.parallel:result is None 2024-04-03T08:41:27.103 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:26 smithi157 ceph-mon[35083]: pgmap v70: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 914 KiB/s rd, 922 KiB/s wr, 266 op/s 2024-04-03T08:41:27.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:26 smithi181 ceph-mon[44183]: pgmap v70: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 914 KiB/s rd, 922 KiB/s wr, 266 op/s 2024-04-03T08:41:28.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:28 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:28.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:28 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:29 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:29 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:29 smithi157 ceph-mon[35083]: Reconfiguring node-exporter.smithi181 (dependencies changed)... 2024-04-03T08:41:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:29 smithi157 ceph-mon[35083]: Reconfiguring daemon node-exporter.smithi181 on smithi181 2024-04-03T08:41:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:29 smithi157 ceph-mon[35083]: pgmap v71: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 914 KiB/s rd, 922 KiB/s wr, 266 op/s 2024-04-03T08:41:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:29 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:29 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:29 smithi181 ceph-mon[44183]: Reconfiguring node-exporter.smithi181 (dependencies changed)... 2024-04-03T08:41:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:29 smithi181 ceph-mon[44183]: Reconfiguring daemon node-exporter.smithi181 on smithi181 2024-04-03T08:41:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:29 smithi181 ceph-mon[44183]: pgmap v71: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 914 KiB/s rd, 922 KiB/s wr, 266 op/s 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: Upgrade: Need to upgrade myself (mgr.smithi181.mfhidq) 2024-04-03T08:41:31.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: Upgrade: Need to upgrade myself (mgr.smithi181.mfhidq) 2024-04-03T08:41:31.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:31 smithi157 ceph-mon[35083]: pgmap v72: 65 pgs: 65 active+clean; 207 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 943 KiB/s rd, 951 KiB/s wr, 313 op/s 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:41:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:32.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: Upgrade: Need to upgrade myself (mgr.smithi181.mfhidq) 2024-04-03T08:41:32.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: Upgrade: Need to upgrade myself (mgr.smithi181.mfhidq) 2024-04-03T08:41:32.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:31 smithi181 ceph-mon[44183]: pgmap v72: 65 pgs: 65 active+clean; 207 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 943 KiB/s rd, 951 KiB/s wr, 313 op/s 2024-04-03T08:41:33.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: Upgrade: Updating mgr.smithi157.qfvynr 2024-04-03T08:41:33.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:33.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:41:33.843 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:41:33.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:41:33.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:41:33.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: Deploying daemon mgr.smithi157.qfvynr on smithi157 2024-04-03T08:41:33.844 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:33 smithi157 ceph-mon[35083]: pgmap v73: 65 pgs: 65 active+clean; 207 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 551 KiB/s rd, 465 KiB/s wr, 178 op/s 2024-04-03T08:41:33.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: Upgrade: Updating mgr.smithi157.qfvynr 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: Deploying daemon mgr.smithi157.qfvynr on smithi157 2024-04-03T08:41:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:33 smithi181 ceph-mon[44183]: pgmap v73: 65 pgs: 65 active+clean; 207 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 551 KiB/s rd, 465 KiB/s wr, 178 op/s 2024-04-03T08:41:35.183 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:34 smithi181 ceph-mon[44183]: pgmap v74: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 551 KiB/s rd, 466 KiB/s wr, 180 op/s 2024-04-03T08:41:35.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:34 smithi157 ceph-mon[35083]: pgmap v74: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 551 KiB/s rd, 466 KiB/s wr, 180 op/s 2024-04-03T08:41:35.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 -- 172.21.15.157:0/800740745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 msgr2=0x7f32e00fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 --2- 172.21.15.157:0/800740745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e00fe540 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f32cc004940 tx=0x7f32cc009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 -- 172.21.15.157:0/800740745 shutdown_connections 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 --2- 172.21.15.157:0/800740745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e00fe540 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 --2- 172.21.15.157:0/800740745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e00fcee0 0x7f32e00fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 -- 172.21.15.157:0/800740745 >> 172.21.15.157:0/800740745 conn(0x7f32e00f8560 msgr2=0x7f32e00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 -- 172.21.15.157:0/800740745 shutdown_connections 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.402+0000 7f32e7000700 1 -- 172.21.15.157:0/800740745 wait complete. 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.403+0000 7f32e7000700 1 Processor -- start 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.403+0000 7f32e7000700 1 -- start start 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.403+0000 7f32e7000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e00fcee0 0x7f32e010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.403+0000 7f32e7000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e010e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.403+0000 7f32e7000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e010e600 con 0x7f32e00fe0d0 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.403+0000 7f32e7000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e010ede0 con 0x7f32e00fcee0 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e010e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e010e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:32912/0 (socket says 172.21.15.157:32912) 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 -- 172.21.15.157:0/90068547 learned_addr learned my addr 172.21.15.157:0/90068547 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32dfe00700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e00fcee0 0x7f32e010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 -- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e00fcee0 msgr2=0x7f32e010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e00fcee0 0x7f32e010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 -- 172.21.15.157:0/90068547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc005040 con 0x7f32e00fe0d0 2024-04-03T08:41:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32df400700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e010e000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009150 tx=0x7f32cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc00e040 con 0x7f32e00fe0d0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32cc00bbf0 con 0x7f32e00fe0d0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.404+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e010f060 con 0x7f32e00fe0d0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.405+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc01c630 con 0x7f32e00fe0d0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.405+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e010f5a0 con 0x7f32e00fe0d0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.406+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e005f5f0 con 0x7f32e00fe0d0 2024-04-03T08:41:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.407+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f32cc00bd60 con 0x7f32e00fe0d0 2024-04-03T08:41:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.408+0000 7f32d7e00700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f32c406b1d0 0x7f32c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.408+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f32cc08af90 con 0x7f32e00fe0d0 2024-04-03T08:41:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.408+0000 7f32dfe00700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f32c406b1d0 0x7f32c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:35.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.409+0000 7f32dfe00700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f32c406b1d0 0x7f32c406d680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32d0007fd0 tx=0x7f32d0009040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:35.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.412+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f32cc0be620 con 0x7f32e00fe0d0 2024-04-03T08:41:35.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.639+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32e010f880 con 0x7f32c406b1d0 2024-04-03T08:41:35.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.641+0000 7f32d7e00700 1 -- 172.21.15.157:0/90068547 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f32e010f880 con 0x7f32c406b1d0 2024-04-03T08:41:35.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f32c406b1d0 msgr2=0x7f32c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:35.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f32c406b1d0 0x7f32c406d680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32d0007fd0 tx=0x7f32d0009040 comp rx=0 tx=0).stop 2024-04-03T08:41:35.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 msgr2=0x7f32e010e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:35.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e010e000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009150 tx=0x7f32cc009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:35.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 shutdown_connections 2024-04-03T08:41:35.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f32c406b1d0 0x7f32c406d680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e00fcee0 0x7f32e010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 --2- 172.21.15.157:0/90068547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e00fe0d0 0x7f32e010e000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.643+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 >> 172.21.15.157:0/90068547 conn(0x7f32e00f8560 msgr2=0x7f32e00f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.644+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 shutdown_connections 2024-04-03T08:41:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.644+0000 7f32e7000700 1 -- 172.21.15.157:0/90068547 wait complete. 2024-04-03T08:41:35.659 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:41:35.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 -- 172.21.15.157:0/3973755735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 msgr2=0x7f6614070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:35.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 --2- 172.21.15.157:0/3973755735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614070e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6600004940 tx=0x7f6600009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:35.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 -- 172.21.15.157:0/3973755735 shutdown_connections 2024-04-03T08:41:35.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 --2- 172.21.15.157:0/3973755735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614070e10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 --2- 172.21.15.157:0/3973755735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6614071f50 0x7f6614070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 -- 172.21.15.157:0/3973755735 >> 172.21.15.157:0/3973755735 conn(0x7f66140f84e0 msgr2=0x7f66140fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:35.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 -- 172.21.15.157:0/3973755735 shutdown_connections 2024-04-03T08:41:35.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.781+0000 7f661a000700 1 -- 172.21.15.157:0/3973755735 wait complete. 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.782+0000 7f661a000700 1 Processor -- start 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.783+0000 7f661a000700 1 -- start start 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.783+0000 7f661a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.783+0000 7f661a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6614071f50 0x7f6614114420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.783+0000 7f661a000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614114a20 con 0x7f66140709a0 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.783+0000 7f661a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614115270 con 0x7f6614071f50 2024-04-03T08:41:35.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:35.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:32924/0 (socket says 172.21.15.157:32924) 2024-04-03T08:41:35.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 -- 172.21.15.157:0/386115039 learned_addr learned my addr 172.21.15.157:0/386115039 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:35.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6612a00700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6614071f50 0x7f6614114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 -- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6614071f50 msgr2=0x7f6614114420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6614071f50 0x7f6614114420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 -- 172.21.15.157:0/386115039 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600005040 con 0x7f66140709a0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.784+0000 7f6613400700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614113ee0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f660400eb70 tx=0x7f660400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.785+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6604007cc0 con 0x7f66140709a0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.785+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f660400f040 con 0x7f66140709a0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.785+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66141154f0 con 0x7f66140709a0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.785+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660400cb20 con 0x7f66140709a0 2024-04-03T08:41:35.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.785+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6614115a30 con 0x7f66140709a0 2024-04-03T08:41:35.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.787+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661405f5f0 con 0x7f66140709a0 2024-04-03T08:41:35.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.787+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f660400cc80 con 0x7f66140709a0 2024-04-03T08:41:35.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.788+0000 7f660b400700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f65f806b1d0 0x7f65f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:35.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.788+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6604089580 con 0x7f66140709a0 2024-04-03T08:41:35.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.788+0000 7f6612a00700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f65f806b1d0 0x7f65f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:35.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.789+0000 7f6612a00700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f65f806b1d0 0x7f65f806d680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f660000b0d0 tx=0x7f6600009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:35.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:35.796+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f660404f620 con 0x7f66140709a0 2024-04-03T08:41:36.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.063+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6614115d10 con 0x7f65f806b1d0 2024-04-03T08:41:36.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:35 smithi157 ceph-mon[35083]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:36.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.066+0000 7f660b400700 1 -- 172.21.15.157:0/386115039 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f6614115d10 con 0x7f65f806b1d0 2024-04-03T08:41:36.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f65f806b1d0 msgr2=0x7f65f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f65f806b1d0 0x7f65f806d680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f660000b0d0 tx=0x7f6600009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:36.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 msgr2=0x7f6614113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614113ee0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f660400eb70 tx=0x7f660400b040 comp rx=0 tx=0).stop 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 shutdown_connections 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f65f806b1d0 0x7f65f806d680 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66140709a0 0x7f6614113ee0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 --2- 172.21.15.157:0/386115039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6614071f50 0x7f6614114420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.069+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 >> 172.21.15.157:0/386115039 conn(0x7f66140f84e0 msgr2=0x7f66140f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.070+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 shutdown_connections 2024-04-03T08:41:36.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.070+0000 7f661a000700 1 -- 172.21.15.157:0/386115039 wait complete. 2024-04-03T08:41:36.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 -- 172.21.15.157:0/2360922100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 msgr2=0x7f07b00fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 --2- 172.21.15.157:0/2360922100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fd230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f079c004940 tx=0x7f079c009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:36.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 -- 172.21.15.157:0/2360922100 shutdown_connections 2024-04-03T08:41:36.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 --2- 172.21.15.157:0/2360922100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fd230 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 --2- 172.21.15.157:0/2360922100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 0x7f07b00fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 -- 172.21.15.157:0/2360922100 >> 172.21.15.157:0/2360922100 conn(0x7f07b00f7270 msgr2=0x7f07b00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:36.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 -- 172.21.15.157:0/2360922100 shutdown_connections 2024-04-03T08:41:36.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.213+0000 7f07b4a00700 1 -- 172.21.15.157:0/2360922100 wait complete. 2024-04-03T08:41:36.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.214+0000 7f07b4a00700 1 Processor -- start 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.214+0000 7f07b4a00700 1 -- start start 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07b4a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 0x7f07b00ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07b4a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07b4a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00fe6b0 con 0x7f07b00fcdc0 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07b4a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00fe820 con 0x7f07b00fbb10 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07ade00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07ade00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fe100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:32942/0 (socket says 172.21.15.157:32942) 2024-04-03T08:41:36.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07ade00700 1 -- 172.21.15.157:0/1008028721 learned_addr learned my addr 172.21.15.157:0/1008028721 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07ae800700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 0x7f07b00ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07ade00700 1 -- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 msgr2=0x7f07b00ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.215+0000 7f07ade00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 0x7f07b00ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07ade00700 1 -- 172.21.15.157:0/1008028721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c005040 con 0x7f07b00fcdc0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07ae800700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 0x7f07b00ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07ade00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fe100 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f079c00b3b0 tx=0x7f079c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079c00e040 con 0x7f07b00fcdc0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f079c004290 con 0x7f07b00fcdc0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00feaa0 con 0x7f07b00fcdc0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079c01c630 con 0x7f07b00fcdc0 2024-04-03T08:41:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.216+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b01158e0 con 0x7f07b00fcdc0 2024-04-03T08:41:36.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.217+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b0101950 con 0x7f07b00fcdc0 2024-04-03T08:41:36.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.219+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f079c00bbf0 con 0x7f07b00fcdc0 2024-04-03T08:41:36.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.219+0000 7f07a6a00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f079406b1d0 0x7f079406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:36.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.220+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f079c08bb50 con 0x7f07b00fcdc0 2024-04-03T08:41:36.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.220+0000 7f07ae800700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f079406b1d0 0x7f079406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:36.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.221+0000 7f07ae800700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f079406b1d0 0x7f079406d680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009fd0 tx=0x7f07a0009f00 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:36.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.227+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f079c055d80 con 0x7f07b00fcdc0 2024-04-03T08:41:36.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:35 smithi181 ceph-mon[44183]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:36.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.452+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07b01047b0 con 0x7f079406b1d0 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.464+0000 7f07a6a00700 1 -- 172.21.15.157:0/1008028721 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f07a0009970 con 0x7f079406b1d0 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 starting - - - - 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (12m) 114s ago 12m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (10m) 2m ago 10m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 starting - - - - 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (5m) 114s ago 5m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (5m) 114s ago 5m 195M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (5m) 2m ago 5m 12.0M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:41:36.465 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (5m) 2m ago 5m 118M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:9283 running (13m) 114s ago 13m 330M - 17.2.7-805-g6fda41ff a49113eacc58 ee821dd50a8b 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (2m) 2m ago 10m 487M - 19.0.0-1670-g1fb5d106 c318aa90b546 b4f1b4d00cca 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (13m) 114s ago 13m 49.6M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (10m) 2m ago 10m 40.0M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 starting - - - - 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 starting - - - - 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (9m) 114s ago 9m 208M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (9m) 114s ago 9m 210M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (8m) 114s ago 8m 178M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:41:36.466 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (8m) 2m ago 8m 254M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:41:36.467 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (7m) 2m ago 7m 215M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:41:36.467 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (7m) 2m ago 7m 242M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:41:36.467 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 starting - - - - 2024-04-03T08:41:36.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f079406b1d0 msgr2=0x7f079406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f079406b1d0 0x7f079406d680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009fd0 tx=0x7f07a0009f00 comp rx=0 tx=0).stop 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 msgr2=0x7f07b00fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fe100 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f079c00b3b0 tx=0x7f079c009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 shutdown_connections 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f079406b1d0 0x7f079406d680 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07b00fbb10 0x7f07b00ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 --2- 172.21.15.157:0/1008028721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07b00fcdc0 0x7f07b00fe100 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 >> 172.21.15.157:0/1008028721 conn(0x7f07b00f7270 msgr2=0x7f07b0065c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 shutdown_connections 2024-04-03T08:41:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.467+0000 7f07b4a00700 1 -- 172.21.15.157:0/1008028721 wait complete. 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 -- 172.21.15.157:0/514248663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fcee0 msgr2=0x7f697c0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 --2- 172.21.15.157:0/514248663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fcee0 0x7f697c0fd310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f696c004940 tx=0x7f696c009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 -- 172.21.15.157:0/514248663 shutdown_connections 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 --2- 172.21.15.157:0/514248663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f697c0fe0d0 0x7f697c0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 --2- 172.21.15.157:0/514248663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fcee0 0x7f697c0fd310 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 -- 172.21.15.157:0/514248663 >> 172.21.15.157:0/514248663 conn(0x7f697c0f8560 msgr2=0x7f697c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 -- 172.21.15.157:0/514248663 shutdown_connections 2024-04-03T08:41:36.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.610+0000 7f6980e00700 1 -- 172.21.15.157:0/514248663 wait complete. 2024-04-03T08:41:36.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.611+0000 7f6980e00700 1 Processor -- start 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.611+0000 7f6980e00700 1 -- start start 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.611+0000 7f6980e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f697c0fcee0 0x7f697c10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.611+0000 7f6980e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 0x7f697c110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.611+0000 7f6980e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c110720 con 0x7f697c0fe0d0 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.611+0000 7f6980e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c110f70 con 0x7f697c0fcee0 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 0x7f697c110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 0x7f697c110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:32956/0 (socket says 172.21.15.157:32956) 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 -- 172.21.15.157:0/249120030 learned_addr learned my addr 172.21.15.157:0/249120030 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f697c0fcee0 0x7f697c10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 -- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f697c0fcee0 msgr2=0x7f697c10fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f697c0fcee0 0x7f697c10fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 -- 172.21.15.157:0/249120030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c005040 con 0x7f697c0fe0d0 2024-04-03T08:41:36.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6979400700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 0x7f697c110120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6968002a80 tx=0x7f69680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:36.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.612+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6968007cc0 con 0x7f697c0fe0d0 2024-04-03T08:41:36.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.613+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f696800f040 con 0x7f697c0fe0d0 2024-04-03T08:41:36.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.613+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696800dac0 con 0x7f697c0fe0d0 2024-04-03T08:41:36.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.613+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c111250 con 0x7f697c0fe0d0 2024-04-03T08:41:36.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.613+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c111790 con 0x7f697c0fe0d0 2024-04-03T08:41:36.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.614+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c101a60 con 0x7f697c0fe0d0 2024-04-03T08:41:36.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.615+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f696800dc20 con 0x7f697c0fe0d0 2024-04-03T08:41:36.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.616+0000 7f6972000700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f696006b1d0 0x7f696006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:36.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.616+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6968089770 con 0x7f697c0fe0d0 2024-04-03T08:41:36.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.616+0000 7f6979e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f696006b1d0 0x7f696006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:36.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.617+0000 7f6979e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f696006b1d0 0x7f696006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f696c00b3b0 tx=0x7f696c009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:36.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.620+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6968057450 con 0x7f697c0fe0d0 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.954+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f697c05f5f0 con 0x7f697c0fe0d0 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.954+0000 7f6972000700 1 -- 172.21.15.157:0/249120030 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f6968056fe0 con 0x7f697c0fe0d0 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:36.955 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 13, 2024-04-03T08:41:36.956 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:41:36.957 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:41:36.957 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:41:36.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f696006b1d0 msgr2=0x7f696006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f696006b1d0 0x7f696006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f696c00b3b0 tx=0x7f696c009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 msgr2=0x7f697c110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 0x7f697c110120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6968002a80 tx=0x7f69680046b0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 shutdown_connections 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f696006b1d0 0x7f696006d680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f697c0fcee0 0x7f697c10fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 --2- 172.21.15.157:0/249120030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f697c0fe0d0 0x7f697c110120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 >> 172.21.15.157:0/249120030 conn(0x7f697c0f8560 msgr2=0x7f697c0f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 shutdown_connections 2024-04-03T08:41:36.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:36.957+0000 7f6980e00700 1 -- 172.21.15.157:0/249120030 wait complete. 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 -- 172.21.15.157:0/3595901405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e40709a0 msgr2=0x7f39e4070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 --2- 172.21.15.157:0/3595901405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e40709a0 0x7f39e4070e10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004940 tx=0x7f39d0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 -- 172.21.15.157:0/3595901405 shutdown_connections 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 --2- 172.21.15.157:0/3595901405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e40709a0 0x7f39e4070e10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 --2- 172.21.15.157:0/3595901405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39e4071f50 0x7f39e4070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 -- 172.21.15.157:0/3595901405 >> 172.21.15.157:0/3595901405 conn(0x7f39e40f8560 msgr2=0x7f39e40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 -- 172.21.15.157:0/3595901405 shutdown_connections 2024-04-03T08:41:37.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.100+0000 7f39ebe00700 1 -- 172.21.15.157:0/3595901405 wait complete. 2024-04-03T08:41:37.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.101+0000 7f39ebe00700 1 Processor -- start 2024-04-03T08:41:37.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.101+0000 7f39ebe00700 1 -- start start 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39ebe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39e40709a0 0x7f39e4113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39ebe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 0x7f39e41144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39ebe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4114ab0 con 0x7f39e4071f50 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39ebe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4115300 con 0x7f39e40709a0 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39e8a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 0x7f39e41144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39e8a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 0x7f39e41144b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:32984/0 (socket says 172.21.15.157:32984) 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39e8a00700 1 -- 172.21.15.157:0/848125315 learned_addr learned my addr 172.21.15.157:0/848125315 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.102+0000 7f39e9400700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39e40709a0 0x7f39e4113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:37.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e8a00700 1 -- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39e40709a0 msgr2=0x7f39e4113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e8a00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39e40709a0 0x7f39e4113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e8a00700 1 -- 172.21.15.157:0/848125315 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0005040 con 0x7f39e4071f50 2024-04-03T08:41:37.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e8a00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 0x7f39e41144b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f39d000b3b0 tx=0x7f39d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:37.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39d000e040 con 0x7f39e4071f50 2024-04-03T08:41:37.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39d0004290 con 0x7f39e4071f50 2024-04-03T08:41:37.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e4115580 con 0x7f39e4071f50 2024-04-03T08:41:37.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39d001c3f0 con 0x7f39e4071f50 2024-04-03T08:41:37.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.103+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e4115ac0 con 0x7f39e4071f50 2024-04-03T08:41:37.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.105+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e405f5f0 con 0x7f39e4071f50 2024-04-03T08:41:37.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.106+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f39d000bbf0 con 0x7f39e4071f50 2024-04-03T08:41:37.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.106+0000 7f39e1600700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f39cc06b1d0 0x7f39cc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:37.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.107+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f39d008ae80 con 0x7f39e4071f50 2024-04-03T08:41:37.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.107+0000 7f39e9400700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f39cc06b1d0 0x7f39cc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:37.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.108+0000 7f39e9400700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f39cc06b1d0 0x7f39cc06d680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009fd0 tx=0x7f39d800b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:37.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.115+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f39d0058be0 con 0x7f39e4071f50 2024-04-03T08:41:37.227 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:36 smithi157 ceph-mon[35083]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:37.227 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:36 smithi157 ceph-mon[35083]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:37.227 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:36 smithi157 ceph-mon[35083]: pgmap v75: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 29 KiB/s wr, 49 op/s 2024-04-03T08:41:37.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:36 smithi181 ceph-mon[44183]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:37.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:36 smithi181 ceph-mon[44183]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:37.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:36 smithi181 ceph-mon[44183]: pgmap v75: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 29 KiB/s wr, 49 op/s 2024-04-03T08:41:37.421 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:41:37.421 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:41:37.421 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:41:37.421 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:41:37.422 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:41:37.423 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:37.424 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:41:37.425 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:41:37.425 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:37.425 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:41:37.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.419+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f39e4115e30 con 0x7f39e4071f50 2024-04-03T08:41:37.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.420+0000 7f39e1600700 1 -- 172.21.15.157:0/848125315 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f39d0058770 con 0x7f39e4071f50 2024-04-03T08:41:37.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.423+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f39cc06b1d0 msgr2=0x7f39cc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.423+0000 7f39ebe00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f39cc06b1d0 0x7f39cc06d680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009fd0 tx=0x7f39d800b040 comp rx=0 tx=0).stop 2024-04-03T08:41:37.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.423+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 msgr2=0x7f39e41144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.423+0000 7f39ebe00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 0x7f39e41144b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f39d000b3b0 tx=0x7f39d0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:37.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.424+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 shutdown_connections 2024-04-03T08:41:37.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.424+0000 7f39ebe00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f39cc06b1d0 0x7f39cc06d680 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009fd0 tx=0x7f39d800b040 comp rx=0 tx=0).stop 2024-04-03T08:41:37.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.424+0000 7f39ebe00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39e40709a0 0x7f39e4113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.424+0000 7f39ebe00700 1 --2- 172.21.15.157:0/848125315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e4071f50 0x7f39e41144b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.424+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 >> 172.21.15.157:0/848125315 conn(0x7f39e40f8560 msgr2=0x7f39e40f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:37.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.427+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 shutdown_connections 2024-04-03T08:41:37.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.427+0000 7f39ebe00700 1 -- 172.21.15.157:0/848125315 wait complete. 2024-04-03T08:41:37.432 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:41:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.574+0000 7f5a41c00700 1 -- 172.21.15.157:0/3996664728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fe070 msgr2=0x7f5a3c0fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.574+0000 7f5a41c00700 1 --2- 172.21.15.157:0/3996664728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fe070 0x7f5a3c0fe4e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5a28004940 tx=0x7f5a28009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.575+0000 7f5a41c00700 1 -- 172.21.15.157:0/3996664728 shutdown_connections 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.575+0000 7f5a41c00700 1 --2- 172.21.15.157:0/3996664728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fe070 0x7f5a3c0fe4e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.575+0000 7f5a41c00700 1 --2- 172.21.15.157:0/3996664728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.575+0000 7f5a41c00700 1 -- 172.21.15.157:0/3996664728 >> 172.21.15.157:0/3996664728 conn(0x7f5a3c0f85a0 msgr2=0x7f5a3c0fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.575+0000 7f5a41c00700 1 -- 172.21.15.157:0/3996664728 shutdown_connections 2024-04-03T08:41:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.575+0000 7f5a41c00700 1 -- 172.21.15.157:0/3996664728 wait complete. 2024-04-03T08:41:37.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.576+0000 7f5a41c00700 1 Processor -- start 2024-04-03T08:41:37.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.576+0000 7f5a41c00700 1 -- start start 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a41c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a41c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a3c0fe070 0x7f5a3c110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a41c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c110740 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a41c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c110f90 con 0x7f5a3c0fe070 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a3aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a3aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c10fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33006/0 (socket says 172.21.15.157:33006) 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a3aa00700 1 -- 172.21.15.157:0/417269590 learned_addr learned my addr 172.21.15.157:0/417269590 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a3a000700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a3c0fe070 0x7f5a3c110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:37.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a3aa00700 1 -- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a3c0fe070 msgr2=0x7f5a3c110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.577+0000 7f5a3aa00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a3c0fe070 0x7f5a3c110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a3aa00700 1 -- 172.21.15.157:0/417269590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28005040 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a3aa00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c10fc00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00eb40 tx=0x7f5a2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:37.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c007cc0 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c111210 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a2c00f040 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c00ca10 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.578+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c111750 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.580+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c101a00 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.580+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f5a2c00cb70 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.582+0000 7f5a32a00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5a2006b1d0 0x7f5a2006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.582+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5a2c0896e0 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.582+0000 7f5a3a000700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5a2006b1d0 0x7f5a2006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.583+0000 7f5a3a000700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5a2006b1d0 0x7f5a2006d680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800b0d0 tx=0x7f5a28009e30 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:37.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.589+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5a2c04f620 con 0x7f5a3c0fcf00 2024-04-03T08:41:37.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.852+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 --> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a3c105a60 con 0x7f5a2006b1d0 2024-04-03T08:41:37.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.854+0000 7f5a32a00700 1 -- 172.21.15.157:0/417269590 <== mgr.24485 v2:172.21.15.181:6828/2457930895 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f5a3c105a60 con 0x7f5a2006b1d0 2024-04-03T08:41:37.854 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:41:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "", 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading mgr daemons", 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:41:37.855 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:41:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5a2006b1d0 msgr2=0x7f5a2006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5a2006b1d0 0x7f5a2006d680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800b0d0 tx=0x7f5a28009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 msgr2=0x7f5a3c10fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c10fc00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00eb40 tx=0x7f5a2c00b040 comp rx=0 tx=0).stop 2024-04-03T08:41:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 shutdown_connections 2024-04-03T08:41:37.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7f5a2006b1d0 0x7f5a2006d680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a3c0fcf00 0x7f5a3c10fc00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 --2- 172.21.15.157:0/417269590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a3c0fe070 0x7f5a3c110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:37.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.856+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 >> 172.21.15.157:0/417269590 conn(0x7f5a3c0f85a0 msgr2=0x7f5a3c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:37.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.857+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 shutdown_connections 2024-04-03T08:41:37.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:37.857+0000 7f5a41c00700 1 -- 172.21.15.157:0/417269590 wait complete. 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 -- 172.21.15.157:0/364344949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fcee0 msgr2=0x7fc9b00fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/364344949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fcee0 0x7fc9b00fd310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0004970 tx=0x7fc9a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 -- 172.21.15.157:0/364344949 shutdown_connections 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/364344949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fe0d0 0x7fc9b00fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/364344949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fcee0 0x7fc9b00fd310 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 -- 172.21.15.157:0/364344949 >> 172.21.15.157:0/364344949 conn(0x7fc9b00f8560 msgr2=0x7fc9b00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 -- 172.21.15.157:0/364344949 shutdown_connections 2024-04-03T08:41:38.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.017+0000 7fc9b4c00700 1 -- 172.21.15.157:0/364344949 wait complete. 2024-04-03T08:41:38.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.018+0000 7fc9b4c00700 1 Processor -- start 2024-04-03T08:41:38.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9b4c00700 1 -- start start 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9b4c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 0x7fc9b010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9b4c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fe0d0 0x7fc9b0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9b4c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0110700 con 0x7fc9b00fcee0 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9b4c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0110f50 con 0x7fc9b00fe0d0 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9ade00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 0x7fc9b010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9ade00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 0x7fc9b010fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33032/0 (socket says 172.21.15.157:33032) 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9ade00700 1 -- 172.21.15.157:0/2293657081 learned_addr learned my addr 172.21.15.157:0/2293657081 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:41:38.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.019+0000 7fc9ad400700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fe0d0 0x7fc9b0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:38.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.020+0000 7fc9ade00700 1 -- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fe0d0 msgr2=0x7fc9b0110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:38.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.020+0000 7fc9ade00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fe0d0 0x7fc9b0110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:38.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.020+0000 7fc9ade00700 1 -- 172.21.15.157:0/2293657081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c005040 con 0x7fc9b00fcee0 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.020+0000 7fc9ad400700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fe0d0 0x7fc9b0110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.020+0000 7fc9ade00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 0x7fc9b010fbc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000b370 tx=0x7fc9a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.021+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a000e040 con 0x7fc9b00fcee0 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.021+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9a0013420 con 0x7fc9b00fcee0 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.021+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a0005040 con 0x7fc9b00fcee0 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.021+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a001c630 con 0x7fc9b00fcee0 2024-04-03T08:41:38.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.021+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b0111580 con 0x7fc9b00fcee0 2024-04-03T08:41:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.022+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b0101a60 con 0x7fc9b00fcee0 2024-04-03T08:41:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.023+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7fc9a0013a00 con 0x7fc9b00fcee0 2024-04-03T08:41:38.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.024+0000 7fc9a6000700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc99406b1d0 0x7fc99406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:41:38.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.024+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc9a008ad60 con 0x7fc9b00fcee0 2024-04-03T08:41:38.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.025+0000 7fc9ad400700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc99406b1d0 0x7fc99406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:41:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.026+0000 7fc9ad400700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc99406b1d0 0x7fc99406d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009fd0 tx=0x7fc99c00b040 comp rx=0 tx=0).ready entity=mgr.24485 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:41:38.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.029+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc9a008f070 con 0x7fc9b00fcee0 2024-04-03T08:41:38.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/249120030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:41:38.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:38.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/848125315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:41:38.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:37 smithi157 ceph-mon[35083]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:38.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.338+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc9b005f5f0 con 0x7fc9b00fcee0 2024-04-03T08:41:38.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.339+0000 7fc9a6000700 1 -- 172.21.15.157:0/2293657081 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc9a0058ac0 con 0x7fc9b00fcee0 2024-04-03T08:41:38.340 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:41:38.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.341+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc99406b1d0 msgr2=0x7fc99406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:38.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.341+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc99406b1d0 0x7fc99406d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009fd0 tx=0x7fc99c00b040 comp rx=0 tx=0).stop 2024-04-03T08:41:38.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 msgr2=0x7fc9b010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:41:38.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 0x7fc9b010fbc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000b370 tx=0x7fc9a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 shutdown_connections 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:6828/2457930895,v1:172.21.15.181:6829/2457930895] conn(0x7fc99406b1d0 0x7fc99406d680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9b00fcee0 0x7fc9b010fbc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 --2- 172.21.15.157:0/2293657081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9b00fe0d0 0x7fc9b0110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 >> 172.21.15.157:0/2293657081 conn(0x7fc9b00f8560 msgr2=0x7fc9b00f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 shutdown_connections 2024-04-03T08:41:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:41:38.342+0000 7fc9b4c00700 1 -- 172.21.15.157:0/2293657081 wait complete. 2024-04-03T08:41:38.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/249120030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:41:38.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/848125315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:41:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:37 smithi181 ceph-mon[44183]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:41:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:38 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2293657081' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:41:39.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:38 smithi181 ceph-mon[44183]: pgmap v76: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 29 KiB/s wr, 49 op/s 2024-04-03T08:41:39.246 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:38 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/2293657081' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:41:39.246 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:38 smithi157 ceph-mon[35083]: pgmap v76: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 29 KiB/s wr, 49 op/s 2024-04-03T08:41:41.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:40 smithi157 ceph-mon[35083]: pgmap v77: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 29 KiB/s wr, 50 op/s 2024-04-03T08:41:41.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:40 smithi181 ceph-mon[44183]: pgmap v77: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 29 KiB/s wr, 50 op/s 2024-04-03T08:41:42.381 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:42.381 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:42 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:42 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:43.472 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:43 smithi157 ceph-mon[35083]: pgmap v78: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-03T08:41:43.473 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:43 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:43.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:43 smithi181 ceph-mon[44183]: pgmap v78: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-03T08:41:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:43 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:46.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:45 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:46.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:45 smithi157 ceph-mon[35083]: pgmap v79: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-03T08:41:46.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:45 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:46.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:45 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:46.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:45 smithi181 ceph-mon[44183]: pgmap v79: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-03T08:41:46.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:45 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: Standby manager daemon smithi157.qfvynr restarted 2024-04-03T08:41:47.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: Standby manager daemon smithi157.qfvynr started 2024-04-03T08:41:47.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/crt"}]: dispatch 2024-04-03T08:41:47.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:41:47.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/key"}]: dispatch 2024-04-03T08:41:47.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:41:47.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:47 smithi157 ceph-mon[35083]: pgmap v80: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: Standby manager daemon smithi157.qfvynr restarted 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: Standby manager daemon smithi157.qfvynr started 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/crt"}]: dispatch 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.qfvynr/key"}]: dispatch 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:41:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:47 smithi181 ceph-mon[44183]: pgmap v80: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:41:48.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:48 smithi157 ceph-mon[35083]: mgrmap e27: smithi181.mfhidq(active, since 2m), standbys: smithi157.qfvynr 2024-04-03T08:41:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:48 smithi181 ceph-mon[44183]: mgrmap e27: smithi181.mfhidq(active, since 2m), standbys: smithi157.qfvynr 2024-04-03T08:41:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:49 smithi157 ceph-mon[35083]: pgmap v81: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:41:49.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:49 smithi181 ceph-mon[44183]: pgmap v81: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: pgmap v82: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr fail", "who": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:41:52.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr fail", "who": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: osdmap e49: 6 total, 6 up, 6 in 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd='[{"prefix": "mgr fail", "who": "smithi181.mfhidq"}]': finished 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: mgrmap e28: smithi157.qfvynr(active, starting, since 0.00672106s) 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:41:52.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:41:52.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:52.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:52.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:52.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:41:52.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:51 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: pgmap v82: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 172.21.15.181:0/4217121431' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr fail", "who": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "mgr fail", "who": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:41:52.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: osdmap e49: 6 total, 6 up, 6 in 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.24485 ' entity='mgr.smithi181.mfhidq' cmd='[{"prefix": "mgr fail", "who": "smithi181.mfhidq"}]': finished 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: mgrmap e28: smithi157.qfvynr(active, starting, since 0.00672106s) 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:41:52.099 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:41:52.100 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:51 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:41:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:53 smithi157 ceph-mon[35083]: [03/Apr/2024:08:41:51] ENGINE Bus STARTING 2024-04-03T08:41:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:53 smithi157 ceph-mon[35083]: [03/Apr/2024:08:41:51] ENGINE Serving on http://172.21.15.157:8765 2024-04-03T08:41:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:53 smithi157 ceph-mon[35083]: [03/Apr/2024:08:41:51] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:41:53.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:53 smithi157 ceph-mon[35083]: [03/Apr/2024:08:41:51] ENGINE Bus STARTED 2024-04-03T08:41:53.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:53 smithi157 ceph-mon[35083]: mgrmap e29: smithi157.qfvynr(active, since 1.01127s) 2024-04-03T08:41:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:53 smithi181 ceph-mon[44183]: [03/Apr/2024:08:41:51] ENGINE Bus STARTING 2024-04-03T08:41:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:53 smithi181 ceph-mon[44183]: [03/Apr/2024:08:41:51] ENGINE Serving on http://172.21.15.157:8765 2024-04-03T08:41:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:53 smithi181 ceph-mon[44183]: [03/Apr/2024:08:41:51] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:41:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:53 smithi181 ceph-mon[44183]: [03/Apr/2024:08:41:51] ENGINE Bus STARTED 2024-04-03T08:41:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:53 smithi181 ceph-mon[44183]: mgrmap e29: smithi157.qfvynr(active, since 1.01127s) 2024-04-03T08:41:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:54 smithi157 ceph-mon[35083]: pgmap v3: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:41:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:54 smithi157 ceph-mon[35083]: pgmap v4: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:41:54.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:54 smithi157 ceph-mon[35083]: mgrmap e30: smithi157.qfvynr(active, since 2s) 2024-04-03T08:41:54.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:54 smithi181 ceph-mon[44183]: pgmap v3: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:41:54.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:54 smithi181 ceph-mon[44183]: pgmap v4: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:41:54.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:54 smithi181 ceph-mon[44183]: mgrmap e30: smithi157.qfvynr(active, since 2s) 2024-04-03T08:41:56.311 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:56 smithi181 ceph-mon[44183]: pgmap v5: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:41:56.312 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:56 smithi181 ceph-mon[44183]: mgrmap e31: smithi157.qfvynr(active, since 4s) 2024-04-03T08:41:56.312 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:56 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:56.312 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:56 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:56 smithi157 ceph-mon[35083]: pgmap v5: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:41:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:56 smithi157 ceph-mon[35083]: mgrmap e31: smithi157.qfvynr(active, since 4s) 2024-04-03T08:41:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:56 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:56.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:56 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:57.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:57 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:57 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:57 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:57 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:58.560 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:58 smithi181 ceph-mon[44183]: pgmap v6: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-04-03T08:41:58.561 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:58 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:58.561 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:58 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:58 smithi157 ceph-mon[35083]: pgmap v6: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-04-03T08:41:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:58 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:41:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:58 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:00.034 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:59 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:00.034 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:41:59 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:00.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:59 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:00.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:41:59 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:00 smithi157 ceph-mon[35083]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-03T08:42:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:00 smithi157 ceph-mon[35083]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:42:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:00 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:42:01.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:00 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:42:01.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:00 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:42:01.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:00 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:42:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:00 smithi181 ceph-mon[44183]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-03T08:42:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:00 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:42:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:00 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:42:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:00 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:42:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:00 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:42:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:00 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/1710147877' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:42:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:01 smithi157 ceph-mon[35083]: mgrmap e32: smithi157.qfvynr(active, since 9s), standbys: smithi181.mfhidq 2024-04-03T08:42:02.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:01 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:42:02.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:01 smithi181 ceph-mon[44183]: mgrmap e32: smithi157.qfvynr(active, since 9s), standbys: smithi181.mfhidq 2024-04-03T08:42:02.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:01 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:42:03.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:02 smithi157 ceph-mon[35083]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-03T08:42:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:02 smithi181 ceph-mon[44183]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: pgmap v9: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:42:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:04 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:42:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: pgmap v9: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-03T08:42:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:42:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:42:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:04 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:42:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:05 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:05 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:05 smithi157 ceph-mon[35083]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:05 smithi157 ceph-mon[35083]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:05 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:05 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:05 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:05 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:06 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:07.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:06 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:42:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:07 smithi157 ceph-mon[35083]: Reconfiguring prometheus.smithi157 (dependencies changed)... 2024-04-03T08:42:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:07 smithi157 ceph-mon[35083]: Reconfiguring daemon prometheus.smithi157 on smithi157 2024-04-03T08:42:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:07 smithi181 ceph-mon[44183]: Reconfiguring prometheus.smithi157 (dependencies changed)... 2024-04-03T08:42:08.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:07 smithi181 ceph-mon[44183]: Reconfiguring daemon prometheus.smithi157 on smithi157 2024-04-03T08:42:08.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.483+0000 7ff7c3a00700 1 -- 172.21.15.157:0/1738802130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 msgr2=0x7ff7bc0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.483+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/1738802130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc0fe540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8004940 tx=0x7ff7a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.483+0000 7ff7c3a00700 1 -- 172.21.15.157:0/1738802130 shutdown_connections 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.483+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/1738802130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc0fe540 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.483+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/1738802130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7bc0fcee0 0x7ff7bc0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.483+0000 7ff7c3a00700 1 -- 172.21.15.157:0/1738802130 >> 172.21.15.157:0/1738802130 conn(0x7ff7bc0f8560 msgr2=0x7ff7bc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.484+0000 7ff7c3a00700 1 -- 172.21.15.157:0/1738802130 shutdown_connections 2024-04-03T08:42:08.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.484+0000 7ff7c3a00700 1 -- 172.21.15.157:0/1738802130 wait complete. 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.484+0000 7ff7c3a00700 1 Processor -- start 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.484+0000 7ff7c3a00700 1 -- start start 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7c3a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7bc0fcee0 0x7ff7bc10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7c3a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7c3a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc110850 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7c3a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc110f90 con 0x7ff7bc0fcee0 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7bbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7bbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60176/0 (socket says 172.21.15.157:60176) 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7bbe00700 1 -- 172.21.15.157:0/2396606429 learned_addr learned my addr 172.21.15.157:0/2396606429 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7c1000700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7bc0fcee0 0x7ff7bc10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7bbe00700 1 -- 172.21.15.157:0/2396606429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7bc0fcee0 msgr2=0x7ff7bc10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7bbe00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7bc0fcee0 0x7ff7bc10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.485+0000 7ff7bbe00700 1 -- 172.21.15.157:0/2396606429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8005040 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.486+0000 7ff7bbe00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc110250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009150 tx=0x7ff7a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:08.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.486+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a800e040 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.486+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7a8004290 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.486+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a801c630 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.486+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc111210 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.486+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1117d0 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.487+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc101a60 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.488+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7ff7a800bbf0 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.489+0000 7ff7b8c00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff7a406d200 0x7ff7a406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:08.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.489+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff7a808d720 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.490+0000 7ff7c1000700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff7a406d200 0x7ff7a406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:08.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.490+0000 7ff7c1000700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff7a406d200 0x7ff7a406f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0fcc20 tx=0x7ff7b000b040 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:08.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.493+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff7a805b1f0 con 0x7ff7bc0fe0d0 2024-04-03T08:42:08.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.720+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 --> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7bc1119f0 con 0x7ff7a406d200 2024-04-03T08:42:08.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.722+0000 7ff7b8c00700 1 -- 172.21.15.157:0/2396606429 <== mgr.14816 v2:172.21.15.157:6800/2321321664 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff7bc1119f0 con 0x7ff7a406d200 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff7a406d200 msgr2=0x7ff7a406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff7a406d200 0x7ff7a406f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0fcc20 tx=0x7ff7b000b040 comp rx=0 tx=0).stop 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 msgr2=0x7ff7bc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc110250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009150 tx=0x7ff7a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 shutdown_connections 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff7a406d200 0x7ff7a406f6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7bc0fcee0 0x7ff7bc10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 --2- 172.21.15.157:0/2396606429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7bc0fe0d0 0x7ff7bc110250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 >> 172.21.15.157:0/2396606429 conn(0x7ff7bc0f8560 msgr2=0x7ff7bc0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:08.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 shutdown_connections 2024-04-03T08:42:08.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.725+0000 7ff7c3a00700 1 -- 172.21.15.157:0/2396606429 wait complete. 2024-04-03T08:42:08.740 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 -- 172.21.15.157:0/1425962771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 msgr2=0x7fdf0c0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 --2- 172.21.15.157:0/1425962771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c0fd290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdefc004940 tx=0x7fdefc009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 -- 172.21.15.157:0/1425962771 shutdown_connections 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 --2- 172.21.15.157:0/1425962771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf0c0fdff0 0x7fdf0c0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 --2- 172.21.15.157:0/1425962771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c0fd290 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 -- 172.21.15.157:0/1425962771 >> 172.21.15.157:0/1425962771 conn(0x7fdf0c0f8560 msgr2=0x7fdf0c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:08.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 -- 172.21.15.157:0/1425962771 shutdown_connections 2024-04-03T08:42:08.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.868+0000 7fdf12800700 1 -- 172.21.15.157:0/1425962771 wait complete. 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.869+0000 7fdf12800700 1 Processor -- start 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.869+0000 7fdf12800700 1 -- start start 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.869+0000 7fdf12800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf12800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf0c0fdff0 0x7fdf0c110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf12800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c110700 con 0x7fdf0c0fce80 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf12800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c110f50 con 0x7fdf0c0fdff0 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c10fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60192/0 (socket says 172.21.15.157:60192) 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 -- 172.21.15.157:0/2927807387 learned_addr learned my addr 172.21.15.157:0/2927807387 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0aa00700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf0c0fdff0 0x7fdf0c110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 -- 172.21.15.157:0/2927807387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf0c0fdff0 msgr2=0x7fdf0c110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf0c0fdff0 0x7fdf0c110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 -- 172.21.15.157:0/2927807387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc005040 con 0x7fdf0c0fce80 2024-04-03T08:42:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.870+0000 7fdf0b400700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c10fbc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00b0d0 tx=0x7fdefc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.871+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdefc00e070 con 0x7fdf0c0fce80 2024-04-03T08:42:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.871+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdefc00b410 con 0x7fdf0c0fce80 2024-04-03T08:42:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.871+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c1111d0 con 0x7fdf0c0fce80 2024-04-03T08:42:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.871+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdefc012600 con 0x7fdf0c0fce80 2024-04-03T08:42:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.871+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c111710 con 0x7fdf0c0fce80 2024-04-03T08:42:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.872+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c101980 con 0x7fdf0c0fce80 2024-04-03T08:42:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.873+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fdefc00ba80 con 0x7fdf0c0fce80 2024-04-03T08:42:08.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.874+0000 7fdf03400700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fdef006d200 0x7fdef006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.874+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdefc08d360 con 0x7fdf0c0fce80 2024-04-03T08:42:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.874+0000 7fdf0aa00700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fdef006d200 0x7fdef006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.875+0000 7fdf0aa00700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fdef006d200 0x7fdef006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdef8004600 tx=0x7fdef800b040 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:08.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:08.879+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fdefc05aee0 con 0x7fdf0c0fce80 2024-04-03T08:42:08.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:08 smithi157 ceph-mon[35083]: pgmap v11: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:09.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:08 smithi181 ceph-mon[44183]: pgmap v11: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:09.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.114+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 --> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf0c111a40 con 0x7fdef006d200 2024-04-03T08:42:09.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.116+0000 7fdf03400700 1 -- 172.21.15.157:0/2927807387 <== mgr.14816 v2:172.21.15.157:6800/2321321664 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fdf0c111a40 con 0x7fdef006d200 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fdef006d200 msgr2=0x7fdef006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fdef006d200 0x7fdef006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdef8004600 tx=0x7fdef800b040 comp rx=0 tx=0).stop 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 msgr2=0x7fdf0c10fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c10fbc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00b0d0 tx=0x7fdefc009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 shutdown_connections 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf0c0fce80 0x7fdf0c10fbc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fdef006d200 0x7fdef006f6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 --2- 172.21.15.157:0/2927807387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf0c0fdff0 0x7fdf0c110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 >> 172.21.15.157:0/2927807387 conn(0x7fdf0c0f8560 msgr2=0x7fdf0c0f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 shutdown_connections 2024-04-03T08:42:09.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.118+0000 7fdf12800700 1 -- 172.21.15.157:0/2927807387 wait complete. 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 -- 172.21.15.157:0/232096057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 msgr2=0x7f381c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 --2- 172.21.15.157:0/232096057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c102380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3808004940 tx=0x7f3808009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 -- 172.21.15.157:0/232096057 shutdown_connections 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 --2- 172.21.15.157:0/232096057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c102380 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 --2- 172.21.15.157:0/232096057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f381c066240 0x7f381c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 -- 172.21.15.157:0/232096057 >> 172.21.15.157:0/232096057 conn(0x7f381c0f7430 msgr2=0x7f381c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 -- 172.21.15.157:0/232096057 shutdown_connections 2024-04-03T08:42:09.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.252+0000 7f3822600700 1 -- 172.21.15.157:0/232096057 wait complete. 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.253+0000 7f3822600700 1 Processor -- start 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.253+0000 7f3822600700 1 -- start start 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.253+0000 7f3822600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f381c066240 0x7f381c10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.253+0000 7f3822600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.253+0000 7f3822600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c110870 con 0x7f381c0fffa0 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.253+0000 7f3822600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c110fb0 con 0x7f381c066240 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:09.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60208/0 (socket says 172.21.15.157:60208) 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 -- 172.21.15.157:0/2473160689 learned_addr learned my addr 172.21.15.157:0/2473160689 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381b400700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f381c066240 0x7f381c10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 -- 172.21.15.157:0/2473160689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f381c066240 msgr2=0x7f381c10fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f381c066240 0x7f381c10fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 -- 172.21.15.157:0/2473160689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808005040 con 0x7f381c0fffa0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f381aa00700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c110270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3808009150 tx=0x7f3808009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f380800e040 con 0x7f381c0fffa0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f380800bbf0 con 0x7f381c0fffa0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3808013ea0 con 0x7f381c0fffa0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.254+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c111230 con 0x7f381c0fffa0 2024-04-03T08:42:09.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.255+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c1117f0 con 0x7f381c0fffa0 2024-04-03T08:42:09.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.256+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c05f5f0 con 0x7f381c0fffa0 2024-04-03T08:42:09.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.257+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f380800bd60 con 0x7f381c0fffa0 2024-04-03T08:42:09.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.257+0000 7f3813400700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f380006d200 0x7f380006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:09.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.257+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f380808db40 con 0x7f381c0fffa0 2024-04-03T08:42:09.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.258+0000 7f381b400700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f380006d200 0x7f380006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:09.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.258+0000 7f381b400700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f380006d200 0x7f380006f6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f381c065f80 tx=0x7f380c00b040 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:09.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.262+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f380805b550 con 0x7f381c0fffa0 2024-04-03T08:42:09.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.487+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 --> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f381c111c30 con 0x7f380006d200 2024-04-03T08:42:09.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.498+0000 7f3813400700 1 -- 172.21.15.157:0/2473160689 <== mgr.14816 v2:172.21.15.157:6800/2321321664 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f381c111c30 con 0x7f380006d200 2024-04-03T08:42:09.498 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:42:09.498 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (2m) 11s ago 12m 14.9M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:42:09.498 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (12m) 11s ago 12m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:42:09.498 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (11m) 14s ago 11m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (68s) 11s ago 12m 74.7M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (6m) 11s ago 6m 12.7M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (6m) 11s ago 6m 139M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (6m) 14s ago 6m 12.8M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (6m) 14s ago 6m 99.6M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (32s) 11s ago 13m 472M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283 running (3m) 14s ago 11m 64.6M - 19.0.0-1670-g1fb5d106 c318aa90b546 b4f1b4d00cca 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (14m) 11s ago 14m 52.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (11m) 14s ago 11m 41.4M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (2m) 11s ago 12m 7726k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (39s) 14s ago 11m 7159k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (10m) 11s ago 10m 226M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (9m) 11s ago 9m 243M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (9m) 11s ago 9m 203M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (8m) 14s ago 8m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:42:09.499 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (8m) 14s ago 8m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:42:09.500 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (7m) 14s ago 7m 222M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:42:09.500 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (41s) 11s ago 11m 40.8M - 2.43.0 a07b618ecd1d 2062509ff1bd 2024-04-03T08:42:09.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f380006d200 msgr2=0x7f380006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f380006d200 0x7f380006f6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f381c065f80 tx=0x7f380c00b040 comp rx=0 tx=0).stop 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 msgr2=0x7f381c110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c110270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3808009150 tx=0x7f3808009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 shutdown_connections 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f380006d200 0x7f380006f6b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f381c066240 0x7f381c10fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 --2- 172.21.15.157:0/2473160689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f381c0fffa0 0x7f381c110270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 >> 172.21.15.157:0/2473160689 conn(0x7f381c0f7430 msgr2=0x7f381c0fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:09.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 shutdown_connections 2024-04-03T08:42:09.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.500+0000 7f3822600700 1 -- 172.21.15.157:0/2473160689 wait complete. 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 -- 172.21.15.157:0/3550523234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fe0d0 msgr2=0x7f8cb00fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 --2- 172.21.15.157:0/3550523234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fe0d0 0x7f8cb00fe540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c004940 tx=0x7f8c9c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 -- 172.21.15.157:0/3550523234 shutdown_connections 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 --2- 172.21.15.157:0/3550523234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fe0d0 0x7f8cb00fe540 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 --2- 172.21.15.157:0/3550523234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cb00fcee0 0x7f8cb00fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 -- 172.21.15.157:0/3550523234 >> 172.21.15.157:0/3550523234 conn(0x7f8cb00f8560 msgr2=0x7f8cb00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 -- 172.21.15.157:0/3550523234 shutdown_connections 2024-04-03T08:42:09.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.634+0000 7f8cb8600700 1 -- 172.21.15.157:0/3550523234 wait complete. 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.635+0000 7f8cb8600700 1 Processor -- start 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.635+0000 7f8cb8600700 1 -- start start 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb8600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 0x7f8cb010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb8600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cb00fe0d0 0x7f8cb0110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb8600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0110850 con 0x7f8cb00fcee0 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb8600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0110f90 con 0x7f8cb00fe0d0 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 0x7f8cb010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 0x7f8cb010fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60234/0 (socket says 172.21.15.157:60234) 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5c00700 1 -- 172.21.15.157:0/1977199763 learned_addr learned my addr 172.21.15.157:0/1977199763 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5200700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cb00fe0d0 0x7f8cb0110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:09.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5c00700 1 -- 172.21.15.157:0/1977199763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cb00fe0d0 msgr2=0x7f8cb0110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5c00700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cb00fe0d0 0x7f8cb0110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.636+0000 7f8cb5c00700 1 -- 172.21.15.157:0/1977199763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c005040 con 0x7f8cb00fcee0 2024-04-03T08:42:09.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.637+0000 7f8cb5c00700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 0x7f8cb010fd10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4002a50 tx=0x7f8ca4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:09.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.637+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ca4007cc0 con 0x7f8cb00fcee0 2024-04-03T08:42:09.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.637+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb0111270 con 0x7f8cb00fcee0 2024-04-03T08:42:09.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.637+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ca400f040 con 0x7f8cb00fcee0 2024-04-03T08:42:09.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.637+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ca400d940 con 0x7f8cb00fcee0 2024-04-03T08:42:09.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.637+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb0111830 con 0x7f8cb00fcee0 2024-04-03T08:42:09.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.638+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb0101a60 con 0x7f8cb00fcee0 2024-04-03T08:42:09.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.639+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f8ca400dc00 con 0x7f8cb00fcee0 2024-04-03T08:42:09.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.640+0000 7f8cad600700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f8c9806d200 0x7f8c9806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:09.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.640+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8ca408c4c0 con 0x7f8cb00fcee0 2024-04-03T08:42:09.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.640+0000 7f8cb5200700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f8c9806d200 0x7f8c9806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:09.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.641+0000 7f8cb5200700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f8c9806d200 0x7f8c9806f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00b3b0 tx=0x7f8c9c009e30 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:09.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.644+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8ca4059e70 con 0x7f8cb00fcee0 2024-04-03T08:42:09.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.944+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8cb0105ad0 con 0x7f8cb00fcee0 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.944+0000 7f8cad600700 1 -- 172.21.15.157:0/1977199763 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8ca4059a00 con 0x7f8cb00fcee0 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:42:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 12, 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:42:09.946 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:42:09.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f8c9806d200 msgr2=0x7f8c9806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f8c9806d200 0x7f8c9806f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00b3b0 tx=0x7f8c9c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 msgr2=0x7f8cb010fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 0x7f8cb010fd10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4002a50 tx=0x7f8ca4004600 comp rx=0 tx=0).stop 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 shutdown_connections 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cb00fcee0 0x7f8cb010fd10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f8c9806d200 0x7f8c9806f6b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 --2- 172.21.15.157:0/1977199763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cb00fe0d0 0x7f8cb0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 >> 172.21.15.157:0/1977199763 conn(0x7f8cb00f8560 msgr2=0x7f8cb00f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 shutdown_connections 2024-04-03T08:42:09.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:09.947+0000 7f8cb8600700 1 -- 172.21.15.157:0/1977199763 wait complete. 2024-04-03T08:42:09.963 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:09 smithi157 ceph-mon[35083]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:10.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:09 smithi181 ceph-mon[44183]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 -- 172.21.15.157:0/1085229756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 msgr2=0x7ff8ac0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1085229756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac0703b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0004940 tx=0x7ff8a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 -- 172.21.15.157:0/1085229756 shutdown_connections 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1085229756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8ac0708f0 0x7ff8ac070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1085229756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac0703b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 -- 172.21.15.157:0/1085229756 >> 172.21.15.157:0/1085229756 conn(0x7ff8ac0f8560 msgr2=0x7ff8ac0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 -- 172.21.15.157:0/1085229756 shutdown_connections 2024-04-03T08:42:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.099+0000 7ff8b3800700 1 -- 172.21.15.157:0/1085229756 wait complete. 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.100+0000 7ff8b3800700 1 Processor -- start 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.100+0000 7ff8b3800700 1 -- start start 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.100+0000 7ff8b3800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8ac0708f0 0x7ff8ac10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.100+0000 7ff8b3800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8b3800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac110860 con 0x7ff8ac071ea0 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8b3800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac110fa0 con 0x7ff8ac0708f0 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8abe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8abe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60256/0 (socket says 172.21.15.157:60256) 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8abe00700 1 -- 172.21.15.157:0/1990302126 learned_addr learned my addr 172.21.15.157:0/1990302126 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8b0e00700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8ac0708f0 0x7ff8ac10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8abe00700 1 -- 172.21.15.157:0/1990302126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8ac0708f0 msgr2=0x7ff8ac10fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8abe00700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8ac0708f0 0x7ff8ac10fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.101+0000 7ff8abe00700 1 -- 172.21.15.157:0/1990302126 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0005040 con 0x7ff8ac071ea0 2024-04-03T08:42:10.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.102+0000 7ff8abe00700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac110260 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff898002a50 tx=0x7ff8980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.102+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff898007cc0 con 0x7ff8ac071ea0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.102+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac111280 con 0x7ff8ac071ea0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.102+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff89800f040 con 0x7ff8ac071ea0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.102+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff89800da30 con 0x7ff8ac071ea0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.102+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac111840 con 0x7ff8ac071ea0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.103+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac05f5f0 con 0x7ff8ac071ea0 2024-04-03T08:42:10.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.104+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7ff89800db90 con 0x7ff8ac071ea0 2024-04-03T08:42:10.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.105+0000 7ff8a8c00700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff89406d200 0x7ff89406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.105+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff89808c510 con 0x7ff8ac071ea0 2024-04-03T08:42:10.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.106+0000 7ff8b0e00700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff89406d200 0x7ff89406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.106+0000 7ff8b0e00700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff89406d200 0x7ff89406f6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000b3b0 tx=0x7ff8a0009e30 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:10.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.109+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff898059ea0 con 0x7ff8ac071ea0 2024-04-03T08:42:10.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.368+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8ac111ab0 con 0x7ff8ac071ea0 2024-04-03T08:42:10.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.368+0000 7ff8a8c00700 1 -- 172.21.15.157:0/1990302126 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ff898059a30 con 0x7ff8ac071ea0 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:42:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:42:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:42:10.372 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:10.373 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:10.373 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:10.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff89406d200 msgr2=0x7ff89406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff89406d200 0x7ff89406f6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000b3b0 tx=0x7ff8a0009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 msgr2=0x7ff8ac110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac110260 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff898002a50 tx=0x7ff8980046b0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 shutdown_connections 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7ff89406d200 0x7ff89406f6b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8ac0708f0 0x7ff8ac10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 --2- 172.21.15.157:0/1990302126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8ac071ea0 0x7ff8ac110260 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 >> 172.21.15.157:0/1990302126 conn(0x7ff8ac0f8560 msgr2=0x7ff8ac0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 shutdown_connections 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.371+0000 7ff8b3800700 1 -- 172.21.15.157:0/1990302126 wait complete. 2024-04-03T08:42:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:42:10.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 -- 172.21.15.157:0/2941373592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fe0d0 msgr2=0x7f11d40fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2941373592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fe0d0 0x7f11d40fe540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f11c0004940 tx=0x7f11c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:10.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 -- 172.21.15.157:0/2941373592 shutdown_connections 2024-04-03T08:42:10.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2941373592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fe0d0 0x7f11d40fe540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2941373592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fcee0 0x7f11d40fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 -- 172.21.15.157:0/2941373592 >> 172.21.15.157:0/2941373592 conn(0x7f11d40f8560 msgr2=0x7f11d40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:10.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 -- 172.21.15.157:0/2941373592 shutdown_connections 2024-04-03T08:42:10.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.509+0000 7f11d9e00700 1 -- 172.21.15.157:0/2941373592 wait complete. 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.510+0000 7f11d9e00700 1 Processor -- start 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.510+0000 7f11d9e00700 1 -- start start 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 0x7f11d410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d9e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fe0d0 0x7f11d4110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d9e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4110700 con 0x7f11d40fcee0 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d9e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4110f50 con 0x7f11d40fe0d0 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 0x7f11d410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 0x7f11d410fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60280/0 (socket says 172.21.15.157:60280) 2024-04-03T08:42:10.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 -- 172.21.15.157:0/2888456508 learned_addr learned my addr 172.21.15.157:0/2888456508 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2000700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fe0d0 0x7f11d4110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 -- 172.21.15.157:0/2888456508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fe0d0 msgr2=0x7f11d4110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fe0d0 0x7f11d4110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 -- 172.21.15.157:0/2888456508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0005040 con 0x7f11d40fcee0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2000700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fe0d0 0x7f11d4110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.511+0000 7f11d2a00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 0x7f11d410fbc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11c400eb70 tx=0x7f11c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.512+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c4007cc0 con 0x7f11d40fcee0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.512+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11c400f040 con 0x7f11d40fcee0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.512+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d41111d0 con 0x7f11d40fcee0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.512+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c400cbd0 con 0x7f11d40fcee0 2024-04-03T08:42:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.512+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d4111710 con 0x7f11d40fcee0 2024-04-03T08:42:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.513+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d4101a60 con 0x7f11d40fcee0 2024-04-03T08:42:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.514+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f11c400cd30 con 0x7f11d40fcee0 2024-04-03T08:42:10.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.515+0000 7f11caa00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f11b806d200 0x7f11b806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.515+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f11c408c2b0 con 0x7f11d40fcee0 2024-04-03T08:42:10.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.515+0000 7f11d2000700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f11b806d200 0x7f11b806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.516+0000 7f11d2000700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f11b806d200 0x7f11b806f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009fd0 tx=0x7f11c0009e30 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:10.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.519+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f11c4059d10 con 0x7f11d40fcee0 2024-04-03T08:42:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.754+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 --> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d4111930 con 0x7f11b806d200 2024-04-03T08:42:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.756+0000 7f11caa00700 1 -- 172.21.15.157:0/2888456508 <== mgr.14816 v2:172.21.15.157:6800/2321321664 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f11d4111930 con 0x7f11b806d200 2024-04-03T08:42:10.756 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:42:10.756 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:42:10.756 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:42:10.756 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "2/21 daemons upgraded", 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:42:10.757 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:42:10.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.758+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f11b806d200 msgr2=0x7f11b806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.758+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f11b806d200 0x7f11b806f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009fd0 tx=0x7f11c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:10.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.758+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 msgr2=0x7f11d410fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.758+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 0x7f11d410fbc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11c400eb70 tx=0x7f11c400b040 comp rx=0 tx=0).stop 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 shutdown_connections 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d40fcee0 0x7f11d410fbc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f11b806d200 0x7f11b806f6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 --2- 172.21.15.157:0/2888456508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d40fe0d0 0x7f11d4110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 >> 172.21.15.157:0/2888456508 conn(0x7f11d40f8560 msgr2=0x7f11d40f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 shutdown_connections 2024-04-03T08:42:10.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.759+0000 7f11d9e00700 1 -- 172.21.15.157:0/2888456508 wait complete. 2024-04-03T08:42:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:10 smithi157 ceph-mon[35083]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:10 smithi157 ceph-mon[35083]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:10 smithi157 ceph-mon[35083]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:10 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1977199763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:10 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/1990302126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:42:10.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 -- 172.21.15.157:0/2422722426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fcee0 msgr2=0x7fed280fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 --2- 172.21.15.157:0/2422722426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fcee0 0x7fed280fd310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fed18004940 tx=0x7fed18009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:10.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 -- 172.21.15.157:0/2422722426 shutdown_connections 2024-04-03T08:42:10.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 --2- 172.21.15.157:0/2422722426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fe0d0 0x7fed280fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 --2- 172.21.15.157:0/2422722426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fcee0 0x7fed280fd310 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 -- 172.21.15.157:0/2422722426 >> 172.21.15.157:0/2422722426 conn(0x7fed280f8560 msgr2=0x7fed280fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:10.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.897+0000 7fed2da00700 1 -- 172.21.15.157:0/2422722426 shutdown_connections 2024-04-03T08:42:10.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.898+0000 7fed2da00700 1 -- 172.21.15.157:0/2422722426 wait complete. 2024-04-03T08:42:10.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.898+0000 7fed2da00700 1 Processor -- start 2024-04-03T08:42:10.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.898+0000 7fed2da00700 1 -- start start 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed2da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fcee0 0x7fed2810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed2da00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 0x7fed28110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed2da00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28110860 con 0x7fed280fe0d0 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed2da00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28110fa0 con 0x7fed280fcee0 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 0x7fed28110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 0x7fed28110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60302/0 (socket says 172.21.15.157:60302) 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26000700 1 -- 172.21.15.157:0/4241718296 learned_addr learned my addr 172.21.15.157:0/4241718296 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26a00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fcee0 0x7fed2810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26000700 1 -- 172.21.15.157:0/4241718296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fcee0 msgr2=0x7fed2810fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26000700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fcee0 0x7fed2810fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26000700 1 -- 172.21.15.157:0/4241718296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18005040 con 0x7fed280fe0d0 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.899+0000 7fed26a00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fcee0 0x7fed2810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:42:10.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.900+0000 7fed26000700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 0x7fed28110260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fed1400c830 tx=0x7fed14004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:10.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.900+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1400a760 con 0x7fed280fe0d0 2024-04-03T08:42:10.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.900+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed28111280 con 0x7fed280fe0d0 2024-04-03T08:42:10.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.900+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed1400ad90 con 0x7fed280fe0d0 2024-04-03T08:42:10.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.900+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed140113a0 con 0x7fed280fe0d0 2024-04-03T08:42:10.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.900+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed28111840 con 0x7fed280fe0d0 2024-04-03T08:42:10.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.901+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed28101a60 con 0x7fed280fe0d0 2024-04-03T08:42:10.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.902+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fed14012400 con 0x7fed280fe0d0 2024-04-03T08:42:10.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.903+0000 7fed1ea00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fed0c06d200 0x7fed0c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:10.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.903+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fed1408c710 con 0x7fed280fe0d0 2024-04-03T08:42:10.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.903+0000 7fed26a00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fed0c06d200 0x7fed0c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:10.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.904+0000 7fed26a00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fed0c06d200 0x7fed0c06f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3b0 tx=0x7fed18009e30 comp rx=0 tx=0).ready entity=mgr.14816 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:10.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:10.908+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fed1405a230 con 0x7fed280fe0d0 2024-04-03T08:42:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:10 smithi181 ceph-mon[44183]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:10 smithi181 ceph-mon[44183]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:10 smithi181 ceph-mon[44183]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:10 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1977199763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:10 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1990302126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:42:11.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.236+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed2804bed0 con 0x7fed280fe0d0 2024-04-03T08:42:11.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.237+0000 7fed1ea00700 1 -- 172.21.15.157:0/4241718296 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fed14059dc0 con 0x7fed280fe0d0 2024-04-03T08:42:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:42:11.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fed0c06d200 msgr2=0x7fed0c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fed0c06d200 0x7fed0c06f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3b0 tx=0x7fed18009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 msgr2=0x7fed28110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 0x7fed28110260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fed1400c830 tx=0x7fed14004470 comp rx=0 tx=0).stop 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 shutdown_connections 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7fed0c06d200 0x7fed0c06f6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed280fcee0 0x7fed2810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 --2- 172.21.15.157:0/4241718296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed280fe0d0 0x7fed28110260 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 >> 172.21.15.157:0/4241718296 conn(0x7fed280f8560 msgr2=0x7fed280f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 shutdown_connections 2024-04-03T08:42:11.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:11.240+0000 7fed2da00700 1 -- 172.21.15.157:0/4241718296 wait complete. 2024-04-03T08:42:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:11 smithi157 ceph-mon[35083]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:12.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:11 smithi157 ceph-mon[35083]: from='client.? 172.21.15.157:0/4241718296' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:42:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:11 smithi181 ceph-mon[44183]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:12.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:11 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/4241718296' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:42:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:12 smithi157 ceph-mon[35083]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:12 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:12 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:12 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:42:13.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:12 smithi157 ceph-mon[35083]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:42:13.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:12 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:13.327 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:12 smithi181 ceph-mon[44183]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:13.327 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:12 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:13.327 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:12 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:13.327 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:12 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:42:13.328 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:12 smithi181 ceph-mon[44183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:42:13.328 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:12 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:14.278 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:13 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:42:14.278 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:13 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:42:14.278 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:13 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:14.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:13 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:42:14.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:13 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:42:14.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:13 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:15.219 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:14 smithi181 ceph-mon[44183]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:15.219 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:14 smithi181 ceph-mon[44183]: Upgrade: Updating mgr.smithi181.mfhidq 2024-04-03T08:42:15.219 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:14 smithi181 ceph-mon[44183]: Deploying daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:42:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:14 smithi157 ceph-mon[35083]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:14 smithi157 ceph-mon[35083]: Upgrade: Updating mgr.smithi181.mfhidq 2024-04-03T08:42:15.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:14 smithi157 ceph-mon[35083]: Deploying daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:42:17.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:16 smithi181 ceph-mon[44183]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:16 smithi157 ceph-mon[35083]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:19.313 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:18 smithi181 ceph-mon[44183]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:42:19.313 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:18 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:19.313 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:18 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:19.313 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:18 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:18 smithi157 ceph-mon[35083]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:42:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:18 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:18 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:18 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:21.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:20 smithi181 ceph-mon[44183]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:21.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:20 smithi157 ceph-mon[35083]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:22.167 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:21 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:42:22.167 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:21 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:22.168 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:21 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:22.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:21 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:42:22.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:21 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:22.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:21 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:22.977 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:22 smithi181 ceph-mon[44183]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:22.977 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:22 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:22.977 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:22 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:23.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:22 smithi157 ceph-mon[35083]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:23.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:22 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:23.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:22 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:25.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:25 smithi157 ceph-mon[35083]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:25.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:25 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:25.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:25 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:25.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:25 smithi181 ceph-mon[44183]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:25.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:25 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:25.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:25 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:26.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:26 smithi181 ceph-mon[44183]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:26 smithi157 ceph-mon[35083]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:42:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:27 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq restarted 2024-04-03T08:42:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:27 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:42:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:42:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:42:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:42:27.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:27 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:42:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:27 smithi157 ceph-mon[35083]: Standby manager daemon smithi181.mfhidq restarted 2024-04-03T08:42:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:27 smithi157 ceph-mon[35083]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:42:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:42:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:42:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:42:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:27 smithi157 ceph-mon[35083]: from='mgr.? 172.21.15.181:0/3150154298' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:42:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:42:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: mgrmap e33: smithi157.qfvynr(active, since 36s), standbys: smithi181.mfhidq 2024-04-03T08:42:28.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: Upgrade: Setting container_image for all mgr 2024-04-03T08:42:28.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.qfvynr"}]: dispatch 2024-04-03T08:42:28.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.qfvynr"}]': finished 2024-04-03T08:42:28.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi181.mfhidq"}]: dispatch 2024-04-03T08:42:28.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi181.mfhidq"}]': finished 2024-04-03T08:42:28.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:28 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-03T08:42:28.528 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: mgrmap e33: smithi157.qfvynr(active, since 36s), standbys: smithi181.mfhidq 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: Upgrade: Setting container_image for all mgr 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.qfvynr"}]: dispatch 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.qfvynr"}]': finished 2024-04-03T08:42:28.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi181.mfhidq"}]: dispatch 2024-04-03T08:42:28.530 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi181.mfhidq"}]': finished 2024-04-03T08:42:28.530 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:28 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-03T08:42:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: pgmap v22: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: Upgrade: Updating mon.smithi157 2024-04-03T08:42:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:42:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:42:30.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:30.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:30 smithi157 ceph-mon[35083]: Deploying daemon mon.smithi157 on smithi157 2024-04-03T08:42:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: pgmap v22: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: Upgrade: Updating mon.smithi157 2024-04-03T08:42:30.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:30.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:42:30.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:42:30.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:30.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:30 smithi181 ceph-mon[44183]: Deploying daemon mon.smithi157 on smithi157 2024-04-03T08:42:31.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:31 smithi157 systemd[1]: Stopping Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:42:32.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:31 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[35060]: 2024-04-03T08:42:31.699+0000 7f64bee00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi157 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:42:32.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:31 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[35060]: 2024-04-03T08:42:31.699+0000 7f64bee00700 -1 mon.smithi157@0(leader) e2 *** Got Signal Terminated *** 2024-04-03T08:42:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:32 smithi157 bash[117471]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157 2024-04-03T08:42:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:32 smithi157 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service: Succeeded. 2024-04-03T08:42:33.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:32 smithi157 systemd[1]: Stopped Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:42:33.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 systemd[1]: Starting Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:42:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: set uid:gid to 167:167 (ceph:ceph) 2024-04-03T08:42:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 7 2024-04-03T08:42:34.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: pidfile_write: ignore empty --pid-file 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: load: jerasure load: lrc 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: RocksDB version: 7.9.2 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Git sha 0 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Compile date 2024-03-20 03:10:51 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: DB SUMMARY 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: DB Session ID: FO57ONL18I0FXVG2KZOV 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: CURRENT file: CURRENT 2024-04-03T08:42:34.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: IDENTITY file: IDENTITY 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1158 Bytes 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi157/store.db dir, Total Num: 1, files: 000033.sst 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi157/store.db: 000031.log size: 2399258 ; 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.error_if_exists: 0 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.create_if_missing: 0 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.paranoid_checks: 1 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.env: 0x556434758b20 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.fs: PosixFileSystem 2024-04-03T08:42:34.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.info_log: 0x55643548f7c0 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_file_opening_threads: 16 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.statistics: (nil) 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.use_fsync: 0 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_log_file_size: 0 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.keep_log_file_num: 1000 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.recycle_log_file_num: 0 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.allow_fallocate: 1 2024-04-03T08:42:34.068 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.allow_mmap_reads: 0 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.allow_mmap_writes: 0 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.use_direct_reads: 0 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.create_missing_column_families: 0 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.db_log_dir: 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.wal_dir: 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-03T08:42:34.069 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.advise_random_on_open: 1 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.db_write_buffer_size: 0 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.write_buffer_manager: 0x556435463400 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-03T08:42:34.070 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.rate_limiter: (nil) 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.wal_recovery_mode: 2 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.enable_thread_tracking: 0 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.enable_pipelined_write: 0 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.unordered_write: 0 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-03T08:42:34.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.row_cache: None 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.wal_filter: None 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.allow_ingest_behind: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.two_write_queues: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.manual_wal_flush: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.wal_compression: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.atomic_flush: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-03T08:42:34.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.log_readahead_size: 0 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.best_efforts_recovery: 0 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.allow_data_in_errors: 0 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.db_host_id: __hostname__ 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_background_jobs: 2 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_background_compactions: -1 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_subcompactions: 1 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-03T08:42:34.073 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_total_wal_size: 0 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_open_files: -1 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bytes_per_sync: 0 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_readahead_size: 0 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_background_flushes: -1 2024-04-03T08:42:34.074 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Compression algorithms supported: 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kZSTD supported: 0 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kXpressCompression supported: 0 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kLZ4HCCompression supported: 1 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kZlibCompression supported: 1 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kSnappyCompression supported: 1 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kLZ4Compression supported: 1 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: kBZip2Compression supported: 0 2024-04-03T08:42:34.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000015 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.merge_operator: 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_filter: None 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_filter_factory: None 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.sst_partitioner_factory: None 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-03T08:42:34.076 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55643548f8e0) 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks: 1 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_top_level_index_and_filter: 1 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_type: 0 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_index_type: 0 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_shortening: 1 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: checksum: 4 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: no_block_cache: 0 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache: 0x556435493090 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_name: BinnedLRUCache 2024-04-03T08:42:34.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_options: 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: capacity : 536870912 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: num_shard_bits : 4 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: strict_capacity_limit : 0 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: high_pri_pool_ratio: 0.000 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_compressed: (nil) 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: persistent_cache: (nil) 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size: 4096 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size_deviation: 10 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_restart_interval: 16 2024-04-03T08:42:34.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_block_restart_interval: 1 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: metadata_block_size: 4096 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: partition_filters: 0 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: use_delta_encoding: 1 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: filter_policy: bloomfilter 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: whole_key_filtering: 1 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: verify_compression: 0 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: read_amp_bytes_per_bit: 0 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: format_version: 5 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_index_compression: 1 2024-04-03T08:42:34.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_align: 0 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_auto_readahead_size: 262144 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: prepopulate_block_cache: 0 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: initial_auto_readahead_size: 8192 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: num_file_reads_for_auto_readahead: 2 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.write_buffer_size: 33554432 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_write_buffer_number: 2 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression: NoCompression 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression: Disabled 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.prefix_extractor: nullptr 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.num_levels: 7 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-03T08:42:34.080 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.level: 32767 2024-04-03T08:42:34.081 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.strategy: 0 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.enabled: false 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-03T08:42:34.082 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.target_file_size_base: 67108864 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-03T08:42:34.083 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.arena_block_size: 1048576 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.disable_auto_compactions: 0 2024-04-03T08:42:34.084 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-03T08:42:34.085 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-03T08:42:34.086 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-03T08:42:34.086 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-03T08:42:34.086 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-03T08:42:34.086 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-03T08:42:34.086 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.table_properties_collectors: 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.inplace_update_support: 0 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-03T08:42:34.087 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.bloom_locality: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.max_successive_merges: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.paranoid_file_checks: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.force_consistency_checks: 1 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.report_bg_io_stats: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.ttl: 2592000 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-03T08:42:34.088 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.enable_blob_files: false 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.min_blob_size: 0 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.blob_file_size: 268435456 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.blob_file_starting_level: 0 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-03T08:42:34.089 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11932, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 28fa53ed-c737-4e54-9c3f-577a6ad30c90 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133753748557, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133753760214, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2203517, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11933, "largest_seqno": 12832, "table_properties": {"data_size": 2198460, "index_size": 2950, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1093, "raw_key_size": 9662, "raw_average_key_size": 23, "raw_value_size": 2189290, "raw_average_value_size": 5288, "num_data_blocks": 136, "num_entries": 414, "num_filter_entries": 414, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712133753, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "28fa53ed-c737-4e54-9c3f-577a6ad30c90", "db_session_id": "FO57ONL18I0FXVG2KZOV", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133753760392, "job": 1, "event": "recovery_finished"} 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi157/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556435582000 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: DB pointer 0x55643556e000 2024-04-03T08:42:34.090 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** DB Stats ** 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-03T08:42:34.091 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L0 1/0 2.10 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 370.6 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L6 1/0 5.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Sum 2/0 7.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 370.6 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 370.6 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-03T08:42:34.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 370.6 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative compaction: 0.00 GB write, 127.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval compaction: 0.00 GB write, 127.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-03T08:42:34.093 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Block cache BinnedLRUCache@0x556435493090#7 capacity: 512.00 MB usage: 4.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: starting mon.smithi157 rank 0 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi157 fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???) e2 preinit fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).mds e17 new map 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).mds e17 print_map 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: e17 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: legacy client fscid: 1 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.094 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Filesystem 'cephfs' (1) 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: fs_name cephfs 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: epoch 17 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: tableserver 0 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: root 0 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: session_timeout 60 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: session_autoclose 300 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_file_size 1099511627776 2024-04-03T08:42:34.095 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_xattr_size 65536 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: required_client_features {} 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: last_failure 0 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: last_failure_osd_epoch 47 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_mds 1 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: in 0 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: up {0=14484} 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: failed 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: damaged 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: stopped 2024-04-03T08:42:34.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_pools [3] 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: metadata_pool 2 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: inline_data disabled 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: balancer 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: bal_rank_mask -1 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: standby_count_wanted 1 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Standby daemons: 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-04-03T08:42:34.097 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 ceph-mon[117693]: mon.smithi157@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 bash[117655]: 17c64a0a69eed1c0baa50872fae493481d6bab107079eefd322d4b8bc407a253 2024-04-03T08:42:34.098 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:33 smithi157 systemd[1]: Started Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:42:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:42:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:42:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: mon.smithi157 calling monitor election 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: mon.smithi157 is new leader, mons smithi157,smithi181 in quorum (ranks 0,1) 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: monmap e2: 2 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],smithi181=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: osdmap e49: 6 total, 6 up, 6 in 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: mgrmap e33: smithi157.qfvynr(active, since 44s), standbys: smithi181.mfhidq 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: from='mgr.14816 ' entity='' 2024-04-03T08:42:35.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:35 smithi157 ceph-mon[117693]: mgrmap e34: smithi157.qfvynr(active, since 44s), standbys: smithi181.mfhidq 2024-04-03T08:42:35.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: from='mgr.14816 172.21.15.157:0/1792743812' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: mon.smithi157 calling monitor election 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: mon.smithi157 is new leader, mons smithi157,smithi181 in quorum (ranks 0,1) 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: monmap e2: 2 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],smithi181=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: osdmap e49: 6 total, 6 up, 6 in 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: mgrmap e33: smithi157.qfvynr(active, since 44s), standbys: smithi181.mfhidq 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: overall HEALTH_OK 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: from='mgr.14816 ' entity='' 2024-04-03T08:42:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:35 smithi181 ceph-mon[44183]: mgrmap e34: smithi157.qfvynr(active, since 44s), standbys: smithi181.mfhidq 2024-04-03T08:42:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.387+0000 7f8476000700 1 -- 172.21.15.157:0/1715779533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84700709a0 msgr2=0x7f8470070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.387+0000 7f8476000700 1 --2- 172.21.15.157:0/1715779533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84700709a0 0x7f8470070e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f845c004940 tx=0x7f845c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.388+0000 7f8476000700 1 -- 172.21.15.157:0/1715779533 shutdown_connections 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.388+0000 7f8476000700 1 --2- 172.21.15.157:0/1715779533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84700709a0 0x7f8470070e10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.388+0000 7f8476000700 1 --2- 172.21.15.157:0/1715779533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470071f50 0x7f8470070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.388+0000 7f8476000700 1 -- 172.21.15.157:0/1715779533 >> 172.21.15.157:0/1715779533 conn(0x7f84700f8560 msgr2=0x7f84700fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.388+0000 7f8476000700 1 -- 172.21.15.157:0/1715779533 shutdown_connections 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.388+0000 7f8476000700 1 -- 172.21.15.157:0/1715779533 wait complete. 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f8476000700 1 Processor -- start 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f8476000700 1 -- start start 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f8476000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 0x7f847010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f8476000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 0x7f84701100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f8476000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701106b0 con 0x7f8470071f50 2024-04-03T08:42:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f8476000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470110f00 con 0x7f84700709a0 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f846ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 0x7f84701100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f846f400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 0x7f847010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f846f400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 0x7f847010fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:43838/0 (socket says 172.21.15.157:43838) 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f846ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 0x7f84701100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:60582/0 (socket says 172.21.15.157:60582) 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.389+0000 7f846f400700 1 -- 172.21.15.157:0/627184248 learned_addr learned my addr 172.21.15.157:0/627184248 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f846ea00700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 msgr2=0x7f847010fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f846ea00700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 0x7f847010fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f846ea00700 1 -- 172.21.15.157:0/627184248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c005040 con 0x7f8470071f50 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 0x7f847010fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:42:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f846ea00700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 0x7f84701100b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f845c00b0d0 tx=0x7f845c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f845c00e070 con 0x7f8470071f50 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f845c00b410 con 0x7f8470071f50 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8470111180 con 0x7f8470071f50 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.390+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f845c012600 con 0x7f8470071f50 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.391+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84701116c0 con 0x7f8470071f50 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.392+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847005f5f0 con 0x7f8470071f50 2024-04-03T08:42:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.393+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 34) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f845c00baa0 con 0x7f8470071f50 2024-04-03T08:42:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.394+0000 7f8467400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.394+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f845c08d8a0 con 0x7f8470071f50 2024-04-03T08:42:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.394+0000 7f846f400700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 msgr2=0x7f845406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/2321321664 2024-04-03T08:42:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.394+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-03T08:42:41.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.399+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f845c05abf0 con 0x7f8470071f50 2024-04-03T08:42:41.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.595+0000 7f846f400700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 msgr2=0x7f845406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/2321321664 2024-04-03T08:42:41.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.595+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-03T08:42:41.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.641+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 --> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8470111a50 con 0x7f845406d900 2024-04-03T08:42:41.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.996+0000 7f846f400700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 msgr2=0x7f845406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/2321321664 2024-04-03T08:42:41.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:41.996+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-03T08:42:42.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:42.797+0000 7f846f400700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 msgr2=0x7f845406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:6800/2321321664 2024-04-03T08:42:42.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:42.797+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-03T08:42:43.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:43.876+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 35) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f845c057490 con 0x7f8470071f50 2024-04-03T08:42:43.966 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:43 smithi157 ceph-mon[117693]: Standby manager daemon smithi181.mfhidq restarted 2024-04-03T08:42:43.967 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:43 smithi157 ceph-mon[117693]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:42:43.967 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:43 smithi157 ceph-mon[117693]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:42:43.967 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:43 smithi157 ceph-mon[117693]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:42:43.967 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:43 smithi157 ceph-mon[117693]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:42:43.967 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:43 smithi157 ceph-mon[117693]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:42:44.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:43 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq restarted 2024-04-03T08:42:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:43 smithi181 ceph-mon[44183]: Standby manager daemon smithi181.mfhidq started 2024-04-03T08:42:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:43 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/crt"}]: dispatch 2024-04-03T08:42:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:43 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-03T08:42:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:43 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi181.mfhidq/key"}]: dispatch 2024-04-03T08:42:44.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:43 smithi181 ceph-mon[44183]: from='mgr.? 172.21.15.181:0/3478287910' entity='mgr.smithi181.mfhidq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-03T08:42:44.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:44.128+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mgrmap(e 36) v1 ==== 91110+0+0 (secure 0 0 0) 0x7f845c08bba0 con 0x7f8470071f50 2024-04-03T08:42:44.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:44.128+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 msgr2=0x7f845406fdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-03T08:42:44.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:44.128+0000 7f8467400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.133+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mon.0 v2:172.21.15.157:3300/0 9 ==== mgrmap(e 37) v1 ==== 91237+0+0 (secure 0 0 0) 0x7f845c057d60 con 0x7f8470071f50 2024-04-03T08:42:45.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.133+0000 7f8467400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f84540288e0 0x7f8454028cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.133+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8470111a50 con 0x7f84540288e0 2024-04-03T08:42:45.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.135+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f84540288e0 0x7f8454028cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.136+0000 7f846f400700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f84540288e0 0x7f8454028cb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8460005010 tx=0x7f846000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:45.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.141+0000 7f8467400700 1 -- 172.21.15.157:0/627184248 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f8470111a50 con 0x7f84540288e0 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: mgrmap e35: smithi157.qfvynr(active, since 52s), standbys: smithi181.mfhidq 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: Active manager daemon smithi157.qfvynr restarted 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: Activating manager daemon smithi157.qfvynr 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: osdmap e50: 6 total, 6 up, 6 in 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: mgrmap e36: smithi157.qfvynr(active, starting, since 0.00763092s), standbys: smithi181.mfhidq 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:42:45.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:45.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:45.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:42:45.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:42:45.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:42:45.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f84540288e0 msgr2=0x7f8454028cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f84540288e0 0x7f8454028cb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8460005010 tx=0x7f846000b040 comp rx=0 tx=0).stop 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 msgr2=0x7f84701100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 0x7f84701100b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f845c00b0d0 tx=0x7f845c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 shutdown_connections 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f84540288e0 0x7f8454028cb0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:6800/2321321664,v1:172.21.15.157:6801/2321321664] conn(0x7f845406d900 0x7f845406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700709a0 0x7f847010fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 --2- 172.21.15.157:0/627184248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8470071f50 0x7f84701100b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 >> 172.21.15.157:0/627184248 conn(0x7f84700f8560 msgr2=0x7f84700f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 shutdown_connections 2024-04-03T08:42:45.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.146+0000 7f8476000700 1 -- 172.21.15.157:0/627184248 wait complete. 2024-04-03T08:42:45.166 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 -- 172.21.15.157:0/4194660649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 msgr2=0x7f6470070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 --2- 172.21.15.157:0/4194660649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f6470070d60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f645c004940 tx=0x7f645c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 -- 172.21.15.157:0/4194660649 shutdown_connections 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 --2- 172.21.15.157:0/4194660649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f6470070d60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 --2- 172.21.15.157:0/4194660649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 0x7f64700703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 -- 172.21.15.157:0/4194660649 >> 172.21.15.157:0/4194660649 conn(0x7f64700f8390 msgr2=0x7f64700fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 -- 172.21.15.157:0/4194660649 shutdown_connections 2024-04-03T08:42:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.296+0000 7f646f200700 1 -- 172.21.15.157:0/4194660649 wait complete. 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646f200700 1 Processor -- start 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646f200700 1 -- start start 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646f200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f647010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 0x7f647010ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646f200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701105a0 con 0x7f64700708f0 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470110d80 con 0x7f6470071ea0 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f647010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f647010fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59190/0 (socket says 172.21.15.157:59190) 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646de00700 1 -- 172.21.15.157:0/1926797342 learned_addr learned my addr 172.21.15.157:0/1926797342 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.297+0000 7f646d400700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 0x7f647010ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646de00700 1 -- 172.21.15.157:0/1926797342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 msgr2=0x7f647010ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646de00700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 0x7f647010ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646de00700 1 -- 172.21.15.157:0/1926797342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c005040 con 0x7f64700708f0 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646d400700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 0x7f647010ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646de00700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f647010fa60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6460002a80 tx=0x7f6460004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6460007cc0 con 0x7f64700708f0 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f646000f040 con 0x7f64700708f0 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6470111060 con 0x7f64700708f0 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646000dad0 con 0x7f64700708f0 2024-04-03T08:42:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.298+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64701115a0 con 0x7f64700708f0 2024-04-03T08:42:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.299+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64700fc010 con 0x7f64700708f0 2024-04-03T08:42:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.300+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 37) v1 ==== 91237+0+0 (secure 0 0 0) 0x7f646000dc30 con 0x7f64700708f0 2024-04-03T08:42:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.301+0000 7f6466000700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f645406d4e0 0x7f645406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.301+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f646008c750 con 0x7f64700708f0 2024-04-03T08:42:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.302+0000 7f646d400700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f645406d4e0 0x7f645406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.302+0000 7f646d400700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f645406d4e0 0x7f645406f990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b020 tx=0x7f645c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:45.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.307+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6460056200 con 0x7f64700708f0 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: mgrmap e35: smithi157.qfvynr(active, since 52s), standbys: smithi181.mfhidq 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: Active manager daemon smithi157.qfvynr restarted 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: Activating manager daemon smithi157.qfvynr 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: osdmap e50: 6 total, 6 up, 6 in 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: mgrmap e36: smithi157.qfvynr(active, starting, since 0.00763092s), standbys: smithi181.mfhidq 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:42:45.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi157.qfvynr", "id": "smithi157.qfvynr"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr metadata", "who": "smithi181.mfhidq", "id": "smithi181.mfhidq"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-03T08:42:45.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: Manager daemon smithi157.qfvynr is now available 2024-04-03T08:42:45.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:45.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:45.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:42:45.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/mirror_snapshot_schedule"}]: dispatch 2024-04-03T08:42:45.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:44 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.qfvynr/trash_purge_schedule"}]: dispatch 2024-04-03T08:42:45.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.537+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6470111980 con 0x7f645406d4e0 2024-04-03T08:42:45.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.538+0000 7f6466000700 1 -- 172.21.15.157:0/1926797342 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f6470111980 con 0x7f645406d4e0 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f645406d4e0 msgr2=0x7f645406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f645406d4e0 0x7f645406f990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b020 tx=0x7f645c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 msgr2=0x7f647010fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f647010fa60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6460002a80 tx=0x7f6460004600 comp rx=0 tx=0).stop 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 shutdown_connections 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f645406d4e0 0x7f645406f990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64700708f0 0x7f647010fa60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 --2- 172.21.15.157:0/1926797342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6470071ea0 0x7f647010ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 >> 172.21.15.157:0/1926797342 conn(0x7f64700f8390 msgr2=0x7f64700f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 shutdown_connections 2024-04-03T08:42:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.541+0000 7f646f200700 1 -- 172.21.15.157:0/1926797342 wait complete. 2024-04-03T08:42:45.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.683+0000 7f66b4a00700 1 -- 172.21.15.157:0/4170127862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 msgr2=0x7f66b0070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.683+0000 7f66b4a00700 1 --2- 172.21.15.157:0/4170127862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b0070d60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f669c004940 tx=0x7f669c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.684+0000 7f66b4a00700 1 -- 172.21.15.157:0/4170127862 shutdown_connections 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.684+0000 7f66b4a00700 1 --2- 172.21.15.157:0/4170127862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b0070d60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.684+0000 7f66b4a00700 1 --2- 172.21.15.157:0/4170127862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66b0071ea0 0x7f66b00703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.684+0000 7f66b4a00700 1 -- 172.21.15.157:0/4170127862 >> 172.21.15.157:0/4170127862 conn(0x7f66b00f8550 msgr2=0x7f66b00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.684+0000 7f66b4a00700 1 -- 172.21.15.157:0/4170127862 shutdown_connections 2024-04-03T08:42:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.684+0000 7f66b4a00700 1 -- 172.21.15.157:0/4170127862 wait complete. 2024-04-03T08:42:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.685+0000 7f66b4a00700 1 Processor -- start 2024-04-03T08:42:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.685+0000 7f66b4a00700 1 -- start start 2024-04-03T08:42:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.685+0000 7f66b4a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.685+0000 7f66b4a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66b0071ea0 0x7f66b01100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.685+0000 7f66b4a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b01106a0 con 0x7f66b00708f0 2024-04-03T08:42:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.685+0000 7f66b4a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0110810 con 0x7f66b0071ea0 2024-04-03T08:42:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59212/0 (socket says 172.21.15.157:59212) 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 -- 172.21.15.157:0/3208725168 learned_addr learned my addr 172.21.15.157:0/3208725168 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ad400700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66b0071ea0 0x7f66b01100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 -- 172.21.15.157:0/3208725168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66b0071ea0 msgr2=0x7f66b01100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66b0071ea0 0x7f66b01100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 -- 172.21.15.157:0/3208725168 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c005040 con 0x7f66b00708f0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.686+0000 7f66ade00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b010fb60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66a0002a80 tx=0x7f66a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.687+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66a0007cc0 con 0x7f66b00708f0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.687+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66a000f040 con 0x7f66b00708f0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.687+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b0115270 con 0x7f66b00708f0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.687+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66a000da30 con 0x7f66b00708f0 2024-04-03T08:42:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.687+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b0115830 con 0x7f66b00708f0 2024-04-03T08:42:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.688+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b004c710 con 0x7f66b00708f0 2024-04-03T08:42:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.689+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 37) v1 ==== 91237+0+0 (secure 0 0 0) 0x7f66a000db90 con 0x7f66b00708f0 2024-04-03T08:42:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.690+0000 7f66a6000700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f669406d4e0 0x7f669406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.690+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f66a008c800 con 0x7f66b00708f0 2024-04-03T08:42:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.690+0000 7f66ad400700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f669406d4e0 0x7f669406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:45.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.691+0000 7f66ad400700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f669406d4e0 0x7f669406f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f669c00b3b0 tx=0x7f669c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.694+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f66a0056230 con 0x7f66b00708f0 2024-04-03T08:42:45.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.921+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66b0103e60 con 0x7f669406d4e0 2024-04-03T08:42:45.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.933+0000 7f66a6000700 1 -- 172.21.15.157:0/3208725168 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f66b0103e60 con 0x7f669406d4e0 2024-04-03T08:42:45.933 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (2m) 21s ago 12m 14.9M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (13m) 21s ago 13m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (11m) 24s ago 11m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (104s) 21s ago 12m 75.1M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (6m) 21s ago 6m 13.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (6m) 21s ago 6m 138M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (6m) 24s ago 6m 13.0M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (6m) 24s ago 6m 99.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (69s) 21s ago 14m 491M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (28s) 24s ago 11m 56.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (14m) 21s ago 14m 53.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 645a846e71d9 2024-04-03T08:42:45.934 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (11m) 24s ago 11m 41.8M 2048M 17.2.7-805-g6fda41ff a49113eacc58 5889d25b0b95 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (2m) 21s ago 13m 8358k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (75s) 24s ago 11m 7109k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (10m) 21s ago 10m 226M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (10m) 21s ago 10m 243M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (9m) 21s ago 9m 203M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (9m) 24s ago 9m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (8m) 24s ago 8m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (8m) 24s ago 8m 222M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:42:45.935 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (34s) 21s ago 12m 35.9M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.935+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f669406d4e0 msgr2=0x7f669406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.935+0000 7f66b4a00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f669406d4e0 0x7f669406f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f669c00b3b0 tx=0x7f669c009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.935+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 msgr2=0x7f66b010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.935+0000 7f66b4a00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b010fb60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66a0002a80 tx=0x7f66a0004600 comp rx=0 tx=0).stop 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 shutdown_connections 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f669406d4e0 0x7f669406f990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b00708f0 0x7f66b010fb60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 --2- 172.21.15.157:0/3208725168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66b0071ea0 0x7f66b01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:45.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 >> 172.21.15.157:0/3208725168 conn(0x7f66b00f8550 msgr2=0x7f66b00f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:45.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 shutdown_connections 2024-04-03T08:42:45.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:45.936+0000 7f66b4a00700 1 -- 172.21.15.157:0/3208725168 wait complete. 2024-04-03T08:42:46.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 -- 172.21.15.157:0/181527561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 msgr2=0x7f20540fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 --2- 172.21.15.157:0/181527561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f20540fe460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2040004940 tx=0x7f2040009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:46.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 -- 172.21.15.157:0/181527561 shutdown_connections 2024-04-03T08:42:46.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 --2- 172.21.15.157:0/181527561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f20540fe460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 --2- 172.21.15.157:0/181527561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 0x7f20540fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 -- 172.21.15.157:0/181527561 >> 172.21.15.157:0/181527561 conn(0x7f20540f8560 msgr2=0x7f20540fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:46.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 -- 172.21.15.157:0/181527561 shutdown_connections 2024-04-03T08:42:46.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.088+0000 7f2059000700 1 -- 172.21.15.157:0/181527561 wait complete. 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.089+0000 7f2059000700 1 Processor -- start 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2059000700 1 -- start start 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2059000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 0x7f2054071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2059000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f2054070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2059000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540708c0 con 0x7f20540fdff0 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2059000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054070a30 con 0x7f20540fce80 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2051400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f2054070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2051400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f2054070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59232/0 (socket says 172.21.15.157:59232) 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2051400700 1 -- 172.21.15.157:0/1418692832 learned_addr learned my addr 172.21.15.157:0/1418692832 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.090+0000 7f2051e00700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 0x7f2054071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f2051e00700 1 -- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 msgr2=0x7f2054070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f2051e00700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f2054070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f2051e00700 1 -- 172.21.15.157:0/1418692832 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044005040 con 0x7f20540fce80 2024-04-03T08:42:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f2051e00700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 0x7f2054071e40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f20440094a0 tx=0x7f2044009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f204400e600 con 0x7f20540fce80 2024-04-03T08:42:46.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f204400f040 con 0x7f20540fce80 2024-04-03T08:42:46.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2044013c40 con 0x7f20540fce80 2024-04-03T08:42:46.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2040005040 con 0x7f20540fce80 2024-04-03T08:42:46.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.091+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540710e0 con 0x7f20540fce80 2024-04-03T08:42:46.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.093+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205405f5f0 con 0x7f20540fce80 2024-04-03T08:42:46.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.093+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 37) v1 ==== 91229+0+0 (secure 0 0 0) 0x7f204400e760 con 0x7f20540fce80 2024-04-03T08:42:46.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.094+0000 7f204a000700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f203806d4e0 0x7f203806f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.094+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f204408c7d0 con 0x7f20540fce80 2024-04-03T08:42:46.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.095+0000 7f2051400700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f203806d4e0 0x7f203806f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.095+0000 7f2051400700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f203806d4e0 0x7f203806f990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2040009fd0 tx=0x7f2040009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:46.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.100+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2044056240 con 0x7f20540fce80 2024-04-03T08:42:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.143+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mgrmap(e 38) v1 ==== 91525+0+0 (secure 0 0 0) 0x7f204408ece0 con 0x7f20540fce80 2024-04-03T08:42:46.401 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: [03/Apr/2024:08:42:44] ENGINE Bus STARTING 2024-04-03T08:42:46.401 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: [03/Apr/2024:08:42:44] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:42:46.402 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: [03/Apr/2024:08:42:44] ENGINE Serving on http://172.21.15.157:8765 2024-04-03T08:42:46.402 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: [03/Apr/2024:08:42:44] ENGINE Bus STARTED 2024-04-03T08:42:46.402 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: mgrmap e37: smithi157.qfvynr(active, since 1.014s), standbys: smithi181.mfhidq 2024-04-03T08:42:46.402 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:46.402 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:46 smithi181 ceph-mon[44183]: pgmap v3: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:46.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.412+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2054115a40 con 0x7f20540fce80 2024-04-03T08:42:46.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.413+0000 7f204a000700 1 -- 172.21.15.157:0/1418692832 <== mon.1 v2:172.21.15.181:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f2044088750 con 0x7f20540fce80 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:42:46.414 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 11, 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:42:46.415 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:42:46.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f203806d4e0 msgr2=0x7f203806f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f203806d4e0 0x7f203806f990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2040009fd0 tx=0x7f2040009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 msgr2=0x7f2054071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 0x7f2054071e40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f20440094a0 tx=0x7f2044009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 shutdown_connections 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f203806d4e0 0x7f203806f990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20540fce80 0x7f2054071e40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.415+0000 7f2059000700 1 --2- 172.21.15.157:0/1418692832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20540fdff0 0x7f2054070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.416+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 >> 172.21.15.157:0/1418692832 conn(0x7f20540f8560 msgr2=0x7f20540f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.416+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 shutdown_connections 2024-04-03T08:42:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.416+0000 7f2059000700 1 -- 172.21.15.157:0/1418692832 wait complete. 2024-04-03T08:42:46.520 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: [03/Apr/2024:08:42:44] ENGINE Bus STARTING 2024-04-03T08:42:46.520 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: [03/Apr/2024:08:42:44] ENGINE Serving on https://172.21.15.157:7150 2024-04-03T08:42:46.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: [03/Apr/2024:08:42:44] ENGINE Serving on http://172.21.15.157:8765 2024-04-03T08:42:46.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: [03/Apr/2024:08:42:44] ENGINE Bus STARTED 2024-04-03T08:42:46.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: mgrmap e37: smithi157.qfvynr(active, since 1.014s), standbys: smithi181.mfhidq 2024-04-03T08:42:46.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:46.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:46 smithi157 ceph-mon[117693]: pgmap v3: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:46.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 -- 172.21.15.157:0/4277911101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 msgr2=0x7f8eb40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 --2- 172.21.15.157:0/4277911101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb40703b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8004940 tx=0x7f8ea8009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:46.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 -- 172.21.15.157:0/4277911101 shutdown_connections 2024-04-03T08:42:46.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 --2- 172.21.15.157:0/4277911101 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 0x7f8eb4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 --2- 172.21.15.157:0/4277911101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb40703b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 -- 172.21.15.157:0/4277911101 >> 172.21.15.157:0/4277911101 conn(0x7f8eb40f83d0 msgr2=0x7f8eb40fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:46.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.556+0000 7f8ebb000700 1 -- 172.21.15.157:0/4277911101 shutdown_connections 2024-04-03T08:42:46.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.557+0000 7f8ebb000700 1 -- 172.21.15.157:0/4277911101 wait complete. 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.557+0000 7f8ebb000700 1 Processor -- start 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.557+0000 7f8ebb000700 1 -- start start 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8ebb000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 0x7f8eb4113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8ebb000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb41143b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8ebb000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4115120 con 0x7f8eb4071ea0 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8ebb000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4115290 con 0x7f8eb40708f0 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8eb9200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb41143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8eb9200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb41143b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59270/0 (socket says 172.21.15.157:59270) 2024-04-03T08:42:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8eb9200700 1 -- 172.21.15.157:0/393231449 learned_addr learned my addr 172.21.15.157:0/393231449 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.558+0000 7f8eb9c00700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 0x7f8eb4113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb9c00700 1 -- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 msgr2=0x7f8eb41143b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb9c00700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb41143b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb9c00700 1 -- 172.21.15.157:0/393231449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8005040 con 0x7f8eb40708f0 2024-04-03T08:42:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb9200700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb41143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb9c00700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 0x7f8eb4113e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8000c00 tx=0x7f8ea8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea800e070 con 0x7f8eb40708f0 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb41154b0 con 0x7f8eb40708f0 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ea8013de0 con 0x7f8eb40708f0 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea800be30 con 0x7f8eb40708f0 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.559+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb4115a40 con 0x7f8eb40708f0 2024-04-03T08:42:46.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.560+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb410c540 con 0x7f8eb40708f0 2024-04-03T08:42:46.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.561+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 38) v1 ==== 91525+0+0 (secure 0 0 0) 0x7f8ea800b680 con 0x7f8eb40708f0 2024-04-03T08:42:46.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.562+0000 7f8eb1600700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8e9c06d880 0x7f8e9c06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.562+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8ea808d770 con 0x7f8eb40708f0 2024-04-03T08:42:46.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.562+0000 7f8eb9200700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8e9c06d880 0x7f8e9c06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.563+0000 7f8eb9200700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8e9c06d880 0x7f8e9c06fd30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00041d0 tx=0x7f8ea000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:46.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.567+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8ea8056f70 con 0x7f8eb40708f0 2024-04-03T08:42:46.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.819+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8eb404bed0 con 0x7f8eb40708f0 2024-04-03T08:42:46.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.820+0000 7f8eb1600700 1 -- 172.21.15.157:0/393231449 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f8ea805a630 con 0x7f8eb40708f0 2024-04-03T08:42:46.820 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:42:46.820 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:42:46.821 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:42:46.822 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:42:46.823 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:42:46.824 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:46.824 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8e9c06d880 msgr2=0x7f8e9c06fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8e9c06d880 0x7f8e9c06fd30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00041d0 tx=0x7f8ea000b040 comp rx=0 tx=0).stop 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 msgr2=0x7f8eb4113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 0x7f8eb4113e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8000c00 tx=0x7f8ea8009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 shutdown_connections 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8e9c06d880 0x7f8e9c06fd30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40708f0 0x7f8eb4113e70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 --2- 172.21.15.157:0/393231449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb4071ea0 0x7f8eb41143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.822+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 >> 172.21.15.157:0/393231449 conn(0x7f8eb40f83d0 msgr2=0x7f8eb40f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.823+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 shutdown_connections 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.823+0000 7f8ebb000700 1 -- 172.21.15.157:0/393231449 wait complete. 2024-04-03T08:42:46.825 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 -- 172.21.15.157:0/3100791073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fcee0 msgr2=0x7f7b380fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 --2- 172.21.15.157:0/3100791073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fcee0 0x7f7b380fd310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b28004940 tx=0x7f7b28009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 -- 172.21.15.157:0/3100791073 shutdown_connections 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 --2- 172.21.15.157:0/3100791073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b380fe0d0 0x7f7b380fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 --2- 172.21.15.157:0/3100791073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fcee0 0x7f7b380fd310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 -- 172.21.15.157:0/3100791073 >> 172.21.15.157:0/3100791073 conn(0x7f7b380f8560 msgr2=0x7f7b380fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 -- 172.21.15.157:0/3100791073 shutdown_connections 2024-04-03T08:42:46.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.971+0000 7f7b3f200700 1 -- 172.21.15.157:0/3100791073 wait complete. 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.972+0000 7f7b3f200700 1 Processor -- start 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.972+0000 7f7b3f200700 1 -- start start 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.972+0000 7f7b3f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b380fcee0 0x7f7b3810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.972+0000 7f7b3f200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 0x7f7b3810df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.972+0000 7f7b3f200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3810e510 con 0x7f7b380fe0d0 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.972+0000 7f7b3f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3810ed60 con 0x7f7b380fcee0 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 0x7f7b3810df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 0x7f7b3810df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59298/0 (socket says 172.21.15.157:59298) 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 -- 172.21.15.157:0/1468798588 learned_addr learned my addr 172.21.15.157:0/1468798588 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37e00700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b380fcee0 0x7f7b3810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 -- 172.21.15.157:0/1468798588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b380fcee0 msgr2=0x7f7b3810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:46.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b380fcee0 0x7f7b3810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:46.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 -- 172.21.15.157:0/1468798588 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b28005040 con 0x7f7b380fe0d0 2024-04-03T08:42:46.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.973+0000 7f7b37400700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 0x7f7b3810df10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400eb40 tx=0x7f7b2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:46.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.974+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b24007cc0 con 0x7f7b380fe0d0 2024-04-03T08:42:46.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.974+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b2400f040 con 0x7f7b380fe0d0 2024-04-03T08:42:46.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.974+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b2400ca10 con 0x7f7b380fe0d0 2024-04-03T08:42:46.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.974+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3810efe0 con 0x7f7b380fe0d0 2024-04-03T08:42:46.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.974+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3810f520 con 0x7f7b380fe0d0 2024-04-03T08:42:46.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.975+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3805f5f0 con 0x7f7b380fe0d0 2024-04-03T08:42:46.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.976+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 38) v1 ==== 91533+0+0 (secure 0 0 0) 0x7f7b2400cc80 con 0x7f7b380fe0d0 2024-04-03T08:42:46.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.977+0000 7f7b2fe00700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f7b1c06d880 0x7f7b1c06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:46.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.978+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7b2408cbd0 con 0x7f7b380fe0d0 2024-04-03T08:42:46.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.978+0000 7f7b37e00700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f7b1c06d880 0x7f7b1c06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:46.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.979+0000 7f7b37e00700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f7b1c06d880 0x7f7b1c06fd30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b28013870 tx=0x7f7b28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:46.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:46.983+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7b24059ec0 con 0x7f7b380fe0d0 2024-04-03T08:42:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.216+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b3810f740 con 0x7f7b1c06d880 2024-04-03T08:42:47.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.218+0000 7f7b2fe00700 1 -- 172.21.15.157:0/1468798588 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f7b3810f740 con 0x7f7b1c06d880 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "2/21 daemons upgraded", 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:42:47.219 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.220+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f7b1c06d880 msgr2=0x7f7b1c06fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.220+0000 7f7b3f200700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f7b1c06d880 0x7f7b1c06fd30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b28013870 tx=0x7f7b28009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.220+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 msgr2=0x7f7b3810df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.220+0000 7f7b3f200700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 0x7f7b3810df10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400eb40 tx=0x7f7b2400b040 comp rx=0 tx=0).stop 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.220+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 shutdown_connections 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.220+0000 7f7b3f200700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f7b1c06d880 0x7f7b1c06fd30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.221+0000 7f7b3f200700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b380fcee0 0x7f7b3810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.221+0000 7f7b3f200700 1 --2- 172.21.15.157:0/1468798588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b380fe0d0 0x7f7b3810df10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.221+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 >> 172.21.15.157:0/1468798588 conn(0x7f7b380f8560 msgr2=0x7f7b380f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:47.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.221+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 shutdown_connections 2024-04-03T08:42:47.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.221+0000 7f7b3f200700 1 -- 172.21.15.157:0/1468798588 wait complete. 2024-04-03T08:42:47.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 -- 172.21.15.157:0/1281626421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680662e0 msgr2=0x7f5c680ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:47.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 --2- 172.21.15.157:0/1281626421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680662e0 0x7f5c680ff9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c58004940 tx=0x7f5c58009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:47.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 -- 172.21.15.157:0/1281626421 shutdown_connections 2024-04-03T08:42:47.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 --2- 172.21.15.157:0/1281626421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c680fff00 0x7f5c68102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 --2- 172.21.15.157:0/1281626421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680662e0 0x7f5c680ff9c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 -- 172.21.15.157:0/1281626421 >> 172.21.15.157:0/1281626421 conn(0x7f5c680f7430 msgr2=0x7f5c680f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:47.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.368+0000 7f5c6e200700 1 -- 172.21.15.157:0/1281626421 shutdown_connections 2024-04-03T08:42:47.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.369+0000 7f5c6e200700 1 -- 172.21.15.157:0/1281626421 wait complete. 2024-04-03T08:42:47.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.369+0000 7f5c6e200700 1 Processor -- start 2024-04-03T08:42:47.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.369+0000 7f5c6e200700 1 -- start start 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c6e200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c680662e0 0x7f5c6810fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c6e200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 0x7f5c681101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c6e200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c681107d0 con 0x7f5c680fff00 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c6e200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68110fd0 con 0x7f5c680662e0 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c66a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 0x7f5c681101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c67400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c680662e0 0x7f5c6810fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c66a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 0x7f5c681101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59318/0 (socket says 172.21.15.157:59318) 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c66a00700 1 -- 172.21.15.157:0/2614172826 learned_addr learned my addr 172.21.15.157:0/2614172826 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c66a00700 1 -- 172.21.15.157:0/2614172826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c680662e0 msgr2=0x7f5c6810fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c66a00700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c680662e0 0x7f5c6810fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.370+0000 7f5c66a00700 1 -- 172.21.15.157:0/2614172826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58005040 con 0x7f5c680fff00 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.371+0000 7f5c66a00700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 0x7f5c681101d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c54002a50 tx=0x7f5c540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:47.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.371+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c54007cc0 con 0x7f5c680fff00 2024-04-03T08:42:47.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.371+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c5400f040 con 0x7f5c680fff00 2024-04-03T08:42:47.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.371+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c5400da30 con 0x7f5c680fff00 2024-04-03T08:42:47.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.371+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c681112b0 con 0x7f5c680fff00 2024-04-03T08:42:47.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.371+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c681117a0 con 0x7f5c680fff00 2024-04-03T08:42:47.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.372+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6805f5f0 con 0x7f5c680fff00 2024-04-03T08:42:47.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.373+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 38) v1 ==== 91533+0+0 (secure 0 0 0) 0x7f5c5400db90 con 0x7f5c680fff00 2024-04-03T08:42:47.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.374+0000 7f5c5f400700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5c4c06d880 0x7f5c4c06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:42:47.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.374+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5c5408ce90 con 0x7f5c680fff00 2024-04-03T08:42:47.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.374+0000 7f5c67400700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5c4c06d880 0x7f5c4c06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:42:47.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.375+0000 7f5c67400700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5c4c06d880 0x7f5c4c06fd30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b3b0 tx=0x7f5c58009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:42:47.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.379+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5c5405a010 con 0x7f5c680fff00 2024-04-03T08:42:47.425 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:47 smithi181 ceph-mon[44183]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:47.426 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:47 smithi181 ceph-mon[44183]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:47.426 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:47 smithi181 ceph-mon[44183]: pgmap v4: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:47.426 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:47 smithi181 ceph-mon[44183]: mgrmap e38: smithi157.qfvynr(active, since 2s), standbys: smithi181.mfhidq 2024-04-03T08:42:47.426 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:47 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/1418692832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:47.426 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:47 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/393231449' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:42:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:47 smithi157 ceph-mon[117693]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:47 smithi157 ceph-mon[117693]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:47.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:47 smithi157 ceph-mon[117693]: pgmap v4: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:47.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:47 smithi157 ceph-mon[117693]: mgrmap e38: smithi157.qfvynr(active, since 2s), standbys: smithi181.mfhidq 2024-04-03T08:42:47.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:47 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1418692832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:47.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:47 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/393231449' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:42:47.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.671+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5c68111a10 con 0x7f5c680fff00 2024-04-03T08:42:47.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.671+0000 7f5c5f400700 1 -- 172.21.15.157:0/2614172826 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5c54059ba0 con 0x7f5c680fff00 2024-04-03T08:42:47.672 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:42:47.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5c4c06d880 msgr2=0x7f5c4c06fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:47.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5c4c06d880 0x7f5c4c06fd30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b3b0 tx=0x7f5c58009e30 comp rx=0 tx=0).stop 2024-04-03T08:42:47.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 msgr2=0x7f5c681101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:42:47.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 0x7f5c681101d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c54002a50 tx=0x7f5c540046b0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 shutdown_connections 2024-04-03T08:42:47.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5c4c06d880 0x7f5c4c06fd30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c680662e0 0x7f5c6810fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 --2- 172.21.15.157:0/2614172826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c680fff00 0x7f5c681101d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:42:47.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.674+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 >> 172.21.15.157:0/2614172826 conn(0x7f5c680f7430 msgr2=0x7f5c680fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:42:47.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.675+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 shutdown_connections 2024-04-03T08:42:47.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:42:47.675+0000 7f5c6e200700 1 -- 172.21.15.157:0/2614172826 wait complete. 2024-04-03T08:42:48.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:48 smithi157 ceph-mon[117693]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:48.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:48 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2614172826' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:42:48.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:48 smithi181 ceph-mon[44183]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:42:48.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:48 smithi181 ceph-mon[44183]: from='client.? 172.21.15.157:0/2614172826' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:42:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:49 smithi157 ceph-mon[117693]: pgmap v5: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:49 smithi157 ceph-mon[117693]: mgrmap e39: smithi157.qfvynr(active, since 4s), standbys: smithi181.mfhidq 2024-04-03T08:42:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:49.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:49 smithi181 ceph-mon[44183]: pgmap v5: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:49.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:49 smithi181 ceph-mon[44183]: mgrmap e39: smithi157.qfvynr(active, since 4s), standbys: smithi181.mfhidq 2024-04-03T08:42:49.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:49 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:49 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:50 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:50 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:50 smithi181 ceph-mon[44183]: pgmap v6: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:50 smithi157 ceph-mon[117693]: pgmap v6: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-03T08:42:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:52.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:52.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:51 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:52.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:51 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:53.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:53 smithi157 ceph-mon[117693]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-03T08:42:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:53 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:53 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:53.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:53 smithi181 ceph-mon[44183]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-03T08:42:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:42:55.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:42:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:42:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-03T08:42:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:55.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:54 smithi157 ceph-mon[117693]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:55.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.conf 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.conf 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:55.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:54 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.conf 2024-04-03T08:42:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:55 smithi157 ceph-mon[117693]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:56.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:55 smithi157 ceph-mon[117693]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:56.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:55 smithi181 ceph-mon[44183]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:56.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:55 smithi181 ceph-mon[44183]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-04-03T08:42:57.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:57.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: pgmap v9: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:57.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-03T08:42:57.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: Updating smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:57.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: Updating smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-03T08:42:57.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: pgmap v9: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-03T08:42:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:42:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:42:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:57 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: Upgrade: Updating mon.smithi181 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: Deploying daemon mon.smithi181 on smithi181 2024-04-03T08:42:59.218 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:58 smithi181 ceph-mon[44183]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:42:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: Upgrade: Updating mon.smithi181 2024-04-03T08:42:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:42:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:42:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:42:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:42:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: Deploying daemon mon.smithi181 on smithi181 2024-04-03T08:42:59.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:58 smithi157 ceph-mon[117693]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-03T08:43:00.147 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:59 smithi181 systemd[1]: Stopping Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:43:00.147 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:42:59 smithi181 ceph-mon[44183]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:00.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:42:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:00 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi181[44157]: 2024-04-03T08:43:00.145+0000 7f84f7a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi181 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:43:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:00 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi181[44157]: 2024-04-03T08:43:00.145+0000 7f84f7a00700 -1 mon.smithi181@1(peon) e2 *** Got Signal Terminated *** 2024-04-03T08:43:01.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:00 smithi181 bash[100904]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi181 2024-04-03T08:43:01.397 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:01 smithi181 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi181.service: Succeeded. 2024-04-03T08:43:01.397 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:01 smithi181 systemd[1]: Stopped Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:43:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:01 smithi181 systemd[1]: Starting Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:43:02.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: set uid:gid to 167:167 (ceph:ceph) 2024-04-03T08:43:02.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 7 2024-04-03T08:43:02.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: pidfile_write: ignore empty --pid-file 2024-04-03T08:43:02.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: load: jerasure load: lrc 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: RocksDB version: 7.9.2 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Git sha 0 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Compile date 2024-03-20 03:10:51 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: DB SUMMARY 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: DB Session ID: IKQY0ZEMI0MX00MSA6RC 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: CURRENT file: CURRENT 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: IDENTITY file: IDENTITY 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1083 Bytes 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi181/store.db dir, Total Num: 1, files: 000027.sst 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi181/store.db: 000025.log size: 6429833 ; 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.error_if_exists: 0 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.create_if_missing: 0 2024-04-03T08:43:02.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.paranoid_checks: 1 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.env: 0x55a0337c1b20 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.fs: PosixFileSystem 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.info_log: 0x55a0358837c0 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_file_opening_threads: 16 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.statistics: (nil) 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.use_fsync: 0 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_log_file_size: 0 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.keep_log_file_num: 1000 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.recycle_log_file_num: 0 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.allow_fallocate: 1 2024-04-03T08:43:02.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.allow_mmap_reads: 0 2024-04-03T08:43:02.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.allow_mmap_writes: 0 2024-04-03T08:43:02.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.use_direct_reads: 0 2024-04-03T08:43:02.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-03T08:43:02.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.create_missing_column_families: 0 2024-04-03T08:43:02.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.db_log_dir: 2024-04-03T08:43:02.600 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.wal_dir: 2024-04-03T08:43:02.601 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-03T08:43:02.601 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.advise_random_on_open: 1 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.db_write_buffer_size: 0 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.write_buffer_manager: 0x55a035857400 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-03T08:43:02.602 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.rate_limiter: (nil) 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.wal_recovery_mode: 2 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.enable_thread_tracking: 0 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.enable_pipelined_write: 0 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.unordered_write: 0 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.row_cache: None 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.wal_filter: None 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-03T08:43:02.603 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.allow_ingest_behind: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.two_write_queues: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.manual_wal_flush: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.wal_compression: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.atomic_flush: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.log_readahead_size: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.best_efforts_recovery: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.allow_data_in_errors: 0 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.db_host_id: __hostname__ 2024-04-03T08:43:02.604 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_background_jobs: 2 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_background_compactions: -1 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_subcompactions: 1 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_total_wal_size: 0 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_open_files: -1 2024-04-03T08:43:02.605 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bytes_per_sync: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_readahead_size: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_background_flushes: -1 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Compression algorithms supported: 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kZSTD supported: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kXpressCompression supported: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kLZ4HCCompression supported: 1 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kZlibCompression supported: 1 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kSnappyCompression supported: 1 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kLZ4Compression supported: 1 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: kBZip2Compression supported: 0 2024-04-03T08:43:02.606 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi181/store.db/MANIFEST-000009 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.merge_operator: 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_filter: None 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_filter_factory: None 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.sst_partitioner_factory: None 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a0358838e0) 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-04-03T08:43:02.607 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: index_type: 0 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: data_block_index_type: 0 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: index_shortening: 1 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: checksum: 4 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: no_block_cache: 0 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache: 0x55a035887090 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache_options: 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: capacity : 536870912 2024-04-03T08:43:02.608 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: num_shard_bits : 4 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: strict_capacity_limit : 0 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_cache_compressed: (nil) 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: persistent_cache: (nil) 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_size: 4096 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_size_deviation: 10 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_restart_interval: 16 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: index_block_restart_interval: 1 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: metadata_block_size: 4096 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: partition_filters: 0 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: use_delta_encoding: 1 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: filter_policy: bloomfilter 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: whole_key_filtering: 1 2024-04-03T08:43:02.609 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: verify_compression: 0 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: format_version: 5 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: enable_index_compression: 1 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: block_align: 0 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: max_auto_readahead_size: 262144 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: prepopulate_block_cache: 0 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: initial_auto_readahead_size: 8192 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: num_file_reads_for_auto_readahead: 2 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.write_buffer_size: 33554432 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_write_buffer_number: 2 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression: NoCompression 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression: Disabled 2024-04-03T08:43:02.610 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.prefix_extractor: nullptr 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.num_levels: 7 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-03T08:43:02.611 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.level: 32767 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.strategy: 0 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.enabled: false 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.target_file_size_base: 67108864 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-03T08:43:02.612 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.arena_block_size: 1048576 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-03T08:43:02.613 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.disable_auto_compactions: 0 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-03T08:43:02.614 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.table_properties_collectors: 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.inplace_update_support: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.bloom_locality: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.max_successive_merges: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.paranoid_file_checks: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.force_consistency_checks: 1 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.report_bg_io_stats: 0 2024-04-03T08:43:02.615 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.ttl: 2592000 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.enable_blob_files: false 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.min_blob_size: 0 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.blob_file_size: 268435456 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.blob_file_starting_level: 0 2024-04-03T08:43:02.616 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi181/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12144, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9724970b-d694-47a7-abdf-25aa07bedea4 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133782108225, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133782130804, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3894817, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12149, "largest_seqno": 13634, "table_properties": {"data_size": 3887761, "index_size": 4437, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 14502, "raw_average_key_size": 23, "raw_value_size": 3874187, "raw_average_value_size": 6218, "num_data_blocks": 203, "num_entries": 623, "num_filter_entries": 623, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712133782, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9724970b-d694-47a7-abdf-25aa07bedea4", "db_session_id": "IKQY0ZEMI0MX00MSA6RC", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712133782130932, "job": 1, "event": "recovery_finished"} 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi181/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-03T08:43:02.617 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a035976000 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: DB pointer 0x55a035962000 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** DB Stats ** 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.618 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** Compaction Stats [default] ** 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: L0 1/0 3.71 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 476.6 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: L6 1/0 5.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Sum 2/0 9.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 476.6 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 476.6 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** Compaction Stats [default] ** 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 476.6 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-03T08:43:02.619 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Cumulative compaction: 0.00 GB write, 134.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Interval compaction: 0.00 GB write, 134.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Block cache BinnedLRUCache@0x55a035887090#7 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: starting mon.smithi181 rank 1 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi181 fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:43:02.620 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???) e2 preinit fsid af80a140-f193-11ee-b648-cb9ed24678a4 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).mds e17 new map 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).mds e17 print_map 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: e17 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: legacy client fscid: 1 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Filesystem 'cephfs' (1) 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: fs_name cephfs 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: epoch 17 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: tableserver 0 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: root 0 2024-04-03T08:43:02.621 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: session_timeout 60 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: session_autoclose 300 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: max_file_size 1099511627776 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: max_xattr_size 65536 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: required_client_features {} 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: last_failure 0 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: last_failure_osd_epoch 47 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: max_mds 1 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: in 0 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: up {0=14484} 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: failed 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: damaged 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: stopped 2024-04-03T08:43:02.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: data_pools [3] 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: metadata_pool 2 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: inline_data disabled 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: balancer 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: bal_rank_mask -1 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: standby_count_wanted 1 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: [mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: [mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: Standby daemons: 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: [mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout: [mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:02.623 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-03T08:43:02.624 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-03T08:43:02.624 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-03T08:43:02.624 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-03T08:43:02.624 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 ceph-mon[101094]: mon.smithi181@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-03T08:43:02.624 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 bash[101057]: 76e5100ed852f67822e06bb640a5b84e6931a333d41574a911a4994c42a17c2d 2024-04-03T08:43:02.624 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:02 smithi181 systemd[1]: Started Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:43:04.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:43:04.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: mon.smithi181 calling monitor election 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: mon.smithi157 calling monitor election 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: mon.smithi157 is new leader, mons smithi157,smithi181 in quorum (ranks 0,1) 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: monmap e3: 2 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],smithi181=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: osdmap e50: 6 total, 6 up, 6 in 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: mgrmap e39: smithi157.qfvynr(active, since 19s), standbys: smithi181.mfhidq 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: mon.smithi181 calling monitor election 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: mon.smithi157 calling monitor election 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mon metadata", "id": "smithi181"}]: dispatch 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: mon.smithi157 is new leader, mons smithi157,smithi181 in quorum (ranks 0,1) 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: monmap e3: 2 mons at {smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],smithi181=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: osdmap e50: 6 total, 6 up, 6 in 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: mgrmap e39: smithi157.qfvynr(active, since 19s), standbys: smithi181.mfhidq 2024-04-03T08:43:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T08:43:04.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:04.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:04.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:43:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:05 smithi181 ceph-mon[101094]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:05.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:05 smithi157 ceph-mon[117693]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:07 smithi157 ceph-mon[117693]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:07 smithi181 ceph-mon[101094]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:07.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:09.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:09.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:09.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:09 smithi181 ceph-mon[101094]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:09.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:09.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:09.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:09 smithi157 ceph-mon[117693]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:11 smithi157 ceph-mon[117693]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:11 smithi181 ceph-mon[101094]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:43:13.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:43:13.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:13.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:43:13.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:43:13.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:14.524 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:14 smithi157 ceph-mon[117693]: Reconfiguring mon.smithi157 (monmap changed)... 2024-04-03T08:43:14.525 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:14 smithi157 ceph-mon[117693]: Reconfiguring daemon mon.smithi157 on smithi157 2024-04-03T08:43:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:14 smithi181 ceph-mon[101094]: Reconfiguring mon.smithi157 (monmap changed)... 2024-04-03T08:43:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:14 smithi181 ceph-mon[101094]: Reconfiguring daemon mon.smithi157 on smithi157 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:43:15.503 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.qfvynr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:43:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:16 smithi157 ceph-mon[117693]: Reconfiguring mgr.smithi157.qfvynr (monmap changed)... 2024-04-03T08:43:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:16 smithi157 ceph-mon[117693]: Reconfiguring daemon mgr.smithi157.qfvynr on smithi157 2024-04-03T08:43:16.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:16 smithi181 ceph-mon[101094]: Reconfiguring mgr.smithi157.qfvynr (monmap changed)... 2024-04-03T08:43:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:16 smithi181 ceph-mon[101094]: Reconfiguring daemon mgr.smithi157.qfvynr on smithi157 2024-04-03T08:43:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:17 smithi157 ceph-mon[117693]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:17.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:17 smithi181 ceph-mon[101094]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 -- 172.21.15.157:0/3465704922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 msgr2=0x7f721c070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 --2- 172.21.15.157:0/3465704922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c070d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7208004940 tx=0x7f7208009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 -- 172.21.15.157:0/3465704922 shutdown_connections 2024-04-03T08:43:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 --2- 172.21.15.157:0/3465704922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c070d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 --2- 172.21.15.157:0/3465704922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f721c071e40 0x7f721c070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 -- 172.21.15.157:0/3465704922 >> 172.21.15.157:0/3465704922 conn(0x7f721c0f85a0 msgr2=0x7f721c0fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 -- 172.21.15.157:0/3465704922 shutdown_connections 2024-04-03T08:43:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.817+0000 7f7223800700 1 -- 172.21.15.157:0/3465704922 wait complete. 2024-04-03T08:43:17.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.818+0000 7f7223800700 1 Processor -- start 2024-04-03T08:43:17.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.818+0000 7f7223800700 1 -- start start 2024-04-03T08:43:17.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.818+0000 7f7223800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7223800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f721c071e40 0x7f721c110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7223800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c110800 con 0x7f721c070890 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7223800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c110ff0 con 0x7f721c071e40 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c10fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48958/0 (socket says 172.21.15.157:48958) 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 -- 172.21.15.157:0/1904050638 learned_addr learned my addr 172.21.15.157:0/1904050638 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f721be00700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f721c071e40 0x7f721c110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 -- 172.21.15.157:0/1904050638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f721c071e40 msgr2=0x7f721c110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f721c071e40 0x7f721c110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 -- 172.21.15.157:0/1904050638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208005040 con 0x7f721c070890 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.819+0000 7f7220e00700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c10fc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f721000b790 tx=0x7f7210009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.820+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f721000f6f0 con 0x7f721c070890 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.820+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c1112d0 con 0x7f721c070890 2024-04-03T08:43:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.820+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f721000fd20 con 0x7f721c070890 2024-04-03T08:43:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.820+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72100103a0 con 0x7f721c070890 2024-04-03T08:43:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.820+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c111890 con 0x7f721c070890 2024-04-03T08:43:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.821+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c05f5f0 con 0x7f721c070890 2024-04-03T08:43:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.822+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f7210011400 con 0x7f721c070890 2024-04-03T08:43:17.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.823+0000 7f7218c00700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f720406d900 0x7f720406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:17.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.823+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f721008cec0 con 0x7f721c070890 2024-04-03T08:43:17.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.823+0000 7f721be00700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f720406d900 0x7f720406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:17.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.824+0000 7f721be00700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f720406d900 0x7f720406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7208009fd0 tx=0x7f7208009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:17.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:17.828+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f721005a110 con 0x7f721c070890 2024-04-03T08:43:18.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.061+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f721c111bd0 con 0x7f720406d900 2024-04-03T08:43:18.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.062+0000 7f7218c00700 1 -- 172.21.15.157:0/1904050638 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f721c111bd0 con 0x7f720406d900 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f720406d900 msgr2=0x7f720406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f720406d900 0x7f720406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7208009fd0 tx=0x7f7208009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 msgr2=0x7f721c10fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c10fc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f721000b790 tx=0x7f7210009220 comp rx=0 tx=0).stop 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 shutdown_connections 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f720406d900 0x7f720406fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f721c070890 0x7f721c10fc30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 --2- 172.21.15.157:0/1904050638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f721c071e40 0x7f721c110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 >> 172.21.15.157:0/1904050638 conn(0x7f721c0f85a0 msgr2=0x7f721c0f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:18.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 shutdown_connections 2024-04-03T08:43:18.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.065+0000 7f7223800700 1 -- 172.21.15.157:0/1904050638 wait complete. 2024-04-03T08:43:18.081 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 -- 172.21.15.157:0/1889342439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fe0d0 msgr2=0x7f15640fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 --2- 172.21.15.157:0/1889342439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fe0d0 0x7f15640fe540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f154c004940 tx=0x7f154c009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 -- 172.21.15.157:0/1889342439 shutdown_connections 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 --2- 172.21.15.157:0/1889342439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fe0d0 0x7f15640fe540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 --2- 172.21.15.157:0/1889342439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15640fcee0 0x7f15640fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 -- 172.21.15.157:0/1889342439 >> 172.21.15.157:0/1889342439 conn(0x7f15640f8560 msgr2=0x7f15640fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 -- 172.21.15.157:0/1889342439 shutdown_connections 2024-04-03T08:43:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.208+0000 7f1569e00700 1 -- 172.21.15.157:0/1889342439 wait complete. 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.209+0000 7f1569e00700 1 Processor -- start 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.209+0000 7f1569e00700 1 -- start start 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1569e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 0x7f156410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1569e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15640fe0d0 0x7f1564110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1569e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1564110850 con 0x7f15640fcee0 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1569e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1564110f90 con 0x7f15640fe0d0 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1562a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 0x7f156410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1562a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 0x7f156410fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48970/0 (socket says 172.21.15.157:48970) 2024-04-03T08:43:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1562a00700 1 -- 172.21.15.157:0/910377317 learned_addr learned my addr 172.21.15.157:0/910377317 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f155be00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15640fe0d0 0x7f1564110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1562a00700 1 -- 172.21.15.157:0/910377317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15640fe0d0 msgr2=0x7f1564110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1562a00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15640fe0d0 0x7f1564110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.210+0000 7f1562a00700 1 -- 172.21.15.157:0/910377317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c005040 con 0x7f15640fcee0 2024-04-03T08:43:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.211+0000 7f1562a00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 0x7f156410fd10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1554002a80 tx=0x7f1554004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.211+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1554007cc0 con 0x7f15640fcee0 2024-04-03T08:43:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.211+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f155400f040 con 0x7f15640fcee0 2024-04-03T08:43:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.211+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1564111270 con 0x7f15640fcee0 2024-04-03T08:43:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.211+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155400da30 con 0x7f15640fcee0 2024-04-03T08:43:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.211+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1564111830 con 0x7f15640fcee0 2024-04-03T08:43:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.212+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1564101a60 con 0x7f15640fcee0 2024-04-03T08:43:18.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.213+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f155400db90 con 0x7f15640fcee0 2024-04-03T08:43:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.215+0000 7f155aa00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f154806d900 0x7f154806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.215+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f155408ce10 con 0x7f15640fcee0 2024-04-03T08:43:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.215+0000 7f155be00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f154806d900 0x7f154806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.215+0000 7f155be00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f154806d900 0x7f154806fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f154c00b3b0 tx=0x7f154c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:18.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.220+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1554059ff0 con 0x7f15640fcee0 2024-04-03T08:43:18.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:18 smithi157 ceph-mon[117693]: Reconfiguring crash.smithi157 (monmap changed)... 2024-04-03T08:43:18.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:18 smithi157 ceph-mon[117693]: Reconfiguring daemon crash.smithi157 on smithi157 2024-04-03T08:43:18.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-03T08:43:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:18.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.454+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1564111aa0 con 0x7f154806d900 2024-04-03T08:43:18.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.456+0000 7f155aa00700 1 -- 172.21.15.157:0/910377317 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1564111aa0 con 0x7f154806d900 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f154806d900 msgr2=0x7f154806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f154806d900 0x7f154806fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f154c00b3b0 tx=0x7f154c009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 msgr2=0x7f156410fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 0x7f156410fd10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1554002a80 tx=0x7f1554004600 comp rx=0 tx=0).stop 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 shutdown_connections 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f154806d900 0x7f154806fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15640fcee0 0x7f156410fd10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 --2- 172.21.15.157:0/910377317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15640fe0d0 0x7f1564110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 >> 172.21.15.157:0/910377317 conn(0x7f15640f8560 msgr2=0x7f15640f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:18.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 shutdown_connections 2024-04-03T08:43:18.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.458+0000 7f1569e00700 1 -- 172.21.15.157:0/910377317 wait complete. 2024-04-03T08:43:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:18 smithi181 ceph-mon[101094]: Reconfiguring crash.smithi157 (monmap changed)... 2024-04-03T08:43:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:18 smithi181 ceph-mon[101094]: Reconfiguring daemon crash.smithi157 on smithi157 2024-04-03T08:43:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-03T08:43:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 -- 172.21.15.157:0/3132257185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 msgr2=0x7f34cc0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 --2- 172.21.15.157:0/3132257185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc0fe540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34b8004940 tx=0x7f34b8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 -- 172.21.15.157:0/3132257185 shutdown_connections 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 --2- 172.21.15.157:0/3132257185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc0fe540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 --2- 172.21.15.157:0/3132257185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34cc0fcee0 0x7f34cc0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 -- 172.21.15.157:0/3132257185 >> 172.21.15.157:0/3132257185 conn(0x7f34cc0f8560 msgr2=0x7f34cc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 -- 172.21.15.157:0/3132257185 shutdown_connections 2024-04-03T08:43:18.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.604+0000 7f34d3000700 1 -- 172.21.15.157:0/3132257185 wait complete. 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.605+0000 7f34d3000700 1 Processor -- start 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.605+0000 7f34d3000700 1 -- start start 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.605+0000 7f34d3000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34cc0fcee0 0x7f34cc071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.605+0000 7f34d3000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.605+0000 7f34d3000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc0708a0 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.605+0000 7f34d3000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc0709e0 con 0x7f34cc0fcee0 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48992/0 (socket says 172.21.15.157:48992) 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 -- 172.21.15.157:0/291097787 learned_addr learned my addr 172.21.15.157:0/291097787 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cbe00700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34cc0fcee0 0x7f34cc071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 -- 172.21.15.157:0/291097787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34cc0fcee0 msgr2=0x7f34cc071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34cc0fcee0 0x7f34cc071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 -- 172.21.15.157:0/291097787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b8005040 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.606+0000 7f34cb400700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc070310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009150 tx=0x7f34b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:18.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.607+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b800e040 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.607+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34b800bbf0 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.607+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b801c630 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.607+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc070c30 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.607+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc115af0 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.608+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc05f5f0 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.609+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f34b800bd60 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.610+0000 7f34c3e00700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f34b006d900 0x7f34b006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.610+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f34b808e480 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.610+0000 7f34cbe00700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f34b006d900 0x7f34b006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.611+0000 7f34cbe00700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f34b006d900 0x7f34b006fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34cc071b60 tx=0x7f34bc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:18.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.615+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f34b8057b10 con 0x7f34cc0fe0d0 2024-04-03T08:43:18.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.838+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34cc1024e0 con 0x7f34b006d900 2024-04-03T08:43:18.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.849+0000 7f34c3e00700 1 -- 172.21.15.157:0/291097787 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f34cc1024e0 con 0x7f34b006d900 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (3m) 28s ago 13m 14.4M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (13m) 28s ago 13m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 d7b911c6db1f 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (12m) 12s ago 12m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (2m) 28s ago 13m 75.2M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (7m) 28s ago 7m 13.1M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (7m) 28s ago 7m 136M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (7m) 12s ago 7m 13.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (7m) 12s ago 7m 99.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (102s) 28s ago 15m 473M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (61s) 12s ago 12m 447M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:43:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (45s) 28s ago 15m 27.6M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (17s) 12s ago 12m 22.6M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (3m) 28s ago 13m 8098k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (108s) 12s ago 12m 7474k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (11m) 28s ago 11m 226M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (10m) 28s ago 10m 244M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (10m) 28s ago 10m 203M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (9m) 12s ago 9m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (9m) 12s ago 9m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (8m) 12s ago 8m 224M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:43:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (67s) 28s ago 12m 42.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:43:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f34b006d900 msgr2=0x7f34b006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f34b006d900 0x7f34b006fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34cc071b60 tx=0x7f34bc00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 msgr2=0x7f34cc070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc070310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009150 tx=0x7f34b8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 shutdown_connections 2024-04-03T08:43:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f34b006d900 0x7f34b006fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34cc0fcee0 0x7f34cc071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.851+0000 7f34d3000700 1 --2- 172.21.15.157:0/291097787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34cc0fe0d0 0x7f34cc070310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.852+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 >> 172.21.15.157:0/291097787 conn(0x7f34cc0f8560 msgr2=0x7f34cc0f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.852+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 shutdown_connections 2024-04-03T08:43:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.852+0000 7f34d3000700 1 -- 172.21.15.157:0/291097787 wait complete. 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 -- 172.21.15.157:0/1386844032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 msgr2=0x7f6540070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 --2- 172.21.15.157:0/1386844032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f6540070350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6530004940 tx=0x7f6530009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 -- 172.21.15.157:0/1386844032 shutdown_connections 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 --2- 172.21.15.157:0/1386844032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6540070890 0x7f6540070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 --2- 172.21.15.157:0/1386844032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f6540070350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 -- 172.21.15.157:0/1386844032 >> 172.21.15.157:0/1386844032 conn(0x7f65400f8540 msgr2=0x7f65400fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 -- 172.21.15.157:0/1386844032 shutdown_connections 2024-04-03T08:43:18.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.988+0000 7f6546400700 1 -- 172.21.15.157:0/1386844032 wait complete. 2024-04-03T08:43:18.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.989+0000 7f6546400700 1 Processor -- start 2024-04-03T08:43:18.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.989+0000 7f6546400700 1 -- start start 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f6546400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6540070890 0x7f65400fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f6546400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f65400fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f6546400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400fd890 con 0x7f6540071e40 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f6546400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400fe0e0 con 0x7f6540070890 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f653ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f65400fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f653ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f65400fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49016/0 (socket says 172.21.15.157:49016) 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f653ea00700 1 -- 172.21.15.157:0/2887037758 learned_addr learned my addr 172.21.15.157:0/2887037758 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:18.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f653f400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6540070890 0x7f65400fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f653ea00700 1 -- 172.21.15.157:0/2887037758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6540070890 msgr2=0x7f65400fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:18.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.990+0000 7f653ea00700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6540070890 0x7f65400fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:18.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f653ea00700 1 -- 172.21.15.157:0/2887037758 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530005040 con 0x7f6540071e40 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f653ea00700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f65400fd240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f652c00eb40 tx=0x7f652c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652c007cc0 con 0x7f6540071e40 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f652c00f040 con 0x7f6540071e40 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65400fe360 con 0x7f6540071e40 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652c00ca10 con 0x7f6540071e40 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.991+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65400fe8a0 con 0x7f6540071e40 2024-04-03T08:43:18.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.992+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654005f5f0 con 0x7f6540071e40 2024-04-03T08:43:18.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.993+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f652c00cb70 con 0x7f6540071e40 2024-04-03T08:43:18.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.994+0000 7f6537400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f652406d900 0x7f652406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:18.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.994+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f652c08ccc0 con 0x7f6540071e40 2024-04-03T08:43:18.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.995+0000 7f653f400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f652406d900 0x7f652406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:18.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:18.996+0000 7f653f400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f652406d900 0x7f652406fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6530013740 tx=0x7f6530009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:19.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.000+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f652c092020 con 0x7f6540071e40 2024-04-03T08:43:19.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.296+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6540107ae0 con 0x7f6540071e40 2024-04-03T08:43:19.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.296+0000 7f6537400700 1 -- 172.21.15.157:0/2887037758 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f652c059eb0 con 0x7f6540071e40 2024-04-03T08:43:19.297 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:43:19.297 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:43:19.297 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:43:19.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 10, 2024-04-03T08:43:19.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:43:19.299 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:43:19.299 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:43:19.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f652406d900 msgr2=0x7f652406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f652406d900 0x7f652406fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6530013740 tx=0x7f6530009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 msgr2=0x7f65400fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f65400fd240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f652c00eb40 tx=0x7f652c00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 shutdown_connections 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f652406d900 0x7f652406fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6540070890 0x7f65400fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 --2- 172.21.15.157:0/2887037758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6540071e40 0x7f65400fd240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 >> 172.21.15.157:0/2887037758 conn(0x7f65400f8540 msgr2=0x7f65400f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 shutdown_connections 2024-04-03T08:43:19.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.299+0000 7f6546400700 1 -- 172.21.15.157:0/2887037758 wait complete. 2024-04-03T08:43:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:19 smithi157 ceph-mon[117693]: Reconfiguring osd.0 (monmap changed)... 2024-04-03T08:43:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:19 smithi157 ceph-mon[117693]: Reconfiguring daemon osd.0 on smithi157 2024-04-03T08:43:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:19 smithi157 ceph-mon[117693]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:19.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:19 smithi157 ceph-mon[117693]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1203271486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88070890 msgr2=0x7f9a88070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1203271486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88070890 0x7f9a88070d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a74004940 tx=0x7f9a74009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1203271486 shutdown_connections 2024-04-03T08:43:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1203271486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88070890 0x7f9a88070d00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1203271486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a88071e40 0x7f9a88070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1203271486 >> 172.21.15.157:0/1203271486 conn(0x7f9a880f8550 msgr2=0x7f9a880fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1203271486 shutdown_connections 2024-04-03T08:43:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.436+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1203271486 wait complete. 2024-04-03T08:43:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.437+0000 7f9a8dc00700 1 Processor -- start 2024-04-03T08:43:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.437+0000 7f9a8dc00700 1 -- start start 2024-04-03T08:43:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.437+0000 7f9a8dc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a88070890 0x7f9a8810fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.437+0000 7f9a8dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 0x7f9a88110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.437+0000 7f9a8dc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88110660 con 0x7f9a88071e40 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.437+0000 7f9a8dc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a881107d0 con 0x7f9a88070890 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 0x7f9a88110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 0x7f9a88110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49032/0 (socket says 172.21.15.157:49032) 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 -- 172.21.15.157:0/1131899047 learned_addr learned my addr 172.21.15.157:0/1131899047 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86a00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a88070890 0x7f9a8810fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 -- 172.21.15.157:0/1131899047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a88070890 msgr2=0x7f9a8810fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a88070890 0x7f9a8810fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 -- 172.21.15.157:0/1131899047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74005040 con 0x7f9a88071e40 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.438+0000 7f9a86000700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 0x7f9a88110060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400b3b0 tx=0x7f9a74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.439+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7400e040 con 0x7f9a88071e40 2024-04-03T08:43:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.439+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a74004290 con 0x7f9a88071e40 2024-04-03T08:43:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.439+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a881151d0 con 0x7f9a88071e40 2024-04-03T08:43:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.439+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7401c3f0 con 0x7f9a88071e40 2024-04-03T08:43:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.439+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a88115790 con 0x7f9a88071e40 2024-04-03T08:43:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.440+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8804c710 con 0x7f9a88071e40 2024-04-03T08:43:19.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.441+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f9a7400bbf0 con 0x7f9a88071e40 2024-04-03T08:43:19.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.442+0000 7f9a7ea00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a6c06d910 0x7f9a6c06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:19.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.443+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9a7408e360 con 0x7f9a88071e40 2024-04-03T08:43:19.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.443+0000 7f9a86a00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a6c06d910 0x7f9a6c06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:19.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.443+0000 7f9a86a00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a6c06d910 0x7f9a6c06fdc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9a88071b80 tx=0x7f9a7800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:19.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.447+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9a7405b5e0 con 0x7f9a88071e40 2024-04-03T08:43:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:19 smithi181 ceph-mon[101094]: Reconfiguring osd.0 (monmap changed)... 2024-04-03T08:43:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:19 smithi181 ceph-mon[101094]: Reconfiguring daemon osd.0 on smithi157 2024-04-03T08:43:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:19 smithi181 ceph-mon[101094]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:19 smithi181 ceph-mon[101094]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:19.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.700+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a88115cc0 con 0x7f9a88071e40 2024-04-03T08:43:19.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.701+0000 7f9a7ea00700 1 -- 172.21.15.157:0/1131899047 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f9a7405b170 con 0x7f9a88071e40 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:43:19.702 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:43:19.703 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:19.704 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:19.705 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:19.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a6c06d910 msgr2=0x7f9a6c06fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a6c06d910 0x7f9a6c06fdc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9a88071b80 tx=0x7f9a7800b040 comp rx=0 tx=0).stop 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 msgr2=0x7f9a88110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 0x7f9a88110060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400b3b0 tx=0x7f9a74009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 shutdown_connections 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a6c06d910 0x7f9a6c06fdc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a88070890 0x7f9a8810fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 --2- 172.21.15.157:0/1131899047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a88071e40 0x7f9a88110060 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.703+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 >> 172.21.15.157:0/1131899047 conn(0x7f9a880f8550 msgr2=0x7f9a880f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.704+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 shutdown_connections 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.704+0000 7f9a8dc00700 1 -- 172.21.15.157:0/1131899047 wait complete. 2024-04-03T08:43:19.707 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 -- 172.21.15.157:0/726148222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 msgr2=0x7f07480fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 --2- 172.21.15.157:0/726148222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f07480fe450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0734004940 tx=0x7f0734009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 -- 172.21.15.157:0/726148222 shutdown_connections 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 --2- 172.21.15.157:0/726148222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f07480fe450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 --2- 172.21.15.157:0/726148222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07480fce70 0x7f07480fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 -- 172.21.15.157:0/726148222 >> 172.21.15.157:0/726148222 conn(0x7f07480f8550 msgr2=0x7f07480fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 -- 172.21.15.157:0/726148222 shutdown_connections 2024-04-03T08:43:19.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.843+0000 7f074fc00700 1 -- 172.21.15.157:0/726148222 wait complete. 2024-04-03T08:43:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.844+0000 7f074fc00700 1 Processor -- start 2024-04-03T08:43:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.844+0000 7f074fc00700 1 -- start start 2024-04-03T08:43:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.844+0000 7f074fc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07480fce70 0x7f074810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.844+0000 7f074fc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f074810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.844+0000 7f074fc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07481105e0 con 0x7f07480fdfe0 2024-04-03T08:43:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.844+0000 7f074fc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0748110750 con 0x7f07480fce70 2024-04-03T08:43:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f074810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f074810ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49048/0 (socket says 172.21.15.157:49048) 2024-04-03T08:43:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 -- 172.21.15.157:0/4105088267 learned_addr learned my addr 172.21.15.157:0/4105088267 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f074d200700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07480fce70 0x7f074810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 -- 172.21.15.157:0/4105088267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07480fce70 msgr2=0x7f074810faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07480fce70 0x7f074810faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 -- 172.21.15.157:0/4105088267 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0734005040 con 0x7f07480fdfe0 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.845+0000 7f0747e00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f074810ffe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0734013870 tx=0x7f0734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.846+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073400e070 con 0x7f07480fdfe0 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.846+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0734013de0 con 0x7f07480fdfe0 2024-04-03T08:43:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.846+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0748115150 con 0x7f07480fdfe0 2024-04-03T08:43:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.846+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073401cea0 con 0x7f07480fdfe0 2024-04-03T08:43:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.846+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0748115630 con 0x7f07480fdfe0 2024-04-03T08:43:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.847+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0748101970 con 0x7f07480fdfe0 2024-04-03T08:43:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.848+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f073401c690 con 0x7f07480fdfe0 2024-04-03T08:43:19.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.849+0000 7f0744c00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f073006d910 0x7f073006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:19.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.849+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f073408e8f0 con 0x7f07480fdfe0 2024-04-03T08:43:19.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.849+0000 7f074d200700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f073006d910 0x7f073006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:19.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.850+0000 7f074d200700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f073006d910 0x7f073006fdc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f073c009b80 tx=0x7f073c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:19.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:19.854+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f073405ba30 con 0x7f07480fdfe0 2024-04-03T08:43:20.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.092+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f074802b340 con 0x7f073006d910 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.094+0000 7f0744c00700 1 -- 172.21.15.157:0/4105088267 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f074802b340 con 0x7f073006d910 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "4/21 daemons upgraded", 2024-04-03T08:43:20.095 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading mon daemons", 2024-04-03T08:43:20.096 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:43:20.096 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:43:20.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f073006d910 msgr2=0x7f073006fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:20.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f073006d910 0x7f073006fdc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f073c009b80 tx=0x7f073c00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 msgr2=0x7f074810ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f074810ffe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0734013870 tx=0x7f0734009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 shutdown_connections 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f073006d910 0x7f073006fdc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07480fce70 0x7f074810faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 --2- 172.21.15.157:0/4105088267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07480fdfe0 0x7f074810ffe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 >> 172.21.15.157:0/4105088267 conn(0x7f07480f8550 msgr2=0x7f07480f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 shutdown_connections 2024-04-03T08:43:20.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.097+0000 7f074fc00700 1 -- 172.21.15.157:0/4105088267 wait complete. 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 -- 172.21.15.157:0/143552589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fbcd0 msgr2=0x7f10c40fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 --2- 172.21.15.157:0/143552589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fbcd0 0x7f10c40fc0e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10b8004940 tx=0x7f10b8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 -- 172.21.15.157:0/143552589 shutdown_connections 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 --2- 172.21.15.157:0/143552589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fcf80 0x7f10c40fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 --2- 172.21.15.157:0/143552589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fbcd0 0x7f10c40fc0e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 -- 172.21.15.157:0/143552589 >> 172.21.15.157:0/143552589 conn(0x7f10c40f7430 msgr2=0x7f10c40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 -- 172.21.15.157:0/143552589 shutdown_connections 2024-04-03T08:43:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.237+0000 7f10cc800700 1 -- 172.21.15.157:0/143552589 wait complete. 2024-04-03T08:43:20.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.238+0000 7f10cc800700 1 Processor -- start 2024-04-03T08:43:20.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.238+0000 7f10cc800700 1 -- start start 2024-04-03T08:43:20.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.238+0000 7f10cc800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fbcd0 0x7f10c410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:20.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.238+0000 7f10cc800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 0x7f10c4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:20.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.238+0000 7f10cc800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4110710 con 0x7f10c40fcf80 2024-04-03T08:43:20.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.238+0000 7f10cc800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41150b0 con 0x7f10c40fbcd0 2024-04-03T08:43:20.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 0x7f10c4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:20.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 0x7f10c4110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49060/0 (socket says 172.21.15.157:49060) 2024-04-03T08:43:20.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 -- 172.21.15.157:0/1009294596 learned_addr learned my addr 172.21.15.157:0/1009294596 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:20.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9e00700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fbcd0 0x7f10c410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 -- 172.21.15.157:0/1009294596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fbcd0 msgr2=0x7f10c410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fbcd0 0x7f10c410fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 -- 172.21.15.157:0/1009294596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8005040 con 0x7f10c40fcf80 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9e00700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fbcd0 0x7f10c410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.239+0000 7f10c9400700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 0x7f10c4110080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b790 tx=0x7f10b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.240+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b400f770 con 0x7f10c40fcf80 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.240+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10b400fda0 con 0x7f10c40fcf80 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.240+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c4115310 con 0x7f10c40fcf80 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.240+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b400d310 con 0x7f10c40fcf80 2024-04-03T08:43:20.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.240+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c4115880 con 0x7f10c40fcf80 2024-04-03T08:43:20.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.241+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c4102a00 con 0x7f10c40fcf80 2024-04-03T08:43:20.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.242+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f10b4010420 con 0x7f10c40fcf80 2024-04-03T08:43:20.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.243+0000 7f10be000700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f10ac06d910 0x7f10ac06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:20.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.243+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f10b408d130 con 0x7f10c40fcf80 2024-04-03T08:43:20.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.243+0000 7f10c9e00700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f10ac06d910 0x7f10ac06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:20.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.244+0000 7f10c9e00700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f10ac06d910 0x7f10ac06fdc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10b800b020 tx=0x7f10b8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:20.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.247+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f10b405a380 con 0x7f10c40fcf80 2024-04-03T08:43:20.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.557+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f10c404c710 con 0x7f10c40fcf80 2024-04-03T08:43:20.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.557+0000 7f10be000700 1 -- 172.21.15.157:0/1009294596 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f10b4059f10 con 0x7f10c40fcf80 2024-04-03T08:43:20.558 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:43:20.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f10ac06d910 msgr2=0x7f10ac06fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f10ac06d910 0x7f10ac06fdc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10b800b020 tx=0x7f10b8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 msgr2=0x7f10c4110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 0x7f10c4110080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b790 tx=0x7f10b4009250 comp rx=0 tx=0).stop 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 shutdown_connections 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f10ac06d910 0x7f10ac06fdc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c40fbcd0 0x7f10c410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 --2- 172.21.15.157:0/1009294596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10c40fcf80 0x7f10c4110080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 >> 172.21.15.157:0/1009294596 conn(0x7f10c40f7430 msgr2=0x7f10c40f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 shutdown_connections 2024-04-03T08:43:20.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:20.560+0000 7f10cc800700 1 -- 172.21.15.157:0/1009294596 wait complete. 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2887037758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1131899047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-03T08:43:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2887037758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1131899047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-03T08:43:20.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:21.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:21 smithi157 ceph-mon[117693]: Reconfiguring osd.1 (monmap changed)... 2024-04-03T08:43:21.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:21 smithi157 ceph-mon[117693]: Reconfiguring daemon osd.1 on smithi157 2024-04-03T08:43:21.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:21 smithi157 ceph-mon[117693]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:21.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:21 smithi157 ceph-mon[117693]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:21.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:21 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1009294596' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:43:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:21 smithi181 ceph-mon[101094]: Reconfiguring osd.1 (monmap changed)... 2024-04-03T08:43:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:21 smithi181 ceph-mon[101094]: Reconfiguring daemon osd.1 on smithi157 2024-04-03T08:43:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:21 smithi181 ceph-mon[101094]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:21 smithi181 ceph-mon[101094]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:21 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1009294596' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:43:23.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:23.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:23.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: Reconfiguring osd.2 (monmap changed)... 2024-04-03T08:43:23.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-03T08:43:23.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:23.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: Reconfiguring daemon osd.2 on smithi157 2024-04-03T08:43:23.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:22 smithi157 ceph-mon[117693]: pgmap v22: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: Reconfiguring osd.2 (monmap changed)... 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: Reconfiguring daemon osd.2 on smithi157 2024-04-03T08:43:23.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:22 smithi181 ceph-mon[101094]: pgmap v22: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:24.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:24.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:24.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: Reconfiguring mds.cephfs.smithi157.sodwui (monmap changed)... 2024-04-03T08:43:24.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:24.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:24.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: Reconfiguring daemon mds.cephfs.smithi157.sodwui on smithi157 2024-04-03T08:43:24.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:24 smithi157 ceph-mon[117693]: pgmap v23: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: Reconfiguring mds.cephfs.smithi157.sodwui (monmap changed)... 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: Reconfiguring daemon mds.cephfs.smithi157.sodwui on smithi157 2024-04-03T08:43:24.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:24 smithi181 ceph-mon[101094]: pgmap v23: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:26.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:26.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:26.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:26 smithi157 ceph-mon[117693]: Reconfiguring mds.cephfs.smithi157.zlscrk (monmap changed)... 2024-04-03T08:43:26.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:26.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:26.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:26 smithi157 ceph-mon[117693]: Reconfiguring daemon mds.cephfs.smithi157.zlscrk on smithi157 2024-04-03T08:43:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:26 smithi181 ceph-mon[101094]: Reconfiguring mds.cephfs.smithi157.zlscrk (monmap changed)... 2024-04-03T08:43:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:26 smithi181 ceph-mon[101094]: Reconfiguring daemon mds.cephfs.smithi157.zlscrk on smithi157 2024-04-03T08:43:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:27 smithi157 ceph-mon[117693]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:27 smithi181 ceph-mon[101094]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:28 smithi157 ceph-mon[117693]: Reconfiguring crash.smithi181 (monmap changed)... 2024-04-03T08:43:28.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:28 smithi157 ceph-mon[117693]: Reconfiguring daemon crash.smithi181 on smithi181 2024-04-03T08:43:28.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:28 smithi181 ceph-mon[101094]: Reconfiguring crash.smithi181 (monmap changed)... 2024-04-03T08:43:28.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:28 smithi181 ceph-mon[101094]: Reconfiguring daemon crash.smithi181 on smithi181 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: pgmap v25: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:29.538 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: pgmap v25: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi181.mfhidq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:30 smithi157 ceph-mon[117693]: Reconfiguring mgr.smithi181.mfhidq (monmap changed)... 2024-04-03T08:43:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:30 smithi157 ceph-mon[117693]: Reconfiguring daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:43:30.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:30 smithi181 ceph-mon[101094]: Reconfiguring mgr.smithi181.mfhidq (monmap changed)... 2024-04-03T08:43:30.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:30 smithi181 ceph-mon[101094]: Reconfiguring daemon mgr.smithi181.mfhidq on smithi181 2024-04-03T08:43:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:31 smithi181 ceph-mon[101094]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:43:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:43:31.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:31 smithi157 ceph-mon[117693]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-03T08:43:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-03T08:43:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:32.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:32 smithi181 ceph-mon[101094]: Reconfiguring mon.smithi181 (monmap changed)... 2024-04-03T08:43:32.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:32 smithi181 ceph-mon[101094]: Reconfiguring daemon mon.smithi181 on smithi181 2024-04-03T08:43:32.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:32.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:32.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-03T08:43:32.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:32 smithi157 ceph-mon[117693]: Reconfiguring mon.smithi181 (monmap changed)... 2024-04-03T08:43:32.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:32 smithi157 ceph-mon[117693]: Reconfiguring daemon mon.smithi181 on smithi181 2024-04-03T08:43:32.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:32.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:32.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-03T08:43:32.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:33 smithi157 ceph-mon[117693]: pgmap v27: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:43:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:33 smithi157 ceph-mon[117693]: Reconfiguring osd.3 (monmap changed)... 2024-04-03T08:43:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:33 smithi157 ceph-mon[117693]: Reconfiguring daemon osd.3 on smithi181 2024-04-03T08:43:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:33 smithi181 ceph-mon[101094]: pgmap v27: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:43:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:33 smithi181 ceph-mon[101094]: Reconfiguring osd.3 (monmap changed)... 2024-04-03T08:43:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:33 smithi181 ceph-mon[101094]: Reconfiguring daemon osd.3 on smithi181 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: Reconfiguring osd.4 (monmap changed)... 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: Reconfiguring daemon osd.4 on smithi181 2024-04-03T08:43:35.248 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:34 smithi181 ceph-mon[101094]: pgmap v28: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: Reconfiguring osd.4 (monmap changed)... 2024-04-03T08:43:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-03T08:43:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:35.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: Reconfiguring daemon osd.4 on smithi181 2024-04-03T08:43:35.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:34 smithi157 ceph-mon[117693]: pgmap v28: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:37.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:37.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:37.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: Reconfiguring osd.5 (monmap changed)... 2024-04-03T08:43:37.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-03T08:43:37.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:37.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: Reconfiguring daemon osd.5 on smithi181 2024-04-03T08:43:37.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:36 smithi157 ceph-mon[117693]: pgmap v29: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: Reconfiguring osd.5 (monmap changed)... 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: Reconfiguring daemon osd.5 on smithi181 2024-04-03T08:43:37.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:36 smithi181 ceph-mon[101094]: pgmap v29: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:39.036 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:39.037 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:39.037 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: Reconfiguring mds.cephfs.smithi181.ecaerp (monmap changed)... 2024-04-03T08:43:39.037 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:39.037 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:39.037 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: Reconfiguring daemon mds.cephfs.smithi181.ecaerp on smithi181 2024-04-03T08:43:39.037 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:38 smithi181 ceph-mon[101094]: pgmap v30: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: Reconfiguring mds.cephfs.smithi181.ecaerp (monmap changed)... 2024-04-03T08:43:39.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:39.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:39.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: Reconfiguring daemon mds.cephfs.smithi181.ecaerp on smithi181 2024-04-03T08:43:39.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:38 smithi157 ceph-mon[117693]: pgmap v30: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:40.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:40.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:40.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: Reconfiguring mds.cephfs.smithi181.wksnwz (monmap changed)... 2024-04-03T08:43:40.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:40.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:40.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: Reconfiguring daemon mds.cephfs.smithi181.wksnwz on smithi181 2024-04-03T08:43:40.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:40 smithi157 ceph-mon[117693]: pgmap v31: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: Reconfiguring mds.cephfs.smithi181.wksnwz (monmap changed)... 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: Reconfiguring daemon mds.cephfs.smithi181.wksnwz on smithi181 2024-04-03T08:43:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:40 smithi181 ceph-mon[101094]: pgmap v31: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:42.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:42.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:42.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:43:42.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:42.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:42.435 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:42.436 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]: dispatch 2024-04-03T08:43:42.436 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]': finished 2024-04-03T08:43:42.436 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi181"}]: dispatch 2024-04-03T08:43:42.436 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi181"}]': finished 2024-04-03T08:43:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:43:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:42.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]: dispatch 2024-04-03T08:43:42.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]': finished 2024-04-03T08:43:42.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi181"}]: dispatch 2024-04-03T08:43:42.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi181"}]': finished 2024-04-03T08:43:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:43 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all mon 2024-04-03T08:43:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:43 smithi157 ceph-mon[117693]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:43:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:43.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:43 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all mon 2024-04-03T08:43:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:43 smithi181 ceph-mon[101094]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:43:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:44.777 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:44 smithi157 ceph-mon[117693]: Upgrade: Updating crash.smithi157 (1/2) 2024-04-03T08:43:44.778 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:44 smithi157 ceph-mon[117693]: Deploying daemon crash.smithi157 on smithi157 2024-04-03T08:43:44.778 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:44.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:44 smithi181 ceph-mon[101094]: Upgrade: Updating crash.smithi157 (1/2) 2024-04-03T08:43:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:44 smithi181 ceph-mon[101094]: Deploying daemon crash.smithi157 on smithi157 2024-04-03T08:43:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:43:45.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:45 smithi157 ceph-mon[117693]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:45.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:45 smithi181 ceph-mon[101094]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:46.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:46 smithi157 ceph-mon[117693]: pgmap v34: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:46.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:46 smithi181 ceph-mon[101094]: pgmap v34: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:48 smithi181 ceph-mon[101094]: pgmap v35: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:48.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:48.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:48.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:48 smithi157 ceph-mon[117693]: pgmap v35: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:50.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.715+0000 7f498be00700 1 -- 172.21.15.157:0/2282257865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fdec0 msgr2=0x7f498c0fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:50.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.715+0000 7f498be00700 1 --2- 172.21.15.157:0/2282257865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fdec0 0x7f498c0fe330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4978004940 tx=0x7f4978009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:50.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 -- 172.21.15.157:0/2282257865 shutdown_connections 2024-04-03T08:43:50.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 --2- 172.21.15.157:0/2282257865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fdec0 0x7f498c0fe330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 --2- 172.21.15.157:0/2282257865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f498c0fcc10 0x7f498c0fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 -- 172.21.15.157:0/2282257865 >> 172.21.15.157:0/2282257865 conn(0x7f498c0f83d0 msgr2=0x7f498c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 -- 172.21.15.157:0/2282257865 shutdown_connections 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 -- 172.21.15.157:0/2282257865 wait complete. 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.716+0000 7f498be00700 1 Processor -- start 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498be00700 1 -- start start 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 0x7f498c10f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f498c0fdec0 0x7f498c10fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498be00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c1104f0 con 0x7f498c0fcc10 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c110d40 con 0x7f498c0fdec0 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 0x7f498c10f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 0x7f498c10f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48546/0 (socket says 172.21.15.157:48546) 2024-04-03T08:43:50.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.717+0000 7f498aa00700 1 -- 172.21.15.157:0/2322275537 learned_addr learned my addr 172.21.15.157:0/2322275537 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f498aa00700 1 -- 172.21.15.157:0/2322275537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f498c0fdec0 msgr2=0x7f498c10fef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f498aa00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f498c0fdec0 0x7f498c10fef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f498aa00700 1 -- 172.21.15.157:0/2322275537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978005040 con 0x7f498c0fcc10 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f498aa00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 0x7f498c10f9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f497c00eb40 tx=0x7f497c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497c007cc0 con 0x7f498c0fcc10 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c110fc0 con 0x7f498c0fcc10 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f497c00f040 con 0x7f498c0fcc10 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497c009620 con 0x7f498c0fcc10 2024-04-03T08:43:50.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.718+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c111500 con 0x7f498c0fcc10 2024-04-03T08:43:50.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.719+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c101850 con 0x7f498c0fcc10 2024-04-03T08:43:50.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.720+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f497c009780 con 0x7f498c0fcc10 2024-04-03T08:43:50.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.721+0000 7f4982a00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f497006d900 0x7f497006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:50.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.721+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f497c08cdd0 con 0x7f498c0fcc10 2024-04-03T08:43:50.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.721+0000 7f498a000700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f497006d900 0x7f497006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:50.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.722+0000 7f498a000700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f497006d900 0x7f497006fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f497800b0d0 tx=0x7f4978009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:50.724 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:50 smithi181 ceph-mon[101094]: Upgrade: Updating crash.smithi181 (2/2) 2024-04-03T08:43:50.724 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:50.724 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:50.724 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:50.724 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:50 smithi181 ceph-mon[101094]: Deploying daemon crash.smithi181 on smithi181 2024-04-03T08:43:50.724 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:50 smithi181 ceph-mon[101094]: pgmap v36: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:50.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.726+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f497c059fc0 con 0x7f498c0fcc10 2024-04-03T08:43:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:50 smithi157 ceph-mon[117693]: Upgrade: Updating crash.smithi181 (2/2) 2024-04-03T08:43:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi181", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-03T08:43:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:43:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:50 smithi157 ceph-mon[117693]: Deploying daemon crash.smithi181 on smithi181 2024-04-03T08:43:50.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:50 smithi157 ceph-mon[117693]: pgmap v36: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:50.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.946+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f498c105870 con 0x7f497006d900 2024-04-03T08:43:50.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.948+0000 7f4982a00700 1 -- 172.21.15.157:0/2322275537 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f498c105870 con 0x7f497006d900 2024-04-03T08:43:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f497006d900 msgr2=0x7f497006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f497006d900 0x7f497006fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f497800b0d0 tx=0x7f4978009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 msgr2=0x7f498c10f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 0x7f498c10f9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f497c00eb40 tx=0x7f497c00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 shutdown_connections 2024-04-03T08:43:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f497006d900 0x7f497006fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498c0fcc10 0x7f498c10f9b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 --2- 172.21.15.157:0/2322275537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f498c0fdec0 0x7f498c10fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 >> 172.21.15.157:0/2322275537 conn(0x7f498c0f83d0 msgr2=0x7f498c0f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 shutdown_connections 2024-04-03T08:43:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:50.950+0000 7f498be00700 1 -- 172.21.15.157:0/2322275537 wait complete. 2024-04-03T08:43:50.966 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:43:51.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 -- 172.21.15.157:0/381473411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 msgr2=0x7fca940fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 --2- 172.21.15.157:0/381473411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca940fd310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca84004940 tx=0x7fca84009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 -- 172.21.15.157:0/381473411 shutdown_connections 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 --2- 172.21.15.157:0/381473411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca940fe0d0 0x7fca940fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 --2- 172.21.15.157:0/381473411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca940fd310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 -- 172.21.15.157:0/381473411 >> 172.21.15.157:0/381473411 conn(0x7fca940f8560 msgr2=0x7fca940fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.086+0000 7fca9a600700 1 -- 172.21.15.157:0/381473411 shutdown_connections 2024-04-03T08:43:51.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.087+0000 7fca9a600700 1 -- 172.21.15.157:0/381473411 wait complete. 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.087+0000 7fca9a600700 1 Processor -- start 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.087+0000 7fca9a600700 1 -- start start 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca9a600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca94113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca9a600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca940fe0d0 0x7fca94114520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca9a600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94114b20 con 0x7fca940fcee0 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca9a600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94115370 con 0x7fca940fe0d0 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca93400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca94113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca93400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca94113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48554/0 (socket says 172.21.15.157:48554) 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca93400700 1 -- 172.21.15.157:0/4254815475 learned_addr learned my addr 172.21.15.157:0/4254815475 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.088+0000 7fca92a00700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca940fe0d0 0x7fca94114520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca93400700 1 -- 172.21.15.157:0/4254815475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca940fe0d0 msgr2=0x7fca94114520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca93400700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca940fe0d0 0x7fca94114520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca93400700 1 -- 172.21.15.157:0/4254815475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84005040 con 0x7fca940fcee0 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca93400700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca94113fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca8400b0d0 tx=0x7fca84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8400e070 con 0x7fca940fcee0 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca84013de0 con 0x7fca940fcee0 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca941155f0 con 0x7fca940fcee0 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8400b410 con 0x7fca940fcee0 2024-04-03T08:43:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.089+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca94115b30 con 0x7fca940fcee0 2024-04-03T08:43:51.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.090+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca94101a60 con 0x7fca940fcee0 2024-04-03T08:43:51.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.091+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fca8401d460 con 0x7fca940fcee0 2024-04-03T08:43:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.092+0000 7fca8b400700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fca7806d900 0x7fca7806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.093+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fca8408e1f0 con 0x7fca940fcee0 2024-04-03T08:43:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.093+0000 7fca92a00700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fca7806d900 0x7fca7806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.093+0000 7fca92a00700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fca7806d900 0x7fca7806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fca80009b80 tx=0x7fca8000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:51.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.097+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fca8405b3b0 con 0x7fca940fcee0 2024-04-03T08:43:51.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.322+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca94115da0 con 0x7fca7806d900 2024-04-03T08:43:51.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.324+0000 7fca8b400700 1 -- 172.21.15.157:0/4254815475 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fca94115da0 con 0x7fca7806d900 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.326+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fca7806d900 msgr2=0x7fca7806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.326+0000 7fca9a600700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fca7806d900 0x7fca7806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fca80009b80 tx=0x7fca8000b040 comp rx=0 tx=0).stop 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.326+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 msgr2=0x7fca94113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.326+0000 7fca9a600700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca94113fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca8400b0d0 tx=0x7fca84009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.326+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 shutdown_connections 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.327+0000 7fca9a600700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fca7806d900 0x7fca7806fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.327+0000 7fca9a600700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca940fcee0 0x7fca94113fe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.327+0000 7fca9a600700 1 --2- 172.21.15.157:0/4254815475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca940fe0d0 0x7fca94114520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.327+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 >> 172.21.15.157:0/4254815475 conn(0x7fca940f8560 msgr2=0x7fca940f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:51.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.327+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 shutdown_connections 2024-04-03T08:43:51.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.327+0000 7fca9a600700 1 -- 172.21.15.157:0/4254815475 wait complete. 2024-04-03T08:43:51.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.460+0000 7f8ade200700 1 -- 172.21.15.157:0/4211680198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 msgr2=0x7f8ad80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.460+0000 7f8ade200700 1 --2- 172.21.15.157:0/4211680198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad80fd290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8004940 tx=0x7f8ac8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.460+0000 7f8ade200700 1 -- 172.21.15.157:0/4211680198 shutdown_connections 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.460+0000 7f8ade200700 1 --2- 172.21.15.157:0/4211680198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad80fdff0 0x7f8ad80fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.460+0000 7f8ade200700 1 --2- 172.21.15.157:0/4211680198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad80fd290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.460+0000 7f8ade200700 1 -- 172.21.15.157:0/4211680198 >> 172.21.15.157:0/4211680198 conn(0x7f8ad80f8540 msgr2=0x7f8ad80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.461+0000 7f8ade200700 1 -- 172.21.15.157:0/4211680198 shutdown_connections 2024-04-03T08:43:51.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.461+0000 7f8ade200700 1 -- 172.21.15.157:0/4211680198 wait complete. 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.461+0000 7f8ade200700 1 Processor -- start 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.461+0000 7f8ade200700 1 -- start start 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ade200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ade200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad80fdff0 0x7f8ad8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ade200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80708c0 con 0x7f8ad80fce80 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ade200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8070a30 con 0x7f8ad80fdff0 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48558/0 (socket says 172.21.15.157:48558) 2024-04-03T08:43:51.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad6a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad80fdff0 0x7f8ad8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad7400700 1 -- 172.21.15.157:0/1938203176 learned_addr learned my addr 172.21.15.157:0/1938203176 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad7400700 1 -- 172.21.15.157:0/1938203176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad80fdff0 msgr2=0x7f8ad8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad7400700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad80fdff0 0x7f8ad8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.462+0000 7f8ad7400700 1 -- 172.21.15.157:0/1938203176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8005040 con 0x7f8ad80fce80 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.463+0000 7f8ad7400700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad8071e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8013870 tx=0x7f8ac8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.463+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac800e070 con 0x7f8ad80fce80 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.463+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ac8013de0 con 0x7f8ad80fce80 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.463+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac801cea0 con 0x7f8ad80fce80 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.463+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad8070cb0 con 0x7f8ad80fce80 2024-04-03T08:43:51.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.463+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad8071190 con 0x7f8ad80fce80 2024-04-03T08:43:51.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.464+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad805f5f0 con 0x7f8ad80fce80 2024-04-03T08:43:51.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.465+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f8ac801c690 con 0x7f8ad80fce80 2024-04-03T08:43:51.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.466+0000 7f8acf400700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8abc06d900 0x7f8abc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.467+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8ac808e700 con 0x7f8ad80fce80 2024-04-03T08:43:51.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.467+0000 7f8ad6a00700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8abc06d900 0x7f8abc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.467+0000 7f8ad6a00700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8abc06d900 0x7f8abc06fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4004fd0 tx=0x7f8ac400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:51.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.471+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8ac8057e50 con 0x7f8ad80fce80 2024-04-03T08:43:51.668 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:51 smithi181 ceph-mon[101094]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:51.668 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:51 smithi181 ceph-mon[101094]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:51.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.686+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ad81022c0 con 0x7f8abc06d900 2024-04-03T08:43:51.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.696+0000 7f8acf400700 1 -- 172.21.15.157:0/1938203176 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8ad81022c0 con 0x7f8abc06d900 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (3m) 60s ago 14m 14.4M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 starting - - - - 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (13m) 44s ago 13m 6651k - 17.2.7-805-g6fda41ff a49113eacc58 1181ec3e125b 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (2m) 60s ago 13m 75.2M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (7m) 60s ago 7m 13.1M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (7m) 60s ago 7m 136M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (7m) 44s ago 7m 13.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (7m) 44s ago 7m 99.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (2m) 60s ago 15m 473M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (94s) 44s ago 12m 447M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:43:51.697 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (78s) 60s ago 15m 27.6M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (50s) 44s ago 12m 22.6M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (4m) 60s ago 14m 8098k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (2m) 44s ago 12m 7474k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (12m) 60s ago 12m 226M 1618M 17.2.7-805-g6fda41ff a49113eacc58 41ec250d3243 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (11m) 60s ago 11m 244M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (11m) 60s ago 10m 203M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (10m) 44s ago 10m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (9m) 44s ago 9m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (9m) 44s ago 9m 224M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:43:51.698 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (100s) 60s ago 13m 42.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:43:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8abc06d900 msgr2=0x7f8abc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8abc06d900 0x7f8abc06fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4004fd0 tx=0x7f8ac400b040 comp rx=0 tx=0).stop 2024-04-03T08:43:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 msgr2=0x7f8ad8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad8071e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8013870 tx=0x7f8ac8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 shutdown_connections 2024-04-03T08:43:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8abc06d900 0x7f8abc06fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ad80fce80 0x7f8ad8071e40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 --2- 172.21.15.157:0/1938203176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad80fdff0 0x7f8ad8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.698+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 >> 172.21.15.157:0/1938203176 conn(0x7f8ad80f8540 msgr2=0x7f8ad80f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.699+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 shutdown_connections 2024-04-03T08:43:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.699+0000 7f8ade200700 1 -- 172.21.15.157:0/1938203176 wait complete. 2024-04-03T08:43:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:51 smithi157 ceph-mon[117693]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:51 smithi157 ceph-mon[117693]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 -- 172.21.15.157:0/4057215867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec0709a0 msgr2=0x7efcec070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 --2- 172.21.15.157:0/4057215867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec0709a0 0x7efcec070e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efcd8004940 tx=0x7efcd8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 -- 172.21.15.157:0/4057215867 shutdown_connections 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 --2- 172.21.15.157:0/4057215867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec0709a0 0x7efcec070e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 --2- 172.21.15.157:0/4057215867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcec071f50 0x7efcec070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 -- 172.21.15.157:0/4057215867 >> 172.21.15.157:0/4057215867 conn(0x7efcec0f8560 msgr2=0x7efcec0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 -- 172.21.15.157:0/4057215867 shutdown_connections 2024-04-03T08:43:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.831+0000 7efcf2800700 1 -- 172.21.15.157:0/4057215867 wait complete. 2024-04-03T08:43:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efcf2800700 1 Processor -- start 2024-04-03T08:43:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efcf2800700 1 -- start start 2024-04-03T08:43:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efcf2800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcec0709a0 0x7efcec10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efcf2800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 0x7efcec110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efcf2800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec110810 con 0x7efcec071f50 2024-04-03T08:43:51.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efcf2800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec111000 con 0x7efcec0709a0 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efceaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 0x7efcec110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efceaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 0x7efcec110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48562/0 (socket says 172.21.15.157:48562) 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efceaa00700 1 -- 172.21.15.157:0/2432068430 learned_addr learned my addr 172.21.15.157:0/2432068430 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.832+0000 7efceb400700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcec0709a0 0x7efcec10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efceaa00700 1 -- 172.21.15.157:0/2432068430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcec0709a0 msgr2=0x7efcec10fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efceaa00700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcec0709a0 0x7efcec10fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:51.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efceaa00700 1 -- 172.21.15.157:0/2432068430 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8005040 con 0x7efcec071f50 2024-04-03T08:43:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efceaa00700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 0x7efcec110180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b3b0 tx=0x7efcd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd800e040 con 0x7efcec071f50 2024-04-03T08:43:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcd8004290 con 0x7efcec071f50 2024-04-03T08:43:51.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec111280 con 0x7efcec071f50 2024-04-03T08:43:51.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd801c3f0 con 0x7efcec071f50 2024-04-03T08:43:51.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.833+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec111840 con 0x7efcec071f50 2024-04-03T08:43:51.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.835+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec04bed0 con 0x7efcec071f50 2024-04-03T08:43:51.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.835+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7efcd800bbf0 con 0x7efcec071f50 2024-04-03T08:43:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.836+0000 7efce3400700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efcd006d900 0x7efcd006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.836+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efcd808e420 con 0x7efcec071f50 2024-04-03T08:43:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.837+0000 7efceb400700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efcd006d900 0x7efcd006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:51.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.837+0000 7efceb400700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efcd006d900 0x7efcd006fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efcec071c90 tx=0x7efcdc0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:51.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:51.841+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efcd805b5e0 con 0x7efcec071f50 2024-04-03T08:43:52.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.125+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efcec109cb0 con 0x7efcec071f50 2024-04-03T08:43:52.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.125+0000 7efce3400700 1 -- 172.21.15.157:0/2432068430 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7efcd805b170 con 0x7efcec071f50 2024-04-03T08:43:52.126 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:43:52.126 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:43:52.126 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:43:52.126 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:52.126 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 10, 2024-04-03T08:43:52.127 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:43:52.128 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:43:52.128 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:43:52.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.127+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efcd006d900 msgr2=0x7efcd006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.127+0000 7efcf2800700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efcd006d900 0x7efcd006fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efcec071c90 tx=0x7efcdc0091a0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.127+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 msgr2=0x7efcec110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.127+0000 7efcf2800700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 0x7efcec110180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b3b0 tx=0x7efcd8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 shutdown_connections 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efcd006d900 0x7efcd006fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcec0709a0 0x7efcec10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 --2- 172.21.15.157:0/2432068430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcec071f50 0x7efcec110180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 >> 172.21.15.157:0/2432068430 conn(0x7efcec0f8560 msgr2=0x7efcec103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 shutdown_connections 2024-04-03T08:43:52.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.128+0000 7efcf2800700 1 -- 172.21.15.157:0/2432068430 wait complete. 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 -- 172.21.15.157:0/657052846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 msgr2=0x7fb85c100410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 --2- 172.21.15.157:0/657052846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c100410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb848004940 tx=0x7fb848009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 -- 172.21.15.157:0/657052846 shutdown_connections 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 --2- 172.21.15.157:0/657052846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c100410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 --2- 172.21.15.157:0/657052846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0fee30 0x7fb85c0ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 -- 172.21.15.157:0/657052846 >> 172.21.15.157:0/657052846 conn(0x7fb85c0fa5d0 msgr2=0x7fb85c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 -- 172.21.15.157:0/657052846 shutdown_connections 2024-04-03T08:43:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.262+0000 7fb85b200700 1 -- 172.21.15.157:0/657052846 wait complete. 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.263+0000 7fb85b200700 1 Processor -- start 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.263+0000 7fb85b200700 1 -- start start 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.263+0000 7fb85b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0fee30 0x7fb85c10fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.263+0000 7fb85b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c10ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.263+0000 7fb85b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c110590 con 0x7fb85c0fffa0 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.263+0000 7fb85b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c110de0 con 0x7fb85c0fee30 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c10ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c10ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48576/0 (socket says 172.21.15.157:48576) 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 -- 172.21.15.157:0/4011183345 learned_addr learned my addr 172.21.15.157:0/4011183345 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859e00700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0fee30 0x7fb85c10fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 -- 172.21.15.157:0/4011183345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0fee30 msgr2=0x7fb85c10fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0fee30 0x7fb85c10fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 -- 172.21.15.157:0/4011183345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848005040 con 0x7fb85c0fffa0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.264+0000 7fb859400700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c10ff90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b3b0 tx=0x7fb848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.265+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84800e040 con 0x7fb85c0fffa0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.265+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb848004290 con 0x7fb85c0fffa0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.265+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84801c3f0 con 0x7fb85c0fffa0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.265+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c111060 con 0x7fb85c0fffa0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.265+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c1115a0 con 0x7fb85c0fffa0 2024-04-03T08:43:52.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.266+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c05f5f0 con 0x7fb85c0fffa0 2024-04-03T08:43:52.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.267+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fb84800bbf0 con 0x7fb85c0fffa0 2024-04-03T08:43:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.269+0000 7fb852000700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb84006d900 0x7fb84006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:52.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.269+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb84808e430 con 0x7fb85c0fffa0 2024-04-03T08:43:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.269+0000 7fb859e00700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb84006d900 0x7fb84006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.270+0000 7fb859e00700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb84006d900 0x7fb84006fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb84c004f40 tx=0x7fb84c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:52.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.274+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb84805b5f0 con 0x7fb85c0fffa0 2024-04-03T08:43:52.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.529+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb85c04bed0 con 0x7fb85c0fffa0 2024-04-03T08:43:52.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.530+0000 7fb852000700 1 -- 172.21.15.157:0/4011183345 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7fb84805b180 con 0x7fb85c0fffa0 2024-04-03T08:43:52.531 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:43:52.531 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:43:52.532 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:43:52.532 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:43:52.532 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:52.532 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:43:52.532 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:43:52.533 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:43:52.533 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:43:52.533 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:43:52.533 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:43:52.533 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:43:52.533 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:43:52.534 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:43:52.535 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:43:52.536 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:43:52.536 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:43:52.536 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:43:52.536 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:43:52.536 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:52.536 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:52.537 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:52.537 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:52.537 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:43:52.537 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:43:52.537 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:52.538 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb84006d900 msgr2=0x7fb84006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb84006d900 0x7fb84006fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb84c004f40 tx=0x7fb84c00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 msgr2=0x7fb85c10ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c10ff90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b3b0 tx=0x7fb848009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 shutdown_connections 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb84006d900 0x7fb84006fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0fee30 0x7fb85c10fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 --2- 172.21.15.157:0/4011183345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb85c0fffa0 0x7fb85c10ff90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.532+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 >> 172.21.15.157:0/4011183345 conn(0x7fb85c0fa5d0 msgr2=0x7fb85c0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:52.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.533+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 shutdown_connections 2024-04-03T08:43:52.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.533+0000 7fb85b200700 1 -- 172.21.15.157:0/4011183345 wait complete. 2024-04-03T08:43:52.540 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:43:52.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.666+0000 7f5ad1000700 1 -- 172.21.15.157:0/2951756949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fe0d0 msgr2=0x7f5acc0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.666+0000 7f5ad1000700 1 --2- 172.21.15.157:0/2951756949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fe0d0 0x7f5acc0fe540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8004940 tx=0x7f5ab8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:52.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.667+0000 7f5ad1000700 1 -- 172.21.15.157:0/2951756949 shutdown_connections 2024-04-03T08:43:52.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.667+0000 7f5ad1000700 1 --2- 172.21.15.157:0/2951756949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fe0d0 0x7f5acc0fe540 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.667+0000 7f5ad1000700 1 --2- 172.21.15.157:0/2951756949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0fcee0 0x7f5acc0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.667+0000 7f5ad1000700 1 -- 172.21.15.157:0/2951756949 >> 172.21.15.157:0/2951756949 conn(0x7f5acc0f8560 msgr2=0x7f5acc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:52.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.667+0000 7f5ad1000700 1 -- 172.21.15.157:0/2951756949 shutdown_connections 2024-04-03T08:43:52.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.667+0000 7f5ad1000700 1 -- 172.21.15.157:0/2951756949 wait complete. 2024-04-03T08:43:52.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ad1000700 1 Processor -- start 2024-04-03T08:43:52.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ad1000700 1 -- start start 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ad1000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 0x7f5acc10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ad1000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0fe0d0 0x7f5acc110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ad1000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc110700 con 0x7f5acc0fcee0 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ad1000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc110f50 con 0x7f5acc0fe0d0 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ac9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 0x7f5acc10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ac9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 0x7f5acc10fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44672/0 (socket says 172.21.15.157:44672) 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ac9e00700 1 -- 172.21.15.157:0/3946423025 learned_addr learned my addr 172.21.15.157:0/3946423025 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.668+0000 7f5ac9400700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0fe0d0 0x7f5acc110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac9e00700 1 -- 172.21.15.157:0/3946423025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0fe0d0 msgr2=0x7f5acc110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac9e00700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0fe0d0 0x7f5acc110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac9e00700 1 -- 172.21.15.157:0/3946423025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8005040 con 0x7f5acc0fcee0 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac9e00700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 0x7f5acc10fbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00eb70 tx=0x7f5abc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc007cc0 con 0x7f5acc0fcee0 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5abc00f040 con 0x7f5acc0fcee0 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc1111d0 con 0x7f5acc0fcee0 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc00cb20 con 0x7f5acc0fcee0 2024-04-03T08:43:52.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.669+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc111710 con 0x7f5acc0fcee0 2024-04-03T08:43:52.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.670+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc101a60 con 0x7f5acc0fcee0 2024-04-03T08:43:52.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.671+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f5abc00cc80 con 0x7f5acc0fcee0 2024-04-03T08:43:52.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.672+0000 7f5ac2000700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5ab006d900 0x7f5ab006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:52.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.672+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5abc08cb30 con 0x7f5acc0fcee0 2024-04-03T08:43:52.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.672+0000 7f5ac9400700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5ab006d900 0x7f5ab006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:52.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.673+0000 7f5ac9400700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5ab006d900 0x7f5ab006fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009fd0 tx=0x7f5ab8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:52.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.676+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5abc059d20 con 0x7f5acc0fcee0 2024-04-03T08:43:52.736 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:52 smithi181 ceph-mon[101094]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:52.737 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:52 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2432068430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:52.737 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:52 smithi181 ceph-mon[101094]: pgmap v37: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:52.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:52 smithi157 ceph-mon[117693]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:52.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:52 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2432068430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:43:52.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:52 smithi157 ceph-mon[117693]: pgmap v37: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:52.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.902+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5acc111980 con 0x7f5ab006d900 2024-04-03T08:43:52.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.903+0000 7f5ac2000700 1 -- 172.21.15.157:0/3946423025 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f5acc111980 con 0x7f5ab006d900 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "4/21 daemons upgraded", 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading crash daemons", 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:43:52.904 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5ab006d900 msgr2=0x7f5ab006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5ab006d900 0x7f5ab006fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009fd0 tx=0x7f5ab8009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 msgr2=0x7f5acc10fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 0x7f5acc10fbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00eb70 tx=0x7f5abc00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 shutdown_connections 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5ab006d900 0x7f5ab006fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc0fcee0 0x7f5acc10fbc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 --2- 172.21.15.157:0/3946423025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0fe0d0 0x7f5acc110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:52.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.905+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 >> 172.21.15.157:0/3946423025 conn(0x7f5acc0f8560 msgr2=0x7f5acc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:52.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.906+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 shutdown_connections 2024-04-03T08:43:52.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:52.906+0000 7f5ad1000700 1 -- 172.21.15.157:0/3946423025 wait complete. 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 -- 172.21.15.157:0/3147699741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 msgr2=0x7f0db80fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 --2- 172.21.15.157:0/3147699741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db80fe540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0da4004940 tx=0x7f0da4009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 -- 172.21.15.157:0/3147699741 shutdown_connections 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 --2- 172.21.15.157:0/3147699741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db80fe540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 --2- 172.21.15.157:0/3147699741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db80fcee0 0x7f0db80fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 -- 172.21.15.157:0/3147699741 >> 172.21.15.157:0/3147699741 conn(0x7f0db80f8560 msgr2=0x7f0db80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 -- 172.21.15.157:0/3147699741 shutdown_connections 2024-04-03T08:43:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.037+0000 7f0dbf400700 1 -- 172.21.15.157:0/3147699741 wait complete. 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.038+0000 7f0dbf400700 1 Processor -- start 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.038+0000 7f0dbf400700 1 -- start start 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.038+0000 7f0dbf400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db80fcee0 0x7f0db810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.038+0000 7f0dbf400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db8110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.038+0000 7f0dbf400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8110700 con 0x7f0db80fe0d0 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.038+0000 7f0dbf400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8110f50 con 0x7f0db80fcee0 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db8110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db8110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44682/0 (socket says 172.21.15.157:44682) 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 -- 172.21.15.157:0/4041225968 learned_addr learned my addr 172.21.15.157:0/4041225968 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0dbca00700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db80fcee0 0x7f0db810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 -- 172.21.15.157:0/4041225968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db80fcee0 msgr2=0x7f0db810fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db80fcee0 0x7f0db810fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 -- 172.21.15.157:0/4041225968 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4005040 con 0x7f0db80fe0d0 2024-04-03T08:43:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.039+0000 7f0db7e00700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db8110100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0da40043d0 tx=0x7f0da4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.040+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da4020070 con 0x7f0db80fe0d0 2024-04-03T08:43:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.040+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0da4009430 con 0x7f0db80fe0d0 2024-04-03T08:43:53.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.040+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db81111d0 con 0x7f0db80fe0d0 2024-04-03T08:43:53.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.040+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da400e070 con 0x7f0db80fe0d0 2024-04-03T08:43:53.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.040+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db81116b0 con 0x7f0db80fe0d0 2024-04-03T08:43:53.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.041+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8101a60 con 0x7f0db80fe0d0 2024-04-03T08:43:53.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.042+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f0da401c770 con 0x7f0db80fe0d0 2024-04-03T08:43:53.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.043+0000 7f0db4c00700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0da006d8a0 0x7f0da006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:43:53.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.043+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0da408e3e0 con 0x7f0db80fe0d0 2024-04-03T08:43:53.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.043+0000 7f0dbca00700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0da006d8a0 0x7f0da006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:43:53.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.044+0000 7f0dbca00700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0da006d8a0 0x7f0da006fd50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009b80 tx=0x7f0dac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:43:53.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.047+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0da405b5c0 con 0x7f0db80fe0d0 2024-04-03T08:43:53.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.335+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0db804bed0 con 0x7f0db80fe0d0 2024-04-03T08:43:53.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.335+0000 7f0db4c00700 1 -- 172.21.15.157:0/4041225968 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0da4004490 con 0x7f0db80fe0d0 2024-04-03T08:43:53.336 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:43:53.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0da006d8a0 msgr2=0x7f0da006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0da006d8a0 0x7f0da006fd50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009b80 tx=0x7f0dac00b040 comp rx=0 tx=0).stop 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 msgr2=0x7f0db8110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db8110100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0da40043d0 tx=0x7f0da4009e30 comp rx=0 tx=0).stop 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 shutdown_connections 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0da006d8a0 0x7f0da006fd50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db80fcee0 0x7f0db810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 --2- 172.21.15.157:0/4041225968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db80fe0d0 0x7f0db8110100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 >> 172.21.15.157:0/4041225968 conn(0x7f0db80f8560 msgr2=0x7f0db80f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 shutdown_connections 2024-04-03T08:43:53.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:43:53.339+0000 7f0dbf400700 1 -- 172.21.15.157:0/4041225968 wait complete. 2024-04-03T08:43:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:53 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/4011183345' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:43:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:53 smithi157 ceph-mon[117693]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:53.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:53 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/4041225968' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:43:53.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:53 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/4011183345' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:43:53.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:53 smithi181 ceph-mon[101094]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:43:53.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:53 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/4041225968' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:43:54.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:54.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:54.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:43:54.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:54 smithi157 ceph-mon[117693]: pgmap v38: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:54.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:54.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:54.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:43:54.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:54 smithi181 ceph-mon[101094]: pgmap v38: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:57 smithi157 ceph-mon[117693]: pgmap v39: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:57.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:57 smithi181 ceph-mon[101094]: pgmap v39: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:43:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:59 smithi157 ceph-mon[117693]: pgmap v40: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:43:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:59.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:59 smithi181 ceph-mon[101094]: pgmap v40: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:43:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:43:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:43:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:00.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:00.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:00.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:01 smithi157 ceph-mon[117693]: pgmap v41: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:44:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:01 smithi181 ceph-mon[101094]: pgmap v41: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:44:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:03.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:03 smithi157 ceph-mon[117693]: pgmap v42: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:03.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:03 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:03.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:03 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:03 smithi181 ceph-mon[101094]: pgmap v42: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:03 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:03 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:05.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:04 smithi157 ceph-mon[117693]: pgmap v43: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:05.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:04 smithi181 ceph-mon[101094]: pgmap v43: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:06.675 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.675 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.675 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all crash 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]: dispatch 2024-04-03T08:44:06.676 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]': finished 2024-04-03T08:44:06.677 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi181"}]: dispatch 2024-04-03T08:44:06.677 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi181"}]': finished 2024-04-03T08:44:06.677 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-03T08:44:06.677 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-03T08:44:06.677 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: Upgrade: osd.0 is safe to restart 2024-04-03T08:44:06.677 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:06 smithi157 ceph-mon[117693]: pgmap v44: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:44:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all crash 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]': finished 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi181"}]: dispatch 2024-04-03T08:44:06.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi181"}]': finished 2024-04-03T08:44:06.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-03T08:44:06.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-03T08:44:06.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: Upgrade: osd.0 is safe to restart 2024-04-03T08:44:06.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:06 smithi181 ceph-mon[101094]: pgmap v44: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:44:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:08 smithi181 ceph-mon[101094]: Upgrade: Updating osd.0 2024-04-03T08:44:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-03T08:44:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:08 smithi181 ceph-mon[101094]: Deploying daemon osd.0 on smithi157 2024-04-03T08:44:08.610 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:08 smithi157 ceph-mon[117693]: Upgrade: Updating osd.0 2024-04-03T08:44:08.610 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:08.610 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-03T08:44:08.610 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:08.610 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:08 smithi157 ceph-mon[117693]: Deploying daemon osd.0 on smithi157 2024-04-03T08:44:09.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:09 smithi181 ceph-mon[101094]: pgmap v45: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:09 smithi157 ceph-mon[117693]: pgmap v45: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:11.347 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:11 smithi157 systemd[1]: Stopping Ceph osd.0 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:44:11.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:11 smithi157 ceph-mon[117693]: pgmap v46: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:44:11.814 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:11 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[58960]: 2024-04-03T08:44:11.404+0000 7ff882e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:44:11.815 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:11 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[58960]: 2024-04-03T08:44:11.404+0000 7ff882e00700 -1 osd.0 50 *** Got signal Terminated *** 2024-04-03T08:44:11.815 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:11 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[58960]: 2024-04-03T08:44:11.404+0000 7ff882e00700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T08:44:11.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:11 smithi181 ceph-mon[101094]: pgmap v46: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:44:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:12 smithi157 ceph-mon[117693]: osd.0 marked itself down and dead 2024-04-03T08:44:12.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:12 smithi181 ceph-mon[101094]: osd.0 marked itself down and dead 2024-04-03T08:44:13.351 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:13 smithi157 bash[127520]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0 2024-04-03T08:44:13.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:13 smithi157 ceph-mon[117693]: pgmap v47: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:13.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:13 smithi157 ceph-mon[117693]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:44:13.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:13 smithi157 ceph-mon[117693]: osdmap e51: 6 total, 5 up, 6 in 2024-04-03T08:44:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:13 smithi181 ceph-mon[101094]: pgmap v47: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:44:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:13 smithi181 ceph-mon[101094]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:44:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:13 smithi181 ceph-mon[101094]: osdmap e51: 6 total, 5 up, 6 in 2024-04-03T08:44:14.685 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:14 smithi157 ceph-mon[117693]: osdmap e52: 6 total, 5 up, 6 in 2024-04-03T08:44:14.685 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:14 smithi157 ceph-mon[117693]: pgmap v50: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-03T08:44:14.685 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:14.685 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:14 smithi181 ceph-mon[101094]: osdmap e52: 6 total, 5 up, 6 in 2024-04-03T08:44:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:14 smithi181 ceph-mon[101094]: pgmap v50: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-03T08:44:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:15.727 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:15 smithi157 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.0.service: Succeeded. 2024-04-03T08:44:15.727 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:15 smithi157 systemd[1]: Stopped Ceph osd.0 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:44:16.064 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:15 smithi157 systemd[1]: Starting Ceph osd.0 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:44:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:16 smithi157 ceph-mon[117693]: Health check failed: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded (PG_DEGRADED) 2024-04-03T08:44:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:16 smithi157 ceph-mon[117693]: mgrmap e40: smithi157.qfvynr(active, since 92s), standbys: smithi181.mfhidq 2024-04-03T08:44:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:16 smithi181 ceph-mon[101094]: Health check failed: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded (PG_DEGRADED) 2024-04-03T08:44:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:16 smithi181 ceph-mon[101094]: mgrmap e40: smithi157.qfvynr(active, since 92s), standbys: smithi181.mfhidq 2024-04-03T08:44:17.515 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:17 smithi157 ceph-mon[117693]: pgmap v51: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-03T08:44:17.516 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:17 smithi157 bash[127792]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-03T08:44:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:17 smithi181 ceph-mon[101094]: pgmap v51: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:18.814 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:18 smithi157 ceph-osd[128106]: -- 172.21.15.157:0/1394877338 <== mon.0 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5652ad93f680 con 0x5652ad908c00 2024-04-03T08:44:18.814 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:18 smithi157 bash[128068]: 90fa5dd9912a620749a430bedd38423202cbb19552f36fc838408ecede0a14c0 2024-04-03T08:44:18.814 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:18 smithi157 systemd[1]: Started Ceph osd.0 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:44:19.266 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:18 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[128083]: 2024-04-03T08:44:18.952+0000 7f77180a07c0 -1 Falling back to public interface 2024-04-03T08:44:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:19 smithi157 ceph-mon[117693]: pgmap v52: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 383 B/s wr, 0 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:19 smithi181 ceph-mon[101094]: pgmap v52: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 383 B/s wr, 0 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:21.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:21 smithi157 ceph-mon[117693]: pgmap v53: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:21 smithi181 ceph-mon[101094]: pgmap v53: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:23.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 -- 172.21.15.157:0/3686875995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 msgr2=0x7fd2c8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:23.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 --2- 172.21.15.157:0/3686875995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c8102380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4004940 tx=0x7fd2b4009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:23.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 -- 172.21.15.157:0/3686875995 shutdown_connections 2024-04-03T08:44:23.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 --2- 172.21.15.157:0/3686875995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c8102380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 --2- 172.21.15.157:0/3686875995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c8066240 0x7fd2c80ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 -- 172.21.15.157:0/3686875995 >> 172.21.15.157:0/3686875995 conn(0x7fd2c80f7430 msgr2=0x7fd2c80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:23.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 -- 172.21.15.157:0/3686875995 shutdown_connections 2024-04-03T08:44:23.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.487+0000 7fd2cda00700 1 -- 172.21.15.157:0/3686875995 wait complete. 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.488+0000 7fd2cda00700 1 Processor -- start 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.488+0000 7fd2cda00700 1 -- start start 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.488+0000 7fd2cda00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c8066240 0x7fd2c80fd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2cda00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c80fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2cda00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80fbf10 con 0x7fd2c80fffa0 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2cda00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80fc080 con 0x7fd2c8066240 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c80fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c80fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59720/0 (socket says 172.21.15.157:59720) 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6000700 1 -- 172.21.15.157:0/1730595793 learned_addr learned my addr 172.21.15.157:0/1730595793 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:23.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6a00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c8066240 0x7fd2c80fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6000700 1 -- 172.21.15.157:0/1730595793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c8066240 msgr2=0x7fd2c80fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6000700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c8066240 0x7fd2c80fd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.489+0000 7fd2c6000700 1 -- 172.21.15.157:0/1730595793 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4005040 con 0x7fd2c80fffa0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.490+0000 7fd2c6000700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c80fb960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009150 tx=0x7fd2b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.490+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b400e040 con 0x7fd2c80fffa0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.490+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2b400bbf0 con 0x7fd2c80fffa0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.490+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c80fc300 con 0x7fd2c80fffa0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.490+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b4013ea0 con 0x7fd2c80fffa0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.490+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8115a70 con 0x7fd2c80fffa0 2024-04-03T08:44:23.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.491+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c805f5f0 con 0x7fd2c80fffa0 2024-04-03T08:44:23.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.492+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd2b400bd60 con 0x7fd2c80fffa0 2024-04-03T08:44:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.493+0000 7fd2bea00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2ac06d7f0 0x7fd2ac06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.494+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd2b408e220 con 0x7fd2c80fffa0 2024-04-03T08:44:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.494+0000 7fd2c6a00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2ac06d7f0 0x7fd2ac06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:23.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.494+0000 7fd2c6a00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2ac06d7f0 0x7fd2ac06fca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80fd220 tx=0x7fd2b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:23.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.502+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd2b4057ad0 con 0x7fd2c80fffa0 2024-04-03T08:44:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:23 smithi157 ceph-mon[117693]: pgmap v54: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 313 B/s wr, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:23 smithi181 ceph-mon[101094]: pgmap v54: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 313 B/s wr, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:23.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.803+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2c80f8f70 con 0x7fd2ac06d7f0 2024-04-03T08:44:23.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.805+0000 7fd2bea00700 1 -- 172.21.15.157:0/1730595793 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd2c80f8f70 con 0x7fd2ac06d7f0 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2ac06d7f0 msgr2=0x7fd2ac06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2ac06d7f0 0x7fd2ac06fca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80fd220 tx=0x7fd2b800b040 comp rx=0 tx=0).stop 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 msgr2=0x7fd2c80fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c80fb960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009150 tx=0x7fd2b4009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 shutdown_connections 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2ac06d7f0 0x7fd2ac06fca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c8066240 0x7fd2c80fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 --2- 172.21.15.157:0/1730595793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2c80fffa0 0x7fd2c80fb960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.807+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 >> 172.21.15.157:0/1730595793 conn(0x7fd2c80f7430 msgr2=0x7fd2c80f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:23.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.808+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 shutdown_connections 2024-04-03T08:44:23.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.808+0000 7fd2cda00700 1 -- 172.21.15.157:0/1730595793 wait complete. 2024-04-03T08:44:23.823 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 -- 172.21.15.157:0/506679602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fe0d0 msgr2=0x7f6ffc0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 --2- 172.21.15.157:0/506679602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fe0d0 0x7f6ffc0fe540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8004940 tx=0x7f6fe8009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 -- 172.21.15.157:0/506679602 shutdown_connections 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 --2- 172.21.15.157:0/506679602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fe0d0 0x7f6ffc0fe540 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 --2- 172.21.15.157:0/506679602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 -- 172.21.15.157:0/506679602 >> 172.21.15.157:0/506679602 conn(0x7f6ffc0f8560 msgr2=0x7f6ffc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 -- 172.21.15.157:0/506679602 shutdown_connections 2024-04-03T08:44:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.964+0000 7f7001e00700 1 -- 172.21.15.157:0/506679602 wait complete. 2024-04-03T08:44:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.965+0000 7f7001e00700 1 Processor -- start 2024-04-03T08:44:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.965+0000 7f7001e00700 1 -- start start 2024-04-03T08:44:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.965+0000 7f7001e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.965+0000 7f7001e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ffc0fe0d0 0x7f6ffc110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.965+0000 7f7001e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc110700 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.965+0000 7f7001e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc110f50 con 0x7f6ffc0fe0d0 2024-04-03T08:44:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc10fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59742/0 (socket says 172.21.15.157:59742) 2024-04-03T08:44:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffaa00700 1 -- 172.21.15.157:0/2603471098 learned_addr learned my addr 172.21.15.157:0/2603471098 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:23.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffa000700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ffc0fe0d0 0x7f6ffc110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffaa00700 1 -- 172.21.15.157:0/2603471098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ffc0fe0d0 msgr2=0x7f6ffc110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffaa00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ffc0fe0d0 0x7f6ffc110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.966+0000 7f6ffaa00700 1 -- 172.21.15.157:0/2603471098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8005040 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.967+0000 7f6ffaa00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc10fbc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00eb70 tx=0x7f6fec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.967+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fec007cc0 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.967+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fec00f040 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.967+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fec00cb20 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.967+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc1111d0 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.967+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc111710 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.968+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc101a60 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.969+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f6fec00cc80 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.971+0000 7f6ff2a00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f6fe006d7f0 0x7f6fe006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.971+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6fec08c800 con 0x7f6ffc0fcee0 2024-04-03T08:44:23.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.972+0000 7f6ffa000700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f6fe006d7f0 0x7f6fe006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:23.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.972+0000 7f6ffa000700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f6fe006d7f0 0x7f6fe006fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800b0d0 tx=0x7f6fe8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:23.977+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6fec059cb0 con 0x7f6ffc0fcee0 2024-04-03T08:44:24.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.222+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ffc111980 con 0x7f6fe006d7f0 2024-04-03T08:44:24.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.224+0000 7f6ff2a00700 1 -- 172.21.15.157:0/2603471098 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ffc111980 con 0x7f6fe006d7f0 2024-04-03T08:44:24.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f6fe006d7f0 msgr2=0x7f6fe006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f6fe006d7f0 0x7f6fe006fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800b0d0 tx=0x7f6fe8009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:24.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 msgr2=0x7f6ffc10fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc10fbc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00eb70 tx=0x7f6fec00b040 comp rx=0 tx=0).stop 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 shutdown_connections 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f6fe006d7f0 0x7f6fe006fca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ffc0fcee0 0x7f6ffc10fbc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 --2- 172.21.15.157:0/2603471098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ffc0fe0d0 0x7f6ffc110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.226+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 >> 172.21.15.157:0/2603471098 conn(0x7f6ffc0f8560 msgr2=0x7f6ffc0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.227+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 shutdown_connections 2024-04-03T08:44:24.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.227+0000 7f7001e00700 1 -- 172.21.15.157:0/2603471098 wait complete. 2024-04-03T08:44:24.314 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:24 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[128083]: 2024-04-03T08:44:24.048+0000 7f77180a07c0 -1 osd.0 50 log_to_monitors true 2024-04-03T08:44:24.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:24 smithi157 ceph-mon[117693]: from='osd.0 [v2:172.21.15.157:6802/637370792,v1:172.21.15.157:6803/637370792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-03T08:44:24.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:24 smithi157 ceph-mon[117693]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 -- 172.21.15.157:0/4009786785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fcc20 msgr2=0x7fe8fc0fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 --2- 172.21.15.157:0/4009786785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fcc20 0x7fe8fc0fd030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec004940 tx=0x7fe8ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 -- 172.21.15.157:0/4009786785 shutdown_connections 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 --2- 172.21.15.157:0/4009786785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc0fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 --2- 172.21.15.157:0/4009786785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fcc20 0x7fe8fc0fd030 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 -- 172.21.15.157:0/4009786785 >> 172.21.15.157:0/4009786785 conn(0x7fe8fc0f83a0 msgr2=0x7fe8fc0fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:24.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 -- 172.21.15.157:0/4009786785 shutdown_connections 2024-04-03T08:44:24.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.388+0000 7fe8fb200700 1 -- 172.21.15.157:0/4009786785 wait complete. 2024-04-03T08:44:24.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.389+0000 7fe8fb200700 1 Processor -- start 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.389+0000 7fe8fb200700 1 -- start start 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8fb200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0fcc20 0x7fe8fc10fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8fb200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc10ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8fb200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc110590 con 0x7fe8fc0fded0 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8fb200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc110de0 con 0x7fe8fc0fcc20 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8f9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc10ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8f9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc10ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59788/0 (socket says 172.21.15.157:59788) 2024-04-03T08:44:24.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8f9400700 1 -- 172.21.15.157:0/2795278287 learned_addr learned my addr 172.21.15.157:0/2795278287 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.390+0000 7fe8f9e00700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0fcc20 0x7fe8fc10fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f9400700 1 -- 172.21.15.157:0/2795278287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0fcc20 msgr2=0x7fe8fc10fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f9400700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0fcc20 0x7fe8fc10fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f9400700 1 -- 172.21.15.157:0/2795278287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec005040 con 0x7fe8fc0fded0 2024-04-03T08:44:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f9400700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc10ff90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8002a50 tx=0x7fe8e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:24.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8007cc0 con 0x7fe8fc0fded0 2024-04-03T08:44:24.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc1110c0 con 0x7fe8fc0fded0 2024-04-03T08:44:24.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8e800f040 con 0x7fe8fc0fded0 2024-04-03T08:44:24.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8009640 con 0x7fe8fc0fded0 2024-04-03T08:44:24.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.391+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc111600 con 0x7fe8fc0fded0 2024-04-03T08:44:24.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.393+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc101860 con 0x7fe8fc0fded0 2024-04-03T08:44:24.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.394+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe8e80097a0 con 0x7fe8fc0fded0 2024-04-03T08:44:24.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.395+0000 7fe8f2000700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8e006d7f0 0x7fe8e006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:24.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.395+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe8e808cc60 con 0x7fe8fc0fded0 2024-04-03T08:44:24.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.395+0000 7fe8f9e00700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8e006d7f0 0x7fe8e006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:24.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.396+0000 7fe8f9e00700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8e006d7f0 0x7fe8e006fca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec004f90 tx=0x7fe8ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.400+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe8e8059fc0 con 0x7fe8fc0fded0 2024-04-03T08:44:24.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:24 smithi181 ceph-mon[101094]: from='osd.0 [v2:172.21.15.157:6802/637370792,v1:172.21.15.157:6803/637370792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-03T08:44:24.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:24 smithi181 ceph-mon[101094]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-03T08:44:24.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.733+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8fc111870 con 0x7fe8e006d7f0 2024-04-03T08:44:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.752+0000 7fe8f2000700 1 -- 172.21.15.157:0/2795278287 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe8fc111870 con 0x7fe8e006d7f0 2024-04-03T08:44:24.753 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (4m) 24s ago 14m 14.5M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (37s) 24s ago 14m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (31s) 27s ago 13m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (3m) 24s ago 14m 74.6M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (8m) 24s ago 8m 13.6M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (8m) 24s ago 8m 136M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (8m) 27s ago 8m 13.6M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (8m) 27s ago 8m 99.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (2m) 24s ago 16m 495M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (2m) 27s ago 13m 449M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (111s) 24s ago 16m 39.8M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:44:24.754 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (83s) 27s ago 13m 32.3M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (4m) 24s ago 14m 7507k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (2m) 27s ago 13m 7616k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 starting - - - 1618M 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (12m) 24s ago 12m 244M 1618M 17.2.7-805-g6fda41ff a49113eacc58 e593c6d66883 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (11m) 24s ago 11m 204M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (11m) 27s ago 11m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (10m) 27s ago 10m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (10m) 27s ago 10m 225M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:44:24.755 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (2m) 24s ago 14m 47.3M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:44:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8e006d7f0 msgr2=0x7fe8e006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8e006d7f0 0x7fe8e006fca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec004f90 tx=0x7fe8ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 msgr2=0x7fe8fc10ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc10ff90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8002a50 tx=0x7fe8e80046b0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 shutdown_connections 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8e006d7f0 0x7fe8e006fca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0fcc20 0x7fe8fc10fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 --2- 172.21.15.157:0/2795278287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8fc0fded0 0x7fe8fc10ff90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 >> 172.21.15.157:0/2795278287 conn(0x7fe8fc0f83a0 msgr2=0x7fe8fc0f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 shutdown_connections 2024-04-03T08:44:24.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.756+0000 7fe8fb200700 1 -- 172.21.15.157:0/2795278287 wait complete. 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 -- 172.21.15.157:0/1903351435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 msgr2=0x7f397c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 --2- 172.21.15.157:0/1903351435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c0fe540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3968004940 tx=0x7f3968009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 -- 172.21.15.157:0/1903351435 shutdown_connections 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 --2- 172.21.15.157:0/1903351435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c0fe540 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 --2- 172.21.15.157:0/1903351435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f397c0fcee0 0x7f397c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 -- 172.21.15.157:0/1903351435 >> 172.21.15.157:0/1903351435 conn(0x7f397c0f8560 msgr2=0x7f397c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 -- 172.21.15.157:0/1903351435 shutdown_connections 2024-04-03T08:44:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.964+0000 7f3983a00700 1 -- 172.21.15.157:0/1903351435 wait complete. 2024-04-03T08:44:24.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.965+0000 7f3983a00700 1 Processor -- start 2024-04-03T08:44:24.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.966+0000 7f3983a00700 1 -- start start 2024-04-03T08:44:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.966+0000 7f3983a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f397c0fcee0 0x7f397c10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.966+0000 7f3983a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.966+0000 7f3983a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c110850 con 0x7f397c0fe0d0 2024-04-03T08:44:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.966+0000 7f3983a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c110f90 con 0x7f397c0fcee0 2024-04-03T08:44:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f397be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:24.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f397be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59800/0 (socket says 172.21.15.157:59800) 2024-04-03T08:44:24.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f397be00700 1 -- 172.21.15.157:0/1842389387 learned_addr learned my addr 172.21.15.157:0/1842389387 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:24.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f3981000700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f397c0fcee0 0x7f397c10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:24.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f397be00700 1 -- 172.21.15.157:0/1842389387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f397c0fcee0 msgr2=0x7f397c10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:24.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f397be00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f397c0fcee0 0x7f397c10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:24.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.967+0000 7f397be00700 1 -- 172.21.15.157:0/1842389387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968005040 con 0x7f397c0fe0d0 2024-04-03T08:44:24.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.968+0000 7f397be00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c110250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f396800b3b0 tx=0x7f3968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:24.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.968+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396800e040 con 0x7f397c0fe0d0 2024-04-03T08:44:24.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.968+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3968004290 con 0x7f397c0fe0d0 2024-04-03T08:44:24.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.968+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396801c630 con 0x7f397c0fe0d0 2024-04-03T08:44:24.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.969+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c111210 con 0x7f397c0fe0d0 2024-04-03T08:44:24.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.969+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c1117d0 con 0x7f397c0fe0d0 2024-04-03T08:44:24.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.970+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c101a60 con 0x7f397c0fe0d0 2024-04-03T08:44:24.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.972+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f396800bbf0 con 0x7f397c0fe0d0 2024-04-03T08:44:24.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.974+0000 7f3978c00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f396406d7f0 0x7f396406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:24.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.974+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f396808e2f0 con 0x7f397c0fe0d0 2024-04-03T08:44:24.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.974+0000 7f3981000700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f396406d7f0 0x7f396406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:24.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.975+0000 7f3981000700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f396406d7f0 0x7f396406fca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f397c0fcc20 tx=0x7f397000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:24.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:24.978+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f396805b6d0 con 0x7f397c0fe0d0 2024-04-03T08:44:25.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.387+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f397c111ab0 con 0x7f397c0fe0d0 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.387+0000 7f3978c00700 1 -- 172.21.15.157:0/1842389387 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f396805b260 con 0x7f397c0fe0d0 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:44:25.388 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 5 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 9, 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:44:25.389 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f396406d7f0 msgr2=0x7f396406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f396406d7f0 0x7f396406fca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f397c0fcc20 tx=0x7f397000b040 comp rx=0 tx=0).stop 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 msgr2=0x7f397c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c110250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f396800b3b0 tx=0x7f3968009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 shutdown_connections 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f396406d7f0 0x7f396406fca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f397c0fcee0 0x7f397c10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 --2- 172.21.15.157:0/1842389387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f397c0fe0d0 0x7f397c110250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 >> 172.21.15.157:0/1842389387 conn(0x7f397c0f8560 msgr2=0x7f397c0f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 shutdown_connections 2024-04-03T08:44:25.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.390+0000 7f3983a00700 1 -- 172.21.15.157:0/1842389387 wait complete. 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.530+0000 7fa47e200700 1 -- 172.21.15.157:0/1169968752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 msgr2=0x7fa4780fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.530+0000 7fa47e200700 1 --2- 172.21.15.157:0/1169968752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa4780fe330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa464004940 tx=0x7fa464009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.531+0000 7fa47e200700 1 -- 172.21.15.157:0/1169968752 shutdown_connections 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.531+0000 7fa47e200700 1 --2- 172.21.15.157:0/1169968752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa4780fe330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.531+0000 7fa47e200700 1 --2- 172.21.15.157:0/1169968752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4780fcc10 0x7fa4780fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.531+0000 7fa47e200700 1 -- 172.21.15.157:0/1169968752 >> 172.21.15.157:0/1169968752 conn(0x7fa4780f83d0 msgr2=0x7fa4780fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.531+0000 7fa47e200700 1 -- 172.21.15.157:0/1169968752 shutdown_connections 2024-04-03T08:44:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.531+0000 7fa47e200700 1 -- 172.21.15.157:0/1169968752 wait complete. 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.532+0000 7fa47e200700 1 Processor -- start 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.532+0000 7fa47e200700 1 -- start start 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.532+0000 7fa47e200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4780fcc10 0x7fa47810fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.532+0000 7fa47e200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa47810ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.532+0000 7fa47e200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478110630 con 0x7fa4780fdec0 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.532+0000 7fa47e200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478110e20 con 0x7fa4780fcc10 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa47810ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa47810ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59814/0 (socket says 172.21.15.157:59814) 2024-04-03T08:44:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 -- 172.21.15.157:0/1876335237 learned_addr learned my addr 172.21.15.157:0/1876335237 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa47ce00700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4780fcc10 0x7fa47810fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 -- 172.21.15.157:0/1876335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4780fcc10 msgr2=0x7fa47810fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4780fcc10 0x7fa47810fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 -- 172.21.15.157:0/1876335237 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464005040 con 0x7fa4780fdec0 2024-04-03T08:44:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.533+0000 7fa477e00700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa47810ffa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b3b0 tx=0x7fa464009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.534+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46400e040 con 0x7fa4780fdec0 2024-04-03T08:44:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.534+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa464004290 con 0x7fa4780fdec0 2024-04-03T08:44:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.534+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46401c3f0 con 0x7fa4780fdec0 2024-04-03T08:44:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.534+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4781110a0 con 0x7fa4780fdec0 2024-04-03T08:44:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.534+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa478111610 con 0x7fa4780fdec0 2024-04-03T08:44:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.535+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478101850 con 0x7fa4780fdec0 2024-04-03T08:44:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.536+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa46400bbf0 con 0x7fa4780fdec0 2024-04-03T08:44:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.537+0000 7fa474c00700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa46006d7f0 0x7fa46006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.537+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa46408e260 con 0x7fa4780fdec0 2024-04-03T08:44:25.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.537+0000 7fa47ce00700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa46006d7f0 0x7fa46006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:25.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.538+0000 7fa47ce00700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa46006d7f0 0x7fa46006fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009bf0 tx=0x7fa46c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:25.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.541+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa46405b5c0 con 0x7fa4780fdec0 2024-04-03T08:44:25.564 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[128083]: 2024-04-03T08:44:25.246+0000 7f7702400700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:44:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: pgmap v55: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 948 B/s rd, 284 B/s wr, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-03T08:44:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: osdmap e53: 6 total, 5 up, 6 in 2024-04-03T08:44:25.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='osd.0 [v2:172.21.15.157:6802/637370792,v1:172.21.15.157:6803/637370792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:44:25.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:44:25.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:25.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:25.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:25 smithi157 ceph-mon[117693]: from='osd.0 ' entity='osd.0' 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: pgmap v55: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 948 B/s rd, 284 B/s wr, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: osdmap e53: 6 total, 5 up, 6 in 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='osd.0 [v2:172.21.15.157:6802/637370792,v1:172.21.15.157:6803/637370792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:25 smithi181 ceph-mon[101094]: from='osd.0 ' entity='osd.0' 2024-04-03T08:44:25.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.817+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa478105880 con 0x7fa4780fdec0 2024-04-03T08:44:25.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.817+0000 7fa474c00700 1 -- 172.21.15.157:0/1876335237 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7fa46405b150 con 0x7fa4780fdec0 2024-04-03T08:44:25.818 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:44:25.818 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:44:25.818 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:44:25.818 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:44:25.818 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:44:25.819 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:44:25.820 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:25.821 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa46006d7f0 msgr2=0x7fa46006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa46006d7f0 0x7fa46006fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009bf0 tx=0x7fa46c0091a0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 msgr2=0x7fa47810ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa47810ffa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b3b0 tx=0x7fa464009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 shutdown_connections 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa46006d7f0 0x7fa46006fca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4780fcc10 0x7fa47810fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 --2- 172.21.15.157:0/1876335237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4780fdec0 0x7fa47810ffa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 >> 172.21.15.157:0/1876335237 conn(0x7fa4780f83d0 msgr2=0x7fa4780f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:25.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 shutdown_connections 2024-04-03T08:44:25.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.820+0000 7fa47e200700 1 -- 172.21.15.157:0/1876335237 wait complete. 2024-04-03T08:44:25.823 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 -- 172.21.15.157:0/2027582256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fcee0 msgr2=0x7fee740fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 --2- 172.21.15.157:0/2027582256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fcee0 0x7fee740fd310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee64004940 tx=0x7fee64009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 -- 172.21.15.157:0/2027582256 shutdown_connections 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 --2- 172.21.15.157:0/2027582256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee740fe0d0 0x7fee740fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 --2- 172.21.15.157:0/2027582256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fcee0 0x7fee740fd310 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 -- 172.21.15.157:0/2027582256 >> 172.21.15.157:0/2027582256 conn(0x7fee740f8560 msgr2=0x7fee740fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 -- 172.21.15.157:0/2027582256 shutdown_connections 2024-04-03T08:44:25.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.963+0000 7fee79200700 1 -- 172.21.15.157:0/2027582256 wait complete. 2024-04-03T08:44:25.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.964+0000 7fee79200700 1 Processor -- start 2024-04-03T08:44:25.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.964+0000 7fee79200700 1 -- start start 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.964+0000 7fee79200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee740fcee0 0x7fee74071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee79200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 0x7fee74070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee79200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee740708c0 con 0x7fee740fe0d0 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee79200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74070a30 con 0x7fee740fcee0 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 0x7fee74070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 0x7fee74070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59836/0 (socket says 172.21.15.157:59836) 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71400700 1 -- 172.21.15.157:0/2670047665 learned_addr learned my addr 172.21.15.157:0/2670047665 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:25.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71e00700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee740fcee0 0x7fee74071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71400700 1 -- 172.21.15.157:0/2670047665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee740fcee0 msgr2=0x7fee74071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71400700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee740fcee0 0x7fee74071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.965+0000 7fee71400700 1 -- 172.21.15.157:0/2670047665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64005040 con 0x7fee740fe0d0 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.966+0000 7fee71400700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 0x7fee74070310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee6000eb40 tx=0x7fee6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.966+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee60007cc0 con 0x7fee740fe0d0 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.966+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee74070cb0 con 0x7fee740fe0d0 2024-04-03T08:44:25.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.966+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee6000f040 con 0x7fee740fe0d0 2024-04-03T08:44:25.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.966+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6000ca10 con 0x7fee740fe0d0 2024-04-03T08:44:25.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.966+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee74115a00 con 0x7fee740fe0d0 2024-04-03T08:44:25.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.967+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7405f5f0 con 0x7fee740fe0d0 2024-04-03T08:44:25.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.968+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fee6000cb70 con 0x7fee740fe0d0 2024-04-03T08:44:25.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.969+0000 7fee6a000700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fee5806d7f0 0x7fee5806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:25.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.969+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fee6008c9b0 con 0x7fee740fe0d0 2024-04-03T08:44:25.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.969+0000 7fee71e00700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fee5806d7f0 0x7fee5806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:25.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.970+0000 7fee71e00700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fee5806d7f0 0x7fee5806fca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee74071bd0 tx=0x7fee64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:25.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:25.974+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee60056330 con 0x7fee740fe0d0 2024-04-03T08:44:26.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.211+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee741023e0 con 0x7fee5806d7f0 2024-04-03T08:44:26.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.213+0000 7fee6a000700 1 -- 172.21.15.157:0/2670047665 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fee741023e0 con 0x7fee5806d7f0 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:44:26.214 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "7/21 daemons upgraded", 2024-04-03T08:44:26.215 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading osd daemons", 2024-04-03T08:44:26.215 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:44:26.215 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fee5806d7f0 msgr2=0x7fee5806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fee5806d7f0 0x7fee5806fca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee74071bd0 tx=0x7fee64009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 msgr2=0x7fee74070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 0x7fee74070310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee6000eb40 tx=0x7fee6000b040 comp rx=0 tx=0).stop 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 shutdown_connections 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fee5806d7f0 0x7fee5806fca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee740fcee0 0x7fee74071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 --2- 172.21.15.157:0/2670047665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee740fe0d0 0x7fee74070310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 >> 172.21.15.157:0/2670047665 conn(0x7fee740f8560 msgr2=0x7fee740f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 shutdown_connections 2024-04-03T08:44:26.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.216+0000 7fee79200700 1 -- 172.21.15.157:0/2670047665 wait complete. 2024-04-03T08:44:26.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 -- 172.21.15.157:0/3188980329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 msgr2=0x7f39000fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:26.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 --2- 172.21.15.157:0/3188980329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f39000fd310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38f0004940 tx=0x7f38f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:26.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 -- 172.21.15.157:0/3188980329 shutdown_connections 2024-04-03T08:44:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 --2- 172.21.15.157:0/3188980329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39000fe0d0 0x7f39000fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 --2- 172.21.15.157:0/3188980329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f39000fd310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 -- 172.21.15.157:0/3188980329 >> 172.21.15.157:0/3188980329 conn(0x7f39000f8560 msgr2=0x7f39000fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 -- 172.21.15.157:0/3188980329 shutdown_connections 2024-04-03T08:44:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.382+0000 7f3906800700 1 -- 172.21.15.157:0/3188980329 wait complete. 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.383+0000 7f3906800700 1 Processor -- start 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.383+0000 7f3906800700 1 -- start start 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f3906800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f390010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f3906800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39000fe0d0 0x7f3900110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f3906800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900110720 con 0x7f39000fcee0 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f3906800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900110f70 con 0x7f39000fe0d0 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38ff400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f390010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38ff400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f390010fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:59858/0 (socket says 172.21.15.157:59858) 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38ff400700 1 -- 172.21.15.157:0/1456919071 learned_addr learned my addr 172.21.15.157:0/1456919071 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38fea00700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39000fe0d0 0x7f3900110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38ff400700 1 -- 172.21.15.157:0/1456919071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39000fe0d0 msgr2=0x7f3900110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38ff400700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39000fe0d0 0x7f3900110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.384+0000 7f38ff400700 1 -- 172.21.15.157:0/1456919071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005040 con 0x7f39000fcee0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.385+0000 7f38ff400700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f390010fbe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38f00040d0 tx=0x7f38f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.385+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f000e070 con 0x7f39000fcee0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.385+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39001111f0 con 0x7f39000fcee0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.385+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38f001c400 con 0x7f39000fcee0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.385+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39001116d0 con 0x7f39000fcee0 2024-04-03T08:44:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.385+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f0026640 con 0x7f39000fcee0 2024-04-03T08:44:26.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.386+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900101a60 con 0x7f39000fcee0 2024-04-03T08:44:26.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.387+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f38f001ca50 con 0x7f39000fcee0 2024-04-03T08:44:26.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.388+0000 7f38f7400700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f38e406d7f0 0x7f38e406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:26.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.388+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f38f008e560 con 0x7f39000fcee0 2024-04-03T08:44:26.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.389+0000 7f38fea00700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f38e406d7f0 0x7f38e406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:26.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.389+0000 7f38fea00700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f38e406d7f0 0x7f38e406fca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009b80 tx=0x7f38ec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:26.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.393+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f38f005b8c0 con 0x7f39000fcee0 2024-04-03T08:44:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1842389387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1876335237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:44:26.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:44:26.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: osd.0 [v2:172.21.15.157:6802/637370792,v1:172.21.15.157:6803/637370792] boot 2024-04-03T08:44:26.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: osdmap e54: 6 total, 6 up, 6 in 2024-04-03T08:44:26.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1842389387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1876335237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: osd.0 [v2:172.21.15.157:6802/637370792,v1:172.21.15.157:6803/637370792] boot 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: osdmap e54: 6 total, 6 up, 6 in 2024-04-03T08:44:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-03T08:44:26.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.691+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f390005f5f0 con 0x7f39000fcee0 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.692+0000 7f38f7400700 1 -- 172.21.15.157:0/1456919071 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1182 (secure 0 0 0) 0x7f38f005b450 con 0x7f39000fcee0 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_WARN Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-04-03T08:44:26.693 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-04-03T08:44:26.694 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-03T08:44:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.694+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f38e406d7f0 msgr2=0x7f38e406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.694+0000 7f3906800700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f38e406d7f0 0x7f38e406fca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009b80 tx=0x7f38ec00b040 comp rx=0 tx=0).stop 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.694+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 msgr2=0x7f390010fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.694+0000 7f3906800700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f390010fbe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38f00040d0 tx=0x7f38f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 shutdown_connections 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f38e406d7f0 0x7f38e406fca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39000fcee0 0x7f390010fbe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 --2- 172.21.15.157:0/1456919071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39000fe0d0 0x7f3900110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 >> 172.21.15.157:0/1456919071 conn(0x7f39000f8560 msgr2=0x7f39000f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 shutdown_connections 2024-04-03T08:44:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:26.695+0000 7f3906800700 1 -- 172.21.15.157:0/1456919071 wait complete. 2024-04-03T08:44:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:27 smithi157 ceph-mon[117693]: pgmap v57: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:27 smithi157 ceph-mon[117693]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:27 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1456919071' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:44:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:27 smithi157 ceph-mon[117693]: osdmap e55: 6 total, 6 up, 6 in 2024-04-03T08:44:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:27 smithi181 ceph-mon[101094]: pgmap v57: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:27 smithi181 ceph-mon[101094]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:27 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1456919071' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:44:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:27 smithi181 ceph-mon[101094]: osdmap e55: 6 total, 6 up, 6 in 2024-04-03T08:44:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:29 smithi157 ceph-mon[117693]: pgmap v60: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:29 smithi181 ceph-mon[101094]: pgmap v60: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 40/222 objects degraded (18.018%) 2024-04-03T08:44:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:30.734 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:30 smithi157 ceph-mon[117693]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded) 2024-04-03T08:44:30.734 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:30 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:44:30.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:30 smithi181 ceph-mon[101094]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded) 2024-04-03T08:44:30.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:30 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:44:31.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: pgmap v61: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 46 B/s, 0 objects/s recovering 2024-04-03T08:44:31.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:31.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:31.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:31.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:44:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-03T08:44:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: pgmap v61: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 46 B/s, 0 objects/s recovering 2024-04-03T08:44:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:31.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-03T08:44:32.774 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:32 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-03T08:44:32.774 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:32 smithi157 ceph-mon[117693]: Upgrade: osd.1 is safe to restart 2024-04-03T08:44:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:32 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-03T08:44:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:32 smithi181 ceph-mon[101094]: Upgrade: osd.1 is safe to restart 2024-04-03T08:44:33.695 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:33 smithi157 ceph-mon[117693]: pgmap v62: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 35 B/s, 0 objects/s recovering 2024-04-03T08:44:33.695 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:33 smithi157 ceph-mon[117693]: Upgrade: Updating osd.1 2024-04-03T08:44:33.695 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:33.695 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-03T08:44:33.695 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:33.696 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:33 smithi157 ceph-mon[117693]: Deploying daemon osd.1 on smithi157 2024-04-03T08:44:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:33 smithi181 ceph-mon[101094]: pgmap v62: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 35 B/s, 0 objects/s recovering 2024-04-03T08:44:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:33 smithi181 ceph-mon[101094]: Upgrade: Updating osd.1 2024-04-03T08:44:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-03T08:44:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:33 smithi181 ceph-mon[101094]: Deploying daemon osd.1 on smithi157 2024-04-03T08:44:34.515 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:34 smithi157 ceph-mon[117693]: pgmap v63: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 35 B/s, 0 objects/s recovering 2024-04-03T08:44:34.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:34 smithi181 ceph-mon[101094]: pgmap v63: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 35 B/s, 0 objects/s recovering 2024-04-03T08:44:37.207 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:36 smithi157 systemd[1]: Stopping Ceph osd.1 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:44:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:37 smithi157 ceph-mon[117693]: pgmap v64: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 928 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-04-03T08:44:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:37 smithi157 ceph-mon[117693]: osd.1 marked itself down and dead 2024-04-03T08:44:37.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:37 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[68587]: 2024-04-03T08:44:37.204+0000 7fd587000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:44:37.565 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:37 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[68587]: 2024-04-03T08:44:37.204+0000 7fd587000700 -1 osd.1 55 *** Got signal Terminated *** 2024-04-03T08:44:37.565 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:37 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[68587]: 2024-04-03T08:44:37.204+0000 7fd587000700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T08:44:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:37 smithi181 ceph-mon[101094]: pgmap v64: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 928 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-04-03T08:44:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:37 smithi181 ceph-mon[101094]: osd.1 marked itself down and dead 2024-04-03T08:44:38.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:38 smithi157 bash[134284]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1 2024-04-03T08:44:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:38 smithi157 ceph-mon[117693]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:44:38.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:38 smithi157 ceph-mon[117693]: osdmap e56: 6 total, 5 up, 6 in 2024-04-03T08:44:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:38 smithi181 ceph-mon[101094]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:44:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:38 smithi181 ceph-mon[101094]: osdmap e56: 6 total, 5 up, 6 in 2024-04-03T08:44:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:39 smithi157 ceph-mon[117693]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-04-03T08:44:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:39 smithi157 ceph-mon[117693]: osdmap e57: 6 total, 5 up, 6 in 2024-04-03T08:44:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:39 smithi181 ceph-mon[101094]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-04-03T08:44:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:39 smithi181 ceph-mon[101094]: osdmap e57: 6 total, 5 up, 6 in 2024-04-03T08:44:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:40.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:40 smithi157 ceph-mon[117693]: Health check failed: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded (PG_DEGRADED) 2024-04-03T08:44:40.565 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:40 smithi157 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.1.service: Succeeded. 2024-04-03T08:44:40.565 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:40 smithi157 systemd[1]: Stopped Ceph osd.1 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:44:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:40 smithi181 ceph-mon[101094]: Health check failed: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded (PG_DEGRADED) 2024-04-03T08:44:41.060 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:40 smithi157 systemd[1]: Starting Ceph osd.1 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:44:41.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:41 smithi157 ceph-mon[117693]: pgmap v68: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:41 smithi181 ceph-mon[101094]: pgmap v68: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:42.314 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-03T08:44:42.314 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-03T08:44:42.314 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-03T08:44:42.314 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-03T08:44:42.314 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-03T08:44:42.315 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-03T08:44:42.315 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:41 smithi157 bash[134560]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-03T08:44:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:43 smithi157 ceph-mon[117693]: pgmap v69: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:43.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:43 smithi157 ceph-osd[134882]: -- 172.21.15.157:0/659342302 <== mon.0 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fde959d680 con 0x55fde9566c00 2024-04-03T08:44:43.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:43 smithi157 bash[134844]: 9bc4dfa4f20009ee60ba9c17d4c7ee9a02838bb4bff90720b7b4929d1c08c345 2024-04-03T08:44:43.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:43 smithi157 systemd[1]: Started Ceph osd.1 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:44:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:43 smithi181 ceph-mon[101094]: pgmap v69: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:44.064 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:43 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[134859]: 2024-04-03T08:44:43.757+0000 7f79540737c0 -1 Falling back to public interface 2024-04-03T08:44:44.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:44.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:44.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:44.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:44 smithi157 ceph-mon[117693]: pgmap v70: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:44.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:44.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:44 smithi181 ceph-mon[101094]: pgmap v70: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:44:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:47 smithi157 ceph-mon[117693]: pgmap v71: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:47 smithi181 ceph-mon[101094]: pgmap v71: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:49 smithi157 ceph-mon[117693]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:49.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:49 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[134859]: 2024-04-03T08:44:49.267+0000 7f79540737c0 -1 osd.1 55 log_to_monitors true 2024-04-03T08:44:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:49 smithi181 ceph-mon[101094]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-03T08:44:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:50 smithi157 ceph-mon[117693]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-03T08:44:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:50 smithi181 ceph-mon[101094]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-03T08:44:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:51.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[134859]: 2024-04-03T08:44:51.111+0000 7f793e400700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:44:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:44:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-03T08:44:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: osdmap e58: 6 total, 5 up, 6 in 2024-04-03T08:44:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:44:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' 2024-04-03T08:44:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: osdmap e58: 6 total, 5 up, 6 in 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: from='osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362]' entity='osd.1' 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:52 smithi157 ceph-mon[117693]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:44:52.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:52 smithi157 ceph-mon[117693]: osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362] boot 2024-04-03T08:44:52.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:52 smithi157 ceph-mon[117693]: osdmap e59: 6 total, 6 up, 6 in 2024-04-03T08:44:52.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:52 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:44:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:52 smithi181 ceph-mon[101094]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:44:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:52 smithi181 ceph-mon[101094]: osd.1 [v2:172.21.15.157:6810/2111989362,v1:172.21.15.157:6811/2111989362] boot 2024-04-03T08:44:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:52 smithi181 ceph-mon[101094]: osdmap e59: 6 total, 6 up, 6 in 2024-04-03T08:44:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:52 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-03T08:44:53.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:53 smithi157 ceph-mon[117693]: pgmap v76: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:44:53.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:53 smithi157 ceph-mon[117693]: osdmap e60: 6 total, 6 up, 6 in 2024-04-03T08:44:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:53 smithi181 ceph-mon[101094]: pgmap v76: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:44:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:53 smithi181 ceph-mon[101094]: osdmap e60: 6 total, 6 up, 6 in 2024-04-03T08:44:55.507 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:55 smithi157 ceph-mon[117693]: pgmap v78: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:44:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:55 smithi181 ceph-mon[101094]: pgmap v78: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:44:56.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 -- 172.21.15.157:0/1904632589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0fff00 msgr2=0x7fddfc102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 --2- 172.21.15.157:0/1904632589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0fff00 0x7fddfc102320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdde8004940 tx=0x7fdde8009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 -- 172.21.15.157:0/1904632589 shutdown_connections 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 --2- 172.21.15.157:0/1904632589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0fff00 0x7fddfc102320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 --2- 172.21.15.157:0/1904632589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddfc0662e0 0x7fddfc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 -- 172.21.15.157:0/1904632589 >> 172.21.15.157:0/1904632589 conn(0x7fddfc0f7430 msgr2=0x7fddfc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 -- 172.21.15.157:0/1904632589 shutdown_connections 2024-04-03T08:44:56.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.840+0000 7fde00e00700 1 -- 172.21.15.157:0/1904632589 wait complete. 2024-04-03T08:44:56.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.841+0000 7fde00e00700 1 Processor -- start 2024-04-03T08:44:56.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.841+0000 7fde00e00700 1 -- start start 2024-04-03T08:44:56.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.841+0000 7fde00e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 0x7fddfc0fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:56.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.841+0000 7fde00e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddfc0fff00 0x7fddfc0fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.841+0000 7fde00e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc0fbee0 con 0x7fddfc0662e0 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.841+0000 7fde00e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc0fc020 con 0x7fddfc0fff00 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 0x7fddfc0fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 0x7fddfc0fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55232/0 (socket says 172.21.15.157:55232) 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 -- 172.21.15.157:0/1209666063 learned_addr learned my addr 172.21.15.157:0/1209666063 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9400700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddfc0fff00 0x7fddfc0fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 -- 172.21.15.157:0/1209666063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddfc0fff00 msgr2=0x7fddfc0fb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddfc0fff00 0x7fddfc0fb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 -- 172.21.15.157:0/1209666063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8005040 con 0x7fddfc0662e0 2024-04-03T08:44:56.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.842+0000 7fddf9e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 0x7fddfc0fd3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fddec00b790 tx=0x7fddec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.843+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddec00f6f0 con 0x7fddfc0662e0 2024-04-03T08:44:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.843+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddec00fd20 con 0x7fddfc0662e0 2024-04-03T08:44:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.843+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc0fc300 con 0x7fddfc0662e0 2024-04-03T08:44:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.843+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddec0103a0 con 0x7fddfc0662e0 2024-04-03T08:44:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.843+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc115af0 con 0x7fddfc0662e0 2024-04-03T08:44:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.844+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc05f5f0 con 0x7fddfc0662e0 2024-04-03T08:44:56.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.845+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fddec011400 con 0x7fddfc0662e0 2024-04-03T08:44:56.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.846+0000 7fddf2000700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdde006d7f0 0x7fdde006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:56.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.846+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fddec08cde0 con 0x7fddfc0662e0 2024-04-03T08:44:56.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.846+0000 7fddf9400700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdde006d7f0 0x7fdde006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:56.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.847+0000 7fddf9400700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdde006d7f0 0x7fdde006fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0fd980 tx=0x7fdde8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:56.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:56.851+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fddec056590 con 0x7fddfc0662e0 2024-04-03T08:44:57.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.077+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddfc0f8f70 con 0x7fdde006d7f0 2024-04-03T08:44:57.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.079+0000 7fddf2000700 1 -- 172.21.15.157:0/1209666063 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fddfc0f8f70 con 0x7fdde006d7f0 2024-04-03T08:44:57.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.081+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdde006d7f0 msgr2=0x7fdde006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.081+0000 7fde00e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdde006d7f0 0x7fdde006fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0fd980 tx=0x7fdde8009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:57.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.081+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 msgr2=0x7fddfc0fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.081+0000 7fde00e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 0x7fddfc0fd3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fddec00b790 tx=0x7fddec009220 comp rx=0 tx=0).stop 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 shutdown_connections 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdde006d7f0 0x7fdde006fca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddfc0662e0 0x7fddfc0fd3a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 --2- 172.21.15.157:0/1209666063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddfc0fff00 0x7fddfc0fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 >> 172.21.15.157:0/1209666063 conn(0x7fddfc0f7430 msgr2=0x7fddfc0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 shutdown_connections 2024-04-03T08:44:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.082+0000 7fde00e00700 1 -- 172.21.15.157:0/1209666063 wait complete. 2024-04-03T08:44:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:44:57.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.219+0000 7f37e1200700 1 -- 172.21.15.157:0/2532077118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fce80 msgr2=0x7f37dc0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.219+0000 7f37e1200700 1 --2- 172.21.15.157:0/2532077118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fce80 0x7f37dc0fd290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f37cc004940 tx=0x7f37cc009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.220+0000 7f37e1200700 1 -- 172.21.15.157:0/2532077118 shutdown_connections 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.220+0000 7f37e1200700 1 --2- 172.21.15.157:0/2532077118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37dc0fdff0 0x7f37dc0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.220+0000 7f37e1200700 1 --2- 172.21.15.157:0/2532077118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fce80 0x7f37dc0fd290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.220+0000 7f37e1200700 1 -- 172.21.15.157:0/2532077118 >> 172.21.15.157:0/2532077118 conn(0x7f37dc0f8560 msgr2=0x7f37dc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.220+0000 7f37e1200700 1 -- 172.21.15.157:0/2532077118 shutdown_connections 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.220+0000 7f37e1200700 1 -- 172.21.15.157:0/2532077118 wait complete. 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37e1200700 1 Processor -- start 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37e1200700 1 -- start start 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37e1200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37dc0fce80 0x7f37dc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37e1200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 0x7f37dc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:57.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37e1200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0708c0 con 0x7f37dc0fdff0 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37e1200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc070a30 con 0x7f37dc0fce80 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37d9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 0x7f37dc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.221+0000 7f37d9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 0x7f37dc070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55258/0 (socket says 172.21.15.157:55258) 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d9400700 1 -- 172.21.15.157:0/2271716710 learned_addr learned my addr 172.21.15.157:0/2271716710 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d9e00700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37dc0fce80 0x7f37dc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d9400700 1 -- 172.21.15.157:0/2271716710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37dc0fce80 msgr2=0x7f37dc071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d9400700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37dc0fce80 0x7f37dc071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d9400700 1 -- 172.21.15.157:0/2271716710 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc005040 con 0x7f37dc0fdff0 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d9400700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 0x7f37dc070310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37c8002a50 tx=0x7f37c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c8007cc0 con 0x7f37dc0fdff0 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37c800f040 con 0x7f37dc0fdff0 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.222+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c800da30 con 0x7f37dc0fdff0 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.223+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc070d10 con 0x7f37dc0fdff0 2024-04-03T08:44:57.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.223+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc115a50 con 0x7f37dc0fdff0 2024-04-03T08:44:57.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.224+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc05f5f0 con 0x7f37dc0fdff0 2024-04-03T08:44:57.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.225+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f37c800db90 con 0x7f37dc0fdff0 2024-04-03T08:44:57.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.227+0000 7f37d2000700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f37c006d7f0 0x7f37c006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:57.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.227+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f37c808cbf0 con 0x7f37dc0fdff0 2024-04-03T08:44:57.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.227+0000 7f37d9e00700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f37c006d7f0 0x7f37c006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:57.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.228+0000 7f37d9e00700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f37c006d7f0 0x7f37c006fca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00b3b0 tx=0x7f37cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:57.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.232+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f37c8056420 con 0x7f37dc0fdff0 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: pgmap v79: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:57.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-03T08:44:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-03T08:44:57.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:56 smithi157 ceph-mon[117693]: Upgrade: osd.2 is safe to restart 2024-04-03T08:44:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:57.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: pgmap v79: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:57.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:57.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-03T08:44:57.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-03T08:44:57.349 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:56 smithi181 ceph-mon[101094]: Upgrade: osd.2 is safe to restart 2024-04-03T08:44:57.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.469+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37dc102310 con 0x7f37c006d7f0 2024-04-03T08:44:57.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.471+0000 7f37d2000700 1 -- 172.21.15.157:0/2271716710 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f37dc102310 con 0x7f37c006d7f0 2024-04-03T08:44:57.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f37c006d7f0 msgr2=0x7f37c006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f37c006d7f0 0x7f37c006fca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00b3b0 tx=0x7f37cc009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 msgr2=0x7f37dc070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 0x7f37dc070310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37c8002a50 tx=0x7f37c80046b0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 shutdown_connections 2024-04-03T08:44:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f37c006d7f0 0x7f37c006fca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37dc0fce80 0x7f37dc071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 --2- 172.21.15.157:0/2271716710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37dc0fdff0 0x7f37dc070310 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 >> 172.21.15.157:0/2271716710 conn(0x7f37dc0f8560 msgr2=0x7f37dc0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:57.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 shutdown_connections 2024-04-03T08:44:57.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.473+0000 7f37e1200700 1 -- 172.21.15.157:0/2271716710 wait complete. 2024-04-03T08:44:57.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 -- 172.21.15.157:0/2268848450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 msgr2=0x7f54080fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 --2- 172.21.15.157:0/2268848450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f54080fe540 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53f4004940 tx=0x7f53f4009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:57.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 -- 172.21.15.157:0/2268848450 shutdown_connections 2024-04-03T08:44:57.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 --2- 172.21.15.157:0/2268848450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f54080fe540 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 --2- 172.21.15.157:0/2268848450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54080fcee0 0x7f54080fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 -- 172.21.15.157:0/2268848450 >> 172.21.15.157:0/2268848450 conn(0x7f54080f8560 msgr2=0x7f54080fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 -- 172.21.15.157:0/2268848450 shutdown_connections 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.613+0000 7f540d200700 1 -- 172.21.15.157:0/2268848450 wait complete. 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f540d200700 1 Processor -- start 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f540d200700 1 -- start start 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f540d200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54080fcee0 0x7f540810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f540d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f540810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:57.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f540d200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540810e600 con 0x7f54080fe0d0 2024-04-03T08:44:57.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f540d200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540810ede0 con 0x7f54080fcee0 2024-04-03T08:44:57.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f5405400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f540810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:57.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f5405400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f540810e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55280/0 (socket says 172.21.15.157:55280) 2024-04-03T08:44:57.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.614+0000 7f5405400700 1 -- 172.21.15.157:0/3880794514 learned_addr learned my addr 172.21.15.157:0/3880794514 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:57.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f5405e00700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54080fcee0 0x7f540810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:57.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f5405400700 1 -- 172.21.15.157:0/3880794514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54080fcee0 msgr2=0x7f540810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f5405400700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54080fcee0 0x7f540810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f5405400700 1 -- 172.21.15.157:0/3880794514 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4005040 con 0x7f54080fe0d0 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f5405400700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f540810e000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b3b0 tx=0x7f53f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f400e040 con 0x7f54080fe0d0 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540810f060 con 0x7f54080fe0d0 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53f4004290 con 0x7f54080fe0d0 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f401c630 con 0x7f54080fe0d0 2024-04-03T08:44:57.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.615+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540810f5a0 con 0x7f54080fe0d0 2024-04-03T08:44:57.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.617+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540805f5f0 con 0x7f54080fe0d0 2024-04-03T08:44:57.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.618+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f53f400bbf0 con 0x7f54080fe0d0 2024-04-03T08:44:57.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.619+0000 7f53fe000700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f53ec06d7f0 0x7f53ec06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:57.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.619+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f53f408e3f0 con 0x7f54080fe0d0 2024-04-03T08:44:57.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.619+0000 7f5405e00700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f53ec06d7f0 0x7f53ec06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:57.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.620+0000 7f5405e00700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f53ec06d7f0 0x7f53ec06fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009fd0 tx=0x7f53f8009f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:57.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.624+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f53f405b750 con 0x7f54080fe0d0 2024-04-03T08:44:57.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.861+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f540810f990 con 0x7f53ec06d7f0 2024-04-03T08:44:57.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.871+0000 7f53fe000700 1 -- 172.21.15.157:0/3880794514 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f540810f990 con 0x7f53ec06d7f0 2024-04-03T08:44:57.872 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:44:57.872 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (5m) 8s ago 15m 13.8M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:44:57.872 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (70s) 8s ago 15m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:44:57.872 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (64s) 60s ago 14m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:44:57.872 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (3m) 8s ago 14m 74.9M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (9m) 8s ago 9m 13.8M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (8m) 8s ago 8m 135M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (8m) 60s ago 8m 13.6M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (8m) 60s ago 8m 99.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (3m) 8s ago 16m 499M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (2m) 60s ago 14m 449M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (2m) 8s ago 16m 43.1M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (116s) 60s ago 13m 32.3M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 8s ago 15m 7524k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (3m) 60s ago 14m 7616k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (39s) 8s ago 13m 91.4M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (15s) 8s ago 12m 11.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (12m) 8s ago 12m 204M 1618M 17.2.7-805-g6fda41ff a49113eacc58 37d764f22839 2024-04-03T08:44:57.873 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (11m) 60s ago 11m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (11m) 60s ago 11m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (10m) 60s ago 10m 225M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (2m) 8s ago 14m 49.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f53ec06d7f0 msgr2=0x7f53ec06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f53ec06d7f0 0x7f53ec06fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009fd0 tx=0x7f53f8009f00 comp rx=0 tx=0).stop 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 msgr2=0x7f540810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f540810e000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b3b0 tx=0x7f53f4009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:57.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 shutdown_connections 2024-04-03T08:44:57.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f53ec06d7f0 0x7f53ec06fca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54080fcee0 0x7f540810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 --2- 172.21.15.157:0/3880794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54080fe0d0 0x7f540810e000 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:57.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 >> 172.21.15.157:0/3880794514 conn(0x7f54080f8560 msgr2=0x7f54080f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:57.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 shutdown_connections 2024-04-03T08:44:57.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:57.874+0000 7f540d200700 1 -- 172.21.15.157:0/3880794514 wait complete. 2024-04-03T08:44:58.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 -- 172.21.15.157:0/3810616128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 msgr2=0x7f8114070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 --2- 172.21.15.157:0/3810616128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f8114070e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8100004940 tx=0x7f8100009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:58.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 -- 172.21.15.157:0/3810616128 shutdown_connections 2024-04-03T08:44:58.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 --2- 172.21.15.157:0/3810616128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f8114070e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 --2- 172.21.15.157:0/3810616128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8114071f50 0x7f8114070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 -- 172.21.15.157:0/3810616128 >> 172.21.15.157:0/3810616128 conn(0x7f81140f8560 msgr2=0x7f81140fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:58.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 -- 172.21.15.157:0/3810616128 shutdown_connections 2024-04-03T08:44:58.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.015+0000 7f8119c00700 1 -- 172.21.15.157:0/3810616128 wait complete. 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.016+0000 7f8119c00700 1 Processor -- start 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.016+0000 7f8119c00700 1 -- start start 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.016+0000 7f8119c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f811410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.016+0000 7f8119c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8114071f50 0x7f8114110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.016+0000 7f8119c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8114110740 con 0x7f81140709a0 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.016+0000 7f8119c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8114110f90 con 0x7f8114071f50 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f811410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f811410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55306/0 (socket says 172.21.15.157:55306) 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 -- 172.21.15.157:0/4015349303 learned_addr learned my addr 172.21.15.157:0/4015349303 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112000700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8114071f50 0x7f8114110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 -- 172.21.15.157:0/4015349303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8114071f50 msgr2=0x7f8114110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8114071f50 0x7f8114110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 -- 172.21.15.157:0/4015349303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100005040 con 0x7f81140709a0 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8112a00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f811410fc00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8104002a80 tx=0x7f8104004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8104007cc0 con 0x7f81140709a0 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f810400f040 con 0x7f81140709a0 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.017+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8114111270 con 0x7f81140709a0 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.018+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810400dad0 con 0x7f81140709a0 2024-04-03T08:44:58.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.018+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141117b0 con 0x7f81140709a0 2024-04-03T08:44:58.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.019+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811405f5f0 con 0x7f81140709a0 2024-04-03T08:44:58.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.020+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f810400dc30 con 0x7f81140709a0 2024-04-03T08:44:58.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.021+0000 7f810aa00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f80f806d7f0 0x7f80f806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.021+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f810408cc80 con 0x7f81140709a0 2024-04-03T08:44:58.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.021+0000 7f8112000700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f80f806d7f0 0x7f80f806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.021+0000 7f8112000700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f80f806d7f0 0x7f80f806fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8100004f90 tx=0x7f8100009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:58.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.025+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f810405a000 con 0x7f81140709a0 2024-04-03T08:44:58.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:57 smithi157 ceph-mon[117693]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded) 2024-04-03T08:44:58.302 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:57 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:44:58.302 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:57 smithi157 ceph-mon[117693]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:58.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.326+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8114111b20 con 0x7f81140709a0 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.327+0000 7f810aa00700 1 -- 172.21.15.157:0/4015349303 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f8104059b90 con 0x7f81140709a0 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:44:58.328 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4, 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 8, 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:44:58.329 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f80f806d7f0 msgr2=0x7f80f806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f80f806d7f0 0x7f80f806fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8100004f90 tx=0x7f8100009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 msgr2=0x7f811410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f811410fc00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8104002a80 tx=0x7f8104004600 comp rx=0 tx=0).stop 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 shutdown_connections 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f80f806d7f0 0x7f80f806fca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81140709a0 0x7f811410fc00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 --2- 172.21.15.157:0/4015349303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8114071f50 0x7f8114110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 >> 172.21.15.157:0/4015349303 conn(0x7f81140f8560 msgr2=0x7f81140f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:58.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 shutdown_connections 2024-04-03T08:44:58.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.330+0000 7f8119c00700 1 -- 172.21.15.157:0/4015349303 wait complete. 2024-04-03T08:44:58.346 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:57 smithi181 ceph-mon[101094]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded) 2024-04-03T08:44:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:57 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:44:58.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:57 smithi181 ceph-mon[101094]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 -- 172.21.15.157:0/3190612922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fe0d0 msgr2=0x7fe0200fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 --2- 172.21.15.157:0/3190612922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fe0d0 0x7fe0200fe540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe00c004940 tx=0x7fe00c009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 -- 172.21.15.157:0/3190612922 shutdown_connections 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 --2- 172.21.15.157:0/3190612922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fe0d0 0x7fe0200fe540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 --2- 172.21.15.157:0/3190612922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fcee0 0x7fe0200fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 -- 172.21.15.157:0/3190612922 >> 172.21.15.157:0/3190612922 conn(0x7fe0200f8560 msgr2=0x7fe0200fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 -- 172.21.15.157:0/3190612922 shutdown_connections 2024-04-03T08:44:58.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.477+0000 7fe025000700 1 -- 172.21.15.157:0/3190612922 wait complete. 2024-04-03T08:44:58.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe025000700 1 Processor -- start 2024-04-03T08:44:58.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe025000700 1 -- start start 2024-04-03T08:44:58.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe025000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 0x7fe02010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe025000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fe0d0 0x7fe020110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe025000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020110850 con 0x7fe0200fcee0 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe025000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020110f90 con 0x7fe0200fe0d0 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.478+0000 7fe01de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 0x7fe02010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 0x7fe02010fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55324/0 (socket says 172.21.15.157:55324) 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01de00700 1 -- 172.21.15.157:0/3518027403 learned_addr learned my addr 172.21.15.157:0/3518027403 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01d400700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fe0d0 0x7fe020110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01de00700 1 -- 172.21.15.157:0/3518027403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fe0d0 msgr2=0x7fe020110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01de00700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fe0d0 0x7fe020110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01de00700 1 -- 172.21.15.157:0/3518027403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c005040 con 0x7fe0200fcee0 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01d400700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fe0d0 0x7fe020110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:44:58.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe01de00700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 0x7fe02010fd10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe010002a80 tx=0x7fe010004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:58.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe010007cc0 con 0x7fe0200fcee0 2024-04-03T08:44:58.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.479+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe020111270 con 0x7fe0200fcee0 2024-04-03T08:44:58.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.480+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe01000f040 con 0x7fe0200fcee0 2024-04-03T08:44:58.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.480+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01000dad0 con 0x7fe0200fcee0 2024-04-03T08:44:58.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.480+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020111830 con 0x7fe0200fcee0 2024-04-03T08:44:58.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.481+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe020101a60 con 0x7fe0200fcee0 2024-04-03T08:44:58.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.482+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe01000dc30 con 0x7fe0200fcee0 2024-04-03T08:44:58.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.483+0000 7fe016000700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe00406d7f0 0x7fe00406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.483+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe01008cc00 con 0x7fe0200fcee0 2024-04-03T08:44:58.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.483+0000 7fe01d400700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe00406d7f0 0x7fe00406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.484+0000 7fe01d400700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe00406d7f0 0x7fe00406fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b7a0 tx=0x7fe00c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:58.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.488+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe010059f60 con 0x7fe0200fcee0 2024-04-03T08:44:58.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.752+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe020111aa0 con 0x7fe0200fcee0 2024-04-03T08:44:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.752+0000 7fe016000700 1 -- 172.21.15.157:0/3518027403 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7fe010059af0 con 0x7fe0200fcee0 2024-04-03T08:44:58.753 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:44:58.753 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:44:58.753 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:44:58.753 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:44:58.753 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:44:58.754 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:44:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:44:58.756 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:58.757 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:44:58.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe00406d7f0 msgr2=0x7fe00406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe00406d7f0 0x7fe00406fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b7a0 tx=0x7fe00c009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 msgr2=0x7fe02010fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 0x7fe02010fd10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe010002a80 tx=0x7fe010004600 comp rx=0 tx=0).stop 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 shutdown_connections 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe00406d7f0 0x7fe00406fca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0200fcee0 0x7fe02010fd10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 --2- 172.21.15.157:0/3518027403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0200fe0d0 0x7fe020110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 >> 172.21.15.157:0/3518027403 conn(0x7fe0200f8560 msgr2=0x7fe0200f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 shutdown_connections 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.755+0000 7fe025000700 1 -- 172.21.15.157:0/3518027403 wait complete. 2024-04-03T08:44:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:44:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.902+0000 7f0c4b000700 1 -- 172.21.15.157:0/2098231423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c44066280 msgr2=0x7f0c440ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.902+0000 7f0c4b000700 1 --2- 172.21.15.157:0/2098231423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c44066280 0x7f0c440ff860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c38004940 tx=0x7f0c38009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.902+0000 7f0c4b000700 1 -- 172.21.15.157:0/2098231423 shutdown_connections 2024-04-03T08:44:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.902+0000 7f0c4b000700 1 --2- 172.21.15.157:0/2098231423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c440ffda0 0x7f0c44102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.902+0000 7f0c4b000700 1 --2- 172.21.15.157:0/2098231423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c44066280 0x7f0c440ff860 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.902+0000 7f0c4b000700 1 -- 172.21.15.157:0/2098231423 >> 172.21.15.157:0/2098231423 conn(0x7f0c440f7270 msgr2=0x7f0c440f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.903+0000 7f0c4b000700 1 -- 172.21.15.157:0/2098231423 shutdown_connections 2024-04-03T08:44:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.903+0000 7f0c4b000700 1 -- 172.21.15.157:0/2098231423 wait complete. 2024-04-03T08:44:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.903+0000 7f0c4b000700 1 Processor -- start 2024-04-03T08:44:58.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c4b000700 1 -- start start 2024-04-03T08:44:58.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c4b000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c44066280 0x7f0c440fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c4b000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 0x7f0c440fb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c4b000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440fbd10 con 0x7f0c440ffda0 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c4b000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440fbe80 con 0x7f0c44066280 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c49200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 0x7f0c440fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c49200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 0x7f0c440fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55340/0 (socket says 172.21.15.157:55340) 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c49200700 1 -- 172.21.15.157:0/319635957 learned_addr learned my addr 172.21.15.157:0/319635957 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.904+0000 7f0c49c00700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c44066280 0x7f0c440fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c49200700 1 -- 172.21.15.157:0/319635957 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c44066280 msgr2=0x7f0c440fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c49200700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c44066280 0x7f0c440fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c49200700 1 -- 172.21.15.157:0/319635957 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38005040 con 0x7f0c440ffda0 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c49200700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 0x7f0c440fb760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000eb40 tx=0x7f0c3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:58.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c30007cc0 con 0x7f0c440ffda0 2024-04-03T08:44:58.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c3000f040 con 0x7f0c440ffda0 2024-04-03T08:44:58.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c440fc100 con 0x7f0c440ffda0 2024-04-03T08:44:58.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c3000ca10 con 0x7f0c440ffda0 2024-04-03T08:44:58.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.905+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44115850 con 0x7f0c440ffda0 2024-04-03T08:44:58.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.906+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4405f5f0 con 0x7f0c440ffda0 2024-04-03T08:44:58.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.907+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0c3000cb70 con 0x7f0c440ffda0 2024-04-03T08:44:58.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.908+0000 7f0c41600700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0c2c06d7e0 0x7f0c2c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:58.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.909+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0c3008ca50 con 0x7f0c440ffda0 2024-04-03T08:44:58.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.909+0000 7f0c49c00700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0c2c06d7e0 0x7f0c2c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:58.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.909+0000 7f0c49c00700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0c2c06d7e0 0x7f0c2c06fc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c38013740 tx=0x7f0c38009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:58.913+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c30056330 con 0x7f0c440ffda0 2024-04-03T08:44:59.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.159+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c440f8db0 con 0x7f0c2c06d7e0 2024-04-03T08:44:59.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.161+0000 7f0c41600700 1 -- 172.21.15.157:0/319635957 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0c440f8db0 con 0x7f0c2c06d7e0 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "8/21 daemons upgraded", 2024-04-03T08:44:59.162 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading osd daemons", 2024-04-03T08:44:59.163 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:44:59.163 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:44:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0c2c06d7e0 msgr2=0x7f0c2c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0c2c06d7e0 0x7f0c2c06fc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c38013740 tx=0x7f0c38009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 msgr2=0x7f0c440fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 0x7f0c440fb760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000eb40 tx=0x7f0c3000b040 comp rx=0 tx=0).stop 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 shutdown_connections 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0c2c06d7e0 0x7f0c2c06fc90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c44066280 0x7f0c440fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 --2- 172.21.15.157:0/319635957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c440ffda0 0x7f0c440fb760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.163+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 >> 172.21.15.157:0/319635957 conn(0x7f0c440f7270 msgr2=0x7f0c440f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.164+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 shutdown_connections 2024-04-03T08:44:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.164+0000 7f0c4b000700 1 -- 172.21.15.157:0/319635957 wait complete. 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 -- 172.21.15.157:0/1033446262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fce80 msgr2=0x7efca40fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 --2- 172.21.15.157:0/1033446262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fce80 0x7efca40fd290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efc94004940 tx=0x7efc94009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 -- 172.21.15.157:0/1033446262 shutdown_connections 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 --2- 172.21.15.157:0/1033446262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40fdff0 0x7efca40fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 --2- 172.21.15.157:0/1033446262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fce80 0x7efca40fd290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 -- 172.21.15.157:0/1033446262 >> 172.21.15.157:0/1033446262 conn(0x7efca40f8560 msgr2=0x7efca40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 -- 172.21.15.157:0/1033446262 shutdown_connections 2024-04-03T08:44:59.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.304+0000 7efcaaa00700 1 -- 172.21.15.157:0/1033446262 wait complete. 2024-04-03T08:44:59.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.305+0000 7efcaaa00700 1 Processor -- start 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.305+0000 7efcaaa00700 1 -- start start 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efcaaa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40fce80 0x7efca4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efcaaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 0x7efca4070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efcaaa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40708c0 con 0x7efca40fdff0 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efcaaa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca4070a30 con 0x7efca40fce80 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 0x7efca4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 0x7efca4070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55350/0 (socket says 172.21.15.157:55350) 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3400700 1 -- 172.21.15.157:0/555236369 learned_addr learned my addr 172.21.15.157:0/555236369 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:44:59.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3e00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40fce80 0x7efca4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3400700 1 -- 172.21.15.157:0/555236369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40fce80 msgr2=0x7efca4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3400700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40fce80 0x7efca4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.306+0000 7efca3400700 1 -- 172.21.15.157:0/555236369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94005040 con 0x7efca40fdff0 2024-04-03T08:44:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.307+0000 7efca3400700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 0x7efca4070310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc90002a50 tx=0x7efc900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.307+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc90007cc0 con 0x7efca40fdff0 2024-04-03T08:44:59.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.307+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc9000f040 con 0x7efca40fdff0 2024-04-03T08:44:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.307+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca4070d10 con 0x7efca40fdff0 2024-04-03T08:44:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.307+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9000da30 con 0x7efca40fdff0 2024-04-03T08:44:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.307+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca4115a50 con 0x7efca40fdff0 2024-04-03T08:44:59.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.308+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca405f5f0 con 0x7efca40fdff0 2024-04-03T08:44:59.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.310+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efc9000db90 con 0x7efca40fdff0 2024-04-03T08:44:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.312+0000 7efc9be00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efc8806d7f0 0x7efc8806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:44:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.312+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efc9008cc60 con 0x7efca40fdff0 2024-04-03T08:44:59.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.312+0000 7efca3e00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efc8806d7f0 0x7efc8806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:44:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.313+0000 7efca3e00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efc8806d7f0 0x7efc8806fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc94009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: pgmap v80: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 773 B/s rd, 0 op/s 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/4015349303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: Upgrade: Updating osd.2 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:59.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-03T08:44:59.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:59.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: Deploying daemon osd.2 on smithi157 2024-04-03T08:44:59.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:44:58 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3518027403' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:44:59.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.316+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efc900564b0 con 0x7efca40fdff0 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: pgmap v80: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 773 B/s rd, 0 op/s 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/4015349303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: Upgrade: Updating osd.2 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: Deploying daemon osd.2 on smithi157 2024-04-03T08:44:59.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:44:58 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3518027403' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:44:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.622+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efca4115c70 con 0x7efca40fdff0 2024-04-03T08:44:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.622+0000 7efc9be00700 1 -- 172.21.15.157:0/555236369 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efc90059b70 con 0x7efca40fdff0 2024-04-03T08:44:59.623 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efc8806d7f0 msgr2=0x7efc8806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efc8806d7f0 0x7efc8806fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc94009e30 comp rx=0 tx=0).stop 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 msgr2=0x7efca4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 0x7efca4070310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc90002a50 tx=0x7efc900046b0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 shutdown_connections 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efc8806d7f0 0x7efc8806fca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40fce80 0x7efca4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 --2- 172.21.15.157:0/555236369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efca40fdff0 0x7efca4070310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 >> 172.21.15.157:0/555236369 conn(0x7efca40f8560 msgr2=0x7efca40f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 shutdown_connections 2024-04-03T08:44:59.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:44:59.625+0000 7efcaaa00700 1 -- 172.21.15.157:0/555236369 wait complete. 2024-04-03T08:45:00.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:00 smithi157 ceph-mon[117693]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:00.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:00.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:00.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:00 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/555236369' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:45:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:00 smithi181 ceph-mon[101094]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:00 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/555236369' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:45:01.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:01 smithi157 ceph-mon[117693]: pgmap v81: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-03T08:45:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:01 smithi181 ceph-mon[101094]: pgmap v81: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-03T08:45:02.626 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:02 smithi157 systemd[1]: Stopping Ceph osd.2 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:45:03.064 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:02 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[78138]: 2024-04-03T08:45:02.624+0000 7f3011000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:45:03.064 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:02 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[78138]: 2024-04-03T08:45:02.624+0000 7f3011000700 -1 osd.2 60 *** Got signal Terminated *** 2024-04-03T08:45:03.064 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:02 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[78138]: 2024-04-03T08:45:02.624+0000 7f3011000700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T08:45:03.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:03 smithi157 ceph-mon[117693]: pgmap v82: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-03T08:45:03.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:03 smithi157 ceph-mon[117693]: osd.2 marked itself down and dead 2024-04-03T08:45:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:03 smithi181 ceph-mon[101094]: pgmap v82: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-03T08:45:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:03 smithi181 ceph-mon[101094]: osd.2 marked itself down and dead 2024-04-03T08:45:04.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:04 smithi157 bash[141592]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2 2024-04-03T08:45:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:04 smithi157 ceph-mon[117693]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:45:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:04 smithi157 ceph-mon[117693]: osdmap e61: 6 total, 5 up, 6 in 2024-04-03T08:45:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:04.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:04 smithi157 ceph-mon[117693]: osdmap e62: 6 total, 5 up, 6 in 2024-04-03T08:45:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:04 smithi181 ceph-mon[101094]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:45:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:04 smithi181 ceph-mon[101094]: osdmap e61: 6 total, 5 up, 6 in 2024-04-03T08:45:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:04.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:04 smithi181 ceph-mon[101094]: osdmap e62: 6 total, 5 up, 6 in 2024-04-03T08:45:05.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:05 smithi157 ceph-mon[117693]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-03T08:45:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:05 smithi181 ceph-mon[101094]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-03T08:45:06.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:06 smithi157 ceph-mon[117693]: Health check failed: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2024-04-03T08:45:06.565 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:06 smithi157 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.2.service: Succeeded. 2024-04-03T08:45:06.565 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:06 smithi157 systemd[1]: Stopped Ceph osd.2 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:45:06.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:06 smithi181 ceph-mon[101094]: Health check failed: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2024-04-03T08:45:07.056 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:06 smithi157 systemd[1]: Starting Ceph osd.2 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:45:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:07 smithi157 ceph-mon[117693]: pgmap v86: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:07.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:07 smithi181 ceph-mon[101094]: pgmap v86: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-03T08:45:08.250 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:07 smithi157 bash[141898]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-03T08:45:09.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:09 smithi157 ceph-mon[117693]: pgmap v87: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:09.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:09 smithi157 ceph-osd[142216]: -- 172.21.15.157:0/3144465037 <== mon.0 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cadadd7680 con 0x55cadada0c00 2024-04-03T08:45:09.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:09 smithi157 bash[142178]: 3f3f3031b9f902ea1e51da8bf429e672173aa7223711cccd9fdbb047ca8429e5 2024-04-03T08:45:09.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:09 smithi157 systemd[1]: Started Ceph osd.2 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:45:09.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:09 smithi181 ceph-mon[101094]: pgmap v87: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:10.064 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:09 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[142193]: 2024-04-03T08:45:09.732+0000 7f992db127c0 -1 Falling back to public interface 2024-04-03T08:45:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:11 smithi157 ceph-mon[117693]: pgmap v88: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:11 smithi181 ceph-mon[101094]: pgmap v88: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:13.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:13 smithi157 ceph-mon[117693]: pgmap v89: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:13 smithi181 ceph-mon[101094]: pgmap v89: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:15.188 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:14 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[142193]: 2024-04-03T08:45:14.893+0000 7f992db127c0 -1 osd.2 60 log_to_monitors true 2024-04-03T08:45:15.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 08:45:15 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[142193]: 2024-04-03T08:45:15.362+0000 7f991ce00700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:45:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:15 smithi157 ceph-mon[117693]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:15 smithi157 ceph-mon[117693]: from='osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-03T08:45:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:15 smithi181 ceph-mon[101094]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:15 smithi181 ceph-mon[101094]: from='osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-03T08:45:16.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:16 smithi157 ceph-mon[117693]: from='osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-03T08:45:16.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:16 smithi157 ceph-mon[117693]: osdmap e63: 6 total, 5 up, 6 in 2024-04-03T08:45:16.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:16 smithi157 ceph-mon[117693]: from='osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:45:16.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:16.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:16 smithi181 ceph-mon[101094]: from='osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-03T08:45:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:16 smithi181 ceph-mon[101094]: osdmap e63: 6 total, 5 up, 6 in 2024-04-03T08:45:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:16 smithi181 ceph-mon[101094]: from='osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-04-03T08:45:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:17.700 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927] boot 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: osdmap e64: 6 total, 6 up, 6 in 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:17.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:17 smithi157 ceph-mon[117693]: osdmap e65: 6 total, 6 up, 6 in 2024-04-03T08:45:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:45:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: osd.2 [v2:172.21.15.157:6818/2462274927,v1:172.21.15.157:6819/2462274927] boot 2024-04-03T08:45:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: osdmap e64: 6 total, 6 up, 6 in 2024-04-03T08:45:17.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-03T08:45:17.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:17.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:17.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:17 smithi181 ceph-mon[101094]: osdmap e65: 6 total, 6 up, 6 in 2024-04-03T08:45:19.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:19 smithi157 ceph-mon[117693]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:19.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:19 smithi181 ceph-mon[101094]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-04-03T08:45:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:20 smithi157 ceph-mon[117693]: pgmap v96: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 17/222 objects degraded (7.658%) 2024-04-03T08:45:20.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:20 smithi157 ceph-mon[117693]: Health check update: Degraded data redundancy: 17/222 objects degraded (7.658%), 6 pgs degraded (PG_DEGRADED) 2024-04-03T08:45:20.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:20 smithi181 ceph-mon[101094]: pgmap v96: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 17/222 objects degraded (7.658%) 2024-04-03T08:45:20.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:20 smithi181 ceph-mon[101094]: Health check update: Degraded data redundancy: 17/222 objects degraded (7.658%), 6 pgs degraded (PG_DEGRADED) 2024-04-03T08:45:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:22.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:22.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:23.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:23 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:23.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:23 smithi157 ceph-mon[117693]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-04-03T08:45:23.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:23 smithi157 ceph-mon[117693]: pgmap v97: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 749 B/s rd, 1 op/s 2024-04-03T08:45:23.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:23 smithi157 ceph-mon[117693]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/222 objects degraded (7.658%), 6 pgs degraded) 2024-04-03T08:45:23.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:23 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:45:23.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:23 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:23.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:23 smithi181 ceph-mon[101094]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-04-03T08:45:23.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:23 smithi181 ceph-mon[101094]: pgmap v97: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 749 B/s rd, 1 op/s 2024-04-03T08:45:23.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:23 smithi181 ceph-mon[101094]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/222 objects degraded (7.658%), 6 pgs degraded) 2024-04-03T08:45:23.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:23 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:45:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:25 smithi157 ceph-mon[117693]: pgmap v98: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-03T08:45:25.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:25 smithi181 ceph-mon[101094]: pgmap v98: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-03T08:45:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:27 smithi157 ceph-mon[117693]: pgmap v99: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-03T08:45:27.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:27 smithi181 ceph-mon[101094]: pgmap v99: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 -- 172.21.15.157:0/2205010055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2164071e60 msgr2=0x7f2164070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 --2- 172.21.15.157:0/2205010055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2164071e60 0x7f2164070370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2158004940 tx=0x7f2158009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 -- 172.21.15.157:0/2205010055 shutdown_connections 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 --2- 172.21.15.157:0/2205010055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21640708b0 0x7f2164070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 --2- 172.21.15.157:0/2205010055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2164071e60 0x7f2164070370 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 -- 172.21.15.157:0/2205010055 >> 172.21.15.157:0/2205010055 conn(0x7f21640f8550 msgr2=0x7f21640fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:29.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 -- 172.21.15.157:0/2205010055 shutdown_connections 2024-04-03T08:45:29.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.776+0000 7f216b400700 1 -- 172.21.15.157:0/2205010055 wait complete. 2024-04-03T08:45:29.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.777+0000 7f216b400700 1 Processor -- start 2024-04-03T08:45:29.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.777+0000 7f216b400700 1 -- start start 2024-04-03T08:45:29.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f216b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 0x7f216410fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:29.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f216b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2164071e60 0x7f2164110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:29.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f216b400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164110690 con 0x7f21640708b0 2024-04-03T08:45:29.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f216b400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164110800 con 0x7f2164071e60 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2168a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 0x7f216410fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2168a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 0x7f216410fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53418/0 (socket says 172.21.15.157:53418) 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2168a00700 1 -- 172.21.15.157:0/3784565586 learned_addr learned my addr 172.21.15.157:0/3784565586 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2163e00700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2164071e60 0x7f2164110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2168a00700 1 -- 172.21.15.157:0/3784565586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2164071e60 msgr2=0x7f2164110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2168a00700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2164071e60 0x7f2164110090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.778+0000 7f2168a00700 1 -- 172.21.15.157:0/3784565586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158005040 con 0x7f21640708b0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.779+0000 7f2168a00700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 0x7f216410fb50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2158000c00 tx=0x7f2158009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.779+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f215800e040 con 0x7f21640708b0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.779+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f215800bbf0 con 0x7f21640708b0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.779+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f215801c630 con 0x7f21640708b0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.779+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2164115200 con 0x7f21640708b0 2024-04-03T08:45:29.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.779+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21641157c0 con 0x7f21640708b0 2024-04-03T08:45:29.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.780+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216404c710 con 0x7f21640708b0 2024-04-03T08:45:29.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.781+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f215800bd60 con 0x7f21640708b0 2024-04-03T08:45:29.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.782+0000 7f2160c00700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f214c06d7e0 0x7f214c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:29.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.782+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f215808e260 con 0x7f21640708b0 2024-04-03T08:45:29.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.783+0000 7f2163e00700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f214c06d7e0 0x7f214c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:29.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.783+0000 7f2163e00700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f214c06d7e0 0x7f214c06fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2150004f40 tx=0x7f215000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:29.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:29.787+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f215805b5c0 con 0x7f21640708b0 2024-04-03T08:45:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:29 smithi157 ceph-mon[117693]: pgmap v100: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 945 B/s rd, 1 op/s 2024-04-03T08:45:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:29 smithi181 ceph-mon[101094]: pgmap v100: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 945 B/s rd, 1 op/s 2024-04-03T08:45:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:30.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.008+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2164103e70 con 0x7f214c06d7e0 2024-04-03T08:45:30.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.010+0000 7f2160c00700 1 -- 172.21.15.157:0/3784565586 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2164103e70 con 0x7f214c06d7e0 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f214c06d7e0 msgr2=0x7f214c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f214c06d7e0 0x7f214c06fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2150004f40 tx=0x7f215000b040 comp rx=0 tx=0).stop 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 msgr2=0x7f216410fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 0x7f216410fb50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2158000c00 tx=0x7f2158009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 shutdown_connections 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f214c06d7e0 0x7f214c06fc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21640708b0 0x7f216410fb50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 --2- 172.21.15.157:0/3784565586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2164071e60 0x7f2164110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 >> 172.21.15.157:0/3784565586 conn(0x7f21640f8550 msgr2=0x7f21640f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:30.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 shutdown_connections 2024-04-03T08:45:30.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.012+0000 7f216b400700 1 -- 172.21.15.157:0/3784565586 wait complete. 2024-04-03T08:45:30.027 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 -- 172.21.15.157:0/3139868493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 msgr2=0x7fc2b80fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 --2- 172.21.15.157:0/3139868493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b80fe540 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4004940 tx=0x7fc2a4009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 -- 172.21.15.157:0/3139868493 shutdown_connections 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 --2- 172.21.15.157:0/3139868493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b80fe540 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 --2- 172.21.15.157:0/3139868493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b80fcee0 0x7fc2b80fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 -- 172.21.15.157:0/3139868493 >> 172.21.15.157:0/3139868493 conn(0x7fc2b80f8560 msgr2=0x7fc2b80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:30.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 -- 172.21.15.157:0/3139868493 shutdown_connections 2024-04-03T08:45:30.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.149+0000 7fc2c0000700 1 -- 172.21.15.157:0/3139868493 wait complete. 2024-04-03T08:45:30.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2c0000700 1 Processor -- start 2024-04-03T08:45:30.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2c0000700 1 -- start start 2024-04-03T08:45:30.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2c0000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b80fcee0 0x7fc2b810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2c0000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2c0000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b810e600 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2c0000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b810ede0 con 0x7fc2b80fcee0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.150+0000 7fc2bcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bcc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b810e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53428/0 (socket says 172.21.15.157:53428) 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bcc00700 1 -- 172.21.15.157:0/2177679798 learned_addr learned my addr 172.21.15.157:0/2177679798 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bd600700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b80fcee0 0x7fc2b810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bcc00700 1 -- 172.21.15.157:0/2177679798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b80fcee0 msgr2=0x7fc2b810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bcc00700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b80fcee0 0x7fc2b810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bcc00700 1 -- 172.21.15.157:0/2177679798 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4005040 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2bcc00700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b810e000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b3b0 tx=0x7fc2a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a400e040 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2a4004290 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b810f060 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.151+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a401c3f0 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.152+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b810f5a0 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.153+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b805f5f0 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.154+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc2a400bbf0 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.154+0000 7fc2b5600700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc2a006d7f0 0x7fc2a006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.155+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc2a408e270 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.155+0000 7fc2bd600700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc2a006d7f0 0x7fc2a006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.155+0000 7fc2bd600700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc2a006d7f0 0x7fc2a006fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80fcc20 tx=0x7fc2ac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.159+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc2a405b5d0 con 0x7fc2b80fe0d0 2024-04-03T08:45:30.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.386+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b810f980 con 0x7fc2a006d7f0 2024-04-03T08:45:30.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.387+0000 7fc2b5600700 1 -- 172.21.15.157:0/2177679798 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc2b810f980 con 0x7fc2a006d7f0 2024-04-03T08:45:30.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc2a006d7f0 msgr2=0x7fc2a006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc2a006d7f0 0x7fc2a006fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80fcc20 tx=0x7fc2ac00b040 comp rx=0 tx=0).stop 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 msgr2=0x7fc2b810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b810e000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b3b0 tx=0x7fc2a4009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 shutdown_connections 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc2a006d7f0 0x7fc2a006fca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b80fcee0 0x7fc2b810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 --2- 172.21.15.157:0/2177679798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2b80fe0d0 0x7fc2b810e000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 >> 172.21.15.157:0/2177679798 conn(0x7fc2b80f8560 msgr2=0x7fc2b80f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 shutdown_connections 2024-04-03T08:45:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.390+0000 7fc2c0000700 1 -- 172.21.15.157:0/2177679798 wait complete. 2024-04-03T08:45:30.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.525+0000 7fdbbdc00700 1 -- 172.21.15.157:0/1942133060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fcf80 msgr2=0x7fdbb80fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.525+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/1942133060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fcf80 0x7fdbb80fd3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdba4004940 tx=0x7fdba4009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:30.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.525+0000 7fdbbdc00700 1 -- 172.21.15.157:0/1942133060 shutdown_connections 2024-04-03T08:45:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.525+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/1942133060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fcf80 0x7fdbb80fd3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.525+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/1942133060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb80fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.525+0000 7fdbbdc00700 1 -- 172.21.15.157:0/1942133060 >> 172.21.15.157:0/1942133060 conn(0x7fdbb80f7430 msgr2=0x7fdbb80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.526+0000 7fdbbdc00700 1 -- 172.21.15.157:0/1942133060 shutdown_connections 2024-04-03T08:45:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.526+0000 7fdbbdc00700 1 -- 172.21.15.157:0/1942133060 wait complete. 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.526+0000 7fdbbdc00700 1 Processor -- start 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.526+0000 7fdbbdc00700 1 -- start start 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbbdc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbbdc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdbb80fcf80 0x7fdbb81100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbbdc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81106e0 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbbdc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8110f30 con 0x7fdbb80fcf80 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb810fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53446/0 (socket says 172.21.15.157:53446) 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6a00700 1 -- 172.21.15.157:0/28548367 learned_addr learned my addr 172.21.15.157:0/28548367 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6000700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdbb80fcf80 0x7fdbb81100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6a00700 1 -- 172.21.15.157:0/28548367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdbb80fcf80 msgr2=0x7fdbb81100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6a00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdbb80fcf80 0x7fdbb81100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.527+0000 7fdbb6a00700 1 -- 172.21.15.157:0/28548367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4005040 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.528+0000 7fdbb6a00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb810fba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdba800eb40 tx=0x7fdba800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.528+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba8007cc0 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.528+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdba800f040 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.528+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba8009620 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.528+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb81111b0 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.528+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81116f0 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.529+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8102a00 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.530+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fdba8009780 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.531+0000 7fdbaea00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdb9c06d7f0 0x7fdb9c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.531+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdba808cc00 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.531+0000 7fdbb6000700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdb9c06d7f0 0x7fdb9c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.532+0000 7fdbb6000700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdb9c06d7f0 0x7fdb9c06fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdba400b0d0 tx=0x7fdba4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:30.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.536+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdba8059f90 con 0x7fdbb80fbcd0 2024-04-03T08:45:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.751+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbb8111910 con 0x7fdb9c06d7f0 2024-04-03T08:45:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.762+0000 7fdbaea00700 1 -- 172.21.15.157:0/28548367 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdbb8111910 con 0x7fdb9c06d7f0 2024-04-03T08:45:30.762 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (5m) 15s ago 15m 13.8M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (103s) 15s ago 15m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (97s) 93s ago 14m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (4m) 15s ago 15m 75.2M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (9m) 15s ago 9m 14.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (9m) 15s ago 9m 135M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (9m) 93s ago 9m 13.6M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (9m) 93s ago 9m 99.5M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (3m) 15s ago 17m 500M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (3m) 93s ago 14m 449M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (2m) 15s ago 17m 44.4M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (2m) 93s ago 14m 32.3M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 15s ago 15m 7516k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:45:30.763 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (4m) 93s ago 14m 7616k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (72s) 15s ago 13m 92.5M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (47s) 15s ago 13m 97.7M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (21s) 15s ago 12m 11.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (12m) 93s ago 12m 287M 2642M 17.2.7-805-g6fda41ff a49113eacc58 f4de2616ae9f 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (11m) 93s ago 11m 251M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (11m) 93s ago 11m 225M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:45:30.764 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (3m) 15s ago 15m 48.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdb9c06d7f0 msgr2=0x7fdb9c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdb9c06d7f0 0x7fdb9c06fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdba400b0d0 tx=0x7fdba4009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 msgr2=0x7fdbb810fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb810fba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdba800eb40 tx=0x7fdba800b040 comp rx=0 tx=0).stop 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 shutdown_connections 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fdb9c06d7f0 0x7fdb9c06fca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbb80fbcd0 0x7fdbb810fba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 --2- 172.21.15.157:0/28548367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdbb80fcf80 0x7fdbb81100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.764+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 >> 172.21.15.157:0/28548367 conn(0x7fdbb80f7430 msgr2=0x7fdbb80f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.765+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 shutdown_connections 2024-04-03T08:45:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.765+0000 7fdbbdc00700 1 -- 172.21.15.157:0/28548367 wait complete. 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 -- 172.21.15.157:0/1380631160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fdec0 msgr2=0x7f45e40fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 --2- 172.21.15.157:0/1380631160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fdec0 0x7f45e40fe330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45d0004940 tx=0x7f45d0009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 -- 172.21.15.157:0/1380631160 shutdown_connections 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 --2- 172.21.15.157:0/1380631160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fdec0 0x7f45e40fe330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 --2- 172.21.15.157:0/1380631160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e40fcc10 0x7f45e40fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 -- 172.21.15.157:0/1380631160 >> 172.21.15.157:0/1380631160 conn(0x7f45e40f83d0 msgr2=0x7f45e40fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 -- 172.21.15.157:0/1380631160 shutdown_connections 2024-04-03T08:45:30.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.897+0000 7f45eb000700 1 -- 172.21.15.157:0/1380631160 wait complete. 2024-04-03T08:45:30.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.898+0000 7f45eb000700 1 Processor -- start 2024-04-03T08:45:30.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.898+0000 7f45eb000700 1 -- start start 2024-04-03T08:45:30.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.898+0000 7f45eb000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 0x7f45e410fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.898+0000 7f45eb000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e40fdec0 0x7f45e410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.898+0000 7f45eb000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4110660 con 0x7f45e40fcc10 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.898+0000 7f45eb000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4110e50 con 0x7f45e40fdec0 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 0x7f45e410fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 0x7f45e410fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53466/0 (socket says 172.21.15.157:53466) 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 -- 172.21.15.157:0/1420417159 learned_addr learned my addr 172.21.15.157:0/1420417159 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9200700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e40fdec0 0x7f45e410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 -- 172.21.15.157:0/1420417159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e40fdec0 msgr2=0x7f45e410ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e40fdec0 0x7f45e410ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 -- 172.21.15.157:0/1420417159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0005040 con 0x7f45e40fcc10 2024-04-03T08:45:30.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e9c00700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 0x7f45e410fa90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45d800b790 tx=0x7f45d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.899+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d800f6f0 con 0x7f45e40fcc10 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.900+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45d800fd20 con 0x7f45e40fcc10 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.900+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e4111130 con 0x7f45e40fcc10 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.900+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d80103a0 con 0x7f45e40fcc10 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.900+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e41116f0 con 0x7f45e40fcc10 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.901+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e4101850 con 0x7f45e40fcc10 2024-04-03T08:45:30.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.902+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f45d8011400 con 0x7f45e40fcc10 2024-04-03T08:45:30.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.903+0000 7f45e1600700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f45cc06d7e0 0x7f45cc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:30.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.903+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f45d808cc70 con 0x7f45e40fcc10 2024-04-03T08:45:30.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.903+0000 7f45e9200700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f45cc06d7e0 0x7f45cc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:30.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.904+0000 7f45e9200700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f45cc06d7e0 0x7f45cc06fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45d000b3b0 tx=0x7f45d0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:30.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:30.907+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f45d8093080 con 0x7f45e40fcc10 2024-04-03T08:45:31.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.194+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45e4105880 con 0x7f45e40fcc10 2024-04-03T08:45:31.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.194+0000 7f45e1600700 1 -- 172.21.15.157:0/1420417159 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f45d805a050 con 0x7f45e40fcc10 2024-04-03T08:45:31.195 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:45:31.195 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 3, 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:45:31.196 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:45:31.197 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 7, 2024-04-03T08:45:31.197 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 7 2024-04-03T08:45:31.197 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:45:31.197 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f45cc06d7e0 msgr2=0x7f45cc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f45cc06d7e0 0x7f45cc06fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45d000b3b0 tx=0x7f45d0009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 msgr2=0x7f45e410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 0x7f45e410fa90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45d800b790 tx=0x7f45d8009250 comp rx=0 tx=0).stop 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 shutdown_connections 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f45cc06d7e0 0x7f45cc06fc90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e40fcc10 0x7f45e410fa90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 --2- 172.21.15.157:0/1420417159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e40fdec0 0x7f45e410ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 >> 172.21.15.157:0/1420417159 conn(0x7f45e40f83d0 msgr2=0x7f45e40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:31.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 shutdown_connections 2024-04-03T08:45:31.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.197+0000 7f45eb000700 1 -- 172.21.15.157:0/1420417159 wait complete. 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 -- 172.21.15.157:0/3632965199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fcc10 msgr2=0x7f99080fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 --2- 172.21.15.157:0/3632965199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fcc10 0x7f99080fd020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f98fc004940 tx=0x7f98fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 -- 172.21.15.157:0/3632965199 shutdown_connections 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 --2- 172.21.15.157:0/3632965199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080fdec0 0x7f99080fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 --2- 172.21.15.157:0/3632965199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fcc10 0x7f99080fd020 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 -- 172.21.15.157:0/3632965199 >> 172.21.15.157:0/3632965199 conn(0x7f99080f83d0 msgr2=0x7f99080fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 -- 172.21.15.157:0/3632965199 shutdown_connections 2024-04-03T08:45:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.333+0000 7f990f000700 1 -- 172.21.15.157:0/3632965199 wait complete. 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.334+0000 7f990f000700 1 Processor -- start 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.334+0000 7f990f000700 1 -- start start 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.334+0000 7f990f000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080fcc10 0x7f990810fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.334+0000 7f990f000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 0x7f990810ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.334+0000 7f990f000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9908110590 con 0x7f99080fdec0 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.334+0000 7f990f000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9908110de0 con 0x7f99080fcc10 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 0x7f990810ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 0x7f990810ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53498/0 (socket says 172.21.15.157:53498) 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 -- 172.21.15.157:0/1772408429 learned_addr learned my addr 172.21.15.157:0/1772408429 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990dc00700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080fcc10 0x7f990810fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 -- 172.21.15.157:0/1772408429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080fcc10 msgr2=0x7f990810fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080fcc10 0x7f990810fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 -- 172.21.15.157:0/1772408429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc005040 con 0x7f99080fdec0 2024-04-03T08:45:31.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f990d200700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 0x7f990810ff90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98f4002a50 tx=0x7f98f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:31.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.335+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f4007cc0 con 0x7f99080fdec0 2024-04-03T08:45:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.336+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98f400f040 con 0x7f99080fdec0 2024-04-03T08:45:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.336+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99081110c0 con 0x7f99080fdec0 2024-04-03T08:45:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.336+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f400da30 con 0x7f99080fdec0 2024-04-03T08:45:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.336+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9908111600 con 0x7f99080fdec0 2024-04-03T08:45:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.337+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9908101850 con 0x7f99080fdec0 2024-04-03T08:45:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.338+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f98f400db90 con 0x7f99080fdec0 2024-04-03T08:45:31.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.339+0000 7f9905600700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f98f006d7f0 0x7f98f006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:31.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.339+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f98f408cb50 con 0x7f99080fdec0 2024-04-03T08:45:31.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.339+0000 7f990dc00700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f98f006d7f0 0x7f98f006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:31.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.340+0000 7f990dc00700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f98f006d7f0 0x7f98f006fca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b3b0 tx=0x7f98fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:31.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.343+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f98f4059f50 con 0x7f99080fdec0 2024-04-03T08:45:31.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.589+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f990805f5f0 con 0x7f99080fdec0 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.590+0000 7f9905600700 1 -- 172.21.15.157:0/1772408429 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f98f4059ae0 con 0x7f99080fdec0 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:45:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:45:31.593 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:45:31.594 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:45:31.594 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:45:31.594 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:45:31.594 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:45:31.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f98f006d7f0 msgr2=0x7f98f006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f98f006d7f0 0x7f98f006fca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b3b0 tx=0x7f98fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 msgr2=0x7f990810ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 0x7f990810ff90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98f4002a50 tx=0x7f98f40046b0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 shutdown_connections 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f98f006d7f0 0x7f98f006fca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080fcc10 0x7f990810fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 --2- 172.21.15.157:0/1772408429 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99080fdec0 0x7f990810ff90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 >> 172.21.15.157:0/1772408429 conn(0x7f99080f83d0 msgr2=0x7f99080f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 shutdown_connections 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.593+0000 7f990f000700 1 -- 172.21.15.157:0/1772408429 wait complete. 2024-04-03T08:45:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:45:31.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 -- 172.21.15.157:0/353255539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 msgr2=0x7f17cc0fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 --2- 172.21.15.157:0/353255539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc0fd020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17bc004940 tx=0x7f17bc009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 -- 172.21.15.157:0/353255539 shutdown_connections 2024-04-03T08:45:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 --2- 172.21.15.157:0/353255539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17cc0fdec0 0x7f17cc0fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 --2- 172.21.15.157:0/353255539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc0fd020 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 -- 172.21.15.157:0/353255539 >> 172.21.15.157:0/353255539 conn(0x7f17cc0f83d0 msgr2=0x7f17cc0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 -- 172.21.15.157:0/353255539 shutdown_connections 2024-04-03T08:45:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.728+0000 7f17d1a00700 1 -- 172.21.15.157:0/353255539 wait complete. 2024-04-03T08:45:31.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.729+0000 7f17d1a00700 1 Processor -- start 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.729+0000 7f17d1a00700 1 -- start start 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17d1a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc10fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17d1a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17cc0fdec0 0x7f17cc10ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17d1a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc110590 con 0x7f17cc0fcc10 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17d1a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc110de0 con 0x7f17cc0fdec0 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc10fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc10fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53518/0 (socket says 172.21.15.157:53518) 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 -- 172.21.15.157:0/173537222 learned_addr learned my addr 172.21.15.157:0/173537222 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cb400700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17cc0fdec0 0x7f17cc10ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 -- 172.21.15.157:0/173537222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17cc0fdec0 msgr2=0x7f17cc10ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17cc0fdec0 0x7f17cc10ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 -- 172.21.15.157:0/173537222 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc005040 con 0x7f17cc0fcc10 2024-04-03T08:45:31.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.730+0000 7f17cbe00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc10fa50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00b3b0 tx=0x7f17bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.731+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17bc00e040 con 0x7f17cc0fcc10 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.731+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17bc004290 con 0x7f17cc0fcc10 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.731+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc111060 con 0x7f17cc0fcc10 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.731+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17bc01c630 con 0x7f17cc0fcc10 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.731+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc1115a0 con 0x7f17cc0fcc10 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.732+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc101850 con 0x7f17cc0fcc10 2024-04-03T08:45:31.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.733+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f17bc00bbf0 con 0x7f17cc0fcc10 2024-04-03T08:45:31.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.734+0000 7f17c3e00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f17b006d7f0 0x7f17b006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:31.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.734+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f17bc08e2d0 con 0x7f17cc0fcc10 2024-04-03T08:45:31.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.734+0000 7f17cb400700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f17b006d7f0 0x7f17b006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:31.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.734+0000 7f17cb400700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f17b006d7f0 0x7f17b006fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17b8004990 tx=0x7f17b8009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:31.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.738+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f17bc05b6b0 con 0x7f17cc0fcc10 2024-04-03T08:45:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:31 smithi157 ceph-mon[117693]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:31 smithi157 ceph-mon[117693]: pgmap v101: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:45:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:31 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1420417159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:31 smithi181 ceph-mon[101094]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:31 smithi181 ceph-mon[101094]: pgmap v101: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:45:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:31 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1420417159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.961+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17cc111810 con 0x7f17b006d7f0 2024-04-03T08:45:31.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.963+0000 7f17c3e00700 1 -- 172.21.15.157:0/173537222 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f17cc111810 con 0x7f17b006d7f0 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "9/21 daemons upgraded", 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading osd daemons", 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:45:31.964 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:45:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f17b006d7f0 msgr2=0x7f17b006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f17b006d7f0 0x7f17b006fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17b8004990 tx=0x7f17b8009ee0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 msgr2=0x7f17cc10fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc10fa50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00b3b0 tx=0x7f17bc009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 shutdown_connections 2024-04-03T08:45:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f17b006d7f0 0x7f17b006fca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17cc0fcc10 0x7f17cc10fa50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 --2- 172.21.15.157:0/173537222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17cc0fdec0 0x7f17cc10ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 >> 172.21.15.157:0/173537222 conn(0x7f17cc0f83d0 msgr2=0x7f17cc0f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.965+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 shutdown_connections 2024-04-03T08:45:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:31.966+0000 7f17d1a00700 1 -- 172.21.15.157:0/173537222 wait complete. 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 -- 172.21.15.157:0/2901333431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fcee0 msgr2=0x7f60d80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 --2- 172.21.15.157:0/2901333431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fcee0 0x7f60d80fd310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f60c8004940 tx=0x7f60c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 -- 172.21.15.157:0/2901333431 shutdown_connections 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 --2- 172.21.15.157:0/2901333431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60d80fe0d0 0x7f60d80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 --2- 172.21.15.157:0/2901333431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fcee0 0x7f60d80fd310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 -- 172.21.15.157:0/2901333431 >> 172.21.15.157:0/2901333431 conn(0x7f60d80f8560 msgr2=0x7f60d80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 -- 172.21.15.157:0/2901333431 shutdown_connections 2024-04-03T08:45:32.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.100+0000 7f60dce00700 1 -- 172.21.15.157:0/2901333431 wait complete. 2024-04-03T08:45:32.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60dce00700 1 Processor -- start 2024-04-03T08:45:32.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60dce00700 1 -- start start 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60dce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60d80fcee0 0x7f60d810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60dce00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 0x7f60d810df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60dce00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d810e510 con 0x7f60d80fe0d0 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60dce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d810ed60 con 0x7f60d80fcee0 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60d5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 0x7f60d810df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60d5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 0x7f60d810df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:53534/0 (socket says 172.21.15.157:53534) 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60d5400700 1 -- 172.21.15.157:0/1415535837 learned_addr learned my addr 172.21.15.157:0/1415535837 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.101+0000 7f60d5e00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60d80fcee0 0x7f60d810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60d5400700 1 -- 172.21.15.157:0/1415535837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60d80fcee0 msgr2=0x7f60d810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60d5400700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60d80fcee0 0x7f60d810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60d5400700 1 -- 172.21.15.157:0/1415535837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8005040 con 0x7f60d80fe0d0 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60d5400700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 0x7f60d810df10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f60c400eb40 tx=0x7f60c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:32.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60c4007cc0 con 0x7f60d80fe0d0 2024-04-03T08:45:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60c400f040 con 0x7f60d80fe0d0 2024-04-03T08:45:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d810efe0 con 0x7f60d80fe0d0 2024-04-03T08:45:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60c400ca10 con 0x7f60d80fe0d0 2024-04-03T08:45:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.102+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d810f520 con 0x7f60d80fe0d0 2024-04-03T08:45:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.104+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d805f5f0 con 0x7f60d80fe0d0 2024-04-03T08:45:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.105+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f60c400cb70 con 0x7f60d80fe0d0 2024-04-03T08:45:32.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.105+0000 7f60ce000700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f60bc06d7f0 0x7f60bc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:45:32.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.106+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f60c408ca50 con 0x7f60d80fe0d0 2024-04-03T08:45:32.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.106+0000 7f60d5e00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f60bc06d7f0 0x7f60bc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:45:32.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.106+0000 7f60d5e00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f60bc06d7f0 0x7f60bc06fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60c8013870 tx=0x7f60c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:45:32.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.110+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f60c4059e60 con 0x7f60d80fe0d0 2024-04-03T08:45:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.398+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f60d804bed0 con 0x7f60d80fe0d0 2024-04-03T08:45:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.399+0000 7f60ce000700 1 -- 172.21.15.157:0/1415535837 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f60c40599f0 con 0x7f60d80fe0d0 2024-04-03T08:45:32.399 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f60bc06d7f0 msgr2=0x7f60bc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f60bc06d7f0 0x7f60bc06fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60c8013870 tx=0x7f60c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 msgr2=0x7f60d810df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 0x7f60d810df10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f60c400eb40 tx=0x7f60c400b040 comp rx=0 tx=0).stop 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 shutdown_connections 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f60bc06d7f0 0x7f60bc06fca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60d80fcee0 0x7f60d810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:32.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 --2- 172.21.15.157:0/1415535837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60d80fe0d0 0x7f60d810df10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:45:32.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 >> 172.21.15.157:0/1415535837 conn(0x7f60d80f8560 msgr2=0x7f60d80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:45:32.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 shutdown_connections 2024-04-03T08:45:32.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:45:32.401+0000 7f60dce00700 1 -- 172.21.15.157:0/1415535837 wait complete. 2024-04-03T08:45:32.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:32 smithi157 ceph-mon[117693]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:32.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:32 smithi157 ceph-mon[117693]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:32.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:32 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1772408429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:45:32.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:32 smithi157 ceph-mon[117693]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:32.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:32 smithi157 ceph-mon[117693]: pgmap v102: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:45:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:32 smithi181 ceph-mon[101094]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:32 smithi181 ceph-mon[101094]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:32 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1772408429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:45:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:32 smithi181 ceph-mon[101094]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:45:32.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:32 smithi181 ceph-mon[101094]: pgmap v102: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:45:33.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:33 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1415535837' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:45:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:33 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1415535837' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:45:34.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:34 smithi157 ceph-mon[117693]: pgmap v103: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:45:34.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:34 smithi181 ceph-mon[101094]: pgmap v103: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:45:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:37 smithi157 ceph-mon[117693]: pgmap v104: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:45:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:37 smithi181 ceph-mon[101094]: pgmap v104: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:45:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:38 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:38.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:38 smithi181 ceph-mon[101094]: Upgrade: osd.3 is safe to restart 2024-04-03T08:45:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:38 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-03T08:45:38.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:38 smithi157 ceph-mon[117693]: Upgrade: osd.3 is safe to restart 2024-04-03T08:45:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:39 smithi157 ceph-mon[117693]: pgmap v105: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:45:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-03T08:45:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:45:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:39 smithi181 ceph-mon[101094]: pgmap v105: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:45:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-03T08:45:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:45:40.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:40 smithi157 ceph-mon[117693]: Upgrade: Updating osd.3 2024-04-03T08:45:40.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:40 smithi157 ceph-mon[117693]: Deploying daemon osd.3 on smithi181 2024-04-03T08:45:40.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:40 smithi181 ceph-mon[101094]: Upgrade: Updating osd.3 2024-04-03T08:45:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:40 smithi181 ceph-mon[101094]: Deploying daemon osd.3 on smithi181 2024-04-03T08:45:41.540 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:41 smithi181 ceph-mon[101094]: pgmap v106: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:45:41.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:41 smithi157 ceph-mon[117693]: pgmap v106: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:45:42.597 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:42 smithi181 systemd[1]: Stopping Ceph osd.3 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:45:43.097 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:42 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[50534]: 2024-04-03T08:45:42.733+0000 7efd03400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:45:43.097 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:42 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[50534]: 2024-04-03T08:45:42.733+0000 7efd03400700 -1 osd.3 65 *** Got signal Terminated *** 2024-04-03T08:45:43.097 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:42 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[50534]: 2024-04-03T08:45:42.733+0000 7efd03400700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T08:45:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:43 smithi157 ceph-mon[117693]: pgmap v107: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:45:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:43 smithi157 ceph-mon[117693]: osd.3 marked itself down and dead 2024-04-03T08:45:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:43 smithi181 ceph-mon[101094]: pgmap v107: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:45:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:43 smithi181 ceph-mon[101094]: osd.3 marked itself down and dead 2024-04-03T08:45:44.349 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:44 smithi181 bash[113107]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: osdmap e66: 6 total, 5 up, 6 in 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 3]}]: dispatch 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 2]}]: dispatch 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]: dispatch 2024-04-03T08:45:44.350 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]: dispatch 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]: dispatch 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]: dispatch 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 3]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 2]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]': finished 2024-04-03T08:45:44.351 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:44 smithi181 ceph-mon[101094]: osdmap e67: 6 total, 5 up, 6 in 2024-04-03T08:45:44.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:45:44.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: osdmap e66: 6 total, 5 up, 6 in 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 3]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 2]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 3]}]': finished 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 2]}]': finished 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]': finished 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]': finished 2024-04-03T08:45:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]': finished 2024-04-03T08:45:44.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]': finished 2024-04-03T08:45:44.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:44 smithi157 ceph-mon[117693]: osdmap e67: 6 total, 5 up, 6 in 2024-04-03T08:45:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:45 smithi157 ceph-mon[117693]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-03T08:45:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:45 smithi157 ceph-mon[117693]: osdmap e68: 6 total, 5 up, 6 in 2024-04-03T08:45:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:45 smithi181 ceph-mon[101094]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-03T08:45:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:45 smithi181 ceph-mon[101094]: osdmap e68: 6 total, 5 up, 6 in 2024-04-03T08:45:46.594 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:46 smithi181 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.3.service: Succeeded. 2024-04-03T08:45:46.594 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:46 smithi181 systemd[1]: Stopped Ceph osd.3 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:45:47.097 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:46 smithi181 systemd[1]: Starting Ceph osd.3 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:45:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:47 smithi157 ceph-mon[117693]: pgmap v112: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-03T08:45:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:47 smithi157 ceph-mon[117693]: osdmap e69: 6 total, 5 up, 6 in 2024-04-03T08:45:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:47 smithi157 ceph-mon[117693]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-03T08:45:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:47 smithi157 ceph-mon[117693]: Health check failed: Degraded data redundancy: 49/222 objects degraded (22.072%), 16 pgs degraded (PG_DEGRADED) 2024-04-03T08:45:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:47 smithi181 ceph-mon[101094]: pgmap v112: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-03T08:45:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:47 smithi181 ceph-mon[101094]: osdmap e69: 6 total, 5 up, 6 in 2024-04-03T08:45:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:47 smithi181 ceph-mon[101094]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-03T08:45:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:47 smithi181 ceph-mon[101094]: Health check failed: Degraded data redundancy: 49/222 objects degraded (22.072%), 16 pgs degraded (PG_DEGRADED) 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-03T08:45:48.287 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:47 smithi181 bash[113377]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-03T08:45:48.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:48 smithi157 ceph-mon[117693]: osdmap e70: 6 total, 5 up, 6 in 2024-04-03T08:45:48.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:48 smithi181 ceph-mon[101094]: osdmap e70: 6 total, 5 up, 6 in 2024-04-03T08:45:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:49 smithi157 ceph-mon[117693]: pgmap v115: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-03T08:45:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:49 smithi157 ceph-mon[117693]: osdmap e71: 6 total, 5 up, 6 in 2024-04-03T08:45:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:49 smithi181 ceph-mon[101094]: pgmap v115: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-03T08:45:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:49 smithi181 ceph-mon[101094]: osdmap e71: 6 total, 5 up, 6 in 2024-04-03T08:45:49.597 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:49 smithi181 ceph-osd[113666]: -- 172.21.15.181:0/708449677 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555fdec33680 con 0x555fdebfcc00 2024-04-03T08:45:49.597 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:49 smithi181 bash[113628]: f4f7d939cae6da7138764b21e7d1864b953216ae187be90f84d2bf8de4cdf2e6 2024-04-03T08:45:49.597 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:49 smithi181 systemd[1]: Started Ceph osd.3 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:45:50.097 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:49 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T08:45:49.785+0000 7f84e4cc87c0 -1 Falling back to public interface 2024-04-03T08:45:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:50 smithi157 ceph-mon[117693]: osdmap e72: 6 total, 5 up, 6 in 2024-04-03T08:45:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:50 smithi181 ceph-mon[101094]: osdmap e72: 6 total, 5 up, 6 in 2024-04-03T08:45:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:51 smithi157 ceph-mon[117693]: pgmap v118: 65 pgs: 5 active+clean+remapped, 2 unknown, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 59 MiB/s wr, 483 op/s; 49/222 objects degraded (22.072%); 4/222 objects misplaced (1.802%); 2.0 MiB/s, 189 objects/s recovering 2024-04-03T08:45:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:51 smithi157 ceph-mon[117693]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-03T08:45:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:51 smithi181 ceph-mon[101094]: pgmap v118: 65 pgs: 5 active+clean+remapped, 2 unknown, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 59 MiB/s wr, 483 op/s; 49/222 objects degraded (22.072%); 4/222 objects misplaced (1.802%); 2.0 MiB/s, 189 objects/s recovering 2024-04-03T08:45:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:51 smithi181 ceph-mon[101094]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-03T08:45:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:53 smithi157 ceph-mon[117693]: pgmap v119: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 40 MiB/s wr, 327 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 2.0 MiB/s, 130 objects/s recovering 2024-04-03T08:45:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:53 smithi181 ceph-mon[101094]: pgmap v119: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 40 MiB/s wr, 327 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 2.0 MiB/s, 130 objects/s recovering 2024-04-03T08:45:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:55 smithi181 ceph-mon[101094]: pgmap v120: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 34 MiB/s wr, 281 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 1.7 MiB/s, 111 objects/s recovering 2024-04-03T08:45:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:55 smithi157 ceph-mon[117693]: pgmap v120: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 34 MiB/s wr, 281 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 1.7 MiB/s, 111 objects/s recovering 2024-04-03T08:45:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:56.097 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:55 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T08:45:55.893+0000 7f84e4cc87c0 -1 osd.3 65 log_to_monitors true 2024-04-03T08:45:56.483 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:56 smithi181 ceph-mon[101094]: from='osd.3 [v2:172.21.15.181:6800/2489609945,v1:172.21.15.181:6801/2489609945]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:45:56.483 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:56 smithi181 ceph-mon[101094]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:45:56.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:56 smithi157 ceph-mon[117693]: from='osd.3 [v2:172.21.15.181:6800/2489609945,v1:172.21.15.181:6801/2489609945]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:45:56.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:56 smithi157 ceph-mon[117693]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-03T08:45:57.597 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 08:45:57 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T08:45:57.337+0000 7f84cf000700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:45:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:57 smithi181 ceph-mon[101094]: pgmap v121: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 30 MiB/s wr, 243 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 1.5 MiB/s, 96 objects/s recovering 2024-04-03T08:45:57.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:57 smithi181 ceph-mon[101094]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-03T08:45:57.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:57 smithi181 ceph-mon[101094]: from='osd.3 [v2:172.21.15.181:6800/2489609945,v1:172.21.15.181:6801/2489609945]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:45:57.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:57 smithi181 ceph-mon[101094]: osdmap e73: 6 total, 5 up, 6 in 2024-04-03T08:45:57.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:57 smithi181 ceph-mon[101094]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:45:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:57 smithi157 ceph-mon[117693]: pgmap v121: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 30 MiB/s wr, 243 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 1.5 MiB/s, 96 objects/s recovering 2024-04-03T08:45:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:57 smithi157 ceph-mon[117693]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-03T08:45:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:57 smithi157 ceph-mon[117693]: from='osd.3 [v2:172.21.15.181:6800/2489609945,v1:172.21.15.181:6801/2489609945]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:45:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:57 smithi157 ceph-mon[117693]: osdmap e73: 6 total, 5 up, 6 in 2024-04-03T08:45:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:57 smithi157 ceph-mon[117693]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:45:58.658 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:58 smithi157 ceph-mon[117693]: from='osd.3 ' entity='osd.3' 2024-04-03T08:45:58.742 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:58 smithi181 ceph-mon[101094]: from='osd.3 ' entity='osd.3' 2024-04-03T08:45:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: pgmap v123: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 27 MiB/s wr, 219 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 1.3 MiB/s, 86 objects/s recovering 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: osd.3 [v2:172.21.15.181:6800/2489609945,v1:172.21.15.181:6801/2489609945] boot 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: osdmap e74: 6 total, 6 up, 6 in 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: osdmap e75: 6 total, 6 up, 6 in 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:45:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:45:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: pgmap v123: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 19 active+undersized, 23 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 27 MiB/s wr, 219 op/s; 49/222 objects degraded (22.072%); 5/222 objects misplaced (2.252%); 1.3 MiB/s, 86 objects/s recovering 2024-04-03T08:45:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:45:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: osd.3 [v2:172.21.15.181:6800/2489609945,v1:172.21.15.181:6801/2489609945] boot 2024-04-03T08:45:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: osdmap e74: 6 total, 6 up, 6 in 2024-04-03T08:45:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-03T08:45:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: osdmap e75: 6 total, 6 up, 6 in 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:45:59.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:00 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:46:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:00 smithi157 ceph-mon[117693]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-04-03T08:46:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:00 smithi157 ceph-mon[117693]: osdmap e76: 6 total, 6 up, 6 in 2024-04-03T08:46:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:00 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:46:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:00 smithi181 ceph-mon[101094]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-04-03T08:46:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:00 smithi181 ceph-mon[101094]: osdmap e76: 6 total, 6 up, 6 in 2024-04-03T08:46:01.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:01 smithi157 ceph-mon[117693]: pgmap v127: 65 pgs: 35 active+clean, 10 active+undersized, 4 active+clean+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 13 active+undersized+degraded, 1 active+undersized+remapped, 1 remapped+peering; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 763/222 objects degraded (343.694%); 4/222 objects misplaced (1.802%); 1024 KiB/s, 4 objects/s recovering 2024-04-03T08:46:01.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:01 smithi157 ceph-mon[117693]: Health check update: Degraded data redundancy: 763/222 objects degraded (343.694%), 14 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:01.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:01 smithi157 ceph-mon[117693]: osdmap e77: 6 total, 6 up, 6 in 2024-04-03T08:46:01.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:01 smithi181 ceph-mon[101094]: pgmap v127: 65 pgs: 35 active+clean, 10 active+undersized, 4 active+clean+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 13 active+undersized+degraded, 1 active+undersized+remapped, 1 remapped+peering; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 763/222 objects degraded (343.694%); 4/222 objects misplaced (1.802%); 1024 KiB/s, 4 objects/s recovering 2024-04-03T08:46:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:01 smithi181 ceph-mon[101094]: Health check update: Degraded data redundancy: 763/222 objects degraded (343.694%), 14 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:01 smithi181 ceph-mon[101094]: osdmap e77: 6 total, 6 up, 6 in 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 -- 172.21.15.157:0/2351178728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 msgr2=0x7f392c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 --2- 172.21.15.157:0/2351178728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c0fe540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3918004940 tx=0x7f3918009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 -- 172.21.15.157:0/2351178728 shutdown_connections 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 --2- 172.21.15.157:0/2351178728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c0fe540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 --2- 172.21.15.157:0/2351178728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f392c0fcee0 0x7f392c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 -- 172.21.15.157:0/2351178728 >> 172.21.15.157:0/2351178728 conn(0x7f392c0f8560 msgr2=0x7f392c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 -- 172.21.15.157:0/2351178728 shutdown_connections 2024-04-03T08:46:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.558+0000 7f3931200700 1 -- 172.21.15.157:0/2351178728 wait complete. 2024-04-03T08:46:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.559+0000 7f3931200700 1 Processor -- start 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.559+0000 7f3931200700 1 -- start start 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.559+0000 7f3931200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f392c0fcee0 0x7f392c10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.559+0000 7f3931200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.559+0000 7f3931200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c110850 con 0x7f392c0fe0d0 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.559+0000 7f3931200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c110f90 con 0x7f392c0fcee0 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48866/0 (socket says 172.21.15.157:48866) 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 -- 172.21.15.157:0/1712269782 learned_addr learned my addr 172.21.15.157:0/1712269782 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929e00700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f392c0fcee0 0x7f392c10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 -- 172.21.15.157:0/1712269782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f392c0fcee0 msgr2=0x7f392c10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f392c0fcee0 0x7f392c10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 -- 172.21.15.157:0/1712269782 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918005040 con 0x7f392c0fe0d0 2024-04-03T08:46:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.560+0000 7f3929400700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c110250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f391800b3b0 tx=0x7f3918009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.561+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391800e040 con 0x7f392c0fe0d0 2024-04-03T08:46:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.561+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3918004290 con 0x7f392c0fe0d0 2024-04-03T08:46:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.561+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391801c3f0 con 0x7f392c0fe0d0 2024-04-03T08:46:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.561+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c111210 con 0x7f392c0fe0d0 2024-04-03T08:46:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.561+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c111780 con 0x7f392c0fe0d0 2024-04-03T08:46:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.562+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c101a60 con 0x7f392c0fe0d0 2024-04-03T08:46:02.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.563+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f391800bbf0 con 0x7f392c0fe0d0 2024-04-03T08:46:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.564+0000 7f3922000700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f391006d7f0 0x7f391006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.564+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f391808e360 con 0x7f392c0fe0d0 2024-04-03T08:46:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.564+0000 7f3929e00700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f391006d7f0 0x7f391006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.565+0000 7f3929e00700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f391006d7f0 0x7f391006fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f392c0fcc20 tx=0x7f391c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:02.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.570+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f391805b5c0 con 0x7f392c0fe0d0 2024-04-03T08:46:02.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.819+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f392c1119f0 con 0x7f391006d7f0 2024-04-03T08:46:02.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.820+0000 7f3922000700 1 -- 172.21.15.157:0/1712269782 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f392c1119f0 con 0x7f391006d7f0 2024-04-03T08:46:02.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.822+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f391006d7f0 msgr2=0x7f391006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:02.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.822+0000 7f3931200700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f391006d7f0 0x7f391006fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f392c0fcc20 tx=0x7f391c00b040 comp rx=0 tx=0).stop 2024-04-03T08:46:02.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.822+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 msgr2=0x7f392c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:02.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.822+0000 7f3931200700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c110250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f391800b3b0 tx=0x7f3918009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 shutdown_connections 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f391006d7f0 0x7f391006fca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f392c0fcee0 0x7f392c10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 --2- 172.21.15.157:0/1712269782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f392c0fe0d0 0x7f392c110250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 >> 172.21.15.157:0/1712269782 conn(0x7f392c0f8560 msgr2=0x7f392c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 shutdown_connections 2024-04-03T08:46:02.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.823+0000 7f3931200700 1 -- 172.21.15.157:0/1712269782 wait complete. 2024-04-03T08:46:02.838 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 -- 172.21.15.157:0/794414060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 msgr2=0x7f56300fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 --2- 172.21.15.157:0/794414060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f56300fd310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5624004940 tx=0x7f5624009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 -- 172.21.15.157:0/794414060 shutdown_connections 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 --2- 172.21.15.157:0/794414060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56300fe0d0 0x7f56300fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 --2- 172.21.15.157:0/794414060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f56300fd310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 -- 172.21.15.157:0/794414060 >> 172.21.15.157:0/794414060 conn(0x7f56300f8560 msgr2=0x7f56300fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 -- 172.21.15.157:0/794414060 shutdown_connections 2024-04-03T08:46:02.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.960+0000 7f5638400700 1 -- 172.21.15.157:0/794414060 wait complete. 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5638400700 1 Processor -- start 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5638400700 1 -- start start 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5638400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f563010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5638400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56300fe0d0 0x7f563010df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5638400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563010e510 con 0x7f56300fcee0 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5638400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563010ed60 con 0x7f56300fe0d0 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5635a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f563010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5635a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f563010d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48878/0 (socket says 172.21.15.157:48878) 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5635a00700 1 -- 172.21.15.157:0/1017912670 learned_addr learned my addr 172.21.15.157:0/1017912670 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.961+0000 7f5635000700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56300fe0d0 0x7f563010df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:02.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f5635a00700 1 -- 172.21.15.157:0/1017912670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56300fe0d0 msgr2=0x7f563010df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f5635a00700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56300fe0d0 0x7f563010df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f5635a00700 1 -- 172.21.15.157:0/1017912670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624005040 con 0x7f56300fcee0 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f5635a00700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f563010d9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f562400b0d0 tx=0x7f5624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f562400e070 con 0x7f56300fcee0 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5624013de0 con 0x7f56300fcee0 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f562400b410 con 0x7f56300fcee0 2024-04-03T08:46:02.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.962+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563010efe0 con 0x7f56300fcee0 2024-04-03T08:46:02.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.963+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563010f520 con 0x7f56300fcee0 2024-04-03T08:46:02.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.964+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563005f5f0 con 0x7f56300fcee0 2024-04-03T08:46:02.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.964+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f562401d460 con 0x7f56300fcee0 2024-04-03T08:46:02.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.965+0000 7f562d600700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f561806d7f0 0x7f561806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:02.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.965+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6642+0+0 (secure 0 0 0) 0x7f562408e090 con 0x7f56300fcee0 2024-04-03T08:46:02.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.966+0000 7f5635000700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f561806d7f0 0x7f561806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:02.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.966+0000 7f5635000700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f561806d7f0 0x7f561806fca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f561c009b80 tx=0x7f561c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:02.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:02.970+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f562405b380 con 0x7f56300fcee0 2024-04-03T08:46:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:02 smithi181 ceph-mon[101094]: osdmap e78: 6 total, 6 up, 6 in 2024-04-03T08:46:03.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:02 smithi181 ceph-mon[101094]: pgmap v130: 65 pgs: 61 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 1 remapped+peering; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 725/222 objects degraded (326.577%); 0 B/s, 28 objects/s recovering 2024-04-03T08:46:03.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.192+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f563010f8a0 con 0x7f561806d7f0 2024-04-03T08:46:03.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.193+0000 7f562d600700 1 -- 172.21.15.157:0/1017912670 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f563010f8a0 con 0x7f561806d7f0 2024-04-03T08:46:03.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f561806d7f0 msgr2=0x7f561806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f561806d7f0 0x7f561806fca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f561c009b80 tx=0x7f561c00b040 comp rx=0 tx=0).stop 2024-04-03T08:46:03.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 msgr2=0x7f563010d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f563010d9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f562400b0d0 tx=0x7f5624009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:03.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 shutdown_connections 2024-04-03T08:46:03.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f561806d7f0 0x7f561806fca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fcee0 0x7f563010d9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 --2- 172.21.15.157:0/1017912670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56300fe0d0 0x7f563010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.195+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 >> 172.21.15.157:0/1017912670 conn(0x7f56300f8560 msgr2=0x7f56300f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:03.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.196+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 shutdown_connections 2024-04-03T08:46:03.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.196+0000 7f5638400700 1 -- 172.21.15.157:0/1017912670 wait complete. 2024-04-03T08:46:03.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:02 smithi157 ceph-mon[117693]: osdmap e78: 6 total, 6 up, 6 in 2024-04-03T08:46:03.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:02 smithi157 ceph-mon[117693]: pgmap v130: 65 pgs: 61 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 1 remapped+peering; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 725/222 objects degraded (326.577%); 0 B/s, 28 objects/s recovering 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 -- 172.21.15.157:0/1402320583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fdec0 msgr2=0x7f74540fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 --2- 172.21.15.157:0/1402320583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fdec0 0x7f74540fe330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7440004940 tx=0x7f7440009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 -- 172.21.15.157:0/1402320583 shutdown_connections 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 --2- 172.21.15.157:0/1402320583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fdec0 0x7f74540fe330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 --2- 172.21.15.157:0/1402320583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74540fcc10 0x7f74540fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 -- 172.21.15.157:0/1402320583 >> 172.21.15.157:0/1402320583 conn(0x7f74540f83d0 msgr2=0x7f74540fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 -- 172.21.15.157:0/1402320583 shutdown_connections 2024-04-03T08:46:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.331+0000 7f7459400700 1 -- 172.21.15.157:0/1402320583 wait complete. 2024-04-03T08:46:03.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7459400700 1 Processor -- start 2024-04-03T08:46:03.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7459400700 1 -- start start 2024-04-03T08:46:03.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7459400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 0x7f745410f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:03.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7459400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74540fdec0 0x7f745410fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7459400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541104f0 con 0x7f74540fcc10 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7459400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7454110d40 con 0x7f74540fdec0 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7453e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 0x7f745410f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7453e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 0x7f745410f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48886/0 (socket says 172.21.15.157:48886) 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.332+0000 7f7453e00700 1 -- 172.21.15.157:0/869322650 learned_addr learned my addr 172.21.15.157:0/869322650 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f7453400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74540fdec0 0x7f745410fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f7453e00700 1 -- 172.21.15.157:0/869322650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74540fdec0 msgr2=0x7f745410fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f7453e00700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74540fdec0 0x7f745410fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f7453e00700 1 -- 172.21.15.157:0/869322650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440005040 con 0x7f74540fcc10 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f7453e00700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 0x7f745410f9b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f744400eb40 tx=0x7f744400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7444007cc0 con 0x7f74540fcc10 2024-04-03T08:46:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f744400f040 con 0x7f74540fcc10 2024-04-03T08:46:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7454110fc0 con 0x7f74540fcc10 2024-04-03T08:46:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.333+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f744400ca10 con 0x7f74540fcc10 2024-04-03T08:46:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.334+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7454111500 con 0x7f74540fcc10 2024-04-03T08:46:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.335+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7454101850 con 0x7f74540fcc10 2024-04-03T08:46:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.335+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f744400cc80 con 0x7f74540fcc10 2024-04-03T08:46:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.337+0000 7f744be00700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f743806d7f0 0x7f743806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.337+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6642+0+0 (secure 0 0 0) 0x7f744408cb50 con 0x7f74540fcc10 2024-04-03T08:46:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.337+0000 7f7453400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f743806d7f0 0x7f743806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.338+0000 7f7453400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f743806d7f0 0x7f743806fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f744000b0d0 tx=0x7f7440009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:03.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.341+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7444059e90 con 0x7f74540fcc10 2024-04-03T08:46:03.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.557+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7454105870 con 0x7f743806d7f0 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.568+0000 7f744be00700 1 -- 172.21.15.157:0/869322650 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7454105870 con 0x7f743806d7f0 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (6m) 47s ago 16m 13.8M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (2m) 47s ago 16m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (2m) 10s ago 15m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (5m) 47s ago 15m 75.2M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (10m) 47s ago 10m 14.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:46:03.569 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (10m) 47s ago 9m 135M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (10m) 10s ago 10m 14.1M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (9m) 10s ago 9m 99.6M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (4m) 47s ago 17m 500M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (3m) 10s ago 15m 450M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (3m) 47s ago 18m 44.4M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (3m) 10s ago 15m 39.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (6m) 47s ago 16m 7516k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (4m) 10s ago 15m 7772k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (105s) 47s ago 14m 92.5M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (80s) 47s ago 13m 97.7M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (54s) 47s ago 13m 11.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (14s) 10s ago 12m 11.0M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:46:03.570 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (12m) 10s ago 12m 252M 2642M 17.2.7-805-g6fda41ff a49113eacc58 30ca0e7e8b16 2024-04-03T08:46:03.571 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (11m) 10s ago 11m 224M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:46:03.571 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (3m) 47s ago 15m 48.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:46:03.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f743806d7f0 msgr2=0x7f743806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f743806d7f0 0x7f743806fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f744000b0d0 tx=0x7f7440009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 msgr2=0x7f745410f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 0x7f745410f9b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f744400eb40 tx=0x7f744400b040 comp rx=0 tx=0).stop 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 shutdown_connections 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f743806d7f0 0x7f743806fca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74540fcc10 0x7f745410f9b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 --2- 172.21.15.157:0/869322650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74540fdec0 0x7f745410fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 >> 172.21.15.157:0/869322650 conn(0x7f74540f83d0 msgr2=0x7f74540f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 shutdown_connections 2024-04-03T08:46:03.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.571+0000 7f7459400700 1 -- 172.21.15.157:0/869322650 wait complete. 2024-04-03T08:46:03.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 -- 172.21.15.157:0/3946818555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948071e40 msgr2=0x7fb948070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 --2- 172.21.15.157:0/3946818555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948071e40 0x7fb948070350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb938004940 tx=0x7fb938009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 -- 172.21.15.157:0/3946818555 shutdown_connections 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 --2- 172.21.15.157:0/3946818555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb948070890 0x7fb948070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 --2- 172.21.15.157:0/3946818555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948071e40 0x7fb948070350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 -- 172.21.15.157:0/3946818555 >> 172.21.15.157:0/3946818555 conn(0x7fb9480f83d0 msgr2=0x7fb9480fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 -- 172.21.15.157:0/3946818555 shutdown_connections 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.704+0000 7fb947e00700 1 -- 172.21.15.157:0/3946818555 wait complete. 2024-04-03T08:46:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.705+0000 7fb947e00700 1 Processor -- start 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.705+0000 7fb947e00700 1 -- start start 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb947e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 0x7fb94810fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb947e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb948071e40 0x7fb94810ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb947e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948110570 con 0x7fb948070890 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb947e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948110dc0 con 0x7fb948071e40 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 0x7fb94810fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 0x7fb94810fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48910/0 (socket says 172.21.15.157:48910) 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946a00700 1 -- 172.21.15.157:0/1828083892 learned_addr learned my addr 172.21.15.157:0/1828083892 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946000700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb948071e40 0x7fb94810ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946a00700 1 -- 172.21.15.157:0/1828083892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb948071e40 msgr2=0x7fb94810ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946a00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb948071e40 0x7fb94810ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.706+0000 7fb946a00700 1 -- 172.21.15.157:0/1828083892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb948070890 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.707+0000 7fb946a00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 0x7fb94810fa30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb938000c00 tx=0x7fb938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.707+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800e030 con 0x7fb948070890 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.707+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb938009430 con 0x7fb948070890 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.707+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb948111040 con 0x7fb948070890 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.707+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800b410 con 0x7fb948070890 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.707+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb948111580 con 0x7fb948070890 2024-04-03T08:46:03.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.708+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94805f5f0 con 0x7fb948070890 2024-04-03T08:46:03.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.709+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb93801c770 con 0x7fb948070890 2024-04-03T08:46:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.710+0000 7fb93ea00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb92c06d7e0 0x7fb92c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.710+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6642+0+0 (secure 0 0 0) 0x7fb93808e500 con 0x7fb948070890 2024-04-03T08:46:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.711+0000 7fb946000700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb92c06d7e0 0x7fb92c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.711+0000 7fb946000700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb92c06d7e0 0x7fb92c06fc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb934009b80 tx=0x7fb93400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:03.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:03.715+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb93805b770 con 0x7fb948070890 2024-04-03T08:46:04.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.010+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9481117a0 con 0x7fb948070890 2024-04-03T08:46:04.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.011+0000 7fb93ea00700 1 -- 172.21.15.157:0/1828083892 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fb93801c400 con 0x7fb948070890 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:46:04.012 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 2, 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 6, 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:46:04.013 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb92c06d7e0 msgr2=0x7fb92c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb92c06d7e0 0x7fb92c06fc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb934009b80 tx=0x7fb93400b040 comp rx=0 tx=0).stop 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 msgr2=0x7fb94810fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 0x7fb94810fa30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb938000c00 tx=0x7fb938009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 shutdown_connections 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb92c06d7e0 0x7fb92c06fc90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948070890 0x7fb94810fa30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 --2- 172.21.15.157:0/1828083892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb948071e40 0x7fb94810ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 >> 172.21.15.157:0/1828083892 conn(0x7fb9480f83d0 msgr2=0x7fb9480f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 shutdown_connections 2024-04-03T08:46:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.013+0000 7fb947e00700 1 -- 172.21.15.157:0/1828083892 wait complete. 2024-04-03T08:46:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:03 smithi157 ceph-mon[117693]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:03 smithi157 ceph-mon[117693]: osdmap e79: 6 total, 6 up, 6 in 2024-04-03T08:46:04.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:03 smithi157 ceph-mon[117693]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:03 smithi181 ceph-mon[101094]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:03 smithi181 ceph-mon[101094]: osdmap e79: 6 total, 6 up, 6 in 2024-04-03T08:46:04.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:03 smithi181 ceph-mon[101094]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:04.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.148+0000 7f2dac200700 1 -- 172.21.15.157:0/1403635798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fcee0 msgr2=0x7f2da40fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.148+0000 7f2dac200700 1 --2- 172.21.15.157:0/1403635798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fcee0 0x7f2da40fd310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d98004940 tx=0x7f2d98009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:04.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.148+0000 7f2dac200700 1 -- 172.21.15.157:0/1403635798 shutdown_connections 2024-04-03T08:46:04.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.148+0000 7f2dac200700 1 --2- 172.21.15.157:0/1403635798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2da40fe0d0 0x7f2da40fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.148+0000 7f2dac200700 1 --2- 172.21.15.157:0/1403635798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fcee0 0x7f2da40fd310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.148+0000 7f2dac200700 1 -- 172.21.15.157:0/1403635798 >> 172.21.15.157:0/1403635798 conn(0x7f2da40f8560 msgr2=0x7f2da40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:04.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.149+0000 7f2dac200700 1 -- 172.21.15.157:0/1403635798 shutdown_connections 2024-04-03T08:46:04.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.149+0000 7f2dac200700 1 -- 172.21.15.157:0/1403635798 wait complete. 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.149+0000 7f2dac200700 1 Processor -- start 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2dac200700 1 -- start start 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2dac200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2da40fcee0 0x7f2da410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2dac200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 0x7f2da4110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2dac200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4110860 con 0x7f2da40fe0d0 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2dac200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4110fa0 con 0x7f2da40fcee0 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2da8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 0x7f2da4110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2da8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 0x7f2da4110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48924/0 (socket says 172.21.15.157:48924) 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2da8e00700 1 -- 172.21.15.157:0/2272451620 learned_addr learned my addr 172.21.15.157:0/2272451620 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:04.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2da9800700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2da40fcee0 0x7f2da410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2da8e00700 1 -- 172.21.15.157:0/2272451620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2da40fcee0 msgr2=0x7f2da410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.150+0000 7f2da8e00700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2da40fcee0 0x7f2da410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2da8e00700 1 -- 172.21.15.157:0/2272451620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98005040 con 0x7f2da40fe0d0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2da8e00700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 0x7f2da4110260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d90002a50 tx=0x7f2d900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d90007cc0 con 0x7f2da40fe0d0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d9000f040 con 0x7f2da40fe0d0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d90009640 con 0x7f2da40fe0d0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da4111280 con 0x7f2da40fe0d0 2024-04-03T08:46:04.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.151+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da4111840 con 0x7f2da40fe0d0 2024-04-03T08:46:04.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.152+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da4101a60 con 0x7f2da40fe0d0 2024-04-03T08:46:04.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.153+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2d900097a0 con 0x7f2da40fe0d0 2024-04-03T08:46:04.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.154+0000 7f2da1600700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2d8c06d7f0 0x7f2d8c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.155+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6642+0+0 (secure 0 0 0) 0x7f2d9008cd50 con 0x7f2da40fe0d0 2024-04-03T08:46:04.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.155+0000 7f2da9800700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2d8c06d7f0 0x7f2d8c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.155+0000 7f2da9800700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2d8c06d7f0 0x7f2d8c06fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800b3b0 tx=0x7f2d98009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:04.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.159+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2d90059fc0 con 0x7f2da40fe0d0 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.410+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2da405f5f0 con 0x7f2da40fe0d0 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.410+0000 7f2da1600700 1 -- 172.21.15.157:0/2272451620 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f2d90059b50 con 0x7f2da40fe0d0 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:46:04.411 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:46:04.412 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:46:04.413 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:04.414 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:04.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2d8c06d7f0 msgr2=0x7f2d8c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2d8c06d7f0 0x7f2d8c06fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800b3b0 tx=0x7f2d98009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:04.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 msgr2=0x7f2da4110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 0x7f2da4110260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d90002a50 tx=0x7f2d900046b0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 shutdown_connections 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2d8c06d7f0 0x7f2d8c06fca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2da40fcee0 0x7f2da410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 --2- 172.21.15.157:0/2272451620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2da40fe0d0 0x7f2da4110260 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.412+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 >> 172.21.15.157:0/2272451620 conn(0x7f2da40f8560 msgr2=0x7f2da40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.413+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 shutdown_connections 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.413+0000 7f2dac200700 1 -- 172.21.15.157:0/2272451620 wait complete. 2024-04-03T08:46:04.416 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:46:04.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 -- 172.21.15.157:0/2717278957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fe0d0 msgr2=0x7f35380fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 --2- 172.21.15.157:0/2717278957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fe0d0 0x7f35380fe540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3524004940 tx=0x7f3524009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 -- 172.21.15.157:0/2717278957 shutdown_connections 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 --2- 172.21.15.157:0/2717278957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fe0d0 0x7f35380fe540 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 --2- 172.21.15.157:0/2717278957 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fcee0 0x7f35380fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 -- 172.21.15.157:0/2717278957 >> 172.21.15.157:0/2717278957 conn(0x7f35380f8560 msgr2=0x7f35380fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.547+0000 7f353ee00700 1 -- 172.21.15.157:0/2717278957 shutdown_connections 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.548+0000 7f353ee00700 1 -- 172.21.15.157:0/2717278957 wait complete. 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.549+0000 7f353ee00700 1 Processor -- start 2024-04-03T08:46:04.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.549+0000 7f353ee00700 1 -- start start 2024-04-03T08:46:04.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.549+0000 7f353ee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 0x7f353810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.549+0000 7f353ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fe0d0 0x7f3538110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.549+0000 7f353ee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538110850 con 0x7f35380fcee0 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.549+0000 7f353ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538110f90 con 0x7f35380fe0d0 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 0x7f353810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 0x7f353810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48940/0 (socket says 172.21.15.157:48940) 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 -- 172.21.15.157:0/3191397569 learned_addr learned my addr 172.21.15.157:0/3191397569 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537400700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fe0d0 0x7f3538110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 -- 172.21.15.157:0/3191397569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fe0d0 msgr2=0x7f3538110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fe0d0 0x7f3538110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 -- 172.21.15.157:0/3191397569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524005040 con 0x7f35380fcee0 2024-04-03T08:46:04.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537400700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fe0d0 0x7f3538110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:46:04.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f3537e00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 0x7f353810fd10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3528002a80 tx=0x7f3528004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:04.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3528007cc0 con 0x7f35380fcee0 2024-04-03T08:46:04.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f352800f040 con 0x7f35380fcee0 2024-04-03T08:46:04.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.550+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352800dad0 con 0x7f35380fcee0 2024-04-03T08:46:04.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.551+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3538111270 con 0x7f35380fcee0 2024-04-03T08:46:04.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.551+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35381117e0 con 0x7f35380fcee0 2024-04-03T08:46:04.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.552+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3538101a60 con 0x7f35380fcee0 2024-04-03T08:46:04.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.553+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f352800dc30 con 0x7f35380fcee0 2024-04-03T08:46:04.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.553+0000 7f352fe00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f351c06d7f0 0x7f351c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.554+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6642+0+0 (secure 0 0 0) 0x7f352808cd70 con 0x7f35380fcee0 2024-04-03T08:46:04.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.554+0000 7f3537400700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f351c06d7f0 0x7f351c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.554+0000 7f3537400700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f351c06d7f0 0x7f351c06fca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f352400b3b0 tx=0x7f3524009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:04.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.558+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f352805a000 con 0x7f35380fcee0 2024-04-03T08:46:04.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.778+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3538111a50 con 0x7f351c06d7f0 2024-04-03T08:46:04.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.780+0000 7f352fe00700 1 -- 172.21.15.157:0/3191397569 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3538111a50 con 0x7f351c06d7f0 2024-04-03T08:46:04.782 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:46:04.782 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:46:04.782 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:46:04.782 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "10/21 daemons upgraded", 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading osd daemons", 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:46:04.783 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f351c06d7f0 msgr2=0x7f351c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f351c06d7f0 0x7f351c06fca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f352400b3b0 tx=0x7f3524009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 msgr2=0x7f353810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 0x7f353810fd10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3528002a80 tx=0x7f3528004600 comp rx=0 tx=0).stop 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 shutdown_connections 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f351c06d7f0 0x7f351c06fca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35380fcee0 0x7f353810fd10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 --2- 172.21.15.157:0/3191397569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35380fe0d0 0x7f3538110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.782+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 >> 172.21.15.157:0/3191397569 conn(0x7f35380f8560 msgr2=0x7f35380f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.783+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 shutdown_connections 2024-04-03T08:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.783+0000 7f353ee00700 1 -- 172.21.15.157:0/3191397569 wait complete. 2024-04-03T08:46:04.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 -- 172.21.15.157:0/240339948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 msgr2=0x7f79f00fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 --2- 172.21.15.157:0/240339948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f00fe460 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79dc004940 tx=0x7f79dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:04.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 -- 172.21.15.157:0/240339948 shutdown_connections 2024-04-03T08:46:04.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 --2- 172.21.15.157:0/240339948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f00fe460 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 --2- 172.21.15.157:0/240339948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79f00fce80 0x7f79f00fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 -- 172.21.15.157:0/240339948 >> 172.21.15.157:0/240339948 conn(0x7f79f00f8560 msgr2=0x7f79f00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:04.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 -- 172.21.15.157:0/240339948 shutdown_connections 2024-04-03T08:46:04.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.922+0000 7f79f5000700 1 -- 172.21.15.157:0/240339948 wait complete. 2024-04-03T08:46:04.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.923+0000 7f79f5000700 1 Processor -- start 2024-04-03T08:46:04.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.923+0000 7f79f5000700 1 -- start start 2024-04-03T08:46:04.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79f5000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79f00fce80 0x7f79f0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79f5000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79f5000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00708c0 con 0x7f79f00fdff0 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79f5000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0070a30 con 0x7f79f00fce80 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79ed400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79ed400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f0070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48956/0 (socket says 172.21.15.157:48956) 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.924+0000 7f79ed400700 1 -- 172.21.15.157:0/572096132 learned_addr learned my addr 172.21.15.157:0/572096132 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79ede00700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79f00fce80 0x7f79f0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79ed400700 1 -- 172.21.15.157:0/572096132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79f00fce80 msgr2=0x7f79f0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79ed400700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79f00fce80 0x7f79f0071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79ed400700 1 -- 172.21.15.157:0/572096132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc005040 con 0x7f79f00fdff0 2024-04-03T08:46:04.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79ed400700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f0070310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b3b0 tx=0x7f79dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:04.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79dc00e040 con 0x7f79f00fdff0 2024-04-03T08:46:04.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79dc004290 con 0x7f79f00fdff0 2024-04-03T08:46:04.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f0070cb0 con 0x7f79f00fdff0 2024-04-03T08:46:04.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79dc01c630 con 0x7f79f00fdff0 2024-04-03T08:46:04.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.925+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f0115a40 con 0x7f79f00fdff0 2024-04-03T08:46:04.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.926+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f005f5f0 con 0x7f79f00fdff0 2024-04-03T08:46:04.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.927+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f79dc00bbf0 con 0x7f79f00fdff0 2024-04-03T08:46:04.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.929+0000 7f79e6000700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f79d406d7f0 0x7f79d406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:04.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.929+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f79dc08e470 con 0x7f79f00fdff0 2024-04-03T08:46:04.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.929+0000 7f79ede00700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f79d406d7f0 0x7f79d406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:04.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.929+0000 7f79ede00700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f79d406d7f0 0x7f79d406fca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79f0071bd0 tx=0x7f79e000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:04.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:04.933+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f79dc057bd0 con 0x7f79f00fdff0 2024-04-03T08:46:05.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.215+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f79f0115c00 con 0x7f79f00fdff0 2024-04-03T08:46:05.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.215+0000 7f79e6000700 1 -- 172.21.15.157:0/572096132 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+264 (secure 0 0 0) 0x7f79dc05b290 con 0x7f79f00fdff0 2024-04-03T08:46:05.216 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_WARN Degraded data redundancy: 725/222 objects degraded (326.577%), 1 pg degraded 2024-04-03T08:46:05.216 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 725/222 objects degraded (326.577%), 1 pg degraded 2024-04-03T08:46:05.216 INFO:teuthology.orchestra.run.smithi157.stdout: pg 3.1c is active+recovery_wait+undersized+degraded+remapped, acting [5,4] 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.217+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f79d406d7f0 msgr2=0x7f79d406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.217+0000 7f79f5000700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f79d406d7f0 0x7f79d406fca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79f0071bd0 tx=0x7f79e000b040 comp rx=0 tx=0).stop 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.217+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 msgr2=0x7f79f0070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.217+0000 7f79f5000700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f0070310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b3b0 tx=0x7f79dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 shutdown_connections 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f79d406d7f0 0x7f79d406fca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79f00fce80 0x7f79f0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 --2- 172.21.15.157:0/572096132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79f00fdff0 0x7f79f0070310 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 >> 172.21.15.157:0/572096132 conn(0x7f79f00f8560 msgr2=0x7f79f00f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 shutdown_connections 2024-04-03T08:46:05.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:05.218+0000 7f79f5000700 1 -- 172.21.15.157:0/572096132 wait complete. 2024-04-03T08:46:05.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:04 smithi157 ceph-mon[117693]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:05.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:04 smithi157 ceph-mon[117693]: osdmap e80: 6 total, 6 up, 6 in 2024-04-03T08:46:05.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:04 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1828083892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:05.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:04 smithi157 ceph-mon[117693]: pgmap v133: 65 pgs: 61 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 1 remapped+peering; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 725/222 objects degraded (326.577%); 0 B/s, 22 objects/s recovering 2024-04-03T08:46:05.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:04 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2272451620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:46:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:04 smithi181 ceph-mon[101094]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:04 smithi181 ceph-mon[101094]: osdmap e80: 6 total, 6 up, 6 in 2024-04-03T08:46:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:04 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1828083892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:04 smithi181 ceph-mon[101094]: pgmap v133: 65 pgs: 61 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 1 remapped+peering; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 725/222 objects degraded (326.577%); 0 B/s, 22 objects/s recovering 2024-04-03T08:46:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:04 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2272451620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:46:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:05 smithi157 ceph-mon[117693]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:05 smithi157 ceph-mon[117693]: osdmap e81: 6 total, 6 up, 6 in 2024-04-03T08:46:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:05 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/572096132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:46:06.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:05 smithi181 ceph-mon[101094]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:06.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:05 smithi181 ceph-mon[101094]: osdmap e81: 6 total, 6 up, 6 in 2024-04-03T08:46:06.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:05 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/572096132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:46:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:06 smithi157 ceph-mon[117693]: osdmap e82: 6 total, 6 up, 6 in 2024-04-03T08:46:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:06 smithi157 ceph-mon[117693]: pgmap v136: 65 pgs: 1 peering, 63 active+clean, 1 active+recovering+undersized+remapped; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 0 B/s, 365 objects/s recovering 2024-04-03T08:46:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:06 smithi181 ceph-mon[101094]: osdmap e82: 6 total, 6 up, 6 in 2024-04-03T08:46:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:06 smithi181 ceph-mon[101094]: pgmap v136: 65 pgs: 1 peering, 63 active+clean, 1 active+recovering+undersized+remapped; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 0 B/s, 365 objects/s recovering 2024-04-03T08:46:08.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:07 smithi157 ceph-mon[117693]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 725/222 objects degraded (326.577%), 1 pg degraded) 2024-04-03T08:46:08.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:07 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:46:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:07 smithi181 ceph-mon[101094]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 725/222 objects degraded (326.577%), 1 pg degraded) 2024-04-03T08:46:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:07 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:46:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:08 smithi157 ceph-mon[117693]: pgmap v137: 65 pgs: 1 peering, 64 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 957 B/s rd, 1 op/s; 0 B/s, 381 objects/s recovering 2024-04-03T08:46:09.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:08 smithi181 ceph-mon[101094]: pgmap v137: 65 pgs: 1 peering, 64 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 957 B/s rd, 1 op/s; 0 B/s, 381 objects/s recovering 2024-04-03T08:46:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:11 smithi157 ceph-mon[117693]: pgmap v138: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 807 B/s rd, 1 op/s; 0 B/s, 321 objects/s recovering 2024-04-03T08:46:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:11 smithi181 ceph-mon[101094]: pgmap v138: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 807 B/s rd, 1 op/s; 0 B/s, 321 objects/s recovering 2024-04-03T08:46:13.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:13 smithi157 ceph-mon[117693]: pgmap v139: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 254 objects/s recovering 2024-04-03T08:46:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:13 smithi181 ceph-mon[101094]: pgmap v139: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 254 objects/s recovering 2024-04-03T08:46:14.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:46:14.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:14.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:46:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:15.513 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:15 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:46:15.514 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:15 smithi181 ceph-mon[101094]: Upgrade: osd.4 is safe to restart 2024-04-03T08:46:15.514 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:15 smithi181 ceph-mon[101094]: pgmap v140: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 139 objects/s recovering 2024-04-03T08:46:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:15 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-03T08:46:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:15 smithi157 ceph-mon[117693]: Upgrade: osd.4 is safe to restart 2024-04-03T08:46:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:15 smithi157 ceph-mon[117693]: pgmap v140: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 139 objects/s recovering 2024-04-03T08:46:17.178 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:16 smithi181 ceph-mon[101094]: Upgrade: Updating osd.4 2024-04-03T08:46:17.178 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:17.179 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-03T08:46:17.179 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:46:17.179 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:16 smithi181 ceph-mon[101094]: Deploying daemon osd.4 on smithi181 2024-04-03T08:46:17.179 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:16 smithi181 ceph-mon[101094]: pgmap v141: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 990 B/s rd, 1 op/s; 0 B/s, 55 objects/s recovering 2024-04-03T08:46:17.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:16 smithi157 ceph-mon[117693]: Upgrade: Updating osd.4 2024-04-03T08:46:17.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:17.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-03T08:46:17.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:46:17.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:16 smithi157 ceph-mon[117693]: Deploying daemon osd.4 on smithi181 2024-04-03T08:46:17.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:16 smithi157 ceph-mon[117693]: pgmap v141: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 990 B/s rd, 1 op/s; 0 B/s, 55 objects/s recovering 2024-04-03T08:46:19.478 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:19 smithi181 ceph-mon[101094]: pgmap v142: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 48 objects/s recovering 2024-04-03T08:46:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:19 smithi157 ceph-mon[117693]: pgmap v142: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 48 objects/s recovering 2024-04-03T08:46:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:20.597 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:20 smithi181 systemd[1]: Stopping Ceph osd.4 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:46:21.097 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:20 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[58475]: 2024-04-03T08:46:20.628+0000 7f873e200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:46:21.097 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:20 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[58475]: 2024-04-03T08:46:20.628+0000 7f873e200700 -1 osd.4 82 *** Got signal Terminated *** 2024-04-03T08:46:21.097 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:20 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[58475]: 2024-04-03T08:46:20.628+0000 7f873e200700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T08:46:21.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:21 smithi157 ceph-mon[117693]: pgmap v143: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:46:21.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:21 smithi157 ceph-mon[117693]: osd.4 marked itself down and dead 2024-04-03T08:46:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:21 smithi181 ceph-mon[101094]: pgmap v143: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:46:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:21 smithi181 ceph-mon[101094]: osd.4 marked itself down and dead 2024-04-03T08:46:22.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:22 smithi157 ceph-mon[117693]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:46:22.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:22 smithi157 ceph-mon[117693]: osdmap e83: 6 total, 5 up, 6 in 2024-04-03T08:46:22.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:22 smithi157 ceph-mon[117693]: osdmap e84: 6 total, 5 up, 6 in 2024-04-03T08:46:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:22 smithi181 ceph-mon[101094]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:46:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:22 smithi181 ceph-mon[101094]: osdmap e83: 6 total, 5 up, 6 in 2024-04-03T08:46:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:22 smithi181 ceph-mon[101094]: osdmap e84: 6 total, 5 up, 6 in 2024-04-03T08:46:22.598 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:22 smithi181 bash[119132]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4 2024-04-03T08:46:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:23 smithi157 ceph-mon[117693]: pgmap v145: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 1 op/s 2024-04-03T08:46:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:23 smithi157 ceph-mon[117693]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-03T08:46:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:23 smithi181 ceph-mon[101094]: pgmap v145: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 1 op/s 2024-04-03T08:46:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:23 smithi181 ceph-mon[101094]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-03T08:46:24.704 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:24 smithi181 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.4.service: Succeeded. 2024-04-03T08:46:24.704 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:24 smithi181 systemd[1]: Stopped Ceph osd.4 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:46:25.097 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:24 smithi181 systemd[1]: Starting Ceph osd.4 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:46:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:25 smithi157 ceph-mon[117693]: pgmap v147: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-04-03T08:46:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:25 smithi181 ceph-mon[101094]: pgmap v147: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-04-03T08:46:26.343 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-03T08:46:26.343 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-03T08:46:26.343 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-03T08:46:26.343 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-03T08:46:26.344 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-03T08:46:26.344 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-03T08:46:26.344 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:26 smithi181 bash[119412]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-03T08:46:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:26 smithi181 ceph-mon[101094]: Health check failed: Degraded data redundancy: 20/222 objects degraded (9.009%), 10 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:26.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:26 smithi157 ceph-mon[117693]: Health check failed: Degraded data redundancy: 20/222 objects degraded (9.009%), 10 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:27 smithi181 ceph-mon[101094]: pgmap v148: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 10 peering, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 20/222 objects degraded (9.009%) 2024-04-03T08:46:27.597 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:27 smithi181 ceph-osd[119706]: -- 172.21.15.181:0/2949862446 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574f3bb1680 con 0x5574f3b7ac00 2024-04-03T08:46:27.597 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:27 smithi181 bash[119668]: 75ed7a1f274dd2b52a3b2578d5a4cb7fad6e056c8798031604fccc7c67875b7c 2024-04-03T08:46:27.597 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:27 smithi181 systemd[1]: Started Ceph osd.4 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:46:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:27 smithi157 ceph-mon[117693]: pgmap v148: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 10 peering, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 20/222 objects degraded (9.009%) 2024-04-03T08:46:28.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:27 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T08:46:27.956+0000 7f674a57b7c0 -1 Falling back to public interface 2024-04-03T08:46:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:28.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:46:28.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:28 smithi157 ceph-mon[117693]: pgmap v149: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:46:28.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:28 smithi181 ceph-mon[101094]: pgmap v149: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:29 smithi157 ceph-mon[117693]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-03T08:46:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:29 smithi181 ceph-mon[101094]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-03T08:46:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:29.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:30.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:30 smithi181 ceph-mon[101094]: pgmap v150: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 459 B/s rd, 0 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:31.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:30 smithi157 ceph-mon[117693]: pgmap v150: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 459 B/s rd, 0 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:32.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:32.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:33.472 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:33 smithi181 ceph-mon[101094]: pgmap v151: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:33.472 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:33.472 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:33 smithi157 ceph-mon[117693]: pgmap v151: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:33.847 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:33 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T08:46:33.480+0000 7f674a57b7c0 -1 osd.4 82 log_to_monitors true 2024-04-03T08:46:34.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 08:46:34 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T08:46:34.242+0000 7f6739a00700 -1 osd.4 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:46:34.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:34 smithi181 ceph-mon[101094]: from='osd.4 [v2:172.21.15.181:6808/1351197277,v1:172.21.15.181:6809/1351197277]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:46:34.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:34 smithi181 ceph-mon[101094]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:46:34.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:34 smithi181 ceph-mon[101094]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 15 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:34.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:34 smithi157 ceph-mon[117693]: from='osd.4 [v2:172.21.15.181:6808/1351197277,v1:172.21.15.181:6809/1351197277]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:46:34.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:34 smithi157 ceph-mon[117693]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-03T08:46:34.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:34 smithi157 ceph-mon[117693]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 15 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 -- 172.21.15.157:0/3154589570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fcc10 msgr2=0x7f07280fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 --2- 172.21.15.157:0/3154589570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fcc10 0x7f07280fd020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f071c004940 tx=0x7f071c009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 -- 172.21.15.157:0/3154589570 shutdown_connections 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 --2- 172.21.15.157:0/3154589570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fdec0 0x7f07280fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 --2- 172.21.15.157:0/3154589570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fcc10 0x7f07280fd020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 -- 172.21.15.157:0/3154589570 >> 172.21.15.157:0/3154589570 conn(0x7f07280f83d0 msgr2=0x7f07280fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 -- 172.21.15.157:0/3154589570 shutdown_connections 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.373+0000 7f072de00700 1 -- 172.21.15.157:0/3154589570 wait complete. 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.374+0000 7f072de00700 1 Processor -- start 2024-04-03T08:46:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.374+0000 7f072de00700 1 -- start start 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.374+0000 7f072de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fcc10 0x7f072810f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.374+0000 7f072de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 0x7f072810ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f072de00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728110520 con 0x7f07280fdec0 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f072de00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728110d70 con 0x7f07280fcc10 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f0727e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 0x7f072810ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f0727e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 0x7f072810ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33072/0 (socket says 172.21.15.157:33072) 2024-04-03T08:46:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f0727e00700 1 -- 172.21.15.157:0/1883102874 learned_addr learned my addr 172.21.15.157:0/1883102874 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f072ca00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fcc10 0x7f072810f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f072ca00700 1 -- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 msgr2=0x7f072810ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f072ca00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 0x7f072810ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f072ca00700 1 -- 172.21.15.157:0/1883102874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c005040 con 0x7f07280fcc10 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.375+0000 7f0727e00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 0x7f072810ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.376+0000 7f072ca00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fcc10 0x7f072810f9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f071c009fd0 tx=0x7f071c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.376+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c021070 con 0x7f07280fcc10 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.376+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f071c01c400 con 0x7f07280fcc10 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.376+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0728110ff0 con 0x7f07280fcc10 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.376+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c00e070 con 0x7f07280fcc10 2024-04-03T08:46:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.376+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0728111530 con 0x7f07280fcc10 2024-04-03T08:46:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.377+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0728101850 con 0x7f07280fcc10 2024-04-03T08:46:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.378+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f071c01ca20 con 0x7f07280fcc10 2024-04-03T08:46:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.379+0000 7f0724c00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f071006d7f0 0x7f071006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.379+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f071c08e0d0 con 0x7f07280fcc10 2024-04-03T08:46:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.379+0000 7f0727e00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f071006d7f0 0x7f071006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.380+0000 7f0727e00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f071006d7f0 0x7f071006fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07140041d0 tx=0x7f071400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:35.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.384+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f071c05b2e0 con 0x7f07280fcc10 2024-04-03T08:46:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:35 smithi157 ceph-mon[117693]: pgmap v152: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 858 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:35 smithi157 ceph-mon[117693]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-03T08:46:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:35 smithi157 ceph-mon[117693]: osdmap e85: 6 total, 5 up, 6 in 2024-04-03T08:46:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:35 smithi157 ceph-mon[117693]: from='osd.4 [v2:172.21.15.181:6808/1351197277,v1:172.21.15.181:6809/1351197277]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:46:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:35 smithi157 ceph-mon[117693]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:46:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:35 smithi181 ceph-mon[101094]: pgmap v152: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 858 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-04-03T08:46:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:35 smithi181 ceph-mon[101094]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-03T08:46:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:35 smithi181 ceph-mon[101094]: osdmap e85: 6 total, 5 up, 6 in 2024-04-03T08:46:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:35 smithi181 ceph-mon[101094]: from='osd.4 [v2:172.21.15.181:6808/1351197277,v1:172.21.15.181:6809/1351197277]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:46:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:35 smithi181 ceph-mon[101094]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:46:35.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.609+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0728105870 con 0x7f071006d7f0 2024-04-03T08:46:35.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.610+0000 7f0724c00700 1 -- 172.21.15.157:0/1883102874 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0728105870 con 0x7f071006d7f0 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f071006d7f0 msgr2=0x7f071006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f071006d7f0 0x7f071006fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07140041d0 tx=0x7f071400b040 comp rx=0 tx=0).stop 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fcc10 msgr2=0x7f072810f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fcc10 0x7f072810f9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f071c009fd0 tx=0x7f071c009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 shutdown_connections 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f071006d7f0 0x7f071006fca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07280fcc10 0x7f072810f9e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 --2- 172.21.15.157:0/1883102874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07280fdec0 0x7f072810ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 >> 172.21.15.157:0/1883102874 conn(0x7f07280f83d0 msgr2=0x7f07280f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 shutdown_connections 2024-04-03T08:46:35.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.613+0000 7f072de00700 1 -- 172.21.15.157:0/1883102874 wait complete. 2024-04-03T08:46:35.628 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:46:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 -- 172.21.15.157:0/2105388158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fe0d0 msgr2=0x7f32940fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 --2- 172.21.15.157:0/2105388158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fe0d0 0x7f32940fe540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3280004940 tx=0x7f3280009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 -- 172.21.15.157:0/2105388158 shutdown_connections 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 --2- 172.21.15.157:0/2105388158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fe0d0 0x7f32940fe540 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 --2- 172.21.15.157:0/2105388158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32940fcee0 0x7f32940fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 -- 172.21.15.157:0/2105388158 >> 172.21.15.157:0/2105388158 conn(0x7f32940f8560 msgr2=0x7f32940fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 -- 172.21.15.157:0/2105388158 shutdown_connections 2024-04-03T08:46:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.747+0000 7f329be00700 1 -- 172.21.15.157:0/2105388158 wait complete. 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f329be00700 1 Processor -- start 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f329be00700 1 -- start start 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f329be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 0x7f329410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f329be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32940fe0d0 0x7f329410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f329be00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329410e550 con 0x7f32940fcee0 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f329be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329410ed50 con 0x7f32940fe0d0 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f3299400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 0x7f329410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f3299400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 0x7f329410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33100/0 (socket says 172.21.15.157:33100) 2024-04-03T08:46:35.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f3299400700 1 -- 172.21.15.157:0/2441941655 learned_addr learned my addr 172.21.15.157:0/2441941655 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.748+0000 7f3298a00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32940fe0d0 0x7f329410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3299400700 1 -- 172.21.15.157:0/2441941655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32940fe0d0 msgr2=0x7f329410df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3299400700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32940fe0d0 0x7f329410df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3299400700 1 -- 172.21.15.157:0/2441941655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280005040 con 0x7f32940fcee0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3299400700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 0x7f329410da10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f328800eb70 tx=0x7f328800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3288007cc0 con 0x7f32940fcee0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f328800f040 con 0x7f32940fcee0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329410efd0 con 0x7f32940fcee0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328800cb20 con 0x7f32940fcee0 2024-04-03T08:46:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.749+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329410f510 con 0x7f32940fcee0 2024-04-03T08:46:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.750+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329405f5f0 con 0x7f32940fcee0 2024-04-03T08:46:35.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.751+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f328800cc80 con 0x7f32940fcee0 2024-04-03T08:46:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.752+0000 7f3291600700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f327c06d7f0 0x7f327c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.752+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f328808ca50 con 0x7f32940fcee0 2024-04-03T08:46:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.753+0000 7f3298a00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f327c06d7f0 0x7f327c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:35.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.753+0000 7f3298a00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f327c06d7f0 0x7f327c06fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f328000b0d0 tx=0x7f3280009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:35.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.757+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3288059d10 con 0x7f32940fcee0 2024-04-03T08:46:35.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.983+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f329410f7f0 con 0x7f327c06d7f0 2024-04-03T08:46:35.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.985+0000 7f3291600700 1 -- 172.21.15.157:0/2441941655 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f329410f7f0 con 0x7f327c06d7f0 2024-04-03T08:46:35.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f327c06d7f0 msgr2=0x7f327c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f327c06d7f0 0x7f327c06fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f328000b0d0 tx=0x7f3280009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:35.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 msgr2=0x7f329410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:35.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 0x7f329410da10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f328800eb70 tx=0x7f328800b040 comp rx=0 tx=0).stop 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 shutdown_connections 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f327c06d7f0 0x7f327c06fca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32940fcee0 0x7f329410da10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 --2- 172.21.15.157:0/2441941655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32940fe0d0 0x7f329410df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.987+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 >> 172.21.15.157:0/2441941655 conn(0x7f32940f8560 msgr2=0x7f32940f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.988+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 shutdown_connections 2024-04-03T08:46:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:35.988+0000 7f329be00700 1 -- 172.21.15.157:0/2441941655 wait complete. 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 -- 172.21.15.157:0/417085853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 msgr2=0x7f006c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 --2- 172.21.15.157:0/417085853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c0fe540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0058004940 tx=0x7f0058009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 -- 172.21.15.157:0/417085853 shutdown_connections 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 --2- 172.21.15.157:0/417085853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c0fe540 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 --2- 172.21.15.157:0/417085853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f006c0fcee0 0x7f006c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 -- 172.21.15.157:0/417085853 >> 172.21.15.157:0/417085853 conn(0x7f006c0f8560 msgr2=0x7f006c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 -- 172.21.15.157:0/417085853 shutdown_connections 2024-04-03T08:46:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.120+0000 7f0072400700 1 -- 172.21.15.157:0/417085853 wait complete. 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f0072400700 1 Processor -- start 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f0072400700 1 -- start start 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f0072400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f006c0fcee0 0x7f006c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f0072400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f0072400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c10e550 con 0x7f006c0fe0d0 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f0072400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c10ed50 con 0x7f006c0fcee0 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f006aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f006aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c10df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33120/0 (socket says 172.21.15.157:33120) 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f006aa00700 1 -- 172.21.15.157:0/3400432864 learned_addr learned my addr 172.21.15.157:0/3400432864 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:36.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.121+0000 7f006b400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f006c0fcee0 0x7f006c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f006aa00700 1 -- 172.21.15.157:0/3400432864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f006c0fcee0 msgr2=0x7f006c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f006aa00700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f006c0fcee0 0x7f006c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f006aa00700 1 -- 172.21.15.157:0/3400432864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058005040 con 0x7f006c0fe0d0 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f006aa00700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c10df50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0058013870 tx=0x7f0058009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f005800e070 con 0x7f006c0fe0d0 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0058009430 con 0x7f006c0fe0d0 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c10efd0 con 0x7f006c0fe0d0 2024-04-03T08:46:36.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f005801cea0 con 0x7f006c0fe0d0 2024-04-03T08:46:36.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.122+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c10f4b0 con 0x7f006c0fe0d0 2024-04-03T08:46:36.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.123+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c05f5f0 con 0x7f006c0fe0d0 2024-04-03T08:46:36.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.124+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f005801c690 con 0x7f006c0fe0d0 2024-04-03T08:46:36.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.125+0000 7f0063400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f005006d7f0 0x7f005006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.125+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f005808e740 con 0x7f006c0fe0d0 2024-04-03T08:46:36.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.126+0000 7f006b400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f005006d7f0 0x7f005006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.126+0000 7f006b400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f005006d7f0 0x7f005006fca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f005c009b80 tx=0x7f005c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:36.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.130+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f005805b9d0 con 0x7f006c0fe0d0 2024-04-03T08:46:36.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.367+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f006c10f790 con 0x7f005006d7f0 2024-04-03T08:46:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.378+0000 7f0063400700 1 -- 172.21.15.157:0/3400432864 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f006c10f790 con 0x7f005006d7f0 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (6m) 80s ago 16m 13.8M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (2m) 80s ago 17m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (2m) 5s ago 15m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (5m) 80s ago 16m 75.2M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (10m) 80s ago 10m 14.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (10m) 80s ago 10m 135M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (10m) 5s ago 10m 14.3M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (10m) 5s ago 10m 99.6M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (4m) 80s ago 18m 500M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (4m) 5s ago 15m 450M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (4m) 80s ago 18m 44.4M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:46:36.379 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (3m) 5s ago 15m 34.0M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (6m) 80s ago 16m 7516k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (5m) 5s ago 15m 7558k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (2m) 80s ago 14m 92.5M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (113s) 80s ago 14m 97.7M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (87s) 80s ago 13m 11.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (47s) 5s ago 13m 136M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (9s) 5s ago 12m 11.0M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (12m) 5s ago 12m 254M 2642M 17.2.7-805-g6fda41ff a49113eacc58 d457d5bfaa56 2024-04-03T08:46:36.380 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (4m) 80s ago 16m 48.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:46:36.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.380+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f005006d7f0 msgr2=0x7f005006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.380+0000 7f0072400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f005006d7f0 0x7f005006fca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f005c009b80 tx=0x7f005c00b040 comp rx=0 tx=0).stop 2024-04-03T08:46:36.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.380+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 msgr2=0x7f006c10df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.380+0000 7f0072400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c10df50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0058013870 tx=0x7f0058009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 shutdown_connections 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f005006d7f0 0x7f005006fca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f006c0fcee0 0x7f006c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 --2- 172.21.15.157:0/3400432864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f006c0fe0d0 0x7f006c10df50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 >> 172.21.15.157:0/3400432864 conn(0x7f006c0f8560 msgr2=0x7f006c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 shutdown_connections 2024-04-03T08:46:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.381+0000 7f0072400700 1 -- 172.21.15.157:0/3400432864 wait complete. 2024-04-03T08:46:36.497 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:36 smithi181 ceph-mon[101094]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:46:36.498 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:36 smithi181 ceph-mon[101094]: osd.4 [v2:172.21.15.181:6808/1351197277,v1:172.21.15.181:6809/1351197277] boot 2024-04-03T08:46:36.498 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:36 smithi181 ceph-mon[101094]: osdmap e86: 6 total, 6 up, 6 in 2024-04-03T08:46:36.498 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:46:36.498 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:36 smithi181 ceph-mon[101094]: osdmap e87: 6 total, 6 up, 6 in 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 -- 172.21.15.157:0/3692320715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 msgr2=0x7fd7400fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 --2- 172.21.15.157:0/3692320715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd7400fd310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd730004940 tx=0x7fd730009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 -- 172.21.15.157:0/3692320715 shutdown_connections 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 --2- 172.21.15.157:0/3692320715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7400fe0d0 0x7fd7400fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 --2- 172.21.15.157:0/3692320715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd7400fd310 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 -- 172.21.15.157:0/3692320715 >> 172.21.15.157:0/3692320715 conn(0x7fd7400f8560 msgr2=0x7fd7400fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 -- 172.21.15.157:0/3692320715 shutdown_connections 2024-04-03T08:46:36.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.515+0000 7fd745000700 1 -- 172.21.15.157:0/3692320715 wait complete. 2024-04-03T08:46:36.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd745000700 1 Processor -- start 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd745000700 1 -- start start 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd745000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd74010fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd745000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7400fe0d0 0x7fd740110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd745000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740110880 con 0x7fd7400fcee0 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd745000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740110fc0 con 0x7fd7400fe0d0 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd73de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd74010fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd73de00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd74010fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33130/0 (socket says 172.21.15.157:33130) 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.516+0000 7fd73de00700 1 -- 172.21.15.157:0/3944579908 learned_addr learned my addr 172.21.15.157:0/3944579908 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd73d400700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7400fe0d0 0x7fd740110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd73de00700 1 -- 172.21.15.157:0/3944579908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7400fe0d0 msgr2=0x7fd740110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd73de00700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7400fe0d0 0x7fd740110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd73de00700 1 -- 172.21.15.157:0/3944579908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd730005040 con 0x7fd7400fcee0 2024-04-03T08:46:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd73de00700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd74010fd40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c00 tx=0x7fd730009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:36.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73000e040 con 0x7fd7400fcee0 2024-04-03T08:46:36.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd73000bbf0 con 0x7fd7400fcee0 2024-04-03T08:46:36.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd740111240 con 0x7fd7400fcee0 2024-04-03T08:46:36.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.517+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73001c630 con 0x7fd7400fcee0 2024-04-03T08:46:36.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.518+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd740111800 con 0x7fd7400fcee0 2024-04-03T08:46:36.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.519+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740101a60 con 0x7fd7400fcee0 2024-04-03T08:46:36.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.520+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd73000bd60 con 0x7fd7400fcee0 2024-04-03T08:46:36.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.520+0000 7fd736000700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd72406d7e0 0x7fd72406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.521+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fd73008e270 con 0x7fd7400fcee0 2024-04-03T08:46:36.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.521+0000 7fd73d400700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd72406d7e0 0x7fd72406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.521+0000 7fd73d400700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd72406d7e0 0x7fd72406fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd72c004f60 tx=0x7fd72c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:36.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.525+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd73005b580 con 0x7fd7400fcee0 2024-04-03T08:46:36.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:36 smithi157 ceph-mon[117693]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:46:36.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:36 smithi157 ceph-mon[117693]: osd.4 [v2:172.21.15.181:6808/1351197277,v1:172.21.15.181:6809/1351197277] boot 2024-04-03T08:46:36.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:36 smithi157 ceph-mon[117693]: osdmap e86: 6 total, 6 up, 6 in 2024-04-03T08:46:36.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-03T08:46:36.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:36 smithi157 ceph-mon[117693]: osdmap e87: 6 total, 6 up, 6 in 2024-04-03T08:46:36.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.812+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7401113d0 con 0x7fd7400fcee0 2024-04-03T08:46:36.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.813+0000 7fd736000700 1 -- 172.21.15.157:0/3944579908 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fd7401113d0 con 0x7fd7400fcee0 2024-04-03T08:46:36.813 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:46:36.814 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:46:36.815 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 5, 2024-04-03T08:46:36.815 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-04-03T08:46:36.815 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:46:36.815 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd72406d7e0 msgr2=0x7fd72406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd72406d7e0 0x7fd72406fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd72c004f60 tx=0x7fd72c00b040 comp rx=0 tx=0).stop 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 msgr2=0x7fd74010fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd74010fd40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c00 tx=0x7fd730009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 shutdown_connections 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd72406d7e0 0x7fd72406fc90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7400fcee0 0x7fd74010fd40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 --2- 172.21.15.157:0/3944579908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7400fe0d0 0x7fd740110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 >> 172.21.15.157:0/3944579908 conn(0x7fd7400f8560 msgr2=0x7fd7400f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 shutdown_connections 2024-04-03T08:46:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.815+0000 7fd745000700 1 -- 172.21.15.157:0/3944579908 wait complete. 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 -- 172.21.15.157:0/67398786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fcee0 msgr2=0x7fa0b80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 --2- 172.21.15.157:0/67398786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fcee0 0x7fa0b80fd310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac004940 tx=0x7fa0ac009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 -- 172.21.15.157:0/67398786 shutdown_connections 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 --2- 172.21.15.157:0/67398786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 --2- 172.21.15.157:0/67398786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fcee0 0x7fa0b80fd310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 -- 172.21.15.157:0/67398786 >> 172.21.15.157:0/67398786 conn(0x7fa0b80f8560 msgr2=0x7fa0b80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 -- 172.21.15.157:0/67398786 shutdown_connections 2024-04-03T08:46:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.949+0000 7fa0bf400700 1 -- 172.21.15.157:0/67398786 wait complete. 2024-04-03T08:46:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.950+0000 7fa0bf400700 1 Processor -- start 2024-04-03T08:46:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.950+0000 7fa0bf400700 1 -- start start 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0bf400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b80fcee0 0x7fa0b810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0bf400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b8110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0bf400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8110860 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0bf400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8110fa0 con 0x7fa0b80fcee0 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0b7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b8110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0b7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b8110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33146/0 (socket says 172.21.15.157:33146) 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0b7e00700 1 -- 172.21.15.157:0/1788015469 learned_addr learned my addr 172.21.15.157:0/1788015469 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0bca00700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b80fcee0 0x7fa0b810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0b7e00700 1 -- 172.21.15.157:0/1788015469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b80fcee0 msgr2=0x7fa0b810fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0b7e00700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b80fcee0 0x7fa0b810fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.951+0000 7fa0b7e00700 1 -- 172.21.15.157:0/1788015469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac005040 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.952+0000 7fa0b7e00700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b8110260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4002a50 tx=0x7fa0a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.952+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0a4007cc0 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.952+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0a400f040 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.952+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0a400da30 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.952+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b8111280 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.952+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b8111840 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.953+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b8101a60 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.954+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa0a400db90 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.955+0000 7fa0b4c00700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa0a006d8c0 0x7fa0a006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.955+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fa0a408ccc0 con 0x7fa0b80fe0d0 2024-04-03T08:46:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.956+0000 7fa0bca00700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa0a006d8c0 0x7fa0a006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:36.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.956+0000 7fa0bca00700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa0a006d8c0 0x7fa0a006fd70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00b3b0 tx=0x7fa0ac009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:36.960+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa0a4059f50 con 0x7fa0b80fe0d0 2024-04-03T08:46:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.208+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0b805f5f0 con 0x7fa0b80fe0d0 2024-04-03T08:46:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.208+0000 7fa0b4c00700 1 -- 172.21.15.157:0/1788015469 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7fa0a4059ae0 con 0x7fa0b80fe0d0 2024-04-03T08:46:37.209 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:46:37.209 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:46:37.209 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:46:37.210 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:46:37.211 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:46:37.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:46:37.213 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:37.213 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:46:37.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa0a006d8c0 msgr2=0x7fa0a006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa0a006d8c0 0x7fa0a006fd70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00b3b0 tx=0x7fa0ac009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:37.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 msgr2=0x7fa0b8110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b8110260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4002a50 tx=0x7fa0a40046b0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 shutdown_connections 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa0a006d8c0 0x7fa0a006fd70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b80fcee0 0x7fa0b810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 --2- 172.21.15.157:0/1788015469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b80fe0d0 0x7fa0b8110260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 >> 172.21.15.157:0/1788015469 conn(0x7fa0b80f8560 msgr2=0x7fa0b80f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 shutdown_connections 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.211+0000 7fa0bf400700 1 -- 172.21.15.157:0/1788015469 wait complete. 2024-04-03T08:46:37.214 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.353+0000 7f9defe00700 1 -- 172.21.15.157:0/1011809537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fe0d0 msgr2=0x7f9de80fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.353+0000 7f9defe00700 1 --2- 172.21.15.157:0/1011809537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fe0d0 0x7f9de80fe540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4004940 tx=0x7f9dd4009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.353+0000 7f9defe00700 1 -- 172.21.15.157:0/1011809537 shutdown_connections 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.354+0000 7f9defe00700 1 --2- 172.21.15.157:0/1011809537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fe0d0 0x7f9de80fe540 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.354+0000 7f9defe00700 1 --2- 172.21.15.157:0/1011809537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fcee0 0x7f9de80fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.354+0000 7f9defe00700 1 -- 172.21.15.157:0/1011809537 >> 172.21.15.157:0/1011809537 conn(0x7f9de80f8560 msgr2=0x7f9de80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.354+0000 7f9defe00700 1 -- 172.21.15.157:0/1011809537 shutdown_connections 2024-04-03T08:46:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.354+0000 7f9defe00700 1 -- 172.21.15.157:0/1011809537 wait complete. 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.354+0000 7f9defe00700 1 Processor -- start 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9defe00700 1 -- start start 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9defe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 0x7f9de810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9defe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fe0d0 0x7f9de810df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9defe00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de810e550 con 0x7f9de80fcee0 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9defe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de810ed50 con 0x7f9de80fe0d0 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9ded400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 0x7f9de810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9ded400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 0x7f9de810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33158/0 (socket says 172.21.15.157:33158) 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9ded400700 1 -- 172.21.15.157:0/4113838098 learned_addr learned my addr 172.21.15.157:0/4113838098 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.355+0000 7f9deca00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fe0d0 0x7f9de810df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9ded400700 1 -- 172.21.15.157:0/4113838098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fe0d0 msgr2=0x7f9de810df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9ded400700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fe0d0 0x7f9de810df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9ded400700 1 -- 172.21.15.157:0/4113838098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4005040 con 0x7f9de80fcee0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9deca00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fe0d0 0x7f9de810df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9ded400700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 0x7f9de810da10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00eb70 tx=0x7f9ddc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ddc007cc0 con 0x7f9de80fcee0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ddc00f040 con 0x7f9de80fcee0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de810efd0 con 0x7f9de80fcee0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ddc00cb20 con 0x7f9de80fcee0 2024-04-03T08:46:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.356+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de810f510 con 0x7f9de80fcee0 2024-04-03T08:46:37.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.357+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de805f5f0 con 0x7f9de80fcee0 2024-04-03T08:46:37.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.359+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9ddc00cc80 con 0x7f9de80fcee0 2024-04-03T08:46:37.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.360+0000 7f9de5600700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9dd006d7f0 0x7f9dd006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:37.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.360+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f9ddc08c970 con 0x7f9de80fcee0 2024-04-03T08:46:37.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.360+0000 7f9deca00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9dd006d7f0 0x7f9dd006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:37.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.361+0000 7f9deca00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9dd006d7f0 0x7f9dd006fca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b0d0 tx=0x7f9dd4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:37.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.365+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ddc059cb0 con 0x7f9de80fcee0 2024-04-03T08:46:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='client.44267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: pgmap v155: 65 pgs: 8 peering, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-03T08:46:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3944579908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:46:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:46:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:37 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1788015469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:46:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.592+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9de810f840 con 0x7f9dd006d7f0 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.593+0000 7f9de5600700 1 -- 172.21.15.157:0/4113838098 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9de810f840 con 0x7f9dd006d7f0 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:46:37.594 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:46:37.595 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:46:37.595 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:46:37.595 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "11/21 daemons upgraded", 2024-04-03T08:46:37.595 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading osd daemons", 2024-04-03T08:46:37.595 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:46:37.595 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:46:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.595+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9dd006d7f0 msgr2=0x7f9dd006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.595+0000 7f9defe00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9dd006d7f0 0x7f9dd006fca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b0d0 tx=0x7f9dd4009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.595+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 msgr2=0x7f9de810da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.595+0000 7f9defe00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 0x7f9de810da10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00eb70 tx=0x7f9ddc00b040 comp rx=0 tx=0).stop 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 shutdown_connections 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9dd006d7f0 0x7f9dd006fca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de80fcee0 0x7f9de810da10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 --2- 172.21.15.157:0/4113838098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9de80fe0d0 0x7f9de810df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 >> 172.21.15.157:0/4113838098 conn(0x7f9de80f8560 msgr2=0x7f9de80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 shutdown_connections 2024-04-03T08:46:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.596+0000 7f9defe00700 1 -- 172.21.15.157:0/4113838098 wait complete. 2024-04-03T08:46:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='client.44267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: pgmap v155: 65 pgs: 8 peering, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3944579908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:37.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:37 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1788015469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 -- 172.21.15.157:0/2766459464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fcee0 msgr2=0x7f603c0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 --2- 172.21.15.157:0/2766459464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fcee0 0x7f603c0fd310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f602c004940 tx=0x7f602c009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 -- 172.21.15.157:0/2766459464 shutdown_connections 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 --2- 172.21.15.157:0/2766459464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f603c0fe0d0 0x7f603c0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 --2- 172.21.15.157:0/2766459464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fcee0 0x7f603c0fd310 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 -- 172.21.15.157:0/2766459464 >> 172.21.15.157:0/2766459464 conn(0x7f603c0f8560 msgr2=0x7f603c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:37.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 -- 172.21.15.157:0/2766459464 shutdown_connections 2024-04-03T08:46:37.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.729+0000 7f6041a00700 1 -- 172.21.15.157:0/2766459464 wait complete. 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.730+0000 7f6041a00700 1 Processor -- start 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.730+0000 7f6041a00700 1 -- start start 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.730+0000 7f6041a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f603c0fcee0 0x7f603c10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.730+0000 7f6041a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 0x7f603c110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.730+0000 7f6041a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c110860 con 0x7f603c0fe0d0 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.730+0000 7f6041a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c110fa0 con 0x7f603c0fcee0 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 0x7f603c110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 0x7f603c110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33178/0 (socket says 172.21.15.157:33178) 2024-04-03T08:46:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603aa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f603c0fcee0 0x7f603c10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:37.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 -- 172.21.15.157:0/742989979 learned_addr learned my addr 172.21.15.157:0/742989979 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:46:37.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 -- 172.21.15.157:0/742989979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f603c0fcee0 msgr2=0x7f603c10fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:37.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f603c0fcee0 0x7f603c10fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:37.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 -- 172.21.15.157:0/742989979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c005040 con 0x7f603c0fe0d0 2024-04-03T08:46:37.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.731+0000 7f603a000700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 0x7f603c110260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6028002a50 tx=0x7f60280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.732+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6028007cc0 con 0x7f603c0fe0d0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.732+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f602800f040 con 0x7f603c0fe0d0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.732+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c111280 con 0x7f603c0fe0d0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.732+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602800da30 con 0x7f603c0fe0d0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.732+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c111840 con 0x7f603c0fe0d0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.733+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c101a60 con 0x7f603c0fe0d0 2024-04-03T08:46:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.734+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f602800db90 con 0x7f603c0fe0d0 2024-04-03T08:46:37.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.735+0000 7f6032a00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f602006d7f0 0x7f602006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:46:37.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.735+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f602808cd30 con 0x7f603c0fe0d0 2024-04-03T08:46:37.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.735+0000 7f603aa00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f602006d7f0 0x7f602006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:46:37.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.735+0000 7f603aa00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f602006d7f0 0x7f602006fca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b3b0 tx=0x7f602c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:46:37.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:37.739+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6028059fe0 con 0x7f603c0fe0d0 2024-04-03T08:46:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.023+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f603c05f5f0 con 0x7f603c0fe0d0 2024-04-03T08:46:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.023+0000 7f6032a00700 1 -- 172.21.15.157:0/742989979 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+797 (secure 0 0 0) 0x7f6028059b70 con 0x7f603c0fe0d0 2024-04-03T08:46:38.024 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_WARN Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-03T08:46:38.025 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f602006d7f0 msgr2=0x7f602006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f602006d7f0 0x7f602006fca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b3b0 tx=0x7f602c009e30 comp rx=0 tx=0).stop 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 msgr2=0x7f603c110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 0x7f603c110260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6028002a50 tx=0x7f60280046b0 comp rx=0 tx=0).stop 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 shutdown_connections 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f602006d7f0 0x7f602006fca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f603c0fcee0 0x7f603c10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 --2- 172.21.15.157:0/742989979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0fe0d0 0x7f603c110260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 >> 172.21.15.157:0/742989979 conn(0x7f603c0f8560 msgr2=0x7f603c0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 shutdown_connections 2024-04-03T08:46:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:46:38.026+0000 7f6041a00700 1 -- 172.21.15.157:0/742989979 wait complete. 2024-04-03T08:46:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:46:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:38.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:38 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/742989979' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:46:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:46:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:46:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:38.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:38 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/742989979' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:46:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:39 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:39 smithi157 ceph-mon[117693]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-03T08:46:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:39 smithi157 ceph-mon[117693]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:39 smithi157 ceph-mon[117693]: pgmap v157: 65 pgs: 8 peering, 9 active+undersized, 6 active+undersized+degraded, 42 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 14/222 objects degraded (6.306%) 2024-04-03T08:46:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:39 smithi157 ceph-mon[117693]: Health check update: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:39 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:39 smithi181 ceph-mon[101094]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-03T08:46:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:39 smithi181 ceph-mon[101094]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:46:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:39 smithi181 ceph-mon[101094]: pgmap v157: 65 pgs: 8 peering, 9 active+undersized, 6 active+undersized+degraded, 42 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 14/222 objects degraded (6.306%) 2024-04-03T08:46:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:39 smithi181 ceph-mon[101094]: Health check update: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded (PG_DEGRADED) 2024-04-03T08:46:40.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:40 smithi157 ceph-mon[117693]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded) 2024-04-03T08:46:40.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:40 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:46:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:40 smithi181 ceph-mon[101094]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded) 2024-04-03T08:46:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:40 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:46:41.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:41 smithi157 ceph-mon[117693]: pgmap v158: 65 pgs: 8 peering, 57 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2024-04-03T08:46:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:41 smithi181 ceph-mon[101094]: pgmap v158: 65 pgs: 8 peering, 57 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2024-04-03T08:46:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:43 smithi157 ceph-mon[117693]: pgmap v159: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-03T08:46:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:43 smithi181 ceph-mon[101094]: pgmap v159: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-03T08:46:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:45 smithi157 ceph-mon[117693]: pgmap v160: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 913 B/s rd, 1 op/s 2024-04-03T08:46:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:45 smithi181 ceph-mon[101094]: pgmap v160: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 913 B/s rd, 1 op/s 2024-04-03T08:46:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:47 smithi157 ceph-mon[117693]: pgmap v161: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-03T08:46:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:47 smithi181 ceph-mon[101094]: pgmap v161: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-03T08:46:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:49 smithi157 ceph-mon[117693]: pgmap v162: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-03T08:46:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:49 smithi181 ceph-mon[101094]: pgmap v162: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-03T08:46:50.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:50.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:51 smithi157 ceph-mon[117693]: pgmap v163: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:46:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:51 smithi181 ceph-mon[101094]: pgmap v163: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:46:53.525 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:53 smithi181 ceph-mon[101094]: pgmap v164: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:46:53.525 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:53 smithi157 ceph-mon[117693]: pgmap v164: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:46:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:54.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:54 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:54 smithi157 ceph-mon[117693]: Upgrade: osd.5 is safe to restart 2024-04-03T08:46:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:54 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-03T08:46:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:54 smithi181 ceph-mon[101094]: Upgrade: osd.5 is safe to restart 2024-04-03T08:46:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:46:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:55 smithi157 ceph-mon[117693]: pgmap v165: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:46:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:55 smithi157 ceph-mon[117693]: Upgrade: Updating osd.5 2024-04-03T08:46:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-03T08:46:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:46:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:55 smithi157 ceph-mon[117693]: Deploying daemon osd.5 on smithi181 2024-04-03T08:46:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:55 smithi181 ceph-mon[101094]: pgmap v165: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:46:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:55 smithi181 ceph-mon[101094]: Upgrade: Updating osd.5 2024-04-03T08:46:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-03T08:46:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:46:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:55 smithi181 ceph-mon[101094]: Deploying daemon osd.5 on smithi181 2024-04-03T08:46:57.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:57 smithi157 ceph-mon[117693]: pgmap v166: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:46:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:57 smithi181 ceph-mon[101094]: pgmap v166: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:46:58.347 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:46:58 smithi181 systemd[1]: Stopping Ceph osd.5 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:46:58.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:46:58 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[67256]: 2024-04-03T08:46:58.479+0000 7f7728800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T08:46:58.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:46:58 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[67256]: 2024-04-03T08:46:58.479+0000 7f7728800700 -1 osd.5 87 *** Got signal Terminated *** 2024-04-03T08:46:58.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:46:58 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[67256]: 2024-04-03T08:46:58.479+0000 7f7728800700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T08:46:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:59 smithi157 ceph-mon[117693]: pgmap v167: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:46:59.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:59 smithi157 ceph-mon[117693]: osd.5 marked itself down and dead 2024-04-03T08:46:59.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:46:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:46:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:59 smithi181 ceph-mon[101094]: pgmap v167: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:46:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:59 smithi181 ceph-mon[101094]: osd.5 marked itself down and dead 2024-04-03T08:46:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:46:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:00.347 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:00 smithi181 bash[125735]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5 2024-04-03T08:47:00.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:00 smithi181 ceph-mon[101094]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:47:00.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:00 smithi181 ceph-mon[101094]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-03T08:47:00.348 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:00 smithi181 ceph-mon[101094]: osdmap e88: 6 total, 5 up, 6 in 2024-04-03T08:47:00.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:00 smithi157 ceph-mon[117693]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-03T08:47:00.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:00 smithi157 ceph-mon[117693]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-03T08:47:00.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:00 smithi157 ceph-mon[117693]: osdmap e88: 6 total, 5 up, 6 in 2024-04-03T08:47:01.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:01 smithi181 ceph-mon[101094]: pgmap v169: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-03T08:47:01.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:01 smithi181 ceph-mon[101094]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-03T08:47:01.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:01 smithi181 ceph-mon[101094]: osdmap e89: 6 total, 5 up, 6 in 2024-04-03T08:47:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:01 smithi157 ceph-mon[117693]: pgmap v169: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-03T08:47:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:01 smithi157 ceph-mon[117693]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-03T08:47:01.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:01 smithi157 ceph-mon[117693]: osdmap e89: 6 total, 5 up, 6 in 2024-04-03T08:47:02.493 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:02 smithi181 ceph-mon[101094]: Health check failed: Degraded data redundancy: 25/222 objects degraded (11.261%), 8 pgs degraded (PG_DEGRADED) 2024-04-03T08:47:02.494 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:02 smithi181 systemd[1]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.5.service: Succeeded. 2024-04-03T08:47:02.494 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:02 smithi181 systemd[1]: Stopped Ceph osd.5 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:47:02.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:02 smithi157 ceph-mon[117693]: Health check failed: Degraded data redundancy: 25/222 objects degraded (11.261%), 8 pgs degraded (PG_DEGRADED) 2024-04-03T08:47:02.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:02 smithi181 systemd[1]: Starting Ceph osd.5 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T08:47:03.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:03 smithi157 ceph-mon[117693]: pgmap v171: 65 pgs: 7 active+undersized, 8 active+undersized+degraded, 6 peering, 4 stale+active+clean, 40 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 25/222 objects degraded (11.261%) 2024-04-03T08:47:03.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:03 smithi181 ceph-mon[101094]: pgmap v171: 65 pgs: 7 active+undersized, 8 active+undersized+degraded, 6 peering, 4 stale+active+clean, 40 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 25/222 objects degraded (11.261%) 2024-04-03T08:47:04.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-03T08:47:04.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-03T08:47:04.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-03T08:47:04.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-03T08:47:04.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-03T08:47:04.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-03T08:47:04.098 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:03 smithi181 bash[126002]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-03T08:47:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:05 smithi181 ceph-mon[101094]: pgmap v172: 65 pgs: 7 active+undersized, 8 active+undersized+degraded, 6 peering, 4 stale+active+clean, 40 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 25/222 objects degraded (11.261%) 2024-04-03T08:47:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:05.597 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:05 smithi181 ceph-osd[126312]: -- 172.21.15.181:0/3856914683 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56120fa71680 con 0x56120fa3b000 2024-04-03T08:47:05.598 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:05 smithi181 bash[126274]: b8c3bb5b1d3295fbd3bde0a11f569f73dd04041a0241d529b3bb1c77a7170ec6 2024-04-03T08:47:05.598 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:05 smithi181 systemd[1]: Started Ceph osd.5 for af80a140-f193-11ee-b648-cb9ed24678a4. 2024-04-03T08:47:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:05 smithi157 ceph-mon[117693]: pgmap v172: 65 pgs: 7 active+undersized, 8 active+undersized+degraded, 6 peering, 4 stale+active+clean, 40 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 25/222 objects degraded (11.261%) 2024-04-03T08:47:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:06.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:05 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T08:47:05.687+0000 7fb7c57fc7c0 -1 Falling back to public interface 2024-04-03T08:47:06.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:06 smithi157 ceph-mon[117693]: pgmap v173: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:06.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:06 smithi157 ceph-mon[117693]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-03T08:47:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:06 smithi181 ceph-mon[101094]: pgmap v173: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:06 smithi181 ceph-mon[101094]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-03T08:47:08.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.173+0000 7f2f1e000700 1 -- 172.21.15.157:0/1600382217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 msgr2=0x7f2f180fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.173+0000 7f2f1e000700 1 --2- 172.21.15.157:0/1600382217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f180fe540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f04004940 tx=0x7f2f04009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 -- 172.21.15.157:0/1600382217 shutdown_connections 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 --2- 172.21.15.157:0/1600382217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f180fe540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 --2- 172.21.15.157:0/1600382217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 0x7f2f180fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 -- 172.21.15.157:0/1600382217 >> 172.21.15.157:0/1600382217 conn(0x7f2f180f8560 msgr2=0x7f2f180fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 -- 172.21.15.157:0/1600382217 shutdown_connections 2024-04-03T08:47:08.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 -- 172.21.15.157:0/1600382217 wait complete. 2024-04-03T08:47:08.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.174+0000 7f2f1e000700 1 Processor -- start 2024-04-03T08:47:08.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f1e000700 1 -- start start 2024-04-03T08:47:08.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f1e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 0x7f2f1810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f1e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f18110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f1e000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18110700 con 0x7f2f180fe0d0 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f1e000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18110f50 con 0x7f2f180fcee0 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f17400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 0x7f2f1810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f16a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f18110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f17400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 0x7f2f1810fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:43400/0 (socket says 172.21.15.157:43400) 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.175+0000 7f2f17400700 1 -- 172.21.15.157:0/3006107827 learned_addr learned my addr 172.21.15.157:0/3006107827 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f16a00700 1 -- 172.21.15.157:0/3006107827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 msgr2=0x7f2f1810fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f16a00700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 0x7f2f1810fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f16a00700 1 -- 172.21.15.157:0/3006107827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04005040 con 0x7f2f180fe0d0 2024-04-03T08:47:08.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f16a00700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f18110100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009fd0 tx=0x7f2f04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:08.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0400e070 con 0x7f2f180fe0d0 2024-04-03T08:47:08.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f0401c400 con 0x7f2f180fe0d0 2024-04-03T08:47:08.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0400b650 con 0x7f2f180fe0d0 2024-04-03T08:47:08.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.176+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f181111d0 con 0x7f2f180fe0d0 2024-04-03T08:47:08.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.177+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181116b0 con 0x7f2f180fe0d0 2024-04-03T08:47:08.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.178+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f18101a60 con 0x7f2f180fe0d0 2024-04-03T08:47:08.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.179+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2f0401ca90 con 0x7f2f180fe0d0 2024-04-03T08:47:08.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.180+0000 7f2f0f400700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2efc06d7f0 0x7f2efc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.180+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f2f0408e510 con 0x7f2f180fe0d0 2024-04-03T08:47:08.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.180+0000 7f2f17400700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2efc06d7f0 0x7f2efc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.181+0000 7f2f17400700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2efc06d7f0 0x7f2efc06fca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f08004ba0 tx=0x7f2f0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:08.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.185+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2f0405b8e0 con 0x7f2f180fe0d0 2024-04-03T08:47:08.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.416+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f18105b50 con 0x7f2efc06d7f0 2024-04-03T08:47:08.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.418+0000 7f2f0f400700 1 -- 172.21.15.157:0/3006107827 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2f18105b50 con 0x7f2efc06d7f0 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2efc06d7f0 msgr2=0x7f2efc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2efc06d7f0 0x7f2efc06fca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f08004ba0 tx=0x7f2f0800b040 comp rx=0 tx=0).stop 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 msgr2=0x7f2f18110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f18110100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009fd0 tx=0x7f2f04009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 shutdown_connections 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2efc06d7f0 0x7f2efc06fca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f180fcee0 0x7f2f1810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 --2- 172.21.15.157:0/3006107827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f180fe0d0 0x7f2f18110100 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 >> 172.21.15.157:0/3006107827 conn(0x7f2f180f8560 msgr2=0x7f2f180f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:08.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 shutdown_connections 2024-04-03T08:47:08.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.420+0000 7f2f1e000700 1 -- 172.21.15.157:0/3006107827 wait complete. 2024-04-03T08:47:08.436 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:47:08.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 -- 172.21.15.157:0/3416787935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fcee0 msgr2=0x7f0f940fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 --2- 172.21.15.157:0/3416787935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fcee0 0x7f0f940fd310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0f88004940 tx=0x7f0f88009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:08.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 -- 172.21.15.157:0/3416787935 shutdown_connections 2024-04-03T08:47:08.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 --2- 172.21.15.157:0/3416787935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f940fe0d0 0x7f0f940fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 --2- 172.21.15.157:0/3416787935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fcee0 0x7f0f940fd310 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 -- 172.21.15.157:0/3416787935 >> 172.21.15.157:0/3416787935 conn(0x7f0f940f8560 msgr2=0x7f0f940fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:08.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 -- 172.21.15.157:0/3416787935 shutdown_connections 2024-04-03T08:47:08.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.555+0000 7f0f9c600700 1 -- 172.21.15.157:0/3416787935 wait complete. 2024-04-03T08:47:08.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.556+0000 7f0f9c600700 1 Processor -- start 2024-04-03T08:47:08.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.556+0000 7f0f9c600700 1 -- start start 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.556+0000 7f0f9c600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f940fcee0 0x7f0f9410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f9c600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 0x7f0f9410df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f9c600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9410e510 con 0x7f0f940fe0d0 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f9c600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9410ed60 con 0x7f0f940fcee0 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 0x7f0f9410df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 0x7f0f9410df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33494/0 (socket says 172.21.15.157:33494) 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 -- 172.21.15.157:0/2909579860 learned_addr learned my addr 172.21.15.157:0/2909579860 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99c00700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f940fcee0 0x7f0f9410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 -- 172.21.15.157:0/2909579860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f940fcee0 msgr2=0x7f0f9410d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f940fcee0 0x7f0f9410d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 -- 172.21.15.157:0/2909579860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88005040 con 0x7f0f940fe0d0 2024-04-03T08:47:08.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.557+0000 7f0f99200700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 0x7f0f9410df10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000eb40 tx=0x7f0f8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:08.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.558+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f80007cc0 con 0x7f0f940fe0d0 2024-04-03T08:47:08.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.558+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f8000f040 con 0x7f0f940fe0d0 2024-04-03T08:47:08.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.558+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9410efe0 con 0x7f0f940fe0d0 2024-04-03T08:47:08.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.558+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f8000ca10 con 0x7f0f940fe0d0 2024-04-03T08:47:08.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.558+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9410f520 con 0x7f0f940fe0d0 2024-04-03T08:47:08.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.559+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9405f5f0 con 0x7f0f940fe0d0 2024-04-03T08:47:08.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.560+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0f8000cb70 con 0x7f0f940fe0d0 2024-04-03T08:47:08.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.561+0000 7f0f91600700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0f7c06d7f0 0x7f0f7c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.561+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f0f8008cb20 con 0x7f0f940fe0d0 2024-04-03T08:47:08.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.561+0000 7f0f99c00700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0f7c06d7f0 0x7f0f7c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.562+0000 7f0f99c00700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0f7c06d7f0 0x7f0f7c06fca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f88013870 tx=0x7f0f88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:08.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.565+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f80059e60 con 0x7f0f940fe0d0 2024-04-03T08:47:08.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.789+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f9410f8f0 con 0x7f0f7c06d7f0 2024-04-03T08:47:08.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.791+0000 7f0f91600700 1 -- 172.21.15.157:0/2909579860 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0f9410f8f0 con 0x7f0f7c06d7f0 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0f7c06d7f0 msgr2=0x7f0f7c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0f7c06d7f0 0x7f0f7c06fca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f88013870 tx=0x7f0f88009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 msgr2=0x7f0f9410df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 0x7f0f9410df10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000eb40 tx=0x7f0f8000b040 comp rx=0 tx=0).stop 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 shutdown_connections 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f0f7c06d7f0 0x7f0f7c06fca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f940fcee0 0x7f0f9410d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 --2- 172.21.15.157:0/2909579860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f940fe0d0 0x7f0f9410df10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 >> 172.21.15.157:0/2909579860 conn(0x7f0f940f8560 msgr2=0x7f0f940f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:08.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 shutdown_connections 2024-04-03T08:47:08.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.793+0000 7f0f9c600700 1 -- 172.21.15.157:0/2909579860 wait complete. 2024-04-03T08:47:08.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 -- 172.21.15.157:0/1630005233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fe0d0 msgr2=0x7f1eb80fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/1630005233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fe0d0 0x7f1eb80fe540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4004940 tx=0x7f1ea4009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 -- 172.21.15.157:0/1630005233 shutdown_connections 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/1630005233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fe0d0 0x7f1eb80fe540 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/1630005233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb80fcee0 0x7f1eb80fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 -- 172.21.15.157:0/1630005233 >> 172.21.15.157:0/1630005233 conn(0x7f1eb80f8560 msgr2=0x7f1eb80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 -- 172.21.15.157:0/1630005233 shutdown_connections 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.928+0000 7f1ebfa00700 1 -- 172.21.15.157:0/1630005233 wait complete. 2024-04-03T08:47:08.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.929+0000 7f1ebfa00700 1 Processor -- start 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.929+0000 7f1ebfa00700 1 -- start start 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.929+0000 7f1ebfa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 0x7f1eb810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.929+0000 7f1ebfa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb80fe0d0 0x7f1eb810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebfa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb810e600 con 0x7f1eb80fcee0 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebfa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb810ede0 con 0x7f1eb80fe0d0 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebd000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 0x7f1eb810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebd000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 0x7f1eb810dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33512/0 (socket says 172.21.15.157:33512) 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebd000700 1 -- 172.21.15.157:0/2085889419 learned_addr learned my addr 172.21.15.157:0/2085889419 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1eb7e00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb80fe0d0 0x7f1eb810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebd000700 1 -- 172.21.15.157:0/2085889419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb80fe0d0 msgr2=0x7f1eb810e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebd000700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb80fe0d0 0x7f1eb810e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.930+0000 7f1ebd000700 1 -- 172.21.15.157:0/2085889419 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4005040 con 0x7f1eb80fcee0 2024-04-03T08:47:08.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.931+0000 7f1ebd000700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 0x7f1eb810dac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c8e0 tx=0x7f1eac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:08.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.931+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac00a760 con 0x7f1eb80fcee0 2024-04-03T08:47:08.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.931+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1eac00ad90 con 0x7f1eb80fcee0 2024-04-03T08:47:08.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.931+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb810f0c0 con 0x7f1eb80fcee0 2024-04-03T08:47:08.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.931+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac0113a0 con 0x7f1eb80fcee0 2024-04-03T08:47:08.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.931+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb810f600 con 0x7f1eb80fcee0 2024-04-03T08:47:08.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.932+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb805f5f0 con 0x7f1eb80fcee0 2024-04-03T08:47:08.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.933+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1eac012400 con 0x7f1eb80fcee0 2024-04-03T08:47:08.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.934+0000 7f1eb4c00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1ea006d7f0 0x7f1ea006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:08.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.934+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f1eac08cea0 con 0x7f1eb80fcee0 2024-04-03T08:47:08.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.934+0000 7f1eb7e00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1ea006d7f0 0x7f1ea006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:08.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.935+0000 7f1eb7e00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1ea006d7f0 0x7f1ea006fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009fd0 tx=0x7f1ea4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:08.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:08.939+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1eac05a270 con 0x7f1eb80fcee0 2024-04-03T08:47:09.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.156+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eb810f970 con 0x7f1ea006d7f0 2024-04-03T08:47:09.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.166+0000 7f1eb4c00700 1 -- 172.21.15.157:0/2085889419 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1eb810f970 con 0x7f1ea006d7f0 2024-04-03T08:47:09.168 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:47:09.168 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (7m) 113s ago 17m 13.8M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:47:09.168 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (3m) 113s ago 17m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:47:09.168 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (3m) 0s ago 16m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:47:09.168 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (6m) 113s ago 17m 75.2M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (11m) 113s ago 11m 14.0M - 17.2.7-805-g6fda41ff a49113eacc58 1644d0f11f2c 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (11m) 113s ago 11m 135M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (11m) 0s ago 11m 14.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (11m) 0s ago 11m 99.6M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (5m) 113s ago 18m 500M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (4m) 0s ago 16m 451M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (4m) 113s ago 19m 44.4M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (4m) 0s ago 16m 35.2M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (7m) 113s ago 17m 7516k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (5m) 0s ago 16m 7574k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (2m) 113s ago 15m 92.5M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (2m) 113s ago 14m 97.7M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (2m) 113s ago 14m 11.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:47:09.169 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (80s) 0s ago 13m 136M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:47:09.170 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (42s) 0s ago 13m 94.4M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:47:09.170 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (4s) 0s ago 12m 11.0M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:47:09.170 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (4m) 113s ago 16m 48.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1ea006d7f0 msgr2=0x7f1ea006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1ea006d7f0 0x7f1ea006fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009fd0 tx=0x7f1ea4009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 msgr2=0x7f1eb810dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 0x7f1eb810dac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c8e0 tx=0x7f1eac0044c0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 shutdown_connections 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1ea006d7f0 0x7f1ea006fca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eb80fcee0 0x7f1eb810dac0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 --2- 172.21.15.157:0/2085889419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb80fe0d0 0x7f1eb810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 >> 172.21.15.157:0/2085889419 conn(0x7f1eb80f8560 msgr2=0x7f1eb80f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 shutdown_connections 2024-04-03T08:47:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.169+0000 7f1ebfa00700 1 -- 172.21.15.157:0/2085889419 wait complete. 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 -- 172.21.15.157:0/453496201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 msgr2=0x7f3c380fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 --2- 172.21.15.157:0/453496201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c380fe330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c24004940 tx=0x7f3c24009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 -- 172.21.15.157:0/453496201 shutdown_connections 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 --2- 172.21.15.157:0/453496201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c380fe330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 --2- 172.21.15.157:0/453496201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c380fcc10 0x7f3c380fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 -- 172.21.15.157:0/453496201 >> 172.21.15.157:0/453496201 conn(0x7f3c380f83d0 msgr2=0x7f3c380fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 -- 172.21.15.157:0/453496201 shutdown_connections 2024-04-03T08:47:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.303+0000 7f3c3d000700 1 -- 172.21.15.157:0/453496201 wait complete. 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.304+0000 7f3c3d000700 1 Processor -- start 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.304+0000 7f3c3d000700 1 -- start start 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.304+0000 7f3c3d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c380fcc10 0x7f3c3810fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.304+0000 7f3c3d000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c3810ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.304+0000 7f3c3d000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38110580 con 0x7f3c380fdec0 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.304+0000 7f3c3d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38110dd0 con 0x7f3c380fcc10 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c3810ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c3810ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33520/0 (socket says 172.21.15.157:33520) 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 -- 172.21.15.157:0/2807557667 learned_addr learned my addr 172.21.15.157:0/2807557667 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c37400700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c380fcc10 0x7f3c3810fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:09.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 -- 172.21.15.157:0/2807557667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c380fcc10 msgr2=0x7f3c3810fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c380fcc10 0x7f3c3810fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 -- 172.21.15.157:0/2807557667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24005040 con 0x7f3c380fdec0 2024-04-03T08:47:09.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c36a00700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c3810ff80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400b3b0 tx=0x7f3c24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:09.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2400e040 con 0x7f3c380fdec0 2024-04-03T08:47:09.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c24004290 con 0x7f3c380fdec0 2024-04-03T08:47:09.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2401c3f0 con 0x7f3c380fdec0 2024-04-03T08:47:09.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.305+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c38111050 con 0x7f3c380fdec0 2024-04-03T08:47:09.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.306+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c38111540 con 0x7f3c380fdec0 2024-04-03T08:47:09.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.307+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c38101850 con 0x7f3c380fdec0 2024-04-03T08:47:09.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.307+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3c2400bbf0 con 0x7f3c380fdec0 2024-04-03T08:47:09.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.308+0000 7f3c2f400700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3c1c06d7f0 0x7f3c1c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:09.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.308+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f3c2408e2b0 con 0x7f3c380fdec0 2024-04-03T08:47:09.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.309+0000 7f3c37400700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3c1c06d7f0 0x7f3c1c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.309+0000 7f3c37400700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3c1c06d7f0 0x7f3c1c06fca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c28004f40 tx=0x7f3c2800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:09.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.313+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3c2405b5e0 con 0x7f3c380fdec0 2024-04-03T08:47:09.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:09 smithi157 ceph-mon[117693]: pgmap v174: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 230 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:09.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:09 smithi157 ceph-mon[117693]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded (PG_DEGRADED) 2024-04-03T08:47:09.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:09.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:09.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:09 smithi181 ceph-mon[101094]: pgmap v174: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 230 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:09.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:09 smithi181 ceph-mon[101094]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded (PG_DEGRADED) 2024-04-03T08:47:09.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:09.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:09.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.599+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c3805f5f0 con 0x7f3c380fdec0 2024-04-03T08:47:09.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.600+0000 7f3c2f400700 1 -- 172.21.15.157:0/2807557667 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f3c2405b170 con 0x7f3c380fdec0 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-04-03T08:47:09.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 4, 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:47:09.603 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:47:09.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3c1c06d7f0 msgr2=0x7f3c1c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3c1c06d7f0 0x7f3c1c06fca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c28004f40 tx=0x7f3c2800b040 comp rx=0 tx=0).stop 2024-04-03T08:47:09.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 msgr2=0x7f3c3810ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c3810ff80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400b3b0 tx=0x7f3c24009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:09.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 shutdown_connections 2024-04-03T08:47:09.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3c1c06d7f0 0x7f3c1c06fca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c380fcc10 0x7f3c3810fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 --2- 172.21.15.157:0/2807557667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c380fdec0 0x7f3c3810ff80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 >> 172.21.15.157:0/2807557667 conn(0x7f3c380f83d0 msgr2=0x7f3c380f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:09.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.602+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 shutdown_connections 2024-04-03T08:47:09.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.603+0000 7f3c3d000700 1 -- 172.21.15.157:0/2807557667 wait complete. 2024-04-03T08:47:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 -- 172.21.15.157:0/3915789606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 msgr2=0x7f5968102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 --2- 172.21.15.157:0/3915789606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968102320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5954004940 tx=0x7f5954009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 -- 172.21.15.157:0/3915789606 shutdown_connections 2024-04-03T08:47:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 --2- 172.21.15.157:0/3915789606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968102320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 --2- 172.21.15.157:0/3915789606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59680662e0 0x7f59680ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 -- 172.21.15.157:0/3915789606 >> 172.21.15.157:0/3915789606 conn(0x7f59680f7430 msgr2=0x7f59680f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:09.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 -- 172.21.15.157:0/3915789606 shutdown_connections 2024-04-03T08:47:09.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.737+0000 7f596e000700 1 -- 172.21.15.157:0/3915789606 wait complete. 2024-04-03T08:47:09.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f596e000700 1 Processor -- start 2024-04-03T08:47:09.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f596e000700 1 -- start start 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f596e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59680662e0 0x7f596810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f596e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f596e000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968110850 con 0x7f59680fff00 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f596e000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968110f90 con 0x7f59680662e0 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f5966a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.738+0000 7f5966a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33538/0 (socket says 172.21.15.157:33538) 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f5966a00700 1 -- 172.21.15.157:0/3617217194 learned_addr learned my addr 172.21.15.157:0/3617217194 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f5967400700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59680662e0 0x7f596810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f5966a00700 1 -- 172.21.15.157:0/3617217194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59680662e0 msgr2=0x7f596810fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f5966a00700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59680662e0 0x7f596810fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f5966a00700 1 -- 172.21.15.157:0/3617217194 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954005040 con 0x7f59680fff00 2024-04-03T08:47:09.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f5966a00700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968110250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f595400b3b0 tx=0x7f5954009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f595400e040 con 0x7f59680fff00 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5954004290 con 0x7f59680fff00 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5968111210 con 0x7f59680fff00 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.739+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f595401c3f0 con 0x7f59680fff00 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.740+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59681117d0 con 0x7f59680fff00 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.741+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59680f8fb0 con 0x7f59680fff00 2024-04-03T08:47:09.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.742+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f595400bbf0 con 0x7f59680fff00 2024-04-03T08:47:09.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.743+0000 7f595f400700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f594c06d7f0 0x7f594c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.743+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f595408e2a0 con 0x7f59680fff00 2024-04-03T08:47:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.743+0000 7f5967400700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f594c06d7f0 0x7f594c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.744+0000 7f5967400700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f594c06d7f0 0x7f594c06fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5958007fd0 tx=0x7f5958009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:09.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.747+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f595405b5d0 con 0x7f59680fff00 2024-04-03T08:47:09.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.997+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f596805f5f0 con 0x7f59680fff00 2024-04-03T08:47:09.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:09.997+0000 7f595f400700 1 -- 172.21.15.157:0/3617217194 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f595405b160 con 0x7f59680fff00 2024-04-03T08:47:09.999 INFO:teuthology.orchestra.run.smithi157.stdout:e17 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 17 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:36:11.675475+0000 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:47:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 47 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:47:10.001 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{0:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.181:6826/3566324146,v1:172.21.15.181:6827/3566324146] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:10.002 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:24327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/4237807179,v1:172.21.15.157:6827/4237807179] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:10.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f594c06d7f0 msgr2=0x7f594c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f594c06d7f0 0x7f594c06fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5958007fd0 tx=0x7f5958009040 comp rx=0 tx=0).stop 2024-04-03T08:47:10.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 msgr2=0x7f5968110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968110250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f595400b3b0 tx=0x7f5954009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:10.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 shutdown_connections 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f594c06d7f0 0x7f594c06fca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59680662e0 0x7f596810fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 --2- 172.21.15.157:0/3617217194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59680fff00 0x7f5968110250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 >> 172.21.15.157:0/3617217194 conn(0x7f59680f7430 msgr2=0x7f59680fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 shutdown_connections 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.000+0000 7f596e000700 1 -- 172.21.15.157:0/3617217194 wait complete. 2024-04-03T08:47:10.004 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 -- 172.21.15.157:0/3274044408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fcee0 msgr2=0x7f2b600fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 --2- 172.21.15.157:0/3274044408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fcee0 0x7f2b600fd310 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b50004940 tx=0x7f2b50009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 -- 172.21.15.157:0/3274044408 shutdown_connections 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 --2- 172.21.15.157:0/3274044408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fe0d0 0x7f2b600fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 --2- 172.21.15.157:0/3274044408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fcee0 0x7f2b600fd310 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 -- 172.21.15.157:0/3274044408 >> 172.21.15.157:0/3274044408 conn(0x7f2b600f8560 msgr2=0x7f2b600fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:10.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 -- 172.21.15.157:0/3274044408 shutdown_connections 2024-04-03T08:47:10.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.134+0000 7f2b65c00700 1 -- 172.21.15.157:0/3274044408 wait complete. 2024-04-03T08:47:10.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.135+0000 7f2b65c00700 1 Processor -- start 2024-04-03T08:47:10.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.135+0000 7f2b65c00700 1 -- start start 2024-04-03T08:47:10.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.135+0000 7f2b65c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fcee0 0x7f2b6010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:10.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.135+0000 7f2b65c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 0x7f2b60110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.135+0000 7f2b65c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60110860 con 0x7f2b600fe0d0 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.135+0000 7f2b65c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60110fa0 con 0x7f2b600fcee0 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b57e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 0x7f2b60110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b5ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fcee0 0x7f2b6010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b5ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fcee0 0x7f2b6010fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:43466/0 (socket says 172.21.15.157:43466) 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b57e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 0x7f2b60110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33546/0 (socket says 172.21.15.157:33546) 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b5ea00700 1 -- 172.21.15.157:0/1118561661 learned_addr learned my addr 172.21.15.157:0/1118561661 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b57e00700 1 -- 172.21.15.157:0/1118561661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fcee0 msgr2=0x7f2b6010fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b57e00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fcee0 0x7f2b6010fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b57e00700 1 -- 172.21.15.157:0/1118561661 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50005040 con 0x7f2b600fe0d0 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b57e00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 0x7f2b60110260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b48002820 tx=0x7f2b48004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:10.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.136+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b48007cc0 con 0x7f2b600fe0d0 2024-04-03T08:47:10.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.137+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b4800f040 con 0x7f2b600fe0d0 2024-04-03T08:47:10.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.137+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b48013920 con 0x7f2b600fe0d0 2024-04-03T08:47:10.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.137+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b60111280 con 0x7f2b600fe0d0 2024-04-03T08:47:10.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.137+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b60111840 con 0x7f2b600fe0d0 2024-04-03T08:47:10.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.138+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b60101a60 con 0x7f2b600fe0d0 2024-04-03T08:47:10.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.139+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2b4801c400 con 0x7f2b600fe0d0 2024-04-03T08:47:10.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.139+0000 7f2b56a00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2b4406d7f0 0x7f2b4406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:10.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.140+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f2b4808cc00 con 0x7f2b600fe0d0 2024-04-03T08:47:10.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.140+0000 7f2b5ea00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2b4406d7f0 0x7f2b4406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:10.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.140+0000 7f2b5ea00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2b4406d7f0 0x7f2b4406fca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000b3b0 tx=0x7f2b50009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:10.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.144+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b48059e90 con 0x7f2b600fe0d0 2024-04-03T08:47:10.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.372+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b60111ab0 con 0x7f2b4406d7f0 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.373+0000 7f2b56a00700 1 -- 172.21.15.157:0/1118561661 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2b60111ab0 con 0x7f2b4406d7f0 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:47:10.375 INFO:teuthology.orchestra.run.smithi157.stdout: "osd", 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "12/21 daemons upgraded", 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading osd daemons", 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:47:10.376 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2b4406d7f0 msgr2=0x7f2b4406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2b4406d7f0 0x7f2b4406fca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000b3b0 tx=0x7f2b50009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 msgr2=0x7f2b60110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 0x7f2b60110260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b48002820 tx=0x7f2b48004570 comp rx=0 tx=0).stop 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 shutdown_connections 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2b4406d7f0 0x7f2b4406fca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b600fcee0 0x7f2b6010fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 --2- 172.21.15.157:0/1118561661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b600fe0d0 0x7f2b60110260 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 >> 172.21.15.157:0/1118561661 conn(0x7f2b600f8560 msgr2=0x7f2b600f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 shutdown_connections 2024-04-03T08:47:10.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.376+0000 7f2b65c00700 1 -- 172.21.15.157:0/1118561661 wait complete. 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.509+0000 7f6164800700 1 -- 172.21.15.157:0/1168935186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 msgr2=0x7f615c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.509+0000 7f6164800700 1 --2- 172.21.15.157:0/1168935186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c0fe540 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f614c004940 tx=0x7f614c009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 -- 172.21.15.157:0/1168935186 shutdown_connections 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 --2- 172.21.15.157:0/1168935186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c0fe540 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 --2- 172.21.15.157:0/1168935186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 0x7f615c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 -- 172.21.15.157:0/1168935186 >> 172.21.15.157:0/1168935186 conn(0x7f615c0f8560 msgr2=0x7f615c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 -- 172.21.15.157:0/1168935186 shutdown_connections 2024-04-03T08:47:10.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 -- 172.21.15.157:0/1168935186 wait complete. 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.510+0000 7f6164800700 1 Processor -- start 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6164800700 1 -- start start 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6164800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 0x7f615c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6164800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6164800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c110700 con 0x7f615c0fe0d0 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6164800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c110f50 con 0x7f615c0fcee0 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6161400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6161400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33560/0 (socket says 172.21.15.157:33560) 2024-04-03T08:47:10.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6161400700 1 -- 172.21.15.157:0/3239610640 learned_addr learned my addr 172.21.15.157:0/3239610640 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.511+0000 7f6161e00700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 0x7f615c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6161400700 1 -- 172.21.15.157:0/3239610640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 msgr2=0x7f615c10fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6161400700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 0x7f615c10fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6161400700 1 -- 172.21.15.157:0/3239610640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c005040 con 0x7f615c0fe0d0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6161e00700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 0x7f615c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6161400700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c110100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f614c00b3b0 tx=0x7f614c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c00e040 con 0x7f615c0fe0d0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f614c004290 con 0x7f615c0fe0d0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c1111d0 con 0x7f615c0fe0d0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c01c630 con 0x7f615c0fe0d0 2024-04-03T08:47:10.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.512+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c111710 con 0x7f615c0fe0d0 2024-04-03T08:47:10.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.513+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c101a60 con 0x7f615c0fe0d0 2024-04-03T08:47:10.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.514+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f614c00bbf0 con 0x7f615c0fe0d0 2024-04-03T08:47:10.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.515+0000 7f6156000700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f614406d7f0 0x7f614406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:10.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.515+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f614c08e4c0 con 0x7f615c0fe0d0 2024-04-03T08:47:10.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.515+0000 7f6161e00700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f614406d7f0 0x7f614406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:10.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.516+0000 7f6161e00700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f614406d7f0 0x7f614406fca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f615c0fcc20 tx=0x7f6150007ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:10.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.520+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f614c05b750 con 0x7f615c0fe0d0 2024-04-03T08:47:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:10 smithi157 ceph-mon[117693]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:10 smithi157 ceph-mon[117693]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:10 smithi157 ceph-mon[117693]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:10 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2807557667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:10 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3617217194' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:47:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:10 smithi181 ceph-mon[101094]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:10 smithi181 ceph-mon[101094]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:10 smithi181 ceph-mon[101094]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:10 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2807557667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:10 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3617217194' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:47:10.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.804+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f615c05f5f0 con 0x7f615c0fe0d0 2024-04-03T08:47:10.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.804+0000 7f6156000700 1 -- 172.21.15.157:0/3239610640 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1178 (secure 0 0 0) 0x7f614c05b2e0 con 0x7f615c0fe0d0 2024-04-03T08:47:10.806 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded 2024-04-03T08:47:10.806 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-03T08:47:10.806 INFO:teuthology.orchestra.run.smithi157.stdout: osd.5 (root=default,host=smithi181) is down 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.2 is active+undersized+degraded, acting [1,3] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-04-03T08:47:10.807 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-04-03T08:47:10.808 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-04-03T08:47:10.808 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1d is active+undersized+degraded, acting [3,2] 2024-04-03T08:47:10.808 INFO:teuthology.orchestra.run.smithi157.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f614406d7f0 msgr2=0x7f614406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f614406d7f0 0x7f614406fca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f615c0fcc20 tx=0x7f6150007ec0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 msgr2=0x7f615c110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c110100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f614c00b3b0 tx=0x7f614c009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 shutdown_connections 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f614406d7f0 0x7f614406fca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f615c0fcee0 0x7f615c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 --2- 172.21.15.157:0/3239610640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f615c0fe0d0 0x7f615c110100 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 >> 172.21.15.157:0/3239610640 conn(0x7f615c0f8560 msgr2=0x7f615c0f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:10.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 shutdown_connections 2024-04-03T08:47:10.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:10.807+0000 7f6164800700 1 -- 172.21.15.157:0/3239610640 wait complete. 2024-04-03T08:47:11.097 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:10 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T08:47:10.782+0000 7fb7c57fc7c0 -1 osd.5 87 log_to_monitors true 2024-04-03T08:47:11.362 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T08:47:11.330+0000 7fb7b4c00700 -1 osd.5 87 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: pgmap v175: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: from='osd.5 [v2:172.21.15.181:6816/891873366,v1:172.21.15.181:6817/891873366]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:47:11.363 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:11 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3239610640' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: pgmap v175: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: from='osd.5 [v2:172.21.15.181:6816/891873366,v1:172.21.15.181:6817/891873366]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-03T08:47:11.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:11 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3239610640' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:47:12.511 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:12 smithi181 ceph-mon[101094]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-03T08:47:12.511 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:12 smithi181 ceph-mon[101094]: osdmap e90: 6 total, 5 up, 6 in 2024-04-03T08:47:12.512 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:12 smithi181 ceph-mon[101094]: from='osd.5 [v2:172.21.15.181:6816/891873366,v1:172.21.15.181:6817/891873366]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:47:12.512 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:12 smithi181 ceph-mon[101094]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:47:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:12 smithi157 ceph-mon[117693]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-03T08:47:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:12 smithi157 ceph-mon[117693]: osdmap e90: 6 total, 5 up, 6 in 2024-04-03T08:47:12.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:12 smithi157 ceph-mon[117693]: from='osd.5 [v2:172.21.15.181:6816/891873366,v1:172.21.15.181:6817/891873366]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:47:12.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:12 smithi157 ceph-mon[117693]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-04-03T08:47:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:13 smithi181 ceph-mon[101094]: pgmap v177: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:13 smithi181 ceph-mon[101094]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:47:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:13 smithi181 ceph-mon[101094]: osd.5 [v2:172.21.15.181:6816/891873366,v1:172.21.15.181:6817/891873366] boot 2024-04-03T08:47:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:13 smithi181 ceph-mon[101094]: osdmap e91: 6 total, 6 up, 6 in 2024-04-03T08:47:13.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:47:13.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:13 smithi181 ceph-mon[101094]: osdmap e92: 6 total, 6 up, 6 in 2024-04-03T08:47:13.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:13 smithi157 ceph-mon[117693]: pgmap v177: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:13.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:13 smithi157 ceph-mon[117693]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-03T08:47:13.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:13 smithi157 ceph-mon[117693]: osd.5 [v2:172.21.15.181:6816/891873366,v1:172.21.15.181:6817/891873366] boot 2024-04-03T08:47:13.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:13 smithi157 ceph-mon[117693]: osdmap e91: 6 total, 6 up, 6 in 2024-04-03T08:47:13.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-03T08:47:13.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:13 smithi157 ceph-mon[117693]: osdmap e92: 6 total, 6 up, 6 in 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: pgmap v180: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:15.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-03T08:47:15.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-03T08:47:15.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-03T08:47:15.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-03T08:47:15.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-03T08:47:15.567 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-03T08:47:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: pgmap v180: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-04-03T08:47:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-03T08:47:15.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-03T08:47:15.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all osd 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: Upgrade: Setting require_osd_release to 19 squid 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: osdmap e93: 6 total, 6 up, 6 in 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all osd 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: Upgrade: Setting require_osd_release to 19 squid 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: osdmap e93: 6 total, 6 up, 6 in 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-03T08:47:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-03T08:47:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: pgmap v182: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 45 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:47:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: osdmap e94: 6 total, 6 up, 6 in 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 9 pgs degraded (PG_DEGRADED) 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 2 up:standby 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:47:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: pgmap v182: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 45 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: osdmap e94: 6 total, 6 up, 6 in 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 9 pgs degraded (PG_DEGRADED) 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 2 up:standby 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:47:17.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:18.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi157.sodwui"]}]: dispatch 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: Upgrade: It appears safe to stop mds.cephfs.smithi157.sodwui 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.181:6826/4016903388,v1:172.21.15.181:6827/4016903388] up:boot 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 3 up:standby 2024-04-03T08:47:18.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi157.sodwui"]}]: dispatch 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: Upgrade: It appears safe to stop mds.cephfs.smithi157.sodwui 2024-04-03T08:47:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.181:6826/4016903388,v1:172.21.15.181:6827/4016903388] up:boot 2024-04-03T08:47:18.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 3 up:standby 2024-04-03T08:47:18.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:47:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:19 smithi157 ceph-mon[117693]: pgmap v184: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 521 B/s rd, 1 op/s 2024-04-03T08:47:19.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:19 smithi157 ceph-mon[117693]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 9 pgs degraded) 2024-04-03T08:47:19.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:19 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:47:19.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:19.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:47:19.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:19 smithi181 ceph-mon[101094]: pgmap v184: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 521 B/s rd, 1 op/s 2024-04-03T08:47:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:19 smithi181 ceph-mon[101094]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 9 pgs degraded) 2024-04-03T08:47:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:19 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:47:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.sodwui", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:47:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:20 smithi157 ceph-mon[117693]: Upgrade: Updating mds.cephfs.smithi157.sodwui 2024-04-03T08:47:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:20 smithi157 ceph-mon[117693]: Deploying daemon mds.cephfs.smithi157.sodwui on smithi157 2024-04-03T08:47:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:20 smithi181 ceph-mon[101094]: Upgrade: Updating mds.cephfs.smithi157.sodwui 2024-04-03T08:47:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:20 smithi181 ceph-mon[101094]: Deploying daemon mds.cephfs.smithi157.sodwui on smithi157 2024-04-03T08:47:21.535 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:21 smithi157 ceph-mon[117693]: pgmap v185: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 446 B/s rd, 1 op/s 2024-04-03T08:47:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:21 smithi181 ceph-mon[101094]: pgmap v185: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 446 B/s rd, 1 op/s 2024-04-03T08:47:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:23 smithi157 ceph-mon[117693]: pgmap v186: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 1 op/s 2024-04-03T08:47:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:23 smithi157 ceph-mon[117693]: osdmap e95: 6 total, 6 up, 6 in 2024-04-03T08:47:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:23 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 2 up:standby 2024-04-03T08:47:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:23 smithi181 ceph-mon[101094]: pgmap v186: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 1 op/s 2024-04-03T08:47:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:23 smithi181 ceph-mon[101094]: osdmap e95: 6 total, 6 up, 6 in 2024-04-03T08:47:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:23 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 2 up:standby 2024-04-03T08:47:25.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:25 smithi157 ceph-mon[117693]: pgmap v188: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-04-03T08:47:25.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:25 smithi181 ceph-mon[101094]: pgmap v188: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-04-03T08:47:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:27 smithi157 ceph-mon[117693]: pgmap v189: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 0 op/s 2024-04-03T08:47:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:27 smithi181 ceph-mon[101094]: pgmap v189: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 0 op/s 2024-04-03T08:47:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:28.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:28 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:boot 2024-04-03T08:47:28.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:28 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 3 up:standby 2024-04-03T08:47:28.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:47:28.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:28 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:boot 2024-04-03T08:47:28.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:28 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.zlscrk=up:active} 3 up:standby 2024-04-03T08:47:28.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:47:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:29 smithi157 ceph-mon[117693]: pgmap v190: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-03T08:47:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:29 smithi181 ceph-mon[101094]: pgmap v190: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-03T08:47:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:31 smithi157 ceph-mon[117693]: pgmap v191: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-03T08:47:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:31 smithi181 ceph-mon[101094]: pgmap v191: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-03T08:47:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:33 smithi157 ceph-mon[117693]: pgmap v192: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:33.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:33.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:33 smithi181 ceph-mon[101094]: pgmap v192: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:35.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:35 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:35.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:35 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:35.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:35 smithi157 ceph-mon[117693]: pgmap v193: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:35 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:35 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:35 smithi181 ceph-mon[101094]: pgmap v193: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:37.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:37 smithi157 ceph-mon[117693]: pgmap v194: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:37 smithi181 ceph-mon[101094]: pgmap v194: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: pgmap v195: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi157.zlscrk"]}]: dispatch 2024-04-03T08:47:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: pgmap v195: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:47:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:39.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:39.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:39.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi157.zlscrk"]}]: dispatch 2024-04-03T08:47:40.417 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:40 smithi157 ceph-mon[117693]: Detected new or changed devices on smithi157 2024-04-03T08:47:40.417 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:40 smithi157 ceph-mon[117693]: Upgrade: It appears safe to stop mds.cephfs.smithi157.zlscrk 2024-04-03T08:47:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:40 smithi181 ceph-mon[101094]: Detected new or changed devices on smithi157 2024-04-03T08:47:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:40 smithi181 ceph-mon[101094]: Upgrade: It appears safe to stop mds.cephfs.smithi157.zlscrk 2024-04-03T08:47:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 -- 172.21.15.157:0/2119757713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3101002b0 msgr2=0x7fd310100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 --2- 172.21.15.157:0/2119757713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3101002b0 0x7fd310100720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc004940 tx=0x7fd2fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 -- 172.21.15.157:0/2119757713 shutdown_connections 2024-04-03T08:47:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 --2- 172.21.15.157:0/2119757713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3101002b0 0x7fd310100720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 --2- 172.21.15.157:0/2119757713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3100ff000 0x7fd3100ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 -- 172.21.15.157:0/2119757713 >> 172.21.15.157:0/2119757713 conn(0x7fd3100fa950 msgr2=0x7fd3100fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 -- 172.21.15.157:0/2119757713 shutdown_connections 2024-04-03T08:47:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.956+0000 7fd318400700 1 -- 172.21.15.157:0/2119757713 wait complete. 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.957+0000 7fd318400700 1 Processor -- start 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.957+0000 7fd318400700 1 -- start start 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd318400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 0x7fd31010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd318400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3101002b0 0x7fd310110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd318400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd310110670 con 0x7fd3100ff000 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd318400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101107e0 con 0x7fd3101002b0 2024-04-03T08:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 0x7fd31010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 0x7fd31010fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49608/0 (socket says 172.21.15.157:49608) 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315a00700 1 -- 172.21.15.157:0/2567447980 learned_addr learned my addr 172.21.15.157:0/2567447980 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315000700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3101002b0 0x7fd310110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315a00700 1 -- 172.21.15.157:0/2567447980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3101002b0 msgr2=0x7fd310110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315a00700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3101002b0 0x7fd310110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.958+0000 7fd315a00700 1 -- 172.21.15.157:0/2567447980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc005040 con 0x7fd3100ff000 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.959+0000 7fd315a00700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 0x7fd31010fb30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd304002a50 tx=0x7fd3040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.959+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd304007cc0 con 0x7fd3100ff000 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.959+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd30400f040 con 0x7fd3100ff000 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.959+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd310115240 con 0x7fd3100ff000 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.959+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd30400da70 con 0x7fd3100ff000 2024-04-03T08:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.959+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd310115800 con 0x7fd3100ff000 2024-04-03T08:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.960+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31004c710 con 0x7fd3100ff000 2024-04-03T08:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.961+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd30400dc10 con 0x7fd3100ff000 2024-04-03T08:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.962+0000 7fd30d600700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2f806d7e0 0x7fd2f806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.962+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fd30408c600 con 0x7fd3100ff000 2024-04-03T08:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.962+0000 7fd315000700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2f806d7e0 0x7fd2f806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.963+0000 7fd315000700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2f806d7e0 0x7fd2f806fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00b3b0 tx=0x7fd2fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:40.967+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd3040598b0 con 0x7fd3100ff000 2024-04-03T08:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.216+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd310104550 con 0x7fd2f806d7e0 2024-04-03T08:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.217+0000 7fd30d600700 1 -- 172.21.15.157:0/2567447980 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd310104550 con 0x7fd2f806d7e0 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2f806d7e0 msgr2=0x7fd2f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2f806d7e0 0x7fd2f806fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00b3b0 tx=0x7fd2fc009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 msgr2=0x7fd31010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 0x7fd31010fb30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd304002a50 tx=0x7fd3040046b0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 shutdown_connections 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd2f806d7e0 0x7fd2f806fc90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3100ff000 0x7fd31010fb30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 --2- 172.21.15.157:0/2567447980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3101002b0 0x7fd310110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 >> 172.21.15.157:0/2567447980 conn(0x7fd3100fa950 msgr2=0x7fd3100fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:41.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 shutdown_connections 2024-04-03T08:47:41.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.221+0000 7fd318400700 1 -- 172.21.15.157:0/2567447980 wait complete. 2024-04-03T08:47:41.240 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:47:41.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.365+0000 7f031b800700 1 -- 172.21.15.157:0/2546829699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 msgr2=0x7f03140fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.365+0000 7f031b800700 1 --2- 172.21.15.157:0/2546829699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f03140fe460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0300004940 tx=0x7f0300009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.365+0000 7f031b800700 1 -- 172.21.15.157:0/2546829699 shutdown_connections 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.365+0000 7f031b800700 1 --2- 172.21.15.157:0/2546829699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f03140fe460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.365+0000 7f031b800700 1 --2- 172.21.15.157:0/2546829699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f03140fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.365+0000 7f031b800700 1 -- 172.21.15.157:0/2546829699 >> 172.21.15.157:0/2546829699 conn(0x7f03140f8540 msgr2=0x7f03140fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.366+0000 7f031b800700 1 -- 172.21.15.157:0/2546829699 shutdown_connections 2024-04-03T08:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.366+0000 7f031b800700 1 -- 172.21.15.157:0/2546829699 wait complete. 2024-04-03T08:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.367+0000 7f031b800700 1 Processor -- start 2024-04-03T08:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.367+0000 7f031b800700 1 -- start start 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.367+0000 7f031b800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f031410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.367+0000 7f031b800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f0314110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.367+0000 7f031b800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314110730 con 0x7f03140fdff0 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.367+0000 7f031b800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314110f80 con 0x7f03140fce80 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0313e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f0314110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0318e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f031410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0318e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f031410fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:48402/0 (socket says 172.21.15.157:48402) 2024-04-03T08:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0318e00700 1 -- 172.21.15.157:0/2050191174 learned_addr learned my addr 172.21.15.157:0/2050191174 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:41.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0313e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f0314110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49614/0 (socket says 172.21.15.157:49614) 2024-04-03T08:47:41.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0313e00700 1 -- 172.21.15.157:0/2050191174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 msgr2=0x7f031410fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0313e00700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f031410fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0313e00700 1 -- 172.21.15.157:0/2050191174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300005040 con 0x7f03140fdff0 2024-04-03T08:47:41.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.368+0000 7f0318e00700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f031410fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.369+0000 7f0313e00700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f0314110130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f030000b970 tx=0x7f0300009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.369+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030000e040 con 0x7f03140fdff0 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.369+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0300004290 con 0x7f03140fdff0 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.369+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0314111200 con 0x7f03140fdff0 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.369+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030001c3f0 con 0x7f03140fdff0 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.369+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0314111740 con 0x7f03140fdff0 2024-04-03T08:47:41.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.370+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0314101980 con 0x7f03140fdff0 2024-04-03T08:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.372+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f030000bbf0 con 0x7f03140fdff0 2024-04-03T08:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.373+0000 7f0310c00700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f02fc06d7f0 0x7f02fc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.373+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f030008e290 con 0x7f03140fdff0 2024-04-03T08:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.373+0000 7f0318e00700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f02fc06d7f0 0x7f02fc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:41.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.374+0000 7f0318e00700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f02fc06d7f0 0x7f02fc06fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f030800e5e0 tx=0x7f030800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:41.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.378+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f030005b5d0 con 0x7f03140fdff0 2024-04-03T08:47:41.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:41 smithi157 ceph-mon[117693]: pgmap v196: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:41.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:41.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:47:41.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:41 smithi181 ceph-mon[101094]: pgmap v196: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.zlscrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:47:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:47:41.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.610+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0314111a20 con 0x7f02fc06d7f0 2024-04-03T08:47:41.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.612+0000 7f0310c00700 1 -- 172.21.15.157:0/2050191174 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0314111a20 con 0x7f02fc06d7f0 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f02fc06d7f0 msgr2=0x7f02fc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f02fc06d7f0 0x7f02fc06fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f030800e5e0 tx=0x7f030800b040 comp rx=0 tx=0).stop 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 msgr2=0x7f0314110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f0314110130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f030000b970 tx=0x7f0300009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 shutdown_connections 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f02fc06d7f0 0x7f02fc06fca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03140fce80 0x7f031410fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 --2- 172.21.15.157:0/2050191174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03140fdff0 0x7f0314110130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 >> 172.21.15.157:0/2050191174 conn(0x7f03140f8540 msgr2=0x7f03140f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:41.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 shutdown_connections 2024-04-03T08:47:41.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.614+0000 7f031b800700 1 -- 172.21.15.157:0/2050191174 wait complete. 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 -- 172.21.15.157:0/3696980854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fcc10 msgr2=0x7fe8c40fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 --2- 172.21.15.157:0/3696980854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fcc10 0x7fe8c40fd020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4004940 tx=0x7fe8b4009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 -- 172.21.15.157:0/3696980854 shutdown_connections 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 --2- 172.21.15.157:0/3696980854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8c40fdec0 0x7fe8c40fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 --2- 172.21.15.157:0/3696980854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fcc10 0x7fe8c40fd020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 -- 172.21.15.157:0/3696980854 >> 172.21.15.157:0/3696980854 conn(0x7fe8c40f83d0 msgr2=0x7fe8c40fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 -- 172.21.15.157:0/3696980854 shutdown_connections 2024-04-03T08:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.752+0000 7fe8c9400700 1 -- 172.21.15.157:0/3696980854 wait complete. 2024-04-03T08:47:41.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.753+0000 7fe8c9400700 1 Processor -- start 2024-04-03T08:47:41.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.753+0000 7fe8c9400700 1 -- start start 2024-04-03T08:47:41.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.753+0000 7fe8c9400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8c40fcc10 0x7fe8c410fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:41.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.753+0000 7fe8c9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 0x7fe8c410ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.753+0000 7fe8c9400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4110590 con 0x7fe8c40fdec0 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.753+0000 7fe8c9400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4110de0 con 0x7fe8c40fcc10 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 0x7fe8c410ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 0x7fe8c410ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49638/0 (socket says 172.21.15.157:49638) 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 -- 172.21.15.157:0/99432449 learned_addr learned my addr 172.21.15.157:0/99432449 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3e00700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8c40fcc10 0x7fe8c410fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 -- 172.21.15.157:0/99432449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8c40fcc10 msgr2=0x7fe8c410fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8c40fcc10 0x7fe8c410fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 -- 172.21.15.157:0/99432449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4005040 con 0x7fe8c40fdec0 2024-04-03T08:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c3400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 0x7fe8c410ff90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0002a50 tx=0x7fe8b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b0007cc0 con 0x7fe8c40fdec0 2024-04-03T08:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8b000f040 con 0x7fe8c40fdec0 2024-04-03T08:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.754+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c41110c0 con 0x7fe8c40fdec0 2024-04-03T08:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.755+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b000da30 con 0x7fe8c40fdec0 2024-04-03T08:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.755+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c4111600 con 0x7fe8c40fdec0 2024-04-03T08:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.756+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c4101850 con 0x7fe8c40fdec0 2024-04-03T08:47:41.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.757+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe8b000db90 con 0x7fe8c40fdec0 2024-04-03T08:47:41.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.758+0000 7fe8bbe00700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8a806d7f0 0x7fe8a806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:41.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.758+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fe8b008cdd0 con 0x7fe8c40fdec0 2024-04-03T08:47:41.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.758+0000 7fe8c3e00700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8a806d7f0 0x7fe8a806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:41.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.759+0000 7fe8c3e00700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8a806d7f0 0x7fe8a806fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400b3b0 tx=0x7fe8b4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:41.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.763+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe8b0059fe0 con 0x7fe8c40fdec0 2024-04-03T08:47:41.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.981+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8c4111820 con 0x7fe8a806d7f0 2024-04-03T08:47:41.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.991+0000 7fe8bbe00700 1 -- 172.21.15.157:0/99432449 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe8c4111820 con 0x7fe8a806d7f0 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (7m) 9s ago 17m 14.0M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (3m) 9s ago 18m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (3m) 32s ago 16m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (6m) 9s ago 17m 74.3M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (15s) 9s ago 11m 9973k - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (11m) 9s ago 11m 135M - 17.2.7-805-g6fda41ff a49113eacc58 2c8762881043 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (11m) 32s ago 11m 14.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (11m) 32s ago 11m 99.6M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (6m) 9s ago 19m 507M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (5m) 32s ago 16m 451M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:47:41.992 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (5m) 9s ago 19m 47.8M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (4m) 32s ago 16m 35.2M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (7m) 9s ago 18m 7700k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (6m) 32s ago 16m 7574k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (3m) 9s ago 15m 135M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (2m) 9s ago 15m 160M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (2m) 9s ago 14m 101M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (113s) 32s ago 14m 136M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (75s) 32s ago 13m 94.4M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (37s) 32s ago 13m 11.0M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:47:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (5m) 9s ago 17m 52.7M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8a806d7f0 msgr2=0x7fe8a806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8a806d7f0 0x7fe8a806fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400b3b0 tx=0x7fe8b4009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 msgr2=0x7fe8c410ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 0x7fe8c410ff90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0002a50 tx=0x7fe8b00046b0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 shutdown_connections 2024-04-03T08:47:41.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe8a806d7f0 0x7fe8a806fca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8c40fcc10 0x7fe8c410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 --2- 172.21.15.157:0/99432449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8c40fdec0 0x7fe8c410ff90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:41.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 >> 172.21.15.157:0/99432449 conn(0x7fe8c40f83d0 msgr2=0x7fe8c40f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:41.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 shutdown_connections 2024-04-03T08:47:41.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:41.993+0000 7fe8c9400700 1 -- 172.21.15.157:0/99432449 wait complete. 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 -- 172.21.15.157:0/1422363790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 msgr2=0x7fd6000fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 --2- 172.21.15.157:0/1422363790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd6000fd290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0004940 tx=0x7fd5f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 -- 172.21.15.157:0/1422363790 shutdown_connections 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 --2- 172.21.15.157:0/1422363790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 0x7fd6000fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 --2- 172.21.15.157:0/1422363790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd6000fd290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 -- 172.21.15.157:0/1422363790 >> 172.21.15.157:0/1422363790 conn(0x7fd6000f8560 msgr2=0x7fd6000fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 -- 172.21.15.157:0/1422363790 shutdown_connections 2024-04-03T08:47:42.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.128+0000 7fd605c00700 1 -- 172.21.15.157:0/1422363790 wait complete. 2024-04-03T08:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.129+0000 7fd605c00700 1 Processor -- start 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.129+0000 7fd605c00700 1 -- start start 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.129+0000 7fd605c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd60010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.129+0000 7fd605c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 0x7fd600110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.129+0000 7fd605c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600110770 con 0x7fd6000fce80 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.129+0000 7fd605c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600110fc0 con 0x7fd6000fdff0 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd60010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd60010fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49656/0 (socket says 172.21.15.157:49656) 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 -- 172.21.15.157:0/2813821922 learned_addr learned my addr 172.21.15.157:0/2813821922 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5f7e00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 0x7fd600110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 -- 172.21.15.157:0/2813821922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 msgr2=0x7fd600110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 0x7fd600110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 -- 172.21.15.157:0/2813821922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0005040 con 0x7fd6000fce80 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5f7e00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 0x7fd600110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.130+0000 7fd5fea00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd60010fc30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000b3b0 tx=0x7fd5f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.131+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5f000e040 con 0x7fd6000fce80 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.131+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5f0004290 con 0x7fd6000fce80 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.131+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd600111240 con 0x7fd6000fce80 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.131+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5f001c630 con 0x7fd6000fce80 2024-04-03T08:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.131+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd600111780 con 0x7fd6000fce80 2024-04-03T08:47:42.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.132+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600101980 con 0x7fd6000fce80 2024-04-03T08:47:42.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.133+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd5f000bbf0 con 0x7fd6000fce80 2024-04-03T08:47:42.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.134+0000 7fd5f6a00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd5e406d7f0 0x7fd5e406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.134+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fd5f008e3a0 con 0x7fd6000fce80 2024-04-03T08:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.134+0000 7fd5f7e00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd5e406d7f0 0x7fd5e406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.135+0000 7fd5f7e00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd5e406d7f0 0x7fd5e406fca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009fd0 tx=0x7fd5e8009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:42.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.138+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd5f005b6b0 con 0x7fd6000fce80 2024-04-03T08:47:42.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.474+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd6001059e0 con 0x7fd6000fce80 2024-04-03T08:47:42.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.475+0000 7fd5f6a00700 1 -- 172.21.15.157:0/2813821922 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fd5f005b240 con 0x7fd6000fce80 2024-04-03T08:47:42.477 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:47:42.477 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:47:42.477 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:47:42.477 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 3, 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 3, 2024-04-03T08:47:42.478 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 11 2024-04-03T08:47:42.479 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:47:42.479 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd5e406d7f0 msgr2=0x7fd5e406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd5e406d7f0 0x7fd5e406fca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009fd0 tx=0x7fd5e8009ee0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 msgr2=0x7fd60010fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd60010fc30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000b3b0 tx=0x7fd5f0009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 shutdown_connections 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd5e406d7f0 0x7fd5e406fca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6000fce80 0x7fd60010fc30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 --2- 172.21.15.157:0/2813821922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6000fdff0 0x7fd600110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 >> 172.21.15.157:0/2813821922 conn(0x7fd6000f8560 msgr2=0x7fd6000f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 shutdown_connections 2024-04-03T08:47:42.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.478+0000 7fd605c00700 1 -- 172.21.15.157:0/2813821922 wait complete. 2024-04-03T08:47:42.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:42 smithi157 ceph-mon[117693]: Upgrade: Updating mds.cephfs.smithi157.zlscrk 2024-04-03T08:47:42.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:42 smithi157 ceph-mon[117693]: Deploying daemon mds.cephfs.smithi157.zlscrk on smithi157 2024-04-03T08:47:42.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:42 smithi157 ceph-mon[117693]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:42 smithi181 ceph-mon[101094]: Upgrade: Updating mds.cephfs.smithi157.zlscrk 2024-04-03T08:47:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:42 smithi181 ceph-mon[101094]: Deploying daemon mds.cephfs.smithi157.zlscrk on smithi157 2024-04-03T08:47:42.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:42 smithi181 ceph-mon[101094]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:42.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 -- 172.21.15.157:0/1623198120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fcee0 msgr2=0x7f43600fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 --2- 172.21.15.157:0/1623198120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fcee0 0x7f43600fd310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4354004940 tx=0x7f4354009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 -- 172.21.15.157:0/1623198120 shutdown_connections 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 --2- 172.21.15.157:0/1623198120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43600fe0d0 0x7f43600fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 --2- 172.21.15.157:0/1623198120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fcee0 0x7f43600fd310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 -- 172.21.15.157:0/1623198120 >> 172.21.15.157:0/1623198120 conn(0x7f43600f8560 msgr2=0x7f43600fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 -- 172.21.15.157:0/1623198120 shutdown_connections 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.618+0000 7f4367e00700 1 -- 172.21.15.157:0/1623198120 wait complete. 2024-04-03T08:47:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.620+0000 7f4367e00700 1 Processor -- start 2024-04-03T08:47:42.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.620+0000 7f4367e00700 1 -- start start 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.620+0000 7f4367e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43600fcee0 0x7f4360071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.620+0000 7f4367e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 0x7f4360070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.620+0000 7f4367e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43600708c0 con 0x7f43600fe0d0 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.620+0000 7f4367e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360070a30 con 0x7f43600fcee0 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 0x7f4360070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 0x7f4360070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35520/0 (socket says 172.21.15.157:35520) 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 -- 172.21.15.157:0/246729510 learned_addr learned my addr 172.21.15.157:0/246729510 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4365400700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43600fcee0 0x7f4360071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:42.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 -- 172.21.15.157:0/246729510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43600fcee0 msgr2=0x7f4360071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43600fcee0 0x7f4360071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 -- 172.21.15.157:0/246729510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354005040 con 0x7f43600fe0d0 2024-04-03T08:47:42.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.621+0000 7f4364a00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 0x7f4360070310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f434c002a50 tx=0x7f434c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.622+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c007cc0 con 0x7f43600fe0d0 2024-04-03T08:47:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.622+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f434c00f040 con 0x7f43600fe0d0 2024-04-03T08:47:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.622+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360070d10 con 0x7f43600fe0d0 2024-04-03T08:47:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.622+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c00da30 con 0x7f43600fe0d0 2024-04-03T08:47:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.622+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4360115a90 con 0x7f43600fe0d0 2024-04-03T08:47:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.623+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436005f5f0 con 0x7f43600fe0d0 2024-04-03T08:47:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.624+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f434c00db90 con 0x7f43600fe0d0 2024-04-03T08:47:42.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.625+0000 7f435d600700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f434806d7f0 0x7f434806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:42.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.625+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f434c08cdd0 con 0x7f43600fe0d0 2024-04-03T08:47:42.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.626+0000 7f4365400700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f434806d7f0 0x7f434806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:42.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.627+0000 7f4365400700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f434806d7f0 0x7f434806fca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4360071bd0 tx=0x7f4354009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:42.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.630+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f434c0564b0 con 0x7f43600fe0d0 2024-04-03T08:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.917+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4360115cb0 con 0x7f43600fe0d0 2024-04-03T08:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.917+0000 7f435d600700 1 -- 172.21.15.157:0/246729510 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f434c059b70 con 0x7f43600fe0d0 2024-04-03T08:47:42.918 INFO:teuthology.orchestra.run.smithi157.stdout:e21 2024-04-03T08:47:42.918 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 18 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:47:16.048582+0000 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:47:42.919 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 0 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=14484} 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:47:42.920 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.157:6828/2668059844,v1:172.21.15.157:6829/2668059844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:24323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:42.921 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:47:42.922 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6826/4016903388,v1:172.21.15.181:6827/4016903388] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:47:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.920+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f434806d7f0 msgr2=0x7f434806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.920+0000 7f4367e00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f434806d7f0 0x7f434806fca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4360071bd0 tx=0x7f4354009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:42.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.920+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 msgr2=0x7f4360070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.920+0000 7f4367e00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 0x7f4360070310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f434c002a50 tx=0x7f434c0046b0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 shutdown_connections 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f434806d7f0 0x7f434806fca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43600fcee0 0x7f4360071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 --2- 172.21.15.157:0/246729510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43600fe0d0 0x7f4360070310 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 >> 172.21.15.157:0/246729510 conn(0x7f43600f8560 msgr2=0x7f43600f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 shutdown_connections 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:42.921+0000 7f4367e00700 1 -- 172.21.15.157:0/246729510 wait complete. 2024-04-03T08:47:42.923 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 21 2024-04-03T08:47:43.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 -- 172.21.15.157:0/1671839195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4440ff000 msgr2=0x7fa4440ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 --2- 172.21.15.157:0/1671839195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4440ff000 0x7fa4440ff410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa434004940 tx=0x7fa434009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:43.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 -- 172.21.15.157:0/1671839195 shutdown_connections 2024-04-03T08:47:43.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 --2- 172.21.15.157:0/1671839195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4441002b0 0x7fa444100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 --2- 172.21.15.157:0/1671839195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4440ff000 0x7fa4440ff410 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 -- 172.21.15.157:0/1671839195 >> 172.21.15.157:0/1671839195 conn(0x7fa4440fa950 msgr2=0x7fa4440fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:43.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 -- 172.21.15.157:0/1671839195 shutdown_connections 2024-04-03T08:47:43.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.064+0000 7fa44a600700 1 -- 172.21.15.157:0/1671839195 wait complete. 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.065+0000 7fa44a600700 1 Processor -- start 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.065+0000 7fa44a600700 1 -- start start 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa44a600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4440ff000 0x7fa44410fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa44a600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 0x7fa44410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa44a600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441105d0 con 0x7fa4441002b0 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa44a600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444110740 con 0x7fa4440ff000 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa442a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 0x7fa44410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa442a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 0x7fa44410ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35536/0 (socket says 172.21.15.157:35536) 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa442a00700 1 -- 172.21.15.157:0/2710511235 learned_addr learned my addr 172.21.15.157:0/2710511235 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:43.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa443400700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4440ff000 0x7fa44410fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa442a00700 1 -- 172.21.15.157:0/2710511235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4440ff000 msgr2=0x7fa44410fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa442a00700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4440ff000 0x7fa44410fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.066+0000 7fa442a00700 1 -- 172.21.15.157:0/2710511235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434005040 con 0x7fa4441002b0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.067+0000 7fa442a00700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 0x7fa44410ffd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa430002a80 tx=0x7fa4300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.067+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa430007cc0 con 0x7fa4441002b0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.067+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa43000f040 con 0x7fa4441002b0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.067+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4441151a0 con 0x7fa4441002b0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.067+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa43000dac0 con 0x7fa4441002b0 2024-04-03T08:47:43.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.067+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa444115760 con 0x7fa4441002b0 2024-04-03T08:47:43.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.068+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44404c710 con 0x7fa4441002b0 2024-04-03T08:47:43.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.069+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa43000dc20 con 0x7fa4441002b0 2024-04-03T08:47:43.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.070+0000 7fa43b400700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa42806d7e0 0x7fa42806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:43.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.070+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6699+0+0 (secure 0 0 0) 0x7fa43008cc40 con 0x7fa4441002b0 2024-04-03T08:47:43.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.070+0000 7fa443400700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa42806d7e0 0x7fa42806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:43.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.071+0000 7fa443400700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa42806d7e0 0x7fa42806fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa43400b3b0 tx=0x7fa434009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:43.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.075+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa430059e80 con 0x7fa4441002b0 2024-04-03T08:47:43.281 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:42 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[117670]: 2024-04-03T08:47:42.918+0000 7f7329600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:47:43.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.299+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa444104550 con 0x7fa42806d7e0 2024-04-03T08:47:43.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.300+0000 7fa43b400700 1 -- 172.21.15.157:0/2710511235 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa444104550 con 0x7fa42806d7e0 2024-04-03T08:47:43.301 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:47:43.301 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:47:43.301 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "osd", 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "13/21 daemons upgraded", 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading mds daemons", 2024-04-03T08:47:43.302 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:47:43.303 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa42806d7e0 msgr2=0x7fa42806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa42806d7e0 0x7fa42806fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa43400b3b0 tx=0x7fa434009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 msgr2=0x7fa44410ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 0x7fa44410ffd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa430002a80 tx=0x7fa4300046b0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 shutdown_connections 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa42806d7e0 0x7fa42806fc90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4440ff000 0x7fa44410fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 --2- 172.21.15.157:0/2710511235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4441002b0 0x7fa44410ffd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 >> 172.21.15.157:0/2710511235 conn(0x7fa4440fa950 msgr2=0x7fa4440fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:43.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 shutdown_connections 2024-04-03T08:47:43.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.303+0000 7fa44a600700 1 -- 172.21.15.157:0/2710511235 wait complete. 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 -- 172.21.15.157:0/1817079489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 msgr2=0x7f22f00fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 --2- 172.21.15.157:0/1817079489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f00fd310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22e4004940 tx=0x7f22e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 -- 172.21.15.157:0/1817079489 shutdown_connections 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 --2- 172.21.15.157:0/1817079489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22f00fe0d0 0x7f22f00fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 --2- 172.21.15.157:0/1817079489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f00fd310 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 -- 172.21.15.157:0/1817079489 >> 172.21.15.157:0/1817079489 conn(0x7f22f00f8560 msgr2=0x7f22f00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 -- 172.21.15.157:0/1817079489 shutdown_connections 2024-04-03T08:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.441+0000 7f22f7400700 1 -- 172.21.15.157:0/1817079489 wait complete. 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f7400700 1 Processor -- start 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f7400700 1 -- start start 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f7400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22f00fe0d0 0x7f22f010df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f7400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f010e510 con 0x7f22f00fcee0 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f7400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f010ed60 con 0x7f22f00fe0d0 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f4a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f4a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f010d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35548/0 (socket says 172.21.15.157:35548) 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22f4a00700 1 -- 172.21.15.157:0/3018828369 learned_addr learned my addr 172.21.15.157:0/3018828369 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.442+0000 7f22efe00700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22f00fe0d0 0x7f22f010df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22f4a00700 1 -- 172.21.15.157:0/3018828369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22f00fe0d0 msgr2=0x7f22f010df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22f4a00700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22f00fe0d0 0x7f22f010df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22f4a00700 1 -- 172.21.15.157:0/3018828369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4005040 con 0x7f22f00fcee0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22f4a00700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f010d9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22e40040d0 tx=0x7f22e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e400e070 con 0x7f22f00fcee0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22e401c400 con 0x7f22f00fcee0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f010efe0 con 0x7f22f00fcee0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e400b610 con 0x7f22f00fcee0 2024-04-03T08:47:43.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.443+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f010f4c0 con 0x7f22f00fcee0 2024-04-03T08:47:43.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.445+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f005f5f0 con 0x7f22f00fcee0 2024-04-03T08:47:43.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.445+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f22e401ca50 con 0x7f22f00fcee0 2024-04-03T08:47:43.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.446+0000 7f22ecc00700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22d806d7f0 0x7f22d806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:47:43.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.446+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6699+0+0 (secure 0 0 0) 0x7f22e408e6f0 con 0x7f22f00fcee0 2024-04-03T08:47:43.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.447+0000 7f22efe00700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22d806d7f0 0x7f22d806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:47:43.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.447+0000 7f22efe00700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22d806d7f0 0x7f22d806fca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009b80 tx=0x7f22dc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:47:43.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.451+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f22e405b930 con 0x7f22f00fcee0 2024-04-03T08:47:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: pgmap v197: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2813821922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/246729510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: osdmap e96: 6 total, 6 up, 6 in 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: Standby daemon mds.cephfs.smithi181.ecaerp assigned to filesystem cephfs as rank 0 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-03T08:47:43.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:43 smithi157 ceph-mon[117693]: fsmap cephfs:1/1 {0=cephfs.smithi181.ecaerp=up:replay} 2 up:standby 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: pgmap v197: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2813821922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/246729510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: osdmap e96: 6 total, 6 up, 6 in 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: Standby daemon mds.cephfs.smithi181.ecaerp assigned to filesystem cephfs as rank 0 2024-04-03T08:47:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-03T08:47:43.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-03T08:47:43.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:43 smithi181 ceph-mon[101094]: fsmap cephfs:1/1 {0=cephfs.smithi181.ecaerp=up:replay} 2 up:standby 2024-04-03T08:47:43.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.741+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f22f004bed0 con 0x7f22f00fcee0 2024-04-03T08:47:43.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.741+0000 7f22ecc00700 1 -- 172.21.15.157:0/3018828369 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f22e405b4c0 con 0x7f22f00fcee0 2024-04-03T08:47:43.743 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-03T08:47:43.743 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-03T08:47:43.743 INFO:teuthology.orchestra.run.smithi157.stdout: fs cephfs is degraded 2024-04-03T08:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22d806d7f0 msgr2=0x7f22d806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22d806d7f0 0x7f22d806fca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009b80 tx=0x7f22dc00b040 comp rx=0 tx=0).stop 2024-04-03T08:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 msgr2=0x7f22f010d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f010d9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22e40040d0 tx=0x7f22e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 shutdown_connections 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22d806d7f0 0x7f22d806fca0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f00fcee0 0x7f22f010d9d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 --2- 172.21.15.157:0/3018828369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22f00fe0d0 0x7f22f010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 >> 172.21.15.157:0/3018828369 conn(0x7f22f00f8560 msgr2=0x7f22f00f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 shutdown_connections 2024-04-03T08:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:47:43.744+0000 7f22f7400700 1 -- 172.21.15.157:0/3018828369 wait complete. 2024-04-03T08:47:44.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:44 smithi157 ceph-mon[117693]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:44.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:44 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3018828369' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:47:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:44.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:44 smithi181 ceph-mon[101094]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:47:44.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:44 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3018828369' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:47:44.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:44.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:45 smithi157 ceph-mon[117693]: pgmap v199: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:47:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:45 smithi181 ceph-mon[101094]: pgmap v199: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:47:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:47:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:47 smithi157 ceph-mon[117693]: pgmap v200: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-04-03T08:47:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:47 smithi181 ceph-mon[101094]: pgmap v200: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-04-03T08:47:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:49 smithi157 ceph-mon[117693]: pgmap v201: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-03T08:47:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:49 smithi181 ceph-mon[101094]: pgmap v201: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-03T08:47:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:51 smithi157 ceph-mon[117693]: pgmap v202: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-03T08:47:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:51 smithi181 ceph-mon[101094]: pgmap v202: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-03T08:47:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:53 smithi157 ceph-mon[117693]: pgmap v203: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-03T08:47:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:53 smithi157 ceph-mon[117693]: reconnect by client.14544 192.168.0.1:0/68447184 after 0.00099998 2024-04-03T08:47:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:53 smithi157 ceph-mon[117693]: reconnect by client.24365 192.168.0.1:0/2560883670 after 0.00099998 2024-04-03T08:47:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:53 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:reconnect 2024-04-03T08:47:53.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:53 smithi157 ceph-mon[117693]: fsmap cephfs:1/1 {0=cephfs.smithi181.ecaerp=up:reconnect} 2 up:standby 2024-04-03T08:47:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:53 smithi181 ceph-mon[101094]: pgmap v203: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-03T08:47:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:53 smithi181 ceph-mon[101094]: reconnect by client.14544 192.168.0.1:0/68447184 after 0.00099998 2024-04-03T08:47:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:53 smithi181 ceph-mon[101094]: reconnect by client.24365 192.168.0.1:0/2560883670 after 0.00099998 2024-04-03T08:47:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:53 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:reconnect 2024-04-03T08:47:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:53 smithi181 ceph-mon[101094]: fsmap cephfs:1/1 {0=cephfs.smithi181.ecaerp=up:reconnect} 2 up:standby 2024-04-03T08:47:54.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:54 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:rejoin 2024-04-03T08:47:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:54 smithi157 ceph-mon[117693]: fsmap cephfs:1/1 {0=cephfs.smithi181.ecaerp=up:rejoin} 2 up:standby 2024-04-03T08:47:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:54 smithi157 ceph-mon[117693]: daemon mds.cephfs.smithi181.ecaerp is now active in filesystem cephfs as rank 0 2024-04-03T08:47:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:54.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:54 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:rejoin 2024-04-03T08:47:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:54 smithi181 ceph-mon[101094]: fsmap cephfs:1/1 {0=cephfs.smithi181.ecaerp=up:rejoin} 2 up:standby 2024-04-03T08:47:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:54 smithi181 ceph-mon[101094]: daemon mds.cephfs.smithi181.ecaerp is now active in filesystem cephfs as rank 0 2024-04-03T08:47:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:54.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: pgmap v204: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:active 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] up:boot 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi181.ecaerp=up:active} 3 up:standby 2024-04-03T08:47:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: pgmap v204: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.181:6824/3882128322,v1:172.21.15.181:6825/3882128322] up:active 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] up:boot 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi181.ecaerp=up:active} 3 up:standby 2024-04-03T08:47:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:47:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:57 smithi181 ceph-mon[101094]: pgmap v205: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-03T08:47:57.668 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:57 smithi157 ceph-mon[117693]: pgmap v205: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-03T08:47:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:59 smithi181 ceph-mon[101094]: pgmap v206: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-03T08:47:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:47:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:59 smithi157 ceph-mon[117693]: pgmap v206: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-03T08:47:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:47:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:47:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:47:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:01 smithi157 ceph-mon[117693]: pgmap v207: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-03T08:48:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:01.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:01 smithi181 ceph-mon[101094]: pgmap v207: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-03T08:48:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:03 smithi181 ceph-mon[101094]: pgmap v208: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-03T08:48:03.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:03 smithi157 ceph-mon[117693]: pgmap v208: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-03T08:48:04.891 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:04 smithi157 ceph-mon[117693]: pgmap v209: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:05.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:04 smithi181 ceph-mon[101094]: pgmap v209: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:06.282 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi181.ecaerp"]}]: dispatch 2024-04-03T08:48:06.283 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:05 smithi181 ceph-mon[101094]: Upgrade: It appears safe to stop mds.cephfs.smithi181.ecaerp 2024-04-03T08:48:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:06.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi181.ecaerp"]}]: dispatch 2024-04-03T08:48:06.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:05 smithi157 ceph-mon[117693]: Upgrade: It appears safe to stop mds.cephfs.smithi181.ecaerp 2024-04-03T08:48:07.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:06 smithi157 ceph-mon[117693]: pgmap v210: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:06 smithi181 ceph-mon[101094]: pgmap v210: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:08 smithi181 ceph-mon[101094]: Upgrade: Updating mds.cephfs.smithi181.ecaerp 2024-04-03T08:48:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:48:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:08.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:08 smithi181 ceph-mon[101094]: Deploying daemon mds.cephfs.smithi181.ecaerp on smithi181 2024-04-03T08:48:08.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:08 smithi157 ceph-mon[117693]: Upgrade: Updating mds.cephfs.smithi181.ecaerp 2024-04-03T08:48:08.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:08.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.ecaerp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:48:08.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:08.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:08 smithi157 ceph-mon[117693]: Deploying daemon mds.cephfs.smithi181.ecaerp on smithi181 2024-04-03T08:48:09.490 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:09 smithi181 ceph-mon[101094]: pgmap v211: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-03T08:48:09.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:09 smithi157 ceph-mon[117693]: pgmap v211: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-03T08:48:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:09 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[117670]: 2024-04-03T08:48:09.489+0000 7f7329600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:48:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-03T08:48:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:48:10.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: osdmap e97: 6 total, 6 up, 6 in 2024-04-03T08:48:10.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: Standby daemon mds.cephfs.smithi157.sodwui assigned to filesystem cephfs as rank 0 2024-04-03T08:48:10.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-03T08:48:10.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-03T08:48:10.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:10 smithi157 ceph-mon[117693]: fsmap cephfs:1/1 {0=cephfs.smithi157.sodwui=up:replay} 2 up:standby 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: osdmap e97: 6 total, 6 up, 6 in 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: Standby daemon mds.cephfs.smithi157.sodwui assigned to filesystem cephfs as rank 0 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-03T08:48:10.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:10 smithi181 ceph-mon[101094]: fsmap cephfs:1/1 {0=cephfs.smithi157.sodwui=up:replay} 2 up:standby 2024-04-03T08:48:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:48:11.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:11 smithi157 ceph-mon[117693]: pgmap v213: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-04-03T08:48:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:48:11.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:11 smithi181 ceph-mon[101094]: pgmap v213: 65 pgs: 65 active+clean; 203 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-04-03T08:48:13.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:13 smithi157 ceph-mon[117693]: pgmap v214: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-04-03T08:48:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:13 smithi181 ceph-mon[101094]: pgmap v214: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-04-03T08:48:13.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 -- 172.21.15.157:0/3117293935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fcee0 msgr2=0x7f4ed80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:13.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 --2- 172.21.15.157:0/3117293935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fcee0 0x7f4ed80fd310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8004940 tx=0x7f4ec8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 -- 172.21.15.157:0/3117293935 shutdown_connections 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 --2- 172.21.15.157:0/3117293935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 --2- 172.21.15.157:0/3117293935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fcee0 0x7f4ed80fd310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 -- 172.21.15.157:0/3117293935 >> 172.21.15.157:0/3117293935 conn(0x7f4ed80f8560 msgr2=0x7f4ed80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 -- 172.21.15.157:0/3117293935 shutdown_connections 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.889+0000 7f4edee00700 1 -- 172.21.15.157:0/3117293935 wait complete. 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.890+0000 7f4edee00700 1 Processor -- start 2024-04-03T08:48:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4edee00700 1 -- start start 2024-04-03T08:48:13.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4edee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fcee0 0x7f4ed810d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:13.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4edee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed810df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:13.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4edee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed810e530 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4edee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed810ed80 con 0x7f4ed80fcee0 2024-04-03T08:48:13.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4ed7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed810df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:13.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4ed7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed810df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42968/0 (socket says 172.21.15.157:42968) 2024-04-03T08:48:13.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.891+0000 7f4ed7400700 1 -- 172.21.15.157:0/3909689963 learned_addr learned my addr 172.21.15.157:0/3909689963 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:13.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ed7e00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fcee0 0x7f4ed810d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:13.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ed7400700 1 -- 172.21.15.157:0/3909689963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fcee0 msgr2=0x7f4ed810d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:13.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ed7400700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fcee0 0x7f4ed810d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ed7400700 1 -- 172.21.15.157:0/3909689963 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8005040 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ed7e00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fcee0 0x7f4ed810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ed7400700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed810df30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400eb70 tx=0x7f4ec400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.892+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec4007cc0 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.893+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ec400f040 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.893+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed810f000 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.893+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec4009640 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.893+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed810f540 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.894+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed805f5f0 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.895+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4ec40097a0 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.897+0000 7f4ecfe00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ebc06d7f0 0x7f4ebc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.897+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f4ec408cbb0 con 0x7f4ed80fe0d0 2024-04-03T08:48:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.897+0000 7f4ed7e00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ebc06d7f0 0x7f4ebc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.898+0000 7f4ed7e00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ebc06d7f0 0x7f4ebc06fca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8013870 tx=0x7f4ec8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:13.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:13.901+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4ec4093080 con 0x7f4ed80fe0d0 2024-04-03T08:48:14.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.135+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ed810f820 con 0x7f4ebc06d7f0 2024-04-03T08:48:14.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.137+0000 7f4ecfe00700 1 -- 172.21.15.157:0/3909689963 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4ed810f820 con 0x7f4ebc06d7f0 2024-04-03T08:48:14.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ebc06d7f0 msgr2=0x7f4ebc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ebc06d7f0 0x7f4ebc06fca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8013870 tx=0x7f4ec8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:14.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 msgr2=0x7f4ed810df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed810df30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400eb70 tx=0x7f4ec400b040 comp rx=0 tx=0).stop 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 shutdown_connections 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ebc06d7f0 0x7f4ebc06fca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ed80fcee0 0x7f4ed810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 --2- 172.21.15.157:0/3909689963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed80fe0d0 0x7f4ed810df30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.139+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 >> 172.21.15.157:0/3909689963 conn(0x7f4ed80f8560 msgr2=0x7f4ed80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.140+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 shutdown_connections 2024-04-03T08:48:14.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.140+0000 7f4edee00700 1 -- 172.21.15.157:0/3909689963 wait complete. 2024-04-03T08:48:14.155 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.283+0000 7fcf2b200700 1 -- 172.21.15.157:0/1319859812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 msgr2=0x7fcf2c070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.283+0000 7fcf2b200700 1 --2- 172.21.15.157:0/1319859812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c070d60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf18004940 tx=0x7fcf18009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.283+0000 7fcf2b200700 1 -- 172.21.15.157:0/1319859812 shutdown_connections 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.283+0000 7fcf2b200700 1 --2- 172.21.15.157:0/1319859812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c070d60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.283+0000 7fcf2b200700 1 --2- 172.21.15.157:0/1319859812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf2c071ea0 0x7fcf2c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.283+0000 7fcf2b200700 1 -- 172.21.15.157:0/1319859812 >> 172.21.15.157:0/1319859812 conn(0x7fcf2c0f83d0 msgr2=0x7fcf2c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.284+0000 7fcf2b200700 1 -- 172.21.15.157:0/1319859812 shutdown_connections 2024-04-03T08:48:14.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.284+0000 7fcf2b200700 1 -- 172.21.15.157:0/1319859812 wait complete. 2024-04-03T08:48:14.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.285+0000 7fcf2b200700 1 Processor -- start 2024-04-03T08:48:14.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.285+0000 7fcf2b200700 1 -- start start 2024-04-03T08:48:14.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.285+0000 7fcf2b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c10fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:14.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.285+0000 7fcf2b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf2c071ea0 0x7fcf2c10ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.285+0000 7fcf2b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c110570 con 0x7fcf2c0708f0 2024-04-03T08:48:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.285+0000 7fcf2b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c110dc0 con 0x7fcf2c071ea0 2024-04-03T08:48:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c10fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c10fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42996/0 (socket says 172.21.15.157:42996) 2024-04-03T08:48:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29e00700 1 -- 172.21.15.157:0/401316249 learned_addr learned my addr 172.21.15.157:0/401316249 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29400700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf2c071ea0 0x7fcf2c10ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29e00700 1 -- 172.21.15.157:0/401316249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf2c071ea0 msgr2=0x7fcf2c10ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29e00700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf2c071ea0 0x7fcf2c10ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.286+0000 7fcf29e00700 1 -- 172.21.15.157:0/401316249 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18005040 con 0x7fcf2c0708f0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.287+0000 7fcf29e00700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c10fa30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c002a80 tx=0x7fcf1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.287+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1c007cc0 con 0x7fcf2c0708f0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.287+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf1c00f040 con 0x7fcf2c0708f0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.287+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c1110a0 con 0x7fcf2c0708f0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.287+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1c00da30 con 0x7fcf2c0708f0 2024-04-03T08:48:14.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.287+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c1115e0 con 0x7fcf2c0708f0 2024-04-03T08:48:14.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.289+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0fc050 con 0x7fcf2c0708f0 2024-04-03T08:48:14.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.289+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcf1c00db90 con 0x7fcf2c0708f0 2024-04-03T08:48:14.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.290+0000 7fcf22000700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcf1006d7e0 0x7fcf1006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:14.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.290+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fcf1c08cd90 con 0x7fcf2c0708f0 2024-04-03T08:48:14.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.291+0000 7fcf29400700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcf1006d7e0 0x7fcf1006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:14.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.291+0000 7fcf29400700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcf1006d7e0 0x7fcf1006fc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b3b0 tx=0x7fcf18009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:14.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.299+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcf1c059f90 con 0x7fcf2c0708f0 2024-04-03T08:48:14.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.533+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf2c111970 con 0x7fcf1006d7e0 2024-04-03T08:48:14.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.534+0000 7fcf22000700 1 -- 172.21.15.157:0/401316249 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcf2c111970 con 0x7fcf1006d7e0 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcf1006d7e0 msgr2=0x7fcf1006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcf1006d7e0 0x7fcf1006fc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b3b0 tx=0x7fcf18009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 msgr2=0x7fcf2c10fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c10fa30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c002a80 tx=0x7fcf1c004600 comp rx=0 tx=0).stop 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 shutdown_connections 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcf1006d7e0 0x7fcf1006fc90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf2c0708f0 0x7fcf2c10fa30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 --2- 172.21.15.157:0/401316249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf2c071ea0 0x7fcf2c10ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 >> 172.21.15.157:0/401316249 conn(0x7fcf2c0f83d0 msgr2=0x7fcf2c0f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:14.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 shutdown_connections 2024-04-03T08:48:14.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.537+0000 7fcf2b200700 1 -- 172.21.15.157:0/401316249 wait complete. 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 -- 172.21.15.157:0/2646611343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c071f50 msgr2=0x7f8c8c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 --2- 172.21.15.157:0/2646611343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c071f50 0x7f8c8c070460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c80004940 tx=0x7f8c80009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 -- 172.21.15.157:0/2646611343 shutdown_connections 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 --2- 172.21.15.157:0/2646611343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 --2- 172.21.15.157:0/2646611343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c071f50 0x7f8c8c070460 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 -- 172.21.15.157:0/2646611343 >> 172.21.15.157:0/2646611343 conn(0x7f8c8c0f8560 msgr2=0x7f8c8c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 -- 172.21.15.157:0/2646611343 shutdown_connections 2024-04-03T08:48:14.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.678+0000 7f8c93600700 1 -- 172.21.15.157:0/2646611343 wait complete. 2024-04-03T08:48:14.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.679+0000 7f8c93600700 1 Processor -- start 2024-04-03T08:48:14.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.679+0000 7f8c93600700 1 -- start start 2024-04-03T08:48:14.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.679+0000 7f8c93600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.679+0000 7f8c93600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c8c071f50 0x7f8c8c110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.679+0000 7f8c93600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c1107f0 con 0x7f8c8c0709a0 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.679+0000 7f8c93600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c110fe0 con 0x7f8c8c071f50 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c90c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c90c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43008/0 (socket says 172.21.15.157:43008) 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c90c00700 1 -- 172.21.15.157:0/469149515 learned_addr learned my addr 172.21.15.157:0/469149515 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:14.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c8be00700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c8c071f50 0x7f8c8c110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c90c00700 1 -- 172.21.15.157:0/469149515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c8c071f50 msgr2=0x7f8c8c110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c90c00700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c8c071f50 0x7f8c8c110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.680+0000 7f8c90c00700 1 -- 172.21.15.157:0/469149515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80005040 con 0x7f8c8c0709a0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.681+0000 7f8c90c00700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c10fc20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b970 tx=0x7f8c80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.681+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c8000e040 con 0x7f8c8c0709a0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.681+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c80004290 con 0x7f8c8c0709a0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.681+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c111260 con 0x7f8c8c0709a0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.681+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c8001c3f0 con 0x7f8c8c0709a0 2024-04-03T08:48:14.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.681+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c111820 con 0x7f8c8c0709a0 2024-04-03T08:48:14.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.682+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c109590 con 0x7f8c8c0709a0 2024-04-03T08:48:14.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.684+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8c8000bbf0 con 0x7f8c8c0709a0 2024-04-03T08:48:14.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.685+0000 7f8c88c00700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c7406d7f0 0x7f8c7406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:14.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.685+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f8c8008e220 con 0x7f8c8c0709a0 2024-04-03T08:48:14.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.685+0000 7f8c8be00700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c7406d7f0 0x7f8c7406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:14.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.686+0000 7f8c8be00700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c7406d7f0 0x7f8c7406fca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009bf0 tx=0x7f8c780091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:14.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.690+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8c8005b540 con 0x7f8c8c0709a0 2024-04-03T08:48:14.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.945+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c8c111ba0 con 0x7f8c7406d7f0 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.956+0000 7f8c88c00700 1 -- 172.21.15.157:0/469149515 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8c8c111ba0 con 0x7f8c7406d7f0 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (8m) 15s ago 18m 14.0M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (4m) 15s ago 18m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (4m) 65s ago 17m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (7m) 15s ago 18m 76.0M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (48s) 15s ago 12m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:48:14.957 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (21s) 15s ago 12m 9903k - 19.0.0-1670-g1fb5d106 c318aa90b546 c20db495a227 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (12m) 65s ago 12m 14.4M - 17.2.7-805-g6fda41ff a49113eacc58 22eedf37e6c7 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (12m) 65s ago 12m 99.6M - 17.2.7-805-g6fda41ff a49113eacc58 cc4a78e39799 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (6m) 15s ago 20m 508M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (5m) 65s ago 17m 451M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (5m) 15s ago 20m 48.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (5m) 65s ago 17m 35.2M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (8m) 15s ago 18m 7671k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (6m) 65s ago 17m 7574k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (3m) 15s ago 16m 139M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (3m) 15s ago 15m 166M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (3m) 15s ago 15m 106M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (2m) 65s ago 14m 136M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (107s) 65s ago 14m 94.4M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:48:14.958 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (70s) 65s ago 13m 11.0M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:48:14.959 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (6m) 15s ago 17m 52.8M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:48:14.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c7406d7f0 msgr2=0x7f8c7406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c7406d7f0 0x7f8c7406fca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009bf0 tx=0x7f8c780091a0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 msgr2=0x7f8c8c10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:14.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c10fc20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b970 tx=0x7f8c80009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 shutdown_connections 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c7406d7f0 0x7f8c7406fca0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c8c0709a0 0x7f8c8c10fc20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 --2- 172.21.15.157:0/469149515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c8c071f50 0x7f8c8c110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 >> 172.21.15.157:0/469149515 conn(0x7f8c8c0f8560 msgr2=0x7f8c8c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 shutdown_connections 2024-04-03T08:48:14.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:14.959+0000 7f8c93600700 1 -- 172.21.15.157:0/469149515 wait complete. 2024-04-03T08:48:15.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.106+0000 7f13a7e00700 1 -- 172.21.15.157:0/49427967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 msgr2=0x7f13a80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.106+0000 7f13a7e00700 1 --2- 172.21.15.157:0/49427967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a80703b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1398004940 tx=0x7f1398009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.106+0000 7f13a7e00700 1 -- 172.21.15.157:0/49427967 shutdown_connections 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.106+0000 7f13a7e00700 1 --2- 172.21.15.157:0/49427967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13a80708f0 0x7f13a8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.106+0000 7f13a7e00700 1 --2- 172.21.15.157:0/49427967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a80703b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.106+0000 7f13a7e00700 1 -- 172.21.15.157:0/49427967 >> 172.21.15.157:0/49427967 conn(0x7f13a80f83d0 msgr2=0x7f13a80fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.107+0000 7f13a7e00700 1 -- 172.21.15.157:0/49427967 shutdown_connections 2024-04-03T08:48:15.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.107+0000 7f13a7e00700 1 -- 172.21.15.157:0/49427967 wait complete. 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.107+0000 7f13a7e00700 1 Processor -- start 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a7e00700 1 -- start start 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13a80708f0 0x7f13a810fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a810ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8110550 con 0x7f13a8071ea0 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8110da0 con 0x7f13a80708f0 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a6000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a810ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a6000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a810ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43026/0 (socket says 172.21.15.157:43026) 2024-04-03T08:48:15.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.108+0000 7f13a6000700 1 -- 172.21.15.157:0/900375103 learned_addr learned my addr 172.21.15.157:0/900375103 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:15.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a6a00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13a80708f0 0x7f13a810fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a6000700 1 -- 172.21.15.157:0/900375103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13a80708f0 msgr2=0x7f13a810fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a6000700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13a80708f0 0x7f13a810fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a6000700 1 -- 172.21.15.157:0/900375103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398005040 con 0x7f13a8071ea0 2024-04-03T08:48:15.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a6000700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a810ff50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f139400eb40 tx=0x7f139400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:15.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1394007cc0 con 0x7f13a8071ea0 2024-04-03T08:48:15.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a8111020 con 0x7f13a8071ea0 2024-04-03T08:48:15.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f139400f040 con 0x7f13a8071ea0 2024-04-03T08:48:15.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.109+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a8111560 con 0x7f13a8071ea0 2024-04-03T08:48:15.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.110+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13940095c0 con 0x7f13a8071ea0 2024-04-03T08:48:15.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.111+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a805f5f0 con 0x7f13a8071ea0 2024-04-03T08:48:15.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.111+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1394009720 con 0x7f13a8071ea0 2024-04-03T08:48:15.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.112+0000 7f139ea00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f138c06d7f0 0x7f138c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.112+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f139408cc40 con 0x7f13a8071ea0 2024-04-03T08:48:15.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.113+0000 7f13a6a00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f138c06d7f0 0x7f138c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.113+0000 7f13a6a00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f138c06d7f0 0x7f138c06fca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f139800b0d0 tx=0x7f1398009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:15.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.117+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1394059ef0 con 0x7f13a8071ea0 2024-04-03T08:48:15.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.418+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13a8111870 con 0x7f13a8071ea0 2024-04-03T08:48:15.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.418+0000 7f139ea00700 1 -- 172.21.15.157:0/900375103 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f1394059a80 con 0x7f13a8071ea0 2024-04-03T08:48:15.419 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:48:15.419 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:48:15.419 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:48:15.419 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:15.419 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 17.2.7-805-g6fda41ff (6fda41ff74b7f038ecae6f40cc5fca107a3d4207) quincy (stable)": 1, 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 12 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:48:15.420 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.422+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f138c06d7f0 msgr2=0x7f138c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.422+0000 7f13a7e00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f138c06d7f0 0x7f138c06fca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f139800b0d0 tx=0x7f1398009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.422+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 msgr2=0x7f13a810ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.422+0000 7f13a7e00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a810ff50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f139400eb40 tx=0x7f139400b040 comp rx=0 tx=0).stop 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 shutdown_connections 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f138c06d7f0 0x7f138c06fca0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13a80708f0 0x7f13a810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 --2- 172.21.15.157:0/900375103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13a8071ea0 0x7f13a810ff50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 >> 172.21.15.157:0/900375103 conn(0x7f13a80f83d0 msgr2=0x7f13a80f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:15.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 shutdown_connections 2024-04-03T08:48:15.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.423+0000 7f13a7e00700 1 -- 172.21.15.157:0/900375103 wait complete. 2024-04-03T08:48:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:15 smithi157 ceph-mon[117693]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:15 smithi157 ceph-mon[117693]: pgmap v215: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-04-03T08:48:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:15.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:15.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.568+0000 7f06bf200700 1 -- 172.21.15.157:0/3690705386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fce80 msgr2=0x7f06b80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.568+0000 7f06bf200700 1 --2- 172.21.15.157:0/3690705386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fce80 0x7f06b80fd290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06a8004940 tx=0x7f06a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 -- 172.21.15.157:0/3690705386 shutdown_connections 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 --2- 172.21.15.157:0/3690705386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fdff0 0x7f06b80fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 --2- 172.21.15.157:0/3690705386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fce80 0x7f06b80fd290 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 -- 172.21.15.157:0/3690705386 >> 172.21.15.157:0/3690705386 conn(0x7f06b80f8560 msgr2=0x7f06b80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 -- 172.21.15.157:0/3690705386 shutdown_connections 2024-04-03T08:48:15.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 -- 172.21.15.157:0/3690705386 wait complete. 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.569+0000 7f06bf200700 1 Processor -- start 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06bf200700 1 -- start start 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06bf200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fce80 0x7f06b810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06bf200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 0x7f06b8110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06bf200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8110770 con 0x7f06b80fdff0 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06bf200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8110fc0 con 0x7f06b80fce80 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06b7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 0x7f06b8110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06b7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 0x7f06b8110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43036/0 (socket says 172.21.15.157:43036) 2024-04-03T08:48:15.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06b7400700 1 -- 172.21.15.157:0/2632362524 learned_addr learned my addr 172.21.15.157:0/2632362524 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:15.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.570+0000 7f06b7e00700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fce80 0x7f06b810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06b7400700 1 -- 172.21.15.157:0/2632362524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fce80 msgr2=0x7f06b810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06b7400700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fce80 0x7f06b810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06b7400700 1 -- 172.21.15.157:0/2632362524 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8005040 con 0x7f06b80fdff0 2024-04-03T08:48:15.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06b7400700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 0x7f06b8110170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f06a4002a50 tx=0x7f06a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:15.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a4007cc0 con 0x7f06b80fdff0 2024-04-03T08:48:15.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06a400f040 con 0x7f06b80fdff0 2024-04-03T08:48:15.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b81112a0 con 0x7f06b80fdff0 2024-04-03T08:48:15.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.571+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a400da30 con 0x7f06b80fdff0 2024-04-03T08:48:15.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.572+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b81117e0 con 0x7f06b80fdff0 2024-04-03T08:48:15.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.573+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b8101980 con 0x7f06b80fdff0 2024-04-03T08:48:15.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.575+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f06a400db90 con 0x7f06b80fdff0 2024-04-03T08:48:15.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.576+0000 7f06afe00700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f069c06d7f0 0x7f069c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.576+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f06a408ce40 con 0x7f06b80fdff0 2024-04-03T08:48:15.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.577+0000 7f06b7e00700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f069c06d7f0 0x7f069c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.577+0000 7f06b7e00700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f069c06d7f0 0x7f069c06fca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06a800b3b0 tx=0x7f06a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:15.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.581+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f06a4059fe0 con 0x7f06b80fdff0 2024-04-03T08:48:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:15 smithi181 ceph-mon[101094]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:15 smithi181 ceph-mon[101094]: pgmap v215: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-04-03T08:48:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:15.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.846+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06b805f5f0 con 0x7f06b80fdff0 2024-04-03T08:48:15.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.846+0000 7f06afe00700 1 -- 172.21.15.157:0/2632362524 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1698 (secure 0 0 0) 0x7f06a4059b70 con 0x7f06b80fdff0 2024-04-03T08:48:15.847 INFO:teuthology.orchestra.run.smithi157.stdout:e28 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 28 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:48:09.497097+0000 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:48:15.848 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 97 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=34412} 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:48:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{0:34412} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{-1:34444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:48:15.850 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6826/4016903388,v1:172.21.15.181:6827/4016903388] compat {c=[1],r=[1],i=[7ff]}] 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f069c06d7f0 msgr2=0x7f069c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f069c06d7f0 0x7f069c06fca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06a800b3b0 tx=0x7f06a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 msgr2=0x7f06b8110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 0x7f06b8110170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f06a4002a50 tx=0x7f06a40046b0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 shutdown_connections 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f069c06d7f0 0x7f069c06fca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06b80fce80 0x7f06b810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 --2- 172.21.15.157:0/2632362524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06b80fdff0 0x7f06b8110170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 >> 172.21.15.157:0/2632362524 conn(0x7f06b80f8560 msgr2=0x7f06b80f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:15.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 shutdown_connections 2024-04-03T08:48:15.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.849+0000 7f06bf200700 1 -- 172.21.15.157:0/2632362524 wait complete. 2024-04-03T08:48:15.852 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 28 2024-04-03T08:48:15.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.988+0000 7f03cb000700 1 -- 172.21.15.157:0/3126414161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fe0d0 msgr2=0x7f03c40fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.988+0000 7f03cb000700 1 --2- 172.21.15.157:0/3126414161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fe0d0 0x7f03c40fe540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f03b0004940 tx=0x7f03b0009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.988+0000 7f03cb000700 1 -- 172.21.15.157:0/3126414161 shutdown_connections 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.988+0000 7f03cb000700 1 --2- 172.21.15.157:0/3126414161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fe0d0 0x7f03c40fe540 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.988+0000 7f03cb000700 1 --2- 172.21.15.157:0/3126414161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03c40fcee0 0x7f03c40fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.988+0000 7f03cb000700 1 -- 172.21.15.157:0/3126414161 >> 172.21.15.157:0/3126414161 conn(0x7f03c40f8560 msgr2=0x7f03c40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.989+0000 7f03cb000700 1 -- 172.21.15.157:0/3126414161 shutdown_connections 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.989+0000 7f03cb000700 1 -- 172.21.15.157:0/3126414161 wait complete. 2024-04-03T08:48:15.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.990+0000 7f03cb000700 1 Processor -- start 2024-04-03T08:48:15.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.990+0000 7f03cb000700 1 -- start start 2024-04-03T08:48:15.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.990+0000 7f03cb000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 0x7f03c410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.990+0000 7f03cb000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03c40fe0d0 0x7f03c4110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03cb000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4110700 con 0x7f03c40fcee0 2024-04-03T08:48:15.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03cb000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4110f50 con 0x7f03c40fe0d0 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 0x7f03c410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 0x7f03c410fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43056/0 (socket says 172.21.15.157:43056) 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3e00700 1 -- 172.21.15.157:0/2465917322 learned_addr learned my addr 172.21.15.157:0/2465917322 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3400700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03c40fe0d0 0x7f03c4110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3e00700 1 -- 172.21.15.157:0/2465917322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03c40fe0d0 msgr2=0x7f03c4110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3e00700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03c40fe0d0 0x7f03c4110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:15.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.991+0000 7f03c3e00700 1 -- 172.21.15.157:0/2465917322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0005040 con 0x7f03c40fcee0 2024-04-03T08:48:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.992+0000 7f03c3e00700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 0x7f03c410fbc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03b400eb70 tx=0x7f03b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.992+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b4007cc0 con 0x7f03c40fcee0 2024-04-03T08:48:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.992+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03b400f040 con 0x7f03c40fcee0 2024-04-03T08:48:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.992+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c41111d0 con 0x7f03c40fcee0 2024-04-03T08:48:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.992+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b400cb20 con 0x7f03c40fcee0 2024-04-03T08:48:15.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.992+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c4111710 con 0x7f03c40fcee0 2024-04-03T08:48:15.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.993+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c4101a60 con 0x7f03c40fcee0 2024-04-03T08:48:15.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.995+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f03b400cc80 con 0x7f03c40fcee0 2024-04-03T08:48:15.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.996+0000 7f03bbe00700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f03a806d7f0 0x7f03a806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:15.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.996+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f03b408cb00 con 0x7f03c40fcee0 2024-04-03T08:48:15.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.996+0000 7f03c3400700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f03a806d7f0 0x7f03a806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:15.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:15.997+0000 7f03c3400700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f03a806d7f0 0x7f03a806fca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03b000b0d0 tx=0x7f03b0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:16.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.001+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f03b4059d10 con 0x7f03c40fcee0 2024-04-03T08:48:16.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.235+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03c4111930 con 0x7f03a806d7f0 2024-04-03T08:48:16.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.237+0000 7f03bbe00700 1 -- 172.21.15.157:0/2465917322 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f03c4111930 con 0x7f03a806d7f0 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "osd", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "14/21 daemons upgraded", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading mds daemons", 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:48:16.238 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f03a806d7f0 msgr2=0x7f03a806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f03a806d7f0 0x7f03a806fca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03b000b0d0 tx=0x7f03b0009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 msgr2=0x7f03c410fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 0x7f03c410fbc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03b400eb70 tx=0x7f03b400b040 comp rx=0 tx=0).stop 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 shutdown_connections 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f03a806d7f0 0x7f03a806fca0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c40fcee0 0x7f03c410fbc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 --2- 172.21.15.157:0/2465917322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03c40fe0d0 0x7f03c4110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 >> 172.21.15.157:0/2465917322 conn(0x7f03c40f8560 msgr2=0x7f03c40f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:16.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.239+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 shutdown_connections 2024-04-03T08:48:16.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.240+0000 7f03cb000700 1 -- 172.21.15.157:0/2465917322 wait complete. 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 -- 172.21.15.157:0/3007656390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 msgr2=0x7fd7b4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/3007656390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b4070460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8004940 tx=0x7fd7a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 -- 172.21.15.157:0/3007656390 shutdown_connections 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/3007656390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40709a0 0x7fd7b4070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/3007656390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b4070460 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 -- 172.21.15.157:0/3007656390 >> 172.21.15.157:0/3007656390 conn(0x7fd7b40f8560 msgr2=0x7fd7b40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 -- 172.21.15.157:0/3007656390 shutdown_connections 2024-04-03T08:48:16.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.378+0000 7fd7bbc00700 1 -- 172.21.15.157:0/3007656390 wait complete. 2024-04-03T08:48:16.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.379+0000 7fd7bbc00700 1 Processor -- start 2024-04-03T08:48:16.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.379+0000 7fd7bbc00700 1 -- start start 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.379+0000 7fd7bbc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40709a0 0x7fd7b4114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7bbc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b41145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7bbc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4114bb0 con 0x7fd7b4071f50 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7bbc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4115400 con 0x7fd7b40709a0 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b41145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b41145b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43068/0 (socket says 172.21.15.157:43068) 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b3e00700 1 -- 172.21.15.157:0/2805133276 learned_addr learned my addr 172.21.15.157:0/2805133276 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:16.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b9200700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40709a0 0x7fd7b4114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:16.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b3e00700 1 -- 172.21.15.157:0/2805133276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40709a0 msgr2=0x7fd7b4114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:16.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b3e00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40709a0 0x7fd7b4114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.380+0000 7fd7b3e00700 1 -- 172.21.15.157:0/2805133276 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8005040 con 0x7fd7b4071f50 2024-04-03T08:48:16.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.381+0000 7fd7b3e00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b41145b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0002a50 tx=0x7fd7a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:16.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.381+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a0007cc0 con 0x7fd7b4071f50 2024-04-03T08:48:16.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.381+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7a000f040 con 0x7fd7b4071f50 2024-04-03T08:48:16.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.381+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b41156e0 con 0x7fd7b4071f50 2024-04-03T08:48:16.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.381+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a000da70 con 0x7fd7b4071f50 2024-04-03T08:48:16.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.381+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b4115c20 con 0x7fd7b4071f50 2024-04-03T08:48:16.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.382+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b405f5f0 con 0x7fd7b4071f50 2024-04-03T08:48:16.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.383+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd7a000dc10 con 0x7fd7b4071f50 2024-04-03T08:48:16.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.385+0000 7fd7b0c00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd79c06d7f0 0x7fd79c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:16.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.386+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fd7a008c6b0 con 0x7fd7b4071f50 2024-04-03T08:48:16.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.386+0000 7fd7b9200700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd79c06d7f0 0x7fd79c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:16.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.386+0000 7fd7b9200700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd79c06d7f0 0x7fd79c06fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800b3b0 tx=0x7fd7a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:16.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.390+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd7a0059890 con 0x7fd7b4071f50 2024-04-03T08:48:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:16 smithi157 ceph-mon[117693]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:16.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:16 smithi157 ceph-mon[117693]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:16 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/900375103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:16.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:16 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2632362524' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:48:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:16 smithi181 ceph-mon[101094]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:16 smithi181 ceph-mon[101094]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:16 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/900375103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:16.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:16 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2632362524' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:48:16.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.688+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd7b410bfa0 con 0x7fd7b4071f50 2024-04-03T08:48:16.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.689+0000 7fd7b0c00700 1 -- 172.21.15.157:0/2805133276 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fd7a0059420 con 0x7fd7b4071f50 2024-04-03T08:48:16.690 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-03T08:48:16.690 INFO:teuthology.orchestra.run.smithi157.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-03T08:48:16.690 INFO:teuthology.orchestra.run.smithi157.stdout: fs cephfs is degraded 2024-04-03T08:48:16.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd79c06d7f0 msgr2=0x7fd79c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:16.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd79c06d7f0 0x7fd79c06fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800b3b0 tx=0x7fd7a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 msgr2=0x7fd7b41145b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b41145b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0002a50 tx=0x7fd7a00046b0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 shutdown_connections 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd79c06d7f0 0x7fd79c06fca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40709a0 0x7fd7b4114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.691+0000 7fd7bbc00700 1 --2- 172.21.15.157:0/2805133276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7b4071f50 0x7fd7b41145b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.692+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 >> 172.21.15.157:0/2805133276 conn(0x7fd7b40f8560 msgr2=0x7fd7b40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.692+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 shutdown_connections 2024-04-03T08:48:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:16.692+0000 7fd7bbc00700 1 -- 172.21.15.157:0/2805133276 wait complete. 2024-04-03T08:48:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:17 smithi157 ceph-mon[117693]: pgmap v216: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-03T08:48:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:17 smithi157 ceph-mon[117693]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:17.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:17 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2805133276' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:48:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:17 smithi181 ceph-mon[101094]: pgmap v216: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-03T08:48:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:17 smithi181 ceph-mon[101094]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:17 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2805133276' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:48:19.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:19 smithi157 ceph-mon[117693]: pgmap v217: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-03T08:48:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:19 smithi181 ceph-mon[101094]: pgmap v217: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-03T08:48:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:20 smithi157 ceph-mon[117693]: reconnect by client.14544 192.168.0.1:0/68447184 after 0.00099998 2024-04-03T08:48:20.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:20 smithi157 ceph-mon[117693]: reconnect by client.24365 192.168.0.1:0/2560883670 after 0.00099998 2024-04-03T08:48:20.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:20 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:reconnect 2024-04-03T08:48:20.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:20 smithi157 ceph-mon[117693]: fsmap cephfs:1/1 {0=cephfs.smithi157.sodwui=up:reconnect} 2 up:standby 2024-04-03T08:48:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:20 smithi181 ceph-mon[101094]: reconnect by client.14544 192.168.0.1:0/68447184 after 0.00099998 2024-04-03T08:48:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:20 smithi181 ceph-mon[101094]: reconnect by client.24365 192.168.0.1:0/2560883670 after 0.00099998 2024-04-03T08:48:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:20 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:reconnect 2024-04-03T08:48:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:20 smithi181 ceph-mon[101094]: fsmap cephfs:1/1 {0=cephfs.smithi157.sodwui=up:reconnect} 2 up:standby 2024-04-03T08:48:21.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:21 smithi157 ceph-mon[117693]: pgmap v218: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-03T08:48:21.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:21 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:rejoin 2024-04-03T08:48:21.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:21 smithi157 ceph-mon[117693]: fsmap cephfs:1/1 {0=cephfs.smithi157.sodwui=up:rejoin} 2 up:standby 2024-04-03T08:48:21.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:21 smithi157 ceph-mon[117693]: daemon mds.cephfs.smithi157.sodwui is now active in filesystem cephfs as rank 0 2024-04-03T08:48:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:21 smithi181 ceph-mon[101094]: pgmap v218: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-03T08:48:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:21 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:rejoin 2024-04-03T08:48:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:21 smithi181 ceph-mon[101094]: fsmap cephfs:1/1 {0=cephfs.smithi157.sodwui=up:rejoin} 2 up:standby 2024-04-03T08:48:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:21 smithi181 ceph-mon[101094]: daemon mds.cephfs.smithi157.sodwui is now active in filesystem cephfs as rank 0 2024-04-03T08:48:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-03T08:48:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: Cluster is now healthy 2024-04-03T08:48:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:active 2024-04-03T08:48:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2 up:standby 2024-04-03T08:48:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: Cluster is now healthy 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] up:active 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2 up:standby 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:23 smithi157 ceph-mon[117693]: pgmap v219: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-04-03T08:48:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:23 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.181:6824/397415286,v1:172.21.15.181:6825/397415286] up:boot 2024-04-03T08:48:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:23 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 3 up:standby 2024-04-03T08:48:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:48:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:23 smithi181 ceph-mon[101094]: pgmap v219: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-04-03T08:48:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:23 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.181:6824/397415286,v1:172.21.15.181:6825/397415286] up:boot 2024-04-03T08:48:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:23 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 3 up:standby 2024-04-03T08:48:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:48:25.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:25 smithi157 ceph-mon[117693]: pgmap v220: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 85 B/s wr, 3 op/s 2024-04-03T08:48:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:25 smithi181 ceph-mon[101094]: pgmap v220: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 85 B/s wr, 3 op/s 2024-04-03T08:48:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:26.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:26.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:27 smithi157 ceph-mon[117693]: pgmap v221: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-03T08:48:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:27.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:27 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:27 smithi181 ceph-mon[101094]: pgmap v221: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-03T08:48:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:27 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:29 smithi157 ceph-mon[117693]: pgmap v222: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-03T08:48:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:29.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:29 smithi181 ceph-mon[101094]: pgmap v222: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-03T08:48:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: pgmap v223: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 618 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:31.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi181.wksnwz"]}]: dispatch 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: pgmap v223: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 618 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:31.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:31.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi181.wksnwz"]}]: dispatch 2024-04-03T08:48:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:32 smithi157 ceph-mon[117693]: Detected new or changed devices on smithi181 2024-04-03T08:48:32.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:32 smithi157 ceph-mon[117693]: Upgrade: It appears safe to stop mds.cephfs.smithi181.wksnwz 2024-04-03T08:48:32.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:32 smithi181 ceph-mon[101094]: Detected new or changed devices on smithi181 2024-04-03T08:48:32.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:32 smithi181 ceph-mon[101094]: Upgrade: It appears safe to stop mds.cephfs.smithi181.wksnwz 2024-04-03T08:48:33.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:33 smithi157 ceph-mon[117693]: pgmap v224: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 618 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:33.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:33.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:48:33.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:33 smithi181 ceph-mon[101094]: pgmap v224: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 618 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-03T08:48:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi181.wksnwz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-03T08:48:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:34.562 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:34 smithi181 ceph-mon[101094]: Upgrade: Updating mds.cephfs.smithi181.wksnwz 2024-04-03T08:48:34.563 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:34 smithi181 ceph-mon[101094]: Deploying daemon mds.cephfs.smithi181.wksnwz on smithi181 2024-04-03T08:48:34.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:34 smithi157 ceph-mon[117693]: Upgrade: Updating mds.cephfs.smithi181.wksnwz 2024-04-03T08:48:34.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:34 smithi157 ceph-mon[117693]: Deploying daemon mds.cephfs.smithi181.wksnwz on smithi181 2024-04-03T08:48:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:35 smithi157 ceph-mon[117693]: pgmap v225: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-03T08:48:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:35 smithi181 ceph-mon[101094]: pgmap v225: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-03T08:48:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:37 smithi157 ceph-mon[117693]: pgmap v226: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-03T08:48:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:37 smithi157 ceph-mon[117693]: osdmap e98: 6 total, 6 up, 6 in 2024-04-03T08:48:37.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:37 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2 up:standby 2024-04-03T08:48:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:37 smithi181 ceph-mon[101094]: pgmap v226: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-03T08:48:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:37 smithi181 ceph-mon[101094]: osdmap e98: 6 total, 6 up, 6 in 2024-04-03T08:48:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:37 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 2 up:standby 2024-04-03T08:48:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:39 smithi157 ceph-mon[117693]: pgmap v228: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:39.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:39.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:39 smithi181 ceph-mon[101094]: pgmap v228: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:40 smithi181 ceph-mon[101094]: mds.? [v2:172.21.15.181:6826/3661110481,v1:172.21.15.181:6827/3661110481] up:boot 2024-04-03T08:48:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:40 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 3 up:standby 2024-04-03T08:48:40.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:48:40.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:40 smithi157 ceph-mon[117693]: mds.? [v2:172.21.15.181:6826/3661110481,v1:172.21.15.181:6827/3661110481] up:boot 2024-04-03T08:48:40.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:40 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 3 up:standby 2024-04-03T08:48:40.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:48:41.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:41 smithi181 ceph-mon[101094]: pgmap v229: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:41.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:41 smithi157 ceph-mon[117693]: pgmap v229: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:43.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:43.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:43.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:43 smithi157 ceph-mon[117693]: pgmap v230: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:43.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:43.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:43.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:43 smithi181 ceph-mon[101094]: pgmap v230: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:44.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:44.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:44.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:44.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:44.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:44.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:45.495 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:45 smithi181 ceph-mon[101094]: pgmap v231: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:45 smithi157 ceph-mon[117693]: pgmap v231: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:46.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 -- 172.21.15.157:0/1734891522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fe0d0 msgr2=0x7f27540fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 --2- 172.21.15.157:0/1734891522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fe0d0 0x7f27540fe540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2740004940 tx=0x7f2740009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 -- 172.21.15.157:0/1734891522 shutdown_connections 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 --2- 172.21.15.157:0/1734891522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fe0d0 0x7f27540fe540 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 --2- 172.21.15.157:0/1734891522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27540fcee0 0x7f27540fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 -- 172.21.15.157:0/1734891522 >> 172.21.15.157:0/1734891522 conn(0x7f27540f8560 msgr2=0x7f27540fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.840+0000 7f275b200700 1 -- 172.21.15.157:0/1734891522 shutdown_connections 2024-04-03T08:48:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.841+0000 7f275b200700 1 -- 172.21.15.157:0/1734891522 wait complete. 2024-04-03T08:48:46.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.841+0000 7f275b200700 1 Processor -- start 2024-04-03T08:48:46.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.841+0000 7f275b200700 1 -- start start 2024-04-03T08:48:46.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f275b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 0x7f275410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f275b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27540fe0d0 0x7f2754110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f275b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754110700 con 0x7f27540fcee0 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f275b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754110f50 con 0x7f27540fe0d0 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f2753e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 0x7f275410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f2753e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 0x7f275410fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42422/0 (socket says 172.21.15.157:42422) 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f2753e00700 1 -- 172.21.15.157:0/402493441 learned_addr learned my addr 172.21.15.157:0/402493441 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f2753400700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27540fe0d0 0x7f2754110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f2753e00700 1 -- 172.21.15.157:0/402493441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27540fe0d0 msgr2=0x7f2754110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.842+0000 7f2753e00700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27540fe0d0 0x7f2754110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f2753e00700 1 -- 172.21.15.157:0/402493441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740005040 con 0x7f27540fcee0 2024-04-03T08:48:46.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f2753e00700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 0x7f275410fbc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f274400eb70 tx=0x7f274400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:46.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2744007cc0 con 0x7f27540fcee0 2024-04-03T08:48:46.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f274400f040 con 0x7f27540fcee0 2024-04-03T08:48:46.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274400cb20 con 0x7f27540fcee0 2024-04-03T08:48:46.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27541111d0 con 0x7f27540fcee0 2024-04-03T08:48:46.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.843+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2754111710 con 0x7f27540fcee0 2024-04-03T08:48:46.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.844+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2754101a60 con 0x7f27540fcee0 2024-04-03T08:48:46.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.845+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f274400cc80 con 0x7f27540fcee0 2024-04-03T08:48:46.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.846+0000 7f274be00700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f273806d7f0 0x7f273806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:46.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.846+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f274408ca20 con 0x7f27540fcee0 2024-04-03T08:48:46.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.846+0000 7f2753400700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f273806d7f0 0x7f273806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:46.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.847+0000 7f2753400700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f273806d7f0 0x7f273806fca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f274000b0d0 tx=0x7f2740009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:46.851+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2744059cb0 con 0x7f27540fcee0 2024-04-03T08:48:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.073+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2754111980 con 0x7f273806d7f0 2024-04-03T08:48:47.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.074+0000 7f274be00700 1 -- 172.21.15.157:0/402493441 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2754111980 con 0x7f273806d7f0 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f273806d7f0 msgr2=0x7f273806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f273806d7f0 0x7f273806fca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f274000b0d0 tx=0x7f2740009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 msgr2=0x7f275410fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 0x7f275410fbc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f274400eb70 tx=0x7f274400b040 comp rx=0 tx=0).stop 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 shutdown_connections 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f273806d7f0 0x7f273806fca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27540fcee0 0x7f275410fbc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 --2- 172.21.15.157:0/402493441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27540fe0d0 0x7f2754110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 >> 172.21.15.157:0/402493441 conn(0x7f27540f8560 msgr2=0x7f27540f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:47.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 shutdown_connections 2024-04-03T08:48:47.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.077+0000 7f275b200700 1 -- 172.21.15.157:0/402493441 wait complete. 2024-04-03T08:48:47.093 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:48:47.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 -- 172.21.15.157:0/927230923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 msgr2=0x7fc1e00fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/927230923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e00fe540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc004940 tx=0x7fc1cc009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:47.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 -- 172.21.15.157:0/927230923 shutdown_connections 2024-04-03T08:48:47.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/927230923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e00fe540 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/927230923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 0x7fc1e00fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 -- 172.21.15.157:0/927230923 >> 172.21.15.157:0/927230923 conn(0x7fc1e00f8560 msgr2=0x7fc1e00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:47.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 -- 172.21.15.157:0/927230923 shutdown_connections 2024-04-03T08:48:47.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.213+0000 7fc1e6e00700 1 -- 172.21.15.157:0/927230923 wait complete. 2024-04-03T08:48:47.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.214+0000 7fc1e6e00700 1 Processor -- start 2024-04-03T08:48:47.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.214+0000 7fc1e6e00700 1 -- start start 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1e6e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 0x7fc1e010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1e6e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1e6e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0110700 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1e6e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0110f50 con 0x7fc1e00fcee0 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e0110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42452/0 (socket says 172.21.15.157:42452) 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 -- 172.21.15.157:0/2122858923 learned_addr learned my addr 172.21.15.157:0/2122858923 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:47.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1dfe00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 0x7fc1e010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 -- 172.21.15.157:0/2122858923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 msgr2=0x7fc1e010fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 0x7fc1e010fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 -- 172.21.15.157:0/2122858923 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc005040 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1dfe00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 0x7fc1e010fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.215+0000 7fc1df400700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e0110100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00b0d0 tx=0x7fc1cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.216+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1cc00e070 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.216+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1cc01d460 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.216+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e01111d0 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.216+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1cc00b610 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.216+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e0111710 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.217+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0101a60 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.218+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc1cc01d5d0 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.219+0000 7fc1d7e00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc1c406d7f0 0x7fc1c406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.219+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fc1cc08df00 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.219+0000 7fc1dfe00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc1c406d7f0 0x7fc1c406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.220+0000 7fc1dfe00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc1c406d7f0 0x7fc1c406fca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009b80 tx=0x7fc1d000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:47.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.223+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc1cc05b210 con 0x7fc1e00fe0d0 2024-04-03T08:48:47.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.449+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e0105b50 con 0x7fc1c406d7f0 2024-04-03T08:48:47.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.450+0000 7fc1d7e00700 1 -- 172.21.15.157:0/2122858923 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc1e0105b50 con 0x7fc1c406d7f0 2024-04-03T08:48:47.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.452+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc1c406d7f0 msgr2=0x7fc1c406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.452+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc1c406d7f0 0x7fc1c406fca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009b80 tx=0x7fc1d000b040 comp rx=0 tx=0).stop 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.452+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 msgr2=0x7fc1e0110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.452+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e0110100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00b0d0 tx=0x7fc1cc009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 shutdown_connections 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc1c406d7f0 0x7fc1c406fca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1e00fcee0 0x7fc1e010fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 --2- 172.21.15.157:0/2122858923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e00fe0d0 0x7fc1e0110100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 >> 172.21.15.157:0/2122858923 conn(0x7fc1e00f8560 msgr2=0x7fc1e00f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 shutdown_connections 2024-04-03T08:48:47.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.453+0000 7fc1e6e00700 1 -- 172.21.15.157:0/2122858923 wait complete. 2024-04-03T08:48:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:47 smithi157 ceph-mon[117693]: pgmap v232: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 -- 172.21.15.157:0/285551836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fcee0 msgr2=0x7f25d80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 --2- 172.21.15.157:0/285551836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fcee0 0x7f25d80fd310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f25c8004940 tx=0x7f25c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 -- 172.21.15.157:0/285551836 shutdown_connections 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 --2- 172.21.15.157:0/285551836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d80fe0d0 0x7f25d80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 --2- 172.21.15.157:0/285551836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fcee0 0x7f25d80fd310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 -- 172.21.15.157:0/285551836 >> 172.21.15.157:0/285551836 conn(0x7f25d80f8560 msgr2=0x7f25d80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 -- 172.21.15.157:0/285551836 shutdown_connections 2024-04-03T08:48:47.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.587+0000 7f25dd800700 1 -- 172.21.15.157:0/285551836 wait complete. 2024-04-03T08:48:47.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25dd800700 1 Processor -- start 2024-04-03T08:48:47.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25dd800700 1 -- start start 2024-04-03T08:48:47.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25dd800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d80fcee0 0x7f25d8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25dd800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 0x7f25d8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25dd800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8070950 con 0x7f25d80fe0d0 2024-04-03T08:48:47.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25dd800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8070ac0 con 0x7f25d80fcee0 2024-04-03T08:48:47.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25cfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 0x7f25d8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25cfe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 0x7f25d8070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42470/0 (socket says 172.21.15.157:42470) 2024-04-03T08:48:47.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25cfe00700 1 -- 172.21.15.157:0/2767157163 learned_addr learned my addr 172.21.15.157:0/2767157163 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:47.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.588+0000 7f25d6a00700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d80fcee0 0x7f25d8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cfe00700 1 -- 172.21.15.157:0/2767157163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d80fcee0 msgr2=0x7f25d8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cfe00700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d80fcee0 0x7f25d8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cfe00700 1 -- 172.21.15.157:0/2767157163 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8005040 con 0x7f25d80fe0d0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cfe00700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 0x7f25d8070310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b790 tx=0x7f25c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c000f6f0 con 0x7f25d80fe0d0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25c000fd20 con 0x7f25d80fe0d0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d8070da0 con 0x7f25d80fe0d0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d8115b00 con 0x7f25d80fe0d0 2024-04-03T08:48:47.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.589+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c00103a0 con 0x7f25d80fe0d0 2024-04-03T08:48:47.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.591+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d805f5f0 con 0x7f25d80fe0d0 2024-04-03T08:48:47.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.592+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f25c0011400 con 0x7f25d80fe0d0 2024-04-03T08:48:47.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.593+0000 7f25cea00700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f25bc06d7f0 0x7f25bc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.593+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f25c008cee0 con 0x7f25d80fe0d0 2024-04-03T08:48:47.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.593+0000 7f25d6a00700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f25bc06d7f0 0x7f25bc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.593+0000 7f25d6a00700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f25bc06d7f0 0x7f25bc06fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25c8000c00 tx=0x7f25c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:47 smithi181 ceph-mon[101094]: pgmap v232: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:47.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.597+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f25c0056590 con 0x7f25d80fe0d0 2024-04-03T08:48:47.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.820+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f25d81023f0 con 0x7f25bc06d7f0 2024-04-03T08:48:47.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.829+0000 7f25cea00700 1 -- 172.21.15.157:0/2767157163 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f25d81023f0 con 0x7f25bc06d7f0 2024-04-03T08:48:47.831 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:48:47.831 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (8m) 48s ago 18m 14.0M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:48:47.831 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (5m) 48s ago 19m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (4m) 5s ago 18m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (7m) 48s ago 18m 76.0M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (81s) 48s ago 12m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (54s) 48s ago 12m 9903k - 19.0.0-1670-g1fb5d106 c318aa90b546 c20db495a227 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (26s) 5s ago 12m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 2a5ba2586b49 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (9s) 5s ago 12m 10.9M - 19.0.0-1670-g1fb5d106 c318aa90b546 60490a032fca 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (7m) 48s ago 20m 508M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (6m) 5s ago 17m 451M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (6m) 48s ago 20m 48.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (5m) 5s ago 17m 40.5M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (8m) 48s ago 19m 7671k - 1.5.0 0da6a335fe13 27dc2e38ce7a 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (7m) 5s ago 17m 8396k - 1.5.0 0da6a335fe13 46d35f60b808 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (4m) 48s ago 16m 139M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:48:47.832 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (4m) 48s ago 16m 166M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:48:47.833 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (3m) 48s ago 15m 106M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:48:47.833 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (2m) 5s ago 15m 137M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:48:47.833 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (2m) 5s ago 14m 97.2M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:48:47.833 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (103s) 5s ago 14m 94.7M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:48:47.833 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (6m) 48s ago 18m 52.8M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f25bc06d7f0 msgr2=0x7f25bc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f25bc06d7f0 0x7f25bc06fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25c8000c00 tx=0x7f25c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 msgr2=0x7f25d8070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 0x7f25d8070310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b790 tx=0x7f25c0009250 comp rx=0 tx=0).stop 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 shutdown_connections 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f25bc06d7f0 0x7f25bc06fca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d80fcee0 0x7f25d8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 --2- 172.21.15.157:0/2767157163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25d80fe0d0 0x7f25d8070310 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 >> 172.21.15.157:0/2767157163 conn(0x7f25d80f8560 msgr2=0x7f25d80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 shutdown_connections 2024-04-03T08:48:47.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.832+0000 7f25dd800700 1 -- 172.21.15.157:0/2767157163 wait complete. 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 -- 172.21.15.157:0/918138303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 msgr2=0x7f643c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 --2- 172.21.15.157:0/918138303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c0fe540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6428004940 tx=0x7f6428009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 -- 172.21.15.157:0/918138303 shutdown_connections 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 --2- 172.21.15.157:0/918138303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c0fe540 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 --2- 172.21.15.157:0/918138303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c0fcee0 0x7f643c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 -- 172.21.15.157:0/918138303 >> 172.21.15.157:0/918138303 conn(0x7f643c0f8560 msgr2=0x7f643c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 -- 172.21.15.157:0/918138303 shutdown_connections 2024-04-03T08:48:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.976+0000 7f6441e00700 1 -- 172.21.15.157:0/918138303 wait complete. 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f6441e00700 1 Processor -- start 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f6441e00700 1 -- start start 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f6441e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c0fcee0 0x7f643c071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f6441e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f6441e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0708a0 con 0x7f643c0fe0d0 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f6441e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0709e0 con 0x7f643c0fcee0 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f643a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f643a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42486/0 (socket says 172.21.15.157:42486) 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f643a000700 1 -- 172.21.15.157:0/3702871942 learned_addr learned my addr 172.21.15.157:0/3702871942 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.977+0000 7f643aa00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c0fcee0 0x7f643c071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f643a000700 1 -- 172.21.15.157:0/3702871942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c0fcee0 msgr2=0x7f643c071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f643a000700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c0fcee0 0x7f643c071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f643a000700 1 -- 172.21.15.157:0/3702871942 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428005040 con 0x7f643c0fe0d0 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f643a000700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c070310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f642800b0d0 tx=0x7f6428009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f642800e070 con 0x7f643c0fe0d0 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f642801d460 con 0x7f643c0fe0d0 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f642800b610 con 0x7f643c0fe0d0 2024-04-03T08:48:47.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.978+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c070c60 con 0x7f643c0fe0d0 2024-04-03T08:48:47.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.979+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c115a40 con 0x7f643c0fe0d0 2024-04-03T08:48:47.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.980+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c05f5f0 con 0x7f643c0fe0d0 2024-04-03T08:48:47.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.980+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f642801d5d0 con 0x7f643c0fe0d0 2024-04-03T08:48:47.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.981+0000 7f6432a00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f642006d7f0 0x7f642006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:47.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.981+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f642808dff0 con 0x7f643c0fe0d0 2024-04-03T08:48:47.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.982+0000 7f643aa00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f642006d7f0 0x7f642006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:47.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.982+0000 7f643aa00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f642006d7f0 0x7f642006fca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f643c071b80 tx=0x7f642c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:47.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:47.986+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f64280c1d20 con 0x7f643c0fe0d0 2024-04-03T08:48:48.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.269+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f643c115c30 con 0x7f643c0fe0d0 2024-04-03T08:48:48.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.270+0000 7f6432a00700 1 -- 172.21.15.157:0/3702871942 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6428022280 con 0x7f643c0fe0d0 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:48.272 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:48:48.273 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:48:48.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:48:48.273 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:48:48.273 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-04-03T08:48:48.273 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:48:48.273 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f642006d7f0 msgr2=0x7f642006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f642006d7f0 0x7f642006fca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f643c071b80 tx=0x7f642c00b040 comp rx=0 tx=0).stop 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 msgr2=0x7f643c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c070310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f642800b0d0 tx=0x7f6428009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 shutdown_connections 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f642006d7f0 0x7f642006fca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c0fcee0 0x7f643c071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 --2- 172.21.15.157:0/3702871942 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f643c0fe0d0 0x7f643c070310 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 >> 172.21.15.157:0/3702871942 conn(0x7f643c0f8560 msgr2=0x7f643c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:48.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 shutdown_connections 2024-04-03T08:48:48.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.272+0000 7f6441e00700 1 -- 172.21.15.157:0/3702871942 wait complete. 2024-04-03T08:48:48.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.407+0000 7f3c00000700 1 -- 172.21.15.157:0/931081808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fe0d0 msgr2=0x7f3bf80fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.407+0000 7f3c00000700 1 --2- 172.21.15.157:0/931081808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf80fe540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3be4004940 tx=0x7f3be4009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 -- 172.21.15.157:0/931081808 shutdown_connections 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 --2- 172.21.15.157:0/931081808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf80fe540 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 --2- 172.21.15.157:0/931081808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fcee0 0x7f3bf80fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 -- 172.21.15.157:0/931081808 >> 172.21.15.157:0/931081808 conn(0x7f3bf80f8560 msgr2=0x7f3bf80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 -- 172.21.15.157:0/931081808 shutdown_connections 2024-04-03T08:48:48.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 -- 172.21.15.157:0/931081808 wait complete. 2024-04-03T08:48:48.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.408+0000 7f3c00000700 1 Processor -- start 2024-04-03T08:48:48.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3c00000700 1 -- start start 2024-04-03T08:48:48.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3c00000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 0x7f3bf810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3c00000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf8110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3c00000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8110850 con 0x7f3bf80fcee0 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3c00000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8110f90 con 0x7f3bf80fe0d0 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3bfd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 0x7f3bf810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3bfd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 0x7f3bf810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42512/0 (socket says 172.21.15.157:42512) 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3bfd600700 1 -- 172.21.15.157:0/2554848914 learned_addr learned my addr 172.21.15.157:0/2554848914 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.409+0000 7f3bfcc00700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf8110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bfd600700 1 -- 172.21.15.157:0/2554848914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fe0d0 msgr2=0x7f3bf8110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bfd600700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf8110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bfd600700 1 -- 172.21.15.157:0/2554848914 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4005040 con 0x7f3bf80fcee0 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bfcc00700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:48:48.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bfd600700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 0x7f3bf810fd10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3bec002a80 tx=0x7f3bec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:48.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bec007cc0 con 0x7f3bf80fcee0 2024-04-03T08:48:48.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bec00f040 con 0x7f3bf80fcee0 2024-04-03T08:48:48.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf8111270 con 0x7f3bf80fcee0 2024-04-03T08:48:48.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bec00dad0 con 0x7f3bf80fcee0 2024-04-03T08:48:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.410+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf8111830 con 0x7f3bf80fcee0 2024-04-03T08:48:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.411+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf8101a60 con 0x7f3bf80fcee0 2024-04-03T08:48:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.412+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3bec00dc30 con 0x7f3bf80fcee0 2024-04-03T08:48:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.413+0000 7f3bf5600700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3be006d7f0 0x7f3be006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.413+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f3bec08cea0 con 0x7f3bf80fcee0 2024-04-03T08:48:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.413+0000 7f3bfcc00700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3be006d7f0 0x7f3be006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.414+0000 7f3bfcc00700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3be006d7f0 0x7f3be006fca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b7a0 tx=0x7f3be4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:48.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.417+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3bec05a000 con 0x7f3bf80fcee0 2024-04-03T08:48:48.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:48:48.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.sodwui"}]': finished 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.zlscrk"}]': finished 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.ecaerp"}]': finished 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.wksnwz"}]': finished 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-03T08:48:48.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:48 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3702871942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.sodwui"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.sodwui"}]': finished 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.zlscrk"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.zlscrk"}]': finished 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.ecaerp"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.ecaerp"}]': finished 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.wksnwz"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi181.wksnwz"}]': finished 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-03T08:48:48.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:48 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3702871942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:48.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.664+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3bf8111a50 con 0x7f3bf80fcee0 2024-04-03T08:48:48.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.665+0000 7f3bf5600700 1 -- 172.21.15.157:0/2554848914 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1875 (secure 0 0 0) 0x7f3bec059b90 con 0x7f3bf80fcee0 2024-04-03T08:48:48.667 INFO:teuthology.orchestra.run.smithi157.stdout:e34 2024-04-03T08:48:48.667 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:48:48.667 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:48:48.667 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:48:48.667 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 31 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:48:20.317409+0000 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:48:48.668 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 97 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=34412} 2024-04-03T08:48:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:48:48.670 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{0:34412} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{-1:34444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:44387} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/397415286,v1:172.21.15.181:6825/397415286] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:48:48.671 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{-1:44391} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6826/3661110481,v1:172.21.15.181:6827/3661110481] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:48:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3be006d7f0 msgr2=0x7f3be006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3be006d7f0 0x7f3be006fca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b7a0 tx=0x7f3be4009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 msgr2=0x7f3bf810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 0x7f3bf810fd10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3bec002a80 tx=0x7f3bec004600 comp rx=0 tx=0).stop 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 shutdown_connections 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f3be006d7f0 0x7f3be006fca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bf80fcee0 0x7f3bf810fd10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 --2- 172.21.15.157:0/2554848914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf80fe0d0 0x7f3bf8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 >> 172.21.15.157:0/2554848914 conn(0x7f3bf80f8560 msgr2=0x7f3bf80f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 shutdown_connections 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.667+0000 7f3c00000700 1 -- 172.21.15.157:0/2554848914 wait complete. 2024-04-03T08:48:48.673 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 34 2024-04-03T08:48:48.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 -- 172.21.15.157:0/1061070585 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 msgr2=0x7fa7580fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 --2- 172.21.15.157:0/1061070585 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa7580fe540 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa748004940 tx=0x7fa748009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 -- 172.21.15.157:0/1061070585 shutdown_connections 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 --2- 172.21.15.157:0/1061070585 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa7580fe540 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 --2- 172.21.15.157:0/1061070585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7580fcee0 0x7fa7580fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 -- 172.21.15.157:0/1061070585 >> 172.21.15.157:0/1061070585 conn(0x7fa7580f8560 msgr2=0x7fa7580fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 -- 172.21.15.157:0/1061070585 shutdown_connections 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.806+0000 7fa760800700 1 -- 172.21.15.157:0/1061070585 wait complete. 2024-04-03T08:48:48.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.807+0000 7fa760800700 1 Processor -- start 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.807+0000 7fa760800700 1 -- start start 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.807+0000 7fa760800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7580fcee0 0x7fa75810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.807+0000 7fa760800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa758110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.807+0000 7fa760800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758110850 con 0x7fa7580fe0d0 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.807+0000 7fa760800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758110f90 con 0x7fa7580fcee0 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa758110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa758110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42526/0 (socket says 172.21.15.157:42526) 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 -- 172.21.15.157:0/1968206469 learned_addr learned my addr 172.21.15.157:0/1968206469 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75de00700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7580fcee0 0x7fa75810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 -- 172.21.15.157:0/1968206469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7580fcee0 msgr2=0x7fa75810fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7580fcee0 0x7fa75810fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 -- 172.21.15.157:0/1968206469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748005040 con 0x7fa7580fe0d0 2024-04-03T08:48:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.808+0000 7fa75d400700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa758110250 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa748009150 tx=0x7fa748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.809+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74800e040 con 0x7fa7580fe0d0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.809+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa74800bbf0 con 0x7fa7580fe0d0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.809+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758111210 con 0x7fa7580fe0d0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.809+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74801c630 con 0x7fa7580fe0d0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.809+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7581117d0 con 0x7fa7580fe0d0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.810+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa758101a60 con 0x7fa7580fe0d0 2024-04-03T08:48:48.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.811+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa74800bd60 con 0x7fa7580fe0d0 2024-04-03T08:48:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.812+0000 7fa752000700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa74006d7f0 0x7fa74006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.812+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa74808e2b0 con 0x7fa7580fe0d0 2024-04-03T08:48:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.812+0000 7fa75de00700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa74006d7f0 0x7fa74006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:48.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.813+0000 7fa75de00700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa74006d7f0 0x7fa74006fca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7580fcc20 tx=0x7fa74c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:48.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:48.817+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa74805b5d0 con 0x7fa7580fe0d0 2024-04-03T08:48:49.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.085+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa758111a40 con 0x7fa74006d7f0 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.087+0000 7fa752000700 1 -- 172.21.15.157:0/1968206469 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fa758111a40 con 0x7fa74006d7f0 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "osd", 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "mds", 2024-04-03T08:48:49.089 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "16/21 daemons upgraded", 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:48:49.090 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:48:49.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.089+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa74006d7f0 msgr2=0x7fa74006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:49.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.089+0000 7fa760800700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa74006d7f0 0x7fa74006fca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7580fcc20 tx=0x7fa74c00b040 comp rx=0 tx=0).stop 2024-04-03T08:48:49.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.089+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 msgr2=0x7fa758110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.089+0000 7fa760800700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa758110250 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa748009150 tx=0x7fa748009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 shutdown_connections 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa74006d7f0 0x7fa74006fca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7580fcee0 0x7fa75810fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 --2- 172.21.15.157:0/1968206469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7580fe0d0 0x7fa758110250 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 >> 172.21.15.157:0/1968206469 conn(0x7fa7580f8560 msgr2=0x7fa7580f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:49.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 shutdown_connections 2024-04-03T08:48:49.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.090+0000 7fa760800700 1 -- 172.21.15.157:0/1968206469 wait complete. 2024-04-03T08:48:49.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.268+0000 7fb723e00700 1 -- 172.21.15.157:0/944206615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0662e0 msgr2=0x7fb71c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:49.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.268+0000 7fb723e00700 1 --2- 172.21.15.157:0/944206615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0662e0 0x7fb71c0ff9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb710004940 tx=0x7fb710009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.268+0000 7fb723e00700 1 -- 172.21.15.157:0/944206615 shutdown_connections 2024-04-03T08:48:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.268+0000 7fb723e00700 1 --2- 172.21.15.157:0/944206615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0fff00 0x7fb71c102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.268+0000 7fb723e00700 1 --2- 172.21.15.157:0/944206615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0662e0 0x7fb71c0ff9c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.268+0000 7fb723e00700 1 -- 172.21.15.157:0/944206615 >> 172.21.15.157:0/944206615 conn(0x7fb71c0f7430 msgr2=0x7fb71c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.269+0000 7fb723e00700 1 -- 172.21.15.157:0/944206615 shutdown_connections 2024-04-03T08:48:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.269+0000 7fb723e00700 1 -- 172.21.15.157:0/944206615 wait complete. 2024-04-03T08:48:49.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.270+0000 7fb723e00700 1 Processor -- start 2024-04-03T08:48:49.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.270+0000 7fb723e00700 1 -- start start 2024-04-03T08:48:49.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb723e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 0x7fb71c1070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb723e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0fff00 0x7fb71c1075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb723e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c107c40 con 0x7fb71c0fff00 2024-04-03T08:48:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb723e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c108440 con 0x7fb71c0662e0 2024-04-03T08:48:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb720a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0fff00 0x7fb71c1075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb721400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 0x7fb71c1070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb721400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 0x7fb71c1070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:56344/0 (socket says 172.21.15.157:56344) 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.271+0000 7fb721400700 1 -- 172.21.15.157:0/2922949318 learned_addr learned my addr 172.21.15.157:0/2922949318 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.272+0000 7fb721400700 1 -- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0fff00 msgr2=0x7fb71c1075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.272+0000 7fb721400700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0fff00 0x7fb71c1075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.272+0000 7fb721400700 1 -- 172.21.15.157:0/2922949318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710005040 con 0x7fb71c0662e0 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.272+0000 7fb721400700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 0x7fb71c1070b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb71000b970 tx=0x7fb710009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.273+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71000e040 con 0x7fb71c0662e0 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.273+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb710004290 con 0x7fb71c0662e0 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.273+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71001c3f0 con 0x7fb71c0662e0 2024-04-03T08:48:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.273+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c108640 con 0x7fb71c0662e0 2024-04-03T08:48:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.274+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c108bd0 con 0x7fb71c0662e0 2024-04-03T08:48:49.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.276+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb71000bbf0 con 0x7fb71c0662e0 2024-04-03T08:48:49.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.276+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c05f5f0 con 0x7fb71c0662e0 2024-04-03T08:48:49.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.277+0000 7fb719600700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb70406d7f0 0x7fb70406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:48:49.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.277+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fb71008dff0 con 0x7fb71c0662e0 2024-04-03T08:48:49.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.278+0000 7fb720a00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb70406d7f0 0x7fb70406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:48:49.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.278+0000 7fb720a00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb70406d7f0 0x7fb70406fca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb708004f40 tx=0x7fb70800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:48:49.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.282+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb7100577e0 con 0x7fb71c0662e0 2024-04-03T08:48:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all mds 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: pgmap v233: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2554848914' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all mds 2024-04-03T08:48:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-03T08:48:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: pgmap v233: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2554848914' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: fsmap cephfs:1 {0=cephfs.smithi157.sodwui=up:active} 1 up:standby-replay 2 up:standby 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:48:49.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:49.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.730+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb71c1058c0 con 0x7fb71c0662e0 2024-04-03T08:48:49.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.730+0000 7fb719600700 1 -- 172.21.15.157:0/2922949318 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb71005aea0 con 0x7fb71c0662e0 2024-04-03T08:48:49.733 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:48:49.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb70406d7f0 msgr2=0x7fb70406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:49.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb70406d7f0 0x7fb70406fca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb708004f40 tx=0x7fb70800b040 comp rx=0 tx=0).stop 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 msgr2=0x7fb71c1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 0x7fb71c1070b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb71000b970 tx=0x7fb710009e30 comp rx=0 tx=0).stop 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 shutdown_connections 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb70406d7f0 0x7fb70406fca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c0662e0 0x7fb71c1070b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 --2- 172.21.15.157:0/2922949318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb71c0fff00 0x7fb71c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 >> 172.21.15.157:0/2922949318 conn(0x7fb71c0f7430 msgr2=0x7fb71c0fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.733+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 shutdown_connections 2024-04-03T08:48:49.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:48:49.734+0000 7fb723e00700 1 -- 172.21.15.157:0/2922949318 wait complete. 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all rgw 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all rbd-mirror 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all ceph-exporter 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all iscsi 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all nfs 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: Upgrade: Setting container_image for all nvmeof 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:50.454 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:50 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2922949318' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:48:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all rgw 2024-04-03T08:48:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all rbd-mirror 2024-04-03T08:48:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all ceph-exporter 2024-04-03T08:48:50.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all iscsi 2024-04-03T08:48:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all nfs 2024-04-03T08:48:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: Upgrade: Setting container_image for all nvmeof 2024-04-03T08:48:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:48:50.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:50 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2922949318' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:48:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:51 smithi181 ceph-mon[101094]: pgmap v234: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1024 KiB/s rd, 0 op/s 2024-04-03T08:48:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:51 smithi157 ceph-mon[117693]: pgmap v234: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1024 KiB/s rd, 0 op/s 2024-04-03T08:48:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:52 smithi181 ceph-mon[101094]: Upgrade: Updating node-exporter.smithi157 (1/2) 2024-04-03T08:48:52.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:52 smithi181 ceph-mon[101094]: Deploying daemon node-exporter.smithi157 on smithi157 2024-04-03T08:48:52.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:52 smithi157 ceph-mon[117693]: Upgrade: Updating node-exporter.smithi157 (1/2) 2024-04-03T08:48:52.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:52 smithi157 ceph-mon[117693]: Deploying daemon node-exporter.smithi157 on smithi157 2024-04-03T08:48:53.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:53 smithi181 ceph-mon[101094]: pgmap v235: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-04-03T08:48:53.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:53 smithi157 ceph-mon[117693]: pgmap v235: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-04-03T08:48:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:55 smithi157 ceph-mon[117693]: pgmap v236: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-04-03T08:48:55.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:55 smithi181 ceph-mon[101094]: pgmap v236: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-04-03T08:48:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:57 smithi181 ceph-mon[101094]: pgmap v237: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-04-03T08:48:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:57.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:57 smithi157 ceph-mon[117693]: pgmap v237: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-04-03T08:48:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:57.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:48:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:59 smithi181 ceph-mon[101094]: pgmap v238: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-03T08:48:59.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:48:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:48:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:59 smithi157 ceph-mon[117693]: pgmap v238: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-03T08:48:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:48:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:00 smithi181 ceph-mon[101094]: Upgrade: Updating node-exporter.smithi181 (2/2) 2024-04-03T08:49:00.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:00 smithi181 ceph-mon[101094]: Deploying daemon node-exporter.smithi181 on smithi181 2024-04-03T08:49:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:00 smithi157 ceph-mon[117693]: Upgrade: Updating node-exporter.smithi181 (2/2) 2024-04-03T08:49:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:00 smithi157 ceph-mon[117693]: Deploying daemon node-exporter.smithi181 on smithi181 2024-04-03T08:49:01.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:01 smithi181 ceph-mon[101094]: pgmap v239: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-03T08:49:01.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:01 smithi157 ceph-mon[117693]: pgmap v239: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-03T08:49:03.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:02 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:03.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:02 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:03.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:02 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:03.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:02 smithi157 ceph-mon[117693]: pgmap v240: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-03T08:49:03.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:02 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:03.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:02 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:03.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:02 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:03.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:02 smithi181 ceph-mon[101094]: pgmap v240: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-03T08:49:05.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:05 smithi157 ceph-mon[117693]: pgmap v241: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 2 op/s 2024-04-03T08:49:05.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:05.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:05 smithi181 ceph-mon[101094]: pgmap v241: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 2 op/s 2024-04-03T08:49:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:05.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:07.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:07 smithi181 ceph-mon[101094]: pgmap v242: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 2 op/s 2024-04-03T08:49:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:07 smithi157 ceph-mon[117693]: pgmap v242: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 2 op/s 2024-04-03T08:49:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:08.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:08 smithi181 ceph-mon[101094]: pgmap v243: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 2 op/s 2024-04-03T08:49:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:08.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:08 smithi157 ceph-mon[117693]: pgmap v243: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 2 op/s 2024-04-03T08:49:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:10.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:10.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:10.942 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:10 smithi157 ceph-mon[117693]: pgmap v244: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 277 KiB/s rd, 1 op/s 2024-04-03T08:49:10.942 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:10.942 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:10 smithi181 ceph-mon[101094]: pgmap v244: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 277 KiB/s rd, 1 op/s 2024-04-03T08:49:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:13.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:13 smithi157 ceph-mon[117693]: pgmap v245: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 278 KiB/s rd, 2 op/s 2024-04-03T08:49:13.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:13 smithi181 ceph-mon[101094]: pgmap v245: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 278 KiB/s rd, 2 op/s 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.713 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:14.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:14 smithi157 ceph-mon[117693]: pgmap v246: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:49:14.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:14.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:14.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:14 smithi181 ceph-mon[101094]: pgmap v246: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:17 smithi157 ceph-mon[117693]: Upgrade: Updating prometheus.smithi157 2024-04-03T08:49:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:17 smithi157 ceph-mon[117693]: Deploying daemon prometheus.smithi157 on smithi157 2024-04-03T08:49:17.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:17 smithi157 ceph-mon[117693]: pgmap v247: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:17 smithi181 ceph-mon[101094]: Upgrade: Updating prometheus.smithi157 2024-04-03T08:49:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:17 smithi181 ceph-mon[101094]: Deploying daemon prometheus.smithi157 on smithi157 2024-04-03T08:49:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:17 smithi181 ceph-mon[101094]: pgmap v247: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:19.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:19 smithi157 ceph-mon[117693]: pgmap v248: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:19 smithi181 ceph-mon[101094]: pgmap v248: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 -- 172.21.15.157:0/3248503040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 msgr2=0x7f932c0fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 --2- 172.21.15.157:0/3248503040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c0fe350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9318004940 tx=0x7f9318009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 -- 172.21.15.157:0/3248503040 shutdown_connections 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 --2- 172.21.15.157:0/3248503040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c0fe350 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 --2- 172.21.15.157:0/3248503040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c0fcc30 0x7f932c0fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 -- 172.21.15.157:0/3248503040 >> 172.21.15.157:0/3248503040 conn(0x7f932c0f83d0 msgr2=0x7f932c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 -- 172.21.15.157:0/3248503040 shutdown_connections 2024-04-03T08:49:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.885+0000 7f9331200700 1 -- 172.21.15.157:0/3248503040 wait complete. 2024-04-03T08:49:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f9331200700 1 Processor -- start 2024-04-03T08:49:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f9331200700 1 -- start start 2024-04-03T08:49:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f9331200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c0fcc30 0x7f932c10fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f9331200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c10ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f9331200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c110550 con 0x7f932c0fdee0 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f9331200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c110da0 con 0x7f932c0fcc30 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f932aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c10ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f932aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c10ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48886/0 (socket says 172.21.15.157:48886) 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.887+0000 7f932aa00700 1 -- 172.21.15.157:0/2327218467 learned_addr learned my addr 172.21.15.157:0/2327218467 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f932b400700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c0fcc30 0x7f932c10fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f932aa00700 1 -- 172.21.15.157:0/2327218467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c0fcc30 msgr2=0x7f932c10fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f932aa00700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c0fcc30 0x7f932c10fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f932aa00700 1 -- 172.21.15.157:0/2327218467 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318005040 con 0x7f932c0fdee0 2024-04-03T08:49:19.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f932aa00700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c10ff50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f931800b3b0 tx=0x7f9318009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:19.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931800e040 con 0x7f932c0fdee0 2024-04-03T08:49:19.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f931800bcc0 con 0x7f932c0fdee0 2024-04-03T08:49:19.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c111020 con 0x7f932c0fdee0 2024-04-03T08:49:19.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.888+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931801c630 con 0x7f932c0fdee0 2024-04-03T08:49:19.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.889+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c111560 con 0x7f932c0fdee0 2024-04-03T08:49:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.890+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c101870 con 0x7f932c0fdee0 2024-04-03T08:49:19.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.891+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9318013420 con 0x7f932c0fdee0 2024-04-03T08:49:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.892+0000 7f9323400700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f931006d7e0 0x7f931006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.892+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f931808ddd0 con 0x7f932c0fdee0 2024-04-03T08:49:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.892+0000 7f932b400700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f931006d7e0 0x7f931006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:19.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.893+0000 7f932b400700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f931006d7e0 0x7f931006fc90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f931c009fd0 tx=0x7f931c009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:19.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:19.897+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f931805af30 con 0x7f932c0fdee0 2024-04-03T08:49:20.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.150+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f932c111780 con 0x7f931006d7e0 2024-04-03T08:49:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.151+0000 7f9323400700 1 -- 172.21.15.157:0/2327218467 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f932c111780 con 0x7f931006d7e0 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f931006d7e0 msgr2=0x7f931006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f931006d7e0 0x7f931006fc90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f931c009fd0 tx=0x7f931c009f60 comp rx=0 tx=0).stop 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 msgr2=0x7f932c10ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c10ff50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f931800b3b0 tx=0x7f9318009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 shutdown_connections 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f931006d7e0 0x7f931006fc90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c0fcc30 0x7f932c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 --2- 172.21.15.157:0/2327218467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f932c0fdee0 0x7f932c10ff50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 >> 172.21.15.157:0/2327218467 conn(0x7f932c0f83d0 msgr2=0x7f932c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 shutdown_connections 2024-04-03T08:49:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.154+0000 7f9331200700 1 -- 172.21.15.157:0/2327218467 wait complete. 2024-04-03T08:49:20.169 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:49:20.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 -- 172.21.15.157:0/2767393239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 msgr2=0x7f9acc070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2767393239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc070e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8004940 tx=0x7f9ab8009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 -- 172.21.15.157:0/2767393239 shutdown_connections 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2767393239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc070e10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2767393239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9acc071f50 0x7f9acc070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 -- 172.21.15.157:0/2767393239 >> 172.21.15.157:0/2767393239 conn(0x7f9acc0f8560 msgr2=0x7f9acc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.297+0000 7f9ad3600700 1 -- 172.21.15.157:0/2767393239 shutdown_connections 2024-04-03T08:49:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.298+0000 7f9ad3600700 1 -- 172.21.15.157:0/2767393239 wait complete. 2024-04-03T08:49:20.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.298+0000 7f9ad3600700 1 Processor -- start 2024-04-03T08:49:20.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.298+0000 7f9ad3600700 1 -- start start 2024-04-03T08:49:20.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad3600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:20.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad3600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9acc071f50 0x7f9acc1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:20.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad3600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1106b0 con 0x7f9acc0709a0 2024-04-03T08:49:20.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad3600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc110f00 con 0x7f9acc071f50 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc10fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48894/0 (socket says 172.21.15.157:48894) 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad0c00700 1 -- 172.21.15.157:0/2967689493 learned_addr learned my addr 172.21.15.157:0/2967689493 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9acbe00700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9acc071f50 0x7f9acc1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad0c00700 1 -- 172.21.15.157:0/2967689493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9acc071f50 msgr2=0x7f9acc1100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad0c00700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9acc071f50 0x7f9acc1100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.299+0000 7f9ad0c00700 1 -- 172.21.15.157:0/2967689493 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8005040 con 0x7f9acc0709a0 2024-04-03T08:49:20.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.300+0000 7f9ad0c00700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc10fb70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000eb70 tx=0x7f9ac000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:20.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.300+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac0007cc0 con 0x7f9acc0709a0 2024-04-03T08:49:20.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.300+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ac000f040 con 0x7f9acc0709a0 2024-04-03T08:49:20.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.300+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac000cb20 con 0x7f9acc0709a0 2024-04-03T08:49:20.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.300+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc111180 con 0x7f9acc0709a0 2024-04-03T08:49:20.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.300+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc1116c0 con 0x7f9acc0709a0 2024-04-03T08:49:20.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.301+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc05f5f0 con 0x7f9acc0709a0 2024-04-03T08:49:20.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.302+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9ac000cc80 con 0x7f9acc0709a0 2024-04-03T08:49:20.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.303+0000 7f9ac8c00700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9ab406d7f0 0x7f9ab406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:20.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.303+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f9ac008ca20 con 0x7f9acc0709a0 2024-04-03T08:49:20.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.303+0000 7f9acbe00700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9ab406d7f0 0x7f9ab406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:20.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.304+0000 7f9acbe00700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9ab406d7f0 0x7f9ab406fca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800b0d0 tx=0x7f9ab8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:20.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.307+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ac0059cb0 con 0x7f9acc0709a0 2024-04-03T08:49:20.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.545+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9acc1119f0 con 0x7f9ab406d7f0 2024-04-03T08:49:20.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ac8c00700 1 -- 172.21.15.157:0/2967689493 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f9acc1119f0 con 0x7f9ab406d7f0 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9ab406d7f0 msgr2=0x7f9ab406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9ab406d7f0 0x7f9ab406fca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800b0d0 tx=0x7f9ab8009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 msgr2=0x7f9acc10fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc10fb70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000eb70 tx=0x7f9ac000b040 comp rx=0 tx=0).stop 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 shutdown_connections 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9ab406d7f0 0x7f9ab406fca0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc0709a0 0x7f9acc10fb70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 --2- 172.21.15.157:0/2967689493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9acc071f50 0x7f9acc1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 >> 172.21.15.157:0/2967689493 conn(0x7f9acc0f8560 msgr2=0x7f9acc0f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:20.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 shutdown_connections 2024-04-03T08:49:20.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.546+0000 7f9ad3600700 1 -- 172.21.15.157:0/2967689493 wait complete. 2024-04-03T08:49:20.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 -- 172.21.15.157:0/3914848489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 msgr2=0x7f11440ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 --2- 172.21.15.157:0/3914848489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f11440ff860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1134004940 tx=0x7f1134009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:20.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 -- 172.21.15.157:0/3914848489 shutdown_connections 2024-04-03T08:49:20.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 --2- 172.21.15.157:0/3914848489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 0x7f1144102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 --2- 172.21.15.157:0/3914848489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f11440ff860 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 -- 172.21.15.157:0/3914848489 >> 172.21.15.157:0/3914848489 conn(0x7f11440f7270 msgr2=0x7f11440f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:20.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 -- 172.21.15.157:0/3914848489 shutdown_connections 2024-04-03T08:49:20.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.686+0000 7f1143200700 1 -- 172.21.15.157:0/3914848489 wait complete. 2024-04-03T08:49:20.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.687+0000 7f1143200700 1 Processor -- start 2024-04-03T08:49:20.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1143200700 1 -- start start 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1143200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f114410fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1143200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 0x7f1144110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1143200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144110610 con 0x7f1144066280 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1143200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144110e60 con 0x7f11440ffda0 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1141e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f114410fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.688+0000 7f1141e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f114410fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48914/0 (socket says 172.21.15.157:48914) 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141e00700 1 -- 172.21.15.157:0/1784003611 learned_addr learned my addr 172.21.15.157:0/1784003611 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:20.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141400700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 0x7f1144110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141e00700 1 -- 172.21.15.157:0/1784003611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 msgr2=0x7f1144110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141e00700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 0x7f1144110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141e00700 1 -- 172.21.15.157:0/1784003611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134005040 con 0x7f1144066280 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141400700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 0x7f1144110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.689+0000 7f1141e00700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f114410fad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f113400b970 tx=0x7f1134009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.690+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f113400e040 con 0x7f1144066280 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.690+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1134004290 con 0x7f1144066280 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.690+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11441110e0 con 0x7f1144066280 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.690+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f113401c3f0 con 0x7f1144066280 2024-04-03T08:49:20.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.690+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1144111620 con 0x7f1144066280 2024-04-03T08:49:20.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.691+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11440f8df0 con 0x7f1144066280 2024-04-03T08:49:20.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.692+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f113400bbf0 con 0x7f1144066280 2024-04-03T08:49:20.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.693+0000 7f113a000700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f112806d7f0 0x7f112806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:20.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.693+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f113408e220 con 0x7f1144066280 2024-04-03T08:49:20.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.693+0000 7f1141400700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f112806d7f0 0x7f112806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:20.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.694+0000 7f1141400700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f112806d7f0 0x7f112806fca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1130010520 tx=0x7f113000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:20.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.699+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f113405b540 con 0x7f1144066280 2024-04-03T08:49:20.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.923+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1144105870 con 0x7f112806d7f0 2024-04-03T08:49:20.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.935+0000 7f113a000700 1 -- 172.21.15.157:0/1784003611 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1144105870 con 0x7f112806d7f0 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (9m) 13s ago 19m 14.1M - 0.25.0 c8568f914cd2 35b688a364ad 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (5m) 13s ago 19m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (5m) 16s ago 18m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (8m) 13s ago 19m 74.8M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (114s) 13s ago 13m 82.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (87s) 13s ago 13m 84.6M - 19.0.0-1670-g1fb5d106 c318aa90b546 c20db495a227 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (60s) 16s ago 13m 11.1M - 19.0.0-1670-g1fb5d106 c318aa90b546 2a5ba2586b49 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (42s) 16s ago 13m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 60490a032fca 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (7m) 13s ago 21m 509M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (7m) 16s ago 18m 452M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (6m) 13s ago 21m 54.3M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (6m) 16s ago 18m 40.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (24s) 13s ago 19m 6929k - 1.5.0 0da6a335fe13 70ae0b3fbf65 2024-04-03T08:49:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (19s) 16s ago 18m 2801k - 1.5.0 0da6a335fe13 90c76e3ccd43 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (5m) 13s ago 17m 141M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (4m) 13s ago 17m 170M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (4m) 13s ago 16m 96.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (3m) 16s ago 15m 139M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (2m) 16s ago 15m 97.5M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (2m) 16s ago 14m 95.2M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:49:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (7m) 13s ago 19m 53.1M - 2.43.0 a07b618ecd1d 6815e6557f71 2024-04-03T08:49:20.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.937+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f112806d7f0 msgr2=0x7f112806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.937+0000 7f1143200700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f112806d7f0 0x7f112806fca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1130010520 tx=0x7f113000b040 comp rx=0 tx=0).stop 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.937+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 msgr2=0x7f114410fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.937+0000 7f1143200700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f114410fad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f113400b970 tx=0x7f1134009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 shutdown_connections 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f112806d7f0 0x7f112806fca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1144066280 0x7f114410fad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 --2- 172.21.15.157:0/1784003611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11440ffda0 0x7f1144110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 >> 172.21.15.157:0/1784003611 conn(0x7f11440f7270 msgr2=0x7f11440fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 shutdown_connections 2024-04-03T08:49:20.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:20.938+0000 7f1143200700 1 -- 172.21.15.157:0/1784003611 wait complete. 2024-04-03T08:49:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 -- 172.21.15.157:0/3746290600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 msgr2=0x7f22dc102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3746290600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc102320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22c8004940 tx=0x7f22c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 -- 172.21.15.157:0/3746290600 shutdown_connections 2024-04-03T08:49:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3746290600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc102320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3746290600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22dc0662e0 0x7f22dc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 -- 172.21.15.157:0/3746290600 >> 172.21.15.157:0/3746290600 conn(0x7f22dc0f7430 msgr2=0x7f22dc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 -- 172.21.15.157:0/3746290600 shutdown_connections 2024-04-03T08:49:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.094+0000 7f22e3c00700 1 -- 172.21.15.157:0/3746290600 wait complete. 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.095+0000 7f22e3c00700 1 Processor -- start 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.095+0000 7f22e3c00700 1 -- start start 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.095+0000 7f22e3c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22dc0662e0 0x7f22dc10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.095+0000 7f22e3c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.095+0000 7f22e3c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc110850 con 0x7f22dc0fff00 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.095+0000 7f22e3c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc110f90 con 0x7f22dc0662e0 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:21.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48930/0 (socket says 172.21.15.157:48930) 2024-04-03T08:49:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 -- 172.21.15.157:0/3778581641 learned_addr learned my addr 172.21.15.157:0/3778581641 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22e1200700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22dc0662e0 0x7f22dc10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 -- 172.21.15.157:0/3778581641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22dc0662e0 msgr2=0x7f22dc10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22dc0662e0 0x7f22dc10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 -- 172.21.15.157:0/3778581641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8005040 con 0x7f22dc0fff00 2024-04-03T08:49:21.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.096+0000 7f22dbe00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc110250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009150 tx=0x7f22c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.097+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c800e040 con 0x7f22dc0fff00 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.097+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22c800bbf0 con 0x7f22dc0fff00 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.097+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc111210 con 0x7f22dc0fff00 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.097+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c801c630 con 0x7f22dc0fff00 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.097+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc1117d0 con 0x7f22dc0fff00 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.098+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc0f8fb0 con 0x7f22dc0fff00 2024-04-03T08:49:21.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.099+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f22c800bd60 con 0x7f22dc0fff00 2024-04-03T08:49:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.100+0000 7f22d8c00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22c406d7f0 0x7f22c406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.100+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f22c808e400 con 0x7f22dc0fff00 2024-04-03T08:49:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.100+0000 7f22e1200700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22c406d7f0 0x7f22c406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.101+0000 7f22e1200700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22c406d7f0 0x7f22c406fca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22d0007fd0 tx=0x7f22d0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:21.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.104+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f22c805b660 con 0x7f22dc0fff00 2024-04-03T08:49:21.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.453+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22dc05f5f0 con 0x7f22dc0fff00 2024-04-03T08:49:21.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.454+0000 7f22d8c00700 1 -- 172.21.15.157:0/3778581641 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f22c805b1f0 con 0x7f22dc0fff00 2024-04-03T08:49:21.455 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:49:21.455 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:49:21.455 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:49:21.456 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22c406d7f0 msgr2=0x7f22c406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22c406d7f0 0x7f22c406fca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22d0007fd0 tx=0x7f22d0009040 comp rx=0 tx=0).stop 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 msgr2=0x7f22dc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc110250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009150 tx=0x7f22c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 shutdown_connections 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f22c406d7f0 0x7f22c406fca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22dc0662e0 0x7f22dc10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 --2- 172.21.15.157:0/3778581641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22dc0fff00 0x7f22dc110250 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 >> 172.21.15.157:0/3778581641 conn(0x7f22dc0f7430 msgr2=0x7f22dc0fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 shutdown_connections 2024-04-03T08:49:21.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.458+0000 7f22e3c00700 1 -- 172.21.15.157:0/3778581641 wait complete. 2024-04-03T08:49:21.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:21 smithi157 ceph-mon[117693]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:21.529 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:21 smithi157 ceph-mon[117693]: pgmap v249: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:21 smithi181 ceph-mon[101094]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:21 smithi181 ceph-mon[101094]: pgmap v249: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:21.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.612+0000 7f8c6b200700 1 -- 172.21.15.157:0/514926538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c071ea0 msgr2=0x7f8c6c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.612+0000 7f8c6b200700 1 --2- 172.21.15.157:0/514926538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c071ea0 0x7f8c6c0703b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c004940 tx=0x7f8c5c009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.612+0000 7f8c6b200700 1 -- 172.21.15.157:0/514926538 shutdown_connections 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.612+0000 7f8c6b200700 1 --2- 172.21.15.157:0/514926538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.612+0000 7f8c6b200700 1 --2- 172.21.15.157:0/514926538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c071ea0 0x7f8c6c0703b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.612+0000 7f8c6b200700 1 -- 172.21.15.157:0/514926538 >> 172.21.15.157:0/514926538 conn(0x7f8c6c0f83d0 msgr2=0x7f8c6c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.613+0000 7f8c6b200700 1 -- 172.21.15.157:0/514926538 shutdown_connections 2024-04-03T08:49:21.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.613+0000 7f8c6b200700 1 -- 172.21.15.157:0/514926538 wait complete. 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.613+0000 7f8c6b200700 1 Processor -- start 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c6b200700 1 -- start start 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c6b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c6b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c6c071ea0 0x7f8c6c114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c6b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c114a60 con 0x7f8c6c0708f0 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c6b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c1151a0 con 0x7f8c6c071ea0 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c69e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:21.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c69e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48954/0 (socket says 172.21.15.157:48954) 2024-04-03T08:49:21.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c69e00700 1 -- 172.21.15.157:0/2927075543 learned_addr learned my addr 172.21.15.157:0/2927075543 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:21.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.614+0000 7f8c69400700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c6c071ea0 0x7f8c6c114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:21.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c69e00700 1 -- 172.21.15.157:0/2927075543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c6c071ea0 msgr2=0x7f8c6c114460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c69e00700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c6c071ea0 0x7f8c6c114460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c69e00700 1 -- 172.21.15.157:0/2927075543 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c005040 con 0x7f8c6c0708f0 2024-04-03T08:49:21.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c69e00700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c113f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b970 tx=0x7f8c5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:21.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5c00e040 con 0x7f8c6c0708f0 2024-04-03T08:49:21.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c5c004290 con 0x7f8c6c0708f0 2024-04-03T08:49:21.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c115420 con 0x7f8c6c0708f0 2024-04-03T08:49:21.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.615+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5c01c3f0 con 0x7f8c6c0708f0 2024-04-03T08:49:21.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.616+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c1159e0 con 0x7f8c6c0708f0 2024-04-03T08:49:21.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.617+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c05f5f0 con 0x7f8c6c0708f0 2024-04-03T08:49:21.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.619+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8c5c00bbf0 con 0x7f8c6c0708f0 2024-04-03T08:49:21.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.620+0000 7f8c62000700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c5006d7f0 0x7f8c5006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:21.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.620+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f8c5c08e110 con 0x7f8c6c0708f0 2024-04-03T08:49:21.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.620+0000 7f8c69400700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c5006d7f0 0x7f8c5006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:21.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.621+0000 7f8c69400700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c5006d7f0 0x7f8c5006fca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004f40 tx=0x7f8c5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:21.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.624+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8c5c05b390 con 0x7f8c6c0708f0 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.891+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8c6c115ca0 con 0x7f8c6c0708f0 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.891+0000 7f8c62000700 1 -- 172.21.15.157:0/2927075543 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f8c5c05af20 con 0x7f8c6c0708f0 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stdout:e35 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:49:21.892 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 35 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:48:48.847209+0000 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:49:21.893 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 97 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=34412} 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:49:21.894 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{0:34412} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:44387} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/397415286,v1:172.21.15.181:6825/397415286] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:21.895 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{-1:44391} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6826/3661110481,v1:172.21.15.181:6827/3661110481] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.893+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c5006d7f0 msgr2=0x7f8c5006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.893+0000 7f8c6b200700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c5006d7f0 0x7f8c5006fca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004f40 tx=0x7f8c5800b040 comp rx=0 tx=0).stop 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 msgr2=0x7f8c6c113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c113f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b970 tx=0x7f8c5c009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 shutdown_connections 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8c5006d7f0 0x7f8c5006fca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c6c0708f0 0x7f8c6c113f20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 --2- 172.21.15.157:0/2927075543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c6c071ea0 0x7f8c6c114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:21.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 >> 172.21.15.157:0/2927075543 conn(0x7f8c6c0f83d0 msgr2=0x7f8c6c0f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:21.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 shutdown_connections 2024-04-03T08:49:21.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:21.894+0000 7f8c6b200700 1 -- 172.21.15.157:0/2927075543 wait complete. 2024-04-03T08:49:21.897 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 35 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 -- 172.21.15.157:0/845080760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 msgr2=0x7efdc4101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 --2- 172.21.15.157:0/845080760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc4101dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efdb4004940 tx=0x7efdb4009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 -- 172.21.15.157:0/845080760 shutdown_connections 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 --2- 172.21.15.157:0/845080760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdc4102300 0x7efdc41046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 --2- 172.21.15.157:0/845080760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc4101dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 -- 172.21.15.157:0/845080760 >> 172.21.15.157:0/845080760 conn(0x7efdc40f7430 msgr2=0x7efdc40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:22.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 -- 172.21.15.157:0/845080760 shutdown_connections 2024-04-03T08:49:22.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.032+0000 7efdcaa00700 1 -- 172.21.15.157:0/845080760 wait complete. 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.033+0000 7efdcaa00700 1 Processor -- start 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.033+0000 7efdcaa00700 1 -- start start 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdcaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdcaa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdc4102300 0x7efdc4110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdcaa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4110760 con 0x7efdc40662e0 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdcaa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4110fb0 con 0x7efdc4102300 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:22.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48978/0 (socket says 172.21.15.157:48978) 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3e00700 1 -- 172.21.15.157:0/2925192784 learned_addr learned my addr 172.21.15.157:0/2925192784 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3400700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdc4102300 0x7efdc4110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3e00700 1 -- 172.21.15.157:0/2925192784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdc4102300 msgr2=0x7efdc4110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3e00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdc4102300 0x7efdc4110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.034+0000 7efdc3e00700 1 -- 172.21.15.157:0/2925192784 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4005040 con 0x7efdc40662e0 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.035+0000 7efdc3e00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc410fc20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efdb400b970 tx=0x7efdb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:22.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.035+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb400e040 con 0x7efdc40662e0 2024-04-03T08:49:22.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.035+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb4004290 con 0x7efdc40662e0 2024-04-03T08:49:22.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.035+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc4111230 con 0x7efdc40662e0 2024-04-03T08:49:22.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.035+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb401c630 con 0x7efdc40662e0 2024-04-03T08:49:22.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.035+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc4111770 con 0x7efdc40662e0 2024-04-03T08:49:22.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.037+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc405f5f0 con 0x7efdc40662e0 2024-04-03T08:49:22.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.037+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efdb400bbf0 con 0x7efdc40662e0 2024-04-03T08:49:22.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.038+0000 7efdbbe00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efda806d7f0 0x7efda806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:22.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.038+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7efdb408e460 con 0x7efdc40662e0 2024-04-03T08:49:22.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.039+0000 7efdc3400700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efda806d7f0 0x7efda806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:22.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.039+0000 7efdc3400700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efda806d7f0 0x7efda806fca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efdb0004990 tx=0x7efdb0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:22.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.047+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efdb405b640 con 0x7efdc40662e0 2024-04-03T08:49:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.309+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc4111ac0 con 0x7efda806d7f0 2024-04-03T08:49:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.311+0000 7efdbbe00700 1 -- 172.21.15.157:0/2925192784 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7efdc4111ac0 con 0x7efda806d7f0 2024-04-03T08:49:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "osd", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "mds", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "16/21 daemons upgraded", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:49:22.312 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efda806d7f0 msgr2=0x7efda806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efda806d7f0 0x7efda806fca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efdb0004990 tx=0x7efdb0009ee0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 msgr2=0x7efdc410fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc410fc20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efdb400b970 tx=0x7efdb4009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 shutdown_connections 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efda806d7f0 0x7efda806fca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc40662e0 0x7efdc410fc20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 --2- 172.21.15.157:0/2925192784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdc4102300 0x7efdc4110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 >> 172.21.15.157:0/2925192784 conn(0x7efdc40f7430 msgr2=0x7efdc40f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:22.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 shutdown_connections 2024-04-03T08:49:22.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.314+0000 7efdcaa00700 1 -- 172.21.15.157:0/2925192784 wait complete. 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.477+0000 7f9a6e400700 1 -- 172.21.15.157:0/1739440167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 msgr2=0x7f9a68070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.477+0000 7f9a6e400700 1 --2- 172.21.15.157:0/1739440167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a68070d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9a54004940 tx=0x7f9a54009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.477+0000 7f9a6e400700 1 -- 172.21.15.157:0/1739440167 shutdown_connections 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.477+0000 7f9a6e400700 1 --2- 172.21.15.157:0/1739440167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a68070d00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.477+0000 7f9a6e400700 1 --2- 172.21.15.157:0/1739440167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a68071e40 0x7f9a68070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.477+0000 7f9a6e400700 1 -- 172.21.15.157:0/1739440167 >> 172.21.15.157:0/1739440167 conn(0x7f9a680f8550 msgr2=0x7f9a680fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.478+0000 7f9a6e400700 1 -- 172.21.15.157:0/1739440167 shutdown_connections 2024-04-03T08:49:22.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.478+0000 7f9a6e400700 1 -- 172.21.15.157:0/1739440167 wait complete. 2024-04-03T08:49:22.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.478+0000 7f9a6e400700 1 Processor -- start 2024-04-03T08:49:22.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.478+0000 7f9a6e400700 1 -- start start 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a6e400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a6810fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a6e400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a68071e40 0x7f9a68110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a6e400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68110660 con 0x7f9a68070890 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a6e400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681107d0 con 0x7f9a68071e40 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a67400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a6810fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a67400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a6810fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:42632/0 (socket says 172.21.15.157:42632) 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a67400700 1 -- 172.21.15.157:0/625745547 learned_addr learned my addr 172.21.15.157:0/625745547 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.479+0000 7f9a66a00700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a68071e40 0x7f9a68110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a67400700 1 -- 172.21.15.157:0/625745547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a68071e40 msgr2=0x7f9a68110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a67400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a68071e40 0x7f9a68110060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a67400700 1 -- 172.21.15.157:0/625745547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54005040 con 0x7f9a68070890 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a67400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a6810fb20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9a58002a80 tx=0x7f9a58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:22.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a58007cc0 con 0x7f9a68070890 2024-04-03T08:49:22.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a5800f040 con 0x7f9a68070890 2024-04-03T08:49:22.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68115230 con 0x7f9a68070890 2024-04-03T08:49:22.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5800da30 con 0x7f9a68070890 2024-04-03T08:49:22.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.480+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a681157f0 con 0x7f9a68070890 2024-04-03T08:49:22.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.482+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6804c710 con 0x7f9a68070890 2024-04-03T08:49:22.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.482+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9a5800db90 con 0x7f9a68070890 2024-04-03T08:49:22.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.483+0000 7f9a5f400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a4c06d7e0 0x7f9a4c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:22.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.484+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f9a5808cda0 con 0x7f9a68070890 2024-04-03T08:49:22.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.484+0000 7f9a66a00700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a4c06d7e0 0x7f9a4c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:22.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.484+0000 7f9a66a00700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a4c06d7e0 0x7f9a4c06fc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400b3b0 tx=0x7f9a54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:22.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.488+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9a58059f80 con 0x7f9a68070890 2024-04-03T08:49:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:22 smithi157 ceph-mon[117693]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:22 smithi157 ceph-mon[117693]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:22 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3778581641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:22.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:22 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2927075543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:49:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:22 smithi181 ceph-mon[101094]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:22 smithi181 ceph-mon[101094]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:22 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3778581641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:22.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:22 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2927075543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:49:22.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.791+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9a68115c90 con 0x7f9a68070890 2024-04-03T08:49:22.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.792+0000 7f9a5f400700 1 -- 172.21.15.157:0/625745547 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9a58059b10 con 0x7f9a68070890 2024-04-03T08:49:22.793 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.794+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a4c06d7e0 msgr2=0x7f9a4c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.794+0000 7f9a6e400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a4c06d7e0 0x7f9a4c06fc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400b3b0 tx=0x7f9a54009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 msgr2=0x7f9a6810fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a6810fb20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9a58002a80 tx=0x7f9a58004600 comp rx=0 tx=0).stop 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 shutdown_connections 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f9a4c06d7e0 0x7f9a4c06fc90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a68070890 0x7f9a6810fb20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 --2- 172.21.15.157:0/625745547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a68071e40 0x7f9a68110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 >> 172.21.15.157:0/625745547 conn(0x7f9a680f8550 msgr2=0x7f9a680f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 shutdown_connections 2024-04-03T08:49:22.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:22.795+0000 7f9a6e400700 1 -- 172.21.15.157:0/625745547 wait complete. 2024-04-03T08:49:23.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:23 smithi157 ceph-mon[117693]: pgmap v250: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:23 smithi157 ceph-mon[117693]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:23.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:23 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/625745547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:49:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:23 smithi181 ceph-mon[101094]: pgmap v250: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:23 smithi181 ceph-mon[101094]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:23 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/625745547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:49:25.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:25 smithi157 ceph-mon[117693]: pgmap v251: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:25 smithi181 ceph-mon[101094]: pgmap v251: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:27.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:27 smithi157 ceph-mon[117693]: pgmap v252: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:27 smithi181 ceph-mon[101094]: pgmap v252: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:29 smithi157 ceph-mon[117693]: pgmap v253: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:29.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:29 smithi181 ceph-mon[101094]: pgmap v253: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:30.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:30.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:30.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:30 smithi157 ceph-mon[117693]: pgmap v254: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:30.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:30.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:30.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:30 smithi181 ceph-mon[101094]: pgmap v254: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:32.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:32.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:32 smithi157 ceph-mon[117693]: pgmap v255: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:33.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:32 smithi181 ceph-mon[101094]: pgmap v255: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:35.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:35 smithi157 ceph-mon[117693]: pgmap v256: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:35 smithi181 ceph-mon[101094]: pgmap v256: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.566 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:36.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:36.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:49:36.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.598 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:36.599 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:37.512 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:37 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:49:37.512 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:37 smithi157 ceph-mon[117693]: pgmap v257: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:37 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-03T08:49:37.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:37 smithi181 ceph-mon[101094]: pgmap v257: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:39 smithi181 ceph-mon[101094]: Upgrade: Updating alertmanager.smithi157 2024-04-03T08:49:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:39 smithi181 ceph-mon[101094]: Deploying daemon alertmanager.smithi157 on smithi157 2024-04-03T08:49:39.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:39 smithi181 ceph-mon[101094]: pgmap v258: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:39.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:39 smithi157 ceph-mon[117693]: Upgrade: Updating alertmanager.smithi157 2024-04-03T08:49:39.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:39 smithi157 ceph-mon[117693]: Deploying daemon alertmanager.smithi157 on smithi157 2024-04-03T08:49:39.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:39 smithi157 ceph-mon[117693]: pgmap v258: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:41.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:41 smithi181 ceph-mon[101094]: pgmap v259: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:41.730 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:41 smithi157 ceph-mon[117693]: pgmap v259: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:43.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:43 smithi157 ceph-mon[117693]: pgmap v260: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:43.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:43 smithi181 ceph-mon[101094]: pgmap v260: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: pgmap v261: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: pgmap v261: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:45.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:47.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:47 smithi157 ceph-mon[117693]: pgmap v262: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:47.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:47 smithi181 ceph-mon[101094]: pgmap v262: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:49.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:49 smithi157 ceph-mon[117693]: pgmap v263: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:49.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:49 smithi181 ceph-mon[101094]: pgmap v263: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:51.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:51 smithi157 ceph-mon[117693]: pgmap v264: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:51.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:51 smithi181 ceph-mon[101094]: pgmap v264: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:52 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:52 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:52.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:52 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:52.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:52 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:52.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 -- 172.21.15.157:0/1162601749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fcee0 msgr2=0x7efdfc0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 --2- 172.21.15.157:0/1162601749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fcee0 0x7efdfc0fd310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efdf0004940 tx=0x7efdf0009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 -- 172.21.15.157:0/1162601749 shutdown_connections 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 --2- 172.21.15.157:0/1162601749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc0fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 --2- 172.21.15.157:0/1162601749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fcee0 0x7efdfc0fd310 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 -- 172.21.15.157:0/1162601749 >> 172.21.15.157:0/1162601749 conn(0x7efdfc0f8560 msgr2=0x7efdfc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 -- 172.21.15.157:0/1162601749 shutdown_connections 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.939+0000 7efe03a00700 1 -- 172.21.15.157:0/1162601749 wait complete. 2024-04-03T08:49:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.940+0000 7efe03a00700 1 Processor -- start 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.940+0000 7efe03a00700 1 -- start start 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efe03a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdfc0fcee0 0x7efdfc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efe03a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efe03a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc111660 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efe03a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1117d0 con 0x7efdfc0fcee0 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54638/0 (socket says 172.21.15.157:54638) 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 -- 172.21.15.157:0/1248978482 learned_addr learned my addr 172.21.15.157:0/1248978482 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efe01000700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdfc0fcee0 0x7efdfc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 -- 172.21.15.157:0/1248978482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdfc0fcee0 msgr2=0x7efdfc071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdfc0fcee0 0x7efdfc071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 -- 172.21.15.157:0/1248978482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0005040 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.941+0000 7efdfbe00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc070310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efde800eb40 tx=0x7efde800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.942+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde8007cc0 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.942+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efde800f040 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.942+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc070910 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.942+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde8009620 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.942+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc070e00 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.943+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc05f5f0 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.944+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efde8009780 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.945+0000 7efdf8c00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efde406d7f0 0x7efde406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.945+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7efde808cd80 con 0x7efdfc0fe0d0 2024-04-03T08:49:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.945+0000 7efe01000700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efde406d7f0 0x7efde406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.946+0000 7efe01000700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efde406d7f0 0x7efde406fca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdf0013740 tx=0x7efdf0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:52.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:52.950+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efde8056460 con 0x7efdfc0fe0d0 2024-04-03T08:49:53.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.177+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdfc071130 con 0x7efde406d7f0 2024-04-03T08:49:53.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.178+0000 7efdf8c00700 1 -- 172.21.15.157:0/1248978482 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7efdfc071130 con 0x7efde406d7f0 2024-04-03T08:49:53.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.180+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efde406d7f0 msgr2=0x7efde406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.180+0000 7efe03a00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efde406d7f0 0x7efde406fca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdf0013740 tx=0x7efdf0009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.180+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 msgr2=0x7efdfc070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.180+0000 7efe03a00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc070310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efde800eb40 tx=0x7efde800b040 comp rx=0 tx=0).stop 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 shutdown_connections 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efde406d7f0 0x7efde406fca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdfc0fcee0 0x7efdfc071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 --2- 172.21.15.157:0/1248978482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdfc0fe0d0 0x7efdfc070310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 >> 172.21.15.157:0/1248978482 conn(0x7efdfc0f8560 msgr2=0x7efdfc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 shutdown_connections 2024-04-03T08:49:53.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.181+0000 7efe03a00700 1 -- 172.21.15.157:0/1248978482 wait complete. 2024-04-03T08:49:53.196 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 -- 172.21.15.157:0/965457838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fcc10 msgr2=0x7fcb340fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 --2- 172.21.15.157:0/965457838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fcc10 0x7fcb340fd020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb24004940 tx=0x7fcb24009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 -- 172.21.15.157:0/965457838 shutdown_connections 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 --2- 172.21.15.157:0/965457838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb340fdec0 0x7fcb340fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 --2- 172.21.15.157:0/965457838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fcc10 0x7fcb340fd020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 -- 172.21.15.157:0/965457838 >> 172.21.15.157:0/965457838 conn(0x7fcb340f8390 msgr2=0x7fcb340fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 -- 172.21.15.157:0/965457838 shutdown_connections 2024-04-03T08:49:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.321+0000 7fcb33e00700 1 -- 172.21.15.157:0/965457838 wait complete. 2024-04-03T08:49:53.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.322+0000 7fcb33e00700 1 Processor -- start 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.322+0000 7fcb33e00700 1 -- start start 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.322+0000 7fcb33e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb340fcc10 0x7fcb34071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.322+0000 7fcb33e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 0x7fcb34070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb33e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340708c0 con 0x7fcb340fdec0 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb33e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34070a30 con 0x7fcb340fcc10 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 0x7fcb34070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 0x7fcb34070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54658/0 (socket says 172.21.15.157:54658) 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32000700 1 -- 172.21.15.157:0/507878920 learned_addr learned my addr 172.21.15.157:0/507878920 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:53.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32a00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb340fcc10 0x7fcb34071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32000700 1 -- 172.21.15.157:0/507878920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb340fcc10 msgr2=0x7fcb34071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32000700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb340fcc10 0x7fcb34071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.323+0000 7fcb32000700 1 -- 172.21.15.157:0/507878920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24005040 con 0x7fcb340fdec0 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.324+0000 7fcb32000700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 0x7fcb34070310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c8c0 tx=0x7fcb200044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.324+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2000a760 con 0x7fcb340fdec0 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.324+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb2000ad90 con 0x7fcb340fdec0 2024-04-03T08:49:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.324+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb34070d10 con 0x7fcb340fdec0 2024-04-03T08:49:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.324+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb200113a0 con 0x7fcb340fdec0 2024-04-03T08:49:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.324+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb34115870 con 0x7fcb340fdec0 2024-04-03T08:49:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.325+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb340fc010 con 0x7fcb340fdec0 2024-04-03T08:49:53.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.327+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcb20012400 con 0x7fcb340fdec0 2024-04-03T08:49:53.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.328+0000 7fcb2aa00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcb1806d7e0 0x7fcb1806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:53.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.328+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fcb2008d0a0 con 0x7fcb340fdec0 2024-04-03T08:49:53.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.328+0000 7fcb32a00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcb1806d7e0 0x7fcb1806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:53.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.329+0000 7fcb32a00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcb1806d7e0 0x7fcb1806fc90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400b3b0 tx=0x7fcb24009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:53.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.337+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcb20056750 con 0x7fcb340fdec0 2024-04-03T08:49:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:53 smithi157 ceph-mon[117693]: pgmap v265: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:53.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.609+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb341021d0 con 0x7fcb1806d7e0 2024-04-03T08:49:53.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.611+0000 7fcb2aa00700 1 -- 172.21.15.157:0/507878920 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fcb341021d0 con 0x7fcb1806d7e0 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcb1806d7e0 msgr2=0x7fcb1806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcb1806d7e0 0x7fcb1806fc90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400b3b0 tx=0x7fcb24009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 msgr2=0x7fcb34070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 0x7fcb34070310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c8c0 tx=0x7fcb200044c0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 shutdown_connections 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcb1806d7e0 0x7fcb1806fc90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb340fcc10 0x7fcb34071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 --2- 172.21.15.157:0/507878920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb340fdec0 0x7fcb34070310 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 >> 172.21.15.157:0/507878920 conn(0x7fcb340f8390 msgr2=0x7fcb340f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 shutdown_connections 2024-04-03T08:49:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.614+0000 7fcb33e00700 1 -- 172.21.15.157:0/507878920 wait complete. 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 -- 172.21.15.157:0/441764439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 msgr2=0x7fce480ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 --2- 172.21.15.157:0/441764439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce480ff9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce38004940 tx=0x7fce38009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 -- 172.21.15.157:0/441764439 shutdown_connections 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 --2- 172.21.15.157:0/441764439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce480fff00 0x7fce48102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 --2- 172.21.15.157:0/441764439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce480ff9c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 -- 172.21.15.157:0/441764439 >> 172.21.15.157:0/441764439 conn(0x7fce480f7430 msgr2=0x7fce480f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 -- 172.21.15.157:0/441764439 shutdown_connections 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.756+0000 7fce4ee00700 1 -- 172.21.15.157:0/441764439 wait complete. 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.757+0000 7fce4ee00700 1 Processor -- start 2024-04-03T08:49:53.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.757+0000 7fce4ee00700 1 -- start start 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.757+0000 7fce4ee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce481070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.757+0000 7fce4ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce480fff00 0x7fce481075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.757+0000 7fce4ee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce48107c40 con 0x7fce480662e0 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.757+0000 7fce4ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce48108490 con 0x7fce480fff00 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce481070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce481070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54684/0 (socket says 172.21.15.157:54684) 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47e00700 1 -- 172.21.15.157:0/3669727180 learned_addr learned my addr 172.21.15.157:0/3669727180 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47400700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce480fff00 0x7fce481075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47e00700 1 -- 172.21.15.157:0/3669727180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce480fff00 msgr2=0x7fce481075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47e00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce480fff00 0x7fce481075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.758+0000 7fce47e00700 1 -- 172.21.15.157:0/3669727180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce38005040 con 0x7fce480662e0 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.759+0000 7fce47e00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce481070b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fce3800b970 tx=0x7fce38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:53.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.759+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3800e040 con 0x7fce480662e0 2024-04-03T08:49:53.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.759+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce38004290 con 0x7fce480662e0 2024-04-03T08:49:53.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.759+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48108710 con 0x7fce480662e0 2024-04-03T08:49:53.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.759+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3801c3f0 con 0x7fce480662e0 2024-04-03T08:49:53.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.759+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48108cd0 con 0x7fce480662e0 2024-04-03T08:49:53.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.760+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4805f5f0 con 0x7fce480662e0 2024-04-03T08:49:53.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.761+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fce3800bbf0 con 0x7fce480662e0 2024-04-03T08:49:53.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.762+0000 7fce3fe00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fce2c06d7f0 0x7fce2c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:53.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.762+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fce3808e220 con 0x7fce480662e0 2024-04-03T08:49:53.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.763+0000 7fce47400700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fce2c06d7f0 0x7fce2c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:53.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.763+0000 7fce47400700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fce2c06d7f0 0x7fce2c06fca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fce34009fd0 tx=0x7fce3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:53.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.767+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce38057a10 con 0x7fce480662e0 2024-04-03T08:49:53.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:53 smithi181 ceph-mon[101094]: pgmap v265: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:53.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.987+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce48108f40 con 0x7fce2c06d7f0 2024-04-03T08:49:53.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:53.997+0000 7fce3fe00700 1 -- 172.21.15.157:0/3669727180 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fce48108f40 con 0x7fce2c06d7f0 2024-04-03T08:49:53.998 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:49:53.998 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (10s) 3s ago 20m 14.5M - 0.25.0 c8568f914cd2 92482e122556 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (6m) 3s ago 20m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (6m) 49s ago 19m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (8m) 3s ago 19m 75.1M - 9.4.7 954c08fa6188 4206ff831906 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (2m) 3s ago 13m 82.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (2m) 3s ago 13m 84.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 c20db495a227 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (93s) 49s ago 13m 11.1M - 19.0.0-1670-g1fb5d106 c318aa90b546 2a5ba2586b49 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (75s) 49s ago 13m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 60490a032fca 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (8m) 3s ago 21m 511M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (7m) 49s ago 18m 452M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (7m) 3s ago 21m 55.2M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (6m) 49s ago 18m 40.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (57s) 3s ago 20m 7419k - 1.5.0 0da6a335fe13 70ae0b3fbf65 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (52s) 49s ago 19m 2801k - 1.5.0 0da6a335fe13 90c76e3ccd43 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (5m) 3s ago 18m 141M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:49:53.999 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (5m) 3s ago 17m 170M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:49:54.000 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (4m) 3s ago 17m 95.9M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:49:54.000 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (4m) 49s ago 16m 139M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:49:54.000 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (3m) 49s ago 16m 97.5M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:49:54.000 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (2m) 49s ago 15m 95.2M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:49:54.000 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (32s) 3s ago 19m 46.9M - 2.43.0 a07b618ecd1d aafef4771904 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fce2c06d7f0 msgr2=0x7fce2c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fce2c06d7f0 0x7fce2c06fca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fce34009fd0 tx=0x7fce3400b040 comp rx=0 tx=0).stop 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 msgr2=0x7fce481070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce481070b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fce3800b970 tx=0x7fce38009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 shutdown_connections 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fce2c06d7f0 0x7fce2c06fca0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce480662e0 0x7fce481070b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 --2- 172.21.15.157:0/3669727180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce480fff00 0x7fce481075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 >> 172.21.15.157:0/3669727180 conn(0x7fce480f7430 msgr2=0x7fce480fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:54.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 shutdown_connections 2024-04-03T08:49:54.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.000+0000 7fce4ee00700 1 -- 172.21.15.157:0/3669727180 wait complete. 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.137+0000 7fe4f5000700 1 -- 172.21.15.157:0/1567421527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fdee0 msgr2=0x7fe4f00fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.137+0000 7fe4f5000700 1 --2- 172.21.15.157:0/1567421527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fdee0 0x7fe4f00fe350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc004940 tx=0x7fe4dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.138+0000 7fe4f5000700 1 -- 172.21.15.157:0/1567421527 shutdown_connections 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.138+0000 7fe4f5000700 1 --2- 172.21.15.157:0/1567421527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fdee0 0x7fe4f00fe350 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.138+0000 7fe4f5000700 1 --2- 172.21.15.157:0/1567421527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4f00fcc30 0x7fe4f00fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.138+0000 7fe4f5000700 1 -- 172.21.15.157:0/1567421527 >> 172.21.15.157:0/1567421527 conn(0x7fe4f00f8390 msgr2=0x7fe4f00fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.138+0000 7fe4f5000700 1 -- 172.21.15.157:0/1567421527 shutdown_connections 2024-04-03T08:49:54.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.138+0000 7fe4f5000700 1 -- 172.21.15.157:0/1567421527 wait complete. 2024-04-03T08:49:54.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4f5000700 1 Processor -- start 2024-04-03T08:49:54.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4f5000700 1 -- start start 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4f5000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 0x7fe4f0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4f5000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4f00fdee0 0x7fe4f0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4f5000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00708c0 con 0x7fe4f00fcc30 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4f5000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0070a30 con 0x7fe4f00fdee0 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4ef400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 0x7fe4f0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4ef400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 0x7fe4f0071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54706/0 (socket says 172.21.15.157:54706) 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.139+0000 7fe4ef400700 1 -- 172.21.15.157:0/887029577 learned_addr learned my addr 172.21.15.157:0/887029577 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4eea00700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4f00fdee0 0x7fe4f0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4ef400700 1 -- 172.21.15.157:0/887029577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4f00fdee0 msgr2=0x7fe4f0070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4ef400700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4f00fdee0 0x7fe4f0070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4ef400700 1 -- 172.21.15.157:0/887029577 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc005040 con 0x7fe4f00fcc30 2024-04-03T08:49:54.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4ef400700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 0x7fe4f0071e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000eb40 tx=0x7fe4e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:54.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e0007cc0 con 0x7fe4f00fcc30 2024-04-03T08:49:54.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4e000f040 con 0x7fe4f00fcc30 2024-04-03T08:49:54.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f0070cb0 con 0x7fe4f00fcc30 2024-04-03T08:49:54.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.140+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e000ca10 con 0x7fe4f00fcc30 2024-04-03T08:49:54.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.141+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f0115820 con 0x7fe4f00fcc30 2024-04-03T08:49:54.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.142+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f005f5f0 con 0x7fe4f00fcc30 2024-04-03T08:49:54.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.143+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe4e000cc80 con 0x7fe4f00fcc30 2024-04-03T08:49:54.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.143+0000 7fe4e7400700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe4d406d7f0 0x7fe4d406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:54.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.144+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fe4e008cc80 con 0x7fe4f00fcc30 2024-04-03T08:49:54.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.144+0000 7fe4eea00700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe4d406d7f0 0x7fe4d406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:54.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.144+0000 7fe4eea00700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe4d406d7f0 0x7fe4d406fca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009fd0 tx=0x7fe4dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:54.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.148+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe4e0056360 con 0x7fe4f00fcc30 2024-04-03T08:49:54.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.451+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4f0115b10 con 0x7fe4f00fcc30 2024-04-03T08:49:54.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.451+0000 7fe4e7400700 1 -- 172.21.15.157:0/887029577 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe4e0059a20 con 0x7fe4f00fcc30 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:49:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-04-03T08:49:54.454 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:49:54.454 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:49:54.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe4d406d7f0 msgr2=0x7fe4d406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe4d406d7f0 0x7fe4d406fca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009fd0 tx=0x7fe4dc009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:54.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 msgr2=0x7fe4f0071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 0x7fe4f0071e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000eb40 tx=0x7fe4e000b040 comp rx=0 tx=0).stop 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 shutdown_connections 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe4d406d7f0 0x7fe4d406fca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4f00fcc30 0x7fe4f0071e40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 --2- 172.21.15.157:0/887029577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4f00fdee0 0x7fe4f0070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 >> 172.21.15.157:0/887029577 conn(0x7fe4f00f8390 msgr2=0x7fe4f00f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 shutdown_connections 2024-04-03T08:49:54.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.454+0000 7fe4f5000700 1 -- 172.21.15.157:0/887029577 wait complete. 2024-04-03T08:49:54.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 -- 172.21.15.157:0/445347261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9181002b0 msgr2=0x7fa918100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 --2- 172.21.15.157:0/445347261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9181002b0 0x7fa918100720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa904004940 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:54.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 -- 172.21.15.157:0/445347261 shutdown_connections 2024-04-03T08:49:54.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 --2- 172.21.15.157:0/445347261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9181002b0 0x7fa918100720 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 --2- 172.21.15.157:0/445347261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9180ff000 0x7fa9180ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 -- 172.21.15.157:0/445347261 >> 172.21.15.157:0/445347261 conn(0x7fa9180fa950 msgr2=0x7fa9180fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:54.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 -- 172.21.15.157:0/445347261 shutdown_connections 2024-04-03T08:49:54.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.599+0000 7fa91ce00700 1 -- 172.21.15.157:0/445347261 wait complete. 2024-04-03T08:49:54.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.600+0000 7fa91ce00700 1 Processor -- start 2024-04-03T08:49:54.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.600+0000 7fa91ce00700 1 -- start start 2024-04-03T08:49:54.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.600+0000 7fa91ce00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 0x7fa91810fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.600+0000 7fa91ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9181002b0 0x7fa91810ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.600+0000 7fa91ce00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9181105d0 con 0x7fa9180ff000 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.600+0000 7fa91ce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918110740 con 0x7fa9181002b0 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 0x7fa91810fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 0x7fa91810fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54716/0 (socket says 172.21.15.157:54716) 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 -- 172.21.15.157:0/124781783 learned_addr learned my addr 172.21.15.157:0/124781783 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915400700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9181002b0 0x7fa91810ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 -- 172.21.15.157:0/124781783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9181002b0 msgr2=0x7fa91810ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9181002b0 0x7fa91810ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 -- 172.21.15.157:0/124781783 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904005040 con 0x7fa9180ff000 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.601+0000 7fa915e00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 0x7fa91810fa90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa90800eb40 tx=0x7fa90800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.602+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908007cc0 con 0x7fa9180ff000 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.602+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa90800f040 con 0x7fa9180ff000 2024-04-03T08:49:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.602+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa918115140 con 0x7fa9180ff000 2024-04-03T08:49:54.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.602+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90800ca10 con 0x7fa9180ff000 2024-04-03T08:49:54.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.602+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa918115680 con 0x7fa9180ff000 2024-04-03T08:49:54.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.603+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91804c710 con 0x7fa9180ff000 2024-04-03T08:49:54.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.604+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa90800cb70 con 0x7fa9180ff000 2024-04-03T08:49:54.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.605+0000 7fa90e000700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa8fc06d7e0 0x7fa8fc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:54.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.605+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa90808cbd0 con 0x7fa9180ff000 2024-04-03T08:49:54.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.605+0000 7fa915400700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa8fc06d7e0 0x7fa8fc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:54.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.606+0000 7fa915400700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa8fc06d7e0 0x7fa8fc06fc90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b0d0 tx=0x7fa904009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:54.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.610+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa908059e60 con 0x7fa9180ff000 2024-04-03T08:49:54.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:54 smithi157 ceph-mon[117693]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:54.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:54 smithi181 ceph-mon[101094]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:54.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.872+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa918115b10 con 0x7fa9180ff000 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.872+0000 7fa90e000700 1 -- 172.21.15.157:0/124781783 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1902 (secure 0 0 0) 0x7fa9080599f0 con 0x7fa9180ff000 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:e35 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 35 2024-04-03T08:49:54.873 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:48:48.847209+0000 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 97 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:49:54.874 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=34412} 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{0:34412} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:49:54.875 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:44387} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/397415286,v1:172.21.15.181:6825/397415286] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{-1:44391} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6826/3661110481,v1:172.21.15.181:6827/3661110481] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa8fc06d7e0 msgr2=0x7fa8fc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa8fc06d7e0 0x7fa8fc06fc90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b0d0 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 msgr2=0x7fa91810fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 0x7fa91810fa90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa90800eb40 tx=0x7fa90800b040 comp rx=0 tx=0).stop 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 shutdown_connections 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa8fc06d7e0 0x7fa8fc06fc90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9180ff000 0x7fa91810fa90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 --2- 172.21.15.157:0/124781783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9181002b0 0x7fa91810ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:54.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 >> 172.21.15.157:0/124781783 conn(0x7fa9180fa950 msgr2=0x7fa9180fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:54.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 shutdown_connections 2024-04-03T08:49:54.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:54.875+0000 7fa91ce00700 1 -- 172.21.15.157:0/124781783 wait complete. 2024-04-03T08:49:54.877 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 35 2024-04-03T08:49:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 -- 172.21.15.157:0/336960237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 msgr2=0x7f1f940fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 --2- 172.21.15.157:0/336960237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f940fd3f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f80004940 tx=0x7f1f80009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 -- 172.21.15.157:0/336960237 shutdown_connections 2024-04-03T08:49:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 --2- 172.21.15.157:0/336960237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f940fd3f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 --2- 172.21.15.157:0/336960237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940fbcd0 0x7f1f940fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 -- 172.21.15.157:0/336960237 >> 172.21.15.157:0/336960237 conn(0x7f1f940f7430 msgr2=0x7f1f940f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 -- 172.21.15.157:0/336960237 shutdown_connections 2024-04-03T08:49:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.048+0000 7f1f9c000700 1 -- 172.21.15.157:0/336960237 wait complete. 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.049+0000 7f1f9c000700 1 Processor -- start 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.049+0000 7f1f9c000700 1 -- start start 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f9c000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940fbcd0 0x7f1f9410fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f9c000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f94110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f9c000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94110710 con 0x7f1f940fcf80 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f9c000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94110f10 con 0x7f1f940fbcd0 2024-04-03T08:49:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f98c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f94110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:55.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f98c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f94110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54736/0 (socket says 172.21.15.157:54736) 2024-04-03T08:49:55.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f98c00700 1 -- 172.21.15.157:0/832442808 learned_addr learned my addr 172.21.15.157:0/832442808 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:55.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.050+0000 7f1f99600700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940fbcd0 0x7f1f9410fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:55.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f98c00700 1 -- 172.21.15.157:0/832442808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940fbcd0 msgr2=0x7f1f9410fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f98c00700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940fbcd0 0x7f1f9410fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f98c00700 1 -- 172.21.15.157:0/832442808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80005040 con 0x7f1f940fcf80 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f98c00700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f94110110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f80013870 tx=0x7f1f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f80021070 con 0x7f1f940fcf80 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f80009430 con 0x7f1f940fcf80 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f94111190 con 0x7f1f940fcf80 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f8000e070 con 0x7f1f940fcf80 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.051+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f941116d0 con 0x7f1f940fcf80 2024-04-03T08:49:55.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.053+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f94101910 con 0x7f1f940fcf80 2024-04-03T08:49:55.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.053+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1f8001c750 con 0x7f1f940fcf80 2024-04-03T08:49:55.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.055+0000 7f1f91600700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1f7c06d770 0x7f1f7c06fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:55.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.055+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f1f8008e260 con 0x7f1f940fcf80 2024-04-03T08:49:55.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.055+0000 7f1f99600700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1f7c06d770 0x7f1f7c06fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:55.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.056+0000 7f1f99600700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1f7c06d770 0x7f1f7c06fc20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009b80 tx=0x7f1f8800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:55.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.059+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1f8005b440 con 0x7f1f940fcf80 2024-04-03T08:49:55.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.311+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f941048d0 con 0x7f1f7c06d770 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.312+0000 7f1f91600700 1 -- 172.21.15.157:0/832442808 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f1f941048d0 con 0x7f1f7c06d770 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f943758ec7cc9be5c815a8661fb380627f02e368f93749b09fa4c7778f9e6fbc", 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": true, 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [ 2024-04-03T08:49:55.313 INFO:teuthology.orchestra.run.smithi157.stdout: "osd", 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "mds", 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "crash", 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "mon", 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr" 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": "16/21 daemons upgraded", 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:49:55.314 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1f7c06d770 msgr2=0x7f1f7c06fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1f7c06d770 0x7f1f7c06fc20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009b80 tx=0x7f1f8800b040 comp rx=0 tx=0).stop 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 msgr2=0x7f1f94110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f94110110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f80013870 tx=0x7f1f80009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 shutdown_connections 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f1f7c06d770 0x7f1f7c06fc20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940fbcd0 0x7f1f9410fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 --2- 172.21.15.157:0/832442808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f940fcf80 0x7f1f94110110 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 >> 172.21.15.157:0/832442808 conn(0x7f1f940f7430 msgr2=0x7f1f94065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 shutdown_connections 2024-04-03T08:49:55.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.315+0000 7f1f9c000700 1 -- 172.21.15.157:0/832442808 wait complete. 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 -- 172.21.15.157:0/414605712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 msgr2=0x7fc1980fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 --2- 172.21.15.157:0/414605712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc1980fd290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc18c004940 tx=0x7fc18c009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 -- 172.21.15.157:0/414605712 shutdown_connections 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 --2- 172.21.15.157:0/414605712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 0x7fc1980fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 --2- 172.21.15.157:0/414605712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc1980fd290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 -- 172.21.15.157:0/414605712 >> 172.21.15.157:0/414605712 conn(0x7fc1980f8560 msgr2=0x7fc1980fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 -- 172.21.15.157:0/414605712 shutdown_connections 2024-04-03T08:49:55.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.455+0000 7fc1a0000700 1 -- 172.21.15.157:0/414605712 wait complete. 2024-04-03T08:49:55.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc1a0000700 1 Processor -- start 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc1a0000700 1 -- start start 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc1a0000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc19810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc1a0000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 0x7fc198110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc1a0000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198110810 con 0x7fc1980fce80 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc1a0000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198111000 con 0x7fc1980fdff0 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc19d600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc19810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc19d600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc19810fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54756/0 (socket says 172.21.15.157:54756) 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.456+0000 7fc19d600700 1 -- 172.21.15.157:0/2241130975 learned_addr learned my addr 172.21.15.157:0/2241130975 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc19d600700 1 -- 172.21.15.157:0/2241130975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 msgr2=0x7fc198110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc19cc00700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 0x7fc198110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc19d600700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 0x7fc198110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc19d600700 1 -- 172.21.15.157:0/2241130975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c005040 con 0x7fc1980fce80 2024-04-03T08:49:55.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc19cc00700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 0x7fc198110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:49:55.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc19d600700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc19810fc40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009150 tx=0x7fc18c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:55.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18c00e040 con 0x7fc1980fce80 2024-04-03T08:49:55.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc18c00bbf0 con 0x7fc1980fce80 2024-04-03T08:49:55.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc198111280 con 0x7fc1980fce80 2024-04-03T08:49:55.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18c01c630 con 0x7fc1980fce80 2024-04-03T08:49:55.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.457+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc198111840 con 0x7fc1980fce80 2024-04-03T08:49:55.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.459+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198101980 con 0x7fc1980fce80 2024-04-03T08:49:55.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.460+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc18c00bd60 con 0x7fc1980fce80 2024-04-03T08:49:55.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.460+0000 7fc195600700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc18006d7f0 0x7fc18006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:49:55.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.461+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fc18c08e440 con 0x7fc1980fce80 2024-04-03T08:49:55.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.461+0000 7fc19cc00700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc18006d7f0 0x7fc18006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:49:55.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.461+0000 7fc19cc00700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc18006d7f0 0x7fc18006fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc184006fd0 tx=0x7fc184008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:49:55.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.465+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc18c05b6c0 con 0x7fc1980fce80 2024-04-03T08:49:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:55 smithi157 ceph-mon[117693]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:55 smithi157 ceph-mon[117693]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:55 smithi157 ceph-mon[117693]: pgmap v266: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:55 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/887029577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:55 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/124781783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:49:55.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.758+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc19805f5f0 con 0x7fc1980fce80 2024-04-03T08:49:55.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.759+0000 7fc195600700 1 -- 172.21.15.157:0/2241130975 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc18c05b250 con 0x7fc1980fce80 2024-04-03T08:49:55.760 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:49:55.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc18006d7f0 msgr2=0x7fc18006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc18006d7f0 0x7fc18006fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc184006fd0 tx=0x7fc184008040 comp rx=0 tx=0).stop 2024-04-03T08:49:55.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 msgr2=0x7fc19810fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:49:55.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc19810fc40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009150 tx=0x7fc18c009e30 comp rx=0 tx=0).stop 2024-04-03T08:49:55.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 shutdown_connections 2024-04-03T08:49:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc18006d7f0 0x7fc18006fca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1980fce80 0x7fc19810fc40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 --2- 172.21.15.157:0/2241130975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1980fdff0 0x7fc198110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:49:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 >> 172.21.15.157:0/2241130975 conn(0x7fc1980f8560 msgr2=0x7fc1980f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:49:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 shutdown_connections 2024-04-03T08:49:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:49:55.761+0000 7fc1a0000700 1 -- 172.21.15.157:0/2241130975 wait complete. 2024-04-03T08:49:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:55 smithi181 ceph-mon[101094]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:55 smithi181 ceph-mon[101094]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:55 smithi181 ceph-mon[101094]: pgmap v266: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:49:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:55 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/887029577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:55 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/124781783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:49:56.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2241130975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2241130975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:49:56.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:56.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:49:57.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:57 smithi157 ceph-mon[117693]: pgmap v267: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:57.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:57 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:49:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:57 smithi181 ceph-mon[101094]: pgmap v267: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:49:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:57 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-03T08:49:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:58 smithi157 ceph-mon[117693]: pgmap v268: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:58 smithi157 ceph-mon[117693]: Upgrade: Updating grafana.smithi157 2024-04-03T08:49:58.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:58 smithi157 ceph-mon[117693]: Deploying daemon grafana.smithi157 on smithi157 2024-04-03T08:49:58.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:58 smithi181 ceph-mon[101094]: pgmap v268: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:49:58.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:58 smithi181 ceph-mon[101094]: Upgrade: Updating grafana.smithi157 2024-04-03T08:49:58.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:58 smithi181 ceph-mon[101094]: Deploying daemon grafana.smithi157 on smithi157 2024-04-03T08:49:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:49:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:49:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:49:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:00.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T08:50:00.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:00 smithi157 ceph-mon[117693]: pgmap v269: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T08:50:00.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:00 smithi181 ceph-mon[101094]: pgmap v269: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:03.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:03 smithi157 ceph-mon[117693]: pgmap v270: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:03.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:03 smithi181 ceph-mon[101094]: pgmap v270: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:05.314 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:05.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:05.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:05.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:05 smithi157 ceph-mon[117693]: pgmap v271: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:05.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:05 smithi181 ceph-mon[101094]: pgmap v271: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:07 smithi157 ceph-mon[117693]: pgmap v272: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:07.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:07 smithi181 ceph-mon[101094]: pgmap v272: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:09.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:09 smithi157 ceph-mon[117693]: pgmap v273: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:09.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:09 smithi181 ceph-mon[101094]: pgmap v273: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:11.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:11.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:11.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:10 smithi157 ceph-mon[117693]: pgmap v274: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:11.097 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:10 smithi181 ceph-mon[101094]: pgmap v274: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:12.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:12.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:12.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:13.250 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:12 smithi157 ceph-mon[117693]: pgmap v275: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:13.347 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:12 smithi181 ceph-mon[101094]: pgmap v275: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:14.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:15.521 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:15 smithi157 ceph-mon[117693]: pgmap v276: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:15 smithi181 ceph-mon[101094]: pgmap v276: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:16.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:50:16.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:50:16.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: Upgrade: Finalizing container_image settings 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-03T08:50:16.817 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-03T08:50:16.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: Upgrade: Complete! 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-03T08:50:16.819 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:16.820 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:16 smithi157 ceph-mon[117693]: pgmap v277: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:50:16.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.848 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: Upgrade: Finalizing container_image settings 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.849 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-03T08:50:16.850 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: Upgrade: Complete! 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-03T08:50:16.851 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:16.852 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:16 smithi181 ceph-mon[101094]: pgmap v277: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:50:17.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:50:17.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:17.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:17.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:50:17.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:50:17.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:50:17.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:18.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:18 smithi181 ceph-mon[101094]: pgmap v278: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:19.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:18 smithi157 ceph-mon[117693]: pgmap v278: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:20.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:50:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:21 smithi181 ceph-mon[101094]: pgmap v279: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:21.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:21 smithi157 ceph-mon[117693]: pgmap v279: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:23 smithi181 ceph-mon[101094]: pgmap v280: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:23.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:23 smithi157 ceph-mon[117693]: pgmap v280: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:25 smithi181 ceph-mon[101094]: pgmap v281: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:25 smithi157 ceph-mon[117693]: pgmap v281: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.913+0000 7ff2dda00700 1 -- 172.21.15.157:0/239320195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 msgr2=0x7ff2d80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.913+0000 7ff2dda00700 1 --2- 172.21.15.157:0/239320195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d80fd310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8004940 tx=0x7ff2c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.913+0000 7ff2dda00700 1 -- 172.21.15.157:0/239320195 shutdown_connections 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.913+0000 7ff2dda00700 1 --2- 172.21.15.157:0/239320195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2d80fe0d0 0x7ff2d80fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.913+0000 7ff2dda00700 1 --2- 172.21.15.157:0/239320195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d80fd310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.913+0000 7ff2dda00700 1 -- 172.21.15.157:0/239320195 >> 172.21.15.157:0/239320195 conn(0x7ff2d80f8560 msgr2=0x7ff2d80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.914+0000 7ff2dda00700 1 -- 172.21.15.157:0/239320195 shutdown_connections 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.914+0000 7ff2dda00700 1 -- 172.21.15.157:0/239320195 wait complete. 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2dda00700 1 Processor -- start 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2dda00700 1 -- start start 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2dda00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2dda00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2d80fe0d0 0x7ff2d8110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2dda00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8110860 con 0x7ff2d80fcee0 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2dda00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8110fa0 con 0x7ff2d80fe0d0 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2d6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2d6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d810fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39546/0 (socket says 172.21.15.157:39546) 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.915+0000 7ff2d6a00700 1 -- 172.21.15.157:0/1158658775 learned_addr learned my addr 172.21.15.157:0/1158658775 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2d6000700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2d80fe0d0 0x7ff2d8110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2d6a00700 1 -- 172.21.15.157:0/1158658775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2d80fe0d0 msgr2=0x7ff2d8110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2d6a00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2d80fe0d0 0x7ff2d8110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2d6a00700 1 -- 172.21.15.157:0/1158658775 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8005040 con 0x7ff2d80fcee0 2024-04-03T08:50:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2d6a00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d810fd20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800b970 tx=0x7ff2c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c800e040 con 0x7ff2d80fcee0 2024-04-03T08:50:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2c8004290 con 0x7ff2d80fcee0 2024-04-03T08:50:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d8111220 con 0x7ff2d80fcee0 2024-04-03T08:50:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c801c3f0 con 0x7ff2d80fcee0 2024-04-03T08:50:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.916+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81117e0 con 0x7ff2d80fcee0 2024-04-03T08:50:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.917+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8101a60 con 0x7ff2d80fcee0 2024-04-03T08:50:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.918+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff2c800bbf0 con 0x7ff2d80fcee0 2024-04-03T08:50:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.919+0000 7ff2cea00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff2bc06d7f0 0x7ff2bc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.919+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7ff2c808e3a0 con 0x7ff2d80fcee0 2024-04-03T08:50:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.920+0000 7ff2d6000700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff2bc06d7f0 0x7ff2bc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:25.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.920+0000 7ff2d6000700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff2bc06d7f0 0x7ff2bc06fca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4004f40 tx=0x7ff2c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:25.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:25.925+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff2c805b580 con 0x7ff2d80fcee0 2024-04-03T08:50:26.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.150+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d8111ac0 con 0x7ff2bc06d7f0 2024-04-03T08:50:26.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.151+0000 7ff2cea00700 1 -- 172.21.15.157:0/1158658775 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ff2d8111ac0 con 0x7ff2bc06d7f0 2024-04-03T08:50:26.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff2bc06d7f0 msgr2=0x7ff2bc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:26.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff2bc06d7f0 0x7ff2bc06fca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4004f40 tx=0x7ff2c400b040 comp rx=0 tx=0).stop 2024-04-03T08:50:26.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 msgr2=0x7ff2d810fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:26.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d810fd20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800b970 tx=0x7ff2c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 shutdown_connections 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff2bc06d7f0 0x7ff2bc06fca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2d80fcee0 0x7ff2d810fd20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 --2- 172.21.15.157:0/1158658775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2d80fe0d0 0x7ff2d8110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.153+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 >> 172.21.15.157:0/1158658775 conn(0x7ff2d80f8560 msgr2=0x7ff2d80f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.154+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 shutdown_connections 2024-04-03T08:50:26.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:26.154+0000 7ff2dda00700 1 -- 172.21.15.157:0/1158658775 wait complete. 2024-04-03T08:50:26.969 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-04-03T08:50:27.442 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:50:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:27 smithi181 ceph-mon[101094]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:50:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:27 smithi181 ceph-mon[101094]: pgmap v282: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:27.715 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:27 smithi157 ceph-mon[117693]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:50:27.715 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:27 smithi157 ceph-mon[117693]: pgmap v282: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 -- 172.21.15.157:0/2380831770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42941035e0 msgr2=0x7f42940fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 --2- 172.21.15.157:0/2380831770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42941035e0 0x7f42940fcc50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4280004940 tx=0x7f4280009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 -- 172.21.15.157:0/2380831770 shutdown_connections 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 --2- 172.21.15.157:0/2380831770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42941035e0 0x7f42940fcc50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 --2- 172.21.15.157:0/2380831770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4294102c40 0x7f4294103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 -- 172.21.15.157:0/2380831770 >> 172.21.15.157:0/2380831770 conn(0x7f42940f8830 msgr2=0x7f42940fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 -- 172.21.15.157:0/2380831770 shutdown_connections 2024-04-03T08:50:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.284+0000 7f4298e00700 1 -- 172.21.15.157:0/2380831770 wait complete. 2024-04-03T08:50:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4298e00700 1 Processor -- start 2024-04-03T08:50:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4298e00700 1 -- start start 2024-04-03T08:50:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4298e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 0x7f4294115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4298e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42941035e0 0x7f4294116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4298e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294116790 con 0x7f4294102c40 2024-04-03T08:50:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4298e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429410fb80 con 0x7f42941035e0 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4293400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 0x7f4294115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4293400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 0x7f4294115c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39558/0 (socket says 172.21.15.157:39558) 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.285+0000 7f4293400700 1 -- 172.21.15.157:0/706396309 learned_addr learned my addr 172.21.15.157:0/706396309 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f4292a00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42941035e0 0x7f4294116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f4293400700 1 -- 172.21.15.157:0/706396309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42941035e0 msgr2=0x7f4294116140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f4293400700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42941035e0 0x7f4294116140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f4293400700 1 -- 172.21.15.157:0/706396309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280005040 con 0x7f4294102c40 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f4293400700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 0x7f4294115c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4284002a80 tx=0x7f42840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4284007cc0 con 0x7f4294102c40 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f428400f040 con 0x7f4294102c40 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429410fe60 con 0x7f4294102c40 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.286+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428400dac0 con 0x7f4294102c40 2024-04-03T08:50:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.287+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4294110370 con 0x7f4294102c40 2024-04-03T08:50:29.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.288+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42940fe390 con 0x7f4294102c40 2024-04-03T08:50:29.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.289+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f428400dc20 con 0x7f4294102c40 2024-04-03T08:50:29.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.289+0000 7f428b400700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f427806d7f0 0x7f427806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:29.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.290+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f428408cc80 con 0x7f4294102c40 2024-04-03T08:50:29.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.290+0000 7f4292a00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f427806d7f0 0x7f427806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:29.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.290+0000 7f4292a00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f427806d7f0 0x7f427806fca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4294111530 tx=0x7f4280009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:29.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.294+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4284059e80 con 0x7f4294102c40 2024-04-03T08:50:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.508+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f429404bf40 con 0x7f427806d7f0 2024-04-03T08:50:29.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.519+0000 7f428b400700 1 -- 172.21.15.157:0/706396309 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f429404bf40 con 0x7f427806d7f0 2024-04-03T08:50:29.519 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (46s) 19s ago 20m 14.5M - 0.25.0 c8568f914cd2 92482e122556 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (6m) 19s ago 20m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (6m) 84s ago 19m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (26s) 19s ago 20m 46.3M - 9.4.12 a0ea5e3c46d9 a013d18b3804 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (3m) 19s ago 14m 82.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (2m) 19s ago 14m 84.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 c20db495a227 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (2m) 84s ago 14m 11.1M - 19.0.0-1670-g1fb5d106 c318aa90b546 2a5ba2586b49 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (110s) 84s ago 14m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 60490a032fca 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (8m) 19s ago 22m 512M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (8m) 84s ago 19m 452M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (7m) 19s ago 22m 55.9M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (7m) 84s ago 19m 40.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (93s) 19s ago 20m 7142k - 1.5.0 0da6a335fe13 70ae0b3fbf65 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (88s) 84s ago 19m 2801k - 1.5.0 0da6a335fe13 90c76e3ccd43 2024-04-03T08:50:29.520 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (6m) 19s ago 18m 141M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:50:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (5m) 19s ago 18m 170M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:50:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (5m) 19s ago 17m 96.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:50:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (4m) 84s ago 17m 139M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:50:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (4m) 84s ago 16m 97.5M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:50:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (3m) 84s ago 16m 95.2M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:50:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (67s) 19s ago 20m 47.1M - 2.43.0 a07b618ecd1d aafef4771904 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f427806d7f0 msgr2=0x7f427806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f427806d7f0 0x7f427806fca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4294111530 tx=0x7f4280009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 msgr2=0x7f4294115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 0x7f4294115c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4284002a80 tx=0x7f42840046b0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 shutdown_connections 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f427806d7f0 0x7f427806fca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4294102c40 0x7f4294115c00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 --2- 172.21.15.157:0/706396309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42941035e0 0x7f4294116140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 >> 172.21.15.157:0/706396309 conn(0x7f42940f8830 msgr2=0x7f4294071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:29.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 shutdown_connections 2024-04-03T08:50:29.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:29.521+0000 7f4298e00700 1 -- 172.21.15.157:0/706396309 wait complete. 2024-04-03T08:50:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:29 smithi181 ceph-mon[101094]: pgmap v283: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:29 smithi157 ceph-mon[117693]: pgmap v283: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:29.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:30.290 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade status' 2024-04-03T08:50:30.721 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:50:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:31 smithi181 ceph-mon[101094]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:50:31.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:31 smithi181 ceph-mon[101094]: pgmap v284: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:31 smithi157 ceph-mon[117693]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:50:31.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:31 smithi157 ceph-mon[117693]: pgmap v284: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:32.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 -- 172.21.15.157:0/3289555001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60081037a0 msgr2=0x7f60080fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:32.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 --2- 172.21.15.157:0/3289555001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60081037a0 0x7f60080fce10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4004940 tx=0x7f5ff4009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:32.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 -- 172.21.15.157:0/3289555001 shutdown_connections 2024-04-03T08:50:32.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 --2- 172.21.15.157:0/3289555001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60081037a0 0x7f60080fce10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 --2- 172.21.15.157:0/3289555001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6008102e00 0x7f60081031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 -- 172.21.15.157:0/3289555001 >> 172.21.15.157:0/3289555001 conn(0x7f60080f89b0 msgr2=0x7f60080fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:32.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 -- 172.21.15.157:0/3289555001 shutdown_connections 2024-04-03T08:50:32.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.557+0000 7f600e400700 1 -- 172.21.15.157:0/3289555001 wait complete. 2024-04-03T08:50:32.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.558+0000 7f600e400700 1 Processor -- start 2024-04-03T08:50:32.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.558+0000 7f600e400700 1 -- start start 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f600e400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 0x7f6008115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f600e400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60081037a0 0x7f6008116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f600e400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008116970 con 0x7f6008102e00 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f600e400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600810fd40 con 0x7f60081037a0 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f6007400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 0x7f6008115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f6007400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 0x7f6008115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43138/0 (socket says 172.21.15.157:43138) 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f6007400700 1 -- 172.21.15.157:0/733631920 learned_addr learned my addr 172.21.15.157:0/733631920 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.559+0000 7f6006a00700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60081037a0 0x7f6008116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:32.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f6007400700 1 -- 172.21.15.157:0/733631920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60081037a0 msgr2=0x7f6008116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f6007400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60081037a0 0x7f6008116320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f6007400700 1 -- 172.21.15.157:0/733631920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4005040 con 0x7f6008102e00 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f6007400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 0x7f6008115de0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8002a50 tx=0x7f5ff80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ff8007cc0 con 0x7f6008102e00 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6008110020 con 0x7f6008102e00 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ff800f040 con 0x7f6008102e00 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ff800da30 con 0x7f6008102e00 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.560+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60081105e0 con 0x7f6008102e00 2024-04-03T08:50:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.561+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60081018c0 con 0x7f6008102e00 2024-04-03T08:50:32.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.562+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5ff800db90 con 0x7f6008102e00 2024-04-03T08:50:32.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.564+0000 7f5fff400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5fec06d7f0 0x7f5fec06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:32.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.564+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f5ff808cd70 con 0x7f6008102e00 2024-04-03T08:50:32.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.564+0000 7f6006a00700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5fec06d7f0 0x7f5fec06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:32.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.565+0000 7f6006a00700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5fec06d7f0 0x7f5fec06fca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6008111680 tx=0x7f5ff4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:32.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.569+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5ff8059f50 con 0x7f6008102e00 2024-04-03T08:50:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.791+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6008109f50 con 0x7f5fec06d7f0 2024-04-03T08:50:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.792+0000 7f5fff400700 1 -- 172.21.15.157:0/733631920 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f6008109f50 con 0x7f5fec06d7f0 2024-04-03T08:50:32.794 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:50:32.794 INFO:teuthology.orchestra.run.smithi157.stdout: "target_image": null, 2024-04-03T08:50:32.794 INFO:teuthology.orchestra.run.smithi157.stdout: "in_progress": false, 2024-04-03T08:50:32.794 INFO:teuthology.orchestra.run.smithi157.stdout: "which": "", 2024-04-03T08:50:32.794 INFO:teuthology.orchestra.run.smithi157.stdout: "services_complete": [], 2024-04-03T08:50:32.795 INFO:teuthology.orchestra.run.smithi157.stdout: "progress": null, 2024-04-03T08:50:32.795 INFO:teuthology.orchestra.run.smithi157.stdout: "message": "", 2024-04-03T08:50:32.795 INFO:teuthology.orchestra.run.smithi157.stdout: "is_paused": false 2024-04-03T08:50:32.795 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.794+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5fec06d7f0 msgr2=0x7f5fec06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.794+0000 7f600e400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5fec06d7f0 0x7f5fec06fca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6008111680 tx=0x7f5ff4009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 msgr2=0x7f6008115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 0x7f6008115de0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8002a50 tx=0x7f5ff80046b0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 shutdown_connections 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f5fec06d7f0 0x7f5fec06fca0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008102e00 0x7f6008115de0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 --2- 172.21.15.157:0/733631920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60081037a0 0x7f6008116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 >> 172.21.15.157:0/733631920 conn(0x7f60080f89b0 msgr2=0x7f6008102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:32.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 shutdown_connections 2024-04-03T08:50:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:32.795+0000 7f600e400700 1 -- 172.21.15.157:0/733631920 wait complete. 2024-04-03T08:50:33.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:33 smithi157 ceph-mon[117693]: pgmap v285: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:33.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph health detail' 2024-04-03T08:50:33.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:33 smithi181 ceph-mon[101094]: pgmap v285: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:34.011 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:50:34.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:34 smithi157 ceph-mon[117693]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:50:34.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:34 smithi181 ceph-mon[101094]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:50:35.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:35 smithi157 ceph-mon[117693]: pgmap v286: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:35.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:35 smithi181 ceph-mon[101094]: pgmap v286: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:35.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 -- 172.21.15.157:0/3216111892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 msgr2=0x7fd9000fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:35.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 --2- 172.21.15.157:0/3216111892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd9000fce10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec004940 tx=0x7fd8ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:35.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 -- 172.21.15.157:0/3216111892 shutdown_connections 2024-04-03T08:50:35.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 --2- 172.21.15.157:0/3216111892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd9000fce10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:35.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 --2- 172.21.15.157:0/3216111892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 0x7fd9001031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:35.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 -- 172.21.15.157:0/3216111892 >> 172.21.15.157:0/3216111892 conn(0x7fd9000f89b0 msgr2=0x7fd9000fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:35.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 -- 172.21.15.157:0/3216111892 shutdown_connections 2024-04-03T08:50:35.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.836+0000 7fd908200700 1 -- 172.21.15.157:0/3216111892 wait complete. 2024-04-03T08:50:35.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.837+0000 7fd908200700 1 Processor -- start 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.837+0000 7fd908200700 1 -- start start 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd908200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 0x7fd900115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd908200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd900116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd908200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900116970 con 0x7fd9001037a0 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd908200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90010fd40 con 0x7fd900102e00 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd904e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd900116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd904e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd900116320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43158/0 (socket says 172.21.15.157:43158) 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd904e00700 1 -- 172.21.15.157:0/2272637624 learned_addr learned my addr 172.21.15.157:0/2272637624 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd905800700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 0x7fd900115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd904e00700 1 -- 172.21.15.157:0/2272637624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 msgr2=0x7fd900115de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd904e00700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 0x7fd900115de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:35.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd904e00700 1 -- 172.21.15.157:0/2272637624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec005040 con 0x7fd9001037a0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.838+0000 7fd905800700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 0x7fd900115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.839+0000 7fd904e00700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd900116320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009100 tx=0x7fd8ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.839+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8ec00e040 con 0x7fd9001037a0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.839+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8ec013420 con 0x7fd9001037a0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.839+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90010ffc0 con 0x7fd9001037a0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.839+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8ec01c630 con 0x7fd9001037a0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.839+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd900110580 con 0x7fd9001037a0 2024-04-03T08:50:35.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.840+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9001018c0 con 0x7fd9001037a0 2024-04-03T08:50:35.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.841+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd8ec013590 con 0x7fd9001037a0 2024-04-03T08:50:35.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.843+0000 7fd8fd600700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd8e806d7f0 0x7fd8e806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:35.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.843+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fd8ec08e360 con 0x7fd9001037a0 2024-04-03T08:50:35.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.843+0000 7fd905800700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd8e806d7f0 0x7fd8e806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:35.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.844+0000 7fd905800700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd8e806d7f0 0x7fd8e806fca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009fd0 tx=0x7fd8f4009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:35.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:35.848+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd8ec05b540 con 0x7fd9001037a0 2024-04-03T08:50:36.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.133+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd9000fe550 con 0x7fd9001037a0 2024-04-03T08:50:36.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.134+0000 7fd8fd600700 1 -- 172.21.15.157:0/2272637624 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd8ec05b0d0 con 0x7fd9001037a0 2024-04-03T08:50:36.136 INFO:teuthology.orchestra.run.smithi157.stdout:HEALTH_OK 2024-04-03T08:50:36.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd8e806d7f0 msgr2=0x7fd8e806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:36.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd8e806d7f0 0x7fd8e806fca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009fd0 tx=0x7fd8f4009ee0 comp rx=0 tx=0).stop 2024-04-03T08:50:36.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 msgr2=0x7fd900116320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd900116320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009100 tx=0x7fd8ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 shutdown_connections 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fd8e806d7f0 0x7fd8e806fca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd900102e00 0x7fd900115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 --2- 172.21.15.157:0/2272637624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9001037a0 0x7fd900116320 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 >> 172.21.15.157:0/2272637624 conn(0x7fd9000f89b0 msgr2=0x7fd900102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 shutdown_connections 2024-04-03T08:50:36.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:36.137+0000 7fd908200700 1 -- 172.21.15.157:0/2272637624 wait complete. 2024-04-03T08:50:36.510 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:36 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2272637624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:50:36.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-04-03T08:50:36.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:36 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2272637624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-03T08:50:37.257 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:50:37.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:37 smithi157 ceph-mon[117693]: pgmap v287: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:37.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:37 smithi181 ceph-mon[101094]: pgmap v287: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:39.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 -- 172.21.15.157:0/3819788735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc1037a0 msgr2=0x7f4acc0fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3819788735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc1037a0 0x7f4acc0fce10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8004940 tx=0x7f4ab8009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 -- 172.21.15.157:0/3819788735 shutdown_connections 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3819788735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc1037a0 0x7f4acc0fce10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3819788735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4acc102e00 0x7f4acc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 -- 172.21.15.157:0/3819788735 >> 172.21.15.157:0/3819788735 conn(0x7f4acc0f89b0 msgr2=0x7f4acc0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 -- 172.21.15.157:0/3819788735 shutdown_connections 2024-04-03T08:50:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.118+0000 7f4ad1400700 1 -- 172.21.15.157:0/3819788735 wait complete. 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.119+0000 7f4ad1400700 1 Processor -- start 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.119+0000 7f4ad1400700 1 -- start start 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4ad1400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 0x7f4acc115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4ad1400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4acc1037a0 0x7f4acc116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4ad1400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc116970 con 0x7f4acc102e00 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4ad1400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc10fd80 con 0x7f4acc1037a0 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4aca800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 0x7f4acc115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4aca800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 0x7f4acc115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:43176/0 (socket says 172.21.15.157:43176) 2024-04-03T08:50:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4aca800700 1 -- 172.21.15.157:0/3301533078 learned_addr learned my addr 172.21.15.157:0/3301533078 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:50:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4aca800700 1 -- 172.21.15.157:0/3301533078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4acc1037a0 msgr2=0x7f4acc116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4aca800700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4acc1037a0 0x7f4acc116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.120+0000 7f4aca800700 1 -- 172.21.15.157:0/3301533078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8005040 con 0x7f4acc102e00 2024-04-03T08:50:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.121+0000 7f4aca800700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 0x7f4acc115de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4abc002a50 tx=0x7f4abc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.121+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4abc007cc0 con 0x7f4acc102e00 2024-04-03T08:50:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.121+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4abc00f040 con 0x7f4acc102e00 2024-04-03T08:50:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.121+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc110060 con 0x7f4acc102e00 2024-04-03T08:50:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.121+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4abc009640 con 0x7f4acc102e00 2024-04-03T08:50:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.121+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc1105a0 con 0x7f4acc102e00 2024-04-03T08:50:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.122+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc102120 con 0x7f4acc102e00 2024-04-03T08:50:39.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.123+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4abc0097a0 con 0x7f4acc102e00 2024-04-03T08:50:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.124+0000 7f4ac2a00700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ab006d7e0 0x7f4ab006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:50:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.124+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f4abc08cea0 con 0x7f4acc102e00 2024-04-03T08:50:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.124+0000 7f4ac9e00700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ab006d7e0 0x7f4ab006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:50:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.125+0000 7f4ac9e00700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ab006d7e0 0x7f4ab006fc90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8004f90 tx=0x7f4ab8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:50:39.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.129+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4abc0564d0 con 0x7f4acc102e00 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.417+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4acc1114a0 con 0x7f4acc102e00 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.417+0000 7f4ac2a00700 1 -- 172.21.15.157:0/3301533078 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4abc059b90 con 0x7f4acc102e00 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:50:39.419 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:50:39.420 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ab006d7e0 msgr2=0x7f4ab006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ab006d7e0 0x7f4ab006fc90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8004f90 tx=0x7f4ab8009e30 comp rx=0 tx=0).stop 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 msgr2=0x7f4acc115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 0x7f4acc115de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4abc002a50 tx=0x7f4abc0046b0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 shutdown_connections 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f4ab006d7e0 0x7f4ab006fc90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4acc102e00 0x7f4acc115de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 --2- 172.21.15.157:0/3301533078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4acc1037a0 0x7f4acc116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 >> 172.21.15.157:0/3301533078 conn(0x7f4acc0f89b0 msgr2=0x7f4acc070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 shutdown_connections 2024-04-03T08:50:39.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:50:39.420+0000 7f4ad1400700 1 -- 172.21.15.157:0/3301533078 wait complete. 2024-04-03T08:50:39.774 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:39 smithi157 ceph-mon[117693]: pgmap v288: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:39.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:39 smithi181 ceph-mon[101094]: pgmap v288: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:40.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-03T08:50:40.537 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:50:40.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:40 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3301533078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:40.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:40 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3301533078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:50:41.724 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:41 smithi157 ceph-mon[117693]: pgmap v289: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:41 smithi181 ceph-mon[101094]: pgmap v289: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:42.400 INFO:teuthology.orchestra.run.smithi157.stdout:wait for servicemap items w/ changing names to refresh 2024-04-03T08:50:43.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'sleep 60' 2024-04-03T08:50:43.494 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:50:43.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:43 smithi157 ceph-mon[117693]: pgmap v290: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:43.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:43 smithi181 ceph-mon[101094]: pgmap v290: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:44.663 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:45.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:45 smithi157 ceph-mon[117693]: pgmap v291: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:45.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:45 smithi181 ceph-mon[101094]: pgmap v291: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:47.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:47 smithi157 ceph-mon[117693]: pgmap v292: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:47.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:47 smithi181 ceph-mon[101094]: pgmap v292: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:49.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:49 smithi157 ceph-mon[117693]: pgmap v293: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:49.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:49 smithi181 ceph-mon[101094]: pgmap v293: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:51.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:51 smithi157 ceph-mon[117693]: pgmap v294: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:51.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:51 smithi181 ceph-mon[101094]: pgmap v294: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:53.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:53 smithi157 ceph-mon[117693]: pgmap v295: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:53.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:53 smithi181 ceph-mon[101094]: pgmap v295: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:55.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:55 smithi157 ceph-mon[117693]: pgmap v296: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:55 smithi181 ceph-mon[101094]: pgmap v296: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:50:57.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:57 smithi157 ceph-mon[117693]: pgmap v297: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:57 smithi181 ceph-mon[101094]: pgmap v297: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:50:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:59 smithi157 ceph-mon[117693]: pgmap v298: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:59.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:50:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:50:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:59 smithi181 ceph-mon[101094]: pgmap v298: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:50:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:50:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:01.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:01 smithi157 ceph-mon[117693]: pgmap v299: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:01 smithi181 ceph-mon[101094]: pgmap v299: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:03.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:03 smithi157 ceph-mon[117693]: pgmap v300: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:03.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:03 smithi181 ceph-mon[101094]: pgmap v300: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:05.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:05 smithi157 ceph-mon[117693]: pgmap v301: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:05 smithi181 ceph-mon[101094]: pgmap v301: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:07.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:07 smithi157 ceph-mon[117693]: pgmap v302: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:07.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:07 smithi181 ceph-mon[101094]: pgmap v302: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:09.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:09 smithi157 ceph-mon[117693]: pgmap v303: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:09.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:09 smithi181 ceph-mon[101094]: pgmap v303: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:11.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:11 smithi157 ceph-mon[117693]: pgmap v304: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:11.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:11 smithi181 ceph-mon[101094]: pgmap v304: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:12 smithi157 ceph-mon[117693]: pgmap v305: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:12.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:12 smithi181 ceph-mon[101094]: pgmap v305: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:14.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:14.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:15 smithi181 ceph-mon[101094]: pgmap v306: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:15.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:15 smithi157 ceph-mon[117693]: pgmap v306: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:17 smithi181 ceph-mon[101094]: pgmap v307: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:17.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:17 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:51:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:17 smithi157 ceph-mon[117693]: pgmap v307: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:17 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:51:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:51:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:51:18.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:51:18.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:51:18.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:51:18.816 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:51:19.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:19 smithi181 ceph-mon[101094]: pgmap v308: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:19.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:19 smithi157 ceph-mon[117693]: pgmap v308: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:21.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:21 smithi181 ceph-mon[101094]: pgmap v309: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:21.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:21 smithi157 ceph-mon[117693]: pgmap v309: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:23.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:23 smithi181 ceph-mon[101094]: pgmap v310: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:23.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:23 smithi157 ceph-mon[117693]: pgmap v310: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:25.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:25 smithi181 ceph-mon[101094]: pgmap v311: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:25 smithi157 ceph-mon[117693]: pgmap v311: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:27.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:27 smithi181 ceph-mon[101094]: pgmap v312: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:27.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:27 smithi157 ceph-mon[117693]: pgmap v312: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:29 smithi181 ceph-mon[101094]: pgmap v313: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:29.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:29 smithi157 ceph-mon[117693]: pgmap v313: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:29.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:31.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:31 smithi157 ceph-mon[117693]: pgmap v314: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:31.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:31 smithi181 ceph-mon[101094]: pgmap v314: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:33.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:33 smithi157 ceph-mon[117693]: pgmap v315: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:33.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:33 smithi181 ceph-mon[101094]: pgmap v315: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:35.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:35 smithi157 ceph-mon[117693]: pgmap v316: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:35.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:35 smithi181 ceph-mon[101094]: pgmap v316: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:37.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:37 smithi157 ceph-mon[117693]: pgmap v317: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:37.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:37 smithi181 ceph-mon[101094]: pgmap v317: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:39.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:39 smithi157 ceph-mon[117693]: pgmap v318: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:39.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:39 smithi181 ceph-mon[101094]: pgmap v318: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:41.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:41 smithi157 ceph-mon[117693]: pgmap v319: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:41.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:41 smithi181 ceph-mon[101094]: pgmap v319: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:43.729 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:43 smithi157 ceph-mon[117693]: pgmap v320: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:43.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:43 smithi181 ceph-mon[101094]: pgmap v320: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:44.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:44.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:45.506 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:45 smithi157 ceph-mon[117693]: pgmap v321: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:45.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:45 smithi181 ceph-mon[101094]: pgmap v321: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:45.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-04-03T08:51:46.297 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:51:47.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:47 smithi157 ceph-mon[117693]: pgmap v322: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:47.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:47 smithi181 ceph-mon[101094]: pgmap v322: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:48.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 -- 172.21.15.157:0/787387938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb338102e00 msgr2=0x7fb3381031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:48.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 --2- 172.21.15.157:0/787387938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb338102e00 0x7fb3381031d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb328004940 tx=0x7fb328009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:48.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 -- 172.21.15.157:0/787387938 shutdown_connections 2024-04-03T08:51:48.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 --2- 172.21.15.157:0/787387938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3381037a0 0x7fb3380fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:48.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 --2- 172.21.15.157:0/787387938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb338102e00 0x7fb3381031d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:48.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 -- 172.21.15.157:0/787387938 >> 172.21.15.157:0/787387938 conn(0x7fb3380f89b0 msgr2=0x7fb3380fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:48.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 -- 172.21.15.157:0/787387938 shutdown_connections 2024-04-03T08:51:48.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.192+0000 7fb33e000700 1 -- 172.21.15.157:0/787387938 wait complete. 2024-04-03T08:51:48.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.193+0000 7fb33e000700 1 Processor -- start 2024-04-03T08:51:48.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.193+0000 7fb33e000700 1 -- start start 2024-04-03T08:51:48.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb33e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb338102e00 0x7fb3380702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:48.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb33e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 0x7fb338070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:48.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb33e000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338070d40 con 0x7fb3381037a0 2024-04-03T08:51:48.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb33e000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338070e80 con 0x7fb338102e00 2024-04-03T08:51:48.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb336a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 0x7fb338070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb336a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 0x7fb338070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57874/0 (socket says 172.21.15.157:57874) 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb336a00700 1 -- 172.21.15.157:0/88439951 learned_addr learned my addr 172.21.15.157:0/88439951 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb337400700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb338102e00 0x7fb3380702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb336a00700 1 -- 172.21.15.157:0/88439951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb338102e00 msgr2=0x7fb3380702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb336a00700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb338102e00 0x7fb3380702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.194+0000 7fb336a00700 1 -- 172.21.15.157:0/88439951 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328005040 con 0x7fb3381037a0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.195+0000 7fb336a00700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 0x7fb338070800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb324002a50 tx=0x7fb324004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.195+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb324007cc0 con 0x7fb3381037a0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.195+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb32400f040 con 0x7fb3381037a0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.195+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32400d9c0 con 0x7fb3381037a0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.195+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb338071130 con 0x7fb3381037a0 2024-04-03T08:51:48.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.195+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33811a320 con 0x7fb3381037a0 2024-04-03T08:51:48.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.196+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb338100110 con 0x7fb3381037a0 2024-04-03T08:51:48.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.197+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb324009730 con 0x7fb3381037a0 2024-04-03T08:51:48.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.198+0000 7fb32f400700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb31c06d7f0 0x7fb31c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:48.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.198+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fb32408cb20 con 0x7fb3381037a0 2024-04-03T08:51:48.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.198+0000 7fb337400700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb31c06d7f0 0x7fb31c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:48.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.199+0000 7fb337400700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb31c06d7f0 0x7fb31c06fca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb328009fd0 tx=0x7fb328009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:48.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.203+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb324056270 con 0x7fb3381037a0 2024-04-03T08:51:48.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.427+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 --> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb338071130 con 0x7fb31c06d7f0 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.437+0000 7fb32f400700 1 -- 172.21.15.157:0/88439951 <== mgr.34104 v2:172.21.15.157:6800/3953350514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb338071130 con 0x7fb31c06d7f0 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:alertmanager.smithi157 smithi157 *:9093,9094 running (2m) 98s ago 21m 14.5M - 0.25.0 c8568f914cd2 92482e122556 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi157 smithi157 running (8m) 98s ago 22m 6647k - 19.0.0-1670-g1fb5d106 c318aa90b546 2943a96bf2ab 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:crash.smithi181 smithi181 running (7m) 2m ago 21m 6651k - 19.0.0-1670-g1fb5d106 c318aa90b546 a78fe1180ecc 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:grafana.smithi157 smithi157 *:3000 running (105s) 98s ago 21m 46.3M - 9.4.12 a0ea5e3c46d9 a013d18b3804 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.sodwui smithi157 running (4m) 98s ago 15m 82.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 bf551bc0ce99 2024-04-03T08:51:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi157.zlscrk smithi157 running (3m) 98s ago 15m 84.4M - 19.0.0-1670-g1fb5d106 c318aa90b546 c20db495a227 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.ecaerp smithi181 running (3m) 2m ago 15m 11.1M - 19.0.0-1670-g1fb5d106 c318aa90b546 2a5ba2586b49 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:mds.cephfs.smithi181.wksnwz smithi181 running (3m) 2m ago 15m 11.0M - 19.0.0-1670-g1fb5d106 c318aa90b546 60490a032fca 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi157.qfvynr smithi157 *:8443,9283,8765 running (10m) 98s ago 23m 512M - 19.0.0-1670-g1fb5d106 c318aa90b546 428c00871a08 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:mgr.smithi181.mfhidq smithi181 *:8443,9283,8765 running (9m) 2m ago 20m 452M - 19.0.0-1670-g1fb5d106 c318aa90b546 d2eeda34ccbd 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi157 smithi157 running (9m) 98s ago 23m 55.9M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 17c64a0a69ee 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:mon.smithi181 smithi181 running (8m) 2m ago 20m 40.7M 2048M 19.0.0-1670-g1fb5d106 c318aa90b546 76e5100ed852 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi157 smithi157 *:9100 running (2m) 98s ago 22m 7142k - 1.5.0 0da6a335fe13 70ae0b3fbf65 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:node-exporter.smithi181 smithi181 *:9100 running (2m) 2m ago 20m 2801k - 1.5.0 0da6a335fe13 90c76e3ccd43 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:osd.0 smithi157 running (7m) 98s ago 19m 141M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 90fa5dd9912a 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:osd.1 smithi157 running (7m) 98s ago 19m 170M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 9bc4dfa4f200 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:osd.2 smithi157 running (6m) 98s ago 18m 96.0M 1618M 19.0.0-1670-g1fb5d106 c318aa90b546 3f3f3031b9f9 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:osd.3 smithi181 running (5m) 2m ago 18m 139M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 f4f7d939cae6 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:osd.4 smithi181 running (5m) 2m ago 17m 97.5M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 75ed7a1f274d 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:osd.5 smithi181 running (4m) 2m ago 17m 95.2M 2642M 19.0.0-1670-g1fb5d106 c318aa90b546 b8c3bb5b1d32 2024-04-03T08:51:48.456 INFO:teuthology.orchestra.run.smithi157.stdout:prometheus.smithi157 smithi157 *:9095 running (2m) 98s ago 21m 47.1M - 2.43.0 a07b618ecd1d aafef4771904 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb31c06d7f0 msgr2=0x7fb31c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb31c06d7f0 0x7fb31c06fca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb328009fd0 tx=0x7fb328009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 msgr2=0x7fb338070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 0x7fb338070800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb324002a50 tx=0x7fb324004600 comp rx=0 tx=0).stop 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 shutdown_connections 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fb31c06d7f0 0x7fb31c06fca0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:48.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb338102e00 0x7fb3380702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:48.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 --2- 172.21.15.157:0/88439951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3381037a0 0x7fb338070800 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:48.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 >> 172.21.15.157:0/88439951 conn(0x7fb3380f89b0 msgr2=0x7fb3381073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:48.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 shutdown_connections 2024-04-03T08:51:48.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:48.440+0000 7fb33e000700 1 -- 172.21.15.157:0/88439951 wait complete. 2024-04-03T08:51:49.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-04-03T08:51:49.558 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:51:49.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:49 smithi157 ceph-mon[117693]: pgmap v323: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:49.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:49 smithi181 ceph-mon[101094]: pgmap v323: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:50.815 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:50 smithi157 ceph-mon[117693]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:51:50.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:50 smithi181 ceph-mon[101094]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.534+0000 7fccfd000700 1 -- 172.21.15.157:0/963410335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 msgr2=0x7fccf80fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.534+0000 7fccfd000700 1 --2- 172.21.15.157:0/963410335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf80fce30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcce4004940 tx=0x7fcce4009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.534+0000 7fccfd000700 1 -- 172.21.15.157:0/963410335 shutdown_connections 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.534+0000 7fccfd000700 1 --2- 172.21.15.157:0/963410335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf80fce30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.534+0000 7fccfd000700 1 --2- 172.21.15.157:0/963410335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccf8102e20 0x7fccf81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.534+0000 7fccfd000700 1 -- 172.21.15.157:0/963410335 >> 172.21.15.157:0/963410335 conn(0x7fccf80f89d0 msgr2=0x7fccf80fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.535+0000 7fccfd000700 1 -- 172.21.15.157:0/963410335 shutdown_connections 2024-04-03T08:51:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.535+0000 7fccfd000700 1 -- 172.21.15.157:0/963410335 wait complete. 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.535+0000 7fccfd000700 1 Processor -- start 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.535+0000 7fccfd000700 1 -- start start 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccfd000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccf8102e20 0x7fccf8115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccfd000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf8116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccfd000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8116970 con 0x7fccf81037c0 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccfd000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf810fd40 con 0x7fccf8102e20 2024-04-03T08:51:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccf5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf8116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccf5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf8116320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57884/0 (socket says 172.21.15.157:57884) 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccf5400700 1 -- 172.21.15.157:0/59370791 learned_addr learned my addr 172.21.15.157:0/59370791 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.536+0000 7fccf5e00700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccf8102e20 0x7fccf8115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccf5400700 1 -- 172.21.15.157:0/59370791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccf8102e20 msgr2=0x7fccf8115de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccf5400700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccf8102e20 0x7fccf8115de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccf5400700 1 -- 172.21.15.157:0/59370791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4005040 con 0x7fccf81037c0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccf5400700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf8116320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009100 tx=0x7fcce4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce400e040 con 0x7fccf81037c0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf810ffc0 con 0x7fccf81037c0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcce4013420 con 0x7fccf81037c0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce401c630 con 0x7fccf81037c0 2024-04-03T08:51:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.537+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf8110580 con 0x7fccf81037c0 2024-04-03T08:51:51.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.538+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf8102140 con 0x7fccf81037c0 2024-04-03T08:51:51.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.540+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcce4013a00 con 0x7fccf81037c0 2024-04-03T08:51:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.541+0000 7fccee000700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fccdc06d7f0 0x7fccdc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.541+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fcce408ec10 con 0x7fccf81037c0 2024-04-03T08:51:51.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.541+0000 7fccf5e00700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fccdc06d7f0 0x7fccdc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:51.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.542+0000 7fccf5e00700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fccdc06d7f0 0x7fccdc06fca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcce8004f40 tx=0x7fcce800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:51.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.545+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcce405be70 con 0x7fccf81037c0 2024-04-03T08:51:51.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:51 smithi157 ceph-mon[117693]: pgmap v324: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.831+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fccf80fe570 con 0x7fccf81037c0 2024-04-03T08:51:51.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.831+0000 7fccee000700 1 -- 172.21.15.157:0/59370791 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fcce405ba00 con 0x7fccf81037c0 2024-04-03T08:51:51.832 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-03T08:51:51.832 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": { 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": { 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": { 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "overall": { 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-04-03T08:51:51.833 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-03T08:51:51.834 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fccdc06d7f0 msgr2=0x7fccdc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fccdc06d7f0 0x7fccdc06fca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcce8004f40 tx=0x7fcce800b040 comp rx=0 tx=0).stop 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 msgr2=0x7fccf8116320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf8116320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009100 tx=0x7fcce4009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 shutdown_connections 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fccdc06d7f0 0x7fccdc06fca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccf8102e20 0x7fccf8115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 --2- 172.21.15.157:0/59370791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccf81037c0 0x7fccf8116320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 >> 172.21.15.157:0/59370791 conn(0x7fccf80f89d0 msgr2=0x7fccf80fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 shutdown_connections 2024-04-03T08:51:51.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:51.834+0000 7fccfd000700 1 -- 172.21.15.157:0/59370791 wait complete. 2024-04-03T08:51:51.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:51 smithi181 ceph-mon[101094]: pgmap v324: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:52.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:52 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/59370791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:51:52.611 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-03T08:51:52.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:52 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/59370791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:51:53.043 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:51:53.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:53 smithi157 ceph-mon[117693]: pgmap v325: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:53.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:53 smithi181 ceph-mon[101094]: pgmap v325: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 -- 172.21.15.157:0/545630683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f81037a0 msgr2=0x7f30f80fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 --2- 172.21.15.157:0/545630683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f81037a0 0x7f30f80fce10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f30e4004940 tx=0x7f30e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 -- 172.21.15.157:0/545630683 shutdown_connections 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 --2- 172.21.15.157:0/545630683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f81037a0 0x7f30f80fce10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 --2- 172.21.15.157:0/545630683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f8102e00 0x7f30f81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 -- 172.21.15.157:0/545630683 >> 172.21.15.157:0/545630683 conn(0x7f30f80f89b0 msgr2=0x7f30f80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:54.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 -- 172.21.15.157:0/545630683 shutdown_connections 2024-04-03T08:51:54.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.911+0000 7f30fe800700 1 -- 172.21.15.157:0/545630683 wait complete. 2024-04-03T08:51:54.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.912+0000 7f30fe800700 1 Processor -- start 2024-04-03T08:51:54.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.912+0000 7f30fe800700 1 -- start start 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30fe800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 0x7f30f8115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30fe800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f81037a0 0x7f30f81162d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30fe800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f81169b0 con 0x7f30f8102e00 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30fe800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f810fcf0 con 0x7f30f81037a0 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 0x7f30f8115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 0x7f30f8115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46446/0 (socket says 172.21.15.157:46446) 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f7400700 1 -- 172.21.15.157:0/3733344029 learned_addr learned my addr 172.21.15.157:0/3733344029 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f6a00700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f81037a0 0x7f30f81162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f7400700 1 -- 172.21.15.157:0/3733344029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f81037a0 msgr2=0x7f30f81162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:54.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f7400700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f81037a0 0x7f30f81162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.913+0000 7f30f7400700 1 -- 172.21.15.157:0/3733344029 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4005040 con 0x7f30f8102e00 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.914+0000 7f30f7400700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 0x7f30f8115d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b790 tx=0x7f30e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.914+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e800f6f0 con 0x7f30f8102e00 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.914+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30e800fd20 con 0x7f30f8102e00 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.914+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f810ff70 con 0x7f30f8102e00 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.914+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e80103a0 con 0x7f30f8102e00 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.914+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f8110530 con 0x7f30f8102e00 2024-04-03T08:51:54.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.915+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f81069b0 con 0x7f30f8102e00 2024-04-03T08:51:54.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.916+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f30e8011400 con 0x7f30f8102e00 2024-04-03T08:51:54.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.917+0000 7f30ef400700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f30dc06d7f0 0x7f30dc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:54.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.917+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f30e808ced0 con 0x7f30f8102e00 2024-04-03T08:51:54.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.917+0000 7f30f6a00700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f30dc06d7f0 0x7f30dc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:54.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.918+0000 7f30f6a00700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f30dc06d7f0 0x7f30dc06fca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30f8111630 tx=0x7f30e4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:54.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:54.922+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f30e805a0b0 con 0x7f30f8102e00 2024-04-03T08:51:55.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.208+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30f80fe550 con 0x7f30f8102e00 2024-04-03T08:51:55.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.208+0000 7f30ef400700 1 -- 172.21.15.157:0/3733344029 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f30e8059c40 con 0x7f30f8102e00 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f30dc06d7f0 msgr2=0x7f30dc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f30dc06d7f0 0x7f30dc06fca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30f8111630 tx=0x7f30e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 msgr2=0x7f30f8115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 0x7f30f8115d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b790 tx=0x7f30e8009250 comp rx=0 tx=0).stop 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 shutdown_connections 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f30dc06d7f0 0x7f30dc06fca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30f8102e00 0x7f30f8115d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 --2- 172.21.15.157:0/3733344029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f81037a0 0x7f30f81162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 >> 172.21.15.157:0/3733344029 conn(0x7f30f80f89b0 msgr2=0x7f30f80fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 shutdown_connections 2024-04-03T08:51:55.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:55.211+0000 7f30fe800700 1 -- 172.21.15.157:0/3733344029 wait complete. 2024-04-03T08:51:55.226 INFO:teuthology.orchestra.run.smithi157.stdout:true 2024-04-03T08:51:55.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:55 smithi157 ceph-mon[117693]: pgmap v326: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:55.565 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:55 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3733344029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:51:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:55 smithi181 ceph-mon[101094]: pgmap v326: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:51:55.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:55 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3733344029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:51:55.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-03T08:51:56.428 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:51:57.632 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:57 smithi157 ceph-mon[117693]: pgmap v327: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:57.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:57 smithi181 ceph-mon[101094]: pgmap v327: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 -- 172.21.15.157:0/1923994154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c102e00 msgr2=0x7fd00c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 --2- 172.21.15.157:0/1923994154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c102e00 0x7fd00c1031d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcffc004940 tx=0x7fcffc009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 -- 172.21.15.157:0/1923994154 shutdown_connections 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 --2- 172.21.15.157:0/1923994154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c1037a0 0x7fd00c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 --2- 172.21.15.157:0/1923994154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c102e00 0x7fd00c1031d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 -- 172.21.15.157:0/1923994154 >> 172.21.15.157:0/1923994154 conn(0x7fd00c0f89b0 msgr2=0x7fd00c0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 -- 172.21.15.157:0/1923994154 shutdown_connections 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.288+0000 7fd012200700 1 -- 172.21.15.157:0/1923994154 wait complete. 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.289+0000 7fd012200700 1 Processor -- start 2024-04-03T08:51:58.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.289+0000 7fd012200700 1 -- start start 2024-04-03T08:51:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd012200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c102e00 0x7fd00c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd012200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 0x7fd00c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd012200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c070d40 con 0x7fd00c1037a0 2024-04-03T08:51:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd012200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c070e80 con 0x7fd00c102e00 2024-04-03T08:51:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 0x7fd00c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:58.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 0x7fd00c070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46466/0 (socket says 172.21.15.157:46466) 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00aa00700 1 -- 172.21.15.157:0/645212635 learned_addr learned my addr 172.21.15.157:0/645212635 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00b400700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c102e00 0x7fd00c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00aa00700 1 -- 172.21.15.157:0/645212635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c102e00 msgr2=0x7fd00c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00aa00700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c102e00 0x7fd00c0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.290+0000 7fd00aa00700 1 -- 172.21.15.157:0/645212635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc005040 con 0x7fd00c1037a0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.291+0000 7fd00aa00700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 0x7fd00c070800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcff8002a50 tx=0x7fcff8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.291+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff8007cc0 con 0x7fd00c1037a0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.291+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcff800f040 con 0x7fd00c1037a0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.291+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c071130 con 0x7fd00c1037a0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.291+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff800d9c0 con 0x7fd00c1037a0 2024-04-03T08:51:58.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.291+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c11a320 con 0x7fd00c1037a0 2024-04-03T08:51:58.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.292+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c100110 con 0x7fd00c1037a0 2024-04-03T08:51:58.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.293+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcff8009730 con 0x7fd00c1037a0 2024-04-03T08:51:58.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.294+0000 7fd003400700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcff006d7f0 0x7fcff006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:51:58.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.294+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fcff808cc40 con 0x7fd00c1037a0 2024-04-03T08:51:58.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.294+0000 7fd00b400700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcff006d7f0 0x7fcff006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:51:58.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.295+0000 7fd00b400700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcff006d7f0 0x7fcff006fca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009fd0 tx=0x7fcffc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:51:58.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.298+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcff8056270 con 0x7fd00c1037a0 2024-04-03T08:51:58.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.587+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd00c0710d0 con 0x7fd00c1037a0 2024-04-03T08:51:58.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.587+0000 7fd003400700 1 -- 172.21.15.157:0/645212635 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fcff8059930 con 0x7fd00c1037a0 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcff006d7f0 msgr2=0x7fcff006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcff006d7f0 0x7fcff006fca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009fd0 tx=0x7fcffc009e30 comp rx=0 tx=0).stop 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 msgr2=0x7fd00c070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 0x7fd00c070800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcff8002a50 tx=0x7fcff8004600 comp rx=0 tx=0).stop 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 shutdown_connections 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcff006d7f0 0x7fcff006fca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c102e00 0x7fd00c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 --2- 172.21.15.157:0/645212635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1037a0 0x7fd00c070800 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 >> 172.21.15.157:0/645212635 conn(0x7fd00c0f89b0 msgr2=0x7fd00c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 shutdown_connections 2024-04-03T08:51:58.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:51:58.590+0000 7fd012200700 1 -- 172.21.15.157:0/645212635 wait complete. 2024-04-03T08:51:58.605 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-04-03T08:51:59.338 DEBUG:teuthology.parallel:result is None 2024-04-03T08:51:59.338 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-03T08:51:59.351 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T08:51:59.351 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af80a140-f193-11ee-b648-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-03T08:51:59.779 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/mon.smithi157/config 2024-04-03T08:51:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:59 smithi157 ceph-mon[117693]: pgmap v328: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:59 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/645212635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:51:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:51:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:51:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:59 smithi181 ceph-mon[101094]: pgmap v328: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:51:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:59 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/645212635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-03T08:51:59.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:51:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:01.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.730+0000 7fc3da200700 1 -- 172.21.15.157:0/3218481765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 msgr2=0x7fc3d4070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.730+0000 7fc3da200700 1 --2- 172.21.15.157:0/3218481765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4070730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8004970 tx=0x7fc3c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.731+0000 7fc3da200700 1 -- 172.21.15.157:0/3218481765 shutdown_connections 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.731+0000 7fc3da200700 1 --2- 172.21.15.157:0/3218481765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3d4070c70 0x7fc3d4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.731+0000 7fc3da200700 1 --2- 172.21.15.157:0/3218481765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4070730 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.731+0000 7fc3da200700 1 -- 172.21.15.157:0/3218481765 >> 172.21.15.157:0/3218481765 conn(0x7fc3d40f87e0 msgr2=0x7fc3d40fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.731+0000 7fc3da200700 1 -- 172.21.15.157:0/3218481765 shutdown_connections 2024-04-03T08:52:01.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.731+0000 7fc3da200700 1 -- 172.21.15.157:0/3218481765 wait complete. 2024-04-03T08:52:01.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3da200700 1 Processor -- start 2024-04-03T08:52:01.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3da200700 1 -- start start 2024-04-03T08:52:01.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3da200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3da200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3d4070c70 0x7fc3d41160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3da200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4116700 con 0x7fc3d4070360 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3da200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d410faf0 con 0x7fc3d4070c70 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3d8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3d8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46486/0 (socket says 172.21.15.157:46486) 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.732+0000 7fc3d8e00700 1 -- 172.21.15.157:0/3768507925 learned_addr learned my addr 172.21.15.157:0/3768507925 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d3e00700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3d4070c70 0x7fc3d41160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d8e00700 1 -- 172.21.15.157:0/3768507925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3d4070c70 msgr2=0x7fc3d41160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d8e00700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3d4070c70 0x7fc3d41160b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d8e00700 1 -- 172.21.15.157:0/3768507925 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8005040 con 0x7fc3d4070360 2024-04-03T08:52:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d8e00700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4115b70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8004f50 tx=0x7fc3c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c800e040 con 0x7fc3d4070360 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3c800bc10 con 0x7fc3d4070360 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d410fd70 con 0x7fc3d4070360 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.733+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c801c630 con 0x7fc3d4070360 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.734+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d41102b0 con 0x7fc3d4070360 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.735+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d4071aa0 con 0x7fc3d4070360 2024-04-03T08:52:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.736+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc3c8013420 con 0x7fc3d4070360 2024-04-03T08:52:01.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.737+0000 7fc3d0c00700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc3bc06d7f0 0x7fc3bc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.737+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fc3c808e380 con 0x7fc3d4070360 2024-04-03T08:52:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.737+0000 7fc3d3e00700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc3bc06d7f0 0x7fc3bc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.738+0000 7fc3d3e00700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc3bc06d7f0 0x7fc3bc06fca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4110cb0 tx=0x7fc3c0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.742+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc3c805b600 con 0x7fc3d4070360 2024-04-03T08:52:01.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:01 smithi157 ceph-mon[117693]: pgmap v329: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:01.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:01 smithi181 ceph-mon[101094]: pgmap v329: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.988+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3d410bf90 con 0x7fc3d4070360 2024-04-03T08:52:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.989+0000 7fc3d0c00700 1 -- 172.21.15.157:0/3768507925 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1902 (secure 0 0 0) 0x7fc3c805b190 con 0x7fc3d4070360 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:e35 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:legacy client fscid: 1 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:Filesystem 'cephfs' (1) 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:fs_name cephfs 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 35 2024-04-03T08:52:01.990 INFO:teuthology.orchestra.run.smithi157.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-03T08:35:52.239154+0000 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:modified 2024-04-03T08:48:48.847209+0000 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:tableserver 0 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:root 0 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:session_timeout 60 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:session_autoclose 300 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:max_file_size 1099511627776 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:max_xattr_size 65536 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:required_client_features {} 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure 0 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:last_failure_osd_epoch 97 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:max_mds 1 2024-04-03T08:52:01.991 INFO:teuthology.orchestra.run.smithi157.stdout:in 0 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:up {0=34412} 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:failed 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:damaged 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:stopped 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:data_pools [3] 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:metadata_pool 2 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:inline_data disabled 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:balancer 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:bal_rank_mask -1 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:standby_count_wanted 1 2024-04-03T08:52:01.992 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.sodwui{0:34412} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.157:6826/1983788696,v1:172.21.15.157:6827/1983788696] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi157.zlscrk{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.157:6828/3713439564,v1:172.21.15.157:6829/3713439564] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout:Standby daemons: 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.ecaerp{-1:44387} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6824/397415286,v1:172.21.15.181:6825/397415286] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:52:01.993 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.cephfs.smithi181.wksnwz{-1:44391} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.181:6826/3661110481,v1:172.21.15.181:6827/3661110481] compat {c=[1],r=[1],i=[fff]}] 2024-04-03T08:52:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.991+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc3bc06d7f0 msgr2=0x7fc3bc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.991+0000 7fc3da200700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc3bc06d7f0 0x7fc3bc06fca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4110cb0 tx=0x7fc3c0009ee0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.991+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 msgr2=0x7fc3d4115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.991+0000 7fc3da200700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4115b70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8004f50 tx=0x7fc3c8009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 shutdown_connections 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fc3bc06d7f0 0x7fc3bc06fca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3d4070360 0x7fc3d4115b70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 --2- 172.21.15.157:0/3768507925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3d4070c70 0x7fc3d41160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 >> 172.21.15.157:0/3768507925 conn(0x7fc3d40f87e0 msgr2=0x7fc3d4105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 shutdown_connections 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:01.992+0000 7fc3da200700 1 -- 172.21.15.157:0/3768507925 wait complete. 2024-04-03T08:52:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 35 2024-04-03T08:52:02.662 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:02 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3768507925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:52:02.686 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-03T08:52:02.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-03T08:52:02.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:02 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3768507925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-03T08:52:02.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 -- 172.21.15.157:0/3452274645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 msgr2=0x7f52000fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 --2- 172.21.15.157:0/3452274645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f52000fcd10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f51ec004940 tx=0x7f51ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 -- 172.21.15.157:0/3452274645 shutdown_connections 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 --2- 172.21.15.157:0/3452274645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f52000fcd10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 --2- 172.21.15.157:0/3452274645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5200102d00 0x7f52001030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 -- 172.21.15.157:0/3452274645 >> 172.21.15.157:0/3452274645 conn(0x7f52000f8850 msgr2=0x7f52000fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 -- 172.21.15.157:0/3452274645 shutdown_connections 2024-04-03T08:52:02.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.892+0000 7f5207a00700 1 -- 172.21.15.157:0/3452274645 wait complete. 2024-04-03T08:52:02.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.893+0000 7f5207a00700 1 Processor -- start 2024-04-03T08:52:02.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.893+0000 7f5207a00700 1 -- start start 2024-04-03T08:52:02.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.893+0000 7f5207a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5200102d00 0x7f5200115af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:02.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.893+0000 7f5207a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f5200116030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:02.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.893+0000 7f5207a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200116680 con 0x7f52001036a0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.893+0000 7f5207a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520010fc60 con 0x7f5200102d00 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f5200116030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f5200116030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34672/0 (socket says 172.21.15.157:34672) 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 -- 172.21.15.157:0/754376226 learned_addr learned my addr 172.21.15.157:0/754376226 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f5205000700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5200102d00 0x7f5200115af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 -- 172.21.15.157:0/754376226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5200102d00 msgr2=0x7f5200115af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5200102d00 0x7f5200115af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 -- 172.21.15.157:0/754376226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec005040 con 0x7f52001036a0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51ffe00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f5200116030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009100 tx=0x7f51ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ec00e040 con 0x7f52001036a0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51ec013420 con 0x7f52001036a0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.894+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520010fee0 con 0x7f52001036a0 2024-04-03T08:52:02.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.895+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ec01c630 con 0x7f52001036a0 2024-04-03T08:52:02.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.895+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52001104a0 con 0x7f52001036a0 2024-04-03T08:52:02.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.895+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52000fe450 con 0x7f52001036a0 2024-04-03T08:52:02.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.897+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f51ec013a00 con 0x7f52001036a0 2024-04-03T08:52:02.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.897+0000 7f51fcc00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f51e806d7e0 0x7f51e806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:02.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.898+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f51ec08e230 con 0x7f52001036a0 2024-04-03T08:52:02.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.898+0000 7f5205000700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f51e806d7e0 0x7f51e806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:02.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.898+0000 7f5205000700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f51e806d7e0 0x7f51e806fc90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51f4004f40 tx=0x7f51f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:02.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:02.902+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f51ec05b410 con 0x7f52001036a0 2024-04-03T08:52:03.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.106+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5200064970 con 0x7f52001036a0 2024-04-03T08:52:03.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.107+0000 7f51fcc00700 1 -- 172.21.15.157:0/754376226 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+17168 (secure 0 0 0) 0x7f51ec05afa0 con 0x7f52001036a0 2024-04-03T08:52:03.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":98,"fsid":"af80a140-f193-11ee-b648-cb9ed24678a4","created":"2024-04-03T08:28:02.650813+0000","modified":"2024-04-03T08:48:35.630202+0000","last_up_change":"2024-04-03T08:47:12.315501+0000","last_in_change":"2024-04-03T08:34:08.784371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T08:33:00.599229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-03T08:35:50.819927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-03T08:35:51.729332+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cacd9869-4ce2-4388-ac14-9b21c32f0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":91,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":637370792},{"type":"v1","addr":"172.21.15.157:6803","nonce":637370792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":637370792},{"type":"v1","addr":"172.21.15.157:6805","nonce":637370792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":637370792},{"type":"v1","addr":"172.21.15.157:6809","nonce":637370792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":637370792},{"type":"v1","addr":"172.21.15.157:6807","nonce":637370792}]},"public_addr":"172.21.15.157:6803/637370792","cluster_addr":"172.21.15.157:6805/637370792","heartbeat_back_addr":"172.21.15.157:6809/637370792","heartbeat_front_addr":"172.21.15.157:6807/637370792","state":["exists","up"]},{"osd":1,"uuid":"cd9fa7a9-0e76-4151-9df8-d0fdb95d25a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":91,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2111989362},{"type":"v1","addr":"172.21.15.157:6811","nonce":2111989362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2111989362},{"type":"v1","addr":"172.21.15.157:6813","nonce":2111989362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2111989362},{"type":"v1","addr":"172.21.15.157:6817","nonce":2111989362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2111989362},{"type":"v1","addr":"172.21.15.157:6815","nonce":2111989362}]},"public_addr":"172.21.15.157:6811/2111989362","cluster_addr":"172.21.15.157:6813/2111989362","heartbeat_back_addr":"172.21.15.157:6817/2111989362","heartbeat_front_addr":"172.21.15.157:6815/2111989362","state":["exists","up"]},{"osd":2,"uuid":"763d371a-2aa7-44e2-8557-952c67342744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":91,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2462274927},{"type":"v1","addr":"172.21.15.157:6819","nonce":2462274927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2462274927},{"type":"v1","addr":"172.21.15.157:6821","nonce":2462274927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2462274927},{"type":"v1","addr":"172.21.15.157:6825","nonce":2462274927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2462274927},{"type":"v1","addr":"172.21.15.157:6823","nonce":2462274927}]},"public_addr":"172.21.15.157:6819/2462274927","cluster_addr":"172.21.15.157:6821/2462274927","heartbeat_back_addr":"172.21.15.157:6825/2462274927","heartbeat_front_addr":"172.21.15.157:6823/2462274927","state":["exists","up"]},{"osd":3,"uuid":"287ca3f3-1f42-4c40-bf6c-13d05fa77363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":74,"up_thru":91,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2489609945},{"type":"v1","addr":"172.21.15.181:6801","nonce":2489609945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2489609945},{"type":"v1","addr":"172.21.15.181:6803","nonce":2489609945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2489609945},{"type":"v1","addr":"172.21.15.181:6807","nonce":2489609945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2489609945},{"type":"v1","addr":"172.21.15.181:6805","nonce":2489609945}]},"public_addr":"172.21.15.181:6801/2489609945","cluster_addr":"172.21.15.181:6803/2489609945","heartbeat_back_addr":"172.21.15.181:6807/2489609945","heartbeat_front_addr":"172.21.15.181:6805/2489609945","state":["exists","up"]},{"osd":4,"uuid":"d591725b-596d-4c27-8ddc-a60269c46dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":82,"up_from":86,"up_thru":91,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1351197277},{"type":"v1","addr":"172.21.15.181:6809","nonce":1351197277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1351197277},{"type":"v1","addr":"172.21.15.181:6811","nonce":1351197277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1351197277},{"type":"v1","addr":"172.21.15.181:6815","nonce":1351197277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1351197277},{"type":"v1","addr":"172.21.15.181:6813","nonce":1351197277}]},"public_addr":"172.21.15.181:6809/1351197277","cluster_addr":"172.21.15.181:6811/1351197277","heartbeat_back_addr":"172.21.15.181:6815/1351197277","heartbeat_front_addr":"172.21.15.181:6813/1351197277","state":["exists","up"]},{"osd":5,"uuid":"207d01dc-ee38-4806-b4c8-646cf217f628","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":87,"up_from":91,"up_thru":91,"down_at":88,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":891873366},{"type":"v1","addr":"172.21.15.181:6817","nonce":891873366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":891873366},{"type":"v1","addr":"172.21.15.181:6819","nonce":891873366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":891873366},{"type":"v1","addr":"172.21.15.181:6823","nonce":891873366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":891873366},{"type":"v1","addr":"172.21.15.181:6821","nonce":891873366}]},"public_addr":"172.21.15.181:6817/891873366","cluster_addr":"172.21.15.181:6819/891873366","heartbeat_back_addr":"172.21.15.181:6823/891873366","heartbeat_front_addr":"172.21.15.181:6821/891873366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:31:54.508321+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:25.748219+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:32:56.905029+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:27.040063+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:33:57.486375+0000","dead_epoch":82},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T08:34:28.274823+0000","dead_epoch":87}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":0,"to":2}]},{"pgid":"2.2","mappings":[{"from":0,"to":3}]},{"pgid":"2.1d","mappings":[{"from":0,"to":2}]},{"pgid":"3.6","mappings":[{"from":1,"to":3}]},{"pgid":"3.a","mappings":[{"from":4,"to":0}]},{"pgid":"3.1a","mappings":[{"from":4,"to":3}]},{"pgid":"3.1c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6824/3882128322":"2024-04-04T08:48:09.490421+0000","172.21.15.157:6828/2668059844":"2024-04-04T08:47:42.918911+0000","172.21.15.157:0/2976717036":"2024-04-04T08:42:44.123053+0000","172.21.15.157:0/2095236671":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6801/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.181:0/3454721443":"2024-04-04T08:41:51.020664+0000","172.21.15.181:6828/2457930895":"2024-04-04T08:41:51.020664+0000","172.21.15.157:6800/1166303024":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6826/2196255510":"2024-04-04T08:36:08.655936+0000","172.21.15.181:0/1353522468":"2024-04-04T08:41:51.020664+0000","172.21.15.181:6825/3882128322":"2024-04-04T08:48:09.490421+0000","172.21.15.157:6800/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6827/2196255510":"2024-04-04T08:36:08.655936+0000","172.21.15.157:6800/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6801/1088955929":"2024-04-04T08:39:12.804453+0000","172.21.15.157:0/2911968524":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6801/494465315":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/1234767895":"2024-04-04T08:42:44.123053+0000","172.21.15.181:0/3536605800":"2024-04-04T08:41:51.020664+0000","172.21.15.157:0/448863526":"2024-04-04T08:28:38.706124+0000","172.21.15.157:6801/2321321664":"2024-04-04T08:42:44.123053+0000","172.21.15.157:0/2296154399":"2024-04-04T08:30:29.978669+0000","172.21.15.157:6829/2668059844":"2024-04-04T08:47:42.918911+0000","172.21.15.157:0/72761889":"2024-04-04T08:42:44.123053+0000","172.21.15.157:6800/2321321664":"2024-04-04T08:42:44.123053+0000","172.21.15.157:0/3147627682":"2024-04-04T08:39:12.804453+0000","172.21.15.181:6829/2457930895":"2024-04-04T08:41:51.020664+0000","172.21.15.157:0/1522499030":"2024-04-04T08:39:12.804453+0000","172.21.15.157:6801/3343433321":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/211164607":"2024-04-04T08:42:44.123053+0000","172.21.15.181:0/172822705":"2024-04-04T08:41:51.020664+0000","172.21.15.157:0/2176602566":"2024-04-04T08:29:14.604092+0000","172.21.15.157:6800/1088955929":"2024-04-04T08:39:12.804453+0000","172.21.15.157:0/510051537":"2024-04-04T08:39:12.804453+0000","172.21.15.157:0/2148643282":"2024-04-04T08:30:29.978669+0000","172.21.15.157:0/3743587418":"2024-04-04T08:39:12.804453+0000","172.21.15.157:0/1447290828":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/3861009982":"2024-04-04T08:42:44.123053+0000","172.21.15.157:0/1509492716":"2024-04-04T08:29:14.604092+0000","172.21.15.157:0/3654712566":"2024-04-04T08:28:38.706124+0000","172.21.15.157:0/3711300479":"2024-04-04T08:42:44.123053+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f51e806d7e0 msgr2=0x7f51e806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f51e806d7e0 0x7f51e806fc90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51f4004f40 tx=0x7f51f400b040 comp rx=0 tx=0).stop 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 msgr2=0x7f5200116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f5200116030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009100 tx=0x7f51ec009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 shutdown_connections 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f51e806d7e0 0x7f51e806fc90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5200102d00 0x7f5200115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 --2- 172.21.15.157:0/754376226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52001036a0 0x7f5200116030 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 >> 172.21.15.157:0/754376226 conn(0x7f52000f8850 msgr2=0x7f52000f97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:03.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 shutdown_connections 2024-04-03T08:52:03.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.110+0000 7f5207a00700 1 -- 172.21.15.157:0/754376226 wait complete. 2024-04-03T08:52:03.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-03T08:33:00.599229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-03T08:35:50.819927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-03T08:35:51.729332+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-03T08:52:03.130 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 -- 172.21.15.157:0/3249553150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 msgr2=0x7fae901030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 --2- 172.21.15.157:0/3249553150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901030b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fae84004940 tx=0x7fae84009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 -- 172.21.15.157:0/3249553150 shutdown_connections 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 --2- 172.21.15.157:0/3249553150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae90103680 0x7fae900fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 --2- 172.21.15.157:0/3249553150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901030b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 -- 172.21.15.157:0/3249553150 >> 172.21.15.157:0/3249553150 conn(0x7fae900f8830 msgr2=0x7fae900fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 -- 172.21.15.157:0/3249553150 shutdown_connections 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 -- 172.21.15.157:0/3249553150 wait complete. 2024-04-03T08:52:03.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.322+0000 7fae97800700 1 Processor -- start 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae97800700 1 -- start start 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae97800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae97800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae90103680 0x7fae90113de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae97800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae901144c0 con 0x7fae90102ce0 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae97800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9010da30 con 0x7fae90103680 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae94e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae94e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901138a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34682/0 (socket says 172.21.15.157:34682) 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.323+0000 7fae94e00700 1 -- 172.21.15.157:0/1761240846 learned_addr learned my addr 172.21.15.157:0/1761240846 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae94e00700 1 -- 172.21.15.157:0/1761240846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae90103680 msgr2=0x7fae90113de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae94e00700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae90103680 0x7fae90113de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae94e00700 1 -- 172.21.15.157:0/1761240846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae84005040 con 0x7fae90102ce0 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae94e00700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901138a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae84009180 tx=0x7fae84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8400e040 con 0x7fae90102ce0 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae8400bbc0 con 0x7fae90102ce0 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9010dcb0 con 0x7fae90102ce0 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8401c630 con 0x7fae90102ce0 2024-04-03T08:52:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.324+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9010e270 con 0x7fae90102ce0 2024-04-03T08:52:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.325+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae900fe430 con 0x7fae90102ce0 2024-04-03T08:52:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.326+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fae8400bd30 con 0x7fae90102ce0 2024-04-03T08:52:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.327+0000 7fae8cc00700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fae7806d7e0 0x7fae7806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.327+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fae8408e3f0 con 0x7fae90102ce0 2024-04-03T08:52:03.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.327+0000 7fae8fe00700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fae7806d7e0 0x7fae7806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:03.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.328+0000 7fae8fe00700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fae7806d7e0 0x7fae7806fc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fae7c006fd0 tx=0x7fae7c006db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.332+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fae8405b650 con 0x7fae90102ce0 2024-04-03T08:52:03.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.537+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae9010e4e0 con 0x7fae90102ce0 2024-04-03T08:52:03.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.538+0000 7fae8cc00700 1 -- 172.21.15.157:0/1761240846 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae8405b1e0 con 0x7fae90102ce0 2024-04-03T08:52:03.539 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-03T08:52:03.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.540+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fae7806d7e0 msgr2=0x7fae7806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.540+0000 7fae97800700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fae7806d7e0 0x7fae7806fc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fae7c006fd0 tx=0x7fae7c006db0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.540+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 msgr2=0x7fae901138a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.540+0000 7fae97800700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901138a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae84009180 tx=0x7fae84009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 shutdown_connections 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fae7806d7e0 0x7fae7806fc90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102ce0 0x7fae901138a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 --2- 172.21.15.157:0/1761240846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae90103680 0x7fae90113de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 >> 172.21.15.157:0/1761240846 conn(0x7fae900f8830 msgr2=0x7fae900f9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 shutdown_connections 2024-04-03T08:52:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.541+0000 7fae97800700 1 -- 172.21.15.157:0/1761240846 wait complete. 2024-04-03T08:52:03.559 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-03T08:52:03.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:03 smithi157 ceph-mon[117693]: pgmap v330: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:03.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:03 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/754376226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:52:03.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 -- 172.21.15.157:0/1212506399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284103670 msgr2=0x7f22840fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 --2- 172.21.15.157:0/1212506399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284103670 0x7f22840fcce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2270004940 tx=0x7f2270009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:03.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 -- 172.21.15.157:0/1212506399 shutdown_connections 2024-04-03T08:52:03.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 --2- 172.21.15.157:0/1212506399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284103670 0x7f22840fcce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 --2- 172.21.15.157:0/1212506399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2284102cd0 0x7f22841030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 -- 172.21.15.157:0/1212506399 >> 172.21.15.157:0/1212506399 conn(0x7f22840f8820 msgr2=0x7f22840fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:03.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.752+0000 7f228a000700 1 -- 172.21.15.157:0/1212506399 shutdown_connections 2024-04-03T08:52:03.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.753+0000 7f228a000700 1 -- 172.21.15.157:0/1212506399 wait complete. 2024-04-03T08:52:03.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.754+0000 7f228a000700 1 Processor -- start 2024-04-03T08:52:03.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.754+0000 7f228a000700 1 -- start start 2024-04-03T08:52:03.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.754+0000 7f228a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 0x7f2284113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:03.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.754+0000 7f228a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2284103670 0x7f2284113dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.754+0000 7f228a000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284114420 con 0x7f2284102cd0 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.754+0000 7f228a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228410da20 con 0x7f2284103670 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 0x7f2284113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 0x7f2284113890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34686/0 (socket says 172.21.15.157:34686) 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 -- 172.21.15.157:0/2603040111 learned_addr learned my addr 172.21.15.157:0/2603040111 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2282a00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2284103670 0x7f2284113dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 -- 172.21.15.157:0/2603040111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2284103670 msgr2=0x7f2284113dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2284103670 0x7f2284113dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 -- 172.21.15.157:0/2603040111 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270005040 con 0x7f2284102cd0 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f2283400700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 0x7f2284113890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2274002a50 tx=0x7f22740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2274007cc0 con 0x7f2284102cd0 2024-04-03T08:52:03.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f227400f040 con 0x7f2284102cd0 2024-04-03T08:52:03.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227400da30 con 0x7f2284102cd0 2024-04-03T08:52:03.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.755+0000 7f228a000700 1 -- 172.21.15.157:0/2603040111 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228410dd00 con 0x7f2284102cd0 2024-04-03T08:52:03.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.756+0000 7f228a000700 1 -- 172.21.15.157:0/2603040111 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228410e290 con 0x7f2284102cd0 2024-04-03T08:52:03.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.757+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22840fe420 con 0x7f2284102cd0 2024-04-03T08:52:03.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.758+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f227400dbb0 con 0x7f2284102cd0 2024-04-03T08:52:03.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.759+0000 7f227b400700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f226806d7e0 0x7f226806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:03.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.759+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f227408cb10 con 0x7f2284102cd0 2024-04-03T08:52:03.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.759+0000 7f2282a00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f226806d7e0 0x7f226806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:03.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.759+0000 7f2282a00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f226806d7e0 0x7f226806fc90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f228410f1c0 tx=0x7f2270009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:03.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.763+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2274059cf0 con 0x7f2284102cd0 2024-04-03T08:52:03.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:03 smithi181 ceph-mon[101094]: pgmap v330: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:03.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:03 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/754376226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-03T08:52:03.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.969+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f2284064970 con 0x7f2284102cd0 2024-04-03T08:52:03.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.969+0000 7f227b400700 1 -- 172.21.15.157:0/2603040111 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v98) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2274059880 con 0x7f2284102cd0 2024-04-03T08:52:03.970 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-03T08:52:03.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f226806d7e0 msgr2=0x7f226806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f226806d7e0 0x7f226806fc90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f228410f1c0 tx=0x7f2270009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 msgr2=0x7f2284113890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 0x7f2284113890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2274002a50 tx=0x7f22740046b0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 shutdown_connections 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f226806d7e0 0x7f226806fc90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284102cd0 0x7f2284113890 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 --2- 172.21.15.157:0/2603040111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2284103670 0x7f2284113dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 >> 172.21.15.157:0/2603040111 conn(0x7f22840f8820 msgr2=0x7f22840f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 shutdown_connections 2024-04-03T08:52:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:03.972+0000 7f2278c00700 1 -- 172.21.15.157:0/2603040111 wait complete. 2024-04-03T08:52:03.990 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-03T08:52:04.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 -- 172.21.15.157:0/595042187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 msgr2=0x7f91f80fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 --2- 172.21.15.157:0/595042187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f80fcce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004940 tx=0x7f91e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 -- 172.21.15.157:0/595042187 shutdown_connections 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 --2- 172.21.15.157:0/595042187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f80fcce0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 --2- 172.21.15.157:0/595042187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91f8102cd0 0x7f91f81030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 -- 172.21.15.157:0/595042187 >> 172.21.15.157:0/595042187 conn(0x7f91f80f8820 msgr2=0x7f91f80fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 -- 172.21.15.157:0/595042187 shutdown_connections 2024-04-03T08:52:04.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.183+0000 7f91fea00700 1 -- 172.21.15.157:0/595042187 wait complete. 2024-04-03T08:52:04.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91fea00700 1 Processor -- start 2024-04-03T08:52:04.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91fea00700 1 -- start start 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91fea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91f8102cd0 0x7f91f80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91fea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f8070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91fea00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8072260 con 0x7f91f8103670 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91fea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8070d40 con 0x7f91f8102cd0 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91f7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91f7400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f8070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34706/0 (socket says 172.21.15.157:34706) 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91f7400700 1 -- 172.21.15.157:0/3565292864 learned_addr learned my addr 172.21.15.157:0/3565292864 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.184+0000 7f91f7e00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91f8102cd0 0x7f91f80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91f7400700 1 -- 172.21.15.157:0/3565292864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91f8102cd0 msgr2=0x7f91f80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91f7400700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91f8102cd0 0x7f91f80702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91f7400700 1 -- 172.21.15.157:0/3565292864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4005040 con 0x7f91f8103670 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91f7400700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f8070800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009100 tx=0x7f91e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e400e040 con 0x7f91f8103670 2024-04-03T08:52:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91e4013420 con 0x7f91f8103670 2024-04-03T08:52:04.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f8070f90 con 0x7f91f8103670 2024-04-03T08:52:04.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e401c630 con 0x7f91f8103670 2024-04-03T08:52:04.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.185+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f8119fb0 con 0x7f91f8103670 2024-04-03T08:52:04.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.186+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f80fe420 con 0x7f91f8103670 2024-04-03T08:52:04.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.187+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f91e4013a00 con 0x7f91f8103670 2024-04-03T08:52:04.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.188+0000 7f91efe00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f91dc06d7e0 0x7f91dc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:04.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.188+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f91e408e200 con 0x7f91f8103670 2024-04-03T08:52:04.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.188+0000 7f91f7e00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f91dc06d7e0 0x7f91dc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:04.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.189+0000 7f91f7e00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f91dc06d7e0 0x7f91dc06fc90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91e8004f40 tx=0x7f91e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:04.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.193+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f91e40578b0 con 0x7f91f8103670 2024-04-03T08:52:04.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.407+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f91f8064970 con 0x7f91f8103670 2024-04-03T08:52:04.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.408+0000 7f91efe00700 1 -- 172.21.15.157:0/3565292864 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v98) v1 ==== 107+0+11 (secure 0 0 0) 0x7f91f8064970 con 0x7f91f8103670 2024-04-03T08:52:04.409 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f91dc06d7e0 msgr2=0x7f91dc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f91dc06d7e0 0x7f91dc06fc90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91e8004f40 tx=0x7f91e800b040 comp rx=0 tx=0).stop 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 msgr2=0x7f91f8070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f8070800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009100 tx=0x7f91e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 shutdown_connections 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f91dc06d7e0 0x7f91dc06fc90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91f8102cd0 0x7f91f80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 --2- 172.21.15.157:0/3565292864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91f8103670 0x7f91f8070800 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 >> 172.21.15.157:0/3565292864 conn(0x7f91f80f8820 msgr2=0x7f91f80f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:04.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 shutdown_connections 2024-04-03T08:52:04.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.410+0000 7f91fea00700 1 -- 172.21.15.157:0/3565292864 wait complete. 2024-04-03T08:52:04.429 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-03T08:52:04.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.618+0000 7f564ac00700 1 -- 172.21.15.157:0/1855146487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 msgr2=0x7f56440fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.618+0000 7f564ac00700 1 --2- 172.21.15.157:0/1855146487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f56440fcd10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5630004940 tx=0x7f5630009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.618+0000 7f564ac00700 1 -- 172.21.15.157:0/1855146487 shutdown_connections 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.618+0000 7f564ac00700 1 --2- 172.21.15.157:0/1855146487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f56440fcd10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.618+0000 7f564ac00700 1 --2- 172.21.15.157:0/1855146487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5644102d00 0x7f56441030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.618+0000 7f564ac00700 1 -- 172.21.15.157:0/1855146487 >> 172.21.15.157:0/1855146487 conn(0x7f56440f8830 msgr2=0x7f56440fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.619+0000 7f564ac00700 1 -- 172.21.15.157:0/1855146487 shutdown_connections 2024-04-03T08:52:04.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.619+0000 7f564ac00700 1 -- 172.21.15.157:0/1855146487 wait complete. 2024-04-03T08:52:04.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.620+0000 7f564ac00700 1 Processor -- start 2024-04-03T08:52:04.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.620+0000 7f564ac00700 1 -- start start 2024-04-03T08:52:04.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.620+0000 7f564ac00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5644102d00 0x7f5644113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:04.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.620+0000 7f564ac00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f5644113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.620+0000 7f564ac00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644114490 con 0x7f56441036a0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.620+0000 7f564ac00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564410da90 con 0x7f5644102d00 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f5644113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f5644113e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34722/0 (socket says 172.21.15.157:34722) 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 -- 172.21.15.157:0/1014827331 learned_addr learned my addr 172.21.15.157:0/1014827331 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643e00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5644102d00 0x7f5644113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 -- 172.21.15.157:0/1014827331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5644102d00 msgr2=0x7f5644113900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5644102d00 0x7f5644113900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 -- 172.21.15.157:0/1014827331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630005040 con 0x7f56441036a0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f5643400700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f5644113e40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5630009100 tx=0x7f5630009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563000e040 con 0x7f56441036a0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5630013420 con 0x7f56441036a0 2024-04-03T08:52:04.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564410dd10 con 0x7f56441036a0 2024-04-03T08:52:04.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.621+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563001c630 con 0x7f56441036a0 2024-04-03T08:52:04.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.622+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564410e2d0 con 0x7f56441036a0 2024-04-03T08:52:04.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.623+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56440fe450 con 0x7f56441036a0 2024-04-03T08:52:04.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.623+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5630013590 con 0x7f56441036a0 2024-04-03T08:52:04.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.624+0000 7f563be00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f562806d7e0 0x7f562806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:04.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.624+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f563008e360 con 0x7f56441036a0 2024-04-03T08:52:04.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.625+0000 7f5643e00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f562806d7e0 0x7f562806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:04.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.625+0000 7f5643e00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f562806d7e0 0x7f562806fc90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5634004990 tx=0x7f5634009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:04.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.629+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f563005b540 con 0x7f56441036a0 2024-04-03T08:52:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:04 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1761240846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-03T08:52:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:04 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2603040111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-03T08:52:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:04 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3565292864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-03T08:52:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:04 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1761240846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-03T08:52:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:04 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2603040111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-03T08:52:04.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:04 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3565292864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-03T08:52:04.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.879+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5644109de0 con 0x7f56441036a0 2024-04-03T08:52:04.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.879+0000 7f563be00700 1 -- 172.21.15.157:0/1014827331 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5013 (secure 0 0 0) 0x7f563005b0d0 con 0x7f56441036a0 2024-04-03T08:52:04.880 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:04.880 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44387,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/397415286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":397415286},{"type":"v1","addr":"172.21.15.181:6825","nonce":397415286}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44391,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/3661110481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3661110481},{"type":"v1","addr":"172.21.15.181:6827","nonce":3661110481}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:48.847209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:04.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f562806d7e0 msgr2=0x7f562806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f562806d7e0 0x7f562806fc90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5634004990 tx=0x7f5634009ee0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 msgr2=0x7f5644113e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f5644113e40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5630009100 tx=0x7f5630009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 shutdown_connections 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f562806d7e0 0x7f562806fc90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5644102d00 0x7f5644113900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 --2- 172.21.15.157:0/1014827331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56441036a0 0x7f5644113e40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 >> 172.21.15.157:0/1014827331 conn(0x7f56440f8830 msgr2=0x7f56440f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 shutdown_connections 2024-04-03T08:52:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:04.882+0000 7f564ac00700 1 -- 172.21.15.157:0/1014827331 wait complete. 2024-04-03T08:52:04.884 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 35 2024-04-03T08:52:04.900 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 1, 'flags': 50} 2024-04-03T08:52:04.900 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 -- 172.21.15.157:0/2010492257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 msgr2=0x7efe100706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 --2- 172.21.15.157:0/2010492257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe100706d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efe04004970 tx=0x7efe04009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 -- 172.21.15.157:0/2010492257 shutdown_connections 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 --2- 172.21.15.157:0/2010492257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe10070c10 0x7efe10109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 --2- 172.21.15.157:0/2010492257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe100706d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 -- 172.21.15.157:0/2010492257 >> 172.21.15.157:0/2010492257 conn(0x7efe100f8830 msgr2=0x7efe100fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:05.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 -- 172.21.15.157:0/2010492257 shutdown_connections 2024-04-03T08:52:05.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.096+0000 7efe17c00700 1 -- 172.21.15.157:0/2010492257 wait complete. 2024-04-03T08:52:05.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.097+0000 7efe17c00700 1 Processor -- start 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.097+0000 7efe17c00700 1 -- start start 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.097+0000 7efe17c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe10115a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.097+0000 7efe17c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe10070c10 0x7efe10115fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe17c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10116600 con 0x7efe10070300 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe17c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1010fbe0 con 0x7efe10070c10 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe10115a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe10115a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34740/0 (socket says 172.21.15.157:34740) 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 -- 172.21.15.157:0/139696666 learned_addr learned my addr 172.21.15.157:0/139696666 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe0fe00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe10070c10 0x7efe10115fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 -- 172.21.15.157:0/139696666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe10070c10 msgr2=0x7efe10115fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe10070c10 0x7efe10115fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 -- 172.21.15.157:0/139696666 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04005040 con 0x7efe10070300 2024-04-03T08:52:05.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.098+0000 7efe15200700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe10115a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efe04004f50 tx=0x7efe04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.099+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0400e040 con 0x7efe10070300 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.099+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe04009400 con 0x7efe10070300 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.099+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1010fe60 con 0x7efe10070300 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.099+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0401c3f0 con 0x7efe10070300 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.099+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101103a0 con 0x7efe10070300 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.100+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe10071a40 con 0x7efe10070300 2024-04-03T08:52:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.101+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efe04013420 con 0x7efe10070300 2024-04-03T08:52:05.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.102+0000 7efe0cc00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efdf806d7e0 0x7efdf806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:05.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.102+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7efe0408e3d0 con 0x7efe10070300 2024-04-03T08:52:05.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.102+0000 7efe0fe00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efdf806d7e0 0x7efdf806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:05.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.103+0000 7efe0fe00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efdf806d7e0 0x7efdf806fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efe10111310 tx=0x7efdfc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:05.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.106+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efe0405b5b0 con 0x7efe10070300 2024-04-03T08:52:05.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.356+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7efe101110c0 con 0x7efe10070300 2024-04-03T08:52:05.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.357+0000 7efe0cc00700 1 -- 172.21.15.157:0/139696666 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4056 (secure 0 0 0) 0x7efe0405b140 con 0x7efe10070300 2024-04-03T08:52:05.357 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:05.357 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24327,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/4237807179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":4237807179},{"type":"v1","addr":"172.21.15.157:6827","nonce":4237807179}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:16.048582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi157.zlscrk","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6829/2668059844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2668059844},{"type":"v1","addr":"172.21.15.157:6829","nonce":2668059844}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:05.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efdf806d7e0 msgr2=0x7efdf806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efdf806d7e0 0x7efdf806fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efe10111310 tx=0x7efdfc00b040 comp rx=0 tx=0).stop 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 msgr2=0x7efe10115a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe10115a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efe04004f50 tx=0x7efe04009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 shutdown_connections 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7efdf806d7e0 0x7efdf806fc90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe10070300 0x7efe10115a70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 --2- 172.21.15.157:0/139696666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe10070c10 0x7efe10115fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 >> 172.21.15.157:0/139696666 conn(0x7efe100f8830 msgr2=0x7efe100f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 shutdown_connections 2024-04-03T08:52:05.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.359+0000 7efe17c00700 1 -- 172.21.15.157:0/139696666 wait complete. 2024-04-03T08:52:05.361 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 18 2024-04-03T08:52:05.377 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-04-03T08:52:05.378 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-03T08:52:05.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 -- 172.21.15.157:0/2818138553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c102ce0 msgr2=0x7fef0c1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 --2- 172.21.15.157:0/2818138553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c102ce0 0x7fef0c1030b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feefc004940 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:05.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 -- 172.21.15.157:0/2818138553 shutdown_connections 2024-04-03T08:52:05.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 --2- 172.21.15.157:0/2818138553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef0c103680 0x7fef0c0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 --2- 172.21.15.157:0/2818138553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c102ce0 0x7fef0c1030b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 -- 172.21.15.157:0/2818138553 >> 172.21.15.157:0/2818138553 conn(0x7fef0c0f8830 msgr2=0x7fef0c0fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:05.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 -- 172.21.15.157:0/2818138553 shutdown_connections 2024-04-03T08:52:05.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 -- 172.21.15.157:0/2818138553 wait complete. 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.568+0000 7fef12a00700 1 Processor -- start 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef12a00700 1 -- start start 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef12a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef0c102ce0 0x7fef0c115ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef12a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 0x7fef0c116000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef12a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c1166e0 con 0x7fef0c103680 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef12a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c10fc30 con 0x7fef0c102ce0 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef0b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 0x7fef0c116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef0be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef0c102ce0 0x7fef0c115ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef0b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 0x7fef0c116000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34762/0 (socket says 172.21.15.157:34762) 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.569+0000 7fef0b400700 1 -- 172.21.15.157:0/38979364 learned_addr learned my addr 172.21.15.157:0/38979364 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef0b400700 1 -- 172.21.15.157:0/38979364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef0c102ce0 msgr2=0x7fef0c115ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef0b400700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef0c102ce0 0x7fef0c115ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef0b400700 1 -- 172.21.15.157:0/38979364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc005040 con 0x7fef0c103680 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef0b400700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 0x7fef0c116000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feef800b790 tx=0x7feef8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef800f6f0 con 0x7fef0c103680 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feef800fd20 con 0x7fef0c103680 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c10feb0 con 0x7fef0c103680 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef80103a0 con 0x7fef0c103680 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.570+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c110470 con 0x7fef0c103680 2024-04-03T08:52:05.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.571+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c0fe430 con 0x7fef0c103680 2024-04-03T08:52:05.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.573+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7feef8011400 con 0x7fef0c103680 2024-04-03T08:52:05.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.573+0000 7fef03e00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7feef006d7e0 0x7feef006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:05.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.574+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7feef808cdf0 con 0x7fef0c103680 2024-04-03T08:52:05.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.574+0000 7fef0be00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7feef006d7e0 0x7feef006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:05.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.574+0000 7fef0be00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7feef006d7e0 0x7feef006fc90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feefc009fd0 tx=0x7feefc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:05.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.578+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feef805a050 con 0x7fef0c103680 2024-04-03T08:52:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:05 smithi157 ceph-mon[117693]: pgmap v331: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:05 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1014827331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-03T08:52:05.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:05 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/139696666' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-03T08:52:05.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.828+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fef0c109e50 con 0x7fef0c103680 2024-04-03T08:52:05.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.829+0000 7fef03e00700 1 -- 172.21.15.157:0/38979364 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4838 (secure 0 0 0) 0x7feef8059be0 con 0x7fef0c103680 2024-04-03T08:52:05.829 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:05.829 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24327,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/4237807179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":4237807179},{"type":"v1","addr":"172.21.15.157:6827","nonce":4237807179}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:16.048582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi157.zlscrk","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6829/2668059844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2668059844},{"type":"v1","addr":"172.21.15.157:6829","nonce":2668059844}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7feef006d7e0 msgr2=0x7feef006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7feef006d7e0 0x7feef006fc90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feefc009fd0 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 msgr2=0x7fef0c116000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 0x7fef0c116000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feef800b790 tx=0x7feef8009220 comp rx=0 tx=0).stop 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 shutdown_connections 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7feef006d7e0 0x7feef006fc90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef0c102ce0 0x7fef0c115ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 --2- 172.21.15.157:0/38979364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef0c103680 0x7fef0c116000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 >> 172.21.15.157:0/38979364 conn(0x7fef0c0f8830 msgr2=0x7fef0c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 shutdown_connections 2024-04-03T08:52:05.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:05.831+0000 7fef12a00700 1 -- 172.21.15.157:0/38979364 wait complete. 2024-04-03T08:52:05.833 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 19 2024-04-03T08:52:05.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:05 smithi181 ceph-mon[101094]: pgmap v331: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:05 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1014827331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-03T08:52:05.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:05 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/139696666' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-03T08:52:05.850 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-04-03T08:52:05.850 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 -- 172.21.15.157:0/1241669362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 msgr2=0x7f41880fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 --2- 172.21.15.157:0/1241669362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f41880fccf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4174004940 tx=0x7f4174009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 -- 172.21.15.157:0/1241669362 shutdown_connections 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 --2- 172.21.15.157:0/1241669362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f41880fccf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 --2- 172.21.15.157:0/1241669362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 0x7f41881030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 -- 172.21.15.157:0/1241669362 >> 172.21.15.157:0/1241669362 conn(0x7f41880f8830 msgr2=0x7f41880fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 -- 172.21.15.157:0/1241669362 shutdown_connections 2024-04-03T08:52:06.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.040+0000 7f4190600700 1 -- 172.21.15.157:0/1241669362 wait complete. 2024-04-03T08:52:06.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.041+0000 7f4190600700 1 Processor -- start 2024-04-03T08:52:06.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.041+0000 7f4190600700 1 -- start start 2024-04-03T08:52:06.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.041+0000 7f4190600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 0x7f4188115a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.041+0000 7f4190600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f4188115fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.041+0000 7f4190600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4188116620 con 0x7f4188103680 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.041+0000 7f4190600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418810fc00 con 0x7f4188102ce0 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f4188115fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f4188115fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34774/0 (socket says 172.21.15.157:34774) 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 -- 172.21.15.157:0/3769342414 learned_addr learned my addr 172.21.15.157:0/3769342414 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418dc00700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 0x7f4188115a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 -- 172.21.15.157:0/3769342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 msgr2=0x7f4188115a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 0x7f4188115a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 -- 172.21.15.157:0/3769342414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174005040 con 0x7f4188103680 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418dc00700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 0x7f4188115a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f418d200700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f4188115fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4174009100 tx=0x7f4174009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.042+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417400e040 con 0x7f4188103680 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.043+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4174013420 con 0x7f4188103680 2024-04-03T08:52:06.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.043+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418810fe80 con 0x7f4188103680 2024-04-03T08:52:06.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.043+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417401c630 con 0x7f4188103680 2024-04-03T08:52:06.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.043+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4188110440 con 0x7f4188103680 2024-04-03T08:52:06.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.044+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41880fe430 con 0x7f4188103680 2024-04-03T08:52:06.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.045+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4174013590 con 0x7f4188103680 2024-04-03T08:52:06.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.045+0000 7f4185600700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f417006d7e0 0x7f417006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.046+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f417408e360 con 0x7f4188103680 2024-04-03T08:52:06.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.046+0000 7f418dc00700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f417006d7e0 0x7f417006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.046+0000 7f418dc00700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f417006d7e0 0x7f417006fc90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f417c009fd0 tx=0x7f417c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:06.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.050+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f417405b540 con 0x7f4188103680 2024-04-03T08:52:06.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.303+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f4188109dc0 con 0x7f4188103680 2024-04-03T08:52:06.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.304+0000 7f4185600700 1 -- 172.21.15.157:0/3769342414 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4056 (secure 0 0 0) 0x7f417405b0d0 con 0x7f4188103680 2024-04-03T08:52:06.304 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:06.304 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:16.048582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi157.zlscrk","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6829/2668059844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2668059844},{"type":"v1","addr":"172.21.15.157:6829","nonce":2668059844}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:06.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f417006d7e0 msgr2=0x7f417006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f417006d7e0 0x7f417006fc90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f417c009fd0 tx=0x7f417c009ee0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 msgr2=0x7f4188115fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f4188115fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4174009100 tx=0x7f4174009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:06.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 shutdown_connections 2024-04-03T08:52:06.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f417006d7e0 0x7f417006fc90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4188102ce0 0x7f4188115a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 --2- 172.21.15.157:0/3769342414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4188103680 0x7f4188115fd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.306+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 >> 172.21.15.157:0/3769342414 conn(0x7f41880f8830 msgr2=0x7f4188071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:06.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.307+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 shutdown_connections 2024-04-03T08:52:06.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.307+0000 7f4190600700 1 -- 172.21.15.157:0/3769342414 wait complete. 2024-04-03T08:52:06.308 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 20 2024-04-03T08:52:06.325 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-03T08:52:06.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.515+0000 7f1668e00700 1 -- 172.21.15.157:0/3119640917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664103680 msgr2=0x7f16640fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.515+0000 7f1668e00700 1 --2- 172.21.15.157:0/3119640917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664103680 0x7f16640fccf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1650004940 tx=0x7f1650009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.515+0000 7f1668e00700 1 -- 172.21.15.157:0/3119640917 shutdown_connections 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.515+0000 7f1668e00700 1 --2- 172.21.15.157:0/3119640917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664103680 0x7f16640fccf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.515+0000 7f1668e00700 1 --2- 172.21.15.157:0/3119640917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1664102ce0 0x7f16641030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.515+0000 7f1668e00700 1 -- 172.21.15.157:0/3119640917 >> 172.21.15.157:0/3119640917 conn(0x7f16640f8830 msgr2=0x7f16640fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.516+0000 7f1668e00700 1 -- 172.21.15.157:0/3119640917 shutdown_connections 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.516+0000 7f1668e00700 1 -- 172.21.15.157:0/3119640917 wait complete. 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.516+0000 7f1668e00700 1 Processor -- start 2024-04-03T08:52:06.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1668e00700 1 -- start start 2024-04-03T08:52:06.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1668e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 0x7f16640702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1668e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1664103680 0x7f1664070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1668e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664072210 con 0x7f1664102ce0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1668e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664070d40 con 0x7f1664103680 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1661e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 0x7f16640702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1661e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 0x7f16640702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34804/0 (socket says 172.21.15.157:34804) 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1661e00700 1 -- 172.21.15.157:0/4103702455 learned_addr learned my addr 172.21.15.157:0/4103702455 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.517+0000 7f1661400700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1664103680 0x7f1664070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f1661e00700 1 -- 172.21.15.157:0/4103702455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1664103680 msgr2=0x7f1664070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f1661e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1664103680 0x7f1664070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f1661e00700 1 -- 172.21.15.157:0/4103702455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650005040 con 0x7f1664102ce0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f1661e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 0x7f16640702c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f165400eb40 tx=0x7f165400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1654007cc0 con 0x7f1664102ce0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f165400f040 con 0x7f1664102ce0 2024-04-03T08:52:06.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1664070fc0 con 0x7f1664102ce0 2024-04-03T08:52:06.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f165400ca10 con 0x7f1664102ce0 2024-04-03T08:52:06.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.518+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1664119f40 con 0x7f1664102ce0 2024-04-03T08:52:06.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.519+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16640fe430 con 0x7f1664102ce0 2024-04-03T08:52:06.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.520+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f165400cc80 con 0x7f1664102ce0 2024-04-03T08:52:06.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.521+0000 7f165a000700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f164806d7e0 0x7f164806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.521+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f165408cc80 con 0x7f1664102ce0 2024-04-03T08:52:06.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.521+0000 7f1661400700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f164806d7e0 0x7f164806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.522+0000 7f1661400700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f164806d7e0 0x7f164806fc90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16640719f0 tx=0x7f1650009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:06.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.525+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1654092020 con 0x7f1664102ce0 2024-04-03T08:52:06.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.775+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f166411a130 con 0x7f1664102ce0 2024-04-03T08:52:06.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.775+0000 7f165a000700 1 -- 172.21.15.157:0/4103702455 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4872 (secure 0 0 0) 0x7f16540563a0 con 0x7f1664102ce0 2024-04-03T08:52:06.776 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:06.776 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:16.048582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi157.zlscrk","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6829/2668059844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2668059844},{"type":"v1","addr":"172.21.15.157:6829","nonce":2668059844}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f164806d7e0 msgr2=0x7f164806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f164806d7e0 0x7f164806fc90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16640719f0 tx=0x7f1650009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 msgr2=0x7f16640702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 0x7f16640702c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f165400eb40 tx=0x7f165400b040 comp rx=0 tx=0).stop 2024-04-03T08:52:06.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 shutdown_connections 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f164806d7e0 0x7f164806fc90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1664102ce0 0x7f16640702c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 --2- 172.21.15.157:0/4103702455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1664103680 0x7f1664070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 >> 172.21.15.157:0/4103702455 conn(0x7f16640f8830 msgr2=0x7f16640f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 shutdown_connections 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.778+0000 7f1668e00700 1 -- 172.21.15.157:0/4103702455 wait complete. 2024-04-03T08:52:06.779 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 21 2024-04-03T08:52:06.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:06 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/38979364' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-03T08:52:06.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:06 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3769342414' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-03T08:52:06.796 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-03T08:52:06.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-03T08:52:06.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:06 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/38979364' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-03T08:52:06.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:06 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3769342414' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 -- 172.21.15.157:0/116161801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 msgr2=0x7ff6880fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 --2- 172.21.15.157:0/116161801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff6880fcce0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff674004940 tx=0x7ff674009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 -- 172.21.15.157:0/116161801 shutdown_connections 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 --2- 172.21.15.157:0/116161801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff6880fcce0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 --2- 172.21.15.157:0/116161801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 0x7ff6881030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 -- 172.21.15.157:0/116161801 >> 172.21.15.157:0/116161801 conn(0x7ff6880f8820 msgr2=0x7ff6880fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 -- 172.21.15.157:0/116161801 shutdown_connections 2024-04-03T08:52:06.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.988+0000 7ff68d000700 1 -- 172.21.15.157:0/116161801 wait complete. 2024-04-03T08:52:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.989+0000 7ff68d000700 1 Processor -- start 2024-04-03T08:52:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.989+0000 7ff68d000700 1 -- start start 2024-04-03T08:52:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.989+0000 7ff68d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 0x7ff688115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff68d000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff688115fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff68d000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff688116610 con 0x7ff688103670 2024-04-03T08:52:06.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff68d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68810fbf0 con 0x7ff688102cd0 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff688115fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 0x7ff688115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 0x7ff688115a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:49816/0 (socket says 172.21.15.157:49816) 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685e00700 1 -- 172.21.15.157:0/533630684 learned_addr learned my addr 172.21.15.157:0/533630684 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685400700 1 -- 172.21.15.157:0/533630684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 msgr2=0x7ff688115a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685400700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 0x7ff688115a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685400700 1 -- 172.21.15.157:0/533630684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674005040 con 0x7ff688103670 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.990+0000 7ff685400700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff688115fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff688067120 tx=0x7ff674009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.991+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff67400e040 con 0x7ff688103670 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.991+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff674004290 con 0x7ff688103670 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.991+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68810fe70 con 0x7ff688103670 2024-04-03T08:52:06.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.991+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff674013e90 con 0x7ff688103670 2024-04-03T08:52:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.991+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff688110430 con 0x7ff688103670 2024-04-03T08:52:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.992+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6880fe420 con 0x7ff688103670 2024-04-03T08:52:06.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.993+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff6740136b0 con 0x7ff688103670 2024-04-03T08:52:06.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.994+0000 7ff67e000700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff66c06d780 0x7ff66c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:06.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.994+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7ff67408e1e0 con 0x7ff688103670 2024-04-03T08:52:06.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.994+0000 7ff685e00700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff66c06d780 0x7ff66c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:06.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.995+0000 7ff685e00700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff66c06d780 0x7ff66c06fc30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff6780041d0 tx=0x7ff67800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:06.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:06.998+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff67405b3c0 con 0x7ff688103670 2024-04-03T08:52:07.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.249+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7ff688064970 con 0x7ff688103670 2024-04-03T08:52:07.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.250+0000 7ff67e000700 1 -- 172.21.15.157:0/533630684 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4080 (secure 0 0 0) 0x7ff67405af50 con 0x7ff688103670 2024-04-03T08:52:07.250 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:07.250 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:42.918928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff66c06d780 msgr2=0x7ff66c06fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff66c06d780 0x7ff66c06fc30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff6780041d0 tx=0x7ff67800b040 comp rx=0 tx=0).stop 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 msgr2=0x7ff688115fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff688115fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff688067120 tx=0x7ff674009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 shutdown_connections 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7ff66c06d780 0x7ff66c06fc30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff688102cd0 0x7ff688115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 --2- 172.21.15.157:0/533630684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff688103670 0x7ff688115fc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 >> 172.21.15.157:0/533630684 conn(0x7ff6880f8820 msgr2=0x7ff688071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 shutdown_connections 2024-04-03T08:52:07.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.252+0000 7ff68d000700 1 -- 172.21.15.157:0/533630684 wait complete. 2024-04-03T08:52:07.254 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 22 2024-04-03T08:52:07.270 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-03T08:52:07.271 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-03T08:52:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 -- 172.21.15.157:0/819742806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f00071f90 msgr2=0x7f8f00070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 --2- 172.21.15.157:0/819742806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f00071f90 0x7f8f00070360 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0004970 tx=0x7f8ef0009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 -- 172.21.15.157:0/819742806 shutdown_connections 2024-04-03T08:52:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 --2- 172.21.15.157:0/819742806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f000708a0 0x7f8f00070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 --2- 172.21.15.157:0/819742806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f00071f90 0x7f8f00070360 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 -- 172.21.15.157:0/819742806 >> 172.21.15.157:0/819742806 conn(0x7f8f000f8830 msgr2=0x7f8f000fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:07.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 -- 172.21.15.157:0/819742806 shutdown_connections 2024-04-03T08:52:07.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.462+0000 7f8f06800700 1 -- 172.21.15.157:0/819742806 wait complete. 2024-04-03T08:52:07.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8f06800700 1 Processor -- start 2024-04-03T08:52:07.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8f06800700 1 -- start start 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8f06800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 0x7f8f00119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8f06800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f00071f90 0x7f8f0011a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8f06800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0011aa60 con 0x7f8f000708a0 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8f06800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00114040 con 0x7f8f00071f90 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8eff400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 0x7f8f00119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8eff400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 0x7f8f00119ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34846/0 (socket says 172.21.15.157:34846) 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.463+0000 7f8eff400700 1 -- 172.21.15.157:0/476357892 learned_addr learned my addr 172.21.15.157:0/476357892 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:07.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8efea00700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f00071f90 0x7f8f0011a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8eff400700 1 -- 172.21.15.157:0/476357892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f00071f90 msgr2=0x7f8f0011a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8eff400700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f00071f90 0x7f8f0011a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8eff400700 1 -- 172.21.15.157:0/476357892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0005040 con 0x7f8f000708a0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8eff400700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 0x7f8f00119ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0005010 tx=0x7f8ef0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef000e040 con 0x7f8f000708a0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ef0009950 con 0x7f8f000708a0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f001142c0 con 0x7f8f000708a0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef001c3f0 con 0x7f8f000708a0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.464+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f00114800 con 0x7f8f000708a0 2024-04-03T08:52:07.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.465+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00071aa0 con 0x7f8f000708a0 2024-04-03T08:52:07.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.466+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8ef00137b0 con 0x7f8f000708a0 2024-04-03T08:52:07.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.467+0000 7f8ef7400700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8ee406d7e0 0x7f8ee406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:07.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.467+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f8ef008e370 con 0x7f8f000708a0 2024-04-03T08:52:07.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.467+0000 7f8efea00700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8ee406d7e0 0x7f8ee406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:07.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.468+0000 7f8efea00700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8ee406d7e0 0x7f8ee406fc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8eec004600 tx=0x7f8eec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:07.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.472+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8ef005b5f0 con 0x7f8f000708a0 2024-04-03T08:52:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:07 smithi157 ceph-mon[117693]: pgmap v332: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:07 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/4103702455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-03T08:52:07.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:07 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/533630684' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-03T08:52:07.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.718+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f8f00110430 con 0x7f8f000708a0 2024-04-03T08:52:07.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.718+0000 7f8ef7400700 1 -- 172.21.15.157:0/476357892 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4091 (secure 0 0 0) 0x7f8ef005b180 con 0x7f8f000708a0 2024-04-03T08:52:07.719 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:07.719 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:42.925083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24323":{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":0,"incarnation":23,"state":"up:replay","state_seq":1,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:07.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8ee406d7e0 msgr2=0x7f8ee406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8ee406d7e0 0x7f8ee406fc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8eec004600 tx=0x7f8eec00b040 comp rx=0 tx=0).stop 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 msgr2=0x7f8f00119ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 0x7f8f00119ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0005010 tx=0x7f8ef0009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 shutdown_connections 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f8ee406d7e0 0x7f8ee406fc90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f000708a0 0x7f8f00119ed0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 --2- 172.21.15.157:0/476357892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f00071f90 0x7f8f0011a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 >> 172.21.15.157:0/476357892 conn(0x7f8f000f8830 msgr2=0x7f8f000f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 shutdown_connections 2024-04-03T08:52:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.721+0000 7f8f06800700 1 -- 172.21.15.157:0/476357892 wait complete. 2024-04-03T08:52:07.723 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 23 2024-04-03T08:52:07.739 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-03T08:52:07.739 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-03T08:52:07.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:07 smithi181 ceph-mon[101094]: pgmap v332: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:07.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:07 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/4103702455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-03T08:52:07.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:07 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/533630684' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-03T08:52:07.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 -- 172.21.15.157:0/2660693687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 msgr2=0x7fa4f41030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2660693687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f41030a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8004940 tx=0x7fa4e8009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:07.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 -- 172.21.15.157:0/2660693687 shutdown_connections 2024-04-03T08:52:07.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2660693687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 0x7fa4f40fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2660693687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f41030a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 -- 172.21.15.157:0/2660693687 >> 172.21.15.157:0/2660693687 conn(0x7fa4f40f8820 msgr2=0x7fa4f40fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:07.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 -- 172.21.15.157:0/2660693687 shutdown_connections 2024-04-03T08:52:07.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.930+0000 7fa4fc800700 1 -- 172.21.15.157:0/2660693687 wait complete. 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.931+0000 7fa4fc800700 1 Processor -- start 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4fc800700 1 -- start start 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4fc800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4fc800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 0x7fa4f4070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4fc800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4072210 con 0x7fa4f4102cd0 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4fc800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4070d40 con 0x7fa4f4103670 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4f9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4f9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f40702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34860/0 (socket says 172.21.15.157:34860) 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.932+0000 7fa4f9e00700 1 -- 172.21.15.157:0/2778513261 learned_addr learned my addr 172.21.15.157:0/2778513261 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:07.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4f9400700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 0x7fa4f4070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4f9e00700 1 -- 172.21.15.157:0/2778513261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 msgr2=0x7fa4f4070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4f9e00700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 0x7fa4f4070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4f9e00700 1 -- 172.21.15.157:0/2778513261 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e4005040 con 0x7fa4f4102cd0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4f9400700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 0x7fa4f4070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4f9e00700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f40702c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80090d0 tx=0x7fa4e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4e8021070 con 0x7fa4f4102cd0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4e8013c00 con 0x7fa4f4102cd0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e8005040 con 0x7fa4f4102cd0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.933+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4e800e070 con 0x7fa4f4102cd0 2024-04-03T08:52:07.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.934+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f4119ef0 con 0x7fa4f4102cd0 2024-04-03T08:52:07.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.935+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f40fe420 con 0x7fa4f4102cd0 2024-04-03T08:52:07.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.935+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa4e801c400 con 0x7fa4f4102cd0 2024-04-03T08:52:07.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.936+0000 7fa4ee000700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa4dc06d7e0 0x7fa4dc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:07.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.936+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa4e808e610 con 0x7fa4f4102cd0 2024-04-03T08:52:07.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.937+0000 7fa4f9400700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa4dc06d7e0 0x7fa4dc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:07.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.937+0000 7fa4f9400700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa4dc06d7e0 0x7fa4dc06fc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40719f0 tx=0x7fa4e4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:07.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:07.941+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa4e8057cc0 con 0x7fa4f4102cd0 2024-04-03T08:52:08.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.192+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fa4f40717a0 con 0x7fa4f4102cd0 2024-04-03T08:52:08.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.193+0000 7fa4ee000700 1 -- 172.21.15.157:0/2778513261 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4096 (secure 0 0 0) 0x7fa4e805b380 con 0x7fa4f4102cd0 2024-04-03T08:52:08.193 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:08.193 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:51.328203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24323":{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":177,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa4dc06d7e0 msgr2=0x7fa4dc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa4dc06d7e0 0x7fa4dc06fc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40719f0 tx=0x7fa4e4009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 msgr2=0x7fa4f40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f40702c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80090d0 tx=0x7fa4e8009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 shutdown_connections 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fa4dc06d7e0 0x7fa4dc06fc90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f4102cd0 0x7fa4f40702c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 --2- 172.21.15.157:0/2778513261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f4103670 0x7fa4f4070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 >> 172.21.15.157:0/2778513261 conn(0x7fa4f40f8820 msgr2=0x7fa4f40f9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:08.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.195+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 shutdown_connections 2024-04-03T08:52:08.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.196+0000 7fa4fc800700 1 -- 172.21.15.157:0/2778513261 wait complete. 2024-04-03T08:52:08.197 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 24 2024-04-03T08:52:08.213 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-03T08:52:08.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-03T08:52:08.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.404+0000 7f9692400700 1 -- 172.21.15.157:0/3086575551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c102cd0 msgr2=0x7f968c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.404+0000 7f9692400700 1 --2- 172.21.15.157:0/3086575551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c102cd0 0x7f968c1030a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f967c004940 tx=0x7f967c009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:08.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.405+0000 7f9692400700 1 -- 172.21.15.157:0/3086575551 shutdown_connections 2024-04-03T08:52:08.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.405+0000 7f9692400700 1 --2- 172.21.15.157:0/3086575551 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c103670 0x7f968c0fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.405+0000 7f9692400700 1 --2- 172.21.15.157:0/3086575551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c102cd0 0x7f968c1030a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.405+0000 7f9692400700 1 -- 172.21.15.157:0/3086575551 >> 172.21.15.157:0/3086575551 conn(0x7f968c0f8820 msgr2=0x7f968c0fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:08.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.405+0000 7f9692400700 1 -- 172.21.15.157:0/3086575551 shutdown_connections 2024-04-03T08:52:08.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.405+0000 7f9692400700 1 -- 172.21.15.157:0/3086575551 wait complete. 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.406+0000 7f9692400700 1 Processor -- start 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.406+0000 7f9692400700 1 -- start start 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.406+0000 7f9692400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 0x7f968c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f9692400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c103670 0x7f968c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f9692400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0721f0 con 0x7f968c103670 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f9692400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c070d40 con 0x7f968c102cd0 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 0x7f968c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c103670 0x7f968c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 0x7f968c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.157:49856/0 (socket says 172.21.15.157:49856) 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968b400700 1 -- 172.21.15.157:0/2238841156 learned_addr learned my addr 172.21.15.157:0/2238841156 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968b400700 1 -- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c103670 msgr2=0x7f968c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968b400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c103670 0x7f968c070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968b400700 1 -- 172.21.15.157:0/2238841156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c005040 con 0x7f968c102cd0 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.407+0000 7f968aa00700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c103670 0x7f968c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.408+0000 7f968b400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 0x7f968c0702c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f967c009180 tx=0x7f967c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.408+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c00e040 con 0x7f968c102cd0 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.408+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c070fc0 con 0x7f968c102cd0 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.408+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f967c013420 con 0x7f968c102cd0 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.408+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c01c630 con 0x7f968c102cd0 2024-04-03T08:52:08.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.408+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c119fc0 con 0x7f968c102cd0 2024-04-03T08:52:08.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.409+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c0fe420 con 0x7f968c102cd0 2024-04-03T08:52:08.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.410+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f967c013590 con 0x7f968c102cd0 2024-04-03T08:52:08.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.411+0000 7f9683400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f967006d7e0 0x7f967006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:08.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.411+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f967c08e3d0 con 0x7f968c102cd0 2024-04-03T08:52:08.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.411+0000 7f968aa00700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f967006d7e0 0x7f967006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:08.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.412+0000 7f968aa00700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f967006d7e0 0x7f967006fc90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f968c106f10 tx=0x7f967800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:08.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.416+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f967c057b00 con 0x7f968c102cd0 2024-04-03T08:52:08.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:08 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/476357892' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-03T08:52:08.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:08 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2778513261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-03T08:52:08.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:08 smithi157 ceph-mon[117693]: pgmap v333: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:08.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.670+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f968c064970 con 0x7f968c102cd0 2024-04-03T08:52:08.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.671+0000 7f9683400700 1 -- 172.21.15.157:0/2238841156 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+4093 (secure 0 0 0) 0x7f967c05b1c0 con 0x7f968c102cd0 2024-04-03T08:52:08.672 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:08.672 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:52.307973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24323":{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":178,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:08.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f967006d7e0 msgr2=0x7f967006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f967006d7e0 0x7f967006fc90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f968c106f10 tx=0x7f967800b040 comp rx=0 tx=0).stop 2024-04-03T08:52:08.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 msgr2=0x7f968c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 0x7f968c0702c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f967c009180 tx=0x7f967c009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 shutdown_connections 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f967006d7e0 0x7f967006fc90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c102cd0 0x7f968c0702c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 --2- 172.21.15.157:0/2238841156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f968c103670 0x7f968c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 >> 172.21.15.157:0/2238841156 conn(0x7f968c0f8820 msgr2=0x7f968c0f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 shutdown_connections 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.674+0000 7f9692400700 1 -- 172.21.15.157:0/2238841156 wait complete. 2024-04-03T08:52:08.675 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 25 2024-04-03T08:52:08.691 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-03T08:52:08.692 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-03T08:52:08.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:08 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/476357892' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-03T08:52:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:08 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2778513261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-03T08:52:08.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:08 smithi181 ceph-mon[101094]: pgmap v333: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:08.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 -- 172.21.15.157:0/2921825983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 msgr2=0x7fec780fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 --2- 172.21.15.157:0/2921825983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec780fccf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fec64004940 tx=0x7fec64009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 -- 172.21.15.157:0/2921825983 shutdown_connections 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 --2- 172.21.15.157:0/2921825983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec780fccf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 --2- 172.21.15.157:0/2921825983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 0x7fec781030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 -- 172.21.15.157:0/2921825983 >> 172.21.15.157:0/2921825983 conn(0x7fec780f8830 msgr2=0x7fec780fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 -- 172.21.15.157:0/2921825983 shutdown_connections 2024-04-03T08:52:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.881+0000 7fec7fa00700 1 -- 172.21.15.157:0/2921825983 wait complete. 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.882+0000 7fec7fa00700 1 Processor -- start 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.882+0000 7fec7fa00700 1 -- start start 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.882+0000 7fec7fa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 0x7fec78113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.882+0000 7fec7fa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec78113dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.882+0000 7fec7fa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec78114420 con 0x7fec78103680 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.882+0000 7fec7fa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7810da20 con 0x7fec78102ce0 2024-04-03T08:52:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec78113dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec78113dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34894/0 (socket says 172.21.15.157:34894) 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 -- 172.21.15.157:0/3803889405 learned_addr learned my addr 172.21.15.157:0/3803889405 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec7d000700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 0x7fec78113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 -- 172.21.15.157:0/3803889405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 msgr2=0x7fec78113890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 0x7fec78113890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 -- 172.21.15.157:0/3803889405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64005040 con 0x7fec78103680 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec7d000700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 0x7fec78113890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec77e00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec78113dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec64009100 tx=0x7fec64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6400e040 con 0x7fec78103680 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec64013420 con 0x7fec78103680 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7810dca0 con 0x7fec78103680 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.883+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6401c630 con 0x7fec78103680 2024-04-03T08:52:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.884+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7810e260 con 0x7fec78103680 2024-04-03T08:52:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.885+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec780fe430 con 0x7fec78103680 2024-04-03T08:52:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.886+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fec64013590 con 0x7fec78103680 2024-04-03T08:52:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.886+0000 7fec74c00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fec6006d7e0 0x7fec6006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.887+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fec6408e180 con 0x7fec78103680 2024-04-03T08:52:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.887+0000 7fec7d000700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fec6006d7e0 0x7fec6006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.887+0000 7fec7d000700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fec6006d7e0 0x7fec6006fc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009fd0 tx=0x7fec6c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:08.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:08.892+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fec6405b4a0 con 0x7fec78103680 2024-04-03T08:52:09.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.147+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fec78109dc0 con 0x7fec78103680 2024-04-03T08:52:09.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.149+0000 7fec74c00700 1 -- 172.21.15.157:0/3803889405 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4909 (secure 0 0 0) 0x7fec6405b030 con 0x7fec78103680 2024-04-03T08:52:09.149 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:09.149 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:47:53.376789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24323":{"gid":24323,"name":"cephfs.smithi181.ecaerp","rank":0,"incarnation":23,"state":"up:active","state_seq":179,"addr":"172.21.15.181:6825/3882128322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3882128322},{"type":"v1","addr":"172.21.15.181:6825","nonce":3882128322}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fec6006d7e0 msgr2=0x7fec6006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fec6006d7e0 0x7fec6006fc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009fd0 tx=0x7fec6c009ee0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 msgr2=0x7fec78113dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec78113dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec64009100 tx=0x7fec64009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 shutdown_connections 2024-04-03T08:52:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fec6006d7e0 0x7fec6006fc90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec78102ce0 0x7fec78113890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 --2- 172.21.15.157:0/3803889405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec78103680 0x7fec78113dd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 >> 172.21.15.157:0/3803889405 conn(0x7fec780f8830 msgr2=0x7fec780f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 shutdown_connections 2024-04-03T08:52:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.152+0000 7fec7fa00700 1 -- 172.21.15.157:0/3803889405 wait complete. 2024-04-03T08:52:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 26 2024-04-03T08:52:09.171 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-03T08:52:09.171 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 -- 172.21.15.157:0/456455584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 msgr2=0x7f63cc1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 --2- 172.21.15.157:0/456455584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc1030a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009ce0 tx=0x7f63c0004d10 comp rx=0 tx=0).stop 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 -- 172.21.15.157:0/456455584 shutdown_connections 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 --2- 172.21.15.157:0/456455584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63cc103670 0x7f63cc0fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 --2- 172.21.15.157:0/456455584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc1030a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 -- 172.21.15.157:0/456455584 >> 172.21.15.157:0/456455584 conn(0x7f63cc0f8820 msgr2=0x7f63cc0fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 -- 172.21.15.157:0/456455584 shutdown_connections 2024-04-03T08:52:09.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.363+0000 7f63d3a00700 1 -- 172.21.15.157:0/456455584 wait complete. 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.364+0000 7f63d3a00700 1 Processor -- start 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d3a00700 1 -- start start 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d3a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d3a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63cc103670 0x7f63cc113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d3a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc114600 con 0x7f63cc102cd0 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d3a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc10dbe0 con 0x7f63cc103670 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d1000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d1000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34906/0 (socket says 172.21.15.157:34906) 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.365+0000 7f63d1000700 1 -- 172.21.15.157:0/3995257464 learned_addr learned my addr 172.21.15.157:0/3995257464 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:09.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63d1000700 1 -- 172.21.15.157:0/3995257464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63cc103670 msgr2=0x7f63cc113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63d1000700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63cc103670 0x7f63cc113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63d1000700 1 -- 172.21.15.157:0/3995257464 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009940 con 0x7f63cc102cd0 2024-04-03T08:52:09.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63d1000700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc113a70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f63c0005010 tx=0x7f63c0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63c000e040 con 0x7f63cc102cd0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63c0008da0 con 0x7f63cc102cd0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc10de60 con 0x7f63cc102cd0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63c001c640 con 0x7f63cc102cd0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.366+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc10e420 con 0x7f63cc102cd0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.367+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63cc0fe420 con 0x7f63cc102cd0 2024-04-03T08:52:09.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.368+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f63c0012410 con 0x7f63cc102cd0 2024-04-03T08:52:09.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.369+0000 7f63c8c00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f63b406d7e0 0x7f63b406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:09.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.369+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f63c008eae0 con 0x7f63cc102cd0 2024-04-03T08:52:09.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.369+0000 7f63cbe00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f63b406d7e0 0x7f63b406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:09.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.370+0000 7f63cbe00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f63b406d7e0 0x7f63b406fc90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63cc10f310 tx=0x7f63b8009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:09.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.374+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f63c005bd60 con 0x7f63cc102cd0 2024-04-03T08:52:09.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.624+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f63cc109dd0 con 0x7f63cc102cd0 2024-04-03T08:52:09.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.625+0000 7f63c8c00700 1 -- 172.21.15.157:0/3995257464 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+4114 (secure 0 0 0) 0x7f63c005b8f0 con 0x7f63cc102cd0 2024-04-03T08:52:09.625 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:09.625 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:09.490433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f63b406d7e0 msgr2=0x7f63b406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f63b406d7e0 0x7f63b406fc90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63cc10f310 tx=0x7f63b8009ce0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 msgr2=0x7f63cc113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc113a70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f63c0005010 tx=0x7f63c0004d10 comp rx=0 tx=0).stop 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 shutdown_connections 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f63b406d7e0 0x7f63b406fc90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63cc102cd0 0x7f63cc113a70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 --2- 172.21.15.157:0/3995257464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63cc103670 0x7f63cc113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 >> 172.21.15.157:0/3995257464 conn(0x7f63cc0f8820 msgr2=0x7f63cc0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:09.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.627+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 shutdown_connections 2024-04-03T08:52:09.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.628+0000 7f63d3a00700 1 -- 172.21.15.157:0/3995257464 wait complete. 2024-04-03T08:52:09.629 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 27 2024-04-03T08:52:09.645 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-03T08:52:09.645 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-03T08:52:09.705 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:09 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2238841156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-03T08:52:09.705 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:09 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3803889405' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-03T08:52:09.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 -- 172.21.15.157:0/637888201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18102cd0 msgr2=0x7fad181030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 --2- 172.21.15.157:0/637888201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18102cd0 0x7fad181030a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fad0c004940 tx=0x7fad0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 -- 172.21.15.157:0/637888201 shutdown_connections 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 --2- 172.21.15.157:0/637888201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad18103670 0x7fad180fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 --2- 172.21.15.157:0/637888201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18102cd0 0x7fad181030a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 -- 172.21.15.157:0/637888201 >> 172.21.15.157:0/637888201 conn(0x7fad180f8820 msgr2=0x7fad180fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 -- 172.21.15.157:0/637888201 shutdown_connections 2024-04-03T08:52:09.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.836+0000 7fad20600700 1 -- 172.21.15.157:0/637888201 wait complete. 2024-04-03T08:52:09.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.837+0000 7fad20600700 1 Processor -- start 2024-04-03T08:52:09.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.837+0000 7fad20600700 1 -- start start 2024-04-03T08:52:09.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.837+0000 7fad20600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad18102cd0 0x7fad18115ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:09.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.837+0000 7fad20600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 0x7fad18116000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:09.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.837+0000 7fad20600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18116650 con 0x7fad18103670 2024-04-03T08:52:09.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.837+0000 7fad20600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1810fc30 con 0x7fad18102cd0 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 0x7fad18116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 0x7fad18116000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34922/0 (socket says 172.21.15.157:34922) 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 -- 172.21.15.157:0/2854771506 learned_addr learned my addr 172.21.15.157:0/2854771506 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1dc00700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad18102cd0 0x7fad18115ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 -- 172.21.15.157:0/2854771506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad18102cd0 msgr2=0x7fad18115ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad18102cd0 0x7fad18115ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 -- 172.21.15.157:0/2854771506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c005040 con 0x7fad18103670 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad1d200700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 0x7fad18116000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fad04002a50 tx=0x7fad04004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.838+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad04007cc0 con 0x7fad18103670 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.839+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad0400f040 con 0x7fad18103670 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.839+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1810ff10 con 0x7fad18103670 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.839+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0400d9c0 con 0x7fad18103670 2024-04-03T08:52:09.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.839+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad181104d0 con 0x7fad18103670 2024-04-03T08:52:09.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.840+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad180fe420 con 0x7fad18103670 2024-04-03T08:52:09.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.841+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fad04009730 con 0x7fad18103670 2024-04-03T08:52:09.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.842+0000 7fad15600700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fad0006d7e0 0x7fad0006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:09.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.842+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fad0408ce50 con 0x7fad18103670 2024-04-03T08:52:09.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.842+0000 7fad1dc00700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fad0006d7e0 0x7fad0006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:09.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.843+0000 7fad1dc00700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fad0006d7e0 0x7fad0006fc90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009fd0 tx=0x7fad0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:09.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:09.846+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad04059fb0 con 0x7fad18103670 2024-04-03T08:52:09.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:09 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2238841156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-03T08:52:09.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:09 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3803889405' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-03T08:52:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.096+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fad18109dd0 con 0x7fad18103670 2024-04-03T08:52:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.097+0000 7fad15600700 1 -- 172.21.15.157:0/2854771506 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4159 (secure 0 0 0) 0x7fad04059b40 con 0x7fad18103670 2024-04-03T08:52:10.097 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:10.098 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:09.497097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fad0006d7e0 msgr2=0x7fad0006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fad0006d7e0 0x7fad0006fc90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009fd0 tx=0x7fad0c009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 msgr2=0x7fad18116000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 0x7fad18116000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fad04002a50 tx=0x7fad04004600 comp rx=0 tx=0).stop 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 shutdown_connections 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fad0006d7e0 0x7fad0006fc90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad18102cd0 0x7fad18115ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 --2- 172.21.15.157:0/2854771506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad18103670 0x7fad18116000 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 >> 172.21.15.157:0/2854771506 conn(0x7fad180f8820 msgr2=0x7fad180f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 shutdown_connections 2024-04-03T08:52:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.100+0000 7fad20600700 1 -- 172.21.15.157:0/2854771506 wait complete. 2024-04-03T08:52:10.102 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 28 2024-04-03T08:52:10.119 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-03T08:52:10.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 -- 172.21.15.157:0/293722440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070300 msgr2=0x7fe46c0706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 --2- 172.21.15.157:0/293722440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070300 0x7fe46c0706d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe45c004970 tx=0x7fe45c009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 -- 172.21.15.157:0/293722440 shutdown_connections 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 --2- 172.21.15.157:0/293722440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe46c070c10 0x7fe46c108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 --2- 172.21.15.157:0/293722440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070300 0x7fe46c0706d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 -- 172.21.15.157:0/293722440 >> 172.21.15.157:0/293722440 conn(0x7fe46c0f86e0 msgr2=0x7fe46c0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 -- 172.21.15.157:0/293722440 shutdown_connections 2024-04-03T08:52:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.309+0000 7fe470c00700 1 -- 172.21.15.157:0/293722440 wait complete. 2024-04-03T08:52:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.310+0000 7fe470c00700 1 Processor -- start 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.310+0000 7fe470c00700 1 -- start start 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.310+0000 7fe470c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe46c070300 0x7fe46c1158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.310+0000 7fe470c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 0x7fe46c115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.310+0000 7fe470c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c116450 con 0x7fe46c070c10 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.310+0000 7fe470c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c10fa50 con 0x7fe46c070300 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 0x7fe46c115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 0x7fe46c115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34942/0 (socket says 172.21.15.157:34942) 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 -- 172.21.15.157:0/764628944 learned_addr learned my addr 172.21.15.157:0/764628944 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46b400700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe46c070300 0x7fe46c1158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 -- 172.21.15.157:0/764628944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe46c070300 msgr2=0x7fe46c1158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe46c070300 0x7fe46c1158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 -- 172.21.15.157:0/764628944 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c005040 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.311+0000 7fe46aa00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 0x7fe46c115e00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe458002a50 tx=0x7fe4580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.312+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe458007cc0 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.312+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe45800f040 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.312+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45800da30 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.312+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c10fd30 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.312+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c110220 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.313+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c071a40 con 0x7fe46c070c10 2024-04-03T08:52:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.314+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe45800dbb0 con 0x7fe46c070c10 2024-04-03T08:52:10.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.315+0000 7fe463400700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe45006d7f0 0x7fe45006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:10.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.315+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fe45808ce80 con 0x7fe46c070c10 2024-04-03T08:52:10.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.315+0000 7fe46b400700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe45006d7f0 0x7fe45006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:10.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.316+0000 7fe46b400700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe45006d7f0 0x7fe45006fca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009fd0 tx=0x7fe45c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:10.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.320+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe458059fe0 con 0x7fe46c070c10 2024-04-03T08:52:10.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.571+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fe46c10be60 con 0x7fe46c070c10 2024-04-03T08:52:10.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.571+0000 7fe463400700 1 -- 172.21.15.157:0/764628944 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+4163 (secure 0 0 0) 0x7fe458059b70 con 0x7fe46c070c10 2024-04-03T08:52:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:10.572 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:18.251406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe45006d7f0 msgr2=0x7fe45006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe45006d7f0 0x7fe45006fca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009fd0 tx=0x7fe45c009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 msgr2=0x7fe46c115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 0x7fe46c115e00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe458002a50 tx=0x7fe4580046b0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 shutdown_connections 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fe45006d7f0 0x7fe45006fca0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe46c070300 0x7fe46c1158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 --2- 172.21.15.157:0/764628944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe46c070c10 0x7fe46c115e00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 >> 172.21.15.157:0/764628944 conn(0x7fe46c0f86e0 msgr2=0x7fe46c0f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:10.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 shutdown_connections 2024-04-03T08:52:10.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.574+0000 7fe470c00700 1 -- 172.21.15.157:0/764628944 wait complete. 2024-04-03T08:52:10.576 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 29 2024-04-03T08:52:10.592 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-03T08:52:10.592 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 -- 172.21.15.157:0/2510637992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 msgr2=0x7f97b41030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 --2- 172.21.15.157:0/2510637992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b41030a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f97a8004940 tx=0x7f97a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 -- 172.21.15.157:0/2510637992 shutdown_connections 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 --2- 172.21.15.157:0/2510637992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b4103670 0x7f97b40fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 --2- 172.21.15.157:0/2510637992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b41030a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 -- 172.21.15.157:0/2510637992 >> 172.21.15.157:0/2510637992 conn(0x7f97b40f8820 msgr2=0x7f97b40fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 -- 172.21.15.157:0/2510637992 shutdown_connections 2024-04-03T08:52:10.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.782+0000 7f97bb800700 1 -- 172.21.15.157:0/2510637992 wait complete. 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.783+0000 7f97bb800700 1 Processor -- start 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.783+0000 7f97bb800700 1 -- start start 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97bb800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97bb800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b4103670 0x7f97b4070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97bb800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4072210 con 0x7f97b4102cd0 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97bb800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4070d40 con 0x7f97b4103670 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97b8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97b8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b40702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34958/0 (socket says 172.21.15.157:34958) 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.784+0000 7f97b8e00700 1 -- 172.21.15.157:0/2848893303 learned_addr learned my addr 172.21.15.157:0/2848893303 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b8e00700 1 -- 172.21.15.157:0/2848893303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b4103670 msgr2=0x7f97b4070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b8e00700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b4103670 0x7f97b4070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:10.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b8e00700 1 -- 172.21.15.157:0/2848893303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8005040 con 0x7f97b4102cd0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b8e00700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b40702c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009180 tx=0x7f97a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a800e040 con 0x7f97b4102cd0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97a800bbc0 con 0x7f97b4102cd0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b4070fc0 con 0x7f97b4102cd0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a801c630 con 0x7f97b4102cd0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.785+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b4119ff0 con 0x7f97b4102cd0 2024-04-03T08:52:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.786+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b40fe420 con 0x7f97b4102cd0 2024-04-03T08:52:10.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.787+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f97a800bd30 con 0x7f97b4102cd0 2024-04-03T08:52:10.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.788+0000 7f97b0c00700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f979c06d7e0 0x7f979c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:10.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.789+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f97a808e4a0 con 0x7f97b4102cd0 2024-04-03T08:52:10.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.789+0000 7f97b3e00700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f979c06d7e0 0x7f979c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:10.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.789+0000 7f97b3e00700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f979c06d7e0 0x7f979c06fc90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f97b40719f0 tx=0x7f97a0009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:10.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:10.793+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f97a8057b50 con 0x7f97b4102cd0 2024-04-03T08:52:10.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:10 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3995257464' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-03T08:52:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:10 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2854771506' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-03T08:52:10.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:10 smithi157 ceph-mon[117693]: pgmap v334: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:10.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:10 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3995257464' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-03T08:52:10.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:10 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2854771506' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-03T08:52:10.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:10 smithi181 ceph-mon[101094]: pgmap v334: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:11.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.050+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f97b4064970 con 0x7f97b4102cd0 2024-04-03T08:52:11.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.051+0000 7f97b0c00700 1 -- 172.21.15.157:0/2848893303 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+4160 (secure 0 0 0) 0x7f97a805b210 con 0x7f97b4102cd0 2024-04-03T08:52:11.051 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:11.051 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:19.247366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:11.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f979c06d7e0 msgr2=0x7f979c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f979c06d7e0 0x7f979c06fc90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f97b40719f0 tx=0x7f97a0009ce0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 msgr2=0x7f97b40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b40702c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009180 tx=0x7f97a8009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 shutdown_connections 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f979c06d7e0 0x7f979c06fc90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97b4102cd0 0x7f97b40702c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 --2- 172.21.15.157:0/2848893303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b4103670 0x7f97b4070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 >> 172.21.15.157:0/2848893303 conn(0x7f97b40f8820 msgr2=0x7f97b40f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 shutdown_connections 2024-04-03T08:52:11.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.053+0000 7f97bb800700 1 -- 172.21.15.157:0/2848893303 wait complete. 2024-04-03T08:52:11.055 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 30 2024-04-03T08:52:11.071 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-03T08:52:11.071 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-03T08:52:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 -- 172.21.15.157:0/2615400245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0102ce0 msgr2=0x7fcec01030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 --2- 172.21.15.157:0/2615400245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0102ce0 0x7fcec01030b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fceb0004940 tx=0x7fceb0009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 -- 172.21.15.157:0/2615400245 shutdown_connections 2024-04-03T08:52:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 --2- 172.21.15.157:0/2615400245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0103680 0x7fcec00fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 --2- 172.21.15.157:0/2615400245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0102ce0 0x7fcec01030b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 -- 172.21.15.157:0/2615400245 >> 172.21.15.157:0/2615400245 conn(0x7fcec00f8830 msgr2=0x7fcec00fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 -- 172.21.15.157:0/2615400245 shutdown_connections 2024-04-03T08:52:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.262+0000 7fcec5c00700 1 -- 172.21.15.157:0/2615400245 wait complete. 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcec5c00700 1 Processor -- start 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcec5c00700 1 -- start start 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcec5c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0102ce0 0x7fcec0115af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcec5c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 0x7fcec0116030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcec5c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec0116680 con 0x7fcec0103680 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcec5c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec010fc60 con 0x7fcec0102ce0 2024-04-03T08:52:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcebe000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 0x7fcec0116030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcebe000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 0x7fcec0116030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34972/0 (socket says 172.21.15.157:34972) 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.263+0000 7fcebe000700 1 -- 172.21.15.157:0/3179425349 learned_addr learned my addr 172.21.15.157:0/3179425349 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcebea00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0102ce0 0x7fcec0115af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcebe000700 1 -- 172.21.15.157:0/3179425349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0102ce0 msgr2=0x7fcec0115af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcebe000700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0102ce0 0x7fcec0115af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcebe000700 1 -- 172.21.15.157:0/3179425349 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0005040 con 0x7fcec0103680 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcebea00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0102ce0 0x7fcec0115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcebe000700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 0x7fcec0116030 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fceac002a50 tx=0x7fceac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceac007cc0 con 0x7fcec0103680 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fceac00f040 con 0x7fcec0103680 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec010ff40 con 0x7fcec0103680 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceac00daf0 con 0x7fcec0103680 2024-04-03T08:52:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.264+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec0110500 con 0x7fcec0103680 2024-04-03T08:52:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.265+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec00fe430 con 0x7fcec0103680 2024-04-03T08:52:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.267+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fceac009810 con 0x7fcec0103680 2024-04-03T08:52:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.267+0000 7fceb6a00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcea406d7e0 0x7fcea406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.267+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fceac08ce70 con 0x7fcec0103680 2024-04-03T08:52:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.268+0000 7fcebea00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcea406d7e0 0x7fcea406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.268+0000 7fcebea00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcea406d7e0 0x7fcea406fc90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fceb0004560 tx=0x7fceb0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:11.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.272+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fceac059fd0 con 0x7fcec0103680 2024-04-03T08:52:11.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.525+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fcec0064970 con 0x7fcec0103680 2024-04-03T08:52:11.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.526+0000 7fceb6a00700 1 -- 172.21.15.157:0/3179425349 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+4160 (secure 0 0 0) 0x7fceac059b60 con 0x7fcec0103680 2024-04-03T08:52:11.527 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:11.527 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:20.317409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcea406d7e0 msgr2=0x7fcea406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcea406d7e0 0x7fcea406fc90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fceb0004560 tx=0x7fceb0009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 msgr2=0x7fcec0116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 0x7fcec0116030 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fceac002a50 tx=0x7fceac004600 comp rx=0 tx=0).stop 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 shutdown_connections 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7fcea406d7e0 0x7fcea406fc90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec0102ce0 0x7fcec0115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 --2- 172.21.15.157:0/3179425349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec0103680 0x7fcec0116030 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 >> 172.21.15.157:0/3179425349 conn(0x7fcec00f8830 msgr2=0x7fcec00f97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:11.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 shutdown_connections 2024-04-03T08:52:11.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.529+0000 7fcec5c00700 1 -- 172.21.15.157:0/3179425349 wait complete. 2024-04-03T08:52:11.530 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 31 2024-04-03T08:52:11.547 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-03T08:52:11.547 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-03T08:52:11.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 -- 172.21.15.157:0/2769428721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc102ce0 msgr2=0x7f85cc1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 --2- 172.21.15.157:0/2769428721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc102ce0 0x7f85cc1030b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f85c0004940 tx=0x7f85c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:11.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 -- 172.21.15.157:0/2769428721 shutdown_connections 2024-04-03T08:52:11.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 --2- 172.21.15.157:0/2769428721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85cc103680 0x7f85cc0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 --2- 172.21.15.157:0/2769428721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc102ce0 0x7f85cc1030b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 -- 172.21.15.157:0/2769428721 >> 172.21.15.157:0/2769428721 conn(0x7f85cc0f8830 msgr2=0x7f85cc0fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:11.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 -- 172.21.15.157:0/2769428721 shutdown_connections 2024-04-03T08:52:11.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.738+0000 7f85d3e00700 1 -- 172.21.15.157:0/2769428721 wait complete. 2024-04-03T08:52:11.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d3e00700 1 Processor -- start 2024-04-03T08:52:11.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d3e00700 1 -- start start 2024-04-03T08:52:11.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85cc102ce0 0x7f85cc115ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:11.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 0x7f85cc115ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d3e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc116640 con 0x7f85cc103680 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc10fc20 con 0x7f85cc102ce0 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d0a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 0x7f85cc115ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d0a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 0x7f85cc115ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34994/0 (socket says 172.21.15.157:34994) 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.739+0000 7f85d0a00700 1 -- 172.21.15.157:0/3159658334 learned_addr learned my addr 172.21.15.157:0/3159658334 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d1400700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85cc102ce0 0x7f85cc115ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d0a00700 1 -- 172.21.15.157:0/3159658334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85cc102ce0 msgr2=0x7f85cc115ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d0a00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85cc102ce0 0x7f85cc115ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:11.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d0a00700 1 -- 172.21.15.157:0/3159658334 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0005040 con 0x7f85cc103680 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d0a00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 0x7f85cc115ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85b8002a50 tx=0x7f85b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b8007cc0 con 0x7f85cc103680 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85b800f040 con 0x7f85cc103680 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc10ff00 con 0x7f85cc103680 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b800da40 con 0x7f85cc103680 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.740+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc1104c0 con 0x7f85cc103680 2024-04-03T08:52:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.741+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc0fe430 con 0x7f85cc103680 2024-04-03T08:52:11.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.742+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f85b80097c0 con 0x7f85cc103680 2024-04-03T08:52:11.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.744+0000 7f85c9600700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f85b406d7e0 0x7f85b406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:11.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.744+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f85b808ced0 con 0x7f85cc103680 2024-04-03T08:52:11.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.744+0000 7f85d1400700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f85b406d7e0 0x7f85b406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:11.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.745+0000 7f85d1400700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f85b406d7e0 0x7f85b406fc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f85c000b3b0 tx=0x7f85c0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:11.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.748+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f85b8059da0 con 0x7f85cc103680 2024-04-03T08:52:11.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:11 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/764628944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-03T08:52:11.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:11 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/2848893303' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-03T08:52:11.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:11 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/764628944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-03T08:52:11.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:11 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/2848893303' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-03T08:52:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.996+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f85cc109de0 con 0x7f85cc103680 2024-04-03T08:52:11.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.997+0000 7f85c9600700 1 -- 172.21.15.157:0/3159658334 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+4973 (secure 0 0 0) 0x7f85b8059bc0 con 0x7f85cc103680 2024-04-03T08:52:11.997 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:11.997 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/4016903388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":4016903388},{"type":"v1","addr":"172.21.15.181:6827","nonce":4016903388}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44387,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/397415286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":397415286},{"type":"v1","addr":"172.21.15.181:6825","nonce":397415286}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:20.317409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.999+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f85b406d7e0 msgr2=0x7f85b406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.999+0000 7f85d3e00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f85b406d7e0 0x7f85b406fc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f85c000b3b0 tx=0x7f85c0009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.999+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 msgr2=0x7f85cc115ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:11.999+0000 7f85d3e00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 0x7f85cc115ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85b8002a50 tx=0x7f85b8004600 comp rx=0 tx=0).stop 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 shutdown_connections 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f85b406d7e0 0x7f85b406fc90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85cc102ce0 0x7f85cc115ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 --2- 172.21.15.157:0/3159658334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85cc103680 0x7f85cc115ff0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 >> 172.21.15.157:0/3159658334 conn(0x7f85cc0f8830 msgr2=0x7f85cc071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:12.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 shutdown_connections 2024-04-03T08:52:12.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.000+0000 7f85d3e00700 1 -- 172.21.15.157:0/3159658334 wait complete. 2024-04-03T08:52:12.001 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 32 2024-04-03T08:52:12.017 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-03T08:52:12.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-03T08:52:12.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.207+0000 7f2f6bc00700 1 -- 172.21.15.157:0/2508772132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 msgr2=0x7f2f640fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.207+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/2508772132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f640fcce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f50004940 tx=0x7f2f50009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:12.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.208+0000 7f2f6bc00700 1 -- 172.21.15.157:0/2508772132 shutdown_connections 2024-04-03T08:52:12.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.208+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/2508772132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f640fcce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.208+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/2508772132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f64102cd0 0x7f2f641030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.208+0000 7f2f6bc00700 1 -- 172.21.15.157:0/2508772132 >> 172.21.15.157:0/2508772132 conn(0x7f2f640f8820 msgr2=0x7f2f640fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:12.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.208+0000 7f2f6bc00700 1 -- 172.21.15.157:0/2508772132 shutdown_connections 2024-04-03T08:52:12.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.208+0000 7f2f6bc00700 1 -- 172.21.15.157:0/2508772132 wait complete. 2024-04-03T08:52:12.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.209+0000 7f2f6bc00700 1 Processor -- start 2024-04-03T08:52:12.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.209+0000 7f2f6bc00700 1 -- start start 2024-04-03T08:52:12.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.209+0000 7f2f6bc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f64102cd0 0x7f2f640702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.209+0000 7f2f6bc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f64070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.209+0000 7f2f6bc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64072260 con 0x7f2f64103670 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f6bc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64070d40 con 0x7f2f64102cd0 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f64070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f64070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35012/0 (socket says 172.21.15.157:35012) 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 -- 172.21.15.157:0/1294008770 learned_addr learned my addr 172.21.15.157:0/1294008770 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f69200700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f64102cd0 0x7f2f640702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 -- 172.21.15.157:0/1294008770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f64102cd0 msgr2=0x7f2f640702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f64102cd0 0x7f2f640702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 -- 172.21.15.157:0/1294008770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50005040 con 0x7f2f64103670 2024-04-03T08:52:12.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.210+0000 7f2f63e00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f64070800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009100 tx=0x7f2f50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:12.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.211+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f5000e040 con 0x7f2f64103670 2024-04-03T08:52:12.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.211+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f50013420 con 0x7f2f64103670 2024-04-03T08:52:12.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.211+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64070f90 con 0x7f2f64103670 2024-04-03T08:52:12.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.211+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f5001c630 con 0x7f2f64103670 2024-04-03T08:52:12.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.211+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f64119fb0 con 0x7f2f64103670 2024-04-03T08:52:12.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.212+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f640fe420 con 0x7f2f64103670 2024-04-03T08:52:12.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.213+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2f50013a00 con 0x7f2f64103670 2024-04-03T08:52:12.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.214+0000 7f2f60c00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2f4c06d7e0 0x7f2f4c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:12.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.214+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f2f5008e200 con 0x7f2f64103670 2024-04-03T08:52:12.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.214+0000 7f2f69200700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2f4c06d7e0 0x7f2f4c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:12.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.215+0000 7f2f69200700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2f4c06d7e0 0x7f2f4c06fc90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f58004f40 tx=0x7f2f5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:12.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.219+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2f500578b0 con 0x7f2f64103670 2024-04-03T08:52:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.475+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f2f64109e40 con 0x7f2f64103670 2024-04-03T08:52:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.475+0000 7f2f60c00700 1 -- 172.21.15.157:0/1294008770 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+4191 (secure 0 0 0) 0x7f2f5005af70 con 0x7f2f64103670 2024-04-03T08:52:12.476 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:12.476 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44387,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/397415286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":397415286},{"type":"v1","addr":"172.21.15.181:6825","nonce":397415286}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:20.317409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:12.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2f4c06d7e0 msgr2=0x7f2f4c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2f4c06d7e0 0x7f2f4c06fc90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f58004f40 tx=0x7f2f5800b040 comp rx=0 tx=0).stop 2024-04-03T08:52:12.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 msgr2=0x7f2f64070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f64070800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009100 tx=0x7f2f50009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 shutdown_connections 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f2f4c06d7e0 0x7f2f4c06fc90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f64102cd0 0x7f2f640702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 --2- 172.21.15.157:0/1294008770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f64103670 0x7f2f64070800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 >> 172.21.15.157:0/1294008770 conn(0x7f2f640f8820 msgr2=0x7f2f640f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 shutdown_connections 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.478+0000 7f2f6bc00700 1 -- 172.21.15.157:0/1294008770 wait complete. 2024-04-03T08:52:12.479 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 33 2024-04-03T08:52:12.496 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-03T08:52:12.496 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-03T08:52:12.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 -- 172.21.15.157:0/389425500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 msgr2=0x7f61881030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 --2- 172.21.15.157:0/389425500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f61881030b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6178004940 tx=0x7f6178009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 -- 172.21.15.157:0/389425500 shutdown_connections 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 --2- 172.21.15.157:0/389425500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6188103680 0x7f6188064e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 --2- 172.21.15.157:0/389425500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f61881030b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 -- 172.21.15.157:0/389425500 >> 172.21.15.157:0/389425500 conn(0x7f6188072ad0 msgr2=0x7f6188072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 -- 172.21.15.157:0/389425500 shutdown_connections 2024-04-03T08:52:12.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.685+0000 7f618cc00700 1 -- 172.21.15.157:0/389425500 wait complete. 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.686+0000 7f618cc00700 1 Processor -- start 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.686+0000 7f618cc00700 1 -- start start 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.686+0000 7f618cc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f6188115a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.686+0000 7f618cc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6188103680 0x7f6188115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.686+0000 7f618cc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61881165c0 con 0x7f6188102ce0 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.686+0000 7f618cc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618810fba0 con 0x7f6188103680 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f6188115a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:12.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f6188115a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50602/0 (socket says 172.21.15.157:50602) 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 -- 172.21.15.157:0/3528007676 learned_addr learned my addr 172.21.15.157:0/3528007676 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 -- 172.21.15.157:0/3528007676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6188103680 msgr2=0x7f6188115f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6188103680 0x7f6188115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 -- 172.21.15.157:0/3528007676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178005040 con 0x7f6188102ce0 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.687+0000 7f6185e00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f6188115a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f61780090d0 tx=0x7f6178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.688+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6178021070 con 0x7f6188102ce0 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.688+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618810fe20 con 0x7f6188102ce0 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.688+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6178013c00 con 0x7f6188102ce0 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.688+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617800e070 con 0x7f6188102ce0 2024-04-03T08:52:12.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.688+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6188110380 con 0x7f6188102ce0 2024-04-03T08:52:12.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.689+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61881061e0 con 0x7f6188102ce0 2024-04-03T08:52:12.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.690+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f617801c400 con 0x7f6188102ce0 2024-04-03T08:52:12.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.690+0000 7f617e000700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f616c06d7e0 0x7f616c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-03T08:52:12.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.691+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f617808e610 con 0x7f6188102ce0 2024-04-03T08:52:12.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.691+0000 7f6185400700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f616c06d7e0 0x7f616c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-03T08:52:12.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.691+0000 7f6185400700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f616c06d7e0 0x7f616c06fc90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61881112d0 tx=0x7f617400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-03T08:52:12.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.695+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f617805b7f0 con 0x7f6188102ce0 2024-04-03T08:52:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:12 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3179425349' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-03T08:52:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:12 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3159658334' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-03T08:52:12.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:12 smithi157 ceph-mon[117693]: pgmap v335: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:12.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:12 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3179425349' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-03T08:52:12.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:12 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3159658334' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-03T08:52:12.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:12 smithi181 ceph-mon[101094]: pgmap v335: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:12.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.944+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f6188109de0 con 0x7f6188102ce0 2024-04-03T08:52:12.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.944+0000 7f617e000700 1 -- 172.21.15.157:0/3528007676 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5007 (secure 0 0 0) 0x7f617805b380 con 0x7f6188102ce0 2024-04-03T08:52:12.945 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-03T08:52:12.945 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi157.zlscrk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6829/3713439564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3713439564},{"type":"v1","addr":"172.21.15.157:6829","nonce":3713439564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":44387,"name":"cephfs.smithi181.ecaerp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6825/397415286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":397415286},{"type":"v1","addr":"172.21.15.181:6825","nonce":397415286}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44391,"name":"cephfs.smithi181.wksnwz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6827/3661110481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3661110481},{"type":"v1","addr":"172.21.15.181:6827","nonce":3661110481}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-03T08:35:52.239154+0000","modified":"2024-04-03T08:48:20.317409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi157.sodwui","rank":0,"incarnation":28,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6827/1983788696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1983788696},{"type":"v1","addr":"172.21.15.157:6827","nonce":1983788696}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-03T08:52:12.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f616c06d7e0 msgr2=0x7f616c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f616c06d7e0 0x7f616c06fc90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61881112d0 tx=0x7f617400b040 comp rx=0 tx=0).stop 2024-04-03T08:52:12.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 msgr2=0x7f6188115a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-03T08:52:12.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f6188115a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f61780090d0 tx=0x7f6178009e30 comp rx=0 tx=0).stop 2024-04-03T08:52:12.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 shutdown_connections 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:6800/3953350514,v1:172.21.15.157:6801/3953350514] conn(0x7f616c06d7e0 0x7f616c06fc90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6188102ce0 0x7f6188115a30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 --2- 172.21.15.157:0/3528007676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6188103680 0x7f6188115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 >> 172.21.15.157:0/3528007676 conn(0x7f6188072ad0 msgr2=0x7f61880fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 shutdown_connections 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-03T08:52:12.947+0000 7f618cc00700 1 -- 172.21.15.157:0/3528007676 wait complete. 2024-04-03T08:52:12.948 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 34 2024-04-03T08:52:12.966 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-04-03T08:52:12.967 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-03T08:52:12.980 INFO:tasks.ceph_fuse:Not unmounting ceph-fuse clients (hack)... 2024-04-03T08:52:13.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:13 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/1294008770' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-03T08:52:13.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:13 smithi157 ceph-mon[117693]: from='client.? 172.21.15.157:0/3528007676' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-03T08:52:13.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:13 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/1294008770' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-03T08:52:13.847 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:13 smithi181 ceph-mon[101094]: from='client.? 172.21.15.157:0/3528007676' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-03T08:52:14.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:14.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:14 smithi157 ceph-mon[117693]: pgmap v336: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:14.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:14.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:14 smithi181 ceph-mon[101094]: pgmap v336: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:17.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:17 smithi181 ceph-mon[101094]: pgmap v337: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:17.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:17 smithi157 ceph-mon[117693]: pgmap v337: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:18.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:18 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:52:18.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:18 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:52:19.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:19 smithi181 ceph-mon[101094]: pgmap v338: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:19.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:52:19.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:19 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:52:19.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:19 smithi157 ceph-mon[117693]: pgmap v338: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:19.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:52:19.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:19 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:52:20.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:52:20.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:52:20.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:52:20.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:52:20.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:52:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:52:21.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:21 smithi181 ceph-mon[101094]: pgmap v339: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:21.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:21 smithi157 ceph-mon[117693]: pgmap v339: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:23.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:23 smithi157 ceph-mon[117693]: pgmap v340: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:23.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:23 smithi181 ceph-mon[101094]: pgmap v340: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:25.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:25 smithi157 ceph-mon[117693]: pgmap v341: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:25.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:25 smithi181 ceph-mon[101094]: pgmap v341: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:27.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:27 smithi157 ceph-mon[117693]: pgmap v342: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:27.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:27 smithi181 ceph-mon[101094]: pgmap v342: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:29.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:29 smithi157 ceph-mon[117693]: pgmap v343: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:29.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:29.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:29 smithi181 ceph-mon[101094]: pgmap v343: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:29.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:31.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:31 smithi157 ceph-mon[117693]: pgmap v344: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:31.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:31 smithi181 ceph-mon[101094]: pgmap v344: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:33.727 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:33 smithi157 ceph-mon[117693]: pgmap v345: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:33.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:33 smithi181 ceph-mon[101094]: pgmap v345: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:35.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:35 smithi157 ceph-mon[117693]: pgmap v346: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:35.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:35 smithi181 ceph-mon[101094]: pgmap v346: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:37.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:37 smithi157 ceph-mon[117693]: pgmap v347: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:37.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:37 smithi181 ceph-mon[101094]: pgmap v347: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:39.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:39 smithi157 ceph-mon[117693]: pgmap v348: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:39.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:39 smithi181 ceph-mon[101094]: pgmap v348: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:41.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:41 smithi157 ceph-mon[117693]: pgmap v349: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:41.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:41 smithi181 ceph-mon[101094]: pgmap v349: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:43.726 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:43 smithi157 ceph-mon[117693]: pgmap v350: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:43.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:43 smithi181 ceph-mon[101094]: pgmap v350: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:44.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:44.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:45.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:45 smithi157 ceph-mon[117693]: pgmap v351: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:45.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:45 smithi181 ceph-mon[101094]: pgmap v351: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:47.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:47 smithi157 ceph-mon[117693]: pgmap v352: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:47.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:47 smithi181 ceph-mon[101094]: pgmap v352: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:49.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:49 smithi157 ceph-mon[117693]: pgmap v353: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:49.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:49 smithi181 ceph-mon[101094]: pgmap v353: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:51.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:51 smithi157 ceph-mon[117693]: pgmap v354: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:51.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:51 smithi181 ceph-mon[101094]: pgmap v354: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:53.726 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:53 smithi157 ceph-mon[117693]: pgmap v355: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:53.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:53 smithi181 ceph-mon[101094]: pgmap v355: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:55.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:55 smithi157 ceph-mon[117693]: pgmap v356: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:55.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:55 smithi181 ceph-mon[101094]: pgmap v356: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:52:57.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:57 smithi157 ceph-mon[117693]: pgmap v357: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:57.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:57 smithi181 ceph-mon[101094]: pgmap v357: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:52:59.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:59 smithi157 ceph-mon[117693]: pgmap v358: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:59.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:52:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:52:59.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:59 smithi181 ceph-mon[101094]: pgmap v358: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:52:59.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:52:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:01.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:01 smithi157 ceph-mon[117693]: pgmap v359: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:01.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:01 smithi181 ceph-mon[101094]: pgmap v359: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:03.725 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:03 smithi157 ceph-mon[117693]: pgmap v360: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:03.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:03 smithi181 ceph-mon[101094]: pgmap v360: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:05.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:05 smithi157 ceph-mon[117693]: pgmap v361: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:05.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:05 smithi181 ceph-mon[101094]: pgmap v361: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:07.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:07 smithi157 ceph-mon[117693]: pgmap v362: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:07.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:07 smithi181 ceph-mon[101094]: pgmap v362: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:09.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:09 smithi157 ceph-mon[117693]: pgmap v363: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:09.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:09 smithi181 ceph-mon[101094]: pgmap v363: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:10.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:10 smithi157 ceph-mon[117693]: pgmap v364: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:10.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:10 smithi181 ceph-mon[101094]: pgmap v364: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:13.725 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:13 smithi157 ceph-mon[117693]: pgmap v365: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:13.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:13 smithi181 ceph-mon[101094]: pgmap v365: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:14.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:14.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:15.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:15 smithi157 ceph-mon[117693]: pgmap v366: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:15.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:15 smithi181 ceph-mon[101094]: pgmap v366: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:17.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:17 smithi157 ceph-mon[117693]: pgmap v367: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:17.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:17 smithi181 ceph-mon[101094]: pgmap v367: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:19.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:19 smithi157 ceph-mon[117693]: pgmap v368: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:19.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:19 smithi181 ceph-mon[101094]: pgmap v368: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:20.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:20 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:53:20.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:20 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:53:21.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:21 smithi157 ceph-mon[117693]: pgmap v369: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:21.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:21 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:53:21.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:21 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:53:21.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:21 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:53:21.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:21 smithi181 ceph-mon[101094]: pgmap v369: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:21.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:21 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:53:21.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:21 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:53:21.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:21 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:53:23.725 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:23 smithi157 ceph-mon[117693]: pgmap v370: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:23.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:23 smithi181 ceph-mon[101094]: pgmap v370: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:25.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:25 smithi157 ceph-mon[117693]: pgmap v371: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:25.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:25 smithi181 ceph-mon[101094]: pgmap v371: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:27.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:27 smithi157 ceph-mon[117693]: pgmap v372: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:27.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:27 smithi181 ceph-mon[101094]: pgmap v372: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:29.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:29 smithi157 ceph-mon[117693]: pgmap v373: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:53:29.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:29.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:29 smithi181 ceph-mon[101094]: pgmap v373: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:53:29.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:31.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:31 smithi157 ceph-mon[117693]: pgmap v374: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:31.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:31 smithi181 ceph-mon[101094]: pgmap v374: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:33.724 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:33 smithi157 ceph-mon[117693]: pgmap v375: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:53:33.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:33 smithi181 ceph-mon[101094]: pgmap v375: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:53:35.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:35 smithi157 ceph-mon[117693]: pgmap v376: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:35.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:35 smithi181 ceph-mon[101094]: pgmap v376: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:37.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:37 smithi157 ceph-mon[117693]: pgmap v377: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:37.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:37 smithi181 ceph-mon[101094]: pgmap v377: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:39.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:39 smithi157 ceph-mon[117693]: pgmap v378: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:39.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:39 smithi181 ceph-mon[101094]: pgmap v378: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:41.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:41 smithi157 ceph-mon[117693]: pgmap v379: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:41.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:41 smithi181 ceph-mon[101094]: pgmap v379: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:43.724 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:43 smithi157 ceph-mon[117693]: pgmap v380: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:43.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:43 smithi181 ceph-mon[101094]: pgmap v380: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:44.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:44.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:45.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:45 smithi157 ceph-mon[117693]: pgmap v381: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:45.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:45 smithi181 ceph-mon[101094]: pgmap v381: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:47.699 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:47 smithi157 ceph-mon[117693]: pgmap v382: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:47.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:47 smithi181 ceph-mon[101094]: pgmap v382: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:49.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:49 smithi157 ceph-mon[117693]: pgmap v383: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:49.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:49 smithi181 ceph-mon[101094]: pgmap v383: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:51.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:51 smithi157 ceph-mon[117693]: pgmap v384: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:51.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:51 smithi181 ceph-mon[101094]: pgmap v384: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:53.724 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:53 smithi157 ceph-mon[117693]: pgmap v385: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:53.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:53 smithi181 ceph-mon[101094]: pgmap v385: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:55.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:55 smithi157 ceph-mon[117693]: pgmap v386: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:55.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:55 smithi181 ceph-mon[101094]: pgmap v386: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:53:56.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:56 smithi157 ceph-mon[117693]: pgmap v387: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:56.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:56 smithi181 ceph-mon[101094]: pgmap v387: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:53:59.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:59 smithi157 ceph-mon[117693]: pgmap v388: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:59.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:53:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:53:59.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:59 smithi181 ceph-mon[101094]: pgmap v388: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:53:59.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:53:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:01.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:01 smithi157 ceph-mon[117693]: pgmap v389: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:01.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:01 smithi181 ceph-mon[101094]: pgmap v389: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:03.724 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:03 smithi157 ceph-mon[117693]: pgmap v390: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:03.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:03 smithi181 ceph-mon[101094]: pgmap v390: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:05.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:05 smithi157 ceph-mon[117693]: pgmap v391: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:05.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:05 smithi181 ceph-mon[101094]: pgmap v391: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:07.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:07 smithi157 ceph-mon[117693]: pgmap v392: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:07.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:07 smithi181 ceph-mon[101094]: pgmap v392: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:09.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:09 smithi157 ceph-mon[117693]: pgmap v393: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:09.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:09 smithi181 ceph-mon[101094]: pgmap v393: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:11.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:11 smithi157 ceph-mon[117693]: pgmap v394: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:11.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:11 smithi181 ceph-mon[101094]: pgmap v394: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:13.723 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:13 smithi157 ceph-mon[117693]: pgmap v395: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:13.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:13 smithi181 ceph-mon[101094]: pgmap v395: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:14.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:14.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:15.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:15 smithi157 ceph-mon[117693]: pgmap v396: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:15.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:15 smithi181 ceph-mon[101094]: pgmap v396: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:17.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:17 smithi157 ceph-mon[117693]: pgmap v397: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:17.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:17 smithi181 ceph-mon[101094]: pgmap v397: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:19.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:19 smithi157 ceph-mon[117693]: pgmap v398: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:19.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:19 smithi181 ceph-mon[101094]: pgmap v398: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:21.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:21 smithi157 ceph-mon[117693]: pgmap v399: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:21.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:21 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:54:21.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:21 smithi181 ceph-mon[101094]: pgmap v399: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:21.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:21 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:54:22.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:54:22.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:54:22.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:54:22.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:54:22.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:54:22.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:54:23.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:23 smithi157 ceph-mon[117693]: pgmap v400: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:54:23.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:23 smithi181 ceph-mon[101094]: pgmap v400: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:54:25.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:25 smithi157 ceph-mon[117693]: pgmap v401: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:54:25.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:25 smithi181 ceph-mon[101094]: pgmap v401: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:54:27.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:27 smithi157 ceph-mon[117693]: pgmap v402: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:54:27.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:27 smithi181 ceph-mon[101094]: pgmap v402: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:54:29.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:29 smithi157 ceph-mon[117693]: pgmap v403: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:54:29.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:29.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:29 smithi181 ceph-mon[101094]: pgmap v403: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:54:29.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:31.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:31 smithi157 ceph-mon[117693]: pgmap v404: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:54:31.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:31 smithi181 ceph-mon[101094]: pgmap v404: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T08:54:33.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:33 smithi157 ceph-mon[117693]: pgmap v405: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:54:33.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:33 smithi181 ceph-mon[101094]: pgmap v405: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T08:54:35.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:35 smithi157 ceph-mon[117693]: pgmap v406: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:35.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:35 smithi181 ceph-mon[101094]: pgmap v406: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:37.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:37 smithi157 ceph-mon[117693]: pgmap v407: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:37.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:37 smithi181 ceph-mon[101094]: pgmap v407: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:39.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:39 smithi157 ceph-mon[117693]: pgmap v408: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:39.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:39 smithi181 ceph-mon[101094]: pgmap v408: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:41.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:41 smithi157 ceph-mon[117693]: pgmap v409: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:41.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:41 smithi181 ceph-mon[101094]: pgmap v409: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:43.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:43 smithi157 ceph-mon[117693]: pgmap v410: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:43.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:43 smithi181 ceph-mon[101094]: pgmap v410: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:44.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:44.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:45.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:45 smithi157 ceph-mon[117693]: pgmap v411: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:45.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:45 smithi181 ceph-mon[101094]: pgmap v411: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:47.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:47 smithi157 ceph-mon[117693]: pgmap v412: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:47.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:47 smithi181 ceph-mon[101094]: pgmap v412: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:49.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:49 smithi157 ceph-mon[117693]: pgmap v413: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:49.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:49 smithi181 ceph-mon[101094]: pgmap v413: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:50.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:50 smithi157 ceph-mon[117693]: pgmap v414: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:50.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:50 smithi181 ceph-mon[101094]: pgmap v414: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:53.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:53 smithi157 ceph-mon[117693]: pgmap v415: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:53.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:53 smithi181 ceph-mon[101094]: pgmap v415: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:55.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:55 smithi157 ceph-mon[117693]: pgmap v416: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:55.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:55 smithi181 ceph-mon[101094]: pgmap v416: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:54:57.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:57 smithi157 ceph-mon[117693]: pgmap v417: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:57.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:57 smithi181 ceph-mon[101094]: pgmap v417: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:54:59.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:59 smithi157 ceph-mon[117693]: pgmap v418: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:59.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:54:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:54:59.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:59 smithi181 ceph-mon[101094]: pgmap v418: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:54:59.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:54:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:01.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:01 smithi157 ceph-mon[117693]: pgmap v419: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:01.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:01 smithi181 ceph-mon[101094]: pgmap v419: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:03.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:03 smithi157 ceph-mon[117693]: pgmap v420: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:03.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:03 smithi181 ceph-mon[101094]: pgmap v420: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:05.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:05 smithi157 ceph-mon[117693]: pgmap v421: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:05.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:05 smithi181 ceph-mon[101094]: pgmap v421: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:07.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:07 smithi157 ceph-mon[117693]: pgmap v422: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:07.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:07 smithi181 ceph-mon[101094]: pgmap v422: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:09.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:09 smithi157 ceph-mon[117693]: pgmap v423: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:09.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:09 smithi181 ceph-mon[101094]: pgmap v423: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:11.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:11 smithi157 ceph-mon[117693]: pgmap v424: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:11.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:11 smithi181 ceph-mon[101094]: pgmap v424: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:13.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:13 smithi157 ceph-mon[117693]: pgmap v425: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:13.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:13 smithi181 ceph-mon[101094]: pgmap v425: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:14.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:14.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:15.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:15 smithi157 ceph-mon[117693]: pgmap v426: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:15.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:15 smithi181 ceph-mon[101094]: pgmap v426: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:17.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:17 smithi157 ceph-mon[117693]: pgmap v427: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:17.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:17 smithi181 ceph-mon[101094]: pgmap v427: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:19.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:19 smithi157 ceph-mon[117693]: pgmap v428: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:19.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:19 smithi181 ceph-mon[101094]: pgmap v428: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:21.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:21 smithi157 ceph-mon[117693]: pgmap v429: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:21.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:21 smithi181 ceph-mon[101094]: pgmap v429: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:22.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:55:22.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:55:23.721 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:23 smithi157 ceph-mon[117693]: pgmap v430: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:23.721 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:55:23.721 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:55:23.721 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:55:23.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:23 smithi181 ceph-mon[101094]: pgmap v430: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:23.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:55:23.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:55:23.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:55:25.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:25 smithi157 ceph-mon[117693]: pgmap v431: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:25.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:25 smithi181 ceph-mon[101094]: pgmap v431: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:27.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:27 smithi157 ceph-mon[117693]: pgmap v432: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:27.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:27 smithi181 ceph-mon[101094]: pgmap v432: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:29.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:29 smithi157 ceph-mon[117693]: pgmap v433: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:29.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:29.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:29 smithi181 ceph-mon[101094]: pgmap v433: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:29.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:31.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:31 smithi157 ceph-mon[117693]: pgmap v434: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:31.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:31 smithi181 ceph-mon[101094]: pgmap v434: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:33.720 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:33 smithi157 ceph-mon[117693]: pgmap v435: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:33.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:33 smithi181 ceph-mon[101094]: pgmap v435: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:35.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:35 smithi157 ceph-mon[117693]: pgmap v436: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:35.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:35 smithi181 ceph-mon[101094]: pgmap v436: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:37.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:37 smithi157 ceph-mon[117693]: pgmap v437: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:37.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:37 smithi181 ceph-mon[101094]: pgmap v437: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:38.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:38 smithi157 ceph-mon[117693]: pgmap v438: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:38.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:38 smithi181 ceph-mon[101094]: pgmap v438: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:41.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:41 smithi157 ceph-mon[117693]: pgmap v439: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:41.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:41 smithi181 ceph-mon[101094]: pgmap v439: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:43.720 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:43 smithi157 ceph-mon[117693]: pgmap v440: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:43.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:43 smithi181 ceph-mon[101094]: pgmap v440: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:44.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:44.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:45.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:45 smithi157 ceph-mon[117693]: pgmap v441: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:45.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:45 smithi181 ceph-mon[101094]: pgmap v441: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:47.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:47 smithi157 ceph-mon[117693]: pgmap v442: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:47.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:47 smithi181 ceph-mon[101094]: pgmap v442: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:49.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:49 smithi157 ceph-mon[117693]: pgmap v443: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:49.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:49 smithi181 ceph-mon[101094]: pgmap v443: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:51.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:51 smithi157 ceph-mon[117693]: pgmap v444: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:51.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:51 smithi181 ceph-mon[101094]: pgmap v444: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:53.720 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:53 smithi157 ceph-mon[117693]: pgmap v445: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:53.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:53 smithi181 ceph-mon[101094]: pgmap v445: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:55.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:55 smithi157 ceph-mon[117693]: pgmap v446: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:55.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:55 smithi181 ceph-mon[101094]: pgmap v446: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:55:57.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:57 smithi157 ceph-mon[117693]: pgmap v447: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:57.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:57 smithi181 ceph-mon[101094]: pgmap v447: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:55:59.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:59 smithi157 ceph-mon[117693]: pgmap v448: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:59.807 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:55:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:55:59.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:59 smithi181 ceph-mon[101094]: pgmap v448: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:55:59.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:55:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:01.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:01 smithi157 ceph-mon[117693]: pgmap v449: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:01.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:01 smithi181 ceph-mon[101094]: pgmap v449: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:03.720 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:03 smithi157 ceph-mon[117693]: pgmap v450: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:03.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:03 smithi181 ceph-mon[101094]: pgmap v450: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:05.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:04 smithi157 ceph-mon[117693]: pgmap v451: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:05.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:04 smithi181 ceph-mon[101094]: pgmap v451: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:07.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:07 smithi157 ceph-mon[117693]: pgmap v452: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:07.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:07 smithi181 ceph-mon[101094]: pgmap v452: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:09.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:09 smithi157 ceph-mon[117693]: pgmap v453: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:09.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:09 smithi181 ceph-mon[101094]: pgmap v453: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:11.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:11 smithi157 ceph-mon[117693]: pgmap v454: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:11.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:11 smithi181 ceph-mon[101094]: pgmap v454: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:13.719 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:13 smithi157 ceph-mon[117693]: pgmap v455: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:13.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:13 smithi181 ceph-mon[101094]: pgmap v455: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:14.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:14.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:15.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:15 smithi157 ceph-mon[117693]: pgmap v456: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:15.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:15 smithi181 ceph-mon[101094]: pgmap v456: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:17.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:17 smithi157 ceph-mon[117693]: pgmap v457: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:17.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:17 smithi181 ceph-mon[101094]: pgmap v457: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:19.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:19 smithi157 ceph-mon[117693]: pgmap v458: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:19.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:19 smithi181 ceph-mon[101094]: pgmap v458: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:21.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:21 smithi157 ceph-mon[117693]: pgmap v459: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:21.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:21 smithi181 ceph-mon[101094]: pgmap v459: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:23.723 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:23 smithi157 ceph-mon[117693]: pgmap v460: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:23.723 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:56:23.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:23 smithi181 ceph-mon[101094]: pgmap v460: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:23.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:56:24.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:56:24.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:56:24.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:56:24.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:56:24.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:56:24.839 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:56:25.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:25 smithi157 ceph-mon[117693]: pgmap v461: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:25.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:25 smithi181 ceph-mon[101094]: pgmap v461: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:27.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:27 smithi157 ceph-mon[117693]: pgmap v462: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:27.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:27 smithi181 ceph-mon[101094]: pgmap v462: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:29.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:29 smithi157 ceph-mon[117693]: pgmap v463: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:29.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:29.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:29 smithi181 ceph-mon[101094]: pgmap v463: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:29.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:31.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:31 smithi157 ceph-mon[117693]: pgmap v464: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:31.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:31 smithi181 ceph-mon[101094]: pgmap v464: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:33.719 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:33 smithi157 ceph-mon[117693]: pgmap v465: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:33.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:33 smithi181 ceph-mon[101094]: pgmap v465: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:35.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:35 smithi157 ceph-mon[117693]: pgmap v466: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:35.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:35 smithi181 ceph-mon[101094]: pgmap v466: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:37.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:37 smithi157 ceph-mon[117693]: pgmap v467: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:37.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:37 smithi181 ceph-mon[101094]: pgmap v467: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:39.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:39 smithi157 ceph-mon[117693]: pgmap v468: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:39.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:39 smithi181 ceph-mon[101094]: pgmap v468: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:41.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:41 smithi157 ceph-mon[117693]: pgmap v469: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:41.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:41 smithi181 ceph-mon[101094]: pgmap v469: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:43.719 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:43 smithi157 ceph-mon[117693]: pgmap v470: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:43.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:43 smithi181 ceph-mon[101094]: pgmap v470: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:44.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:44.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:45.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:45 smithi157 ceph-mon[117693]: pgmap v471: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:45.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:45 smithi181 ceph-mon[101094]: pgmap v471: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:47.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:47 smithi157 ceph-mon[117693]: pgmap v472: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:47.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:47 smithi181 ceph-mon[101094]: pgmap v472: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:48.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:48 smithi157 ceph-mon[117693]: pgmap v473: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:48.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:48 smithi181 ceph-mon[101094]: pgmap v473: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:51.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:51 smithi157 ceph-mon[117693]: pgmap v474: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:51.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:51 smithi181 ceph-mon[101094]: pgmap v474: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:53.719 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:53 smithi157 ceph-mon[117693]: pgmap v475: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:53.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:53 smithi181 ceph-mon[101094]: pgmap v475: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:55.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:55 smithi157 ceph-mon[117693]: pgmap v476: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:55.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:55 smithi181 ceph-mon[101094]: pgmap v476: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:56:57.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:57 smithi157 ceph-mon[117693]: pgmap v477: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:57.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:57 smithi181 ceph-mon[101094]: pgmap v477: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:56:59.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:59 smithi157 ceph-mon[117693]: pgmap v478: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:59.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:56:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:56:59.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:59 smithi181 ceph-mon[101094]: pgmap v478: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:56:59.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:56:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:01.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:01 smithi157 ceph-mon[117693]: pgmap v479: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:01.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:01 smithi181 ceph-mon[101094]: pgmap v479: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:03.719 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:03 smithi157 ceph-mon[117693]: pgmap v480: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:03.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:03 smithi181 ceph-mon[101094]: pgmap v480: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:05.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:05 smithi157 ceph-mon[117693]: pgmap v481: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:05.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:05 smithi181 ceph-mon[101094]: pgmap v481: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:07.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:07 smithi157 ceph-mon[117693]: pgmap v482: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:07.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:07 smithi181 ceph-mon[101094]: pgmap v482: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:09.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:09 smithi157 ceph-mon[117693]: pgmap v483: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:09.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:09 smithi181 ceph-mon[101094]: pgmap v483: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:11.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:11 smithi157 ceph-mon[117693]: pgmap v484: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:11.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:11 smithi181 ceph-mon[101094]: pgmap v484: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:13.718 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:13 smithi157 ceph-mon[117693]: pgmap v485: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:13.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:13 smithi181 ceph-mon[101094]: pgmap v485: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:14.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:14.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:15.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:15 smithi157 ceph-mon[117693]: pgmap v486: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:15.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:15 smithi181 ceph-mon[101094]: pgmap v486: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:17.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:17 smithi157 ceph-mon[117693]: pgmap v487: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:17.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:17 smithi181 ceph-mon[101094]: pgmap v487: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:19.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:19 smithi157 ceph-mon[117693]: pgmap v488: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:19.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:19 smithi181 ceph-mon[101094]: pgmap v488: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:21.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:21 smithi157 ceph-mon[117693]: pgmap v489: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:21.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:21 smithi181 ceph-mon[101094]: pgmap v489: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:23.718 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:23 smithi157 ceph-mon[117693]: pgmap v490: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:23.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:23 smithi181 ceph-mon[101094]: pgmap v490: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:24.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:57:24.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:57:25.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:25 smithi157 ceph-mon[117693]: pgmap v491: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:25.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:57:25.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:57:25.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:57:25.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:25 smithi181 ceph-mon[101094]: pgmap v491: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:25.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:57:25.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:57:25.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:57:27.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:27 smithi157 ceph-mon[117693]: pgmap v492: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:27.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:27 smithi181 ceph-mon[101094]: pgmap v492: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:28.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:28 smithi157 ceph-mon[117693]: pgmap v493: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:28.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:28 smithi181 ceph-mon[101094]: pgmap v493: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:29.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:29.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:30.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:30 smithi157 ceph-mon[117693]: pgmap v494: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:30.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:30 smithi181 ceph-mon[101094]: pgmap v494: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:33.718 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:33 smithi157 ceph-mon[117693]: pgmap v495: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:33.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:33 smithi181 ceph-mon[101094]: pgmap v495: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:35.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:35 smithi157 ceph-mon[117693]: pgmap v496: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:35.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:35 smithi181 ceph-mon[101094]: pgmap v496: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:37.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:37 smithi157 ceph-mon[117693]: pgmap v497: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:37.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:37 smithi181 ceph-mon[101094]: pgmap v497: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:39.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:39 smithi157 ceph-mon[117693]: pgmap v498: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:39.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:39 smithi181 ceph-mon[101094]: pgmap v498: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:41.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:41 smithi157 ceph-mon[117693]: pgmap v499: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:41.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:41 smithi181 ceph-mon[101094]: pgmap v499: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:43.718 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:43 smithi157 ceph-mon[117693]: pgmap v500: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:43.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:43 smithi181 ceph-mon[101094]: pgmap v500: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:44.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:44.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:45.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:45 smithi157 ceph-mon[117693]: pgmap v501: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:45.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:45 smithi181 ceph-mon[101094]: pgmap v501: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:47.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:47 smithi157 ceph-mon[117693]: pgmap v502: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:47.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:47 smithi181 ceph-mon[101094]: pgmap v502: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:49.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:49 smithi157 ceph-mon[117693]: pgmap v503: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:49.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:49 smithi181 ceph-mon[101094]: pgmap v503: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:51.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:51 smithi157 ceph-mon[117693]: pgmap v504: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:51.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:51 smithi181 ceph-mon[101094]: pgmap v504: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:53.717 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:53 smithi157 ceph-mon[117693]: pgmap v505: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:53.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:53 smithi181 ceph-mon[101094]: pgmap v505: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:55.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:55 smithi157 ceph-mon[117693]: pgmap v506: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:55.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:55 smithi181 ceph-mon[101094]: pgmap v506: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:57:57.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:57 smithi157 ceph-mon[117693]: pgmap v507: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:57.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:57 smithi181 ceph-mon[101094]: pgmap v507: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:57:59.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:59 smithi157 ceph-mon[117693]: pgmap v508: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:59.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:57:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:57:59.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:59 smithi181 ceph-mon[101094]: pgmap v508: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:57:59.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:57:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:01.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:01 smithi157 ceph-mon[117693]: pgmap v509: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:01.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:01 smithi181 ceph-mon[101094]: pgmap v509: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:03.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:03 smithi157 ceph-mon[117693]: pgmap v510: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:03.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:03 smithi181 ceph-mon[101094]: pgmap v510: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:05.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:05 smithi157 ceph-mon[117693]: pgmap v511: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:05.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:05 smithi181 ceph-mon[101094]: pgmap v511: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:07.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:07 smithi157 ceph-mon[117693]: pgmap v512: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:07.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:07 smithi181 ceph-mon[101094]: pgmap v512: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:09.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:09 smithi157 ceph-mon[117693]: pgmap v513: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:09.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:09 smithi181 ceph-mon[101094]: pgmap v513: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:11.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:11 smithi157 ceph-mon[117693]: pgmap v514: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:11.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:11 smithi181 ceph-mon[101094]: pgmap v514: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:12.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:12 smithi157 ceph-mon[117693]: pgmap v515: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:12.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:12 smithi181 ceph-mon[101094]: pgmap v515: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:14.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:14.586 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:15.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:15 smithi157 ceph-mon[117693]: pgmap v516: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:15.586 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:15 smithi181 ceph-mon[101094]: pgmap v516: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:17.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:17 smithi157 ceph-mon[117693]: pgmap v517: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:17.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:17 smithi181 ceph-mon[101094]: pgmap v517: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:19.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:19 smithi157 ceph-mon[117693]: pgmap v518: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:19.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:19 smithi181 ceph-mon[101094]: pgmap v518: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:21.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:21 smithi157 ceph-mon[117693]: pgmap v519: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:21.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:21 smithi181 ceph-mon[101094]: pgmap v519: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:23.716 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:23 smithi157 ceph-mon[117693]: pgmap v520: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:23.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:23 smithi181 ceph-mon[101094]: pgmap v520: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:25.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:25 smithi157 ceph-mon[117693]: pgmap v521: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:25.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:58:25.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:25 smithi181 ceph-mon[101094]: pgmap v521: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:25.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:58:26.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:58:26.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:58:26.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:58:26.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:58:26.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:58:26.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:58:27.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:27 smithi157 ceph-mon[117693]: pgmap v522: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:27.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:27 smithi181 ceph-mon[101094]: pgmap v522: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:29.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:29 smithi157 ceph-mon[117693]: pgmap v523: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:29.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:29.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:29 smithi181 ceph-mon[101094]: pgmap v523: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:29.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:31.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:31 smithi157 ceph-mon[117693]: pgmap v524: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:31.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:31 smithi181 ceph-mon[101094]: pgmap v524: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:33.717 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:33 smithi157 ceph-mon[117693]: pgmap v525: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:33.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:33 smithi181 ceph-mon[101094]: pgmap v525: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:35.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:35 smithi157 ceph-mon[117693]: pgmap v526: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:35.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:35 smithi181 ceph-mon[101094]: pgmap v526: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:37.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:37 smithi157 ceph-mon[117693]: pgmap v527: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:37.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:37 smithi181 ceph-mon[101094]: pgmap v527: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:39.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:39 smithi157 ceph-mon[117693]: pgmap v528: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:39.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:39 smithi181 ceph-mon[101094]: pgmap v528: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:41.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:41 smithi157 ceph-mon[117693]: pgmap v529: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:41.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:41 smithi181 ceph-mon[101094]: pgmap v529: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:43.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:43 smithi157 ceph-mon[117693]: pgmap v530: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:43.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:43 smithi181 ceph-mon[101094]: pgmap v530: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:44.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:44.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:45.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:45 smithi157 ceph-mon[117693]: pgmap v531: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:45.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:45 smithi181 ceph-mon[101094]: pgmap v531: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:47.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:47 smithi157 ceph-mon[117693]: pgmap v532: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:47.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:47 smithi181 ceph-mon[101094]: pgmap v532: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:49.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:49 smithi157 ceph-mon[117693]: pgmap v533: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:49.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:49 smithi181 ceph-mon[101094]: pgmap v533: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:51.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:51 smithi157 ceph-mon[117693]: pgmap v534: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:51.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:51 smithi181 ceph-mon[101094]: pgmap v534: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:52.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:52 smithi157 ceph-mon[117693]: pgmap v535: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:52.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:52 smithi181 ceph-mon[101094]: pgmap v535: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:55.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:55 smithi157 ceph-mon[117693]: pgmap v536: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:55.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:55 smithi181 ceph-mon[101094]: pgmap v536: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:58:57.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:57 smithi157 ceph-mon[117693]: pgmap v537: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:57.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:57 smithi181 ceph-mon[101094]: pgmap v537: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:58:59.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:59 smithi157 ceph-mon[117693]: pgmap v538: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:59.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:58:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:58:59.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:59 smithi181 ceph-mon[101094]: pgmap v538: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:58:59.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:58:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:01.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:01 smithi157 ceph-mon[117693]: pgmap v539: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:01.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:01 smithi181 ceph-mon[101094]: pgmap v539: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:03.716 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:03 smithi157 ceph-mon[117693]: pgmap v540: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:03.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:03 smithi181 ceph-mon[101094]: pgmap v540: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:05.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:05 smithi157 ceph-mon[117693]: pgmap v541: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:05.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:05 smithi181 ceph-mon[101094]: pgmap v541: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:07.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:07 smithi157 ceph-mon[117693]: pgmap v542: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:07.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:07 smithi181 ceph-mon[101094]: pgmap v542: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:09.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:09 smithi157 ceph-mon[117693]: pgmap v543: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:09.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:09 smithi181 ceph-mon[101094]: pgmap v543: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:11.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:11 smithi157 ceph-mon[117693]: pgmap v544: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:11.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:11 smithi181 ceph-mon[101094]: pgmap v544: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:13.716 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:13 smithi157 ceph-mon[117693]: pgmap v545: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:13.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:13 smithi181 ceph-mon[101094]: pgmap v545: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:14.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:14.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:15.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:15 smithi157 ceph-mon[117693]: pgmap v546: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:15.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:15 smithi181 ceph-mon[101094]: pgmap v546: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:17.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:17 smithi157 ceph-mon[117693]: pgmap v547: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:17.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:17 smithi181 ceph-mon[101094]: pgmap v547: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:19.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:19 smithi157 ceph-mon[117693]: pgmap v548: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:19.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:19 smithi181 ceph-mon[101094]: pgmap v548: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:21.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:21 smithi157 ceph-mon[117693]: pgmap v549: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:21.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:21 smithi181 ceph-mon[101094]: pgmap v549: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:23.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:23 smithi157 ceph-mon[117693]: pgmap v550: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:23.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:23 smithi181 ceph-mon[101094]: pgmap v550: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:25.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:25 smithi157 ceph-mon[117693]: pgmap v551: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:25.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:25 smithi181 ceph-mon[101094]: pgmap v551: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:26.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:26 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:59:26.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:26 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T08:59:27.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:27 smithi157 ceph-mon[117693]: pgmap v552: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:27.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:27 smithi181 ceph-mon[101094]: pgmap v552: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:28.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:28 smithi157 ceph-mon[117693]: pgmap v553: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:28.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:28 smithi181 ceph-mon[101094]: pgmap v553: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:30.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:59:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:59:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:59:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:59:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:59:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:59:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:59:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T08:59:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T08:59:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T08:59:31.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:31 smithi157 ceph-mon[117693]: pgmap v554: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:31.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:31 smithi181 ceph-mon[101094]: pgmap v554: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:33.715 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:33 smithi157 ceph-mon[117693]: pgmap v555: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:33.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:33 smithi181 ceph-mon[101094]: pgmap v555: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:35.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:35 smithi157 ceph-mon[117693]: pgmap v556: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:35.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:35 smithi181 ceph-mon[101094]: pgmap v556: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:37.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:37 smithi157 ceph-mon[117693]: pgmap v557: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:37.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:37 smithi181 ceph-mon[101094]: pgmap v557: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:39.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:39 smithi157 ceph-mon[117693]: pgmap v558: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:39.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:39 smithi181 ceph-mon[101094]: pgmap v558: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:41.802 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:41 smithi157 ceph-mon[117693]: pgmap v559: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:41.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:41 smithi181 ceph-mon[101094]: pgmap v559: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:43.715 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:43 smithi157 ceph-mon[117693]: pgmap v560: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:43.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:43 smithi181 ceph-mon[101094]: pgmap v560: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:44.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:44.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:45.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:45 smithi157 ceph-mon[117693]: pgmap v561: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:45.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:45 smithi181 ceph-mon[101094]: pgmap v561: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:47.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:47 smithi157 ceph-mon[117693]: pgmap v562: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:47.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:47 smithi181 ceph-mon[101094]: pgmap v562: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:49.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:49 smithi157 ceph-mon[117693]: pgmap v563: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:49.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:49 smithi181 ceph-mon[101094]: pgmap v563: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:51.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:51 smithi157 ceph-mon[117693]: pgmap v564: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:51.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:51 smithi181 ceph-mon[101094]: pgmap v564: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:53.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:53 smithi157 ceph-mon[117693]: pgmap v565: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:53.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:53 smithi181 ceph-mon[101094]: pgmap v565: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:55.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:55 smithi157 ceph-mon[117693]: pgmap v566: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:55.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:55 smithi181 ceph-mon[101094]: pgmap v566: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T08:59:57.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:57 smithi157 ceph-mon[117693]: pgmap v567: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:57.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:57 smithi181 ceph-mon[101094]: pgmap v567: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T08:59:59.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:59 smithi157 ceph-mon[117693]: pgmap v568: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:59.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 08:59:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T08:59:59.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:59 smithi181 ceph-mon[101094]: pgmap v568: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T08:59:59.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 08:59:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:00.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T09:00:00.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T09:00:01.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:01 smithi157 ceph-mon[117693]: pgmap v569: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:01.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:01 smithi181 ceph-mon[101094]: pgmap v569: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:02.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:02 smithi181 ceph-mon[101094]: pgmap v570: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:03.051 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:02 smithi157 ceph-mon[117693]: pgmap v570: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:05.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:04 smithi157 ceph-mon[117693]: pgmap v571: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:05.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:04 smithi181 ceph-mon[101094]: pgmap v571: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:07.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:07 smithi157 ceph-mon[117693]: pgmap v572: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:07.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:07 smithi181 ceph-mon[101094]: pgmap v572: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:09.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:09 smithi157 ceph-mon[117693]: pgmap v573: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:09.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:09 smithi181 ceph-mon[101094]: pgmap v573: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:11.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:11 smithi157 ceph-mon[117693]: pgmap v574: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:11.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:11 smithi181 ceph-mon[101094]: pgmap v574: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:13.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:13 smithi157 ceph-mon[117693]: pgmap v575: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:13.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:13 smithi181 ceph-mon[101094]: pgmap v575: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:14.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:14.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:15.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:15 smithi157 ceph-mon[117693]: pgmap v576: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:15.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:15 smithi181 ceph-mon[101094]: pgmap v576: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:17.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:17 smithi157 ceph-mon[117693]: pgmap v577: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:17.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:17 smithi181 ceph-mon[101094]: pgmap v577: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:19.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:19 smithi157 ceph-mon[117693]: pgmap v578: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:19.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:19 smithi181 ceph-mon[101094]: pgmap v578: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:21.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:21 smithi157 ceph-mon[117693]: pgmap v579: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:21.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:21 smithi181 ceph-mon[101094]: pgmap v579: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:23.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:23 smithi157 ceph-mon[117693]: pgmap v580: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:23.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:23 smithi181 ceph-mon[101094]: pgmap v580: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:25.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:25 smithi157 ceph-mon[117693]: pgmap v581: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:25.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:25 smithi181 ceph-mon[101094]: pgmap v581: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:27.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:27 smithi157 ceph-mon[117693]: pgmap v582: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:27.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:27 smithi181 ceph-mon[101094]: pgmap v582: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:29.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:29 smithi157 ceph-mon[117693]: pgmap v583: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:29.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:29.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:29 smithi181 ceph-mon[101094]: pgmap v583: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:29.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:30.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:00:30.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:00:31.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:31 smithi157 ceph-mon[117693]: pgmap v584: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:31.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:31.801 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:31.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:31 smithi181 ceph-mon[101094]: pgmap v584: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:31.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:31.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:33.714 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:33 smithi157 ceph-mon[117693]: pgmap v585: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:33.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:33 smithi181 ceph-mon[101094]: pgmap v585: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:35.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:35 smithi157 ceph-mon[117693]: pgmap v586: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:35.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:35 smithi181 ceph-mon[101094]: pgmap v586: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:37.550 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:37.550 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:37.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:37 smithi157 ceph-mon[117693]: pgmap v587: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:37.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:00:37.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:00:37.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:37.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:37.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:37.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:37 smithi181 ceph-mon[101094]: pgmap v587: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:37.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:00:37.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:00:37.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:00:39.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:39 smithi157 ceph-mon[117693]: pgmap v588: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:39.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:39 smithi181 ceph-mon[101094]: pgmap v588: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:41.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:41 smithi157 ceph-mon[117693]: pgmap v589: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:41.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:41 smithi181 ceph-mon[101094]: pgmap v589: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:43.715 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:43 smithi157 ceph-mon[117693]: pgmap v590: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:43.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:43 smithi181 ceph-mon[101094]: pgmap v590: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:44.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:44.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:45.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:45 smithi157 ceph-mon[117693]: pgmap v591: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:45.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:45 smithi181 ceph-mon[101094]: pgmap v591: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:47.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:47 smithi157 ceph-mon[117693]: pgmap v592: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:47.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:47 smithi181 ceph-mon[101094]: pgmap v592: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:49.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:49 smithi157 ceph-mon[117693]: pgmap v593: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:49.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:49 smithi181 ceph-mon[101094]: pgmap v593: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:51.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:51 smithi157 ceph-mon[117693]: pgmap v594: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:51.833 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:51 smithi181 ceph-mon[101094]: pgmap v594: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:53.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:53 smithi157 ceph-mon[117693]: pgmap v595: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:53.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:53 smithi181 ceph-mon[101094]: pgmap v595: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:55.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:55 smithi157 ceph-mon[117693]: pgmap v596: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:55.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:55 smithi181 ceph-mon[101094]: pgmap v596: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:00:57.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:57 smithi157 ceph-mon[117693]: pgmap v597: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:57.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:57 smithi181 ceph-mon[101094]: pgmap v597: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:00:59.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:59 smithi157 ceph-mon[117693]: pgmap v598: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:59.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:00:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:00:59.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:59 smithi181 ceph-mon[101094]: pgmap v598: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:00:59.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:00:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:01.785 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:01 smithi181 ceph-mon[101094]: pgmap v599: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:01.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:01 smithi157 ceph-mon[117693]: pgmap v599: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:03.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:03 smithi157 ceph-mon[117693]: pgmap v600: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:03.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:03 smithi181 ceph-mon[101094]: pgmap v600: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:05.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:04 smithi157 ceph-mon[117693]: pgmap v601: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:05.332 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:04 smithi181 ceph-mon[101094]: pgmap v601: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:07.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:07 smithi157 ceph-mon[117693]: pgmap v602: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:07.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:07 smithi181 ceph-mon[101094]: pgmap v602: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:09.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:09 smithi157 ceph-mon[117693]: pgmap v603: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:09.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:09 smithi181 ceph-mon[101094]: pgmap v603: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:11.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:11 smithi157 ceph-mon[117693]: pgmap v604: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:11.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:11 smithi181 ceph-mon[101094]: pgmap v604: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:13.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:13 smithi157 ceph-mon[117693]: pgmap v605: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:13.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:13 smithi181 ceph-mon[101094]: pgmap v605: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:14.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:14.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:15.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:15 smithi157 ceph-mon[117693]: pgmap v606: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:15.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:15 smithi181 ceph-mon[101094]: pgmap v606: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:17.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:17 smithi157 ceph-mon[117693]: pgmap v607: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:17.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:17 smithi181 ceph-mon[101094]: pgmap v607: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:19.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:19 smithi157 ceph-mon[117693]: pgmap v608: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:19.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:19 smithi181 ceph-mon[101094]: pgmap v608: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:21.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:21 smithi157 ceph-mon[117693]: pgmap v609: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:21.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:21 smithi181 ceph-mon[101094]: pgmap v609: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:23.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:23 smithi157 ceph-mon[117693]: pgmap v610: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:23.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:23 smithi181 ceph-mon[101094]: pgmap v610: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:25.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:25 smithi157 ceph-mon[117693]: pgmap v611: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:25.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:25 smithi181 ceph-mon[101094]: pgmap v611: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:27.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:27 smithi157 ceph-mon[117693]: pgmap v612: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:27.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:27 smithi181 ceph-mon[101094]: pgmap v612: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:29.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:29 smithi157 ceph-mon[117693]: pgmap v613: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:29.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:29.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:29 smithi181 ceph-mon[101094]: pgmap v613: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:29.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:31.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:31 smithi157 ceph-mon[117693]: pgmap v614: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:31.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:31 smithi181 ceph-mon[101094]: pgmap v614: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:32.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:32 smithi157 ceph-mon[117693]: pgmap v615: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:32.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:32 smithi181 ceph-mon[101094]: pgmap v615: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:35.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:35 smithi157 ceph-mon[117693]: pgmap v616: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:35.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:35 smithi181 ceph-mon[101094]: pgmap v616: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:37.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:37 smithi157 ceph-mon[117693]: pgmap v617: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:37.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:37 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:01:37.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:37 smithi181 ceph-mon[101094]: pgmap v617: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:37.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:37 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:01:38.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:01:38.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:01:38.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:01:38.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:01:38.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:01:38.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:01:39.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:39 smithi157 ceph-mon[117693]: pgmap v618: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:39.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:39 smithi181 ceph-mon[101094]: pgmap v618: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:41.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:41 smithi157 ceph-mon[117693]: pgmap v619: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:41.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:41 smithi181 ceph-mon[101094]: pgmap v619: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:43.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:43 smithi157 ceph-mon[117693]: pgmap v620: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:01:43.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:43 smithi181 ceph-mon[101094]: pgmap v620: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:01:44.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:44.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:45.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:45 smithi157 ceph-mon[117693]: pgmap v621: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:45.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:45 smithi181 ceph-mon[101094]: pgmap v621: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:47.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:47 smithi157 ceph-mon[117693]: pgmap v622: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:47.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:47 smithi181 ceph-mon[101094]: pgmap v622: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:49.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:49 smithi157 ceph-mon[117693]: pgmap v623: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:01:49.834 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:49 smithi181 ceph-mon[101094]: pgmap v623: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:01:51.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:51 smithi157 ceph-mon[117693]: pgmap v624: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:51.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:51 smithi181 ceph-mon[101094]: pgmap v624: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:53.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:53 smithi157 ceph-mon[117693]: pgmap v625: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:53.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:53 smithi181 ceph-mon[101094]: pgmap v625: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:55.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:55 smithi157 ceph-mon[117693]: pgmap v626: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:55.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:55 smithi181 ceph-mon[101094]: pgmap v626: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:01:57.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:57 smithi157 ceph-mon[117693]: pgmap v627: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:57.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:57 smithi181 ceph-mon[101094]: pgmap v627: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:01:59.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:59 smithi157 ceph-mon[117693]: pgmap v628: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:59.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:01:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:01:59.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:59 smithi181 ceph-mon[101094]: pgmap v628: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:01:59.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:01:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:01.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:01 smithi157 ceph-mon[117693]: pgmap v629: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:01.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:01 smithi181 ceph-mon[101094]: pgmap v629: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:02.800 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:02 smithi157 ceph-mon[117693]: pgmap v630: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:02.904 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:02 smithi181 ceph-mon[101094]: pgmap v630: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:05.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:05 smithi157 ceph-mon[117693]: pgmap v631: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:05.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:05 smithi181 ceph-mon[101094]: pgmap v631: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:07.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:07 smithi157 ceph-mon[117693]: pgmap v632: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:07.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:07 smithi181 ceph-mon[101094]: pgmap v632: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:09.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:09 smithi157 ceph-mon[117693]: pgmap v633: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:09.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:09 smithi181 ceph-mon[101094]: pgmap v633: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:11.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:11 smithi157 ceph-mon[117693]: pgmap v634: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:11.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:11 smithi181 ceph-mon[101094]: pgmap v634: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:13.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:13 smithi157 ceph-mon[117693]: pgmap v635: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:13.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:13 smithi181 ceph-mon[101094]: pgmap v635: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:14.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:14.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:15.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:15 smithi157 ceph-mon[117693]: pgmap v636: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:15.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:15 smithi181 ceph-mon[101094]: pgmap v636: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:17.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:17 smithi157 ceph-mon[117693]: pgmap v637: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:17.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:17 smithi181 ceph-mon[101094]: pgmap v637: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:19.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:19 smithi157 ceph-mon[117693]: pgmap v638: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:19.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:19 smithi181 ceph-mon[101094]: pgmap v638: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:21.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:21 smithi157 ceph-mon[117693]: pgmap v639: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:21.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:21 smithi181 ceph-mon[101094]: pgmap v639: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:23.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:23 smithi157 ceph-mon[117693]: pgmap v640: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:23.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:23 smithi181 ceph-mon[101094]: pgmap v640: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:25.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:25 smithi157 ceph-mon[117693]: pgmap v641: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:25.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:25 smithi181 ceph-mon[101094]: pgmap v641: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:27.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:27 smithi157 ceph-mon[117693]: pgmap v642: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:27.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:27 smithi181 ceph-mon[101094]: pgmap v642: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:28.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:28 smithi181 ceph-mon[101094]: pgmap v643: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:29.048 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:28 smithi157 ceph-mon[117693]: pgmap v643: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:29.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:30.048 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:31.048 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:30 smithi157 ceph-mon[117693]: pgmap v644: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:31.081 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:30 smithi181 ceph-mon[101094]: pgmap v644: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:33.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:33 smithi157 ceph-mon[117693]: pgmap v645: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:33.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:33 smithi181 ceph-mon[101094]: pgmap v645: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:35.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:35 smithi157 ceph-mon[117693]: pgmap v646: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:35.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:35 smithi181 ceph-mon[101094]: pgmap v646: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:37.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:37 smithi157 ceph-mon[117693]: pgmap v647: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:37.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:37 smithi181 ceph-mon[101094]: pgmap v647: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:38.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:38 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:02:38.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:38 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:02:39.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:39 smithi157 ceph-mon[117693]: pgmap v648: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:39.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:02:39.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:39 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:02:39.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:39 smithi181 ceph-mon[101094]: pgmap v648: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:39.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:02:39.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:39 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:02:40.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:02:40.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:02:40.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:02:40.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:02:40.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:02:40.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:02:41.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:41 smithi157 ceph-mon[117693]: pgmap v649: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:41.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:41 smithi181 ceph-mon[101094]: pgmap v649: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:43.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:43 smithi157 ceph-mon[117693]: pgmap v650: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:43.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:43 smithi181 ceph-mon[101094]: pgmap v650: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:44.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:44.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:45.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:45 smithi157 ceph-mon[117693]: pgmap v651: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:45.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:45 smithi181 ceph-mon[101094]: pgmap v651: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:47.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:47 smithi157 ceph-mon[117693]: pgmap v652: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:47.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:47 smithi181 ceph-mon[101094]: pgmap v652: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:49.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:49 smithi157 ceph-mon[117693]: pgmap v653: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:49.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:49 smithi181 ceph-mon[101094]: pgmap v653: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:51.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:51 smithi157 ceph-mon[117693]: pgmap v654: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:51.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:51 smithi181 ceph-mon[101094]: pgmap v654: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:53.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:53 smithi157 ceph-mon[117693]: pgmap v655: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:53.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:53 smithi181 ceph-mon[101094]: pgmap v655: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:54.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:54 smithi157 ceph-mon[117693]: pgmap v656: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:54.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:54 smithi181 ceph-mon[101094]: pgmap v656: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:02:57.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:57 smithi157 ceph-mon[117693]: pgmap v657: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:57.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:57 smithi181 ceph-mon[101094]: pgmap v657: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:02:59.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:59 smithi157 ceph-mon[117693]: pgmap v658: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:59.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:02:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:02:59.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:59 smithi181 ceph-mon[101094]: pgmap v658: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:02:59.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:02:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:01.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:01 smithi157 ceph-mon[117693]: pgmap v659: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:01.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:01 smithi181 ceph-mon[101094]: pgmap v659: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:03.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:03 smithi157 ceph-mon[117693]: pgmap v660: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:03.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:03 smithi181 ceph-mon[101094]: pgmap v660: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:05.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:05 smithi157 ceph-mon[117693]: pgmap v661: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:05.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:05 smithi181 ceph-mon[101094]: pgmap v661: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:07.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:07 smithi157 ceph-mon[117693]: pgmap v662: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:07.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:07 smithi181 ceph-mon[101094]: pgmap v662: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:09.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:09 smithi157 ceph-mon[117693]: pgmap v663: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:09.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:09 smithi181 ceph-mon[101094]: pgmap v663: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:11.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:11 smithi157 ceph-mon[117693]: pgmap v664: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:11.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:11 smithi181 ceph-mon[101094]: pgmap v664: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:13.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:13 smithi157 ceph-mon[117693]: pgmap v665: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:13.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:13 smithi181 ceph-mon[101094]: pgmap v665: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:14.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:14.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:15.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:15 smithi157 ceph-mon[117693]: pgmap v666: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:15.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:15 smithi181 ceph-mon[101094]: pgmap v666: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:17.048 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:16 smithi157 ceph-mon[117693]: pgmap v667: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:17.080 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:16 smithi181 ceph-mon[101094]: pgmap v667: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:19.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:19 smithi157 ceph-mon[117693]: pgmap v668: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:19.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:19 smithi181 ceph-mon[101094]: pgmap v668: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:21.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:21 smithi157 ceph-mon[117693]: pgmap v669: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:21.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:21 smithi181 ceph-mon[101094]: pgmap v669: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:23.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:23 smithi157 ceph-mon[117693]: pgmap v670: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:23.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:23 smithi181 ceph-mon[101094]: pgmap v670: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:25.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:25 smithi157 ceph-mon[117693]: pgmap v671: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:25.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:25 smithi181 ceph-mon[101094]: pgmap v671: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:27.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:27 smithi157 ceph-mon[117693]: pgmap v672: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:27.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:27 smithi181 ceph-mon[101094]: pgmap v672: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:29.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:29 smithi157 ceph-mon[117693]: pgmap v673: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:29.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:29.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:29 smithi181 ceph-mon[101094]: pgmap v673: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:29.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:31.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:31 smithi157 ceph-mon[117693]: pgmap v674: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:31.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:31 smithi181 ceph-mon[101094]: pgmap v674: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:33.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:33 smithi157 ceph-mon[117693]: pgmap v675: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:03:33.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:33 smithi181 ceph-mon[101094]: pgmap v675: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:03:35.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:35 smithi157 ceph-mon[117693]: pgmap v676: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:03:35.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:35 smithi181 ceph-mon[101094]: pgmap v676: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:03:37.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:37 smithi157 ceph-mon[117693]: pgmap v677: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:03:37.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:37 smithi181 ceph-mon[101094]: pgmap v677: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:03:39.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:39 smithi157 ceph-mon[117693]: pgmap v678: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:03:39.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:39 smithi181 ceph-mon[101094]: pgmap v678: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:03:40.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:03:40.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:03:41.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:41 smithi157 ceph-mon[117693]: pgmap v679: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:03:41.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:03:41.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:03:41.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:03:41.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:41 smithi181 ceph-mon[101094]: pgmap v679: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:03:41.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:03:41.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:03:41.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:03:42.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:42 smithi157 ceph-mon[117693]: pgmap v680: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:03:42.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:42 smithi181 ceph-mon[101094]: pgmap v680: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:03:44.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:44.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:45.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:45 smithi157 ceph-mon[117693]: pgmap v681: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:45.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:45 smithi181 ceph-mon[101094]: pgmap v681: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:47.777 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:47 smithi157 ceph-mon[117693]: pgmap v682: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:47.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:47 smithi181 ceph-mon[101094]: pgmap v682: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:49.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:49 smithi157 ceph-mon[117693]: pgmap v683: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:49.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:49 smithi181 ceph-mon[101094]: pgmap v683: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:51.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:51 smithi157 ceph-mon[117693]: pgmap v684: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:51.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:51 smithi181 ceph-mon[101094]: pgmap v684: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:53.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:53 smithi157 ceph-mon[117693]: pgmap v685: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:53.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:53 smithi181 ceph-mon[101094]: pgmap v685: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:55.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:55 smithi157 ceph-mon[117693]: pgmap v686: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:55.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:55 smithi181 ceph-mon[101094]: pgmap v686: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:03:57.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:57 smithi157 ceph-mon[117693]: pgmap v687: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:57.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:57 smithi181 ceph-mon[101094]: pgmap v687: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:03:59.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:59 smithi157 ceph-mon[117693]: pgmap v688: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:59.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:03:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:03:59.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:59 smithi181 ceph-mon[101094]: pgmap v688: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:03:59.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:03:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:01.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:01 smithi157 ceph-mon[117693]: pgmap v689: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:01.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:01 smithi181 ceph-mon[101094]: pgmap v689: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:03.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:03 smithi157 ceph-mon[117693]: pgmap v690: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:03.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:03 smithi181 ceph-mon[101094]: pgmap v690: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:05.297 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:05 smithi157 ceph-mon[117693]: pgmap v691: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:05.329 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:05 smithi181 ceph-mon[101094]: pgmap v691: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:07.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:07 smithi157 ceph-mon[117693]: pgmap v692: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:07.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:07 smithi181 ceph-mon[101094]: pgmap v692: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:09.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:09 smithi157 ceph-mon[117693]: pgmap v693: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:09.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:09 smithi181 ceph-mon[101094]: pgmap v693: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:11.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:11 smithi157 ceph-mon[117693]: pgmap v694: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:11.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:11 smithi181 ceph-mon[101094]: pgmap v694: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:13.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:13 smithi157 ceph-mon[117693]: pgmap v695: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:13.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:13 smithi181 ceph-mon[101094]: pgmap v695: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:14.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:14.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:15.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:15 smithi157 ceph-mon[117693]: pgmap v696: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:15.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:15 smithi181 ceph-mon[101094]: pgmap v696: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:17.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:17 smithi157 ceph-mon[117693]: pgmap v697: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:17.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:17 smithi181 ceph-mon[101094]: pgmap v697: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:19.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:19 smithi157 ceph-mon[117693]: pgmap v698: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:19.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:19 smithi181 ceph-mon[101094]: pgmap v698: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:21.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:21 smithi157 ceph-mon[117693]: pgmap v699: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:21.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:21 smithi181 ceph-mon[101094]: pgmap v699: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:23.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:23 smithi157 ceph-mon[117693]: pgmap v700: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:23.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:23 smithi181 ceph-mon[101094]: pgmap v700: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:25.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:24 smithi157 ceph-mon[117693]: pgmap v701: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:25.079 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:24 smithi181 ceph-mon[101094]: pgmap v701: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:27.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:27 smithi157 ceph-mon[117693]: pgmap v702: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:27.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:27 smithi181 ceph-mon[101094]: pgmap v702: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:29.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:29 smithi157 ceph-mon[117693]: pgmap v703: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:29.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:29.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:29 smithi181 ceph-mon[101094]: pgmap v703: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:29.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:31.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:31 smithi157 ceph-mon[117693]: pgmap v704: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:31.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:31 smithi181 ceph-mon[101094]: pgmap v704: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:33.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:33 smithi157 ceph-mon[117693]: pgmap v705: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:33.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:33 smithi181 ceph-mon[101094]: pgmap v705: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:35.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:35 smithi157 ceph-mon[117693]: pgmap v706: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:35.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:35 smithi181 ceph-mon[101094]: pgmap v706: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:37.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:37 smithi157 ceph-mon[117693]: pgmap v707: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:37.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:37 smithi181 ceph-mon[101094]: pgmap v707: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:39.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:39 smithi157 ceph-mon[117693]: pgmap v708: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:39.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:39 smithi181 ceph-mon[101094]: pgmap v708: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:41.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:41 smithi157 ceph-mon[117693]: pgmap v709: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:41.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:04:41.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:41 smithi181 ceph-mon[101094]: pgmap v709: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:41.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:04:42.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:04:42.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:04:42.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:04:42.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:04:42.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:04:42.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:04:43.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:43 smithi181 ceph-mon[101094]: pgmap v710: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:44.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:43 smithi157 ceph-mon[117693]: pgmap v710: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:44.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:45.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:04:45.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:45 smithi181 ceph-mon[101094]: pgmap v711: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:46.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:45 smithi157 ceph-mon[117693]: pgmap v711: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:46.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:46 smithi181 ceph-mon[101094]: pgmap v712: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:47.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:46 smithi157 ceph-mon[117693]: pgmap v712: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:49.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:49 smithi157 ceph-mon[117693]: pgmap v713: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:49.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:49 smithi181 ceph-mon[101094]: pgmap v713: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:51.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:51 smithi157 ceph-mon[117693]: pgmap v714: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:51.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:51 smithi181 ceph-mon[101094]: pgmap v714: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:04:53.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:53 smithi157 ceph-mon[117693]: pgmap v715: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:53.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:53 smithi181 ceph-mon[101094]: pgmap v715: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:55.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:55 smithi157 ceph-mon[117693]: pgmap v716: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:55.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:55 smithi181 ceph-mon[101094]: pgmap v716: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:57.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:57 smithi157 ceph-mon[117693]: pgmap v717: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:57.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:57 smithi181 ceph-mon[101094]: pgmap v717: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:04:59.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:59 smithi181 ceph-mon[101094]: pgmap v718: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:04:59.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:04:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:00.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:59 smithi157 ceph-mon[117693]: pgmap v718: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:00.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:04:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:01.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:01 smithi181 ceph-mon[101094]: pgmap v719: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:02.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:01 smithi157 ceph-mon[117693]: pgmap v719: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:03.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:02 smithi157 ceph-mon[117693]: pgmap v720: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:03.079 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:02 smithi181 ceph-mon[101094]: pgmap v720: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:05.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:05 smithi157 ceph-mon[117693]: pgmap v721: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:05.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:05 smithi181 ceph-mon[101094]: pgmap v721: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:07.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:07 smithi157 ceph-mon[117693]: pgmap v722: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:07.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:07 smithi181 ceph-mon[101094]: pgmap v722: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:09.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:09 smithi157 ceph-mon[117693]: pgmap v723: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:09.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:09 smithi181 ceph-mon[101094]: pgmap v723: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:11.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:11 smithi157 ceph-mon[117693]: pgmap v724: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:11.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:11 smithi181 ceph-mon[101094]: pgmap v724: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:13.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:13 smithi157 ceph-mon[117693]: pgmap v725: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:13.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:13 smithi181 ceph-mon[101094]: pgmap v725: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:14.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:15.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:15.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:15 smithi181 ceph-mon[101094]: pgmap v726: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:16.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:15 smithi157 ceph-mon[117693]: pgmap v726: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:17.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:17 smithi181 ceph-mon[101094]: pgmap v727: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:18.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:17 smithi157 ceph-mon[117693]: pgmap v727: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:19.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:18 smithi157 ceph-mon[117693]: pgmap v728: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:19.078 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:18 smithi181 ceph-mon[101094]: pgmap v728: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:21.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:21 smithi157 ceph-mon[117693]: pgmap v729: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:21.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:21 smithi181 ceph-mon[101094]: pgmap v729: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:23.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:23 smithi157 ceph-mon[117693]: pgmap v730: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:23.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:23 smithi181 ceph-mon[101094]: pgmap v730: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:25.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:25 smithi157 ceph-mon[117693]: pgmap v731: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:25.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:25 smithi181 ceph-mon[101094]: pgmap v731: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:27.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:27 smithi157 ceph-mon[117693]: pgmap v732: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:27.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:27 smithi181 ceph-mon[101094]: pgmap v732: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:29.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:29 smithi157 ceph-mon[117693]: pgmap v733: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:29.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:29.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:29 smithi181 ceph-mon[101094]: pgmap v733: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:29.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:31.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:31 smithi181 ceph-mon[101094]: pgmap v734: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:32.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:31 smithi157 ceph-mon[117693]: pgmap v734: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:33.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:33 smithi181 ceph-mon[101094]: pgmap v735: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:34.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:33 smithi157 ceph-mon[117693]: pgmap v735: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:35.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:35 smithi181 ceph-mon[101094]: pgmap v736: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:36.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:35 smithi157 ceph-mon[117693]: pgmap v736: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:36.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:36 smithi181 ceph-mon[101094]: pgmap v737: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:37.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:36 smithi157 ceph-mon[117693]: pgmap v737: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:39.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:39 smithi157 ceph-mon[117693]: pgmap v738: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:39.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:39 smithi181 ceph-mon[101094]: pgmap v738: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:41.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:41 smithi157 ceph-mon[117693]: pgmap v739: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:41.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:41 smithi181 ceph-mon[101094]: pgmap v739: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:42.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:42 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:05:42.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:42 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:05:43.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:43 smithi157 ceph-mon[117693]: pgmap v740: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:43.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:05:43.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:05:43.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:05:43.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:43 smithi181 ceph-mon[101094]: pgmap v740: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:43.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:05:43.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:05:43.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:05:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:45.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:05:45.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:45 smithi181 ceph-mon[101094]: pgmap v741: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:46.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:45 smithi157 ceph-mon[117693]: pgmap v741: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:47.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:47 smithi181 ceph-mon[101094]: pgmap v742: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:48.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:47 smithi157 ceph-mon[117693]: pgmap v742: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:49.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:48 smithi157 ceph-mon[117693]: pgmap v743: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:49.079 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:48 smithi181 ceph-mon[101094]: pgmap v743: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:51.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:51 smithi157 ceph-mon[117693]: pgmap v744: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:51.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:51 smithi181 ceph-mon[101094]: pgmap v744: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:05:53.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:53 smithi157 ceph-mon[117693]: pgmap v745: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:53.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:53 smithi181 ceph-mon[101094]: pgmap v745: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:55.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:55 smithi181 ceph-mon[101094]: pgmap v746: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:56.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:55 smithi157 ceph-mon[117693]: pgmap v746: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:57.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:57 smithi181 ceph-mon[101094]: pgmap v747: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:58.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:57 smithi157 ceph-mon[117693]: pgmap v747: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:05:59.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:59 smithi181 ceph-mon[101094]: pgmap v748: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:05:59.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:05:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:00.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:59 smithi157 ceph-mon[117693]: pgmap v748: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:00.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:05:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:01.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:01 smithi181 ceph-mon[101094]: pgmap v749: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:02.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:01 smithi157 ceph-mon[117693]: pgmap v749: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:03.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:03 smithi181 ceph-mon[101094]: pgmap v750: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:04.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:03 smithi157 ceph-mon[117693]: pgmap v750: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:04.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:04 smithi181 ceph-mon[101094]: pgmap v751: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:05.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:04 smithi157 ceph-mon[117693]: pgmap v751: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:07.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:07 smithi157 ceph-mon[117693]: pgmap v752: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:07.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:07 smithi181 ceph-mon[101094]: pgmap v752: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:09.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:09 smithi181 ceph-mon[101094]: pgmap v753: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:10.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:09 smithi157 ceph-mon[117693]: pgmap v753: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:11.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:11 smithi181 ceph-mon[101094]: pgmap v754: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:12.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:11 smithi157 ceph-mon[117693]: pgmap v754: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:13.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:13 smithi181 ceph-mon[101094]: pgmap v755: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:14.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:13 smithi157 ceph-mon[117693]: pgmap v755: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:14.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:15.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:15.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:15 smithi181 ceph-mon[101094]: pgmap v756: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:16.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:15 smithi157 ceph-mon[117693]: pgmap v756: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:17.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:16 smithi157 ceph-mon[117693]: pgmap v757: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:17.078 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:16 smithi181 ceph-mon[101094]: pgmap v757: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:19.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:19 smithi157 ceph-mon[117693]: pgmap v758: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:19.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:19 smithi181 ceph-mon[101094]: pgmap v758: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:21.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:21 smithi181 ceph-mon[101094]: pgmap v759: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:22.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:21 smithi157 ceph-mon[117693]: pgmap v759: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:23.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:23 smithi181 ceph-mon[101094]: pgmap v760: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:24.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:23 smithi157 ceph-mon[117693]: pgmap v760: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:25.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:25 smithi181 ceph-mon[101094]: pgmap v761: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:26.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:25 smithi157 ceph-mon[117693]: pgmap v761: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:27.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:27 smithi181 ceph-mon[101094]: pgmap v762: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:28.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:27 smithi157 ceph-mon[117693]: pgmap v762: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:29.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:29 smithi181 ceph-mon[101094]: pgmap v763: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:29.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:30.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:29 smithi157 ceph-mon[117693]: pgmap v763: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:30.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:30.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:30 smithi181 ceph-mon[101094]: pgmap v764: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:31.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:30 smithi157 ceph-mon[117693]: pgmap v764: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:33.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:33 smithi181 ceph-mon[101094]: pgmap v765: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:34.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:33 smithi157 ceph-mon[117693]: pgmap v765: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:35.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:35 smithi181 ceph-mon[101094]: pgmap v766: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:36.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:35 smithi157 ceph-mon[117693]: pgmap v766: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:37.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:37 smithi181 ceph-mon[101094]: pgmap v767: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:38.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:37 smithi157 ceph-mon[117693]: pgmap v767: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:39.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:39 smithi181 ceph-mon[101094]: pgmap v768: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:40.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:39 smithi157 ceph-mon[117693]: pgmap v768: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:41.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:41 smithi181 ceph-mon[101094]: pgmap v769: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:42.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:41 smithi157 ceph-mon[117693]: pgmap v769: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:43.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:43 smithi181 ceph-mon[101094]: pgmap v770: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:43.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:43 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:06:44.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:43 smithi157 ceph-mon[117693]: pgmap v770: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:44.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:43 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:06:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:06:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:06:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:06:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:44 smithi181 ceph-mon[101094]: pgmap v771: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:45.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:06:45.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:06:45.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:06:45.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:06:45.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:44 smithi157 ceph-mon[117693]: pgmap v771: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:47.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:47 smithi181 ceph-mon[101094]: pgmap v772: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:48.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:47 smithi157 ceph-mon[117693]: pgmap v772: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:49.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:49 smithi181 ceph-mon[101094]: pgmap v773: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:50.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:49 smithi157 ceph-mon[117693]: pgmap v773: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:51.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:51 smithi181 ceph-mon[101094]: pgmap v774: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:52.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:51 smithi157 ceph-mon[117693]: pgmap v774: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:06:53.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:53 smithi181 ceph-mon[101094]: pgmap v775: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:54.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:53 smithi157 ceph-mon[117693]: pgmap v775: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:55.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:55 smithi181 ceph-mon[101094]: pgmap v776: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:56.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:55 smithi157 ceph-mon[117693]: pgmap v776: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:56.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:56 smithi181 ceph-mon[101094]: pgmap v777: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:57.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:56 smithi157 ceph-mon[117693]: pgmap v777: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:06:59.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:59 smithi181 ceph-mon[101094]: pgmap v778: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:06:59.874 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:06:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:00.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:59 smithi157 ceph-mon[117693]: pgmap v778: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:00.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:06:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:01.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:01 smithi181 ceph-mon[101094]: pgmap v779: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:02.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:01 smithi157 ceph-mon[117693]: pgmap v779: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:03.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:03 smithi181 ceph-mon[101094]: pgmap v780: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:04.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:03 smithi157 ceph-mon[117693]: pgmap v780: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:05.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:05 smithi181 ceph-mon[101094]: pgmap v781: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:06.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:05 smithi157 ceph-mon[117693]: pgmap v781: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:07.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:07 smithi181 ceph-mon[101094]: pgmap v782: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:08.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:07 smithi157 ceph-mon[117693]: pgmap v782: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:08.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:08 smithi181 ceph-mon[101094]: pgmap v783: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:09.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:08 smithi157 ceph-mon[117693]: pgmap v783: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:11.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:11 smithi181 ceph-mon[101094]: pgmap v784: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:12.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:11 smithi157 ceph-mon[117693]: pgmap v784: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:13.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:13 smithi181 ceph-mon[101094]: pgmap v785: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:14.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:13 smithi157 ceph-mon[117693]: pgmap v785: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:14.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:15.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:15.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:15 smithi181 ceph-mon[101094]: pgmap v786: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:16.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:15 smithi157 ceph-mon[117693]: pgmap v786: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:17.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:16 smithi157 ceph-mon[117693]: pgmap v787: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:17.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:16 smithi181 ceph-mon[101094]: pgmap v787: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:19.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:19 smithi181 ceph-mon[101094]: pgmap v788: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:20.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:19 smithi157 ceph-mon[117693]: pgmap v788: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:21.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:21 smithi181 ceph-mon[101094]: pgmap v789: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:22.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:21 smithi157 ceph-mon[117693]: pgmap v789: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:23.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:23 smithi181 ceph-mon[101094]: pgmap v790: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:24.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:23 smithi157 ceph-mon[117693]: pgmap v790: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:25.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:25 smithi181 ceph-mon[101094]: pgmap v791: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:26.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:25 smithi157 ceph-mon[117693]: pgmap v791: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:27.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:26 smithi157 ceph-mon[117693]: pgmap v792: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:27.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:26 smithi181 ceph-mon[101094]: pgmap v792: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:29.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:29 smithi181 ceph-mon[101094]: pgmap v793: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:29.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:30.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:29 smithi157 ceph-mon[117693]: pgmap v793: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:30.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:31.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:31 smithi181 ceph-mon[101094]: pgmap v794: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:32.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:31 smithi157 ceph-mon[117693]: pgmap v794: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:33.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:33 smithi181 ceph-mon[101094]: pgmap v795: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:34.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:33 smithi157 ceph-mon[117693]: pgmap v795: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:35.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:35 smithi181 ceph-mon[101094]: pgmap v796: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:36.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:35 smithi157 ceph-mon[117693]: pgmap v796: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:37.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:36 smithi157 ceph-mon[117693]: pgmap v797: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:37.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:36 smithi181 ceph-mon[101094]: pgmap v797: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:39.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:39 smithi181 ceph-mon[101094]: pgmap v798: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:40.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:39 smithi157 ceph-mon[117693]: pgmap v798: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:41.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:41 smithi181 ceph-mon[101094]: pgmap v799: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:42.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:41 smithi157 ceph-mon[117693]: pgmap v799: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:43.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:43 smithi181 ceph-mon[101094]: pgmap v800: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:44.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:43 smithi157 ceph-mon[117693]: pgmap v800: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:45.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:07:45.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:45.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:07:45.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:07:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:45 smithi157 ceph-mon[117693]: pgmap v801: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:07:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:07:46.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:07:46.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:45 smithi181 ceph-mon[101094]: pgmap v801: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:46.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:07:46.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:07:46.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:07:47.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:46 smithi157 ceph-mon[117693]: pgmap v802: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:47.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:46 smithi181 ceph-mon[101094]: pgmap v802: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:49.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:49 smithi181 ceph-mon[101094]: pgmap v803: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:50.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:49 smithi157 ceph-mon[117693]: pgmap v803: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:51.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:51 smithi181 ceph-mon[101094]: pgmap v804: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:52.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:51 smithi157 ceph-mon[117693]: pgmap v804: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:07:54.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:53 smithi157 ceph-mon[117693]: pgmap v805: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:54.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:53 smithi181 ceph-mon[101094]: pgmap v805: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:55.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:54 smithi157 ceph-mon[117693]: pgmap v806: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:55.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:54 smithi181 ceph-mon[101094]: pgmap v806: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:57.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:57 smithi181 ceph-mon[101094]: pgmap v807: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:58.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:57 smithi157 ceph-mon[117693]: pgmap v807: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:07:59.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:59 smithi181 ceph-mon[101094]: pgmap v808: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:07:59.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:07:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:00.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:59 smithi157 ceph-mon[117693]: pgmap v808: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:00.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:07:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:02.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:01 smithi157 ceph-mon[117693]: pgmap v809: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:02.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:01 smithi181 ceph-mon[101094]: pgmap v809: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:03.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:02 smithi157 ceph-mon[117693]: pgmap v810: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:03.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:02 smithi181 ceph-mon[101094]: pgmap v810: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:05.327 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:05 smithi181 ceph-mon[101094]: pgmap v811: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:05.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:05 smithi157 ceph-mon[117693]: pgmap v811: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:07.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:07 smithi181 ceph-mon[101094]: pgmap v812: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:08.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:07 smithi157 ceph-mon[117693]: pgmap v812: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:10.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:09 smithi157 ceph-mon[117693]: pgmap v813: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:10.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:09 smithi181 ceph-mon[101094]: pgmap v813: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:12.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:11 smithi157 ceph-mon[117693]: pgmap v814: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:12.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:11 smithi181 ceph-mon[101094]: pgmap v814: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:13.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:12 smithi157 ceph-mon[117693]: pgmap v815: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:13.077 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:12 smithi181 ceph-mon[101094]: pgmap v815: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:14.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:14.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:15.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:15 smithi157 ceph-mon[117693]: pgmap v816: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:15.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:15 smithi181 ceph-mon[101094]: pgmap v816: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:17.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:17 smithi181 ceph-mon[101094]: pgmap v817: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:18.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:17 smithi157 ceph-mon[117693]: pgmap v817: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:20.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:19 smithi157 ceph-mon[117693]: pgmap v818: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:20.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:19 smithi181 ceph-mon[101094]: pgmap v818: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:21.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:20 smithi157 ceph-mon[117693]: pgmap v819: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:21.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:20 smithi181 ceph-mon[101094]: pgmap v819: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:24.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:23 smithi157 ceph-mon[117693]: pgmap v820: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:24.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:23 smithi181 ceph-mon[101094]: pgmap v820: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:26.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:25 smithi157 ceph-mon[117693]: pgmap v821: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:26.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:25 smithi181 ceph-mon[101094]: pgmap v821: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:27.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:26 smithi157 ceph-mon[117693]: pgmap v822: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:27.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:26 smithi181 ceph-mon[101094]: pgmap v822: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:30.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:29 smithi157 ceph-mon[117693]: pgmap v823: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:30.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:30.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:29 smithi181 ceph-mon[101094]: pgmap v823: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:30.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:32.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:31 smithi157 ceph-mon[117693]: pgmap v824: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:32.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:31 smithi181 ceph-mon[101094]: pgmap v824: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:32 smithi157 ceph-mon[117693]: pgmap v825: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:33.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:32 smithi181 ceph-mon[101094]: pgmap v825: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:36.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:35 smithi157 ceph-mon[117693]: pgmap v826: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:36.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:35 smithi181 ceph-mon[101094]: pgmap v826: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:38.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:37 smithi157 ceph-mon[117693]: pgmap v827: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:38.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:37 smithi181 ceph-mon[101094]: pgmap v827: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:39.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:38 smithi157 ceph-mon[117693]: pgmap v828: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:39.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:38 smithi181 ceph-mon[101094]: pgmap v828: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:42.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:41 smithi157 ceph-mon[117693]: pgmap v829: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:42.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:41 smithi181 ceph-mon[101094]: pgmap v829: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:43.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:42 smithi157 ceph-mon[117693]: pgmap v830: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:43.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:42 smithi181 ceph-mon[101094]: pgmap v830: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:44.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:44.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:08:45.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:45 smithi157 ceph-mon[117693]: pgmap v831: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:45.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:08:45.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:45 smithi181 ceph-mon[101094]: pgmap v831: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:45.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:08:46.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:46 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:08:46.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:46 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:08:46.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:46 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:08:46.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:46 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:08:46.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:46 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:08:46.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:46 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:08:47.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:47 smithi181 ceph-mon[101094]: pgmap v832: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:47.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:47 smithi157 ceph-mon[117693]: pgmap v832: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:50.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:49 smithi157 ceph-mon[117693]: pgmap v833: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:50.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:49 smithi181 ceph-mon[101094]: pgmap v833: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:51.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:50 smithi157 ceph-mon[117693]: pgmap v834: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:51.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:50 smithi181 ceph-mon[101094]: pgmap v834: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:08:54.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:53 smithi157 ceph-mon[117693]: pgmap v835: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:54.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:53 smithi181 ceph-mon[101094]: pgmap v835: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:55.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:54 smithi157 ceph-mon[117693]: pgmap v836: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:55.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:54 smithi181 ceph-mon[101094]: pgmap v836: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:58.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:57 smithi157 ceph-mon[117693]: pgmap v837: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:58.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:57 smithi181 ceph-mon[101094]: pgmap v837: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:08:59.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:58 smithi157 ceph-mon[117693]: pgmap v838: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:08:59.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:58 smithi181 ceph-mon[101094]: pgmap v838: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:00.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:08:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:00.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:08:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:01.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:00 smithi157 ceph-mon[117693]: pgmap v839: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:01.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:00 smithi181 ceph-mon[101094]: pgmap v839: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:04.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:03 smithi157 ceph-mon[117693]: pgmap v840: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:04.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:03 smithi181 ceph-mon[101094]: pgmap v840: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:05.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:04 smithi157 ceph-mon[117693]: pgmap v841: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:05.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:04 smithi181 ceph-mon[101094]: pgmap v841: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:08.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:07 smithi157 ceph-mon[117693]: pgmap v842: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:08.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:07 smithi181 ceph-mon[101094]: pgmap v842: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:09.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:08 smithi157 ceph-mon[117693]: pgmap v843: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:09.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:08 smithi181 ceph-mon[101094]: pgmap v843: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:12.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:11 smithi157 ceph-mon[117693]: pgmap v844: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:12.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:11 smithi181 ceph-mon[101094]: pgmap v844: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:13.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:12 smithi157 ceph-mon[117693]: pgmap v845: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:13.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:12 smithi181 ceph-mon[101094]: pgmap v845: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:14.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:14.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:15.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:15 smithi157 ceph-mon[117693]: pgmap v846: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:15.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:15 smithi181 ceph-mon[101094]: pgmap v846: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:17.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:16 smithi157 ceph-mon[117693]: pgmap v847: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:17.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:16 smithi181 ceph-mon[101094]: pgmap v847: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:18 smithi157 ceph-mon[117693]: pgmap v848: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:19.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:18 smithi181 ceph-mon[101094]: pgmap v848: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:21.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:20 smithi157 ceph-mon[117693]: pgmap v849: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:21.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:20 smithi181 ceph-mon[101094]: pgmap v849: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:23.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:22 smithi157 ceph-mon[117693]: pgmap v850: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:23.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:22 smithi181 ceph-mon[101094]: pgmap v850: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:25.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:24 smithi157 ceph-mon[117693]: pgmap v851: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:25.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:24 smithi181 ceph-mon[101094]: pgmap v851: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:27.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:26 smithi157 ceph-mon[117693]: pgmap v852: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:27.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:26 smithi181 ceph-mon[101094]: pgmap v852: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:29.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:28 smithi157 ceph-mon[117693]: pgmap v853: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:29.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:28 smithi181 ceph-mon[101094]: pgmap v853: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:30.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:30.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:31.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:30 smithi157 ceph-mon[117693]: pgmap v854: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:31.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:30 smithi181 ceph-mon[101094]: pgmap v854: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:32 smithi157 ceph-mon[117693]: pgmap v855: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:33.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:32 smithi181 ceph-mon[101094]: pgmap v855: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:35.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:34 smithi157 ceph-mon[117693]: pgmap v856: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:35.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:34 smithi181 ceph-mon[101094]: pgmap v856: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:37.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:36 smithi157 ceph-mon[117693]: pgmap v857: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:37.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:36 smithi181 ceph-mon[101094]: pgmap v857: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:39.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:38 smithi157 ceph-mon[117693]: pgmap v858: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:39.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:38 smithi181 ceph-mon[101094]: pgmap v858: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:41.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:40 smithi157 ceph-mon[117693]: pgmap v859: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:41.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:40 smithi181 ceph-mon[101094]: pgmap v859: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:43.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:42 smithi157 ceph-mon[117693]: pgmap v860: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:43.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:42 smithi181 ceph-mon[101094]: pgmap v860: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:44.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:44.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:09:45.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:45 smithi157 ceph-mon[117693]: pgmap v861: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:45.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:45 smithi181 ceph-mon[101094]: pgmap v861: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:46.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:46 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:09:46.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:46 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:09:47.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:47 smithi181 ceph-mon[101094]: pgmap v862: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:47.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:47 smithi157 ceph-mon[117693]: pgmap v862: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:49.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:48 smithi157 ceph-mon[117693]: pgmap v863: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:49.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:48 smithi181 ceph-mon[101094]: pgmap v863: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:50.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:09:50.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:09:50.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:09:50.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:09:50.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:09:50.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:09:50.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:09:50.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:09:50.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:09:50.576 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:09:51.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:51 smithi157 ceph-mon[117693]: pgmap v864: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:51.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:51 smithi181 ceph-mon[101094]: pgmap v864: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:09:53.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:52 smithi157 ceph-mon[117693]: pgmap v865: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:53.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:52 smithi181 ceph-mon[101094]: pgmap v865: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:55.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:54 smithi157 ceph-mon[117693]: pgmap v866: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:55.076 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:54 smithi181 ceph-mon[101094]: pgmap v866: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:57.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:56 smithi157 ceph-mon[117693]: pgmap v867: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:57.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:56 smithi181 ceph-mon[101094]: pgmap v867: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:09:59.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:58 smithi157 ceph-mon[117693]: pgmap v868: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:09:59.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:58 smithi181 ceph-mon[101094]: pgmap v868: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:00.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:09:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:00.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:09:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:01.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T09:10:01.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:00 smithi157 ceph-mon[117693]: pgmap v869: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:01.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T09:10:01.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:00 smithi181 ceph-mon[101094]: pgmap v869: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:03.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:02 smithi157 ceph-mon[117693]: pgmap v870: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:03.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:02 smithi181 ceph-mon[101094]: pgmap v870: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:04.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:04 smithi157 ceph-mon[117693]: pgmap v871: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:05.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:04 smithi181 ceph-mon[101094]: pgmap v871: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:07.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:06 smithi157 ceph-mon[117693]: pgmap v872: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:07.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:06 smithi181 ceph-mon[101094]: pgmap v872: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:09.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:08 smithi157 ceph-mon[117693]: pgmap v873: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:09.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:08 smithi181 ceph-mon[101094]: pgmap v873: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:11.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:10 smithi157 ceph-mon[117693]: pgmap v874: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:11.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:10 smithi181 ceph-mon[101094]: pgmap v874: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:13.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:12 smithi157 ceph-mon[117693]: pgmap v875: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:13.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:12 smithi181 ceph-mon[101094]: pgmap v875: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:14.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:14.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:15.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:15 smithi157 ceph-mon[117693]: pgmap v876: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:15.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:15 smithi181 ceph-mon[101094]: pgmap v876: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:17.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:16 smithi157 ceph-mon[117693]: pgmap v877: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:17.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:16 smithi181 ceph-mon[101094]: pgmap v877: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:18 smithi157 ceph-mon[117693]: pgmap v878: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:19.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:18 smithi181 ceph-mon[101094]: pgmap v878: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:21.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:20 smithi157 ceph-mon[117693]: pgmap v879: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:21.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:20 smithi181 ceph-mon[101094]: pgmap v879: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:22.955 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:22 smithi181 ceph-mon[101094]: pgmap v880: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:23.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:22 smithi157 ceph-mon[117693]: pgmap v880: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:25.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:24 smithi157 ceph-mon[117693]: pgmap v881: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:25.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:24 smithi181 ceph-mon[101094]: pgmap v881: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:27.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:26 smithi157 ceph-mon[117693]: pgmap v882: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:27.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:26 smithi181 ceph-mon[101094]: pgmap v882: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:29.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:28 smithi157 ceph-mon[117693]: pgmap v883: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:29.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:28 smithi181 ceph-mon[101094]: pgmap v883: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:30.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:31.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:30 smithi157 ceph-mon[117693]: pgmap v884: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:31.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:30 smithi181 ceph-mon[101094]: pgmap v884: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:33.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:32 smithi157 ceph-mon[117693]: pgmap v885: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:33.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:32 smithi181 ceph-mon[101094]: pgmap v885: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:35.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:34 smithi157 ceph-mon[117693]: pgmap v886: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:35.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:34 smithi181 ceph-mon[101094]: pgmap v886: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:37.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:36 smithi157 ceph-mon[117693]: pgmap v887: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:37.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:36 smithi181 ceph-mon[101094]: pgmap v887: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:39.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:38 smithi157 ceph-mon[117693]: pgmap v888: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:39.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:38 smithi181 ceph-mon[101094]: pgmap v888: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:41.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:40 smithi157 ceph-mon[117693]: pgmap v889: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:41.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:40 smithi181 ceph-mon[101094]: pgmap v889: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:10:43.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:42 smithi157 ceph-mon[117693]: pgmap v890: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:43.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:42 smithi181 ceph-mon[101094]: pgmap v890: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:44.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:44.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:10:45.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:45 smithi157 ceph-mon[117693]: pgmap v891: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:45.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:45 smithi181 ceph-mon[101094]: pgmap v891: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:47.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:46 smithi157 ceph-mon[117693]: pgmap v892: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:47.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:46 smithi181 ceph-mon[101094]: pgmap v892: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:49.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:48 smithi157 ceph-mon[117693]: pgmap v893: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:49.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:48 smithi181 ceph-mon[101094]: pgmap v893: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:50.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:10:50.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:10:51.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:51 smithi157 ceph-mon[117693]: pgmap v894: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:51.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:51.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:51.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:51 smithi181 ceph-mon[101094]: pgmap v894: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:51.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:51.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:53.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:52 smithi157 ceph-mon[117693]: pgmap v895: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:10:53.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:52 smithi181 ceph-mon[101094]: pgmap v895: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:10:54.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:54 smithi157 ceph-mon[117693]: pgmap v896: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:55.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:54 smithi181 ceph-mon[101094]: pgmap v896: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:57.325 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:57.325 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:57.325 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:57 smithi181 ceph-mon[101094]: pgmap v897: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:57.325 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:10:57.325 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:10:57.325 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:57.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:57.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:57.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:57 smithi157 ceph-mon[117693]: pgmap v897: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:10:57.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:10:57.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:10:57.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:10:59.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:58 smithi157 ceph-mon[117693]: pgmap v898: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:10:59.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:58 smithi181 ceph-mon[101094]: pgmap v898: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:00.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:10:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:00.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:10:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:01.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:00 smithi157 ceph-mon[117693]: pgmap v899: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:01.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:00 smithi181 ceph-mon[101094]: pgmap v899: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:03.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:02 smithi157 ceph-mon[117693]: pgmap v900: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:03.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:02 smithi181 ceph-mon[101094]: pgmap v900: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:05.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:04 smithi157 ceph-mon[117693]: pgmap v901: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:05.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:04 smithi181 ceph-mon[101094]: pgmap v901: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:07.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:06 smithi157 ceph-mon[117693]: pgmap v902: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:07.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:06 smithi181 ceph-mon[101094]: pgmap v902: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:09.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:08 smithi157 ceph-mon[117693]: pgmap v903: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:09.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:08 smithi181 ceph-mon[101094]: pgmap v903: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:11.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:10 smithi157 ceph-mon[117693]: pgmap v904: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:11.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:10 smithi181 ceph-mon[101094]: pgmap v904: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:13.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:12 smithi157 ceph-mon[117693]: pgmap v905: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:13.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:12 smithi181 ceph-mon[101094]: pgmap v905: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:14.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:14.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:15.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:15 smithi181 ceph-mon[101094]: pgmap v906: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:15.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:15 smithi157 ceph-mon[117693]: pgmap v906: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:17.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:16 smithi157 ceph-mon[117693]: pgmap v907: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:17.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:16 smithi181 ceph-mon[101094]: pgmap v907: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:19.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:18 smithi157 ceph-mon[117693]: pgmap v908: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:19.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:18 smithi181 ceph-mon[101094]: pgmap v908: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:21.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:20 smithi157 ceph-mon[117693]: pgmap v909: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:21.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:20 smithi181 ceph-mon[101094]: pgmap v909: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:23.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:22 smithi157 ceph-mon[117693]: pgmap v910: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:23.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:22 smithi181 ceph-mon[101094]: pgmap v910: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:25.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:24 smithi157 ceph-mon[117693]: pgmap v911: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:25.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:24 smithi181 ceph-mon[101094]: pgmap v911: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:27.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:26 smithi157 ceph-mon[117693]: pgmap v912: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:27.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:26 smithi181 ceph-mon[101094]: pgmap v912: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:29.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:28 smithi157 ceph-mon[117693]: pgmap v913: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:29.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:28 smithi181 ceph-mon[101094]: pgmap v913: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:30.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:30.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:31.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:30 smithi157 ceph-mon[117693]: pgmap v914: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:31.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:30 smithi181 ceph-mon[101094]: pgmap v914: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:33.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:32 smithi157 ceph-mon[117693]: pgmap v915: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:33.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:32 smithi181 ceph-mon[101094]: pgmap v915: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:35.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:34 smithi157 ceph-mon[117693]: pgmap v916: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:35.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:34 smithi181 ceph-mon[101094]: pgmap v916: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:37.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:36 smithi157 ceph-mon[117693]: pgmap v917: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:37.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:36 smithi181 ceph-mon[101094]: pgmap v917: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:39.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:38 smithi157 ceph-mon[117693]: pgmap v918: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:39.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:38 smithi181 ceph-mon[101094]: pgmap v918: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:41.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:40 smithi157 ceph-mon[117693]: pgmap v919: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:41.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:40 smithi181 ceph-mon[101094]: pgmap v919: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:43.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:42 smithi157 ceph-mon[117693]: pgmap v920: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:43.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:42 smithi181 ceph-mon[101094]: pgmap v920: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:44.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:44.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:11:45.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:45 smithi181 ceph-mon[101094]: pgmap v921: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:45.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:45 smithi157 ceph-mon[117693]: pgmap v921: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:47.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:46 smithi157 ceph-mon[117693]: pgmap v922: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:47.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:46 smithi181 ceph-mon[101094]: pgmap v922: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:49.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:48 smithi157 ceph-mon[117693]: pgmap v923: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:49.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:48 smithi181 ceph-mon[101094]: pgmap v923: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:51.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:50 smithi157 ceph-mon[117693]: pgmap v924: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:51.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:50 smithi181 ceph-mon[101094]: pgmap v924: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:11:53.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:52 smithi157 ceph-mon[117693]: pgmap v925: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:53.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:52 smithi181 ceph-mon[101094]: pgmap v925: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:55.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:54 smithi157 ceph-mon[117693]: pgmap v926: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:55.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:54 smithi181 ceph-mon[101094]: pgmap v926: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:57.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:56 smithi157 ceph-mon[117693]: pgmap v927: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:57.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:56 smithi181 ceph-mon[101094]: pgmap v927: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:11:58.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:57 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:11:58.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:57 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:11:59.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:11:59.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:11:59.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:11:59.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:11:58 smithi157 ceph-mon[117693]: pgmap v928: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:11:59.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:11:59.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:11:59.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:11:59.075 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:11:58 smithi181 ceph-mon[101094]: pgmap v928: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:00.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:00.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:01.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:01 smithi157 ceph-mon[117693]: pgmap v929: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:01.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:01 smithi181 ceph-mon[101094]: pgmap v929: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:03.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:02 smithi157 ceph-mon[117693]: pgmap v930: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:03.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:02 smithi181 ceph-mon[101094]: pgmap v930: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:05.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:05 smithi157 ceph-mon[117693]: pgmap v931: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:05.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:05 smithi181 ceph-mon[101094]: pgmap v931: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:07.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:06 smithi157 ceph-mon[117693]: pgmap v932: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:07.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:06 smithi181 ceph-mon[101094]: pgmap v932: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:09.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:08 smithi157 ceph-mon[117693]: pgmap v933: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:09.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:08 smithi181 ceph-mon[101094]: pgmap v933: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:11.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:10 smithi157 ceph-mon[117693]: pgmap v934: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:11.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:10 smithi181 ceph-mon[101094]: pgmap v934: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:13.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:12 smithi157 ceph-mon[117693]: pgmap v935: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:13.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:12 smithi181 ceph-mon[101094]: pgmap v935: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:14.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:14.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:15.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:15 smithi181 ceph-mon[101094]: pgmap v936: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:15.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:15 smithi157 ceph-mon[117693]: pgmap v936: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:17.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:16 smithi157 ceph-mon[117693]: pgmap v937: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:17.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:16 smithi181 ceph-mon[101094]: pgmap v937: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:19.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:18 smithi157 ceph-mon[117693]: pgmap v938: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:19.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:18 smithi181 ceph-mon[101094]: pgmap v938: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:21.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:20 smithi157 ceph-mon[117693]: pgmap v939: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:21.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:20 smithi181 ceph-mon[101094]: pgmap v939: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:23.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:22 smithi157 ceph-mon[117693]: pgmap v940: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:23.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:22 smithi181 ceph-mon[101094]: pgmap v940: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:25.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:24 smithi157 ceph-mon[117693]: pgmap v941: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:25.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:24 smithi181 ceph-mon[101094]: pgmap v941: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:27.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:26 smithi157 ceph-mon[117693]: pgmap v942: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:27.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:26 smithi181 ceph-mon[101094]: pgmap v942: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:29.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:28 smithi157 ceph-mon[117693]: pgmap v943: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:29.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:28 smithi181 ceph-mon[101094]: pgmap v943: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:30.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:30.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:31.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:30 smithi157 ceph-mon[117693]: pgmap v944: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:31.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:30 smithi181 ceph-mon[101094]: pgmap v944: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:33.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:32 smithi157 ceph-mon[117693]: pgmap v945: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:33.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:32 smithi181 ceph-mon[101094]: pgmap v945: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:35.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:34 smithi157 ceph-mon[117693]: pgmap v946: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:35.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:34 smithi181 ceph-mon[101094]: pgmap v946: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:37.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:36 smithi157 ceph-mon[117693]: pgmap v947: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:37.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:36 smithi181 ceph-mon[101094]: pgmap v947: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:39.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:38 smithi157 ceph-mon[117693]: pgmap v948: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:12:39.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:38 smithi181 ceph-mon[101094]: pgmap v948: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:12:41.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:40 smithi157 ceph-mon[117693]: pgmap v949: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:12:41.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:40 smithi181 ceph-mon[101094]: pgmap v949: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:12:43.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:42 smithi157 ceph-mon[117693]: pgmap v950: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:12:43.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:42 smithi181 ceph-mon[101094]: pgmap v950: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:12:44.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:44.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:12:45.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:45 smithi157 ceph-mon[117693]: pgmap v951: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:12:45.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:45 smithi181 ceph-mon[101094]: pgmap v951: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:12:47.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:46 smithi157 ceph-mon[117693]: pgmap v952: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:47.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:46 smithi181 ceph-mon[101094]: pgmap v952: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:49.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:48 smithi157 ceph-mon[117693]: pgmap v953: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:49.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:48 smithi181 ceph-mon[101094]: pgmap v953: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:51.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:50 smithi157 ceph-mon[117693]: pgmap v954: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:51.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:50 smithi181 ceph-mon[101094]: pgmap v954: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:12:53.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:52 smithi157 ceph-mon[117693]: pgmap v955: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:53.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:52 smithi181 ceph-mon[101094]: pgmap v955: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:54 smithi157 ceph-mon[117693]: pgmap v956: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:55.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:54 smithi181 ceph-mon[101094]: pgmap v956: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:57.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:56 smithi157 ceph-mon[117693]: pgmap v957: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:57.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:56 smithi181 ceph-mon[101094]: pgmap v957: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:12:58.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:58 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:12:58.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:58 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:12:59.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:59 smithi157 ceph-mon[117693]: pgmap v958: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:59.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:12:59.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:12:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:12:59.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:59 smithi181 ceph-mon[101094]: pgmap v958: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:12:59.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:12:59.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:12:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:13:00.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:00.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:13:00.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:13:00.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:13:00.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:00.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:13:00.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:13:00.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:13:01.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:01 smithi157 ceph-mon[117693]: pgmap v959: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:01.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:01 smithi181 ceph-mon[101094]: pgmap v959: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:03.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:02 smithi157 ceph-mon[117693]: pgmap v960: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:03.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:02 smithi181 ceph-mon[101094]: pgmap v960: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:05.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:04 smithi157 ceph-mon[117693]: pgmap v961: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:05.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:04 smithi181 ceph-mon[101094]: pgmap v961: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:07.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:06 smithi157 ceph-mon[117693]: pgmap v962: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:07.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:06 smithi181 ceph-mon[101094]: pgmap v962: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:09.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:08 smithi157 ceph-mon[117693]: pgmap v963: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:09.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:08 smithi181 ceph-mon[101094]: pgmap v963: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:11.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:10 smithi157 ceph-mon[117693]: pgmap v964: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:11.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:10 smithi181 ceph-mon[101094]: pgmap v964: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:13.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:12 smithi157 ceph-mon[117693]: pgmap v965: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:13.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:12 smithi181 ceph-mon[101094]: pgmap v965: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:14.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:14.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:15.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:15 smithi181 ceph-mon[101094]: pgmap v966: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:15.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:15 smithi157 ceph-mon[117693]: pgmap v966: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:17.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:16 smithi157 ceph-mon[117693]: pgmap v967: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:17.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:16 smithi181 ceph-mon[101094]: pgmap v967: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:19.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:18 smithi157 ceph-mon[117693]: pgmap v968: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:19.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:18 smithi181 ceph-mon[101094]: pgmap v968: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:21.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:20 smithi157 ceph-mon[117693]: pgmap v969: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:21.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:20 smithi181 ceph-mon[101094]: pgmap v969: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:23.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:22 smithi157 ceph-mon[117693]: pgmap v970: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:23.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:22 smithi181 ceph-mon[101094]: pgmap v970: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:25.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:24 smithi157 ceph-mon[117693]: pgmap v971: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:25.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:24 smithi181 ceph-mon[101094]: pgmap v971: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:27.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:26 smithi157 ceph-mon[117693]: pgmap v972: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:27.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:26 smithi181 ceph-mon[101094]: pgmap v972: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:29.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:28 smithi157 ceph-mon[117693]: pgmap v973: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:29.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:28 smithi181 ceph-mon[101094]: pgmap v973: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:30.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:30.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:31.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:30 smithi157 ceph-mon[117693]: pgmap v974: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:31.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:30 smithi181 ceph-mon[101094]: pgmap v974: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:33.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:32 smithi157 ceph-mon[117693]: pgmap v975: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:33.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:32 smithi181 ceph-mon[101094]: pgmap v975: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:35.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:34 smithi157 ceph-mon[117693]: pgmap v976: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:35.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:34 smithi181 ceph-mon[101094]: pgmap v976: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:37.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:36 smithi157 ceph-mon[117693]: pgmap v977: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:37.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:36 smithi181 ceph-mon[101094]: pgmap v977: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:39.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:38 smithi157 ceph-mon[117693]: pgmap v978: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:39.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:38 smithi181 ceph-mon[101094]: pgmap v978: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:41.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:40 smithi157 ceph-mon[117693]: pgmap v979: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:41.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:40 smithi181 ceph-mon[101094]: pgmap v979: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:43.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:42 smithi157 ceph-mon[117693]: pgmap v980: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:43.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:42 smithi181 ceph-mon[101094]: pgmap v980: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:44.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:44.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:13:45.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:45 smithi181 ceph-mon[101094]: pgmap v981: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:45.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:45 smithi157 ceph-mon[117693]: pgmap v981: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:47.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:46 smithi157 ceph-mon[117693]: pgmap v982: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:47.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:46 smithi181 ceph-mon[101094]: pgmap v982: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:49.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:48 smithi157 ceph-mon[117693]: pgmap v983: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:49.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:48 smithi181 ceph-mon[101094]: pgmap v983: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:51.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:50 smithi157 ceph-mon[117693]: pgmap v984: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:51.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:50 smithi181 ceph-mon[101094]: pgmap v984: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:13:53.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:52 smithi157 ceph-mon[117693]: pgmap v985: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:53.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:52 smithi181 ceph-mon[101094]: pgmap v985: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:54 smithi157 ceph-mon[117693]: pgmap v986: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:55.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:54 smithi181 ceph-mon[101094]: pgmap v986: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:57.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:56 smithi157 ceph-mon[117693]: pgmap v987: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:57.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:56 smithi181 ceph-mon[101094]: pgmap v987: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:13:59.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:58 smithi157 ceph-mon[117693]: pgmap v988: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:13:59.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:58 smithi181 ceph-mon[101094]: pgmap v988: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:00.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:13:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:00.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:13:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:01.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:14:01.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:14:01.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:14:01.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:14:01.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:00 smithi157 ceph-mon[117693]: pgmap v989: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:01.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:14:01.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:14:01.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:14:01.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:14:01.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:00 smithi181 ceph-mon[101094]: pgmap v989: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:03.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:02 smithi157 ceph-mon[117693]: pgmap v990: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:03.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:02 smithi181 ceph-mon[101094]: pgmap v990: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:05.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:04 smithi157 ceph-mon[117693]: pgmap v991: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:05.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:04 smithi181 ceph-mon[101094]: pgmap v991: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:07.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:06 smithi157 ceph-mon[117693]: pgmap v992: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:07.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:06 smithi181 ceph-mon[101094]: pgmap v992: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:09.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:08 smithi157 ceph-mon[117693]: pgmap v993: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:09.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:08 smithi181 ceph-mon[101094]: pgmap v993: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:11.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:10 smithi157 ceph-mon[117693]: pgmap v994: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:11.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:10 smithi181 ceph-mon[101094]: pgmap v994: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:13.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:12 smithi157 ceph-mon[117693]: pgmap v995: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:13.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:12 smithi181 ceph-mon[101094]: pgmap v995: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:14.540 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:14.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:15.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:15 smithi181 ceph-mon[101094]: pgmap v996: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:15.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:15 smithi157 ceph-mon[117693]: pgmap v996: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:17.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:16 smithi157 ceph-mon[117693]: pgmap v997: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:17.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:16 smithi181 ceph-mon[101094]: pgmap v997: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:19.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:18 smithi157 ceph-mon[117693]: pgmap v998: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:19.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:18 smithi181 ceph-mon[101094]: pgmap v998: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:21.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:20 smithi157 ceph-mon[117693]: pgmap v999: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:21.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:20 smithi181 ceph-mon[101094]: pgmap v999: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:23.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:22 smithi157 ceph-mon[117693]: pgmap v1000: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:23.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:22 smithi181 ceph-mon[101094]: pgmap v1000: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:25.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:24 smithi157 ceph-mon[117693]: pgmap v1001: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:25.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:24 smithi181 ceph-mon[101094]: pgmap v1001: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:27.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:26 smithi157 ceph-mon[117693]: pgmap v1002: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:27.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:26 smithi181 ceph-mon[101094]: pgmap v1002: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:29.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:28 smithi157 ceph-mon[117693]: pgmap v1003: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:29.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:28 smithi181 ceph-mon[101094]: pgmap v1003: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:30.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:30.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:31.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:30 smithi157 ceph-mon[117693]: pgmap v1004: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:31.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:30 smithi181 ceph-mon[101094]: pgmap v1004: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:33.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:32 smithi157 ceph-mon[117693]: pgmap v1005: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:33.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:32 smithi181 ceph-mon[101094]: pgmap v1005: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:35.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:34 smithi157 ceph-mon[117693]: pgmap v1006: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:35.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:34 smithi181 ceph-mon[101094]: pgmap v1006: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:37.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:36 smithi157 ceph-mon[117693]: pgmap v1007: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:37.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:36 smithi181 ceph-mon[101094]: pgmap v1007: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:39.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:38 smithi157 ceph-mon[117693]: pgmap v1008: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:39.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:38 smithi181 ceph-mon[101094]: pgmap v1008: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:41.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:40 smithi157 ceph-mon[117693]: pgmap v1009: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:41.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:40 smithi181 ceph-mon[101094]: pgmap v1009: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:43.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:42 smithi157 ceph-mon[117693]: pgmap v1010: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:43.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:42 smithi181 ceph-mon[101094]: pgmap v1010: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:44.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:44.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:14:45.573 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:45 smithi181 ceph-mon[101094]: pgmap v1011: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:45.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:45 smithi157 ceph-mon[117693]: pgmap v1011: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:47.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:46 smithi157 ceph-mon[117693]: pgmap v1012: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:47.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:46 smithi181 ceph-mon[101094]: pgmap v1012: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:49.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:48 smithi157 ceph-mon[117693]: pgmap v1013: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:49.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:48 smithi181 ceph-mon[101094]: pgmap v1013: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:51.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:50 smithi157 ceph-mon[117693]: pgmap v1014: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:51.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:50 smithi181 ceph-mon[101094]: pgmap v1014: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:14:53.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:52 smithi157 ceph-mon[117693]: pgmap v1015: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:53.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:52 smithi181 ceph-mon[101094]: pgmap v1015: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:55.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:54 smithi157 ceph-mon[117693]: pgmap v1016: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:55.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:54 smithi181 ceph-mon[101094]: pgmap v1016: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:57.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:56 smithi157 ceph-mon[117693]: pgmap v1017: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:57.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:56 smithi181 ceph-mon[101094]: pgmap v1017: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:14:59.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:58 smithi157 ceph-mon[117693]: pgmap v1018: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:14:59.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:58 smithi181 ceph-mon[101094]: pgmap v1018: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:00.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:14:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:00.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:14:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:01.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:00 smithi157 ceph-mon[117693]: pgmap v1019: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:01.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:00 smithi181 ceph-mon[101094]: pgmap v1019: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:02.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:15:02.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:15:02.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:15:02.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:15:02.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:15:02.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:15:02.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:15:02.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:15:03.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:02 smithi157 ceph-mon[117693]: pgmap v1020: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:03.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:02 smithi181 ceph-mon[101094]: pgmap v1020: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:05.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:04 smithi157 ceph-mon[117693]: pgmap v1021: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:05.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:04 smithi181 ceph-mon[101094]: pgmap v1021: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:07.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:06 smithi157 ceph-mon[117693]: pgmap v1022: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:07.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:06 smithi181 ceph-mon[101094]: pgmap v1022: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:09.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:08 smithi157 ceph-mon[117693]: pgmap v1023: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:09.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:08 smithi181 ceph-mon[101094]: pgmap v1023: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:11.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:10 smithi157 ceph-mon[117693]: pgmap v1024: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:11.074 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:10 smithi181 ceph-mon[101094]: pgmap v1024: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:13.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:12 smithi157 ceph-mon[117693]: pgmap v1025: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:13.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:12 smithi181 ceph-mon[101094]: pgmap v1025: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:14.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:14.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:15.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:15 smithi181 ceph-mon[101094]: pgmap v1026: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:15.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:15 smithi157 ceph-mon[117693]: pgmap v1026: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:17.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:16 smithi157 ceph-mon[117693]: pgmap v1027: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:17.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:16 smithi181 ceph-mon[101094]: pgmap v1027: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:19.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:18 smithi157 ceph-mon[117693]: pgmap v1028: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:19.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:18 smithi181 ceph-mon[101094]: pgmap v1028: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:21.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:20 smithi157 ceph-mon[117693]: pgmap v1029: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:21.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:20 smithi181 ceph-mon[101094]: pgmap v1029: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:23.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:22 smithi157 ceph-mon[117693]: pgmap v1030: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:23.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:22 smithi181 ceph-mon[101094]: pgmap v1030: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:25.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:24 smithi157 ceph-mon[117693]: pgmap v1031: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:25.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:24 smithi181 ceph-mon[101094]: pgmap v1031: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:27.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:26 smithi157 ceph-mon[117693]: pgmap v1032: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:27.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:26 smithi181 ceph-mon[101094]: pgmap v1032: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:29.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:28 smithi157 ceph-mon[117693]: pgmap v1033: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:29.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:28 smithi181 ceph-mon[101094]: pgmap v1033: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:30.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:30.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:31.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:30 smithi157 ceph-mon[117693]: pgmap v1034: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:31.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:30 smithi181 ceph-mon[101094]: pgmap v1034: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:33.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:32 smithi157 ceph-mon[117693]: pgmap v1035: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:33.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:32 smithi181 ceph-mon[101094]: pgmap v1035: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:35.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:34 smithi157 ceph-mon[117693]: pgmap v1036: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:35.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:34 smithi181 ceph-mon[101094]: pgmap v1036: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:37.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:36 smithi157 ceph-mon[117693]: pgmap v1037: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:37.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:36 smithi181 ceph-mon[101094]: pgmap v1037: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:39.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:38 smithi157 ceph-mon[117693]: pgmap v1038: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:39.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:38 smithi181 ceph-mon[101094]: pgmap v1038: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:41.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:40 smithi157 ceph-mon[117693]: pgmap v1039: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:41.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:40 smithi181 ceph-mon[101094]: pgmap v1039: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:43.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:42 smithi157 ceph-mon[117693]: pgmap v1040: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:43.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:42 smithi181 ceph-mon[101094]: pgmap v1040: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:44.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:44.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:15:45.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:45 smithi181 ceph-mon[101094]: pgmap v1041: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:45.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:45 smithi157 ceph-mon[117693]: pgmap v1041: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:47.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:46 smithi157 ceph-mon[117693]: pgmap v1042: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:47.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:46 smithi181 ceph-mon[101094]: pgmap v1042: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:49.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:48 smithi157 ceph-mon[117693]: pgmap v1043: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:49.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:48 smithi181 ceph-mon[101094]: pgmap v1043: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:51.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:50 smithi157 ceph-mon[117693]: pgmap v1044: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:51.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:50 smithi181 ceph-mon[101094]: pgmap v1044: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:15:53.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:52 smithi157 ceph-mon[117693]: pgmap v1045: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:53.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:52 smithi181 ceph-mon[101094]: pgmap v1045: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:55.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:54 smithi157 ceph-mon[117693]: pgmap v1046: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:55.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:54 smithi181 ceph-mon[101094]: pgmap v1046: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:57.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:56 smithi157 ceph-mon[117693]: pgmap v1047: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:57.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:56 smithi181 ceph-mon[101094]: pgmap v1047: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:15:59.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:58 smithi157 ceph-mon[117693]: pgmap v1048: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:15:59.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:58 smithi181 ceph-mon[101094]: pgmap v1048: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:00.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:15:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:00.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:15:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:01.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:00 smithi157 ceph-mon[117693]: pgmap v1049: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:01.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:00 smithi181 ceph-mon[101094]: pgmap v1049: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:02.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:16:02.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:16:03.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:02 smithi157 ceph-mon[117693]: pgmap v1050: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:03.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:02 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:16:03.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:02 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:16:03.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:02 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:16:03.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:02 smithi181 ceph-mon[101094]: pgmap v1050: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:03.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:02 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:16:03.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:02 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:16:03.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:02 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:16:05.540 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:05 smithi157 ceph-mon[117693]: pgmap v1051: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:05.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:05 smithi181 ceph-mon[101094]: pgmap v1051: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:07.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:06 smithi157 ceph-mon[117693]: pgmap v1052: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:07.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:06 smithi181 ceph-mon[101094]: pgmap v1052: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:09.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:08 smithi157 ceph-mon[117693]: pgmap v1053: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:09.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:08 smithi181 ceph-mon[101094]: pgmap v1053: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:11.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:10 smithi157 ceph-mon[117693]: pgmap v1054: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:11.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:10 smithi181 ceph-mon[101094]: pgmap v1054: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:13.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:12 smithi157 ceph-mon[117693]: pgmap v1055: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:13.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:12 smithi181 ceph-mon[101094]: pgmap v1055: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:14.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:14.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:15.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:15 smithi181 ceph-mon[101094]: pgmap v1056: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:15.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:15 smithi157 ceph-mon[117693]: pgmap v1056: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:17.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:16 smithi157 ceph-mon[117693]: pgmap v1057: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:17.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:16 smithi181 ceph-mon[101094]: pgmap v1057: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:19.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:18 smithi157 ceph-mon[117693]: pgmap v1058: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:19.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:18 smithi181 ceph-mon[101094]: pgmap v1058: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:21.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:20 smithi157 ceph-mon[117693]: pgmap v1059: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:21.073 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:20 smithi181 ceph-mon[101094]: pgmap v1059: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:23.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:22 smithi157 ceph-mon[117693]: pgmap v1060: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:23.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:22 smithi181 ceph-mon[101094]: pgmap v1060: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:25.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:24 smithi157 ceph-mon[117693]: pgmap v1061: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:25.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:24 smithi181 ceph-mon[101094]: pgmap v1061: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:27.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:26 smithi157 ceph-mon[117693]: pgmap v1062: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:27.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:26 smithi181 ceph-mon[101094]: pgmap v1062: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:29.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:28 smithi157 ceph-mon[117693]: pgmap v1063: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:29.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:28 smithi181 ceph-mon[101094]: pgmap v1063: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:30.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:30.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:31.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:30 smithi157 ceph-mon[117693]: pgmap v1064: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:31.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:30 smithi181 ceph-mon[101094]: pgmap v1064: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:33.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:32 smithi157 ceph-mon[117693]: pgmap v1065: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:33.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:32 smithi181 ceph-mon[101094]: pgmap v1065: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:35.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:34 smithi157 ceph-mon[117693]: pgmap v1066: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:35.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:34 smithi181 ceph-mon[101094]: pgmap v1066: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:37.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:36 smithi157 ceph-mon[117693]: pgmap v1067: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:37.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:36 smithi181 ceph-mon[101094]: pgmap v1067: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:39.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:38 smithi157 ceph-mon[117693]: pgmap v1068: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:39.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:38 smithi181 ceph-mon[101094]: pgmap v1068: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:41.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:40 smithi157 ceph-mon[117693]: pgmap v1069: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:41.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:40 smithi181 ceph-mon[101094]: pgmap v1069: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:43.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:42 smithi157 ceph-mon[117693]: pgmap v1070: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:43.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:42 smithi181 ceph-mon[101094]: pgmap v1070: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:44.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:44.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:16:45.572 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:45 smithi181 ceph-mon[101094]: pgmap v1071: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:45.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:45 smithi157 ceph-mon[117693]: pgmap v1071: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:47.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:46 smithi157 ceph-mon[117693]: pgmap v1072: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:47.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:46 smithi181 ceph-mon[101094]: pgmap v1072: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:49.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:48 smithi157 ceph-mon[117693]: pgmap v1073: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:49.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:48 smithi181 ceph-mon[101094]: pgmap v1073: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:51.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:50 smithi157 ceph-mon[117693]: pgmap v1074: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:51.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:50 smithi181 ceph-mon[101094]: pgmap v1074: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:16:53.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:52 smithi157 ceph-mon[117693]: pgmap v1075: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:53.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:52 smithi181 ceph-mon[101094]: pgmap v1075: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:55.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:54 smithi157 ceph-mon[117693]: pgmap v1076: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:55.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:54 smithi181 ceph-mon[101094]: pgmap v1076: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:57.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:56 smithi157 ceph-mon[117693]: pgmap v1077: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:57.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:56 smithi181 ceph-mon[101094]: pgmap v1077: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:16:59.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:58 smithi157 ceph-mon[117693]: pgmap v1078: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:16:59.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:58 smithi181 ceph-mon[101094]: pgmap v1078: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:00.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:16:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:00.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:16:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:01.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:00 smithi157 ceph-mon[117693]: pgmap v1079: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:01.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:00 smithi181 ceph-mon[101094]: pgmap v1079: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:03.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:02 smithi157 ceph-mon[117693]: pgmap v1080: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:03.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:02 smithi181 ceph-mon[101094]: pgmap v1080: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:04.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:03 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:17:04.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:03 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:17:04.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:03 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:17:04.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:03 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:17:04.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:03 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:17:04.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:03 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:17:04.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:03 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:17:04.072 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:03 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:17:05.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:04 smithi157 ceph-mon[117693]: pgmap v1081: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:05.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:04 smithi181 ceph-mon[101094]: pgmap v1081: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:07.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:06 smithi157 ceph-mon[117693]: pgmap v1082: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:07.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:06 smithi181 ceph-mon[101094]: pgmap v1082: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:09.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:08 smithi157 ceph-mon[117693]: pgmap v1083: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:09.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:08 smithi181 ceph-mon[101094]: pgmap v1083: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:11.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:10 smithi157 ceph-mon[117693]: pgmap v1084: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:11.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:10 smithi181 ceph-mon[101094]: pgmap v1084: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:13.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:12 smithi157 ceph-mon[117693]: pgmap v1085: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:13.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:12 smithi181 ceph-mon[101094]: pgmap v1085: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:14.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:14.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:15.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:15 smithi181 ceph-mon[101094]: pgmap v1086: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:15.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:15 smithi157 ceph-mon[117693]: pgmap v1086: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:17.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:16 smithi157 ceph-mon[117693]: pgmap v1087: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:17.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:16 smithi181 ceph-mon[101094]: pgmap v1087: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:19.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:18 smithi157 ceph-mon[117693]: pgmap v1088: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:19.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:18 smithi181 ceph-mon[101094]: pgmap v1088: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:21.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:20 smithi157 ceph-mon[117693]: pgmap v1089: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:21.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:20 smithi181 ceph-mon[101094]: pgmap v1089: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:23.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:22 smithi157 ceph-mon[117693]: pgmap v1090: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:23.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:22 smithi181 ceph-mon[101094]: pgmap v1090: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:25.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:24 smithi157 ceph-mon[117693]: pgmap v1091: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:25.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:24 smithi181 ceph-mon[101094]: pgmap v1091: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:27.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:26 smithi157 ceph-mon[117693]: pgmap v1092: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:27.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:26 smithi181 ceph-mon[101094]: pgmap v1092: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:29.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:28 smithi157 ceph-mon[117693]: pgmap v1093: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:29.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:28 smithi181 ceph-mon[101094]: pgmap v1093: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:30.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:30.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:31.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:30 smithi157 ceph-mon[117693]: pgmap v1094: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:31.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:30 smithi181 ceph-mon[101094]: pgmap v1094: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:33.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:32 smithi157 ceph-mon[117693]: pgmap v1095: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:33.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:32 smithi181 ceph-mon[101094]: pgmap v1095: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:35.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:34 smithi157 ceph-mon[117693]: pgmap v1096: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:35.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:34 smithi181 ceph-mon[101094]: pgmap v1096: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:37.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:36 smithi157 ceph-mon[117693]: pgmap v1097: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:37.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:36 smithi181 ceph-mon[101094]: pgmap v1097: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:39.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:38 smithi157 ceph-mon[117693]: pgmap v1098: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:39.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:38 smithi181 ceph-mon[101094]: pgmap v1098: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:41.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:40 smithi157 ceph-mon[117693]: pgmap v1099: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:41.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:40 smithi181 ceph-mon[101094]: pgmap v1099: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:43.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:42 smithi157 ceph-mon[117693]: pgmap v1100: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:43.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:42 smithi181 ceph-mon[101094]: pgmap v1100: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:44.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:44.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:17:45.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:45 smithi181 ceph-mon[101094]: pgmap v1101: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:45.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:45 smithi157 ceph-mon[117693]: pgmap v1101: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:47.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:46 smithi157 ceph-mon[117693]: pgmap v1102: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:47.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:46 smithi181 ceph-mon[101094]: pgmap v1102: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:49.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:48 smithi157 ceph-mon[117693]: pgmap v1103: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:49.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:48 smithi181 ceph-mon[101094]: pgmap v1103: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:51.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:50 smithi157 ceph-mon[117693]: pgmap v1104: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:51.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:50 smithi181 ceph-mon[101094]: pgmap v1104: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:17:53.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:52 smithi157 ceph-mon[117693]: pgmap v1105: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:53.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:52 smithi181 ceph-mon[101094]: pgmap v1105: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:55.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:54 smithi157 ceph-mon[117693]: pgmap v1106: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:55.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:54 smithi181 ceph-mon[101094]: pgmap v1106: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:57.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:56 smithi157 ceph-mon[117693]: pgmap v1107: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:57.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:56 smithi181 ceph-mon[101094]: pgmap v1107: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:17:59.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:58 smithi157 ceph-mon[117693]: pgmap v1108: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:17:59.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:58 smithi181 ceph-mon[101094]: pgmap v1108: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:00.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:17:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:00.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:17:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:01.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:00 smithi157 ceph-mon[117693]: pgmap v1109: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:01.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:00 smithi181 ceph-mon[101094]: pgmap v1109: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:03.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:02 smithi157 ceph-mon[117693]: pgmap v1110: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:03.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:02 smithi181 ceph-mon[101094]: pgmap v1110: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:04.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:04 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:18:04.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:04 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:18:05.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:05 smithi157 ceph-mon[117693]: pgmap v1111: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:05.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:18:05.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:18:05.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:18:05.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:05 smithi181 ceph-mon[101094]: pgmap v1111: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:05.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:18:05.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:18:05.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:18:07.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:06 smithi157 ceph-mon[117693]: pgmap v1112: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:07.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:06 smithi181 ceph-mon[101094]: pgmap v1112: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:09.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:08 smithi157 ceph-mon[117693]: pgmap v1113: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:09.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:08 smithi181 ceph-mon[101094]: pgmap v1113: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:11.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:10 smithi157 ceph-mon[117693]: pgmap v1114: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:11.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:10 smithi181 ceph-mon[101094]: pgmap v1114: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:13.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:12 smithi157 ceph-mon[117693]: pgmap v1115: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:13.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:12 smithi181 ceph-mon[101094]: pgmap v1115: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:14.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:14.788 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:15.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:15 smithi181 ceph-mon[101094]: pgmap v1116: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:15.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:15 smithi157 ceph-mon[117693]: pgmap v1116: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:17.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:16 smithi157 ceph-mon[117693]: pgmap v1117: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:17.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:16 smithi181 ceph-mon[101094]: pgmap v1117: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:19.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:18 smithi157 ceph-mon[117693]: pgmap v1118: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:19.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:18 smithi181 ceph-mon[101094]: pgmap v1118: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:21.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:20 smithi157 ceph-mon[117693]: pgmap v1119: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:21.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:20 smithi181 ceph-mon[101094]: pgmap v1119: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:23.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:22 smithi157 ceph-mon[117693]: pgmap v1120: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:23.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:22 smithi181 ceph-mon[101094]: pgmap v1120: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:25.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:24 smithi157 ceph-mon[117693]: pgmap v1121: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:25.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:24 smithi181 ceph-mon[101094]: pgmap v1121: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:27.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:26 smithi157 ceph-mon[117693]: pgmap v1122: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:27.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:26 smithi181 ceph-mon[101094]: pgmap v1122: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:29.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:28 smithi157 ceph-mon[117693]: pgmap v1123: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:29.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:28 smithi181 ceph-mon[101094]: pgmap v1123: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:30.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:30.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:31.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:30 smithi157 ceph-mon[117693]: pgmap v1124: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:31.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:30 smithi181 ceph-mon[101094]: pgmap v1124: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:33.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:32 smithi157 ceph-mon[117693]: pgmap v1125: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:33.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:32 smithi181 ceph-mon[101094]: pgmap v1125: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:35.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:34 smithi157 ceph-mon[117693]: pgmap v1126: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:35.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:34 smithi181 ceph-mon[101094]: pgmap v1126: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:37.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:36 smithi157 ceph-mon[117693]: pgmap v1127: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:37.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:36 smithi181 ceph-mon[101094]: pgmap v1127: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:39.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:38 smithi157 ceph-mon[117693]: pgmap v1128: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:39.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:38 smithi181 ceph-mon[101094]: pgmap v1128: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:41.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:40 smithi157 ceph-mon[117693]: pgmap v1129: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:41.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:40 smithi181 ceph-mon[101094]: pgmap v1129: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:43.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:42 smithi157 ceph-mon[117693]: pgmap v1130: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:43.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:42 smithi181 ceph-mon[101094]: pgmap v1130: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:44.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:44.788 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:18:45.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:45 smithi181 ceph-mon[101094]: pgmap v1131: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:45.788 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:45 smithi157 ceph-mon[117693]: pgmap v1131: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:47.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:46 smithi157 ceph-mon[117693]: pgmap v1132: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:47.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:46 smithi181 ceph-mon[101094]: pgmap v1132: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:49.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:48 smithi157 ceph-mon[117693]: pgmap v1133: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:49.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:48 smithi181 ceph-mon[101094]: pgmap v1133: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:51.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:50 smithi157 ceph-mon[117693]: pgmap v1134: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:51.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:50 smithi181 ceph-mon[101094]: pgmap v1134: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:18:53.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:52 smithi157 ceph-mon[117693]: pgmap v1135: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:53.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:52 smithi181 ceph-mon[101094]: pgmap v1135: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:55.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:54 smithi157 ceph-mon[117693]: pgmap v1136: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:55.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:54 smithi181 ceph-mon[101094]: pgmap v1136: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:57.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:56 smithi157 ceph-mon[117693]: pgmap v1137: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:57.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:56 smithi181 ceph-mon[101094]: pgmap v1137: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:18:59.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:58 smithi157 ceph-mon[117693]: pgmap v1138: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:18:59.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:58 smithi181 ceph-mon[101094]: pgmap v1138: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:00.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:18:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:00.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:18:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:01.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:00 smithi157 ceph-mon[117693]: pgmap v1139: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:01.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:00 smithi181 ceph-mon[101094]: pgmap v1139: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:03.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:02 smithi157 ceph-mon[117693]: pgmap v1140: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:03.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:02 smithi181 ceph-mon[101094]: pgmap v1140: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:05.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:04 smithi157 ceph-mon[117693]: pgmap v1141: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:05.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:04 smithi181 ceph-mon[101094]: pgmap v1141: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:06.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:05 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:19:06.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:05 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:19:07.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:19:07.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:19:07.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:19:07.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:06 smithi157 ceph-mon[117693]: pgmap v1142: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:07.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:19:07.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:19:07.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:19:07.071 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:06 smithi181 ceph-mon[101094]: pgmap v1142: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:09.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:08 smithi157 ceph-mon[117693]: pgmap v1143: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:09.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:08 smithi181 ceph-mon[101094]: pgmap v1143: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:11.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:10 smithi157 ceph-mon[117693]: pgmap v1144: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:11.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:10 smithi181 ceph-mon[101094]: pgmap v1144: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:13.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:12 smithi157 ceph-mon[117693]: pgmap v1145: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:13.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:12 smithi181 ceph-mon[101094]: pgmap v1145: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:14.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:14.788 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:15.571 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:15 smithi181 ceph-mon[101094]: pgmap v1146: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:15.788 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:15 smithi157 ceph-mon[117693]: pgmap v1146: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:17.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:16 smithi157 ceph-mon[117693]: pgmap v1147: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:17.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:16 smithi181 ceph-mon[101094]: pgmap v1147: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:19.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:18 smithi157 ceph-mon[117693]: pgmap v1148: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:19.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:18 smithi181 ceph-mon[101094]: pgmap v1148: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:22.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:21 smithi157 ceph-mon[117693]: pgmap v1149: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:22.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:21 smithi181 ceph-mon[101094]: pgmap v1149: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:24.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:23 smithi157 ceph-mon[117693]: pgmap v1150: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:24.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:23 smithi181 ceph-mon[101094]: pgmap v1150: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:26.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:25 smithi157 ceph-mon[117693]: pgmap v1151: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:26.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:25 smithi181 ceph-mon[101094]: pgmap v1151: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:28.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:27 smithi157 ceph-mon[117693]: pgmap v1152: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:28.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:27 smithi181 ceph-mon[101094]: pgmap v1152: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:30.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:29 smithi157 ceph-mon[117693]: pgmap v1153: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:30.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:30.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:29 smithi181 ceph-mon[101094]: pgmap v1153: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:30.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:32.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:31 smithi157 ceph-mon[117693]: pgmap v1154: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:32.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:31 smithi181 ceph-mon[101094]: pgmap v1154: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:34.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:33 smithi157 ceph-mon[117693]: pgmap v1155: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:34.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:33 smithi181 ceph-mon[101094]: pgmap v1155: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:36.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:35 smithi157 ceph-mon[117693]: pgmap v1156: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:36.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:35 smithi181 ceph-mon[101094]: pgmap v1156: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:38.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:37 smithi157 ceph-mon[117693]: pgmap v1157: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:38.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:37 smithi181 ceph-mon[101094]: pgmap v1157: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:40.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:39 smithi157 ceph-mon[117693]: pgmap v1158: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:40.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:39 smithi181 ceph-mon[101094]: pgmap v1158: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:42.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:41 smithi181 ceph-mon[101094]: pgmap v1159: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:42.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:41 smithi157 ceph-mon[117693]: pgmap v1159: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:44.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:43 smithi157 ceph-mon[117693]: pgmap v1160: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:44.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:43 smithi181 ceph-mon[101094]: pgmap v1160: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:45.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:45.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:19:46.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:45 smithi181 ceph-mon[101094]: pgmap v1161: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:46.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:45 smithi157 ceph-mon[117693]: pgmap v1161: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:48.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:47 smithi181 ceph-mon[101094]: pgmap v1162: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:48.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:47 smithi157 ceph-mon[117693]: pgmap v1162: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:50.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:49 smithi181 ceph-mon[101094]: pgmap v1163: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:50.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:49 smithi157 ceph-mon[117693]: pgmap v1163: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:52.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:51 smithi181 ceph-mon[101094]: pgmap v1164: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:52.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:51 smithi157 ceph-mon[117693]: pgmap v1164: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:19:54.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:53 smithi157 ceph-mon[117693]: pgmap v1165: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:54.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:53 smithi181 ceph-mon[101094]: pgmap v1165: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:56.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:55 smithi157 ceph-mon[117693]: pgmap v1166: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:56.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:55 smithi181 ceph-mon[101094]: pgmap v1166: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:19:58.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:57 smithi157 ceph-mon[117693]: pgmap v1167: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:19:58.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:57 smithi181 ceph-mon[101094]: pgmap v1167: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:00.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:59 smithi157 ceph-mon[117693]: pgmap v1168: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:20:00.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:19:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:00.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:59 smithi181 ceph-mon[101094]: pgmap v1168: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:20:00.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:19:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:01.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T09:20:01.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T09:20:02.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:01 smithi157 ceph-mon[117693]: pgmap v1169: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:20:02.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:01 smithi181 ceph-mon[101094]: pgmap v1169: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:20:04.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:03 smithi157 ceph-mon[117693]: pgmap v1170: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:20:04.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:03 smithi181 ceph-mon[101094]: pgmap v1170: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:20:06.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:06 smithi157 ceph-mon[117693]: pgmap v1171: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:20:06.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:20:06.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:06 smithi181 ceph-mon[101094]: pgmap v1171: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:20:06.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:20:08.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:08 smithi157 ceph-mon[117693]: pgmap v1172: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:08.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:08 smithi181 ceph-mon[101094]: pgmap v1172: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:10.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:09 smithi157 ceph-mon[117693]: pgmap v1173: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:10.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:10.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:10.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:09 smithi181 ceph-mon[101094]: pgmap v1173: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:10.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:10.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:11.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:11.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:11.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:11.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:12.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:12 smithi181 ceph-mon[101094]: pgmap v1174: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:12.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:12 smithi157 ceph-mon[117693]: pgmap v1174: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:14.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:14 smithi157 ceph-mon[117693]: pgmap v1175: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:14.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:14 smithi181 ceph-mon[101094]: pgmap v1175: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:15.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:15.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:15.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:15.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:20:15.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:20:15.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:20:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:20:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:20:16.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:16 smithi157 ceph-mon[117693]: pgmap v1176: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:16.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:16 smithi181 ceph-mon[101094]: pgmap v1176: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:18.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:18 smithi157 ceph-mon[117693]: pgmap v1177: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:18.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:18 smithi181 ceph-mon[101094]: pgmap v1177: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:20.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:20 smithi157 ceph-mon[117693]: pgmap v1178: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:20.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:20 smithi181 ceph-mon[101094]: pgmap v1178: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:22.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:22 smithi157 ceph-mon[117693]: pgmap v1179: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:22 smithi181 ceph-mon[101094]: pgmap v1179: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:24.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:24 smithi157 ceph-mon[117693]: pgmap v1180: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:24.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:24 smithi181 ceph-mon[101094]: pgmap v1180: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:26.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:26 smithi157 ceph-mon[117693]: pgmap v1181: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:26.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:26 smithi181 ceph-mon[101094]: pgmap v1181: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:28 smithi157 ceph-mon[117693]: pgmap v1182: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:28 smithi181 ceph-mon[101094]: pgmap v1182: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:30.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:30 smithi157 ceph-mon[117693]: pgmap v1183: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:30.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:30.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:30 smithi181 ceph-mon[101094]: pgmap v1183: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:30.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:32.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:32 smithi157 ceph-mon[117693]: pgmap v1184: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:32.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:32 smithi181 ceph-mon[101094]: pgmap v1184: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:34.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:34 smithi157 ceph-mon[117693]: pgmap v1185: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:34.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:34 smithi181 ceph-mon[101094]: pgmap v1185: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:36.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:36 smithi157 ceph-mon[117693]: pgmap v1186: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:36.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:36 smithi181 ceph-mon[101094]: pgmap v1186: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:38.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:38 smithi157 ceph-mon[117693]: pgmap v1187: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:38.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:38 smithi181 ceph-mon[101094]: pgmap v1187: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:40.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:40 smithi157 ceph-mon[117693]: pgmap v1188: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:40.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:40 smithi181 ceph-mon[101094]: pgmap v1188: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:42.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:42 smithi157 ceph-mon[117693]: pgmap v1189: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:42.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:42 smithi181 ceph-mon[101094]: pgmap v1189: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:44.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:44 smithi157 ceph-mon[117693]: pgmap v1190: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:44.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:44 smithi181 ceph-mon[101094]: pgmap v1190: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:45.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:45.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:46.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:46 smithi157 ceph-mon[117693]: pgmap v1191: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:46.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:46 smithi181 ceph-mon[101094]: pgmap v1191: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:48.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:48 smithi157 ceph-mon[117693]: pgmap v1192: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:48.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:48 smithi181 ceph-mon[101094]: pgmap v1192: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:50.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:50 smithi157 ceph-mon[117693]: pgmap v1193: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:50.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:50 smithi181 ceph-mon[101094]: pgmap v1193: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:52.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:52 smithi157 ceph-mon[117693]: pgmap v1194: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:52.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:52 smithi181 ceph-mon[101094]: pgmap v1194: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:20:54.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:54 smithi157 ceph-mon[117693]: pgmap v1195: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:54.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:54 smithi181 ceph-mon[101094]: pgmap v1195: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:56.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:56 smithi157 ceph-mon[117693]: pgmap v1196: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:56.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:56 smithi181 ceph-mon[101094]: pgmap v1196: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:20:58.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:58 smithi157 ceph-mon[117693]: pgmap v1197: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:58.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:58 smithi181 ceph-mon[101094]: pgmap v1197: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:20:59.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:20:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:20:59.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:20:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:00.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:00 smithi157 ceph-mon[117693]: pgmap v1198: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:00.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:00 smithi181 ceph-mon[101094]: pgmap v1198: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:02.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:02 smithi157 ceph-mon[117693]: pgmap v1199: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:02.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:02 smithi181 ceph-mon[101094]: pgmap v1199: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:04.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:04 smithi181 ceph-mon[101094]: pgmap v1200: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:04.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:04 smithi157 ceph-mon[117693]: pgmap v1200: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:06.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:06 smithi181 ceph-mon[101094]: pgmap v1201: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:06.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:06 smithi157 ceph-mon[117693]: pgmap v1201: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:08.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:08 smithi181 ceph-mon[101094]: pgmap v1202: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:08.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:08 smithi157 ceph-mon[117693]: pgmap v1202: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:10.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:10 smithi181 ceph-mon[101094]: pgmap v1203: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:10.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:10 smithi157 ceph-mon[117693]: pgmap v1203: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:12.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:12 smithi181 ceph-mon[101094]: pgmap v1204: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:12.788 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:12 smithi157 ceph-mon[117693]: pgmap v1204: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:14.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:14 smithi181 ceph-mon[101094]: pgmap v1205: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:14.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:14.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:14 smithi157 ceph-mon[117693]: pgmap v1205: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:14.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:15.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:21:15.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:21:16.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:16 smithi181 ceph-mon[101094]: pgmap v1206: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:16.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:16.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:16.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:16 smithi157 ceph-mon[117693]: pgmap v1206: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:16.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:16.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:18.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:18 smithi157 ceph-mon[117693]: pgmap v1207: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:18.820 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:18 smithi181 ceph-mon[101094]: pgmap v1207: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:20.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:20 smithi157 ceph-mon[117693]: pgmap v1208: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:20.820 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:20 smithi181 ceph-mon[101094]: pgmap v1208: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:22.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:22 smithi157 ceph-mon[117693]: pgmap v1209: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:22.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:22.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:22 smithi181 ceph-mon[101094]: pgmap v1209: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:22.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:23.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:23.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:23 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:23.820 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:23.820 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:23 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:24.722 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:24 smithi157 ceph-mon[117693]: pgmap v1210: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:24.820 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:24 smithi181 ceph-mon[101094]: pgmap v1210: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:26.703 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:26 smithi157 ceph-mon[117693]: pgmap v1211: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:26.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:26 smithi181 ceph-mon[101094]: pgmap v1211: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:28 smithi157 ceph-mon[117693]: pgmap v1212: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:28.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:28.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:21:28.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:21:28.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:28 smithi181 ceph-mon[101094]: pgmap v1212: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:21:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:21:28.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:21:30.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:30 smithi157 ceph-mon[117693]: pgmap v1213: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:30.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:30.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:30 smithi181 ceph-mon[101094]: pgmap v1213: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:30.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:32.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:32 smithi157 ceph-mon[117693]: pgmap v1214: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:32.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:32 smithi181 ceph-mon[101094]: pgmap v1214: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:34.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:34 smithi157 ceph-mon[117693]: pgmap v1215: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:34.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:34 smithi181 ceph-mon[101094]: pgmap v1215: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:36.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:36 smithi157 ceph-mon[117693]: pgmap v1216: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:36.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:36 smithi181 ceph-mon[101094]: pgmap v1216: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:38.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:38 smithi157 ceph-mon[117693]: pgmap v1217: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:38.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:38 smithi181 ceph-mon[101094]: pgmap v1217: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:40.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:40 smithi157 ceph-mon[117693]: pgmap v1218: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:40.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:40 smithi181 ceph-mon[101094]: pgmap v1218: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:42.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:42 smithi157 ceph-mon[117693]: pgmap v1219: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:42.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:42 smithi181 ceph-mon[101094]: pgmap v1219: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:44.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:44 smithi157 ceph-mon[117693]: pgmap v1220: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:44.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:44 smithi181 ceph-mon[101094]: pgmap v1220: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:45.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:45.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:21:46.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:46 smithi157 ceph-mon[117693]: pgmap v1221: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:46.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:46 smithi181 ceph-mon[101094]: pgmap v1221: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:48.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:48 smithi157 ceph-mon[117693]: pgmap v1222: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:48.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:48 smithi181 ceph-mon[101094]: pgmap v1222: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:50.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:50 smithi157 ceph-mon[117693]: pgmap v1223: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:50.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:50 smithi181 ceph-mon[101094]: pgmap v1223: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:52.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:52 smithi157 ceph-mon[117693]: pgmap v1224: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:52.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:52 smithi181 ceph-mon[101094]: pgmap v1224: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:21:54.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:54 smithi157 ceph-mon[117693]: pgmap v1225: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:54.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:54 smithi181 ceph-mon[101094]: pgmap v1225: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:56.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:56 smithi157 ceph-mon[117693]: pgmap v1226: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:56.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:56 smithi181 ceph-mon[101094]: pgmap v1226: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:21:58.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:21:58 smithi157 ceph-mon[117693]: pgmap v1227: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:21:58.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:21:58 smithi181 ceph-mon[101094]: pgmap v1227: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:00.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:00 smithi157 ceph-mon[117693]: pgmap v1228: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:00.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:00.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:00 smithi181 ceph-mon[101094]: pgmap v1228: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:00.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:02.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:02 smithi157 ceph-mon[117693]: pgmap v1229: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:02.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:02 smithi181 ceph-mon[101094]: pgmap v1229: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:04.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:04 smithi157 ceph-mon[117693]: pgmap v1230: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:04.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:04 smithi181 ceph-mon[101094]: pgmap v1230: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:06.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:06 smithi157 ceph-mon[117693]: pgmap v1231: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:06.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:06 smithi181 ceph-mon[101094]: pgmap v1231: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:08.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:08 smithi157 ceph-mon[117693]: pgmap v1232: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:08.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:08 smithi181 ceph-mon[101094]: pgmap v1232: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:10.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:10 smithi157 ceph-mon[117693]: pgmap v1233: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:10.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:10 smithi181 ceph-mon[101094]: pgmap v1233: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:12.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:12 smithi157 ceph-mon[117693]: pgmap v1234: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:12.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:12 smithi181 ceph-mon[101094]: pgmap v1234: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:14.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:14 smithi157 ceph-mon[117693]: pgmap v1235: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:14.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:14 smithi181 ceph-mon[101094]: pgmap v1235: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:15.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:15.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:16.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:16 smithi157 ceph-mon[117693]: pgmap v1236: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:16.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:16 smithi181 ceph-mon[101094]: pgmap v1236: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:18.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:18 smithi157 ceph-mon[117693]: pgmap v1237: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:18.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:18 smithi181 ceph-mon[101094]: pgmap v1237: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:20.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:20 smithi157 ceph-mon[117693]: pgmap v1238: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:20.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:20 smithi181 ceph-mon[101094]: pgmap v1238: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:22.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:22 smithi157 ceph-mon[117693]: pgmap v1239: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:22.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:22 smithi181 ceph-mon[101094]: pgmap v1239: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:24.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:24 smithi157 ceph-mon[117693]: pgmap v1240: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:24.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:24 smithi181 ceph-mon[101094]: pgmap v1240: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:26.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:26 smithi157 ceph-mon[117693]: pgmap v1241: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:26.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:26 smithi181 ceph-mon[101094]: pgmap v1241: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:28.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:28 smithi157 ceph-mon[117693]: pgmap v1242: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:22:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:22:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:22:28.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:28 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:22:28.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:28 smithi181 ceph-mon[101094]: pgmap v1242: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:28.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:22:28.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:22:28.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:22:28.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:28 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:22:30.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:30 smithi157 ceph-mon[117693]: pgmap v1243: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:30.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:30.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:30 smithi181 ceph-mon[101094]: pgmap v1243: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:30.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:32.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:32 smithi157 ceph-mon[117693]: pgmap v1244: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:32.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:32 smithi181 ceph-mon[101094]: pgmap v1244: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:34.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:34 smithi157 ceph-mon[117693]: pgmap v1245: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:34.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:34 smithi181 ceph-mon[101094]: pgmap v1245: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:36.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:36 smithi157 ceph-mon[117693]: pgmap v1246: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:36.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:36 smithi181 ceph-mon[101094]: pgmap v1246: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:38.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:38 smithi157 ceph-mon[117693]: pgmap v1247: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:38.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:38 smithi181 ceph-mon[101094]: pgmap v1247: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:40.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:40 smithi157 ceph-mon[117693]: pgmap v1248: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:40.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:40 smithi181 ceph-mon[101094]: pgmap v1248: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:42.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:42 smithi157 ceph-mon[117693]: pgmap v1249: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:42.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:42 smithi181 ceph-mon[101094]: pgmap v1249: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:44.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:44 smithi157 ceph-mon[117693]: pgmap v1250: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:44.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:44 smithi181 ceph-mon[101094]: pgmap v1250: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:45.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:45.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:46.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:46 smithi157 ceph-mon[117693]: pgmap v1251: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:46.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:46 smithi181 ceph-mon[101094]: pgmap v1251: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:48.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:48 smithi157 ceph-mon[117693]: pgmap v1252: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:48.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:48 smithi181 ceph-mon[101094]: pgmap v1252: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:50.537 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:50 smithi157 ceph-mon[117693]: pgmap v1253: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:50.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:50 smithi181 ceph-mon[101094]: pgmap v1253: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:52.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:52 smithi157 ceph-mon[117693]: pgmap v1254: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:52.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:52 smithi181 ceph-mon[101094]: pgmap v1254: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:22:54.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:54 smithi157 ceph-mon[117693]: pgmap v1255: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:54.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:54 smithi181 ceph-mon[101094]: pgmap v1255: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:56.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:56 smithi157 ceph-mon[117693]: pgmap v1256: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:56.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:56 smithi181 ceph-mon[101094]: pgmap v1256: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:22:58.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:58 smithi157 ceph-mon[117693]: pgmap v1257: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:58.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:58 smithi181 ceph-mon[101094]: pgmap v1257: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:22:59.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:22:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:22:59.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:22:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:00.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:00 smithi157 ceph-mon[117693]: pgmap v1258: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:00.570 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:00 smithi181 ceph-mon[101094]: pgmap v1258: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:02.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:02 smithi181 ceph-mon[101094]: pgmap v1259: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:02.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:02 smithi157 ceph-mon[117693]: pgmap v1259: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:04.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:04 smithi181 ceph-mon[101094]: pgmap v1260: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:04.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:04 smithi157 ceph-mon[117693]: pgmap v1260: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:06.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:06 smithi181 ceph-mon[101094]: pgmap v1261: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:06.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:06 smithi157 ceph-mon[117693]: pgmap v1261: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:08.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:08 smithi181 ceph-mon[101094]: pgmap v1262: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:08.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:08 smithi157 ceph-mon[117693]: pgmap v1262: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:10.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:10 smithi181 ceph-mon[101094]: pgmap v1263: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:10.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:10 smithi157 ceph-mon[117693]: pgmap v1263: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:12.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:12 smithi181 ceph-mon[101094]: pgmap v1264: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:12.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:12 smithi157 ceph-mon[117693]: pgmap v1264: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:14.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:14 smithi181 ceph-mon[101094]: pgmap v1265: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:14.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:14.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:14 smithi157 ceph-mon[117693]: pgmap v1265: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:14.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:16.569 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:16 smithi181 ceph-mon[101094]: pgmap v1266: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:16.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:16 smithi157 ceph-mon[117693]: pgmap v1266: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:18.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:18 smithi157 ceph-mon[117693]: pgmap v1267: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:18.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:18 smithi181 ceph-mon[101094]: pgmap v1267: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:20.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:20 smithi157 ceph-mon[117693]: pgmap v1268: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:20.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:20 smithi181 ceph-mon[101094]: pgmap v1268: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:22.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:22 smithi157 ceph-mon[117693]: pgmap v1269: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:22.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:22 smithi181 ceph-mon[101094]: pgmap v1269: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:24.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:24 smithi157 ceph-mon[117693]: pgmap v1270: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:24.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:24 smithi181 ceph-mon[101094]: pgmap v1270: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:26.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:26 smithi157 ceph-mon[117693]: pgmap v1271: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:26.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:26 smithi181 ceph-mon[101094]: pgmap v1271: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:28.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:28 smithi157 ceph-mon[117693]: pgmap v1272: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:28.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:28 smithi181 ceph-mon[101094]: pgmap v1272: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:29.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:23:29.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:23:29.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:23:29.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:29.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:23:29.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:23:29.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:23:29.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:30.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:30 smithi157 ceph-mon[117693]: pgmap v1273: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:30.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:23:30.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:23:30.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:23:30.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:30 smithi181 ceph-mon[101094]: pgmap v1273: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:30.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:23:30.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:23:30.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:23:32.787 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:32 smithi157 ceph-mon[117693]: pgmap v1274: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:32.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:32 smithi181 ceph-mon[101094]: pgmap v1274: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:34.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:34 smithi157 ceph-mon[117693]: pgmap v1275: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:34.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:34 smithi181 ceph-mon[101094]: pgmap v1275: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:36.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:36 smithi157 ceph-mon[117693]: pgmap v1276: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:36.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:36 smithi181 ceph-mon[101094]: pgmap v1276: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:38.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:38 smithi157 ceph-mon[117693]: pgmap v1277: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:38.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:38 smithi181 ceph-mon[101094]: pgmap v1277: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:40.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:40 smithi157 ceph-mon[117693]: pgmap v1278: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:40.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:40 smithi181 ceph-mon[101094]: pgmap v1278: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:42.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:42 smithi157 ceph-mon[117693]: pgmap v1279: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:42.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:42 smithi181 ceph-mon[101094]: pgmap v1279: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:44.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:44 smithi157 ceph-mon[117693]: pgmap v1280: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:44.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:44.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:44 smithi181 ceph-mon[101094]: pgmap v1280: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:44.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:46.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:46 smithi157 ceph-mon[117693]: pgmap v1281: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:46.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:46 smithi181 ceph-mon[101094]: pgmap v1281: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:48.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:48 smithi157 ceph-mon[117693]: pgmap v1282: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:48.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:48 smithi181 ceph-mon[101094]: pgmap v1282: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:50.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:50 smithi157 ceph-mon[117693]: pgmap v1283: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:50.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:50 smithi181 ceph-mon[101094]: pgmap v1283: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:52.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:52 smithi157 ceph-mon[117693]: pgmap v1284: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:52.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:52 smithi181 ceph-mon[101094]: pgmap v1284: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:23:54.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:54 smithi157 ceph-mon[117693]: pgmap v1285: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:54.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:54 smithi181 ceph-mon[101094]: pgmap v1285: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:56.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:56 smithi157 ceph-mon[117693]: pgmap v1286: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:56.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:56 smithi181 ceph-mon[101094]: pgmap v1286: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:23:58.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:58 smithi157 ceph-mon[117693]: pgmap v1287: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:58.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:58 smithi181 ceph-mon[101094]: pgmap v1287: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:23:59.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:23:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:23:59.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:23:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:00.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:00 smithi157 ceph-mon[117693]: pgmap v1288: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:00.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:00 smithi181 ceph-mon[101094]: pgmap v1288: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:02.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:02 smithi157 ceph-mon[117693]: pgmap v1289: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:02.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:02 smithi181 ceph-mon[101094]: pgmap v1289: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:04.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:04 smithi157 ceph-mon[117693]: pgmap v1290: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:04.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:04 smithi181 ceph-mon[101094]: pgmap v1290: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:06.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:06 smithi157 ceph-mon[117693]: pgmap v1291: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:06.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:06 smithi181 ceph-mon[101094]: pgmap v1291: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:08.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:08 smithi157 ceph-mon[117693]: pgmap v1292: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:08.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:08 smithi181 ceph-mon[101094]: pgmap v1292: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:10.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:10 smithi157 ceph-mon[117693]: pgmap v1293: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:10.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:10 smithi181 ceph-mon[101094]: pgmap v1293: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:12.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:12 smithi157 ceph-mon[117693]: pgmap v1294: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:12.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:12 smithi181 ceph-mon[101094]: pgmap v1294: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:14.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:14 smithi157 ceph-mon[117693]: pgmap v1295: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:14.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:14.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:14 smithi181 ceph-mon[101094]: pgmap v1295: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:14.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:16.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:16 smithi157 ceph-mon[117693]: pgmap v1296: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:16.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:16 smithi181 ceph-mon[101094]: pgmap v1296: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:18.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:18 smithi157 ceph-mon[117693]: pgmap v1297: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:18.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:18 smithi181 ceph-mon[101094]: pgmap v1297: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:20.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:20 smithi157 ceph-mon[117693]: pgmap v1298: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:20.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:20 smithi181 ceph-mon[101094]: pgmap v1298: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:22.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:22 smithi157 ceph-mon[117693]: pgmap v1299: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:22.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:22 smithi181 ceph-mon[101094]: pgmap v1299: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:24.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:24 smithi157 ceph-mon[117693]: pgmap v1300: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:24.819 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:24 smithi181 ceph-mon[101094]: pgmap v1300: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:26.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:26 smithi157 ceph-mon[117693]: pgmap v1301: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:26.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:26 smithi181 ceph-mon[101094]: pgmap v1301: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:28.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:28 smithi157 ceph-mon[117693]: pgmap v1302: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:28.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:28 smithi181 ceph-mon[101094]: pgmap v1302: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:29.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:29.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:30.785 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:30 smithi157 ceph-mon[117693]: pgmap v1303: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:30.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:24:30.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:30 smithi181 ceph-mon[101094]: pgmap v1303: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:30.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:24:31.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:24:31.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:24:31.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:24:31.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:24:31.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:24:31.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:24:32.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:32 smithi157 ceph-mon[117693]: pgmap v1304: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:32.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:32 smithi181 ceph-mon[101094]: pgmap v1304: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:34.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:34 smithi157 ceph-mon[117693]: pgmap v1305: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:34.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:34 smithi181 ceph-mon[101094]: pgmap v1305: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:36.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:36 smithi157 ceph-mon[117693]: pgmap v1306: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:36.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:36 smithi181 ceph-mon[101094]: pgmap v1306: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:38.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:38 smithi157 ceph-mon[117693]: pgmap v1307: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:38.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:38 smithi181 ceph-mon[101094]: pgmap v1307: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:40.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:40 smithi157 ceph-mon[117693]: pgmap v1308: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:40.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:40 smithi181 ceph-mon[101094]: pgmap v1308: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:42.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:42 smithi157 ceph-mon[117693]: pgmap v1309: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:42.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:42 smithi181 ceph-mon[101094]: pgmap v1309: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:44.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:44 smithi157 ceph-mon[117693]: pgmap v1310: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:44.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:44.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:44 smithi181 ceph-mon[101094]: pgmap v1310: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:44.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:46.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:46 smithi157 ceph-mon[117693]: pgmap v1311: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:46.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:46 smithi181 ceph-mon[101094]: pgmap v1311: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:48.785 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:48 smithi157 ceph-mon[117693]: pgmap v1312: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:48.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:48 smithi181 ceph-mon[101094]: pgmap v1312: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:50.785 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:50 smithi157 ceph-mon[117693]: pgmap v1313: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:50.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:50 smithi181 ceph-mon[101094]: pgmap v1313: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:52.785 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:52 smithi157 ceph-mon[117693]: pgmap v1314: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:52.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:52 smithi181 ceph-mon[101094]: pgmap v1314: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:24:54.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:54 smithi157 ceph-mon[117693]: pgmap v1315: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:54.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:54 smithi181 ceph-mon[101094]: pgmap v1315: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:56.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:56 smithi157 ceph-mon[117693]: pgmap v1316: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:56.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:56 smithi181 ceph-mon[101094]: pgmap v1316: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:24:58.786 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:58 smithi157 ceph-mon[117693]: pgmap v1317: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:58.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:58 smithi181 ceph-mon[101094]: pgmap v1317: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:24:59.785 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:24:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:24:59.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:24:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:00.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:00 smithi181 ceph-mon[101094]: pgmap v1318: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:01.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:00 smithi157 ceph-mon[117693]: pgmap v1318: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:02.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:02 smithi181 ceph-mon[101094]: pgmap v1319: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:03.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:02 smithi157 ceph-mon[117693]: pgmap v1319: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:04.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:04 smithi181 ceph-mon[101094]: pgmap v1320: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:05.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:04 smithi157 ceph-mon[117693]: pgmap v1320: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:06.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:06 smithi181 ceph-mon[101094]: pgmap v1321: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:07.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:06 smithi157 ceph-mon[117693]: pgmap v1321: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:08.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:08 smithi181 ceph-mon[101094]: pgmap v1322: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:09.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:08 smithi157 ceph-mon[117693]: pgmap v1322: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:10.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:10 smithi181 ceph-mon[101094]: pgmap v1323: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:11.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:10 smithi157 ceph-mon[117693]: pgmap v1323: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:12.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:12 smithi181 ceph-mon[101094]: pgmap v1324: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:13.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:12 smithi157 ceph-mon[117693]: pgmap v1324: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:14.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:14 smithi181 ceph-mon[101094]: pgmap v1325: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:14.818 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:15.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:14 smithi157 ceph-mon[117693]: pgmap v1325: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:15.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:17.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:16 smithi157 ceph-mon[117693]: pgmap v1326: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:17.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:16 smithi181 ceph-mon[101094]: pgmap v1326: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:19.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:18 smithi157 ceph-mon[117693]: pgmap v1327: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:19.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:18 smithi181 ceph-mon[101094]: pgmap v1327: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:21.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:20 smithi157 ceph-mon[117693]: pgmap v1328: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:21.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:20 smithi181 ceph-mon[101094]: pgmap v1328: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:23.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:22 smithi157 ceph-mon[117693]: pgmap v1329: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:23.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:22 smithi181 ceph-mon[101094]: pgmap v1329: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:25.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:24 smithi157 ceph-mon[117693]: pgmap v1330: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:25.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:24 smithi181 ceph-mon[101094]: pgmap v1330: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:27.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:26 smithi157 ceph-mon[117693]: pgmap v1331: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:27.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:26 smithi181 ceph-mon[101094]: pgmap v1331: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:29.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:28 smithi157 ceph-mon[117693]: pgmap v1332: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:29.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:28 smithi181 ceph-mon[101094]: pgmap v1332: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:30.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:30.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:31.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:30 smithi157 ceph-mon[117693]: pgmap v1333: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:31.067 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:30 smithi181 ceph-mon[101094]: pgmap v1333: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:32.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:31 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:25:32.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:31 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:25:33.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:32 smithi157 ceph-mon[117693]: pgmap v1334: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:33.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:25:33.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:25:33.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:25:33.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:32 smithi181 ceph-mon[101094]: pgmap v1334: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:33.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:25:33.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:25:33.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:25:35.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:34 smithi157 ceph-mon[117693]: pgmap v1335: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:35.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:34 smithi181 ceph-mon[101094]: pgmap v1335: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:37.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:36 smithi157 ceph-mon[117693]: pgmap v1336: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:37.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:36 smithi181 ceph-mon[101094]: pgmap v1336: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:39.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:38 smithi157 ceph-mon[117693]: pgmap v1337: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:39.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:38 smithi181 ceph-mon[101094]: pgmap v1337: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:41.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:40 smithi157 ceph-mon[117693]: pgmap v1338: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:41.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:40 smithi181 ceph-mon[101094]: pgmap v1338: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:43.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:42 smithi157 ceph-mon[117693]: pgmap v1339: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:43.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:42 smithi181 ceph-mon[101094]: pgmap v1339: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:45.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:44 smithi157 ceph-mon[117693]: pgmap v1340: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:45.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:45.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:44 smithi181 ceph-mon[101094]: pgmap v1340: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:45.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:25:47.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:46 smithi157 ceph-mon[117693]: pgmap v1341: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:47.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:46 smithi181 ceph-mon[101094]: pgmap v1341: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:49.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:48 smithi157 ceph-mon[117693]: pgmap v1342: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:49.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:48 smithi181 ceph-mon[101094]: pgmap v1342: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:51.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:50 smithi157 ceph-mon[117693]: pgmap v1343: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:51.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:50 smithi181 ceph-mon[101094]: pgmap v1343: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:53.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:52 smithi157 ceph-mon[117693]: pgmap v1344: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:53.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:52 smithi181 ceph-mon[101094]: pgmap v1344: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:25:55.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:54 smithi157 ceph-mon[117693]: pgmap v1345: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:55.067 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:54 smithi181 ceph-mon[101094]: pgmap v1345: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:57.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:56 smithi157 ceph-mon[117693]: pgmap v1346: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:57.067 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:56 smithi181 ceph-mon[101094]: pgmap v1346: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:25:59.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:58 smithi157 ceph-mon[117693]: pgmap v1347: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:25:59.067 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:58 smithi181 ceph-mon[101094]: pgmap v1347: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:00.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:25:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:00.067 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:25:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:01.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:00 smithi157 ceph-mon[117693]: pgmap v1348: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:01.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:00 smithi181 ceph-mon[101094]: pgmap v1348: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:03.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:02 smithi157 ceph-mon[117693]: pgmap v1349: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:03.067 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:02 smithi181 ceph-mon[101094]: pgmap v1349: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:05.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:04 smithi157 ceph-mon[117693]: pgmap v1350: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:05.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:04 smithi181 ceph-mon[101094]: pgmap v1350: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:07.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:06 smithi157 ceph-mon[117693]: pgmap v1351: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:07.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:06 smithi181 ceph-mon[101094]: pgmap v1351: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:09.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:08 smithi157 ceph-mon[117693]: pgmap v1352: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:09.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:08 smithi181 ceph-mon[101094]: pgmap v1352: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:11.035 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:10 smithi157 ceph-mon[117693]: pgmap v1353: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:11.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:10 smithi181 ceph-mon[101094]: pgmap v1353: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:13.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:12 smithi157 ceph-mon[117693]: pgmap v1354: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:13.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:12 smithi181 ceph-mon[101094]: pgmap v1354: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:15.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:14 smithi157 ceph-mon[117693]: pgmap v1355: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:15.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:15.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:14 smithi181 ceph-mon[101094]: pgmap v1355: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:15.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:17.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:16 smithi157 ceph-mon[117693]: pgmap v1356: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:17.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:16 smithi181 ceph-mon[101094]: pgmap v1356: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:19.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:18 smithi157 ceph-mon[117693]: pgmap v1357: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:19.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:18 smithi181 ceph-mon[101094]: pgmap v1357: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:21.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:20 smithi157 ceph-mon[117693]: pgmap v1358: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:21.068 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:20 smithi181 ceph-mon[101094]: pgmap v1358: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:23.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:22 smithi157 ceph-mon[117693]: pgmap v1359: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:23.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:22 smithi181 ceph-mon[101094]: pgmap v1359: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:25.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:24 smithi157 ceph-mon[117693]: pgmap v1360: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:25.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:24 smithi181 ceph-mon[101094]: pgmap v1360: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:27.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:26 smithi157 ceph-mon[117693]: pgmap v1361: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:27.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:26 smithi181 ceph-mon[101094]: pgmap v1361: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:29.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:28 smithi157 ceph-mon[117693]: pgmap v1362: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:29.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:28 smithi181 ceph-mon[101094]: pgmap v1362: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:30.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:30.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:31.036 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:30 smithi157 ceph-mon[117693]: pgmap v1363: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:31.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:30 smithi181 ceph-mon[101094]: pgmap v1363: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:33.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:32 smithi157 ceph-mon[117693]: pgmap v1364: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:33.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:32 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:26:33.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:32 smithi181 ceph-mon[101094]: pgmap v1364: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:33.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:32 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:26:34.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:26:34.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:26:34.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:26:34.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:26:34.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:26:34.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:26:35.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:34 smithi157 ceph-mon[117693]: pgmap v1365: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:35.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:34 smithi181 ceph-mon[101094]: pgmap v1365: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:37.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:36 smithi157 ceph-mon[117693]: pgmap v1366: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:37.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:36 smithi181 ceph-mon[101094]: pgmap v1366: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:39.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:38 smithi157 ceph-mon[117693]: pgmap v1367: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:39.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:38 smithi181 ceph-mon[101094]: pgmap v1367: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:41.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:40 smithi157 ceph-mon[117693]: pgmap v1368: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:41.069 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:40 smithi181 ceph-mon[101094]: pgmap v1368: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:43.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:42 smithi157 ceph-mon[117693]: pgmap v1369: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:43.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:42 smithi181 ceph-mon[101094]: pgmap v1369: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:45.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:44 smithi157 ceph-mon[117693]: pgmap v1370: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:45.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:45.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:44 smithi181 ceph-mon[101094]: pgmap v1370: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:45.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:26:47.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:46 smithi157 ceph-mon[117693]: pgmap v1371: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:47.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:46 smithi181 ceph-mon[101094]: pgmap v1371: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:49.037 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:48 smithi157 ceph-mon[117693]: pgmap v1372: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:49.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:48 smithi181 ceph-mon[101094]: pgmap v1372: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:51.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:50 smithi157 ceph-mon[117693]: pgmap v1373: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:51.070 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:50 smithi181 ceph-mon[101094]: pgmap v1373: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:52.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:51 smithi157 ceph-mon[117693]: pgmap v1374: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:52.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:51 smithi181 ceph-mon[101094]: pgmap v1374: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:26:54.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:53 smithi157 ceph-mon[117693]: pgmap v1375: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:54.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:53 smithi181 ceph-mon[101094]: pgmap v1375: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:56.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:55 smithi157 ceph-mon[117693]: pgmap v1376: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:56.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:55 smithi181 ceph-mon[101094]: pgmap v1376: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:26:58.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:57 smithi157 ceph-mon[117693]: pgmap v1377: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:26:58.320 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:57 smithi181 ceph-mon[101094]: pgmap v1377: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:00.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:59 smithi157 ceph-mon[117693]: pgmap v1378: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:00.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:26:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:00.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:59 smithi181 ceph-mon[101094]: pgmap v1378: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:00.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:26:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:02.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:01 smithi157 ceph-mon[117693]: pgmap v1379: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:02.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:01 smithi181 ceph-mon[101094]: pgmap v1379: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:04.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:03 smithi157 ceph-mon[117693]: pgmap v1380: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:04.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:03 smithi181 ceph-mon[101094]: pgmap v1380: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:06.288 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:05 smithi157 ceph-mon[117693]: pgmap v1381: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:06.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:05 smithi181 ceph-mon[101094]: pgmap v1381: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:08.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:07 smithi157 ceph-mon[117693]: pgmap v1382: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:08.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:07 smithi181 ceph-mon[101094]: pgmap v1382: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:10.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:09 smithi157 ceph-mon[117693]: pgmap v1383: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:10.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:09 smithi181 ceph-mon[101094]: pgmap v1383: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:12.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:11 smithi157 ceph-mon[117693]: pgmap v1384: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:12.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:11 smithi181 ceph-mon[101094]: pgmap v1384: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:14.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:13 smithi157 ceph-mon[117693]: pgmap v1385: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:14.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:13 smithi181 ceph-mon[101094]: pgmap v1385: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:15.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:15.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:16.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:15 smithi157 ceph-mon[117693]: pgmap v1386: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:16.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:15 smithi181 ceph-mon[101094]: pgmap v1386: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:18.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:17 smithi157 ceph-mon[117693]: pgmap v1387: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:18.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:17 smithi181 ceph-mon[101094]: pgmap v1387: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:20.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:19 smithi157 ceph-mon[117693]: pgmap v1388: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:20.321 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:19 smithi181 ceph-mon[101094]: pgmap v1388: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:22.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:21 smithi157 ceph-mon[117693]: pgmap v1389: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:22.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:21 smithi181 ceph-mon[101094]: pgmap v1389: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:24.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:23 smithi157 ceph-mon[117693]: pgmap v1390: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:24.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:23 smithi181 ceph-mon[101094]: pgmap v1390: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:26.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:25 smithi157 ceph-mon[117693]: pgmap v1391: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:26.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:25 smithi181 ceph-mon[101094]: pgmap v1391: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:28.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:27 smithi157 ceph-mon[117693]: pgmap v1392: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:28.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:27 smithi181 ceph-mon[101094]: pgmap v1392: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:30.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:29 smithi157 ceph-mon[117693]: pgmap v1393: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:30.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:30.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:29 smithi181 ceph-mon[101094]: pgmap v1393: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:30.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:32.289 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:31 smithi157 ceph-mon[117693]: pgmap v1394: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:32.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:31 smithi181 ceph-mon[101094]: pgmap v1394: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:34.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:33 smithi157 ceph-mon[117693]: pgmap v1395: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:34.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:33 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:27:34.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:33 smithi181 ceph-mon[101094]: pgmap v1395: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:34.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:33 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:27:35.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:27:35.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:27:35.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:27:35.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:27:35.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:27:35.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:27:36.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:36 smithi157 ceph-mon[117693]: pgmap v1396: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:36.322 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:36 smithi181 ceph-mon[101094]: pgmap v1396: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:38.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:38 smithi157 ceph-mon[117693]: pgmap v1397: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:38.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:38 smithi181 ceph-mon[101094]: pgmap v1397: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:40.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:40 smithi157 ceph-mon[117693]: pgmap v1398: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:40.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:40 smithi181 ceph-mon[101094]: pgmap v1398: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:42.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:42 smithi157 ceph-mon[117693]: pgmap v1399: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:42.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:42 smithi181 ceph-mon[101094]: pgmap v1399: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:44.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:44 smithi157 ceph-mon[117693]: pgmap v1400: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:44.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:44 smithi181 ceph-mon[101094]: pgmap v1400: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:45.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:45.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:27:46.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:46 smithi157 ceph-mon[117693]: pgmap v1401: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:46.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:46 smithi181 ceph-mon[101094]: pgmap v1401: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:48.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:48 smithi157 ceph-mon[117693]: pgmap v1402: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:48.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:48 smithi181 ceph-mon[101094]: pgmap v1402: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:50.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:50 smithi157 ceph-mon[117693]: pgmap v1403: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:50.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:50 smithi181 ceph-mon[101094]: pgmap v1403: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:52.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:52 smithi157 ceph-mon[117693]: pgmap v1404: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:52.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:52 smithi181 ceph-mon[101094]: pgmap v1404: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:27:54.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:54 smithi157 ceph-mon[117693]: pgmap v1405: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:54.324 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:54 smithi181 ceph-mon[101094]: pgmap v1405: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:56.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:56 smithi157 ceph-mon[117693]: pgmap v1406: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:56.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:56 smithi181 ceph-mon[101094]: pgmap v1406: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:27:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:27:58 smithi157 ceph-mon[117693]: pgmap v1407: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:27:58.323 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:27:58 smithi181 ceph-mon[101094]: pgmap v1407: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:00.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:00 smithi157 ceph-mon[117693]: pgmap v1408: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:00.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:00.324 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:00 smithi181 ceph-mon[101094]: pgmap v1408: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:00.324 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:02.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:02 smithi157 ceph-mon[117693]: pgmap v1409: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:02.324 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:02 smithi181 ceph-mon[101094]: pgmap v1409: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:04.324 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:04 smithi181 ceph-mon[101094]: pgmap v1410: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:04.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:04 smithi157 ceph-mon[117693]: pgmap v1410: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:06.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:06 smithi157 ceph-mon[117693]: pgmap v1411: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:06.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:06 smithi181 ceph-mon[101094]: pgmap v1411: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:08.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:08 smithi157 ceph-mon[117693]: pgmap v1412: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:08.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:08 smithi181 ceph-mon[101094]: pgmap v1412: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:10.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:10 smithi157 ceph-mon[117693]: pgmap v1413: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:10.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:10 smithi181 ceph-mon[101094]: pgmap v1413: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:12.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:12 smithi181 ceph-mon[101094]: pgmap v1414: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:12.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:12 smithi157 ceph-mon[117693]: pgmap v1414: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:14.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:14 smithi181 ceph-mon[101094]: pgmap v1415: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:14.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:14.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:14 smithi157 ceph-mon[117693]: pgmap v1415: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:14.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:16.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:16 smithi181 ceph-mon[101094]: pgmap v1416: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:16.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:16 smithi157 ceph-mon[117693]: pgmap v1416: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:18.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:18 smithi181 ceph-mon[101094]: pgmap v1417: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:18.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:18 smithi157 ceph-mon[117693]: pgmap v1417: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:20.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:20 smithi181 ceph-mon[101094]: pgmap v1418: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:20.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:20 smithi157 ceph-mon[117693]: pgmap v1418: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:22.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:22 smithi181 ceph-mon[101094]: pgmap v1419: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:22.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:22 smithi157 ceph-mon[117693]: pgmap v1419: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:24.574 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:24 smithi181 ceph-mon[101094]: pgmap v1420: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:24.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:24 smithi157 ceph-mon[117693]: pgmap v1420: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:26.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:26 smithi181 ceph-mon[101094]: pgmap v1421: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:26.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:26 smithi157 ceph-mon[117693]: pgmap v1421: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:28.575 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:28 smithi181 ceph-mon[101094]: pgmap v1422: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:28.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:28 smithi157 ceph-mon[117693]: pgmap v1422: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:29.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:29.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:30.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:30 smithi157 ceph-mon[117693]: pgmap v1423: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:30.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:30 smithi181 ceph-mon[101094]: pgmap v1423: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:32.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:32 smithi157 ceph-mon[117693]: pgmap v1424: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:32.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:32 smithi181 ceph-mon[101094]: pgmap v1424: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:34.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:34 smithi157 ceph-mon[117693]: pgmap v1425: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:34.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:34 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:28:34.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:34 smithi181 ceph-mon[101094]: pgmap v1425: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:34.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:34 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:28:35.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:35 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:28:35.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:35 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:28:35.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:35 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:28:35.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:35 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:28:35.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:35 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:28:35.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:35 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:28:36.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:36 smithi157 ceph-mon[117693]: pgmap v1426: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:36.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:36 smithi181 ceph-mon[101094]: pgmap v1426: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:38.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:38 smithi157 ceph-mon[117693]: pgmap v1427: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:38.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:38 smithi181 ceph-mon[101094]: pgmap v1427: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:40.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:40 smithi157 ceph-mon[117693]: pgmap v1428: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:40.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:40 smithi181 ceph-mon[101094]: pgmap v1428: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:42.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:42 smithi157 ceph-mon[117693]: pgmap v1429: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:42.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:42 smithi181 ceph-mon[101094]: pgmap v1429: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:44.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:44 smithi157 ceph-mon[117693]: pgmap v1430: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:44.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:44.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:44 smithi181 ceph-mon[101094]: pgmap v1430: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:44.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:46.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:46 smithi157 ceph-mon[117693]: pgmap v1431: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:46.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:46 smithi181 ceph-mon[101094]: pgmap v1431: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:48.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:48 smithi157 ceph-mon[117693]: pgmap v1432: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:48.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:48 smithi181 ceph-mon[101094]: pgmap v1432: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:50.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:50 smithi157 ceph-mon[117693]: pgmap v1433: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:50.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:50 smithi181 ceph-mon[101094]: pgmap v1433: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:52.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:52 smithi157 ceph-mon[117693]: pgmap v1434: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:52.825 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:52 smithi181 ceph-mon[101094]: pgmap v1434: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:28:54.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:54 smithi157 ceph-mon[117693]: pgmap v1435: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:54.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:54 smithi181 ceph-mon[101094]: pgmap v1435: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:56.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:56 smithi157 ceph-mon[117693]: pgmap v1436: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:56.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:56 smithi181 ceph-mon[101094]: pgmap v1436: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:28:58.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:58 smithi157 ceph-mon[117693]: pgmap v1437: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:58.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:58 smithi181 ceph-mon[101094]: pgmap v1437: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:28:59.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:28:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:28:59.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:28:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:00 smithi157 ceph-mon[117693]: pgmap v1438: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:00.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:00 smithi181 ceph-mon[101094]: pgmap v1438: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:02.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:02 smithi157 ceph-mon[117693]: pgmap v1439: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:02.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:02 smithi181 ceph-mon[101094]: pgmap v1439: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:04.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:04 smithi157 ceph-mon[117693]: pgmap v1440: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:04.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:04 smithi181 ceph-mon[101094]: pgmap v1440: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:06.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:06 smithi157 ceph-mon[117693]: pgmap v1441: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:06.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:06 smithi181 ceph-mon[101094]: pgmap v1441: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:08.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:08 smithi157 ceph-mon[117693]: pgmap v1442: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:08.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:08 smithi181 ceph-mon[101094]: pgmap v1442: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:10.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:10 smithi157 ceph-mon[117693]: pgmap v1443: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:29:10.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:10 smithi181 ceph-mon[101094]: pgmap v1443: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:29:12.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:12 smithi157 ceph-mon[117693]: pgmap v1444: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:29:12.826 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:12 smithi181 ceph-mon[101094]: pgmap v1444: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:29:14.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:14 smithi157 ceph-mon[117693]: pgmap v1445: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:29:14.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:14.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:14 smithi181 ceph-mon[101094]: pgmap v1445: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:29:14.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:16.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:16 smithi157 ceph-mon[117693]: pgmap v1446: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:29:16.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:16 smithi181 ceph-mon[101094]: pgmap v1446: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:29:18.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:18 smithi157 ceph-mon[117693]: pgmap v1447: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:18.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:18 smithi181 ceph-mon[101094]: pgmap v1447: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:20.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:20 smithi157 ceph-mon[117693]: pgmap v1448: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:20.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:20 smithi181 ceph-mon[101094]: pgmap v1448: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:22.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:22 smithi157 ceph-mon[117693]: pgmap v1449: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:22.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:22 smithi181 ceph-mon[101094]: pgmap v1449: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:24.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:24 smithi157 ceph-mon[117693]: pgmap v1450: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:24.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:24 smithi181 ceph-mon[101094]: pgmap v1450: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:26.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:26 smithi157 ceph-mon[117693]: pgmap v1451: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:26.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:26 smithi181 ceph-mon[101094]: pgmap v1451: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:28.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:28 smithi157 ceph-mon[117693]: pgmap v1452: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:28.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:28 smithi181 ceph-mon[101094]: pgmap v1452: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:29.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:29.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:30.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:30 smithi157 ceph-mon[117693]: pgmap v1453: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:30.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:30 smithi181 ceph-mon[101094]: pgmap v1453: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:32.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:32 smithi157 ceph-mon[117693]: pgmap v1454: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:32.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:32 smithi181 ceph-mon[101094]: pgmap v1454: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:34.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:34 smithi157 ceph-mon[117693]: pgmap v1455: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:34.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:34 smithi181 ceph-mon[101094]: pgmap v1455: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:35.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:35 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:29:35.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:35 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:29:36.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:36 smithi157 ceph-mon[117693]: pgmap v1456: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:36.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:29:36.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:29:36.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:29:36.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:36 smithi181 ceph-mon[101094]: pgmap v1456: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:36.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:29:36.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:29:36.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:29:38.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:38 smithi157 ceph-mon[117693]: pgmap v1457: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:38.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:38 smithi181 ceph-mon[101094]: pgmap v1457: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:40.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:40 smithi157 ceph-mon[117693]: pgmap v1458: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:40.827 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:40 smithi181 ceph-mon[101094]: pgmap v1458: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:42.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:42 smithi157 ceph-mon[117693]: pgmap v1459: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:42.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:42 smithi181 ceph-mon[101094]: pgmap v1459: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:44.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:44 smithi157 ceph-mon[117693]: pgmap v1460: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:44.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:44 smithi181 ceph-mon[101094]: pgmap v1460: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:44.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:46.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:46 smithi157 ceph-mon[117693]: pgmap v1461: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:46.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:46 smithi181 ceph-mon[101094]: pgmap v1461: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:48.795 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:48 smithi157 ceph-mon[117693]: pgmap v1462: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:48.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:48 smithi181 ceph-mon[101094]: pgmap v1462: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:50.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:50 smithi157 ceph-mon[117693]: pgmap v1463: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:50.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:50 smithi181 ceph-mon[101094]: pgmap v1463: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:52.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:52 smithi157 ceph-mon[117693]: pgmap v1464: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:52.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:52 smithi181 ceph-mon[101094]: pgmap v1464: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:29:54.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:54 smithi157 ceph-mon[117693]: pgmap v1465: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:54.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:54 smithi181 ceph-mon[101094]: pgmap v1465: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:56.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:56 smithi157 ceph-mon[117693]: pgmap v1466: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:56.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:56 smithi181 ceph-mon[101094]: pgmap v1466: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:29:58.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:58 smithi157 ceph-mon[117693]: pgmap v1467: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:58.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:58 smithi181 ceph-mon[101094]: pgmap v1467: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:29:59.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:29:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:29:59.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:29:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:00.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:00 smithi157 ceph-mon[117693]: pgmap v1468: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:00.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T09:30:00.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:00 smithi181 ceph-mon[101094]: pgmap v1468: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:00.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T09:30:02.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:02 smithi157 ceph-mon[117693]: pgmap v1469: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:02.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:02 smithi181 ceph-mon[101094]: pgmap v1469: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:04.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:04 smithi157 ceph-mon[117693]: pgmap v1470: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:04.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:04 smithi181 ceph-mon[101094]: pgmap v1470: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:06.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:06 smithi157 ceph-mon[117693]: pgmap v1471: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:06.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:06 smithi181 ceph-mon[101094]: pgmap v1471: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:08.796 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:08 smithi157 ceph-mon[117693]: pgmap v1472: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:08.828 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:08 smithi181 ceph-mon[101094]: pgmap v1472: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:10.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:10 smithi157 ceph-mon[117693]: pgmap v1473: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:10.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:10 smithi181 ceph-mon[101094]: pgmap v1473: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:12.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:12 smithi181 ceph-mon[101094]: pgmap v1474: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:13.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:12 smithi157 ceph-mon[117693]: pgmap v1474: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:14.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:14 smithi181 ceph-mon[101094]: pgmap v1475: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:14.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:15.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:14 smithi157 ceph-mon[117693]: pgmap v1475: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:15.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:16.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:16 smithi181 ceph-mon[101094]: pgmap v1476: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:17.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:16 smithi157 ceph-mon[117693]: pgmap v1476: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:18.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:18 smithi181 ceph-mon[101094]: pgmap v1477: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:19.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:18 smithi157 ceph-mon[117693]: pgmap v1477: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:20.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:20 smithi181 ceph-mon[101094]: pgmap v1478: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:21.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:20 smithi157 ceph-mon[117693]: pgmap v1478: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:22.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:22 smithi181 ceph-mon[101094]: pgmap v1479: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:23.046 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:22 smithi157 ceph-mon[117693]: pgmap v1479: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:24.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:24 smithi181 ceph-mon[101094]: pgmap v1480: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:25.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:24 smithi157 ceph-mon[117693]: pgmap v1480: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:26.829 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:26 smithi181 ceph-mon[101094]: pgmap v1481: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:27.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:26 smithi157 ceph-mon[117693]: pgmap v1481: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:29.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:28 smithi157 ceph-mon[117693]: pgmap v1482: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:29.080 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:28 smithi181 ceph-mon[101094]: pgmap v1482: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:30.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:30.080 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:31.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:30 smithi157 ceph-mon[117693]: pgmap v1483: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:31.079 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:30 smithi181 ceph-mon[101094]: pgmap v1483: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:33.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:32 smithi157 ceph-mon[117693]: pgmap v1484: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:33.079 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:32 smithi181 ceph-mon[101094]: pgmap v1484: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:35.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:34 smithi157 ceph-mon[117693]: pgmap v1485: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:35.080 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:34 smithi181 ceph-mon[101094]: pgmap v1485: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:37.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:36 smithi157 ceph-mon[117693]: pgmap v1486: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:37.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:36 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:30:37.079 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:36 smithi181 ceph-mon[101094]: pgmap v1486: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:37.080 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:36 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:30:39.047 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:38 smithi157 ceph-mon[117693]: pgmap v1487: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:39.080 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:38 smithi181 ceph-mon[101094]: pgmap v1487: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:40.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:40 smithi157 ceph-mon[117693]: pgmap v1488: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:40.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:30:40.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:30:40.548 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:30:40.548 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:30:40.548 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:30:40.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:40 smithi181 ceph-mon[101094]: pgmap v1488: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:40.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:30:40.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:30:40.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:30:40.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:30:40.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:30:42.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:42 smithi157 ceph-mon[117693]: pgmap v1489: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:42.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:42 smithi181 ceph-mon[101094]: pgmap v1489: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:44.548 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:44 smithi157 ceph-mon[117693]: pgmap v1490: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:44.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:44 smithi181 ceph-mon[101094]: pgmap v1490: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:45.547 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:45.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:46.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:46 smithi181 ceph-mon[101094]: pgmap v1491: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:46.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:46 smithi157 ceph-mon[117693]: pgmap v1491: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:48.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:48 smithi181 ceph-mon[101094]: pgmap v1492: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:48.797 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:48 smithi157 ceph-mon[117693]: pgmap v1492: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:50.580 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:50 smithi181 ceph-mon[101094]: pgmap v1493: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:50.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:50 smithi157 ceph-mon[117693]: pgmap v1493: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:52.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:52 smithi157 ceph-mon[117693]: pgmap v1494: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:52.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:52 smithi181 ceph-mon[101094]: pgmap v1494: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:30:54.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:54 smithi157 ceph-mon[117693]: pgmap v1495: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:54.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:54 smithi181 ceph-mon[101094]: pgmap v1495: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:56.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:56 smithi157 ceph-mon[117693]: pgmap v1496: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:56.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:56 smithi181 ceph-mon[101094]: pgmap v1496: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:30:58.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:58 smithi157 ceph-mon[117693]: pgmap v1497: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:58.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:58 smithi181 ceph-mon[101094]: pgmap v1497: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:30:59.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:30:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:30:59.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:30:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:00.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:00 smithi157 ceph-mon[117693]: pgmap v1498: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:00.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:00 smithi181 ceph-mon[101094]: pgmap v1498: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:02.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:02 smithi157 ceph-mon[117693]: pgmap v1499: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:02.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:02 smithi181 ceph-mon[101094]: pgmap v1499: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:04.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:04 smithi157 ceph-mon[117693]: pgmap v1500: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:04.830 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:04 smithi181 ceph-mon[101094]: pgmap v1500: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:06.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:06 smithi157 ceph-mon[117693]: pgmap v1501: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:06.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:06 smithi181 ceph-mon[101094]: pgmap v1501: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:08.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:08 smithi157 ceph-mon[117693]: pgmap v1502: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:08.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:08 smithi181 ceph-mon[101094]: pgmap v1502: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:10.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:10 smithi157 ceph-mon[117693]: pgmap v1503: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:10.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:10 smithi181 ceph-mon[101094]: pgmap v1503: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:12.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:12 smithi157 ceph-mon[117693]: pgmap v1504: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:12.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:12 smithi181 ceph-mon[101094]: pgmap v1504: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:14.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:14 smithi157 ceph-mon[117693]: pgmap v1505: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:14.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:14.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:14 smithi181 ceph-mon[101094]: pgmap v1505: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:14.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:16.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:16 smithi157 ceph-mon[117693]: pgmap v1506: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:16.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:16 smithi181 ceph-mon[101094]: pgmap v1506: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:18.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:18 smithi157 ceph-mon[117693]: pgmap v1507: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:18.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:18 smithi181 ceph-mon[101094]: pgmap v1507: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:20.798 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:20 smithi157 ceph-mon[117693]: pgmap v1508: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:20.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:20 smithi181 ceph-mon[101094]: pgmap v1508: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:22.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:22 smithi157 ceph-mon[117693]: pgmap v1509: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:22.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:22 smithi181 ceph-mon[101094]: pgmap v1509: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:24.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:24 smithi157 ceph-mon[117693]: pgmap v1510: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:24.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:24 smithi181 ceph-mon[101094]: pgmap v1510: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:26.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:26 smithi157 ceph-mon[117693]: pgmap v1511: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:26.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:26 smithi181 ceph-mon[101094]: pgmap v1511: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:28.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:28 smithi157 ceph-mon[117693]: pgmap v1512: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:28.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:28 smithi181 ceph-mon[101094]: pgmap v1512: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:29.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:29.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:30.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:30 smithi157 ceph-mon[117693]: pgmap v1513: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:30.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:30 smithi181 ceph-mon[101094]: pgmap v1513: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:32.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:32 smithi157 ceph-mon[117693]: pgmap v1514: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:32.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:32 smithi181 ceph-mon[101094]: pgmap v1514: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:34.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:34 smithi157 ceph-mon[117693]: pgmap v1515: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:34.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:34 smithi181 ceph-mon[101094]: pgmap v1515: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:36.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:36 smithi157 ceph-mon[117693]: pgmap v1516: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:36.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:36 smithi181 ceph-mon[101094]: pgmap v1516: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:38.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:38 smithi157 ceph-mon[117693]: pgmap v1517: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:38.831 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:38 smithi181 ceph-mon[101094]: pgmap v1517: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:40.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:40 smithi157 ceph-mon[117693]: pgmap v1518: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:40.799 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:40 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:31:40.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:40 smithi181 ceph-mon[101094]: pgmap v1518: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:40.832 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:40 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:31:42.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:42.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:41 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:42.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:42.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:41 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:43.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:42 smithi157 ceph-mon[117693]: pgmap v1519: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:43.081 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:42 smithi181 ceph-mon[101094]: pgmap v1519: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:45.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:44 smithi157 ceph-mon[117693]: pgmap v1520: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:45.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:45.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:44 smithi181 ceph-mon[101094]: pgmap v1520: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:45.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:31:47.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:46 smithi157 ceph-mon[117693]: pgmap v1521: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:47.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:46 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:47.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:46 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:47.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:46 smithi181 ceph-mon[101094]: pgmap v1521: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:47.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:46 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:47.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:46 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:48.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:47 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:31:48.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:47 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:31:48.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:47 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:48.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:47 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:31:48.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:47 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:31:48.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:47 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:31:49.049 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:48 smithi157 ceph-mon[117693]: pgmap v1522: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:49.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:48 smithi181 ceph-mon[101094]: pgmap v1522: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:51.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:50 smithi157 ceph-mon[117693]: pgmap v1523: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:51.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:50 smithi181 ceph-mon[101094]: pgmap v1523: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:53.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:52 smithi157 ceph-mon[117693]: pgmap v1524: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:53.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:52 smithi181 ceph-mon[101094]: pgmap v1524: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:31:55.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:54 smithi157 ceph-mon[117693]: pgmap v1525: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:55.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:54 smithi181 ceph-mon[101094]: pgmap v1525: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:57.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:56 smithi157 ceph-mon[117693]: pgmap v1526: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:57.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:56 smithi181 ceph-mon[101094]: pgmap v1526: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:31:59.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:58 smithi157 ceph-mon[117693]: pgmap v1527: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:31:59.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:58 smithi181 ceph-mon[101094]: pgmap v1527: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:00.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:31:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:00.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:31:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:01.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:00 smithi157 ceph-mon[117693]: pgmap v1528: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:01.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:00 smithi181 ceph-mon[101094]: pgmap v1528: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:03.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:02 smithi157 ceph-mon[117693]: pgmap v1529: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:03.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:02 smithi181 ceph-mon[101094]: pgmap v1529: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:05.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:04 smithi157 ceph-mon[117693]: pgmap v1530: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:05.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:04 smithi181 ceph-mon[101094]: pgmap v1530: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:07.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:06 smithi157 ceph-mon[117693]: pgmap v1531: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:07.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:06 smithi181 ceph-mon[101094]: pgmap v1531: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:09.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:08 smithi157 ceph-mon[117693]: pgmap v1532: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:09.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:08 smithi181 ceph-mon[101094]: pgmap v1532: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:11.050 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:10 smithi157 ceph-mon[117693]: pgmap v1533: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:11.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:10 smithi181 ceph-mon[101094]: pgmap v1533: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:13.082 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:12 smithi181 ceph-mon[101094]: pgmap v1534: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:13.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:12 smithi157 ceph-mon[117693]: pgmap v1534: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:15.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:14 smithi181 ceph-mon[101094]: pgmap v1535: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:15.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:15.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:14 smithi157 ceph-mon[117693]: pgmap v1535: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:15.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:17.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:16 smithi181 ceph-mon[101094]: pgmap v1536: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:17.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:16 smithi157 ceph-mon[117693]: pgmap v1536: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:19.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:18 smithi181 ceph-mon[101094]: pgmap v1537: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:19.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:18 smithi157 ceph-mon[117693]: pgmap v1537: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:21.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:20 smithi181 ceph-mon[101094]: pgmap v1538: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:21.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:20 smithi157 ceph-mon[117693]: pgmap v1538: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:23.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:22 smithi181 ceph-mon[101094]: pgmap v1539: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:23.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:22 smithi157 ceph-mon[117693]: pgmap v1539: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:25.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:24 smithi181 ceph-mon[101094]: pgmap v1540: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:25.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:24 smithi157 ceph-mon[117693]: pgmap v1540: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:27.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:26 smithi181 ceph-mon[101094]: pgmap v1541: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:27.300 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:26 smithi157 ceph-mon[117693]: pgmap v1541: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:29.083 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:28 smithi181 ceph-mon[101094]: pgmap v1542: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:29.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:28 smithi157 ceph-mon[117693]: pgmap v1542: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:30.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:30.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:31.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:30 smithi157 ceph-mon[117693]: pgmap v1543: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:31.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:30 smithi181 ceph-mon[101094]: pgmap v1543: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:33.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:32 smithi157 ceph-mon[117693]: pgmap v1544: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:33.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:32 smithi181 ceph-mon[101094]: pgmap v1544: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:35.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:34 smithi157 ceph-mon[117693]: pgmap v1545: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:35.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:34 smithi181 ceph-mon[101094]: pgmap v1545: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:37.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:36 smithi157 ceph-mon[117693]: pgmap v1546: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:37.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:36 smithi181 ceph-mon[101094]: pgmap v1546: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:38.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:37 smithi157 ceph-mon[117693]: pgmap v1547: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:38.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:37 smithi181 ceph-mon[101094]: pgmap v1547: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:40.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:39 smithi157 ceph-mon[117693]: pgmap v1548: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:40.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:39 smithi181 ceph-mon[101094]: pgmap v1548: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:42.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:42 smithi157 ceph-mon[117693]: pgmap v1549: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:42.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:42 smithi181 ceph-mon[101094]: pgmap v1549: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:44.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:44 smithi157 ceph-mon[117693]: pgmap v1550: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:44.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:44 smithi181 ceph-mon[101094]: pgmap v1550: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:45.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:45.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:32:46.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:46 smithi157 ceph-mon[117693]: pgmap v1551: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:46.333 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:46 smithi181 ceph-mon[101094]: pgmap v1551: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:48.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:48 smithi157 ceph-mon[117693]: pgmap v1552: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:48.365 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:48 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:32:48.365 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:48 smithi181 ceph-mon[101094]: pgmap v1552: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:48.365 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:48 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:32:49.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:32:49.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:32:49.302 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:32:49.334 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:32:49.334 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:32:49.334 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:32:50.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:50 smithi157 ceph-mon[117693]: pgmap v1553: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:50.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:50 smithi181 ceph-mon[101094]: pgmap v1553: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:52.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:52 smithi157 ceph-mon[117693]: pgmap v1554: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:52.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:52 smithi181 ceph-mon[101094]: pgmap v1554: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:32:54.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:54 smithi157 ceph-mon[117693]: pgmap v1555: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:54.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:54 smithi181 ceph-mon[101094]: pgmap v1555: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:56.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:56 smithi157 ceph-mon[117693]: pgmap v1556: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:56.583 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:56 smithi181 ceph-mon[101094]: pgmap v1556: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:32:58.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:32:58 smithi157 ceph-mon[117693]: pgmap v1557: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:32:58.622 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:32:58 smithi181 ceph-mon[101094]: pgmap v1557: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:00.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:00 smithi157 ceph-mon[117693]: pgmap v1558: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:00.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:00.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:00 smithi181 ceph-mon[101094]: pgmap v1558: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:00.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:02.551 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:02 smithi157 ceph-mon[117693]: pgmap v1559: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:02.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:02 smithi181 ceph-mon[101094]: pgmap v1559: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:04.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:04 smithi157 ceph-mon[117693]: pgmap v1560: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:04.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:04 smithi181 ceph-mon[101094]: pgmap v1560: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:06.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:06 smithi157 ceph-mon[117693]: pgmap v1561: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:06.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:06 smithi181 ceph-mon[101094]: pgmap v1561: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:08.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:08 smithi157 ceph-mon[117693]: pgmap v1562: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:08.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:08 smithi181 ceph-mon[101094]: pgmap v1562: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:10.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:10 smithi157 ceph-mon[117693]: pgmap v1563: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:10.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:10 smithi181 ceph-mon[101094]: pgmap v1563: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:12.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:12 smithi157 ceph-mon[117693]: pgmap v1564: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:12.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:12 smithi181 ceph-mon[101094]: pgmap v1564: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:14.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:14 smithi157 ceph-mon[117693]: pgmap v1565: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:14.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:14 smithi181 ceph-mon[101094]: pgmap v1565: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:15.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:15.586 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:16.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:16 smithi157 ceph-mon[117693]: pgmap v1566: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:16.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:16 smithi181 ceph-mon[101094]: pgmap v1566: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:18.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:18 smithi157 ceph-mon[117693]: pgmap v1567: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:18.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:18 smithi181 ceph-mon[101094]: pgmap v1567: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:20.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:20 smithi157 ceph-mon[117693]: pgmap v1568: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:20.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:20 smithi181 ceph-mon[101094]: pgmap v1568: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:22.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:22 smithi157 ceph-mon[117693]: pgmap v1569: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:22.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:22 smithi181 ceph-mon[101094]: pgmap v1569: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:24.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:24 smithi157 ceph-mon[117693]: pgmap v1570: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:24.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:24 smithi181 ceph-mon[101094]: pgmap v1570: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:26.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:26 smithi157 ceph-mon[117693]: pgmap v1571: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:26.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:26 smithi181 ceph-mon[101094]: pgmap v1571: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:28.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:28 smithi157 ceph-mon[117693]: pgmap v1572: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:28.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:28 smithi181 ceph-mon[101094]: pgmap v1572: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:30 smithi157 ceph-mon[117693]: pgmap v1573: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:30.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:30.584 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:30 smithi181 ceph-mon[101094]: pgmap v1573: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:30.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:32.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:32 smithi157 ceph-mon[117693]: pgmap v1574: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:32.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:32 smithi181 ceph-mon[101094]: pgmap v1574: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:34.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:34 smithi157 ceph-mon[117693]: pgmap v1575: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:34.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:34 smithi181 ceph-mon[101094]: pgmap v1575: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:36.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:36 smithi157 ceph-mon[117693]: pgmap v1576: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:36.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:36 smithi181 ceph-mon[101094]: pgmap v1576: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:38.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:38 smithi157 ceph-mon[117693]: pgmap v1577: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:38.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:38 smithi181 ceph-mon[101094]: pgmap v1577: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:40.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:40 smithi157 ceph-mon[117693]: pgmap v1578: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:40.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:40 smithi181 ceph-mon[101094]: pgmap v1578: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:42.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:42 smithi157 ceph-mon[117693]: pgmap v1579: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:42.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:42 smithi181 ceph-mon[101094]: pgmap v1579: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:44.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:44 smithi157 ceph-mon[117693]: pgmap v1580: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:44.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:44 smithi181 ceph-mon[101094]: pgmap v1580: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:45.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:45.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:33:46.552 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:46 smithi157 ceph-mon[117693]: pgmap v1581: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:46.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:46 smithi181 ceph-mon[101094]: pgmap v1581: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:48.302 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:48 smithi157 ceph-mon[117693]: pgmap v1582: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:48.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:48 smithi181 ceph-mon[101094]: pgmap v1582: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:49.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:33:49.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:33:49.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:49 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:33:49.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:33:49.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:33:49.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:49 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:33:50.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:50 smithi157 ceph-mon[117693]: pgmap v1583: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:50.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:33:50.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:33:50.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:33:50.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:50 smithi181 ceph-mon[101094]: pgmap v1583: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:50.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:33:50.586 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:33:50.586 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:33:52.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:52 smithi157 ceph-mon[117693]: pgmap v1584: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:52.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:52 smithi181 ceph-mon[101094]: pgmap v1584: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:33:54.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:54 smithi157 ceph-mon[117693]: pgmap v1585: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:54.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:54 smithi181 ceph-mon[101094]: pgmap v1585: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:56.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:56 smithi157 ceph-mon[117693]: pgmap v1586: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:56.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:56 smithi181 ceph-mon[101094]: pgmap v1586: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:33:58.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:33:58 smithi157 ceph-mon[117693]: pgmap v1587: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:33:58.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:33:58 smithi181 ceph-mon[101094]: pgmap v1587: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:00.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:00 smithi157 ceph-mon[117693]: pgmap v1588: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:00.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:00.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:00 smithi181 ceph-mon[101094]: pgmap v1588: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:00.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:02.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:02 smithi157 ceph-mon[117693]: pgmap v1589: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:02.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:02 smithi181 ceph-mon[101094]: pgmap v1589: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:04.553 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:04 smithi157 ceph-mon[117693]: pgmap v1590: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:04.585 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:04 smithi181 ceph-mon[101094]: pgmap v1590: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:06.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:06 smithi157 ceph-mon[117693]: pgmap v1591: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:06.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:06 smithi181 ceph-mon[101094]: pgmap v1591: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:08.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:08 smithi157 ceph-mon[117693]: pgmap v1592: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:08.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:08 smithi181 ceph-mon[101094]: pgmap v1592: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:10.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:10 smithi157 ceph-mon[117693]: pgmap v1593: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:10.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:10 smithi181 ceph-mon[101094]: pgmap v1593: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:12.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:12 smithi157 ceph-mon[117693]: pgmap v1594: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:12.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:12 smithi181 ceph-mon[101094]: pgmap v1594: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:14.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:14 smithi157 ceph-mon[117693]: pgmap v1595: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:14.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:14.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:14 smithi181 ceph-mon[101094]: pgmap v1595: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:14.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:16.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:16 smithi157 ceph-mon[117693]: pgmap v1596: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:16.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:16 smithi181 ceph-mon[101094]: pgmap v1596: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:18.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:18 smithi157 ceph-mon[117693]: pgmap v1597: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:18.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:18 smithi181 ceph-mon[101094]: pgmap v1597: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:20.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:20 smithi157 ceph-mon[117693]: pgmap v1598: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:20.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:20 smithi181 ceph-mon[101094]: pgmap v1598: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:22.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:22 smithi157 ceph-mon[117693]: pgmap v1599: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:22.835 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:22 smithi181 ceph-mon[101094]: pgmap v1599: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:24.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:24 smithi157 ceph-mon[117693]: pgmap v1600: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:24.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:24 smithi181 ceph-mon[101094]: pgmap v1600: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:26.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:26 smithi157 ceph-mon[117693]: pgmap v1601: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:26.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:26 smithi181 ceph-mon[101094]: pgmap v1601: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:28.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:28 smithi157 ceph-mon[117693]: pgmap v1602: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:28.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:28 smithi181 ceph-mon[101094]: pgmap v1602: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:29.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:29.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:30.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:30 smithi157 ceph-mon[117693]: pgmap v1603: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:30.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:30 smithi181 ceph-mon[101094]: pgmap v1603: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:32.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:32 smithi157 ceph-mon[117693]: pgmap v1604: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:32.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:32 smithi181 ceph-mon[101094]: pgmap v1604: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:34.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:34 smithi157 ceph-mon[117693]: pgmap v1605: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:34.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:34 smithi181 ceph-mon[101094]: pgmap v1605: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:36.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:36 smithi157 ceph-mon[117693]: pgmap v1606: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:36.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:36 smithi181 ceph-mon[101094]: pgmap v1606: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:38.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:38 smithi157 ceph-mon[117693]: pgmap v1607: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:38.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:38 smithi181 ceph-mon[101094]: pgmap v1607: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:40.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:40 smithi157 ceph-mon[117693]: pgmap v1608: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:40.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:40 smithi181 ceph-mon[101094]: pgmap v1608: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:42.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:42 smithi157 ceph-mon[117693]: pgmap v1609: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:42.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:42 smithi181 ceph-mon[101094]: pgmap v1609: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:44.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:44 smithi157 ceph-mon[117693]: pgmap v1610: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:44.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:44.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:44 smithi181 ceph-mon[101094]: pgmap v1610: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:44.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:34:46.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:46 smithi157 ceph-mon[117693]: pgmap v1611: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:46.838 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:46 smithi181 ceph-mon[101094]: pgmap v1611: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:48.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:48 smithi157 ceph-mon[117693]: pgmap v1612: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:48.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:48 smithi181 ceph-mon[101094]: pgmap v1612: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:50.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:50 smithi157 ceph-mon[117693]: pgmap v1613: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:50.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:50 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:34:50.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:50 smithi181 ceph-mon[101094]: pgmap v1613: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:50.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:50 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:34:51.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:34:51.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:34:51.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:34:51.836 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:34:51.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:34:51.837 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:34:53.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:52 smithi157 ceph-mon[117693]: pgmap v1614: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:53.086 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:52 smithi181 ceph-mon[101094]: pgmap v1614: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:34:55.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:54 smithi157 ceph-mon[117693]: pgmap v1615: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:55.086 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:54 smithi181 ceph-mon[101094]: pgmap v1615: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:57.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:56 smithi157 ceph-mon[117693]: pgmap v1616: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:57.086 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:56 smithi181 ceph-mon[101094]: pgmap v1616: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:34:59.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:58 smithi157 ceph-mon[117693]: pgmap v1617: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:34:59.086 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:58 smithi181 ceph-mon[101094]: pgmap v1617: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:00.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:34:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:00.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:34:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:01.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:00 smithi157 ceph-mon[117693]: pgmap v1618: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:01.086 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:00 smithi181 ceph-mon[101094]: pgmap v1618: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:03.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:02 smithi157 ceph-mon[117693]: pgmap v1619: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:03.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:02 smithi181 ceph-mon[101094]: pgmap v1619: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:05.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:04 smithi157 ceph-mon[117693]: pgmap v1620: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:05.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:04 smithi181 ceph-mon[101094]: pgmap v1620: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:07.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:06 smithi157 ceph-mon[117693]: pgmap v1621: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:07.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:06 smithi181 ceph-mon[101094]: pgmap v1621: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:09.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:08 smithi157 ceph-mon[117693]: pgmap v1622: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:09.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:08 smithi181 ceph-mon[101094]: pgmap v1622: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:11.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:10 smithi157 ceph-mon[117693]: pgmap v1623: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:11.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:10 smithi181 ceph-mon[101094]: pgmap v1623: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:13.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:12 smithi157 ceph-mon[117693]: pgmap v1624: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:13.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:12 smithi181 ceph-mon[101094]: pgmap v1624: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:15.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:14 smithi157 ceph-mon[117693]: pgmap v1625: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:15.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:15.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:14 smithi181 ceph-mon[101094]: pgmap v1625: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:15.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:17.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:16 smithi157 ceph-mon[117693]: pgmap v1626: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:17.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:16 smithi181 ceph-mon[101094]: pgmap v1626: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:19.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:18 smithi157 ceph-mon[117693]: pgmap v1627: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:19.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:18 smithi181 ceph-mon[101094]: pgmap v1627: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:21.054 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:20 smithi157 ceph-mon[117693]: pgmap v1628: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:21.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:20 smithi181 ceph-mon[101094]: pgmap v1628: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:23.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:22 smithi157 ceph-mon[117693]: pgmap v1629: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:23.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:22 smithi181 ceph-mon[101094]: pgmap v1629: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:25.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:24 smithi157 ceph-mon[117693]: pgmap v1630: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:25.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:24 smithi181 ceph-mon[101094]: pgmap v1630: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:27.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:26 smithi181 ceph-mon[101094]: pgmap v1631: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:27.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:26 smithi157 ceph-mon[117693]: pgmap v1631: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:29.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:28 smithi181 ceph-mon[101094]: pgmap v1632: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:29.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:28 smithi157 ceph-mon[117693]: pgmap v1632: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:30.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:30.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:31.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:30 smithi181 ceph-mon[101094]: pgmap v1633: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:31.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:30 smithi157 ceph-mon[117693]: pgmap v1633: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:33.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:32 smithi181 ceph-mon[101094]: pgmap v1634: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:33.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:32 smithi157 ceph-mon[117693]: pgmap v1634: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:35.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:34 smithi181 ceph-mon[101094]: pgmap v1635: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:35.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:34 smithi157 ceph-mon[117693]: pgmap v1635: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:37.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:36 smithi181 ceph-mon[101094]: pgmap v1636: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:37.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:36 smithi157 ceph-mon[117693]: pgmap v1636: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:39.087 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:38 smithi181 ceph-mon[101094]: pgmap v1637: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:39.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:38 smithi157 ceph-mon[117693]: pgmap v1637: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:41.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:40 smithi157 ceph-mon[117693]: pgmap v1638: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:41.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:40 smithi181 ceph-mon[101094]: pgmap v1638: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:43.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:42 smithi157 ceph-mon[117693]: pgmap v1639: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:43.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:42 smithi181 ceph-mon[101094]: pgmap v1639: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:45.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:44 smithi157 ceph-mon[117693]: pgmap v1640: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:45.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:45.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:44 smithi181 ceph-mon[101094]: pgmap v1640: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:45.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:35:47.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:46 smithi157 ceph-mon[117693]: pgmap v1641: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:47.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:46 smithi181 ceph-mon[101094]: pgmap v1641: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:49.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:48 smithi157 ceph-mon[117693]: pgmap v1642: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:49.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:48 smithi181 ceph-mon[101094]: pgmap v1642: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:51.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:50 smithi157 ceph-mon[117693]: pgmap v1643: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:51.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:50 smithi181 ceph-mon[101094]: pgmap v1643: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:52.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:35:52.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:35:52.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:35:52.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:51 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:35:52.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:35:52.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:35:52.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:35:52.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:51 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:35:53.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:52 smithi157 ceph-mon[117693]: pgmap v1644: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:53.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:52 smithi181 ceph-mon[101094]: pgmap v1644: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:35:55.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:54 smithi157 ceph-mon[117693]: pgmap v1645: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:55.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:54 smithi181 ceph-mon[101094]: pgmap v1645: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:57.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:56 smithi157 ceph-mon[117693]: pgmap v1646: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:57.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:56 smithi181 ceph-mon[101094]: pgmap v1646: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:35:59.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:58 smithi157 ceph-mon[117693]: pgmap v1647: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:35:59.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:58 smithi181 ceph-mon[101094]: pgmap v1647: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:00.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:35:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:00.337 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:35:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:01.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:00 smithi157 ceph-mon[117693]: pgmap v1648: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:01.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:00 smithi181 ceph-mon[101094]: pgmap v1648: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:03.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:02 smithi157 ceph-mon[117693]: pgmap v1649: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:03.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:02 smithi181 ceph-mon[101094]: pgmap v1649: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:05.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:04 smithi157 ceph-mon[117693]: pgmap v1650: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:05.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:04 smithi181 ceph-mon[101094]: pgmap v1650: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:07.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:06 smithi157 ceph-mon[117693]: pgmap v1651: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:07.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:06 smithi181 ceph-mon[101094]: pgmap v1651: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:08.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:07 smithi157 ceph-mon[117693]: pgmap v1652: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:08.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:07 smithi181 ceph-mon[101094]: pgmap v1652: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:10.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:10 smithi157 ceph-mon[117693]: pgmap v1653: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:10.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:10 smithi181 ceph-mon[101094]: pgmap v1653: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:12.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:12 smithi157 ceph-mon[117693]: pgmap v1654: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:12.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:12 smithi181 ceph-mon[101094]: pgmap v1654: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:14.305 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:14 smithi157 ceph-mon[117693]: pgmap v1655: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:14.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:14 smithi181 ceph-mon[101094]: pgmap v1655: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:15.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:15.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:16.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:16 smithi181 ceph-mon[101094]: pgmap v1656: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:16.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:16 smithi157 ceph-mon[117693]: pgmap v1656: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:18.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:18 smithi181 ceph-mon[101094]: pgmap v1657: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:18.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:18 smithi157 ceph-mon[117693]: pgmap v1657: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:20.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:20 smithi181 ceph-mon[101094]: pgmap v1658: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:20.555 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:20 smithi157 ceph-mon[117693]: pgmap v1658: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:22.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:22 smithi181 ceph-mon[101094]: pgmap v1659: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:22.555 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:22 smithi157 ceph-mon[117693]: pgmap v1659: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:24.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:24 smithi181 ceph-mon[101094]: pgmap v1660: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:24.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:24 smithi157 ceph-mon[117693]: pgmap v1660: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:26.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:26 smithi181 ceph-mon[101094]: pgmap v1661: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:26.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:26 smithi157 ceph-mon[117693]: pgmap v1661: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:28.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:28 smithi181 ceph-mon[101094]: pgmap v1662: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:28.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:28 smithi157 ceph-mon[117693]: pgmap v1662: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:30.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:30 smithi157 ceph-mon[117693]: pgmap v1663: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:30.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:30.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:30 smithi181 ceph-mon[101094]: pgmap v1663: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:30.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:32.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:32 smithi157 ceph-mon[117693]: pgmap v1664: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:32.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:32 smithi181 ceph-mon[101094]: pgmap v1664: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:34.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:34 smithi157 ceph-mon[117693]: pgmap v1665: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:36:34.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:34 smithi181 ceph-mon[101094]: pgmap v1665: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:36:36.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:36 smithi157 ceph-mon[117693]: pgmap v1666: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:36.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:36 smithi181 ceph-mon[101094]: pgmap v1666: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:38.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:38 smithi157 ceph-mon[117693]: pgmap v1667: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:38.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:38 smithi181 ceph-mon[101094]: pgmap v1667: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:40.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:40 smithi157 ceph-mon[117693]: pgmap v1668: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:40.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:40 smithi181 ceph-mon[101094]: pgmap v1668: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-03T09:36:42.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:42 smithi157 ceph-mon[117693]: pgmap v1669: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:42.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:42 smithi181 ceph-mon[101094]: pgmap v1669: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:44.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:44 smithi157 ceph-mon[117693]: pgmap v1670: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:44.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:44 smithi181 ceph-mon[101094]: pgmap v1670: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:45.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:45.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:36:46.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:46 smithi157 ceph-mon[117693]: pgmap v1671: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:46.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:46 smithi181 ceph-mon[101094]: pgmap v1671: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:48.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:48 smithi157 ceph-mon[117693]: pgmap v1672: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:48.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:48 smithi181 ceph-mon[101094]: pgmap v1672: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:50.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:50 smithi157 ceph-mon[117693]: pgmap v1673: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:50.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:50 smithi181 ceph-mon[101094]: pgmap v1673: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:52.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:52 smithi157 ceph-mon[117693]: pgmap v1674: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:52.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:52 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:36:52.588 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:52 smithi181 ceph-mon[101094]: pgmap v1674: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:36:52.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:52 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:36:53.556 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:36:53.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:36:53.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:36:53.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:36:53.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:36:53.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:36:55.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:54 smithi157 ceph-mon[117693]: pgmap v1675: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:55.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:54 smithi181 ceph-mon[101094]: pgmap v1675: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:57.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:56 smithi157 ceph-mon[117693]: pgmap v1676: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:57.338 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:56 smithi181 ceph-mon[101094]: pgmap v1676: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:36:59.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:58 smithi157 ceph-mon[117693]: pgmap v1677: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:36:59.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:58 smithi181 ceph-mon[101094]: pgmap v1677: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:00.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:36:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:00.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:36:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:01.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:00 smithi157 ceph-mon[117693]: pgmap v1678: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:01.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:00 smithi181 ceph-mon[101094]: pgmap v1678: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:03.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:02 smithi157 ceph-mon[117693]: pgmap v1679: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:03.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:02 smithi181 ceph-mon[101094]: pgmap v1679: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:05.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:04 smithi157 ceph-mon[117693]: pgmap v1680: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:05.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:04 smithi181 ceph-mon[101094]: pgmap v1680: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:07.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:06 smithi157 ceph-mon[117693]: pgmap v1681: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:07.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:06 smithi181 ceph-mon[101094]: pgmap v1681: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:09.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:08 smithi157 ceph-mon[117693]: pgmap v1682: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:09.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:08 smithi181 ceph-mon[101094]: pgmap v1682: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:11.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:10 smithi157 ceph-mon[117693]: pgmap v1683: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:11.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:10 smithi181 ceph-mon[101094]: pgmap v1683: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:13.306 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:12 smithi157 ceph-mon[117693]: pgmap v1684: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:13.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:12 smithi181 ceph-mon[101094]: pgmap v1684: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:15.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:14 smithi157 ceph-mon[117693]: pgmap v1685: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:15.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:15.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:14 smithi181 ceph-mon[101094]: pgmap v1685: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:15.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:17.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:16 smithi157 ceph-mon[117693]: pgmap v1686: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:17.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:16 smithi181 ceph-mon[101094]: pgmap v1686: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:19.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:18 smithi157 ceph-mon[117693]: pgmap v1687: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:19.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:18 smithi181 ceph-mon[101094]: pgmap v1687: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:21.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:20 smithi157 ceph-mon[117693]: pgmap v1688: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:21.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:20 smithi181 ceph-mon[101094]: pgmap v1688: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:22.307 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:21 smithi157 ceph-mon[117693]: pgmap v1689: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:22.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:21 smithi181 ceph-mon[101094]: pgmap v1689: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:24.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:24 smithi181 ceph-mon[101094]: pgmap v1690: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:24.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:24 smithi157 ceph-mon[117693]: pgmap v1690: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:26.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:26 smithi181 ceph-mon[101094]: pgmap v1691: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:26.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:26 smithi157 ceph-mon[117693]: pgmap v1691: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:28.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:28 smithi181 ceph-mon[101094]: pgmap v1692: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:28.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:28 smithi157 ceph-mon[117693]: pgmap v1692: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:30.340 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:30 smithi181 ceph-mon[101094]: pgmap v1693: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:30.340 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:30.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:30 smithi157 ceph-mon[117693]: pgmap v1693: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:30.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:32.339 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:32 smithi181 ceph-mon[101094]: pgmap v1694: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:32.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:32 smithi157 ceph-mon[117693]: pgmap v1694: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:34.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:34 smithi157 ceph-mon[117693]: pgmap v1695: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:34.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:34 smithi181 ceph-mon[101094]: pgmap v1695: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:36.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:36 smithi157 ceph-mon[117693]: pgmap v1696: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:36.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:36 smithi181 ceph-mon[101094]: pgmap v1696: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:38.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:38 smithi157 ceph-mon[117693]: pgmap v1697: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:38.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:38 smithi181 ceph-mon[101094]: pgmap v1697: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:40.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:40 smithi157 ceph-mon[117693]: pgmap v1698: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:40.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:40 smithi181 ceph-mon[101094]: pgmap v1698: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:42.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:42 smithi157 ceph-mon[117693]: pgmap v1699: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:42.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:42 smithi181 ceph-mon[101094]: pgmap v1699: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:44.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:44 smithi157 ceph-mon[117693]: pgmap v1700: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:44.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:44 smithi181 ceph-mon[101094]: pgmap v1700: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:45.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:45.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:37:46.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:46 smithi157 ceph-mon[117693]: pgmap v1701: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:46.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:46 smithi181 ceph-mon[101094]: pgmap v1701: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:48.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:48 smithi157 ceph-mon[117693]: pgmap v1702: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:48.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:48 smithi181 ceph-mon[101094]: pgmap v1702: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:50.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:50 smithi157 ceph-mon[117693]: pgmap v1703: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:50.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:50 smithi181 ceph-mon[101094]: pgmap v1703: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:52.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:52 smithi157 ceph-mon[117693]: pgmap v1704: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:52.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:52 smithi181 ceph-mon[101094]: pgmap v1704: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:37:53.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:53 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:37:53.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:53 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:37:54.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:54 smithi157 ceph-mon[117693]: pgmap v1705: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:54.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:37:54.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:37:54.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:37:54.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:54 smithi181 ceph-mon[101094]: pgmap v1705: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:54.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:37:54.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:37:54.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:37:56.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:56 smithi157 ceph-mon[117693]: pgmap v1706: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:56.589 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:56 smithi181 ceph-mon[101094]: pgmap v1706: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:37:58.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:37:58 smithi157 ceph-mon[117693]: pgmap v1707: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:37:58.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:37:58 smithi181 ceph-mon[101094]: pgmap v1707: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:00.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:00 smithi157 ceph-mon[117693]: pgmap v1708: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:00.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:00.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:00 smithi181 ceph-mon[101094]: pgmap v1708: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:00.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:02.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:02 smithi157 ceph-mon[117693]: pgmap v1709: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:02.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:02 smithi181 ceph-mon[101094]: pgmap v1709: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:04.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:04 smithi157 ceph-mon[117693]: pgmap v1710: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:04.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:04 smithi181 ceph-mon[101094]: pgmap v1710: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:06.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:06 smithi157 ceph-mon[117693]: pgmap v1711: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:06.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:06 smithi181 ceph-mon[101094]: pgmap v1711: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:08.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:08 smithi157 ceph-mon[117693]: pgmap v1712: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:08.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:08 smithi181 ceph-mon[101094]: pgmap v1712: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:10.557 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:10 smithi157 ceph-mon[117693]: pgmap v1713: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:10.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:10 smithi181 ceph-mon[101094]: pgmap v1713: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:12.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:12 smithi157 ceph-mon[117693]: pgmap v1714: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:12.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:12 smithi181 ceph-mon[101094]: pgmap v1714: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:14.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:14 smithi157 ceph-mon[117693]: pgmap v1715: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:14.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:14 smithi181 ceph-mon[101094]: pgmap v1715: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:15.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:15.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:16.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:16 smithi157 ceph-mon[117693]: pgmap v1716: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:16.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:16 smithi181 ceph-mon[101094]: pgmap v1716: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:18.558 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:18 smithi157 ceph-mon[117693]: pgmap v1717: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:18.590 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:18 smithi181 ceph-mon[101094]: pgmap v1717: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:20.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:20 smithi157 ceph-mon[117693]: pgmap v1718: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:38:20.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:20 smithi181 ceph-mon[101094]: pgmap v1718: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:38:22.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:22 smithi157 ceph-mon[117693]: pgmap v1719: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:38:22.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:22 smithi181 ceph-mon[101094]: pgmap v1719: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:38:24.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:24 smithi157 ceph-mon[117693]: pgmap v1720: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:38:24.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:24 smithi181 ceph-mon[101094]: pgmap v1720: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:38:26.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:26 smithi157 ceph-mon[117693]: pgmap v1721: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:38:26.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:26 smithi181 ceph-mon[101094]: pgmap v1721: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:38:28.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:28 smithi157 ceph-mon[117693]: pgmap v1722: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:28.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:28 smithi181 ceph-mon[101094]: pgmap v1722: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:29.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:29.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:30.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:30 smithi157 ceph-mon[117693]: pgmap v1723: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:30.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:30 smithi181 ceph-mon[101094]: pgmap v1723: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:32.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:32 smithi157 ceph-mon[117693]: pgmap v1724: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:32.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:32 smithi181 ceph-mon[101094]: pgmap v1724: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:34.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:34 smithi157 ceph-mon[117693]: pgmap v1725: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:34.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:34 smithi181 ceph-mon[101094]: pgmap v1725: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:36.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:36 smithi157 ceph-mon[117693]: pgmap v1726: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:36.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:36 smithi181 ceph-mon[101094]: pgmap v1726: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:38.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:38 smithi157 ceph-mon[117693]: pgmap v1727: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:38.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:38 smithi181 ceph-mon[101094]: pgmap v1727: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:40.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:40 smithi157 ceph-mon[117693]: pgmap v1728: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:40.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:40 smithi181 ceph-mon[101094]: pgmap v1728: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:42.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:42 smithi157 ceph-mon[117693]: pgmap v1729: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:42.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:42 smithi181 ceph-mon[101094]: pgmap v1729: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:44.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:44 smithi157 ceph-mon[117693]: pgmap v1730: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:44.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:44.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:44 smithi181 ceph-mon[101094]: pgmap v1730: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:44.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:46.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:46 smithi157 ceph-mon[117693]: pgmap v1731: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:46.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:46 smithi181 ceph-mon[101094]: pgmap v1731: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:48.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:48 smithi157 ceph-mon[117693]: pgmap v1732: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:48.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:48 smithi181 ceph-mon[101094]: pgmap v1732: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:50.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:50 smithi157 ceph-mon[117693]: pgmap v1733: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:50.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:50 smithi181 ceph-mon[101094]: pgmap v1733: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:52.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:52 smithi157 ceph-mon[117693]: pgmap v1734: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:52.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:52 smithi181 ceph-mon[101094]: pgmap v1734: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:38:54.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:54 smithi157 ceph-mon[117693]: pgmap v1735: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:54.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:54 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:38:54.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:54 smithi181 ceph-mon[101094]: pgmap v1735: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:54.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:54 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:38:55.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:38:55.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:38:55.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:38:55.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:38:55.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:38:55.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:38:56.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:56 smithi157 ceph-mon[117693]: pgmap v1736: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:56.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:56 smithi181 ceph-mon[101094]: pgmap v1736: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:38:58.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:58 smithi157 ceph-mon[117693]: pgmap v1737: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:58.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:58 smithi181 ceph-mon[101094]: pgmap v1737: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:38:59.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:38:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:38:59.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:38:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:00.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:00 smithi157 ceph-mon[117693]: pgmap v1738: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:00.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:00 smithi181 ceph-mon[101094]: pgmap v1738: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:02.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:02 smithi157 ceph-mon[117693]: pgmap v1739: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:02.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:02 smithi181 ceph-mon[101094]: pgmap v1739: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:04.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:04 smithi157 ceph-mon[117693]: pgmap v1740: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:04.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:04 smithi181 ceph-mon[101094]: pgmap v1740: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:06.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:06 smithi157 ceph-mon[117693]: pgmap v1741: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:06.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:06 smithi181 ceph-mon[101094]: pgmap v1741: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:08.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:08 smithi157 ceph-mon[117693]: pgmap v1742: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:08.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:08 smithi181 ceph-mon[101094]: pgmap v1742: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:10.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:10 smithi157 ceph-mon[117693]: pgmap v1743: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:10.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:10 smithi181 ceph-mon[101094]: pgmap v1743: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:12.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:12 smithi157 ceph-mon[117693]: pgmap v1744: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:12.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:12 smithi181 ceph-mon[101094]: pgmap v1744: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:14.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:14 smithi157 ceph-mon[117693]: pgmap v1745: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:14.810 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:14.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:14 smithi181 ceph-mon[101094]: pgmap v1745: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:14.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:16.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:16 smithi157 ceph-mon[117693]: pgmap v1746: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:16.840 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:16 smithi181 ceph-mon[101094]: pgmap v1746: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:18.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:18 smithi157 ceph-mon[117693]: pgmap v1747: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:18.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:18 smithi181 ceph-mon[101094]: pgmap v1747: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:20.808 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:20 smithi157 ceph-mon[117693]: pgmap v1748: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:20.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:20 smithi181 ceph-mon[101094]: pgmap v1748: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:22.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:22 smithi157 ceph-mon[117693]: pgmap v1749: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:22.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:22 smithi181 ceph-mon[101094]: pgmap v1749: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:24.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:24 smithi157 ceph-mon[117693]: pgmap v1750: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:24.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:24 smithi181 ceph-mon[101094]: pgmap v1750: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:26.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:26 smithi157 ceph-mon[117693]: pgmap v1751: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:26.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:26 smithi181 ceph-mon[101094]: pgmap v1751: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:28.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:28 smithi157 ceph-mon[117693]: pgmap v1752: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:28.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:28 smithi181 ceph-mon[101094]: pgmap v1752: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:29.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:30.058 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:30.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:30 smithi181 ceph-mon[101094]: pgmap v1753: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:31.058 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:30 smithi157 ceph-mon[117693]: pgmap v1753: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:32.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:32 smithi181 ceph-mon[101094]: pgmap v1754: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:33.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:32 smithi157 ceph-mon[117693]: pgmap v1754: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:34.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:34 smithi181 ceph-mon[101094]: pgmap v1755: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:35.058 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:34 smithi157 ceph-mon[117693]: pgmap v1755: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:36.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:36 smithi181 ceph-mon[101094]: pgmap v1756: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:37.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:36 smithi157 ceph-mon[117693]: pgmap v1756: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:38.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:38 smithi181 ceph-mon[101094]: pgmap v1757: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:39.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:38 smithi157 ceph-mon[117693]: pgmap v1757: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:40.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:40 smithi181 ceph-mon[101094]: pgmap v1758: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:41.058 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:40 smithi157 ceph-mon[117693]: pgmap v1758: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:42.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:42 smithi181 ceph-mon[101094]: pgmap v1759: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:43.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:42 smithi157 ceph-mon[117693]: pgmap v1759: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:44.841 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:44 smithi181 ceph-mon[101094]: pgmap v1760: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:44.842 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:45.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:44 smithi157 ceph-mon[117693]: pgmap v1760: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:45.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:39:47.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:46 smithi157 ceph-mon[117693]: pgmap v1761: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:47.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:46 smithi181 ceph-mon[101094]: pgmap v1761: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:49.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:48 smithi157 ceph-mon[117693]: pgmap v1762: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:49.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:48 smithi181 ceph-mon[101094]: pgmap v1762: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:51.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:50 smithi157 ceph-mon[117693]: pgmap v1763: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:51.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:50 smithi181 ceph-mon[101094]: pgmap v1763: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:53.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:52 smithi157 ceph-mon[117693]: pgmap v1764: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:53.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:52 smithi181 ceph-mon[101094]: pgmap v1764: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:39:55.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:54 smithi157 ceph-mon[117693]: pgmap v1765: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:55.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:54 smithi181 ceph-mon[101094]: pgmap v1765: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:56.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:55 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:39:56.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:55 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:39:57.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:56 smithi157 ceph-mon[117693]: pgmap v1766: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:57.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:39:57.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:39:57.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:39:57.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:56 smithi181 ceph-mon[101094]: pgmap v1766: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:39:57.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:39:57.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:39:57.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:39:59.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:58 smithi157 ceph-mon[117693]: pgmap v1767: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:39:59.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:58 smithi181 ceph-mon[101094]: pgmap v1767: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:00.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:39:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:00.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:39:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:01.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:00 smithi157 ceph-mon[117693]: pgmap v1768: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:01.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T09:40:01.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:00 smithi181 ceph-mon[101094]: pgmap v1768: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:01.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T09:40:03.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:02 smithi157 ceph-mon[117693]: pgmap v1769: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:03.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:02 smithi181 ceph-mon[101094]: pgmap v1769: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:04.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:04 smithi157 ceph-mon[117693]: pgmap v1770: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:05.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:04 smithi181 ceph-mon[101094]: pgmap v1770: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:07.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:06 smithi157 ceph-mon[117693]: pgmap v1771: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:07.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:06 smithi181 ceph-mon[101094]: pgmap v1771: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:09.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:08 smithi157 ceph-mon[117693]: pgmap v1772: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:09.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:08 smithi181 ceph-mon[101094]: pgmap v1772: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:11.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:10 smithi157 ceph-mon[117693]: pgmap v1773: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:11.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:10 smithi181 ceph-mon[101094]: pgmap v1773: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:13.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:12 smithi157 ceph-mon[117693]: pgmap v1774: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:13.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:12 smithi181 ceph-mon[101094]: pgmap v1774: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:15.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:14 smithi157 ceph-mon[117693]: pgmap v1775: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:15.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:15.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:14 smithi181 ceph-mon[101094]: pgmap v1775: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:15.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:17.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:16 smithi157 ceph-mon[117693]: pgmap v1776: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:17.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:16 smithi181 ceph-mon[101094]: pgmap v1776: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:19.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:18 smithi157 ceph-mon[117693]: pgmap v1777: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:19.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:18 smithi181 ceph-mon[101094]: pgmap v1777: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:21.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:20 smithi157 ceph-mon[117693]: pgmap v1778: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:21.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:20 smithi181 ceph-mon[101094]: pgmap v1778: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:22.971 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:22 smithi181 ceph-mon[101094]: pgmap v1779: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:23.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:22 smithi157 ceph-mon[117693]: pgmap v1779: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:25.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:24 smithi157 ceph-mon[117693]: pgmap v1780: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:25.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:24 smithi181 ceph-mon[101094]: pgmap v1780: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:27.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:26 smithi157 ceph-mon[117693]: pgmap v1781: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:27.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:26 smithi181 ceph-mon[101094]: pgmap v1781: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:29.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:28 smithi157 ceph-mon[117693]: pgmap v1782: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:29.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:28 smithi181 ceph-mon[101094]: pgmap v1782: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:30.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:30.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:31.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:30 smithi157 ceph-mon[117693]: pgmap v1783: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:31.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:30 smithi181 ceph-mon[101094]: pgmap v1783: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:33.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:32 smithi157 ceph-mon[117693]: pgmap v1784: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:33.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:32 smithi181 ceph-mon[101094]: pgmap v1784: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:35.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:34 smithi157 ceph-mon[117693]: pgmap v1785: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:35.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:34 smithi181 ceph-mon[101094]: pgmap v1785: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:37.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:36 smithi157 ceph-mon[117693]: pgmap v1786: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:37.091 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:36 smithi181 ceph-mon[101094]: pgmap v1786: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:39.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:38 smithi157 ceph-mon[117693]: pgmap v1787: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:39.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:38 smithi181 ceph-mon[101094]: pgmap v1787: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:41.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:40 smithi157 ceph-mon[117693]: pgmap v1788: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:41.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:40 smithi181 ceph-mon[101094]: pgmap v1788: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:43.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:42 smithi157 ceph-mon[117693]: pgmap v1789: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:43.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:42 smithi181 ceph-mon[101094]: pgmap v1789: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:45.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:44 smithi157 ceph-mon[117693]: pgmap v1790: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:45.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:45.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:44 smithi181 ceph-mon[101094]: pgmap v1790: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:45.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:40:47.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:46 smithi157 ceph-mon[117693]: pgmap v1791: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:47.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:46 smithi181 ceph-mon[101094]: pgmap v1791: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:49.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:48 smithi157 ceph-mon[117693]: pgmap v1792: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:49.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:48 smithi181 ceph-mon[101094]: pgmap v1792: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:51.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:50 smithi157 ceph-mon[117693]: pgmap v1793: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:51.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:50 smithi181 ceph-mon[101094]: pgmap v1793: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:53.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:52 smithi157 ceph-mon[117693]: pgmap v1794: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:53.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:52 smithi181 ceph-mon[101094]: pgmap v1794: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:40:55.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:54 smithi157 ceph-mon[117693]: pgmap v1795: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:55.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:54 smithi181 ceph-mon[101094]: pgmap v1795: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:57.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:56 smithi157 ceph-mon[117693]: pgmap v1796: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:57.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:56 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:40:57.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:56 smithi181 ceph-mon[101094]: pgmap v1796: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:40:57.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:56 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:40:59.059 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:40:58 smithi157 ceph-mon[117693]: pgmap v1797: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:40:59.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:40:58 smithi181 ceph-mon[101094]: pgmap v1797: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: pgmap v1798: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:41:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: pgmap v1798: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:41:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:41:02.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:02 smithi157 ceph-mon[117693]: pgmap v1799: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:02.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:02 smithi181 ceph-mon[101094]: pgmap v1799: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:04.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:04 smithi157 ceph-mon[117693]: pgmap v1800: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:04.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:04 smithi181 ceph-mon[101094]: pgmap v1800: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:06.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:06 smithi157 ceph-mon[117693]: pgmap v1801: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:06.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:06 smithi181 ceph-mon[101094]: pgmap v1801: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:08.559 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:08 smithi157 ceph-mon[117693]: pgmap v1802: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:08.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:08 smithi181 ceph-mon[101094]: pgmap v1802: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:10.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:10 smithi157 ceph-mon[117693]: pgmap v1803: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:10.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:10 smithi181 ceph-mon[101094]: pgmap v1803: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:12.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:12 smithi157 ceph-mon[117693]: pgmap v1804: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:12.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:12 smithi181 ceph-mon[101094]: pgmap v1804: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:14.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:14 smithi157 ceph-mon[117693]: pgmap v1805: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:14.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:14 smithi181 ceph-mon[101094]: pgmap v1805: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:15.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:15.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:16.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:16 smithi157 ceph-mon[117693]: pgmap v1806: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:16.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:16 smithi181 ceph-mon[101094]: pgmap v1806: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:18.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:18 smithi157 ceph-mon[117693]: pgmap v1807: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:18.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:18 smithi181 ceph-mon[101094]: pgmap v1807: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:20.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:20 smithi157 ceph-mon[117693]: pgmap v1808: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:20.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:20 smithi181 ceph-mon[101094]: pgmap v1808: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:22.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:22 smithi157 ceph-mon[117693]: pgmap v1809: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:22.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:22 smithi181 ceph-mon[101094]: pgmap v1809: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:24.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:24 smithi157 ceph-mon[117693]: pgmap v1810: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:24.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:24 smithi181 ceph-mon[101094]: pgmap v1810: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:26.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:26 smithi157 ceph-mon[117693]: pgmap v1811: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:26.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:26 smithi181 ceph-mon[101094]: pgmap v1811: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:28.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:28 smithi157 ceph-mon[117693]: pgmap v1812: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:28.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:28 smithi181 ceph-mon[101094]: pgmap v1812: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:30.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:30 smithi157 ceph-mon[117693]: pgmap v1813: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:30.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:30.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:30 smithi181 ceph-mon[101094]: pgmap v1813: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:30.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:32.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:32 smithi157 ceph-mon[117693]: pgmap v1814: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:32.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:32 smithi181 ceph-mon[101094]: pgmap v1814: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:34.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:34 smithi157 ceph-mon[117693]: pgmap v1815: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:34.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:34 smithi181 ceph-mon[101094]: pgmap v1815: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:36.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:36 smithi157 ceph-mon[117693]: pgmap v1816: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:36.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:36 smithi181 ceph-mon[101094]: pgmap v1816: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:38.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:38 smithi157 ceph-mon[117693]: pgmap v1817: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:38.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:38 smithi181 ceph-mon[101094]: pgmap v1817: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:40.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:40 smithi157 ceph-mon[117693]: pgmap v1818: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:40.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:40 smithi181 ceph-mon[101094]: pgmap v1818: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:42.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:42 smithi157 ceph-mon[117693]: pgmap v1819: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:42.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:42 smithi181 ceph-mon[101094]: pgmap v1819: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:44.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:44 smithi157 ceph-mon[117693]: pgmap v1820: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:44.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:44 smithi181 ceph-mon[101094]: pgmap v1820: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:45.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:45.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:41:46.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:46 smithi157 ceph-mon[117693]: pgmap v1821: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:46.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:46 smithi181 ceph-mon[101094]: pgmap v1821: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:48.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:48 smithi157 ceph-mon[117693]: pgmap v1822: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:48.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:48 smithi181 ceph-mon[101094]: pgmap v1822: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:50.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:50 smithi157 ceph-mon[117693]: pgmap v1823: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:50.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:50 smithi181 ceph-mon[101094]: pgmap v1823: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:52.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:52 smithi157 ceph-mon[117693]: pgmap v1824: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:52.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:52 smithi181 ceph-mon[101094]: pgmap v1824: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:41:54.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:54 smithi157 ceph-mon[117693]: pgmap v1825: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:54.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:54 smithi181 ceph-mon[101094]: pgmap v1825: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:56.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:56 smithi157 ceph-mon[117693]: pgmap v1826: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:56.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:56 smithi181 ceph-mon[101094]: pgmap v1826: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:41:58.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:41:58 smithi157 ceph-mon[117693]: pgmap v1827: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:41:58.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:41:58 smithi181 ceph-mon[101094]: pgmap v1827: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:00 smithi157 ceph-mon[117693]: pgmap v1828: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:00.560 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:42:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:00 smithi181 ceph-mon[101094]: pgmap v1828: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:00.592 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:00.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:42:02.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:02.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:01 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:02.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:02.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:01 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:03.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:02 smithi157 ceph-mon[117693]: pgmap v1829: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:03.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:02 smithi181 ceph-mon[101094]: pgmap v1829: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:05.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:04 smithi157 ceph-mon[117693]: pgmap v1830: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:05.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:04 smithi181 ceph-mon[101094]: pgmap v1830: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:07.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:06 smithi157 ceph-mon[117693]: pgmap v1831: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:07.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:07.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:06 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:07.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:06 smithi181 ceph-mon[101094]: pgmap v1831: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:07.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:07.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:06 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:08.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:42:08.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:42:08.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:08.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:42:08.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:42:08.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:42:09.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:08 smithi157 ceph-mon[117693]: pgmap v1832: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:09.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:08 smithi181 ceph-mon[101094]: pgmap v1832: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:11.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:10 smithi157 ceph-mon[117693]: pgmap v1833: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:11.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:10 smithi181 ceph-mon[101094]: pgmap v1833: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:13.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:12 smithi157 ceph-mon[117693]: pgmap v1834: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:13.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:12 smithi181 ceph-mon[101094]: pgmap v1834: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:15.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:14 smithi157 ceph-mon[117693]: pgmap v1835: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:15.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:15.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:14 smithi181 ceph-mon[101094]: pgmap v1835: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:15.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:17.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:16 smithi157 ceph-mon[117693]: pgmap v1836: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:17.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:16 smithi181 ceph-mon[101094]: pgmap v1836: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:19.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:18 smithi157 ceph-mon[117693]: pgmap v1837: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:19.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:18 smithi181 ceph-mon[101094]: pgmap v1837: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:21.060 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:20 smithi157 ceph-mon[117693]: pgmap v1838: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:21.092 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:20 smithi181 ceph-mon[101094]: pgmap v1838: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:23.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:22 smithi181 ceph-mon[101094]: pgmap v1839: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:23.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:22 smithi157 ceph-mon[117693]: pgmap v1839: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:25.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:24 smithi181 ceph-mon[101094]: pgmap v1840: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:25.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:24 smithi157 ceph-mon[117693]: pgmap v1840: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:27.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:26 smithi181 ceph-mon[101094]: pgmap v1841: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:27.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:26 smithi157 ceph-mon[117693]: pgmap v1841: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:29.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:28 smithi181 ceph-mon[101094]: pgmap v1842: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:29.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:28 smithi157 ceph-mon[117693]: pgmap v1842: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:30.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:30.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:31.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:30 smithi181 ceph-mon[101094]: pgmap v1843: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:31.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:30 smithi157 ceph-mon[117693]: pgmap v1843: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:33.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:32 smithi181 ceph-mon[101094]: pgmap v1844: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:33.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:32 smithi157 ceph-mon[117693]: pgmap v1844: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:35.093 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:34 smithi181 ceph-mon[101094]: pgmap v1845: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:35.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:34 smithi157 ceph-mon[117693]: pgmap v1845: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:37.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:36 smithi157 ceph-mon[117693]: pgmap v1846: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:37.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:36 smithi181 ceph-mon[101094]: pgmap v1846: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:39.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:38 smithi157 ceph-mon[117693]: pgmap v1847: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:39.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:38 smithi181 ceph-mon[101094]: pgmap v1847: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:41.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:40 smithi157 ceph-mon[117693]: pgmap v1848: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:41.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:40 smithi181 ceph-mon[101094]: pgmap v1848: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:43.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:42 smithi157 ceph-mon[117693]: pgmap v1849: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:43.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:42 smithi181 ceph-mon[101094]: pgmap v1849: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:45.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:44 smithi157 ceph-mon[117693]: pgmap v1850: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:45.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:45.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:44 smithi181 ceph-mon[101094]: pgmap v1850: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:45.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:42:47.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:46 smithi157 ceph-mon[117693]: pgmap v1851: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:47.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:46 smithi181 ceph-mon[101094]: pgmap v1851: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:49.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:48 smithi157 ceph-mon[117693]: pgmap v1852: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:49.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:48 smithi181 ceph-mon[101094]: pgmap v1852: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:51.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:50 smithi157 ceph-mon[117693]: pgmap v1853: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:51.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:50 smithi181 ceph-mon[101094]: pgmap v1853: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:53.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:52 smithi157 ceph-mon[117693]: pgmap v1854: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:53.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:52 smithi181 ceph-mon[101094]: pgmap v1854: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:42:55.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:54 smithi157 ceph-mon[117693]: pgmap v1855: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:55.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:54 smithi181 ceph-mon[101094]: pgmap v1855: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:57.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:56 smithi157 ceph-mon[117693]: pgmap v1856: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:57.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:56 smithi181 ceph-mon[101094]: pgmap v1856: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:42:59.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:58 smithi157 ceph-mon[117693]: pgmap v1857: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:42:59.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:58 smithi181 ceph-mon[101094]: pgmap v1857: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:00.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:42:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:00.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:42:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:01.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:00 smithi157 ceph-mon[117693]: pgmap v1858: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:01.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:00 smithi181 ceph-mon[101094]: pgmap v1858: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:03.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:02 smithi157 ceph-mon[117693]: pgmap v1859: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:03.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:02 smithi181 ceph-mon[101094]: pgmap v1859: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:05.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:04 smithi157 ceph-mon[117693]: pgmap v1860: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:05.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:04 smithi181 ceph-mon[101094]: pgmap v1860: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:07.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:06 smithi157 ceph-mon[117693]: pgmap v1861: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:07.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:06 smithi181 ceph-mon[101094]: pgmap v1861: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:08.310 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:07 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:43:08.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:07 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:43:09.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:08 smithi157 ceph-mon[117693]: pgmap v1862: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:09.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:43:09.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:43:09.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:43:09.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:08 smithi181 ceph-mon[101094]: pgmap v1862: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:09.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:43:09.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:43:09.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:43:11.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:10 smithi157 ceph-mon[117693]: pgmap v1863: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:11.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:10 smithi181 ceph-mon[101094]: pgmap v1863: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:13.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:12 smithi157 ceph-mon[117693]: pgmap v1864: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:13.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:12 smithi181 ceph-mon[101094]: pgmap v1864: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:15.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:14 smithi157 ceph-mon[117693]: pgmap v1865: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:15.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:15.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:14 smithi181 ceph-mon[101094]: pgmap v1865: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:15.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:17.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:16 smithi157 ceph-mon[117693]: pgmap v1866: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:17.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:16 smithi181 ceph-mon[101094]: pgmap v1866: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:19.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:18 smithi157 ceph-mon[117693]: pgmap v1867: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:19.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:18 smithi181 ceph-mon[101094]: pgmap v1867: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:21.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:20 smithi157 ceph-mon[117693]: pgmap v1868: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:21.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:20 smithi181 ceph-mon[101094]: pgmap v1868: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:23.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:22 smithi157 ceph-mon[117693]: pgmap v1869: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:23.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:22 smithi181 ceph-mon[101094]: pgmap v1869: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:25.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:24 smithi157 ceph-mon[117693]: pgmap v1870: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:25.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:24 smithi181 ceph-mon[101094]: pgmap v1870: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:27.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:26 smithi157 ceph-mon[117693]: pgmap v1871: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:27.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:26 smithi181 ceph-mon[101094]: pgmap v1871: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:29.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:28 smithi157 ceph-mon[117693]: pgmap v1872: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:29.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:28 smithi181 ceph-mon[101094]: pgmap v1872: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:30.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:30.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:31.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:30 smithi157 ceph-mon[117693]: pgmap v1873: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:31.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:30 smithi181 ceph-mon[101094]: pgmap v1873: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:33.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:32 smithi157 ceph-mon[117693]: pgmap v1874: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:33.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:32 smithi181 ceph-mon[101094]: pgmap v1874: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:35.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:34 smithi157 ceph-mon[117693]: pgmap v1875: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:35.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:34 smithi181 ceph-mon[101094]: pgmap v1875: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:37.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:36 smithi157 ceph-mon[117693]: pgmap v1876: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:37.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:36 smithi181 ceph-mon[101094]: pgmap v1876: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:39.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:38 smithi157 ceph-mon[117693]: pgmap v1877: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:39.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:38 smithi181 ceph-mon[101094]: pgmap v1877: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:41.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:40 smithi157 ceph-mon[117693]: pgmap v1878: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:41.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:40 smithi181 ceph-mon[101094]: pgmap v1878: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:42.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:41 smithi157 ceph-mon[117693]: pgmap v1879: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:42.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:41 smithi181 ceph-mon[101094]: pgmap v1879: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:44.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:44 smithi157 ceph-mon[117693]: pgmap v1880: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:44.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:44 smithi181 ceph-mon[101094]: pgmap v1880: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:45.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:45.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:43:46.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:46 smithi157 ceph-mon[117693]: pgmap v1881: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:46.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:46 smithi181 ceph-mon[101094]: pgmap v1881: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:48.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:48 smithi157 ceph-mon[117693]: pgmap v1882: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:48.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:48 smithi181 ceph-mon[101094]: pgmap v1882: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:50.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:50 smithi157 ceph-mon[117693]: pgmap v1883: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:50.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:50 smithi181 ceph-mon[101094]: pgmap v1883: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:52.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:52 smithi157 ceph-mon[117693]: pgmap v1884: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:52.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:52 smithi181 ceph-mon[101094]: pgmap v1884: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:43:54.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:54 smithi157 ceph-mon[117693]: pgmap v1885: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:54.593 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:54 smithi181 ceph-mon[101094]: pgmap v1885: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:56.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:56 smithi157 ceph-mon[117693]: pgmap v1886: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:56.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:56 smithi181 ceph-mon[101094]: pgmap v1886: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:43:58.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:43:58 smithi157 ceph-mon[117693]: pgmap v1887: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:43:58.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:43:58 smithi181 ceph-mon[101094]: pgmap v1887: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:00.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:00 smithi157 ceph-mon[117693]: pgmap v1888: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:00.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:00.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:00 smithi181 ceph-mon[101094]: pgmap v1888: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:00.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:02.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:02 smithi157 ceph-mon[117693]: pgmap v1889: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:02.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:02 smithi181 ceph-mon[101094]: pgmap v1889: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:04.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:04 smithi157 ceph-mon[117693]: pgmap v1890: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:04.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:04 smithi181 ceph-mon[101094]: pgmap v1890: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:06.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:06 smithi157 ceph-mon[117693]: pgmap v1891: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:06.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:06 smithi181 ceph-mon[101094]: pgmap v1891: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:08.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:08 smithi157 ceph-mon[117693]: pgmap v1892: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:08.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:08 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:44:08.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:08 smithi181 ceph-mon[101094]: pgmap v1892: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:08.843 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:08 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:44:10.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:44:10.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:44:10.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:44:10.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:44:10.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:09 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:44:10.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:44:10.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:44:10.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:44:10.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:44:10.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:09 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:44:11.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:10 smithi157 ceph-mon[117693]: pgmap v1893: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:11.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:10 smithi181 ceph-mon[101094]: pgmap v1893: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:13.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:12 smithi157 ceph-mon[117693]: pgmap v1894: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:13.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:12 smithi181 ceph-mon[101094]: pgmap v1894: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:15.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:14 smithi157 ceph-mon[117693]: pgmap v1895: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:15.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:15.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:14 smithi181 ceph-mon[101094]: pgmap v1895: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:15.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:17.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:16 smithi157 ceph-mon[117693]: pgmap v1896: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:17.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:16 smithi181 ceph-mon[101094]: pgmap v1896: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:19.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:18 smithi157 ceph-mon[117693]: pgmap v1897: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:19.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:18 smithi181 ceph-mon[101094]: pgmap v1897: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:21.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:20 smithi157 ceph-mon[117693]: pgmap v1898: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:21.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:20 smithi181 ceph-mon[101094]: pgmap v1898: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:23.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:22 smithi157 ceph-mon[117693]: pgmap v1899: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:23.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:22 smithi181 ceph-mon[101094]: pgmap v1899: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:25.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:24 smithi157 ceph-mon[117693]: pgmap v1900: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:25.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:24 smithi181 ceph-mon[101094]: pgmap v1900: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:27.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:26 smithi157 ceph-mon[117693]: pgmap v1901: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:27.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:26 smithi181 ceph-mon[101094]: pgmap v1901: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:29.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:28 smithi157 ceph-mon[117693]: pgmap v1902: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:29.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:28 smithi181 ceph-mon[101094]: pgmap v1902: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:30.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:30.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:31.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:30 smithi157 ceph-mon[117693]: pgmap v1903: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:31.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:30 smithi181 ceph-mon[101094]: pgmap v1903: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:33.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:32 smithi157 ceph-mon[117693]: pgmap v1904: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:33.343 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:32 smithi181 ceph-mon[101094]: pgmap v1904: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:35.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:34 smithi157 ceph-mon[117693]: pgmap v1905: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:35.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:34 smithi181 ceph-mon[101094]: pgmap v1905: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:37.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:36 smithi157 ceph-mon[117693]: pgmap v1906: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:37.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:36 smithi181 ceph-mon[101094]: pgmap v1906: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:39.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:38 smithi157 ceph-mon[117693]: pgmap v1907: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:39.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:38 smithi181 ceph-mon[101094]: pgmap v1907: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:41.311 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:40 smithi157 ceph-mon[117693]: pgmap v1908: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:41.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:40 smithi181 ceph-mon[101094]: pgmap v1908: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:43.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:42 smithi157 ceph-mon[117693]: pgmap v1909: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:43.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:42 smithi181 ceph-mon[101094]: pgmap v1909: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:44:45.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:45 smithi157 ceph-mon[117693]: pgmap v1910: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:45.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:45.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:45 smithi181 ceph-mon[101094]: pgmap v1910: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:45.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:44:46.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:46 smithi157 ceph-mon[117693]: pgmap v1911: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:46.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:46 smithi181 ceph-mon[101094]: pgmap v1911: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:48.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:48 smithi157 ceph-mon[117693]: pgmap v1912: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:48.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:48 smithi181 ceph-mon[101094]: pgmap v1912: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:50.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:50 smithi157 ceph-mon[117693]: pgmap v1913: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:50.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:50 smithi181 ceph-mon[101094]: pgmap v1913: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:52.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:52 smithi157 ceph-mon[117693]: pgmap v1914: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:52.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:52 smithi181 ceph-mon[101094]: pgmap v1914: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:54.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:54 smithi157 ceph-mon[117693]: pgmap v1915: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:44:54.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:54 smithi181 ceph-mon[101094]: pgmap v1915: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:44:56.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:56 smithi157 ceph-mon[117693]: pgmap v1916: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:56.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:56 smithi181 ceph-mon[101094]: pgmap v1916: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:44:58.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:44:58 smithi157 ceph-mon[117693]: pgmap v1917: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:44:58.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:44:58 smithi181 ceph-mon[101094]: pgmap v1917: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:00.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:00 smithi157 ceph-mon[117693]: pgmap v1918: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:00.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:00.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:00 smithi181 ceph-mon[101094]: pgmap v1918: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:00.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:02.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:02 smithi157 ceph-mon[117693]: pgmap v1919: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:02.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:02 smithi181 ceph-mon[101094]: pgmap v1919: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:04.561 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:04 smithi157 ceph-mon[117693]: pgmap v1920: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:04.594 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:04 smithi181 ceph-mon[101094]: pgmap v1920: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:06.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:06 smithi157 ceph-mon[117693]: pgmap v1921: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:06.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:06 smithi181 ceph-mon[101094]: pgmap v1921: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:08.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:08 smithi157 ceph-mon[117693]: pgmap v1922: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:08.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:08 smithi181 ceph-mon[101094]: pgmap v1922: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:10.811 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:10 smithi157 ceph-mon[117693]: pgmap v1923: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:10.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:10 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:45:10.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:10 smithi181 ceph-mon[101094]: pgmap v1923: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:10.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:10 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:45:11.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:45:11.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:45:11.812 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:45:11.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:45:11.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:45:11.844 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:45:13.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:12 smithi157 ceph-mon[117693]: pgmap v1924: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:13.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:12 smithi181 ceph-mon[101094]: pgmap v1924: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:15.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:14 smithi157 ceph-mon[117693]: pgmap v1925: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:15.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:15.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:14 smithi181 ceph-mon[101094]: pgmap v1925: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:15.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:17.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:16 smithi157 ceph-mon[117693]: pgmap v1926: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:17.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:16 smithi181 ceph-mon[101094]: pgmap v1926: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:19.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:18 smithi157 ceph-mon[117693]: pgmap v1927: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:19.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:18 smithi181 ceph-mon[101094]: pgmap v1927: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:20 smithi157 ceph-mon[117693]: pgmap v1928: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:21.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:20 smithi181 ceph-mon[101094]: pgmap v1928: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:23.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:22 smithi157 ceph-mon[117693]: pgmap v1929: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:23.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:22 smithi181 ceph-mon[101094]: pgmap v1929: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:25.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:24 smithi157 ceph-mon[117693]: pgmap v1930: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:25.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:24 smithi181 ceph-mon[101094]: pgmap v1930: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:27.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:26 smithi157 ceph-mon[117693]: pgmap v1931: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:27.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:26 smithi181 ceph-mon[101094]: pgmap v1931: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:29.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:28 smithi157 ceph-mon[117693]: pgmap v1932: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:29.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:28 smithi181 ceph-mon[101094]: pgmap v1932: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:30.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:30.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:31.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:30 smithi181 ceph-mon[101094]: pgmap v1933: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:31.315 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:30 smithi157 ceph-mon[117693]: pgmap v1933: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:33.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:32 smithi181 ceph-mon[101094]: pgmap v1934: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:33.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:32 smithi157 ceph-mon[117693]: pgmap v1934: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:35.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:34 smithi181 ceph-mon[101094]: pgmap v1935: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:35.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:34 smithi157 ceph-mon[117693]: pgmap v1935: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:37.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:36 smithi181 ceph-mon[101094]: pgmap v1936: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:37.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:36 smithi157 ceph-mon[117693]: pgmap v1936: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:39.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:38 smithi181 ceph-mon[101094]: pgmap v1937: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:39.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:38 smithi157 ceph-mon[117693]: pgmap v1937: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:41.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:40 smithi181 ceph-mon[101094]: pgmap v1938: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:41.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:40 smithi157 ceph-mon[117693]: pgmap v1938: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:43.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:42 smithi181 ceph-mon[101094]: pgmap v1939: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:43.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:42 smithi157 ceph-mon[117693]: pgmap v1939: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:45.094 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:44 smithi181 ceph-mon[101094]: pgmap v1940: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:45.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:45.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:44 smithi157 ceph-mon[117693]: pgmap v1940: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:45.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:45:47.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:46 smithi157 ceph-mon[117693]: pgmap v1941: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:47.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:46 smithi181 ceph-mon[101094]: pgmap v1941: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:49.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:48 smithi157 ceph-mon[117693]: pgmap v1942: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:49.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:48 smithi181 ceph-mon[101094]: pgmap v1942: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:51.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:50 smithi157 ceph-mon[117693]: pgmap v1943: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:51.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:50 smithi181 ceph-mon[101094]: pgmap v1943: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:53.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:52 smithi157 ceph-mon[117693]: pgmap v1944: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:53.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:52 smithi181 ceph-mon[101094]: pgmap v1944: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:45:55.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:54 smithi157 ceph-mon[117693]: pgmap v1945: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:55.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:54 smithi181 ceph-mon[101094]: pgmap v1945: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:57.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:56 smithi157 ceph-mon[117693]: pgmap v1946: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:57.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:56 smithi181 ceph-mon[101094]: pgmap v1946: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:45:59.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:58 smithi157 ceph-mon[117693]: pgmap v1947: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:45:59.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:58 smithi181 ceph-mon[101094]: pgmap v1947: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:00.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:45:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:00.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:45:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:01.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:00 smithi157 ceph-mon[117693]: pgmap v1948: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:46:01.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:00 smithi181 ceph-mon[101094]: pgmap v1948: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:46:03.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:02 smithi157 ceph-mon[117693]: pgmap v1949: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:46:03.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:02 smithi181 ceph-mon[101094]: pgmap v1949: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:46:05.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:04 smithi157 ceph-mon[117693]: pgmap v1950: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:46:05.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:04 smithi181 ceph-mon[101094]: pgmap v1950: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-03T09:46:07.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:06 smithi157 ceph-mon[117693]: pgmap v1951: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:46:07.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:06 smithi181 ceph-mon[101094]: pgmap v1951: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-03T09:46:09.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:08 smithi157 ceph-mon[117693]: pgmap v1952: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:09.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:08 smithi181 ceph-mon[101094]: pgmap v1952: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:11.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:10 smithi157 ceph-mon[117693]: pgmap v1953: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:11.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:10 smithi181 ceph-mon[101094]: pgmap v1953: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:12.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:46:12.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:46:12.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:46:12.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:11 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:46:12.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:46:12.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:46:12.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:46:12.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:11 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:46:13.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:12 smithi157 ceph-mon[117693]: pgmap v1954: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:13.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:12 smithi181 ceph-mon[101094]: pgmap v1954: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:15.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:14 smithi157 ceph-mon[117693]: pgmap v1955: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:15.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:15.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:14 smithi181 ceph-mon[101094]: pgmap v1955: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:15.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:17.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:16 smithi157 ceph-mon[117693]: pgmap v1956: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:17.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:16 smithi181 ceph-mon[101094]: pgmap v1956: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:19.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:18 smithi157 ceph-mon[117693]: pgmap v1957: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:19.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:18 smithi181 ceph-mon[101094]: pgmap v1957: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:21.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:20 smithi157 ceph-mon[117693]: pgmap v1958: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:21.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:20 smithi181 ceph-mon[101094]: pgmap v1958: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:23.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:22 smithi157 ceph-mon[117693]: pgmap v1959: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:23.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:22 smithi181 ceph-mon[101094]: pgmap v1959: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:25.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:24 smithi157 ceph-mon[117693]: pgmap v1960: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:25.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:24 smithi181 ceph-mon[101094]: pgmap v1960: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:27.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:26 smithi157 ceph-mon[117693]: pgmap v1961: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:27.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:26 smithi181 ceph-mon[101094]: pgmap v1961: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:29.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:28 smithi157 ceph-mon[117693]: pgmap v1962: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:29.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:28 smithi181 ceph-mon[101094]: pgmap v1962: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:30.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:30.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:31.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:30 smithi157 ceph-mon[117693]: pgmap v1963: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:31.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:30 smithi181 ceph-mon[101094]: pgmap v1963: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:33.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:32 smithi157 ceph-mon[117693]: pgmap v1964: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:33.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:32 smithi181 ceph-mon[101094]: pgmap v1964: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:35.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:34 smithi157 ceph-mon[117693]: pgmap v1965: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:35.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:34 smithi181 ceph-mon[101094]: pgmap v1965: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:37.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:36 smithi157 ceph-mon[117693]: pgmap v1966: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:37.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:36 smithi181 ceph-mon[101094]: pgmap v1966: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:39.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:38 smithi157 ceph-mon[117693]: pgmap v1967: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:39.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:38 smithi181 ceph-mon[101094]: pgmap v1967: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:41.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:40 smithi157 ceph-mon[117693]: pgmap v1968: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:41.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:40 smithi181 ceph-mon[101094]: pgmap v1968: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:43.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:42 smithi157 ceph-mon[117693]: pgmap v1969: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:43.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:42 smithi181 ceph-mon[101094]: pgmap v1969: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:45.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:44 smithi157 ceph-mon[117693]: pgmap v1970: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:45.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:45.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:44 smithi181 ceph-mon[101094]: pgmap v1970: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:45.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:46:47.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:46 smithi157 ceph-mon[117693]: pgmap v1971: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:47.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:46 smithi181 ceph-mon[101094]: pgmap v1971: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:49.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:48 smithi157 ceph-mon[117693]: pgmap v1972: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:49.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:48 smithi181 ceph-mon[101094]: pgmap v1972: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:51.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:50 smithi157 ceph-mon[117693]: pgmap v1973: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:51.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:50 smithi181 ceph-mon[101094]: pgmap v1973: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:53.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:52 smithi157 ceph-mon[117693]: pgmap v1974: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:53.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:52 smithi181 ceph-mon[101094]: pgmap v1974: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:46:55.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:54 smithi157 ceph-mon[117693]: pgmap v1975: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:55.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:54 smithi181 ceph-mon[101094]: pgmap v1975: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:57.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:56 smithi157 ceph-mon[117693]: pgmap v1976: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:57.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:57 smithi181 ceph-mon[101094]: pgmap v1976: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:46:59.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:46:59 smithi157 ceph-mon[117693]: pgmap v1977: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:46:59.344 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:46:59 smithi181 ceph-mon[101094]: pgmap v1977: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:00.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:00 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:00.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:00 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:01.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:01 smithi157 ceph-mon[117693]: pgmap v1978: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:01.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:01 smithi181 ceph-mon[101094]: pgmap v1978: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:03.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:03 smithi157 ceph-mon[117693]: pgmap v1979: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:03.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:03 smithi181 ceph-mon[101094]: pgmap v1979: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:05.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:05 smithi157 ceph-mon[117693]: pgmap v1980: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:05.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:05 smithi181 ceph-mon[101094]: pgmap v1980: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:07.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:07 smithi157 ceph-mon[117693]: pgmap v1981: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:07.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:07 smithi181 ceph-mon[101094]: pgmap v1981: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:09.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:09 smithi157 ceph-mon[117693]: pgmap v1982: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:09.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:09 smithi181 ceph-mon[101094]: pgmap v1982: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:11.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:11 smithi157 ceph-mon[117693]: pgmap v1983: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:11.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:11 smithi181 ceph-mon[101094]: pgmap v1983: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:12.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:12 smithi157 ceph-mon[117693]: pgmap v1984: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:12.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:12 smithi181 ceph-mon[101094]: pgmap v1984: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:13.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:47:13.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:47:13.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:47:13.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:47:13.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:47:13.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:47:13.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:47:13.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:47:14.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:14 smithi157 ceph-mon[117693]: pgmap v1985: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:14.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:14 smithi181 ceph-mon[101094]: pgmap v1985: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:15.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:15.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:16.312 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:16 smithi157 ceph-mon[117693]: pgmap v1986: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:16.345 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:16 smithi181 ceph-mon[101094]: pgmap v1986: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:18.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:18 smithi157 ceph-mon[117693]: pgmap v1987: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:18.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:18 smithi181 ceph-mon[101094]: pgmap v1987: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:20.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:20 smithi157 ceph-mon[117693]: pgmap v1988: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:20.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:20 smithi181 ceph-mon[101094]: pgmap v1988: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:22.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:22 smithi157 ceph-mon[117693]: pgmap v1989: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:22.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:22 smithi181 ceph-mon[101094]: pgmap v1989: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:24.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:24 smithi157 ceph-mon[117693]: pgmap v1990: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:24.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:24 smithi181 ceph-mon[101094]: pgmap v1990: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:26.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:26 smithi157 ceph-mon[117693]: pgmap v1991: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:26.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:26 smithi181 ceph-mon[101094]: pgmap v1991: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:28.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:28 smithi157 ceph-mon[117693]: pgmap v1992: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:28.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:28 smithi181 ceph-mon[101094]: pgmap v1992: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:30.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:30 smithi157 ceph-mon[117693]: pgmap v1993: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:30.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:30.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:30 smithi181 ceph-mon[101094]: pgmap v1993: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:30.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:32.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:32 smithi157 ceph-mon[117693]: pgmap v1994: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:32.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:32 smithi181 ceph-mon[101094]: pgmap v1994: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:34.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:34 smithi157 ceph-mon[117693]: pgmap v1995: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:34.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:34 smithi181 ceph-mon[101094]: pgmap v1995: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:36.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:36 smithi157 ceph-mon[117693]: pgmap v1996: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:36.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:36 smithi181 ceph-mon[101094]: pgmap v1996: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:38.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:38 smithi157 ceph-mon[117693]: pgmap v1997: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:38.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:38 smithi181 ceph-mon[101094]: pgmap v1997: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:40.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:40 smithi157 ceph-mon[117693]: pgmap v1998: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:40.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:40 smithi181 ceph-mon[101094]: pgmap v1998: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:42.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:42 smithi157 ceph-mon[117693]: pgmap v1999: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:42.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:42 smithi181 ceph-mon[101094]: pgmap v1999: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:44.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:44 smithi157 ceph-mon[117693]: pgmap v2000: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:44.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:44 smithi181 ceph-mon[101094]: pgmap v2000: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:45.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:45 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:45.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:45 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:46.562 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:46 smithi157 ceph-mon[117693]: pgmap v2001: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:46.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:46 smithi181 ceph-mon[101094]: pgmap v2001: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:48.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:48 smithi157 ceph-mon[117693]: pgmap v2002: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:48.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:48 smithi181 ceph-mon[101094]: pgmap v2002: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:50.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:50 smithi157 ceph-mon[117693]: pgmap v2003: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:50.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:50 smithi181 ceph-mon[101094]: pgmap v2003: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:52.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:52 smithi157 ceph-mon[117693]: pgmap v2004: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:52.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:52 smithi181 ceph-mon[101094]: pgmap v2004: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:47:54.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:54 smithi181 ceph-mon[101094]: pgmap v2005: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:54.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:54 smithi157 ceph-mon[117693]: pgmap v2005: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:56.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:56 smithi181 ceph-mon[101094]: pgmap v2006: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:56.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:56 smithi157 ceph-mon[117693]: pgmap v2006: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:47:58.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:58 smithi181 ceph-mon[101094]: pgmap v2007: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:58.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:58 smithi157 ceph-mon[117693]: pgmap v2007: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:47:59.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:47:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:47:59.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:47:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:00.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:00 smithi181 ceph-mon[101094]: pgmap v2008: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:00.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:00 smithi157 ceph-mon[117693]: pgmap v2008: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:02.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:02 smithi181 ceph-mon[101094]: pgmap v2009: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:02.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:02 smithi157 ceph-mon[117693]: pgmap v2009: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:04.595 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:04 smithi181 ceph-mon[101094]: pgmap v2010: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:04.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:04 smithi157 ceph-mon[117693]: pgmap v2010: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:06.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:06 smithi157 ceph-mon[117693]: pgmap v2011: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:06.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:06 smithi181 ceph-mon[101094]: pgmap v2011: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:08.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:08 smithi157 ceph-mon[117693]: pgmap v2012: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:08.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:08 smithi181 ceph-mon[101094]: pgmap v2012: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:10.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:10 smithi157 ceph-mon[117693]: pgmap v2013: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:10.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:10 smithi181 ceph-mon[101094]: pgmap v2013: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:12.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:12 smithi157 ceph-mon[117693]: pgmap v2014: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:12.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:12 smithi181 ceph-mon[101094]: pgmap v2014: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:13.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:13 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:48:13.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:13 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:48:14.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:14 smithi157 ceph-mon[117693]: pgmap v2015: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:14.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:48:14.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:48:14.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:48:14.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:14.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:14 smithi181 ceph-mon[101094]: pgmap v2015: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:14.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:48:14.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:48:14.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:48:14.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:16.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:16 smithi157 ceph-mon[117693]: pgmap v2016: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:16.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:16 smithi181 ceph-mon[101094]: pgmap v2016: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:18.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:18 smithi157 ceph-mon[117693]: pgmap v2017: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:18.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:18 smithi181 ceph-mon[101094]: pgmap v2017: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:20.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:20 smithi157 ceph-mon[117693]: pgmap v2018: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:20.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:20 smithi181 ceph-mon[101094]: pgmap v2018: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:22.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:22 smithi181 ceph-mon[101094]: pgmap v2019: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:23.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:22 smithi157 ceph-mon[117693]: pgmap v2019: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:24.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:24 smithi181 ceph-mon[101094]: pgmap v2020: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:25.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:24 smithi157 ceph-mon[117693]: pgmap v2020: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:26.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:26 smithi181 ceph-mon[101094]: pgmap v2021: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:27.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:26 smithi157 ceph-mon[117693]: pgmap v2021: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:28.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:28 smithi181 ceph-mon[101094]: pgmap v2022: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:29.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:28 smithi157 ceph-mon[117693]: pgmap v2022: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:29.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:30.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:30.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:30 smithi181 ceph-mon[101094]: pgmap v2023: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:31.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:30 smithi157 ceph-mon[117693]: pgmap v2023: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:32.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:32 smithi181 ceph-mon[101094]: pgmap v2024: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:33.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:32 smithi157 ceph-mon[117693]: pgmap v2024: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:34.845 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:34 smithi181 ceph-mon[101094]: pgmap v2025: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:35.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:34 smithi157 ceph-mon[117693]: pgmap v2025: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:37.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:36 smithi157 ceph-mon[117693]: pgmap v2026: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:37.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:36 smithi181 ceph-mon[101094]: pgmap v2026: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:39.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:38 smithi157 ceph-mon[117693]: pgmap v2027: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:39.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:38 smithi181 ceph-mon[101094]: pgmap v2027: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:41.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:40 smithi157 ceph-mon[117693]: pgmap v2028: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:41.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:40 smithi181 ceph-mon[101094]: pgmap v2028: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:43.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:42 smithi157 ceph-mon[117693]: pgmap v2029: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:43.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:42 smithi181 ceph-mon[101094]: pgmap v2029: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:45.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:44 smithi157 ceph-mon[117693]: pgmap v2030: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:45.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:45.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:44 smithi181 ceph-mon[101094]: pgmap v2030: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:45.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:48:47.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:46 smithi157 ceph-mon[117693]: pgmap v2031: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:47.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:46 smithi181 ceph-mon[101094]: pgmap v2031: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:49.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:48 smithi157 ceph-mon[117693]: pgmap v2032: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:49.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:48 smithi181 ceph-mon[101094]: pgmap v2032: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:51.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:50 smithi157 ceph-mon[117693]: pgmap v2033: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:51.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:50 smithi181 ceph-mon[101094]: pgmap v2033: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:53.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:52 smithi157 ceph-mon[117693]: pgmap v2034: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:53.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:52 smithi181 ceph-mon[101094]: pgmap v2034: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:48:55.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:54 smithi157 ceph-mon[117693]: pgmap v2035: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:55.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:54 smithi181 ceph-mon[101094]: pgmap v2035: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:57.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:56 smithi157 ceph-mon[117693]: pgmap v2036: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:57.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:56 smithi181 ceph-mon[101094]: pgmap v2036: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:48:59.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:58 smithi157 ceph-mon[117693]: pgmap v2037: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:48:59.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:58 smithi181 ceph-mon[101094]: pgmap v2037: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:00.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:48:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:00.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:48:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:01.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:00 smithi157 ceph-mon[117693]: pgmap v2038: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:01.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:00 smithi181 ceph-mon[101094]: pgmap v2038: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:03.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:02 smithi157 ceph-mon[117693]: pgmap v2039: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:03.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:02 smithi181 ceph-mon[101094]: pgmap v2039: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:05.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:04 smithi157 ceph-mon[117693]: pgmap v2040: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:05.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:04 smithi181 ceph-mon[101094]: pgmap v2040: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:07.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:06 smithi157 ceph-mon[117693]: pgmap v2041: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:07.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:06 smithi181 ceph-mon[101094]: pgmap v2041: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:09.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:08 smithi157 ceph-mon[117693]: pgmap v2042: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:09.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:08 smithi181 ceph-mon[101094]: pgmap v2042: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:11.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:10 smithi157 ceph-mon[117693]: pgmap v2043: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:11.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:10 smithi181 ceph-mon[101094]: pgmap v2043: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:13.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:12 smithi157 ceph-mon[117693]: pgmap v2044: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:13.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:12 smithi181 ceph-mon[101094]: pgmap v2044: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:15.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:14 smithi157 ceph-mon[117693]: pgmap v2045: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:15.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:49:15.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:15.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:14 smithi181 ceph-mon[101094]: pgmap v2045: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:15.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:49:15.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:16.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:49:16.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:49:16.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:49:16.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:49:16.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:49:16.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:49:17.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:16 smithi157 ceph-mon[117693]: pgmap v2046: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:17.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:16 smithi181 ceph-mon[101094]: pgmap v2046: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:19.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:18 smithi157 ceph-mon[117693]: pgmap v2047: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:19.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:18 smithi181 ceph-mon[101094]: pgmap v2047: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:21.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:20 smithi157 ceph-mon[117693]: pgmap v2048: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:21.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:20 smithi181 ceph-mon[101094]: pgmap v2048: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:23.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:22 smithi157 ceph-mon[117693]: pgmap v2049: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:23.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:22 smithi181 ceph-mon[101094]: pgmap v2049: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:25.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:24 smithi157 ceph-mon[117693]: pgmap v2050: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:25.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:24 smithi181 ceph-mon[101094]: pgmap v2050: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:27.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:26 smithi157 ceph-mon[117693]: pgmap v2051: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:27.098 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:26 smithi181 ceph-mon[101094]: pgmap v2051: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:29.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:28 smithi157 ceph-mon[117693]: pgmap v2052: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:29.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:28 smithi181 ceph-mon[101094]: pgmap v2052: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:30.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:30.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:31.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:30 smithi157 ceph-mon[117693]: pgmap v2053: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:31.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:30 smithi181 ceph-mon[101094]: pgmap v2053: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:33.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:32 smithi157 ceph-mon[117693]: pgmap v2054: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:33.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:32 smithi181 ceph-mon[101094]: pgmap v2054: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:35.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:34 smithi157 ceph-mon[117693]: pgmap v2055: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:35.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:34 smithi181 ceph-mon[101094]: pgmap v2055: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:37.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:36 smithi157 ceph-mon[117693]: pgmap v2056: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:37.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:36 smithi181 ceph-mon[101094]: pgmap v2056: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:39.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:38 smithi157 ceph-mon[117693]: pgmap v2057: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:39.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:38 smithi181 ceph-mon[101094]: pgmap v2057: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:41.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:40 smithi157 ceph-mon[117693]: pgmap v2058: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:41.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:40 smithi181 ceph-mon[101094]: pgmap v2058: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:43.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:42 smithi157 ceph-mon[117693]: pgmap v2059: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:43.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:42 smithi181 ceph-mon[101094]: pgmap v2059: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:45.065 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:44 smithi157 ceph-mon[117693]: pgmap v2060: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:45.066 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:45.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:44 smithi181 ceph-mon[101094]: pgmap v2060: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:45.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:49:47.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:46 smithi157 ceph-mon[117693]: pgmap v2061: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:47.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:46 smithi181 ceph-mon[101094]: pgmap v2061: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:49.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:48 smithi157 ceph-mon[117693]: pgmap v2062: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:49.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:48 smithi181 ceph-mon[101094]: pgmap v2062: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:51.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:50 smithi157 ceph-mon[117693]: pgmap v2063: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:51.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:50 smithi181 ceph-mon[101094]: pgmap v2063: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:53.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:52 smithi157 ceph-mon[117693]: pgmap v2064: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:53.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:52 smithi181 ceph-mon[101094]: pgmap v2064: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:49:55.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:54 smithi157 ceph-mon[117693]: pgmap v2065: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:55.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:54 smithi181 ceph-mon[101094]: pgmap v2065: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:57.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:56 smithi157 ceph-mon[117693]: pgmap v2066: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:57.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:56 smithi181 ceph-mon[101094]: pgmap v2066: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:49:59.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:58 smithi157 ceph-mon[117693]: pgmap v2067: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:49:59.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:58 smithi181 ceph-mon[101094]: pgmap v2067: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:00.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:49:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:00.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:49:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:01.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:00 smithi157 ceph-mon[117693]: pgmap v2068: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:01.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:00 smithi157 ceph-mon[117693]: overall HEALTH_OK 2024-04-03T09:50:01.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:00 smithi181 ceph-mon[101094]: pgmap v2068: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:01.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:00 smithi181 ceph-mon[101094]: overall HEALTH_OK 2024-04-03T09:50:03.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:02 smithi157 ceph-mon[117693]: pgmap v2069: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:03.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:02 smithi181 ceph-mon[101094]: pgmap v2069: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:05.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:04 smithi157 ceph-mon[117693]: pgmap v2070: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:05.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:04 smithi181 ceph-mon[101094]: pgmap v2070: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:07.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:06 smithi157 ceph-mon[117693]: pgmap v2071: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:07.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:06 smithi181 ceph-mon[101094]: pgmap v2071: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:09.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:08 smithi157 ceph-mon[117693]: pgmap v2072: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:09.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:08 smithi181 ceph-mon[101094]: pgmap v2072: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:11.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:10 smithi157 ceph-mon[117693]: pgmap v2073: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:11.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:10 smithi181 ceph-mon[101094]: pgmap v2073: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:13.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:12 smithi157 ceph-mon[117693]: pgmap v2074: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:13.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:12 smithi181 ceph-mon[101094]: pgmap v2074: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:15.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:14 smithi157 ceph-mon[117693]: pgmap v2075: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:15.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:15.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:14 smithi181 ceph-mon[101094]: pgmap v2075: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:15.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:16.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:15 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:50:16.095 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:15 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:50:17.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:16 smithi157 ceph-mon[117693]: pgmap v2076: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:17.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:17.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:16 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:17.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:16 smithi181 ceph-mon[101094]: pgmap v2076: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:17.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:17.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:16 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:18.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:18 smithi181 ceph-mon[101094]: pgmap v2077: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:19.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:18 smithi157 ceph-mon[117693]: pgmap v2077: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:21.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:20 smithi181 ceph-mon[101094]: pgmap v2078: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:21.313 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:20 smithi157 ceph-mon[117693]: pgmap v2078: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:22.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:50:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:50:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:22.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:22 smithi157 ceph-mon[117693]: pgmap v2079: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:22.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:22.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:22.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:50:22.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:50:22.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:50:22.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:22 smithi181 ceph-mon[101094]: pgmap v2079: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:24.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:24 smithi157 ceph-mon[117693]: pgmap v2080: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:24.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:24 smithi181 ceph-mon[101094]: pgmap v2080: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:26.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:26 smithi157 ceph-mon[117693]: pgmap v2081: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:26.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:26 smithi181 ceph-mon[101094]: pgmap v2081: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:28.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:28 smithi157 ceph-mon[117693]: pgmap v2082: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:28.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:28 smithi181 ceph-mon[101094]: pgmap v2082: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:30.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:30 smithi157 ceph-mon[117693]: pgmap v2083: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:30.564 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:30 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:30.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:30 smithi181 ceph-mon[101094]: pgmap v2083: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:30.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:30 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:32.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:32 smithi181 ceph-mon[101094]: pgmap v2084: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:32.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:32 smithi157 ceph-mon[117693]: pgmap v2084: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:34.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:34 smithi181 ceph-mon[101094]: pgmap v2085: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:34.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:34 smithi157 ceph-mon[117693]: pgmap v2085: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:36.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:36 smithi181 ceph-mon[101094]: pgmap v2086: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:36.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:36 smithi157 ceph-mon[117693]: pgmap v2086: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:38.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:38 smithi181 ceph-mon[101094]: pgmap v2087: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:38.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:38 smithi157 ceph-mon[117693]: pgmap v2087: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:40.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:40 smithi181 ceph-mon[101094]: pgmap v2088: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:40.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:40 smithi157 ceph-mon[117693]: pgmap v2088: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:42.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:42 smithi181 ceph-mon[101094]: pgmap v2089: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:42.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:42 smithi157 ceph-mon[117693]: pgmap v2089: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:44.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:44 smithi181 ceph-mon[101094]: pgmap v2090: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:44.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:44.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:44 smithi157 ceph-mon[117693]: pgmap v2090: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:44.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:46.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:46 smithi181 ceph-mon[101094]: pgmap v2091: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:46.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:46 smithi157 ceph-mon[117693]: pgmap v2091: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:48.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:48 smithi157 ceph-mon[117693]: pgmap v2092: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:48.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:48 smithi181 ceph-mon[101094]: pgmap v2092: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:50.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:50 smithi157 ceph-mon[117693]: pgmap v2093: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:50.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:50 smithi181 ceph-mon[101094]: pgmap v2093: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:52.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:52 smithi157 ceph-mon[117693]: pgmap v2094: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:52.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:52 smithi181 ceph-mon[101094]: pgmap v2094: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:50:54.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:54 smithi157 ceph-mon[117693]: pgmap v2095: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:54.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:54 smithi181 ceph-mon[101094]: pgmap v2095: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:56.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:56 smithi157 ceph-mon[117693]: pgmap v2096: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:56.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:56 smithi181 ceph-mon[101094]: pgmap v2096: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:50:58.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:58 smithi157 ceph-mon[117693]: pgmap v2097: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:58.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:58 smithi181 ceph-mon[101094]: pgmap v2097: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:50:59.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:50:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:50:59.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:50:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:00.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:00 smithi157 ceph-mon[117693]: pgmap v2098: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:00.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:00 smithi181 ceph-mon[101094]: pgmap v2098: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:02.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:02 smithi157 ceph-mon[117693]: pgmap v2099: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:02.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:02 smithi181 ceph-mon[101094]: pgmap v2099: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:04.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:04 smithi157 ceph-mon[117693]: pgmap v2100: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:04 smithi181 ceph-mon[101094]: pgmap v2100: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:06.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:06 smithi157 ceph-mon[117693]: pgmap v2101: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:06.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:06 smithi181 ceph-mon[101094]: pgmap v2101: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:08.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:08 smithi157 ceph-mon[117693]: pgmap v2102: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:08.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:08 smithi181 ceph-mon[101094]: pgmap v2102: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:10.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:10 smithi157 ceph-mon[117693]: pgmap v2103: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:10.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:10 smithi181 ceph-mon[101094]: pgmap v2103: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:12.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:12 smithi157 ceph-mon[117693]: pgmap v2104: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:12.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:12 smithi181 ceph-mon[101094]: pgmap v2104: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:14.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:14 smithi157 ceph-mon[117693]: pgmap v2105: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:14.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:14 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:14.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:14 smithi181 ceph-mon[101094]: pgmap v2105: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:14.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:14 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:16.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:16 smithi157 ceph-mon[117693]: pgmap v2106: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:16.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:16 smithi181 ceph-mon[101094]: pgmap v2106: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:18.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:18 smithi157 ceph-mon[117693]: pgmap v2107: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:18.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:18 smithi181 ceph-mon[101094]: pgmap v2107: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:20.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:20 smithi157 ceph-mon[117693]: pgmap v2108: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:20.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:20 smithi181 ceph-mon[101094]: pgmap v2108: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:22 smithi157 ceph-mon[117693]: pgmap v2109: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:22.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:22 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:51:22.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:22 smithi181 ceph-mon[101094]: pgmap v2109: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:22.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:22 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-03T09:51:24.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:24 smithi157 ceph-mon[117693]: pgmap v2110: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:24.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:51:24.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:24 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:51:24.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:24 smithi181 ceph-mon[101094]: pgmap v2110: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:24.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:51:24.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:24 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:51:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:51:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:51:25.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:25 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:51:25.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-03T09:51:25.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-03T09:51:25.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:25 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' 2024-04-03T09:51:26.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:26 smithi157 ceph-mon[117693]: pgmap v2111: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:26.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:26 smithi181 ceph-mon[101094]: pgmap v2111: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:28.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:28 smithi157 ceph-mon[117693]: pgmap v2112: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:28.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:28 smithi181 ceph-mon[101094]: pgmap v2112: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:29.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:29 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:29.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:29 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:30.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:30 smithi157 ceph-mon[117693]: pgmap v2113: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:30.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:30 smithi181 ceph-mon[101094]: pgmap v2113: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:32.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:32 smithi157 ceph-mon[117693]: pgmap v2114: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:32.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:32 smithi181 ceph-mon[101094]: pgmap v2114: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:34.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:34 smithi157 ceph-mon[117693]: pgmap v2115: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:34.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:34 smithi181 ceph-mon[101094]: pgmap v2115: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:36.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:36 smithi157 ceph-mon[117693]: pgmap v2116: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:36.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:36 smithi181 ceph-mon[101094]: pgmap v2116: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:38.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:38 smithi157 ceph-mon[117693]: pgmap v2117: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:38.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:38 smithi181 ceph-mon[101094]: pgmap v2117: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:40.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:40 smithi157 ceph-mon[117693]: pgmap v2118: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:40.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:40 smithi181 ceph-mon[101094]: pgmap v2118: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:42.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:42 smithi157 ceph-mon[117693]: pgmap v2119: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:42.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:42 smithi181 ceph-mon[101094]: pgmap v2119: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:44.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:44 smithi157 ceph-mon[117693]: pgmap v2120: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:44.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:44 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:44.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:44 smithi181 ceph-mon[101094]: pgmap v2120: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:44.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:44 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:46.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:46 smithi157 ceph-mon[117693]: pgmap v2121: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:46.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:46 smithi181 ceph-mon[101094]: pgmap v2121: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:48.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:48 smithi157 ceph-mon[117693]: pgmap v2122: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:48.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:48 smithi181 ceph-mon[101094]: pgmap v2122: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:50.813 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:50 smithi157 ceph-mon[117693]: pgmap v2123: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:50.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:50 smithi181 ceph-mon[101094]: pgmap v2123: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:52.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:52 smithi157 ceph-mon[117693]: pgmap v2124: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:52.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:52 smithi181 ceph-mon[101094]: pgmap v2124: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:51:54.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:54 smithi157 ceph-mon[117693]: pgmap v2125: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:54.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:54 smithi181 ceph-mon[101094]: pgmap v2125: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:56.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:56 smithi157 ceph-mon[117693]: pgmap v2126: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:56.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:56 smithi181 ceph-mon[101094]: pgmap v2126: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:51:58.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:58 smithi157 ceph-mon[117693]: pgmap v2127: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:58.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:58 smithi181 ceph-mon[101094]: pgmap v2127: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:51:59.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:51:59 smithi157 ceph-mon[117693]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:51:59.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:51:59 smithi181 ceph-mon[101094]: from='mgr.34104 172.21.15.157:0/680350362' entity='mgr.smithi157.qfvynr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-03T09:52:00.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:00 smithi157 ceph-mon[117693]: pgmap v2128: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:52:00.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:00 smithi181 ceph-mon[101094]: pgmap v2128: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:52:02.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:02 smithi157 ceph-mon[117693]: pgmap v2129: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:52:02.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:02 smithi181 ceph-mon[101094]: pgmap v2129: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:52:04.814 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:04 smithi157 ceph-mon[117693]: pgmap v2130: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:52:04.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:04 smithi181 ceph-mon[101094]: pgmap v2130: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:52:06.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:06 smithi181 ceph-mon[101094]: pgmap v2131: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:52:07.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:06 smithi157 ceph-mon[117693]: pgmap v2131: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:52:08.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:08 smithi181 ceph-mon[101094]: pgmap v2132: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:52:09.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:08 smithi157 ceph-mon[117693]: pgmap v2132: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-03T09:52:10.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:10 smithi181 ceph-mon[101094]: pgmap v2133: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:52:11.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:10 smithi157 ceph-mon[117693]: pgmap v2133: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-03T09:52:12.846 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:12 smithi181 ceph-mon[101094]: pgmap v2134: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:52:12.981 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-03T09:52:12.993 INFO:tasks.cephadm:Teardown begin 2024-04-03T09:52:12.994 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-03T09:52:13.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:12 smithi157 ceph-mon[117693]: pgmap v2134: 65 pgs: 65 active+clean; 203 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-03T09:52:13.073 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-03T09:52:13.152 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-03T09:52:13.152 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-03T09:52:13.200 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-03T09:52:13.247 INFO:tasks.cephadm:Stopping all daemons... 2024-04-03T09:52:13.248 INFO:tasks.cephadm.mon.smithi157:Stopping mon.smithi157... 2024-04-03T09:52:13.248 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157 2024-04-03T09:52:13.665 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:13 smithi157 systemd[1]: Stopping Ceph mon.smithi157 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:14.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:13 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[117670]: 2024-04-03T09:52:13.664+0000 7f7330400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi157 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:14.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:13 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157[117670]: 2024-04-03T09:52:13.664+0000 7f7330400700 -1 mon.smithi157@0(leader) e3 *** Got Signal Terminated *** 2024-04-03T09:52:14.563 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Apr 03 09:52:14 smithi157 bash[203421]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi157 2024-04-03T09:52:14.713 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi157.service' 2024-04-03T09:52:14.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:14.830 INFO:tasks.cephadm.mon.smithi157:Stopped mon.smithi157 2024-04-03T09:52:14.830 INFO:tasks.cephadm.mon.smithi181:Stopping mon.smithi181... 2024-04-03T09:52:14.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi181 2024-04-03T09:52:15.262 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:14 smithi181 systemd[1]: Stopping Ceph mon.smithi181 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:15.596 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:15 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi181[101071]: 2024-04-03T09:52:15.260+0000 7ff3adc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi181 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:15.597 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:15 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi181[101071]: 2024-04-03T09:52:15.260+0000 7ff3adc00700 -1 mon.smithi181@1(peon) e3 *** Got Signal Terminated *** 2024-04-03T09:52:16.096 INFO:journalctl@ceph.mon.smithi181.smithi181.stdout:Apr 03 09:52:15 smithi181 bash[165642]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-mon-smithi181 2024-04-03T09:52:16.399 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@mon.smithi181.service' 2024-04-03T09:52:16.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:16.516 INFO:tasks.cephadm.mon.smithi181:Stopped mon.smithi181 2024-04-03T09:52:16.516 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-03T09:52:16.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.0 2024-04-03T09:52:16.936 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 09:52:16 smithi157 systemd[1]: Stopping Ceph osd.0 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:17.314 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 09:52:16 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[128083]: 2024-04-03T09:52:16.935+0000 7f770d000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:17.314 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 09:52:16 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[128083]: 2024-04-03T09:52:16.935+0000 7f770d000700 -1 osd.0 98 *** Got signal Terminated *** 2024-04-03T09:52:17.314 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 09:52:16 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0[128083]: 2024-04-03T09:52:16.935+0000 7f770d000700 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T09:52:23.064 INFO:journalctl@ceph.osd.0.smithi157.stdout:Apr 03 09:52:22 smithi157 bash[203677]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-0 2024-04-03T09:52:25.297 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.0.service' 2024-04-03T09:52:25.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:25.385 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-03T09:52:25.386 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-03T09:52:25.386 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.1 2024-04-03T09:52:25.564 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 09:52:25 smithi157 systemd[1]: Stopping Ceph osd.1 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:26.064 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 09:52:25 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[134859]: 2024-04-03T09:52:25.763+0000 7f7949000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:26.064 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 09:52:25 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[134859]: 2024-04-03T09:52:25.763+0000 7f7949000700 -1 osd.1 98 *** Got signal Terminated *** 2024-04-03T09:52:26.064 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 09:52:25 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1[134859]: 2024-04-03T09:52:25.763+0000 7f7949000700 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T09:52:31.814 INFO:journalctl@ceph.osd.1.smithi157.stdout:Apr 03 09:52:31 smithi157 bash[203949]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-1 2024-04-03T09:52:33.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.1.service' 2024-04-03T09:52:33.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:33.857 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-03T09:52:33.857 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-03T09:52:33.858 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.2 2024-04-03T09:52:34.064 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 09:52:33 smithi157 systemd[1]: Stopping Ceph osd.2 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:34.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 09:52:34 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[142193]: 2024-04-03T09:52:34.258+0000 7f9922a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:34.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 09:52:34 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[142193]: 2024-04-03T09:52:34.258+0000 7f9922a00700 -1 osd.2 98 *** Got signal Terminated *** 2024-04-03T09:52:34.564 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 09:52:34 smithi157 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2[142193]: 2024-04-03T09:52:34.258+0000 7f9922a00700 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T09:52:40.314 INFO:journalctl@ceph.osd.2.smithi157.stdout:Apr 03 09:52:40 smithi157 bash[204216]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-2 2024-04-03T09:52:42.014 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.2.service' 2024-04-03T09:52:42.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:42.102 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-03T09:52:42.102 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-03T09:52:42.102 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.3 2024-04-03T09:52:42.537 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:42 smithi181 systemd[1]: Stopping Ceph osd.3 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:42.846 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:42 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:42.535+0000 7f84d9c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:42.846 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:42 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:42.535+0000 7f84d9c00700 -1 osd.3 98 *** Got signal Terminated *** 2024-04-03T09:52:42.847 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:42 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:42.535+0000 7f84d9c00700 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T09:52:43.391 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:43 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:43.109+0000 7f84d0e00700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:20.034000+0000 front 2024-04-03T09:52:20.033890+0000 (oldest deadline 2024-04-03T09:52:42.933732+0000) 2024-04-03T09:52:43.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:43 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:43.389+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:44.346 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:44 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:44.095+0000 7f84d0e00700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:20.034000+0000 front 2024-04-03T09:52:20.033890+0000 (oldest deadline 2024-04-03T09:52:42.933732+0000) 2024-04-03T09:52:44.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:44 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:44.412+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:45.346 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:45 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:45.069+0000 7f84d0e00700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:20.034000+0000 front 2024-04-03T09:52:20.033890+0000 (oldest deadline 2024-04-03T09:52:42.933732+0000) 2024-04-03T09:52:45.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:44 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:44.911+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:45.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:45 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:45.432+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:46.346 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:46 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:46.084+0000 7f84d0e00700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:20.034000+0000 front 2024-04-03T09:52:20.033890+0000 (oldest deadline 2024-04-03T09:52:42.933732+0000) 2024-04-03T09:52:46.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:45 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:45.880+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:46.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:46 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:46.424+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:47.346 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:47 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3[113642]: 2024-04-03T09:52:47.098+0000 7f84d0e00700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:20.034000+0000 front 2024-04-03T09:52:20.033890+0000 (oldest deadline 2024-04-03T09:52:42.933732+0000) 2024-04-03T09:52:47.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:46 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:46.910+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:47.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:47 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:47.449+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:48.164 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:47 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:47.873+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:48.497 INFO:journalctl@ceph.osd.3.smithi181.stdout:Apr 03 09:52:48 smithi181 bash[165798]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-3 2024-04-03T09:52:48.842 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:48 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:48.495+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:49.096 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:48 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:48.841+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:49.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:49 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:49.518+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:50.346 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:49 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:49.870+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:50.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.3.service' 2024-04-03T09:52:50.463 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:50.464 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-03T09:52:50.464 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-03T09:52:50.464 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.4 2024-04-03T09:52:50.847 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:50 smithi181 systemd[1]: Stopping Ceph osd.4 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:50.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:50 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:50.520+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:51.346 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:50 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:50.846+0000 7f673f600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:51.346 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:50 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:50.846+0000 7f673f600700 -1 osd.4 98 *** Got signal Terminated *** 2024-04-03T09:52:51.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:50 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:50.846+0000 7f673f600700 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T09:52:51.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:50 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:50.853+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:51.825 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:51 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:51.500+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:52.096 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:51 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:51.825+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:52.096 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:51 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:51.825+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.194654+0000 front 2024-04-03T09:52:29.194731+0000 (oldest deadline 2024-04-03T09:52:51.494444+0000) 2024-04-03T09:52:52.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:52 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:52.474+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:53.346 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:52 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:52.848+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:53.346 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:52 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:52.848+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.194654+0000 front 2024-04-03T09:52:29.194731+0000 (oldest deadline 2024-04-03T09:52:51.494444+0000) 2024-04-03T09:52:53.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:53 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:53.511+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:54.346 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:53 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:53.857+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:54.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:53 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:53.857+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.194654+0000 front 2024-04-03T09:52:29.194731+0000 (oldest deadline 2024-04-03T09:52:51.494444+0000) 2024-04-03T09:52:54.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:54 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:54.517+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:55.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:54 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:54.855+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:19.293064+0000 front 2024-04-03T09:52:19.293004+0000 (oldest deadline 2024-04-03T09:52:43.992954+0000) 2024-04-03T09:52:55.347 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:54 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4[119683]: 2024-04-03T09:52:54.855+0000 7f673b800700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.194654+0000 front 2024-04-03T09:52:29.194731+0000 (oldest deadline 2024-04-03T09:52:51.494444+0000) 2024-04-03T09:52:55.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:55 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:55.476+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:55.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:55 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:55.476+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:52:56.832 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:56 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:56.469+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:56.833 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:56 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:56.469+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:52:57.096 INFO:journalctl@ceph.osd.4.smithi181.stdout:Apr 03 09:52:56 smithi181 bash[166061]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-4 2024-04-03T09:52:57.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:57 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:57.456+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:57.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:57 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:57.456+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:52:58.581 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:58 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:58.479+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:58.581 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:58 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:58.479+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:52:58.969 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.4.service' 2024-04-03T09:52:59.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:52:59.057 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-03T09:52:59.057 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-03T09:52:59.057 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.5 2024-04-03T09:52:59.346 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:59 smithi181 systemd[1]: Stopping Ceph osd.5 for af80a140-f193-11ee-b648-cb9ed24678a4... 2024-04-03T09:52:59.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:59 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:59.457+0000 7fb7ba800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-03T09:52:59.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:59 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:59.457+0000 7fb7ba800700 -1 osd.5 98 *** Got signal Terminated *** 2024-04-03T09:52:59.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:59 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:59.457+0000 7fb7ba800700 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-03T09:52:59.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:59 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:59.465+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:52:59.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:52:59 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:52:59.465+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:53:00.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:00 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:00.454+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:53:00.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:00 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:00.454+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:53:00.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:00 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:00.454+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6822 osd.2 since back 2024-04-03T09:52:34.578105+0000 front 2024-04-03T09:52:34.578080+0000 (oldest deadline 2024-04-03T09:52:59.877833+0000) 2024-04-03T09:53:01.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:01 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:01.409+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:53:01.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:01 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:01.409+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:53:01.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:01 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:01.409+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6822 osd.2 since back 2024-04-03T09:52:34.578105+0000 front 2024-04-03T09:52:34.578080+0000 (oldest deadline 2024-04-03T09:52:59.877833+0000) 2024-04-03T09:53:02.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:02 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:02.368+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:53:02.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:02 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:02.368+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:53:02.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:02 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:02.368+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6822 osd.2 since back 2024-04-03T09:52:34.578105+0000 front 2024-04-03T09:52:34.578080+0000 (oldest deadline 2024-04-03T09:52:59.877833+0000) 2024-04-03T09:53:03.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:03 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:03.369+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:53:03.846 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:03 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:03.369+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:53:03.847 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:03 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:03.369+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6822 osd.2 since back 2024-04-03T09:52:34.578105+0000 front 2024-04-03T09:52:34.578080+0000 (oldest deadline 2024-04-03T09:52:59.877833+0000) 2024-04-03T09:53:04.596 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:04 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:04.326+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6806 osd.0 since back 2024-04-03T09:52:18.676549+0000 front 2024-04-03T09:52:18.676769+0000 (oldest deadline 2024-04-03T09:52:43.376534+0000) 2024-04-03T09:53:04.597 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:04 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:04.326+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6814 osd.1 since back 2024-04-03T09:52:29.277572+0000 front 2024-04-03T09:52:29.277558+0000 (oldest deadline 2024-04-03T09:52:54.577350+0000) 2024-04-03T09:53:04.597 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:04 smithi181 ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5[126289]: 2024-04-03T09:53:04.326+0000 7fb7b6a00700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.157:6822 osd.2 since back 2024-04-03T09:52:34.578105+0000 front 2024-04-03T09:52:34.578080+0000 (oldest deadline 2024-04-03T09:52:59.877833+0000) 2024-04-03T09:53:05.597 INFO:journalctl@ceph.osd.5.smithi181.stdout:Apr 03 09:53:05 smithi181 bash[166323]: ceph-af80a140-f193-11ee-b648-cb9ed24678a4-osd-5 2024-04-03T09:53:07.405 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af80a140-f193-11ee-b648-cb9ed24678a4@osd.5.service' 2024-04-03T09:53:07.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-03T09:53:07.492 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-03T09:53:07.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af80a140-f193-11ee-b648-cb9ed24678a4 --force --keep-logs 2024-04-03T09:53:31.785 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af80a140-f193-11ee-b648-cb9ed24678a4 --force --keep-logs 2024-04-03T09:53:48.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-03T09:53:48.963 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-03T09:53:49.033 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-03T09:53:49.035 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/crash to /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/remote/smithi157/crash 2024-04-03T09:53:49.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/crash -- . 2024-04-03T09:53:49.103 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-03T09:53:49.104 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2024-04-03T09:53:49.107 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/crash to /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/remote/smithi181/crash 2024-04-03T09:53:49.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/crash -- . 2024-04-03T09:53:49.172 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-03T09:53:49.172 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-04-03T09:53:49.174 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-03T09:53:49.174 DEBUG:teuthology.orchestra.run.smithi157:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-04-03T09:53:49.260 INFO:tasks.cephadm:Compressing logs... 2024-04-03T09:53:49.260 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-03T09:53:49.264 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-03T09:53:49.325 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-03T09:53:49.326 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi157.sodwui.log 2024-04-03T09:53:49.326 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-volume.log 2024-04-03T09:53:49.327 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi157.sodwui.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.2.log 2024-04-03T09:53:49.328 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mgr.smithi157.qfvynr.log 2024-04-03T09:53:49.329 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-volume.log 2024-04-03T09:53:49.329 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-04-03T09:53:49.330 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.audit.log 2024-04-03T09:53:49.330 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.audit.log 2024-04-03T09:53:49.331 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mgr.smithi157.qfvynr.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.cephadm.log 2024-04-03T09:53:49.331 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.cephadm.log 2024-04-03T09:53:49.332 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mon.smithi157.log 2024-04-03T09:53:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.3.log 2024-04-03T09:53:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log 2024-04-03T09:53:49.334 INFO:teuthology.orchestra.run.smithi181.stderr: 85.2% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-03T09:53:49.334 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.cephadm.log: 85.2% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-03T09:53:49.335 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi181.ecaerp.log 2024-04-03T09:53:49.335 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mon.smithi157.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.0.log 2024-04-03T09:53:49.335 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.4.log 2024-04-03T09:53:49.336 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi181.ecaerp.log: 91.9% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.audit.log.gz 2024-04-03T09:53:49.337 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi181.wksnwz.log 2024-04-03T09:53:49.337 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log 2024-04-03T09:53:49.338 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.0.log: 91.7% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.audit.log.gz 2024-04-03T09:53:49.339 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.5.log 2024-04-03T09:53:49.340 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi157.zlscrk.log 2024-04-03T09:53:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi181.wksnwz.log: /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mgr.smithi181.mfhidq.log 2024-04-03T09:53:49.343 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi157.zlscrk.log: gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.1.log 2024-04-03T09:53:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mon.smithi181.log 2024-04-03T09:53:49.344 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log.gz 2024-04-03T09:53:49.347 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.1.log: 90.8% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph.log.gz 2024-04-03T09:53:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mgr.smithi181.mfhidq.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-03T09:53:49.349 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-03T09:53:49.351 INFO:teuthology.orchestra.run.smithi157.stderr: 91.2% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-volume.log.gz 2024-04-03T09:53:49.352 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mon.smithi181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-03T09:53:49.354 INFO:teuthology.orchestra.run.smithi181.stderr: 91.2% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-volume.log.gz 2024-04-03T09:53:49.355 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-03T09:53:49.357 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.1.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-03T09:53:49.369 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.0.log: 90.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-03T09:53:49.426 INFO:teuthology.orchestra.run.smithi181.stderr: 90.2% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mgr.smithi181.mfhidq.log.gz 2024-04-03T09:53:50.133 INFO:teuthology.orchestra.run.smithi157.stderr: 89.7% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mgr.smithi157.qfvynr.log.gz 2024-04-03T09:53:50.564 INFO:teuthology.orchestra.run.smithi181.stderr: 92.7% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mon.smithi181.log.gz 2024-04-03T09:53:52.491 INFO:teuthology.orchestra.run.smithi157.stderr: 89.9% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mon.smithi157.log.gz 2024-04-03T09:53:55.247 INFO:teuthology.orchestra.run.smithi181.stderr: 94.7% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi181.ecaerp.log.gz 2024-04-03T09:53:57.331 INFO:teuthology.orchestra.run.smithi181.stderr: 93.3% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.4.log.gz 2024-04-03T09:53:57.603 INFO:teuthology.orchestra.run.smithi157.stderr: 93.2% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.2.log.gz 2024-04-03T09:53:58.012 INFO:teuthology.orchestra.run.smithi181.stderr: 93.4% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.5.log.gz 2024-04-03T09:53:58.274 INFO:teuthology.orchestra.run.smithi157.stderr: 93.0% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.1.log.gz 2024-04-03T09:53:58.790 INFO:teuthology.orchestra.run.smithi157.stderr: 94.7% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi157.sodwui.log.gz 2024-04-03T09:53:58.915 INFO:teuthology.orchestra.run.smithi157.stderr: 93.1% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.0.log.gz 2024-04-03T09:53:59.242 INFO:teuthology.orchestra.run.smithi181.stderr: 93.4% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-osd.3.log.gz 2024-04-03T09:53:59.574 INFO:teuthology.orchestra.run.smithi181.stderr: 94.8% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi181.wksnwz.log.gz 2024-04-03T09:54:05.592 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-03T09:54:05.593 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-03T09:54:05.597 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-04-03T09:54:05.597 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m16.290s 2024-04-03T09:54:05.597 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m56.162s 2024-04-03T09:54:05.597 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m3.979s 2024-04-03T09:54:05.656 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/ceph-client.0.log: file size changed while zipping 2024-04-03T09:54:05.656 INFO:teuthology.orchestra.run.smithi157.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-03T09:55:24.261 INFO:teuthology.orchestra.run.smithi157.stderr: 92.9% -- replaced with /var/log/ceph/af80a140-f193-11ee-b648-cb9ed24678a4/ceph-mds.cephfs.smithi157.zlscrk.log.gz 2024-04-03T09:55:24.264 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-04-03T09:55:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:real 1m34.961s 2024-04-03T09:55:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:user 2m20.990s 2024-04-03T09:55:24.264 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m10.251s 2024-04-03T09:55:24.264 INFO:tasks.cephadm:Archiving logs... 2024-04-03T09:55:24.265 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/remote/smithi157/log 2024-04-03T09:55:24.266 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-03T09:55:45.620 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/remote/smithi181/log 2024-04-03T09:55:45.621 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-03T09:55:52.876 INFO:tasks.cephadm:Removing cluster... 2024-04-03T09:55:52.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af80a140-f193-11ee-b648-cb9ed24678a4 --force 2024-04-03T09:55:54.004 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af80a140-f193-11ee-b648-cb9ed24678a4 --force 2024-04-03T09:55:54.845 INFO:tasks.cephadm:Removing cephadm ... 2024-04-03T09:55:54.846 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-03T09:55:54.897 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-03T09:55:54.942 INFO:tasks.cephadm:Teardown complete 2024-04-03T09:55:54.942 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-03T09:55:54.955 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-03T09:55:54.955 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-03T09:55:54.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-03T09:55:55.094 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-03T09:55:55.106 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-03T09:55:55.106 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T09:55:55.110 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T09:55:55.149 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2024-04-03T09:55:55.153 INFO:teuthology.orchestra.run.smithi181.stderr:bash: ntpq: command not found 2024-04-03T09:55:55.158 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-03T09:55:55.158 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-04-03T09:55:55.158 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 80 -1512us[-1512us] +/- 80ms 2024-04-03T09:55:55.158 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 8 377 212 -2284us[-2295us] +/- 57ms 2024-04-03T09:55:55.158 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +5111us[+5111us] +/- 66ms 2024-04-03T09:55:55.158 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T09:55:55.161 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-03T09:55:55.161 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-04-03T09:55:55.161 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 -1598us[-1571us] +/- 80ms 2024-04-03T09:55:55.161 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 8 377 18 -2321us[-2294us] +/- 60ms 2024-04-03T09:55:55.161 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +5052us[+5052us] +/- 66ms 2024-04-03T09:55:55.161 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-03T09:55:55.163 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-03T09:55:55.174 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-03T09:55:55.175 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-03T09:55:55.202 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-03T09:55:55.343 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-03T09:55:55.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-03T09:55:55.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T09:55:55.550 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-03T09:55:55.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T09:55:55.622 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-03T09:55:55.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-03T09:55:55.683 INFO:teuthology.task.internal:Duration was 6147.049608 seconds 2024-04-03T09:55:55.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-03T09:55:55.722 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-03T09:55:55.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-03T09:55:55.727 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-03T09:55:55.836 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-03T09:55:55.986 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-03T09:55:56.128 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-03T09:55:56.129 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-04-03T09:55:56.129 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-03T09:55:56.187 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-04-03T09:55:56.188 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-03T09:55:56.249 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-03T09:55:56.249 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-03T09:55:56.255 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-03T09:55:56.363 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-03T09:55:56.363 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-03T09:55:56.369 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-03T09:55:56.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-03T09:55:56.576 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-03T09:55:56.576 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-03T09:55:56.643 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-03T09:55:56.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-03T09:55:56.723 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-03T09:55:56.727 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-03T09:55:56.789 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-04-03T09:55:56.793 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-04-03T09:55:56.840 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-03T09:55:56.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T09:55:56.883 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-03T09:55:56.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T09:55:56.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-03T09:55:56.938 INFO:teuthology.task.internal:Transferring archived files... 2024-04-03T09:55:56.942 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/remote/smithi157 2024-04-03T09:55:56.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-03T09:55:57.029 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-03_07:59:51-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7637921/remote/smithi181 2024-04-03T09:55:57.030 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-03T09:55:57.113 INFO:teuthology.task.internal:Removing archive directory... 2024-04-03T09:55:57.113 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-03T09:55:57.117 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-03T09:55:57.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-03T09:55:57.178 INFO:teuthology.task.internal:Not uploading archives. 2024-04-03T09:55:57.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-03T09:55:57.201 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-03T09:55:57.201 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-03T09:55:57.206 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-03T20:08:43.732 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-03T20:08:43.733 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2024-04-03T20:08:43.733 DEBUG:teuthology.task.console_log:Killing console logger for smithi181 2024-04-03T20:08:43.734 DEBUG:teuthology.exit:Finished running handlers